Page tree
Skip to end of metadata
Go to start of metadata

VSwitchPerf Release Plan

This Page will maintain the release plans for VSPERF


Kali Release Plan

Feature DetailsJIRA IDContactStatus

VSPERF-Openstack

Intel Pod10/15/18

(a) Add More Testcases

(b) Add TRex Support.

(c) Multi-Dimensional TestVNF Support




Kubernetes CNB - Phase2

Intel Pod12

(a) Multiple Pods.

(b) Multiple Hosts

(c) Containerizing vswitch

(d) Containerized TGens

(e) DanM

(f) DPDK Version has any performance impact?

(g) Different eBPF/Cilium Plugin?

(h) Memif interface



Phase-1:

K8S Cluster Deployment.

Plugins: Multus - OVSDPDK, VPP and SRIOV.

Pod: DPDK+L2/L3 FWD.

VSPERF-Xtesting Integration

(a) More testcases

(b) Run in Pod12.

(c) K8S




Improve TRex Integration - Better Data analysis


VSPERF GUI






Jerma Release Plan

Jerma release will include CN-Benchmarking, Container Metrics and Enhanced analytics features as the main outcomes.


Feature DetailsJIRA IDContactStatus

Integration with X-Testing  

Outcome of VSPERF-594 and VSPERF-595

VSPERF-604


Container Networking Benchmarking - Setup AutomationVSPERF-607Emanuele Urselli, Parth Yadav
Container Networking Benchmarking - TestingVSPERF-608
Container Metrics - agent and visualization

Enhanced Analytics.

Live-Results from Ixia TGen
Ancuta Enache
Enhanced Results Container and VM

TST-009 Testcases

VSPERF-583


VSPERF With OpenstackVSPERF-619

Iruya Release Plan

Iruya release will include Containerization of VSPERF and Newer software versions as the main outcomes.


Feature DetailsJIRA IDContactStatus
VSPERF ContainerVSPERF-594

COMPLETED

Results Container

All 5 - Infrastructure, End-Of-Test-Results, Live-Results, Events from VSPERF/Sw-Tools, Environment details

VSPERF-595

COMPLETED

Usability : Configuration wizard ( CLI)

VSPERF-543

COMPLETED

VSPERF Upgrades - PythonVSPERF-605

COMPLETED

VSPERF Upgrades - OVS, DPDK and VPPVSPERF-606

COMPLETED

Hunter Release Plan


Feature DetailsJIRA IDContactStatus
Live Results: Spirent, T-RexVSPERF-524

COMPLETED

Testcase: Imix (Spirent) SupportVSPERF-521

COMPLETED

Test Case: OVS-Conntrack rules impact analysis.

VSPERF-545

POSTPONED

IMIX Support : Xena Traffic GeneratorVSPERF-596

POSTPONED

Advanced L3-Cache management - Intel RMD

VSPERF-584

VSPERF-585

POSTPONED

Testcase: Cross-Numa Performance BenchmarkingVSPERF-597

COMPLETED

Logstash/Fluentd Writer

Related to Results Container (VSPERF-595)

VSPERF-586


COMPLETED

Resolve CI Issues

COMPLETED

Experience VSPERF on Virtualbox

COMPLETED

Gambia Release Plan


Feature DetailsJIRA IDContactStatus

Comparative Studies: CSIT, NFVBench, Yardstick, Bottlenecks


VSPERF-540,

VSPERF-541

Initiated: Trevor Cooper

Responsibility:  Sridhar Rao 

Mars Toktonaliev

COMPLETED

Results Improvement : Latency Histogram (Spirent)

VSPERF-522

COMPLETED

VSPERF-Xena Enhancements

VSPERF-575

VSPERF-582

COMPLETED

COMPLETED

VSPERF-OVS Enhancements

VSPERF-580

VSPERF-577

VSPERF-578

VSPERF-581

VSPERF-570

COMPLETED

COMPLETED

COMPLETED

COMPLETED

COMPLETED

VSPERF-VPP Enhancements


VSPERF-VSWITCH Architecture EnhancementVSPERF-579

COMPLETED

TREX Enhancements: Burst traffic type, Scapy Frame Definition, Customized Scapy Version,

VSPERF-562 VSPERF-565, VSPERF-566,

COMPLETED

Testcase: Continuous StreamVSPERF-568@Julien Meunier

COMPLETED

Tools Enhancement: Pidstat

VSPERF-569@Julien Meunier

COMPLETED

Testcase: Custom StatisticsVSPERF-572

COMPLETED

Ixia Script enhancementsVSPERF-149

COMPLETED

Tunneling protocol supportVSPERF-573

COMPLETED

Testplans for Benchmarking vSwitch in Containerized Environments

COMPLETED

Stability Improvements
Multiple

COMPLETED

Xena - Benchmarking with Multi-flows
Bob Fubel

COMPLETED

Fraser Plan.

Feature DetailsJIRA IDContactStatus
Tool Support: Integration of Collectd as Monitoring toolVSPERF-505
COMPLETED
Tool Support: Integration of RDT Cache Management tool to improve vSwitch performance under NN-conditions.VSPERF-544

Initiated: Trevor Cooper

Responsibility:  Sridhar Rao 

COMPLETED
Tool Support: VMs (Stress-NG and Spirent Cloudstress) as Load-generatorsVSPERF-504

COMPLETED

Test Case: Noisy Neighbor TestVSPERF-523

Unassigned

 Sridhar Rao 

COMPLETED
Test Case: regression tests cases DPDK, OVSVSPERF-539
COMPLETED
Test Case: OVS-Conntrack rules impact analysis.VSPERF-545
IN PROGRESS
Standardization Support: Back-to-Back Frame Testing - IETF.VSPERF-549

Initiated: Al Morton 

IN PROGRESS
Standardization Support: ETSI NFV TST009VSPERF-552
IN PROGRESS
T-Rex Support Improvement

VSPERF-546

VSPERF-547

VSPERF-559

COMPLETED

Additional improvementsVSPERF-548

COMPLETED

Miscelleneous:

Expand requirements of Soak/Long Duration Tests

Updated build scripts for Centos and RHEL to python34

VSPERF-557

VSPERF-558

COMPLETED

Testcases: T-Rex as VMVSPERF-560

COMPLETED

Fraser Deadlines

Danube

Deliverables: VSPERF Release D JIRA Issues


Project plan per the milestones described at Danube.

Milestone
Status/Plan
Notes
(MS0) Open Intent to ParticipateDone
(MS1) Planning complete (scenarios or deliverables defined)10/25/16
(MS2) Detailed test case descriptions communicated to test project teams11/22/16
(MS3) Installer integration with OpenStack completed11/30/16
(MS4) Infrastructure updates completed12/6/16
(MS5) Scenario integration and Feature Freeze completed1/13/17
(MS6) Test cases implemented, preliminary documentation completed, and stable branch open1/26/17
(MS7) Stable branch window close3/10/17
(MS8) Formal test execution completed3/20/17
(MS9) JIRA issues assigned to release closed or deferred3/22/17
(MS10) Documentation completed3/24/17
(MS11) Release Danube 1.0
3/27/17
(MS12) Release Danube 2.0
5/4/17
(MS13) Release Danube 3.06/8/17



Rel C VSPERF Sprint and Backlog

ReleaseFeature Detail

Jira Number

Rel CIntegration with YardstickVSPERF -276
Rel CMoving to SW Traffic Generator (MoonGen)VSPERF - 277
Rel C

Installer Integration extension of capabilities (Fuel)

VSPERF- 278
Rel CIntegration with Functest results API onlyVSPERF - 279
Rel CInstaller Integration extension of capabilities (Apex)VSPERF -280


Project Dependencies 

  • Moongen for SW Traffic Generator (JIRA VSPERF-168)
  • Yardstick integration (JIRA Yardstick -109)
  • Fuel 9 plugin (needs to be updated) and any other requirements that are needed to run under yardstick
  • POD 3 ( two new servers that will be setup as sandbox and CI needs to migrated to existing servers) (JIRA Pharos- 129)

Project Timeline (these dates are tentative)

  • Feature Code Freeze Mid June 
  • Test Code Freeze July 
  • Integration Ready August

Upstream Dependencies  

Release B VSPERF Scrum Board and backlog

Brahmaputra Release

Goals

Our goals for the VSPERF test framework this release are:

  • Support our 3 base deployment scenarios: P2P, PVP and PVVP
  • CI Support and integration for VSPERF
  • Support Vanilla OVS and OVS with DPDK.
  • Support all RFC2544 defined tests.
  • Support IMIX traffic testing with RFC 2544.
  • Support IXIA, Spirent, Moongen and Xena.
  • Participate in opnfv_test_dashboard

Stretch Goal:

  • Support IP routing on the switch, as well as simple port forwarding
  • RFC2544 Scalability tests (Implementation)
  • LTD.Throughput.RFC2544.Profile (Implementation)
  • LTD.Throughput.RFC2544.SystemRecoveryTime (Implementation)

Timeline

JIRA

https://jira.opnfv.org/browse/VSPERF-75

Make sure stories reference this Epic and have the VSPERF and R2 Label

Sprints

Active Sprint

Sprint Backlog

Interaction with other OPNFV projects

We would like to collaborate with Yardstick on their vswitch performance tests and the OPNFV dashboard for Release B.


  • No labels