VSwitchPerf Release Plan

This Page will maintain the release plans for VSPERF


Kali Release Plan

Feature DetailsJIRA IDContactStatus

VSPERF-Openstack

Intel Pod10/15/18

(a) Add More Testcases

(b) Add TRex Support.

(c) Multi-Dimensional TestVNF Support




Kubernetes CNB - Phase2

Intel Pod12

(a) Multiple Pods.

(b) Multiple Hosts

(c) Containerizing vswitch

(d) Containerized TGens

(e) DanM

(f) DPDK Version has any performance impact?

(g) Different eBPF/Cilium Plugin?

(h) Memif interface



Phase-1:

K8S Cluster Deployment.

Plugins: Multus - OVSDPDK, VPP and SRIOV.

Pod: DPDK+L2/L3 FWD.

VSPERF-Xtesting Integration

(a) More testcases

(b) Run in Pod12.

(c) K8S




Improve TRex Integration - Better Data analysis


VSPERF GUI






Jerma Release Plan

Jerma release will include CN-Benchmarking, Container Metrics and Enhanced analytics features as the main outcomes.


Feature DetailsJIRA IDContactStatus

Integration with X-Testing  

Outcome of VSPERF-594 and VSPERF-595

VSPERF-604


Container Networking Benchmarking - Setup AutomationVSPERF-607Emanuele Urselli, Parth Yadav
Container Networking Benchmarking - TestingVSPERF-608
Container Metrics - agent and visualization

Enhanced Analytics.

Live-Results from Ixia TGen
Ancuta Enache
Enhanced Results Container and VM

TST-009 Testcases

VSPERF-583


VSPERF With OpenstackVSPERF-619

Iruya Release Plan

Iruya release will include Containerization of VSPERF and Newer software versions as the main outcomes.


Feature DetailsJIRA IDContactStatus
VSPERF ContainerVSPERF-594

Results Container

All 5 - Infrastructure, End-Of-Test-Results, Live-Results, Events from VSPERF/Sw-Tools, Environment details

VSPERF-595

Usability : Configuration wizard ( CLI)

VSPERF-543

VSPERF Upgrades - PythonVSPERF-605

VSPERF Upgrades - OVS, DPDK and VPPVSPERF-606

Hunter Release Plan


Feature DetailsJIRA IDContactStatus
Live Results: Spirent, T-RexVSPERF-524

Testcase: Imix (Spirent) SupportVSPERF-521

Test Case: OVS-Conntrack rules impact analysis.

VSPERF-545

IMIX Support : Xena Traffic GeneratorVSPERF-596

Advanced L3-Cache management - Intel RMD

VSPERF-584

VSPERF-585

Testcase: Cross-Numa Performance BenchmarkingVSPERF-597

Logstash/Fluentd Writer

Related to Results Container (VSPERF-595)

VSPERF-586


Resolve CI Issues

Experience VSPERF on Virtualbox

Gambia Release Plan


Feature DetailsJIRA IDContactStatus

Comparative Studies: CSIT, NFVBench, Yardstick, Bottlenecks


VSPERF-540,

VSPERF-541

Initiated: Trevor Cooper

Responsibility:  Sridhar Rao 

Mars Toktonaliev

Results Improvement : Latency Histogram (Spirent)

VSPERF-522

VSPERF-Xena Enhancements

VSPERF-575

VSPERF-582

VSPERF-OVS Enhancements

VSPERF-580

VSPERF-577

VSPERF-578

VSPERF-581

VSPERF-570

VSPERF-VPP Enhancements


VSPERF-VSWITCH Architecture EnhancementVSPERF-579

TREX Enhancements: Burst traffic type, Scapy Frame Definition, Customized Scapy Version,

VSPERF-562 VSPERF-565, VSPERF-566,

Testcase: Continuous StreamVSPERF-568@Julien Meunier

Tools Enhancement: Pidstat

VSPERF-569@Julien Meunier

Testcase: Custom StatisticsVSPERF-572

Ixia Script enhancementsVSPERF-149

Tunneling protocol supportVSPERF-573

Testplans for Benchmarking vSwitch in Containerized Environments

Stability Improvements
Multiple

Xena - Benchmarking with Multi-flows
Bob Fubel

Fraser Plan.

Feature DetailsJIRA IDContactStatus
Tool Support: Integration of Collectd as Monitoring toolVSPERF-505
Tool Support: Integration of RDT Cache Management tool to improve vSwitch performance under NN-conditions.VSPERF-544

Initiated: Trevor Cooper

Responsibility:  Sridhar Rao 

Tool Support: VMs (Stress-NG and Spirent Cloudstress) as Load-generatorsVSPERF-504

Test Case: Noisy Neighbor TestVSPERF-523

Unassigned

 Sridhar Rao 

Test Case: regression tests cases DPDK, OVSVSPERF-539
Test Case: OVS-Conntrack rules impact analysis.VSPERF-545
Standardization Support: Back-to-Back Frame Testing - IETF.VSPERF-549

Initiated: Al Morton 

Standardization Support: ETSI NFV TST009VSPERF-552
T-Rex Support Improvement

VSPERF-546

VSPERF-547

VSPERF-559

Additional improvementsVSPERF-548

Miscelleneous:

Expand requirements of Soak/Long Duration Tests

Updated build scripts for Centos and RHEL to python34

VSPERF-557

VSPERF-558

Testcases: T-Rex as VMVSPERF-560

Fraser Deadlines

Danube

Deliverables: VSPERF Release D JIRA Issues


Project plan per the milestones described at Danube.

Milestone
Status/Plan
Notes
(MS0) Open Intent to ParticipateDone
(MS1) Planning complete (scenarios or deliverables defined)10/25/16
(MS2) Detailed test case descriptions communicated to test project teams11/22/16
(MS3) Installer integration with OpenStack completed11/30/16
(MS4) Infrastructure updates completed12/6/16
(MS5) Scenario integration and Feature Freeze completed1/13/17
(MS6) Test cases implemented, preliminary documentation completed, and stable branch open1/26/17
(MS7) Stable branch window close3/10/17
(MS8) Formal test execution completed3/20/17
(MS9) JIRA issues assigned to release closed or deferred3/22/17
(MS10) Documentation completed3/24/17
(MS11) Release Danube 1.0
3/27/17
(MS12) Release Danube 2.0
5/4/17
(MS13) Release Danube 3.06/8/17



Rel C VSPERF Sprint and Backlog

ReleaseFeature Detail

Jira Number

Rel CIntegration with YardstickVSPERF -276
Rel CMoving to SW Traffic Generator (MoonGen)VSPERF - 277
Rel C

Installer Integration extension of capabilities (Fuel)

VSPERF- 278
Rel CIntegration with Functest results API onlyVSPERF - 279
Rel CInstaller Integration extension of capabilities (Apex)VSPERF -280


Project Dependencies 

Project Timeline (these dates are tentative)

Upstream Dependencies  

Release B VSPERF Scrum Board and backlog

Release

Plan

Slides

Rel B

vsperf_rel_b_highlevel_plan.xlsx

opnfv_vsperf_brahmaputra_releaseplanning.pptx

Brahmaputra Release

Goals

Our goals for the VSPERF test framework this release are:

Stretch Goal:

Timeline

JIRA

https://jira.opnfv.org/browse/VSPERF-75

Make sure stories reference this Epic and have the VSPERF and R2 Label

Sprints

Active Sprint

Sprint Backlog

Interaction with other OPNFV projects

We would like to collaborate with Yardstick on their vswitch performance tests and the OPNFV dashboard for Release B.