Page tree
Skip to end of metadata
Go to start of metadata

Yardstick Test Cases

Planned

This sections lists the planned test cases.

Slogan

Domain

Jira issue link

TC Specification

OPNFV_YARDSTICK_TC001_NW PERF

Network

YARDSTICK-5 - Getting issue details... STATUS

https://docs.opnfv.org/en/stable-danube/submodules/yardstick/docs/testing/user/userguide/opnfv_yardstick_tc001.html

OPNFV_YARDSTICK_TC002_NW LATENCY

Network

YARDSTICK-7 - Getting issue details... STATUS

https://docs.opnfv.org/en/stable-danube/submodules/yardstick/docs/testing/user/userguide/opnfv_yardstick_tc002.html

OPNFV_YARDSTICK_TC003_CPU Performance

Compute

YARDSTICK-12 - Getting issue details... STATUS

 

OPNFV_YARDSTICK_TC004_Cache Performance

Compute

YARDSTICK-14 - Getting issue details... STATUS

https://docs.opnfv.org/en/stable-danube/submodules/yardstick/docs/testing/user/userguide/opnfv_yardstick_tc004.html

OPNFV_YARDSTICK_TC005_Storage Performance

Storage  YARDSTICK-34 - Getting issue details... STATUS

https://docs.opnfv.org/en/stable-danube/submodules/yardstick/docs/testing/user/userguide/opnfv_yardstick_tc005.html

OPNFV_YARDSTICK_TC006_Virtual Traffic Classifier Data Plane Throughput Benchmarking Test

vTC  YARDSTICK-35 - Getting issue details... STATUS

https://docs.opnfv.org/en/stable-danube/submodules/yardstick/docs/testing/user/userguide/opnfv_yardstick_tc006.html

OPNFV_YARDSTICK_TC007_Virtual Traffic Classifier Data Plane Throughput Benchmarking in presence of noisy neighbours Test

vTC  YARDSTICK-36 - Getting issue details... STATUS

https://docs.opnfv.org/en/stable-danube/submodules/yardstick/docs/testing/user/userguide/opnfv_yardstick_tc007.html

OPNFV_YARDSTICK_TC008_Packet loss extended test

Network  YARDSTICK-80 - Getting issue details... STATUS

https://docs.opnfv.org/en/stable-danube/submodules/yardstick/docs/testing/user/userguide/opnfv_yardstick_tc008.html

OPNFV_YARDSTICK_TC009_Packet loss

Network   YARDSTICK-87 - Getting issue details... STATUS

https://docs.opnfv.org/en/stable-danube/submodules/yardstick/docs/testing/user/userguide/opnfv_yardstick_tc009.html

OPNFV_YARDSTICK_TC010_Memory latency

Compute

YARDSTICK-94 - Getting issue details... STATUS

https://docs.opnfv.org/en/stable-danube/submodules/yardstick/docs/testing/user/userguide/opnfv_yardstick_tc010.html

OPNFV_YARDSTICK_TC011_Packet delay variation between VMs

Network

YARDSTICK-111 - Getting issue details... STATUS

https://docs.opnfv.org/en/stable-danube/submodules/yardstick/docs/testing/user/userguide/opnfv_yardstick_tc011.html

OPNFV_YARDSTICK_TC012_Memory bandwidth

Compute

YARDSTICK-113 - Getting issue details... STATUS

https://docs.opnfv.org/en/stable-danube/submodules/yardstick/docs/testing/user/userguide/opnfv_yardstick_tc012.html

OPNFV_YARDSTICK_TC013_Memory availability

Compute

YARDSTICK-114 - Getting issue details... STATUS

https://docs.opnfv.org/en/stable-danube/submodules/yardstick/docs/testing/user/userguide/opnfv_yardstick_tc044.html

OPNFV_YARDSTICK_TC014_Processing speed

Compute

YARDSTICK-116 - Getting issue details... STATUS

https://docs.opnfv.org/en/stable-danube/submodules/yardstick/docs/testing/user/userguide/opnfv_yardstick_tc014.html

OPNFV_YARDSTICK_TC015_Processor availability ?not yet implemented?

 

YARDSTICK-117 - Getting issue details... STATUS

 

OPNFV_YARDSTICK_TC016_NIC availability ?not yet implemented?

 

YARDSTICK-125 - Getting issue details... STATUS

 

OPNFV_YARDSTICK_TC017_Disk availability ?not yet implemented?

 

YARDSTICK-126 - Getting issue details... STATUS

 

OPNFV_YARDSTICK_TC018_Network timeout ?not yet implemented?

 

YARDSTICK-127 - Getting issue details... STATUS

 

OPNFV_YARDSTICK_TC019_HA: Control node - OpenStack service down

HA

YARDSTICK-135 - Getting issue details... STATUS

https://docs.opnfv.org/en/stable-danube/submodules/yardstick/docs/testing/user/userguide/opnfv_yardstick_tc019.html

OPNFV_YARDSTICK_TC020_Virtual Traffic Classifier instantiation test

vTC

YARDSTICK-145 - Getting issue details... STATUS

https://docs.opnfv.org/en/stable-danube/submodules/yardstick/docs/testing/user/userguide/opnfv_yardstick_tc020.html

OPNFV_YARDSTICK_TC021_Virtual Traffic Classifier instantiation in presence of noisy neighbors test

vTC

YARDSTICK-146 - Getting issue details... STATUS

https://docs.opnfv.org/en/stable-danube/submodules/yardstick/docs/testing/user/userguide/opnfv_yardstick_tc021.html

OPNFV_YARDSTICK_TC022_SFC: Connectivity between Controller and Compute ?not yet implemented?

 

YARDSTICK-164 - Getting issue details... STATUS

 

OPNFV_YARDSTICK_TC023 VM availability during live migration ?not yet implemented?

  YARDSTICK-174 - Getting issue details... STATUS

 

OPNFV_YARDSTICK_TC024_CPU Load

Compute

YARDSTICK-181 - Getting issue details... STATUS

https://docs.opnfv.org/en/stable-danube/submodules/yardstick/docs/testing/user/userguide/opnfv_yardstick_tc024.html

OPNFV_YARDSTICK_TC025_HA OpenStack Controll Node abnormally shutdown

HA

YARDSTICK-182 - Getting issue details... STATUS

https://docs.opnfv.org/en/stable-danube/submodules/yardstick/docs/testing/user/userguide/opnfv_yardstick_tc025.html

OPNFV_YARDSTICK_TC026_SDNVPN: VPN Connectivity ?not yet implemented?

 

YARDSTICK-185 - Getting issue details... STATUS

 

OPNFV_YARDSTICK_TC027_IPVSIX: IPv6 connectivity

Feature

YARDSTICK-187 - Getting issue details... STATUS

https://docs.opnfv.org/en/stable-danube/submodules/yardstick/docs/testing/user/userguide/opnfv_yardstick_tc027.html

OPNFV_YARDSTICK_TC028_KVM: Latency measurements with cyclictest

Feature

YARDSTICK-188 - Getting issue details... STATUS

https://docs.opnfv.org/en/stable-danube/submodules/yardstick/docs/testing/user/userguide/opnfv_yardstick_tc028.html

OPNFV_YARDSTICK_TC029_SFC: VM Creation ?not yet implemented?

 

YARDSTICK-189 - Getting issue details... STATUS

 

OPNFV_YARDSTICK_TC030_SFC: Block HTTP ?not yet implemented?

 

YARDSTICK-190 - Getting issue details... STATUS

 

OPNFV_YARDSTICK_TC031_SFC: Block SSH?not yet implemented?

 

YARDSTICK-191 - Getting issue details... STATUS

 

OPNFV_YARDSTICK_TC032_SDNVPN: Tenant separation?not yet implemented?

  YARDSTICK-192 - Getting issue details... STATUS

 

OPNFV_YARDSTICK_TC033_VNFGRAPH: Block HTTP (OpenStack Networking-SFC)?not yet implemented?

 

YARDSTICK-194 - Getting issue details... STATUS

 

OPNFV_YARDSTICK_TC034_VNFGRAPH: Block HTTP (ONOS-SFC)?not yet implemented?

 

YARDSTICK-195 - Getting issue details... STATUS

 

OPNFV_YARDSTICK_TC035_OVSNFV: Yardstick Test suite for OVSNFV

 

YARDSTICK-196 - Getting issue details... STATUS

 

OPNFV_YARDSTICK_TC036_ARMBAND: Yardstick Test suite for ARMBAND

 

YARDSTICK-197 - Getting issue details... STATUS

 

OPNFV_YARDSTICK_TC037_Measure network throughput and packet loss using pktgen and measure CPU utilization using mpstat

Network

Compute

YARDSTICK-181 - Getting issue details... STATUS

https://docs.opnfv.org/en/stable-danube/submodules/yardstick/docs/testing/user/userguide/opnfv_yardstick_tc037.html
OPNFV_YARDSTICK_TC038_Measure network throughput and packet loss using pktgen and measure CPU utilization using mpstat (Extended)

Network

Compute

YARDSTICK-181 - Getting issue details... STATUS

https://docs.opnfv.org/en/stable-danube/submodules/yardstick/docs/testing/user/userguide/opnfv_yardstick_tc038.html
OPNFV_YARDSTICK_TC040_Parser Running Parser Yang-to-Tosca module as a tool, validating output against expected outcome Feature https://docs.opnfv.org/en/stable-danube/submodules/yardstick/docs/testing/user/userguide/opnfv_yardstick_tc040.html
OPNFV_YARDSTICK_TC042_Measure network latency using testpmd and pktgen-dpdkNetwork YARDSTICK-233 - Getting issue details... STATUS https://docs.opnfv.org/en/stable-danube/submodules/yardstick/docs/testing/user/userguide/opnfv_yardstick_tc042.html
OPNFV_YARDSTICK_TC043_Measure latency between NFVI nodes using ping
Network YARDSTICK-258 - Getting issue details... STATUS https://docs.opnfv.org/en/stable-danube/submodules/yardstick/docs/testing/user/userguide/opnfv_yardstick_tc043.html
OPNFV_YARDSTICK_TC045_Control Node Openstack Service High Availability - Neutron ServerHA YARDSTICK-291 - Getting issue details... STATUS https://docs.opnfv.org/en/stable-danube/submodules/yardstick/docs/testing/user/userguide/opnfv_yardstick_tc045.html
OPNFV_YARDSTICK_TC046_Control Node Openstack Service High Availability - KeystoneHA YARDSTICK-292 - Getting issue details... STATUS https://docs.opnfv.org/en/stable-danube/submodules/yardstick/docs/testing/user/userguide/opnfv_yardstick_tc046.html
OPNFV_YARDSTICK_TC047_Control Node Openstack Service High Availability - Glance ApiHA YARDSTICK-293 - Getting issue details... STATUS https://docs.opnfv.org/en/stable-danube/submodules/yardstick/docs/testing/user/userguide/opnfv_yardstick_tc047.html
OPNFV_YARDSTICK_TC048_Control Node Openstack Service High Availability - Cinder Api HA YARDSTICK-294 - Getting issue details... STATUS https://docs.opnfv.org/en/stable-danube/submodules/yardstick/docs/testing/user/userguide/opnfv_yardstick_tc048.html
OPNFV_YARDSTICK_TC049_Control Node Openstack Service High Availability - Swift Proxy HA YARDSTICK-295 - Getting issue details... STATUS https://docs.opnfv.org/en/stable-danube/submodules/yardstick/docs/testing/user/userguide/opnfv_yardstick_tc049.html
OPNFV_YARDSTICK_TC050_OpenStack Controller Node Network High AvailabilityHA YARDSTICK-297 - Getting issue details... STATUS https://docs.opnfv.org/en/stable-danube/submodules/yardstick/docs/testing/user/userguide/opnfv_yardstick_tc050.html
OPNFV_YARDSTICK_TC051_OpenStack Controller Node CPU Overload High AvailabilityHA YARDSTICK-296 - Getting issue details... STATUS https://docs.opnfv.org/en/stable-danube/submodules/yardstick/docs/testing/user/userguide/opnfv_yardstick_tc051.html
OPNFV_YARDSTICK_TC052_OpenStack Controller Node Disk I/O Block High AvailabilityHA YARDSTICK-300 - Getting issue details... STATUS https://docs.opnfv.org/en/stable-danube/submodules/yardstick/docs/testing/user/userguide/opnfv_yardstick_tc052.html
OPNFV_YARDSTICK_TC053_OpenStack Controller Load Balance Service High AvailabilityHA YARDSTICK-301 - Getting issue details... STATUS https://docs.opnfv.org/en/stable-danube/submodules/yardstick/docs/testing/user/userguide/opnfv_yardstick_tc053.html
OPNFV_YARDSTICK_TC054_OpenStack Virtual IP High AvailabilityHA YARDSTICK-302 - Getting issue details... STATUS https://docs.opnfv.org/en/stable-danube/submodules/yardstick/docs/testing/user/userguide/opnfv_yardstick_tc054.html
OPNFV_YARDSTICK_TC055_Collect hardware specification from /proc/cpuinfo /proc/meminfoCompute YARDSTICK-704 - Getting issue details... STATUS https://docs.opnfv.org/en/stable-danube/submodules/yardstick/docs/testing/user/userguide/opnfv_yardstick_tc055.html
OPNFV_YARDSTICK_TC056_Controller node Messaging Queue Service High AvailabilityHA YARDSTICK-778 - Getting issue details... STATUS https://docs.opnfv.org/en/stable-danube/submodules/yardstick/docs/testing/user/userguide/opnfv_yardstick_tc056.html
OPNFV_YARDSTICK_TC057_Controller node Cluster Management Service High AvailabilityHA YARDSTICK-779 - Getting issue details... STATUS https://docs.opnfv.org/en/stable-danube/submodules/yardstick/docs/testing/user/userguide/opnfv_yardstick_tc057.html
OPNFV_YARDSTICK_TC058_Controller node Virtual Router Service HighAvailability.HA YARDSTICK-780 - Getting issue details... STATUS https://docs.opnfv.org/en/stable-danube/submodules/yardstick/docs/testing/user/userguide/opnfv_yardstick_tc058.html
OPNFV_YARDSTICK_TC061_Network UtilizationNetwork YARDSTICK-283 - Getting issue details... STATUS https://docs.opnfv.org/en/stable-danube/submodules/yardstick/docs/testing/user/userguide/opnfv_yardstick_tc061.html
OPNFV_YARDSTICK_TC063_Measure disk size, block size and disk utilization using fdisk and iostatStorage YARDSTICK-705 - Getting issue details... STATUS https://docs.opnfv.org/en/stable-danube/submodules/yardstick/docs/testing/user/userguide/opnfv_yardstick_tc063.html
OPNFV_YARDSTICK_TC069_Measure memory read and write bandwidth using ramspeedCompute YARDSTICK-255 - Getting issue details... STATUS https://docs.opnfv.org/en/stable-danube/submodules/yardstick/docs/testing/user/userguide/opnfv_yardstick_tc069.html
OPNFV_YARDSTICK_TC070_Measure memory utilization, network throughput and packet loss using pktgen

Network

Compute
YARDSTICK-259 - Getting issue details... STATUS https://docs.opnfv.org/en/stable-danube/submodules/yardstick/docs/testing/user/userguide/opnfv_yardstick_tc070.html
OPNFV_YARDSTICK_TC071_Measure cache hit/miss ratio and usage, network throughput and latency

Network

Compute
YARDSTICK-267 - Getting issue details... STATUS https://docs.opnfv.org/en/stable-danube/submodules/yardstick/docs/testing/user/userguide/opnfv_yardstick_tc071.html
OPNFV_YARDSTICK_TC072_Measure network utilization,network throughput and packet loss using pktgenNetwork YARDSTICK-706 - Getting issue details... STATUS https://docs.opnfv.org/en/stable-danube/submodules/yardstick/docs/testing/user/userguide/opnfv_yardstick_tc072.html
OPNFV_YARDSTICK_TC073_Measure network latency and throughput using netperfNetwork YARDSTICK-707 - Getting issue details... STATUS https://docs.opnfv.org/en/stable-danube/submodules/yardstick/docs/testing/user/userguide/opnfv_yardstick_tc073.html
OPNFV_YARDSTICK_TC074_StorPerf integrationStorage YARDSTICK-253 - Getting issue details... STATUS https://docs.opnfv.org/en/stable-danube/submodules/yardstick/docs/testing/user/userguide/opnfv_yardstick_tc074.html
OPNFV_YARDSTICK_TC075_Measure network capacity and scaleNetwork YARDSTICK-283 - Getting issue details... STATUS https://docs.opnfv.org/en/stable-danube/submodules/yardstick/docs/testing/user/userguide/opnfv_yardstick_tc075.html
OPNFV_YARDSTICK_TC076_Monitor_Network_MetricsNetwork YARDSTICK-534 - Getting issue details... STATUS https://docs.opnfv.org/en/stable-danube/submodules/yardstick/docs/testing/user/userguide/opnfv_yardstick_tc076.html
OPNFV_YARDSTICK_TC077_Measure_Packet_extended_lossNetwork YARDSTICK-614 - Getting issue details... STATUS http://docs.opnfv.org/en/stable-euphrates/submodules/yardstick/docs/testing/user/userguide/opnfv_yardstick_tc077.html
OPNFV_YARDSTICK_TC078_Measure_CPU_using_CPU2006Compute YARDSTICK-764 - Getting issue details... STATUS http://docs.opnfv.org/en/stable-euphrates/submodules/yardstick/docs/testing/user/userguide/opnfv_yardstick_tc078.html
OPNFV_YARDSTICK_TC079_Measure_storage_file_system_performance_using_Bonnie++Storage YARDSTICK-770 - Getting issue details... STATUS http://docs.opnfv.org/en/stable-euphrates/submodules/yardstick/docs/testing/user/userguide/opnfv_yardstick_tc079.html
OPNFV_YARDSTICK_TC080_Measure_network_latency_between_containers_in_k8sNetwork YARDSTICK-682 - Getting issue details... STATUS

http://docs.opnfv.org/en/stable-euphrates/submodules/yardstick/docs/testing/user/userguide/opnfv_yardstick_tc080.html

OPNFV_YARDSTICK_TC081_Measure_network_latency_beween_container_and_VMNetwork YARDSTICK-825 - Getting issue details... STATUS http://docs.opnfv.org/en/stable-euphrates/submodules/yardstick/docs/testing/user/userguide/opnfv_yardstick_tc081.html
OPNFV_YARDSTICK_TC082_Measure_various_software_perf_events_using_perfCompute YARDSTICK-794 - Getting issue details... STATUS http://docs.opnfv.org/en/stable-euphrates/submodules/yardstick/docs/testing/user/userguide/opnfv_yardstick_tc082.html
OPNFV_YARDSTICK_TC083_Measure_network_latency_and_throughput_using_netperfNetwork YARDSTICK-792 - Getting issue details... STATUS http://docs.opnfv.org/en/stable-euphrates/submodules/yardstick/docs/testing/user/userguide/opnfv_yardstick_tc083.html
OPNFV_YARDSTICK_TC084_Measure_CPU_performance_in_VM_using_CPU2006Compute YARDSTICK-906 - Getting issue details... STATUS http://docs.opnfv.org/en/stable-euphrates/submodules/yardstick/docs/testing/user/userguide/opnfv_yardstick_tc084.html
OPNFV_YARDSTICK_TC085: HA on VMHA
YARDSTICK-956 - Getting issue details... STATUS
 
OPNFV_YARDSTICK_TC086: HA on HypervisorHA YARDSTICK-957 - Getting issue details... STATUS  
OPNFV_YARDSTICK_TC087: SDN controller resilience in non-HA configurationHA YARDSTICK-986 - Getting issue details... STATUS  
OPNFV_YARDSTICK_TC088_Control Node Openstack Service High Availability - Nova SchedulerHA YARDSTICK-958 - Getting issue details... STATUS  
OPNFV_YARDSTICK_TC089_Control Node Openstack Service High Availability - Nova ConductorHA YARDSTICK-959 - Getting issue details... STATUS  
OPNFV_YARDSTICK_TC090_Control Node Openstack Service High Availability - Database InstancesHA YARDSTICK-960 - Getting issue details... STATUS  
OPNFV_YARDSTICK_TC091_Control Node Openstack Service High Availability - Heat ApiHA YARDSTICK-961 - Getting issue details... STATUS  
OPNFV_YARDSTICK_TC092_SDN controller resilience in HA configurationHA YARDSTICK-987 - Getting issue details... STATUS  
OPNFV_YARDSTICK_TC093_SDN vswitch resilienceHA YARDSTICK-988 - Getting issue details... STATUS  

Proposed

This section collects ideas/requests for test cases to be developed by Yardstick Project.
The prioritization will be decided in the weekly meeting.
Add your suggestions to the comments.

 

 

  • No labels

3 Comments

  1. Ross Brattain Kubi I guess this page is outdated...can we remove it or update it?

    1. Yes, thanks for your reminder, I will update it soon.

  2. Qiao Fu , thanks for adding new test cases(TC 085 and 086) into Yardstick, I 'm not sure if you already create related JIRA tickets,  if not, please feel free to create them in JIRA and feed back at the third column, thanks a lot.