Page tree

Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

Yardstick Test Cases

Planned

This sections lists the planned test cases.

Slogan

Domain

Jira issue link

TC Specification

OPNFV_YARDSTICK_TC001_NW PERF

Network

JIRA
serverOPNFV JIRA
serverId96acfcf2-db1a-3859-891e-03a53e9315b0
keyYARDSTICK-5

https://docs.opnfv.org/en/stable-danube/submodules/yardstick/docs/testing/user/userguide/opnfv_yardstick_tc001.html

OPNFV_YARDSTICK_TC002_NW LATENCY

Network

JIRA
serverOPNFV JIRA
serverId96acfcf2-db1a-3859-891e-03a53e9315b0
keyYARDSTICK-7

https://docs.opnfv.org/en/stable-danube/submodules/yardstick/docs/testing/user/userguide/opnfv_yardstick_tc002.html

OPNFV_YARDSTICK_TC003_CPU Performance

Compute

JIRA
serverOPNFV JIRA
serverId96acfcf2-db1a-3859-891e-03a53e9315b0
keyYARDSTICK-12

 

OPNFV_YARDSTICK_TC004_Cache Performance

Compute

JIRA
serverOPNFV JIRA
serverId96acfcf2-db1a-3859-891e-03a53e9315b0
keyYARDSTICK-14

https://docs.opnfv.org/en/stable-danube/submodules/yardstick/docs/testing/user/userguide/opnfv_yardstick_tc004.html

OPNFV_YARDSTICK_TC005_Storage Performance

Storage 
JIRA
serverOPNFV JIRA
serverId96acfcf2-db1a-3859-891e-03a53e9315b0
keyYARDSTICK-34

https://docs.opnfv.org/en/stable-danube/submodules/yardstick/docs/testing/user/userguide/opnfv_yardstick_tc005.html

OPNFV_YARDSTICK_TC006_Virtual Traffic Classifier Data Plane Throughput Benchmarking Test

vTC 
JIRA
serverOPNFV JIRA
serverId96acfcf2-db1a-3859-891e-03a53e9315b0
keyYARDSTICK-35

https://docs.opnfv.org/en/stable-danube/submodules/yardstick/docs/testing/user/userguide/opnfv_yardstick_tc006.html

OPNFV_YARDSTICK_TC007_Virtual Traffic Classifier Data Plane Throughput Benchmarking in presence of noisy neighbours Test

vTC 
JIRA
serverOPNFV JIRA
serverId96acfcf2-db1a-3859-891e-03a53e9315b0
keyYARDSTICK-36

https://docs.opnfv.org/en/stable-danube/submodules/yardstick/docs/testing/user/userguide/opnfv_yardstick_tc007.html

OPNFV_YARDSTICK_TC008_Packet loss extended test

Network 
JIRA
serverOPNFV JIRA
serverId96acfcf2-db1a-3859-891e-03a53e9315b0
keyYARDSTICK-80

https://docs.opnfv.org/en/stable-danube/submodules/yardstick/docs/testing/user/userguide/opnfv_yardstick_tc008.html

OPNFV_YARDSTICK_TC009_Packet loss

Network  
JIRA
serverOPNFV JIRA
serverId96acfcf2-db1a-3859-891e-03a53e9315b0
keyYARDSTICK-87

https://docs.opnfv.org/en/stable-danube/submodules/yardstick/docs/testing/user/userguide/opnfv_yardstick_tc009.html

OPNFV_YARDSTICK_TC010_Memory latency

Compute

JIRA
serverOPNFV JIRA
serverId96acfcf2-db1a-3859-891e-03a53e9315b0
keyYARDSTICK-94

https://docs.opnfv.org/en/stable-danube/submodules/yardstick/docs/testing/user/userguide/opnfv_yardstick_tc010.html

OPNFV_YARDSTICK_TC011_Packet delay variation between VMs

Network

JIRA
serverOPNFV JIRA
serverId96acfcf2-db1a-3859-891e-03a53e9315b0
keyYARDSTICK-111

https://docs.opnfv.org/en/stable-danube/submodules/yardstick/docs/testing/user/userguide/opnfv_yardstick_tc011.html

OPNFV_YARDSTICK_TC012_Memory bandwidth

Compute

JIRA
serverOPNFV JIRA
serverId96acfcf2-db1a-3859-891e-03a53e9315b0
keyYARDSTICK-113

https://docs.opnfv.org/en/stable-danube/submodules/yardstick/docs/testing/user/userguide/opnfv_yardstick_tc012.html

OPNFV_YARDSTICK_TC013_Memory availability

Compute

JIRA
serverOPNFV JIRA
serverId96acfcf2-db1a-3859-891e-03a53e9315b0
keyYARDSTICK-114

https://docs.opnfv.org/en/stable-danube/submodules/yardstick/docs/testing/user/userguide/opnfv_yardstick_tc044.html

OPNFV_YARDSTICK_TC014_Processing speed

Compute

JIRA
serverOPNFV JIRA
serverId96acfcf2-db1a-3859-891e-03a53e9315b0
keyYARDSTICK-116

https://docs.opnfv.org/en/stable-danube/submodules/yardstick/docs/testing/user/userguide/opnfv_yardstick_tc014.html

OPNFV_YARDSTICK_TC015_Processor availability ?not yet implemented?

 

JIRA
serverOPNFV JIRA
serverId96acfcf2-db1a-3859-891e-03a53e9315b0
keyYARDSTICK-117

 

OPNFV_YARDSTICK_TC016_NIC availability ?not yet implemented?

 

JIRA
serverOPNFV JIRA
serverId96acfcf2-db1a-3859-891e-03a53e9315b0
keyYARDSTICK-125

 

OPNFV_YARDSTICK_TC017_Disk availability ?not yet implemented?

 

JIRA
serverOPNFV JIRA
serverId96acfcf2-db1a-3859-891e-03a53e9315b0
keyYARDSTICK-126

 

OPNFV_YARDSTICK_TC018_Network timeout ?not yet implemented?

 

JIRA
serverOPNFV JIRA
serverId96acfcf2-db1a-3859-891e-03a53e9315b0
keyYARDSTICK-127

 

OPNFV_YARDSTICK_TC019_HA: Control node - OpenStack service down

HA

JIRA
serverOPNFV JIRA
serverId96acfcf2-db1a-3859-891e-03a53e9315b0
keyYARDSTICK-135

https://docs.opnfv.org/en/stable-danube/submodules/yardstick/docs/testing/user/userguide/opnfv_yardstick_tc019.html

OPNFV_YARDSTICK_TC020_Virtual Traffic Classifier instantiation test

vTC

JIRA
serverOPNFV JIRA
serverId96acfcf2-db1a-3859-891e-03a53e9315b0
keyYARDSTICK-145

https://docs.opnfv.org/en/stable-danube/submodules/yardstick/docs/testing/user/userguide/opnfv_yardstick_tc020.html

OPNFV_YARDSTICK_TC021_Virtual Traffic Classifier instantiation in presence of noisy neighbors test

vTC

JIRA
serverOPNFV JIRA
serverId96acfcf2-db1a-3859-891e-03a53e9315b0
keyYARDSTICK-146

https://docs.opnfv.org/en/stable-danube/submodules/yardstick/docs/testing/user/userguide/opnfv_yardstick_tc021.html

OPNFV_YARDSTICK_TC022_SFC: Connectivity between Controller and Compute ?not yet implemented?

 

JIRA
serverOPNFV JIRA
serverId96acfcf2-db1a-3859-891e-03a53e9315b0
keyYARDSTICK-164

 

OPNFV_YARDSTICK_TC023 VM availability during live migration ?not yet implemented?

 
JIRA
serverOPNFV JIRA
serverId96acfcf2-db1a-3859-891e-03a53e9315b0
keyYARDSTICK-174

 

OPNFV_YARDSTICK_TC024_CPU Load

Compute

JIRA
serverOPNFV JIRA
serverId96acfcf2-db1a-3859-891e-03a53e9315b0
keyYARDSTICK-181

https://docs.opnfv.org/en/stable-danube/submodules/yardstick/docs/testing/user/userguide/opnfv_yardstick_tc024.html

OPNFV_YARDSTICK_TC025_HA OpenStack Controll Node abnormally shutdown

HA

JIRA
serverOPNFV JIRA
serverId96acfcf2-db1a-3859-891e-03a53e9315b0
keyYARDSTICK-182

https://docs.opnfv.org/en/stable-danube/submodules/yardstick/docs/testing/user/userguide/opnfv_yardstick_tc025.html

OPNFV_YARDSTICK_TC026_SDNVPN: VPN Connectivity ?not yet implemented?

 

JIRA
serverOPNFV JIRA
serverId96acfcf2-db1a-3859-891e-03a53e9315b0
keyYARDSTICK-185

 

OPNFV_YARDSTICK_TC027_IPVSIX: IPv6 connectivity

Feature

JIRA
serverOPNFV JIRA
serverId96acfcf2-db1a-3859-891e-03a53e9315b0
keyYARDSTICK-187

https://docs.opnfv.org/en/stable-danube/submodules/yardstick/docs/testing/user/userguide/opnfv_yardstick_tc027.html

OPNFV_YARDSTICK_TC028_KVM: Latency measurements with cyclictest

Feature

JIRA
serverOPNFV JIRA
serverId96acfcf2-db1a-3859-891e-03a53e9315b0
keyYARDSTICK-188

https://docs.opnfv.org/en/stable-danube/submodules/yardstick/docs/testing/user/userguide/opnfv_yardstick_tc028.html

OPNFV_YARDSTICK_TC029_SFC: VM Creation ?not yet implemented?

 

JIRA
serverOPNFV JIRA
serverId96acfcf2-db1a-3859-891e-03a53e9315b0
keyYARDSTICK-189

 

OPNFV_YARDSTICK_TC030_SFC: Block HTTP ?not yet implemented?

 

JIRA
serverOPNFV JIRA
serverId96acfcf2-db1a-3859-891e-03a53e9315b0
keyYARDSTICK-190

 

OPNFV_YARDSTICK_TC031_SFC: Block SSH?not yet implemented?

 

JIRA
serverOPNFV JIRA
serverId96acfcf2-db1a-3859-891e-03a53e9315b0
keyYARDSTICK-191

 

OPNFV_YARDSTICK_TC032_SDNVPN: Tenant separation?not yet implemented?

 
JIRA
serverOPNFV JIRA
serverId96acfcf2-db1a-3859-891e-03a53e9315b0
keyYARDSTICK-192

 

OPNFV_YARDSTICK_TC033_VNFGRAPH: Block HTTP (OpenStack Networking-SFC)?not yet implemented?

 

JIRA
serverOPNFV JIRA
serverId96acfcf2-db1a-3859-891e-03a53e9315b0
keyYARDSTICK-194

 

OPNFV_YARDSTICK_TC034_VNFGRAPH: Block HTTP (ONOS-SFC)?not yet implemented?

 

JIRA
serverOPNFV JIRA
serverId96acfcf2-db1a-3859-891e-03a53e9315b0
keyYARDSTICK-195

 

OPNFV_YARDSTICK_TC035_OVSNFV: Yardstick Test suite for OVSNFV

 

JIRA
serverOPNFV JIRA
serverId96acfcf2-db1a-3859-891e-03a53e9315b0
keyYARDSTICK-196

 

OPNFV_YARDSTICK_TC036_ARMBAND: Yardstick Test suite for ARMBAND

 

JIRA
serverOPNFV JIRA
serverId96acfcf2-db1a-3859-891e-03a53e9315b0
keyYARDSTICK-197

 

OPNFV_YARDSTICK_TC037_Measure network throughput and packet loss using pktgen and measure CPU utilization using mpstat

Network

Compute

JIRA
serverOPNFV JIRA
serverId96acfcf2-db1a-3859-891e-03a53e9315b0
keyYARDSTICK-181

https://docs.opnfv.org/en/stable-danube/submodules/yardstick/docs/testing/user/userguide/opnfv_yardstick_tc037.html
OPNFV_YARDSTICK_TC038_Measure network throughput and packet loss using pktgen and measure CPU utilization using mpstat (Extended)

Network

Compute

JIRA
serverOPNFV JIRA
serverId96acfcf2-db1a-3859-891e-03a53e9315b0
keyYARDSTICK-181

https://docs.opnfv.org/en/stable-danube/submodules/yardstick/docs/testing/user/userguide/opnfv_yardstick_tc038.html
OPNFV_YARDSTICK_TC040_Parser Running Parser Yang-to-Tosca module as a tool, validating output against expected outcome Feature https://docs.opnfv.org/en/stable-danube/submodules/yardstick/docs/testing/user/userguide/opnfv_yardstick_tc040.html
OPNFV_YARDSTICK_TC042_Measure network latency using testpmd and pktgen-dpdkNetwork
JIRA
serverOPNFV JIRA
serverId96acfcf2-db1a-3859-891e-03a53e9315b0
keyYARDSTICK-233
https://docs.opnfv.org/en/stable-danube/submodules/yardstick/docs/testing/user/userguide/opnfv_yardstick_tc042.html
OPNFV_YARDSTICK_TC043_Measure latency between NFVI nodes using ping
Network
JIRA
serverOPNFV JIRA
serverId96acfcf2-db1a-3859-891e-03a53e9315b0
keyYARDSTICK-258
https://docs.opnfv.org/en/stable-danube/submodules/yardstick/docs/testing/user/userguide/opnfv_yardstick_tc043.html
OPNFV_YARDSTICK_TC045_Control Node Openstack Service High Availability - Neutron ServerHA
JIRA
serverOPNFV JIRA
serverId96acfcf2-db1a-3859-891e-03a53e9315b0
keyYARDSTICK-291
https://docs.opnfv.org/en/stable-danube/submodules/yardstick/docs/testing/user/userguide/opnfv_yardstick_tc045.html
OPNFV_YARDSTICK_TC046_Control Node Openstack Service High Availability - KeystoneHA
JIRA
serverOPNFV JIRA
serverId96acfcf2-db1a-3859-891e-03a53e9315b0
keyYARDSTICK-292
https://docs.opnfv.org/en/stable-danube/submodules/yardstick/docs/testing/user/userguide/opnfv_yardstick_tc046.html
OPNFV_YARDSTICK_TC047_Control Node Openstack Service High Availability - Glance ApiHA
JIRA
serverOPNFV JIRA
serverId96acfcf2-db1a-3859-891e-03a53e9315b0
keyYARDSTICK-293
https://docs.opnfv.org/en/stable-danube/submodules/yardstick/docs/testing/user/userguide/opnfv_yardstick_tc047.html
OPNFV_YARDSTICK_TC048_Control Node Openstack Service High Availability - Cinder Api HA
JIRA
serverOPNFV JIRA
serverId96acfcf2-db1a-3859-891e-03a53e9315b0
keyYARDSTICK-294
https://docs.opnfv.org/en/stable-danube/submodules/yardstick/docs/testing/user/userguide/opnfv_yardstick_tc048.html
OPNFV_YARDSTICK_TC049_Control Node Openstack Service High Availability - Swift Proxy HA
JIRA
serverOPNFV JIRA
serverId96acfcf2-db1a-3859-891e-03a53e9315b0
keyYARDSTICK-295
https://docs.opnfv.org/en/stable-danube/submodules/yardstick/docs/testing/user/userguide/opnfv_yardstick_tc049.html
OPNFV_YARDSTICK_TC050_OpenStack Controller Node Network High AvailabilityHA
JIRA
serverOPNFV JIRA
serverId96acfcf2-db1a-3859-891e-03a53e9315b0
keyYARDSTICK-297
https://docs.opnfv.org/en/stable-danube/submodules/yardstick/docs/testing/user/userguide/opnfv_yardstick_tc050.html
OPNFV_YARDSTICK_TC051_OpenStack Controller Node CPU Overload High AvailabilityHA
JIRA
serverOPNFV JIRA
serverId96acfcf2-db1a-3859-891e-03a53e9315b0
keyYARDSTICK-296
https://docs.opnfv.org/en/stable-danube/submodules/yardstick/docs/testing/user/userguide/opnfv_yardstick_tc051.html
OPNFV_YARDSTICK_TC052_OpenStack Controller Node Disk I/O Block High AvailabilityHA
JIRA
serverOPNFV JIRA
serverId96acfcf2-db1a-3859-891e-03a53e9315b0
keyYARDSTICK-300
https://docs.opnfv.org/en/stable-danube/submodules/yardstick/docs/testing/user/userguide/opnfv_yardstick_tc052.html
OPNFV_YARDSTICK_TC053_OpenStack Controller Load Balance Service High AvailabilityHA
JIRA
serverOPNFV JIRA
serverId96acfcf2-db1a-3859-891e-03a53e9315b0
keyYARDSTICK-301
https://docs.opnfv.org/en/stable-danube/submodules/yardstick/docs/testing/user/userguide/opnfv_yardstick_tc053.html
OPNFV_YARDSTICK_TC054_OpenStack Virtual IP High AvailabilityHA
JIRA
serverOPNFV JIRA
serverId96acfcf2-db1a-3859-891e-03a53e9315b0
keyYARDSTICK-302
https://docs.opnfv.org/en/stable-danube/submodules/yardstick/docs/testing/user/userguide/opnfv_yardstick_tc054.html
OPNFV_YARDSTICK_TC055_Collect hardware specification from /proc/cpuinfo /proc/meminfoCompute
JIRA
serverOPNFV JIRA
serverId96acfcf2-db1a-3859-891e-03a53e9315b0
keyYARDSTICK-704
https://docs.opnfv.org/en/stable-danube/submodules/yardstick/docs/testing/user/userguide/opnfv_yardstick_tc055.html
OPNFV_YARDSTICK_TC056_Controller node Messaging Queue Service High AvailabilityHA
JIRA
serverOPNFV JIRA
columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId96acfcf2-db1a-3859-891e-03a53e9315b0
keyYARDSTICK-778
https://docs.opnfv.org/en/stable-danube/submodules/yardstick/docs/testing/user/userguide/opnfv_yardstick_tc056.html
OPNFV_YARDSTICK_TC057_Controller node Cluster Management Service High AvailabilityHA
JIRA
serverOPNFV JIRA
columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId96acfcf2-db1a-3859-891e-03a53e9315b0
keyYARDSTICK-779
https://docs.opnfv.org/en/stable-danube/submodules/yardstick/docs/testing/user/userguide/opnfv_yardstick_tc057.html
OPNFV_YARDSTICK_TC058_Controller node Virtual Router Service HighAvailability.HA
JIRA
serverOPNFV JIRA
columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId96acfcf2-db1a-3859-891e-03a53e9315b0
keyYARDSTICK-780
https://docs.opnfv.org/en/stable-danube/submodules/yardstick/docs/testing/user/userguide/opnfv_yardstick_tc058.html
OPNFV_YARDSTICK_TC061_Network UtilizationNetwork
JIRA
serverOPNFV JIRA
serverId96acfcf2-db1a-3859-891e-03a53e9315b0
keyYARDSTICK-283
https://docs.opnfv.org/en/stable-danube/submodules/yardstick/docs/testing/user/userguide/opnfv_yardstick_tc061.html
OPNFV_YARDSTICK_TC063_Measure disk size, block size and disk utilization using fdisk and iostatStorage
JIRA
serverOPNFV JIRA
serverId96acfcf2-db1a-3859-891e-03a53e9315b0
keyYARDSTICK-705
https://docs.opnfv.org/en/stable-danube/submodules/yardstick/docs/testing/user/userguide/opnfv_yardstick_tc063.html
OPNFV_YARDSTICK_TC069_Measure memory read and write bandwidth using ramspeedCompute
JIRA
serverOPNFV JIRA
serverId96acfcf2-db1a-3859-891e-03a53e9315b0
keyYARDSTICK-255
https://docs.opnfv.org/en/stable-danube/submodules/yardstick/docs/testing/user/userguide/opnfv_yardstick_tc069.html
OPNFV_YARDSTICK_TC070_Measure memory utilization, network throughput and packet loss using pktgen

Network

Compute
JIRA
serverOPNFV JIRA
serverId96acfcf2-db1a-3859-891e-03a53e9315b0
keyYARDSTICK-259
https://docs.opnfv.org/en/stable-danube/submodules/yardstick/docs/testing/user/userguide/opnfv_yardstick_tc070.html
OPNFV_YARDSTICK_TC071_Measure cache hit/miss ratio and usage, network throughput and latency

Network

Compute
JIRA
serverOPNFV JIRA
serverId96acfcf2-db1a-3859-891e-03a53e9315b0
keyYARDSTICK-267
https://docs.opnfv.org/en/stable-danube/submodules/yardstick/docs/testing/user/userguide/opnfv_yardstick_tc071.html
OPNFV_YARDSTICK_TC072_Measure network utilization,network throughput and packet loss using pktgenNetwork
JIRA
serverOPNFV JIRA
serverId96acfcf2-db1a-3859-891e-03a53e9315b0
keyYARDSTICK-706
https://docs.opnfv.org/en/stable-danube/submodules/yardstick/docs/testing/user/userguide/opnfv_yardstick_tc072.html
OPNFV_YARDSTICK_TC073_Measure network latency and throughput using netperfNetwork
JIRA
serverOPNFV JIRA
serverId96acfcf2-db1a-3859-891e-03a53e9315b0
keyYARDSTICK-707
https://docs.opnfv.org/en/stable-danube/submodules/yardstick/docs/testing/user/userguide/opnfv_yardstick_tc073.html
OPNFV_YARDSTICK_TC074_StorPerf integrationStorage
JIRA
serverOPNFV JIRA
serverId96acfcf2-db1a-3859-891e-03a53e9315b0
keyYARDSTICK-253
https://docs.opnfv.org/en/stable-danube/submodules/yardstick/docs/testing/user/userguide/opnfv_yardstick_tc074.html
OPNFV_YARDSTICK_TC075_Measure network capacity and scaleNetwork
JIRA
serverOPNFV JIRA
serverId96acfcf2-db1a-3859-891e-03a53e9315b0
keyYARDSTICK-283
https://docs.opnfv.org/en/stable-danube/submodules/yardstick/docs/testing/user/userguide/opnfv_yardstick_tc075.html
OPNFV_YARDSTICK_TC076_Monitor_Network_MetricsNetwork
JIRA
serverOPNFV JIRA
serverId96acfcf2-db1a-3859-891e-03a53e9315b0
keyYARDSTICK-534
https://docs.opnfv.org/en/stable-danube/submodules/yardstick/docs/testing/user/userguide/opnfv_yardstick_tc076.html

Proposed

This section collects ideas/requests for test cases to be developed by Yardstick Project.
The prioritization will be decided in the weekly meeting.
Add your suggestions to the comments.

...