Coverage by Domain
Testing category |
Sub Category |
OPNFV project |
Comments |
|---|---|---|---|
System-level functional testing |
component |
Functest |
R1= Tempest + ODL + Rally |
Subsystem |
|
|
|
End to End |
|
|
|
from a user/VNF perspective |
Yardstick / Functest |
R1 = vPing |
|
Performance |
Component |
VPERF |
for OVS |
Subsystem |
Functest |
R1= Rally for OpenStack |
|
End to End |
Qtip / Yardstick |
|
|
Security |
Component |
|
|
Subsystem |
|
|
|
End to End |
|
|
|
Robustness |
Component |
|
|
Subsystem |
|
|
|
End to End |
Yardstick |
|
|
OAM |
installation |
|
|
patch |
|
|
|
upgrade |
|
|
|
backup & restore |
|
|
|
disaster recovery |
|
|
|
Reporting |
Releng |
|
|
Coverage by Component
In Arno BGS defined its content, we shall assume that each component is properly tested.
Component |
OPNFV Project |
Comments |
|---|---|---|
OpenStack |
Functest |
Rally is used to run Tempest suite as well as Rally benchs |
ODL |
Functest |
ODL OPNFV suite using Robotframework |
KVM |
Yardstick |
|
OVF |
VPERF / Yardstick |
|
Ceph |
Functest / Yardstick |
|
VNFs |
Functest / Yardstick |
vPing developed for Arno |
NIC |
Qtip |
|
Memory |
Qtip / Yardstick |
|
CPU |
Qtip /Yardstick |
|
Storage |
Qtip / Yardstick |
|
Coverage per ETSI domain
Domain |
?ubDomain |
OPNFV project |
Comments |
|---|---|---|---|
Compute |
virtual |
Yardstick |
|
hardware |
Yardstick |
|
|
Storage |
virtual |
Yardstick |
|
hardware |
Yardstick |
|
|
Network |
virtual |
VPERF / Yardstick |
|
hardware |
Yardstick |
|
|
Virtualization layer |
Yardstick |
|
|
VIM |
Functest / Yardstick |
Tempest + Rally test suites |
|
Interfaces |
Nf-Vi |
|
|
Vn-Nf |
|
|
|
Vl-HA |
|
|
|
Vl-HA |
|
|
|
Or-Vi |
|
|
|
Vi-Vnfm |
|
|
|
ETSI domains |
vEPC |
|
|
vIMS |
|
|
|
Mobile base stations |
|
|
|
Fixed Access Network |
|
|
|
vHGW |
|
|
|
vCDNs |
|
|
|
Network Functions Virtualisation IaaS |
|
|
|
Virtual Network Function ‘aaS |
Yardstick |
infra verification for VTC, SFC, SDNVPN |
|
Virtual Network PaaS |
|
|
|
VNF Forwarding Graphs |
|
|
|