Anuket Project

Scope of OVP 2018.01

The tests of the previous release of OVP will be part of the next release. For more inforation, please see

New test cases for OVP 2018.0x

Functional tests

Tempest compute (smoke) (mandatory)

  • tempest.api.compute.flavors.test_flavors.FlavorsV2TestJSON.test_get_flavor

  • tempest.api.compute.flavors.test_flavors.FlavorsV2TestJSON.test_list_flavors

  • tempest.api.compute.security_groups.test_security_group_rules.SecurityGroupRulesTestJSON.test_security_group_rules_create[id-850795d7-d4d3-4e55-b527-a774c0123d3a,smoke]

  • tempest.api.compute.security_groups.test_security_group_rules.SecurityGroupRulesTestJSON.test_security_group_rules_list[id-a6154130-5a55-4850-8be4-5e9e796dbf17,smoke]

  • tempest.api.compute.security_groups.test_security_groups.SecurityGroupsTestJSON.test_security_groups_create_list_delete[id-eb2b087d-633d-4d0d-a7bd-9e6ba35b32de,smoke]

  • tempest.api.compute.servers.test_attach_interfaces.AttachInterfacesTestJSON.test_add_remove_fixed_ip[id-c7e0e60b-ee45-43d0-abeb-8596fd42a2f9,network,smoke]

  • tempest.api.compute.servers.test_server_addresses.ServerAddressesTestJSON.test_list_server_addresses[id-6eb718c0-02d9-4d5e-acd1-4e0c269cef39,network,smoke]

  • tempest.api.compute.servers.test_server_addresses.ServerAddressesTestJSON.test_list_server_addresses_by_network[id-87bbc374-5538-4f64-b673-2b0e4443cc30,network,smoke]

  • tempest.api.compute.test_versions.TestVersions.test_get_version_details[id-b953a29e-929c-4a8e-81be-ec3a7e03cb76,smoke]

  • tempest.api.compute.servers.test_create_server.ServersTestBootFromVolume.test_verify_server_details[id-5de47127-9977-400a-936f-abcfbec1218f,smoke]

  • tempest.api.compute.servers.test_create_server.ServersTestBootFromVolume.test_list_servers[id-9a438d88-10c6-4bcd-8b5b-5b6e25e1346f,smoke]

  • tempest.scenario.test_server_basic_ops.TestServerBasicOps.test_server_basic_ops[compute,id-7fff3fb3-91d8-4fd0-bd7d-0204f1f180ba,network,smoke]

Tempest identity v2 (smoke) (mandatory)

  • tempest.api.identity.admin.v2.test_services.ServicesTestJSON.test_list_services[id-34ea6489-012d-4a86-9038-1287cadd5eca,smoke]

  • tempest.api.identity.admin.v2.test_users.UsersTestJSON.test_create_user[id-2d55a71e-da1d-4b43-9c03-d269fd93d905,smoke]

  • tempest.api.identity.v2.test_api_discovery.TestApiDiscovery.test_api_media_types[id-007a0be0-78fe-4fdb-bbee-e9216cc17bb2,smoke]

  • tempest.api.identity.v2.test_api_discovery.TestApiDiscovery.test_api_version_resources[id-ea889a68-a15f-4166-bfb1-c12456eae853,smoke]

  • tempest.api.identity.v2.test_api_discovery.TestApiDiscovery.test_api_version_statuses[id-77fd6be0-8801-48e6-b9bf-38cdd2f253ec,smoke]

Tempest identity v3 (smoke) (mandatory)

  • tempest.api.identity.admin.v3.test_credentials.CredentialsTestJSON.test_credentials_create_get_update_delete[id-7cd59bf9-bda4-4c72-9467-d21cab278355,smoke]

  • tempest.api.identity.admin.v3.test_domains.DefaultDomainTestJSON.test_default_domain_exists[id-17a5de24-e6a0-4e4a-a9ee-d85b6e5612b5,smoke]

  • tempest.api.identity.admin.v3.test_domains.DomainsTestJSON.test_create_update_delete_domain[id-f2f5b44a-82e8-4dad-8084-0661ea3b18cf,smoke]

  • tempest.api.identity.admin.v3.test_endpoints.EndPointsTestJSON.test_update_endpoint[id-37e8f15e-ee7c-4657-a1e7-f6b61e375eff,smoke]

  • tempest.api.identity.admin.v3.test_groups.GroupsV3TestJSON.test_group_users_add_list_delete[id-1598521a-2f36-4606-8df9-30772bd51339,smoke]

  • tempest.api.identity.admin.v3.test_policies.PoliciesTestJSON.test_create_update_delete_policy[id-e544703a-2f03-4cf2-9b0f-350782fdb0d3,smoke]

  • tempest.api.identity.admin.v3.test_regions.RegionsTestJSON.test_create_region_with_specific_id[id-2c12c5b5-efcf-4aa5-90c5-bff1ab0cdbe2,smoke]

  • tempest.api.identity.admin.v3.test_roles.RolesV3TestJSON.test_role_create_update_show_list[id-18afc6c0-46cf-4911-824e-9989cc056c3a,smoke]

  • tempest.api.identity.admin.v3.test_services.ServicesTestJSON.test_create_update_get_service[id-5193aad5-bcb7-411d-85b0-b3b61b96ef06,smoke]

  • tempest.api.identity.admin.v3.test_trusts.TrustsV3TestJSON.test_get_trusts_all[id-4773ebd5-ecbf-4255-b8d8-b63e6f72b65d,smoke]

  • tempest.api.identity.v3.test_api_discovery.TestApiDiscovery.test_list_api_versions[id-721f480f-35b6-46c7-846e-047e6acea0dc,smoke]

Tempest image (smoke) (mandatory)

  • tempest.api.image.v2.test_images.BasicOperationsImagesTest.test_register_upload_get_image_file[id-139b765e-7f3d-4b3d-8b37-3ca3876ee318,smoke]

  • tempest.api.image.v2.test_versions.VersionsTest.test_list_versions[id-659ea30a-a17c-4317-832c-0f68ed23c31d,smoke]

Tempest network (API tests, smoke suite) (mandatory)

  • tempest.api.network.test_extensions.ExtensionsTestJSON.test_list_show_extensions[id-ef28c7e6-e646-4979-9d67-deb207bc5564,smoke]

  • tempest.api.network.test_floating_ips.FloatingIPTestJSON.test_create_floating_ip_specifying_a_fixed_ip_address[id-36de4bd0-f09c-43e3-a8e1-1decc1ffd3a5,smoke]

  • tempest.api.network.test_floating_ips.FloatingIPTestJSON.test_create_list_show_update_delete_floating_ip[id-62595970-ab1c-4b7f-8fcc-fddfe55e8718,smoke]

  • tempest.api.network.test_networks.BulkNetworkOpsTest.test_bulk_create_delete_network[id-d4f9024d-1e28-4fc1-a6b1-25dbc6fa11e2,smoke]

  • tempest.api.network.test_networks.BulkNetworkOpsTest.test_bulk_create_delete_port[id-48037ff2-e889-4c3b-b86a-8e3f34d2d060,smoke]

  • tempest.api.network.test_networks.BulkNetworkOpsTest.test_bulk_create_delete_subnet[id-8936533b-c0aa-4f29-8e53-6cc873aec489,smoke]

  • tempest.api.network.test_networks.NetworksTest.test_external_network_visibility[id-af774677-42a9-4e4b-bb58-16fe6a5bc1ec,smoke]

  • tempest.api.network.test_ports.PortsTestJSON.test_create_port_with_no_securitygroups[id-4179dcb9-1382-4ced-84fe-1b91c54f5735,smoke]

  • tempest.api.network.test_routers.RoutersTest.test_add_multiple_router_interfaces[id-802c73c9-c937-4cef-824b-2191e24a6aab,smoke]

  • tempest.api.network.test_routers.RoutersTest.test_add_remove_router_interface_with_port_id[id-2b7d2f37-6748-4d78-92e5-1d590234f0d5,smoke]

  • tempest.api.network.test_routers.RoutersTest.test_add_remove_router_interface_with_subnet_id[id-b42e6e39-2e37-49cc-a6f4-8467e940900a,smoke]

  • tempest.api.network.test_routers.RoutersTest.test_create_show_list_update_delete_router[id-f64403e2-8483-4b34-8ccd-b09a87bcc68c,smoke]

  • tempest.api.network.test_subnetpools_extensions.SubnetPoolsTestJSON.test_create_list_show_update_delete_subnetpools[id-62595970-ab1c-4b7f-8fcc-fddfe55e9811,smoke]

  • tempest.api.network.test_versions.NetworksApiDiscovery.test_api_version_resources[id-cac8a836-c2e0-4304-b556-cd299c7281d1,smoke]

Tempest network (scenario tests, smoke suite) (optional)

  • tempest.scenario.test_network_basic_ops.TestNetworkBasicOps.test_hotplug_nic[compute,id-c5adff73-e961-41f1-b4a9-343614f18cfa,network]

  • tempest.scenario.test_network_basic_ops.TestNetworkBasicOps.test_network_basic_ops[compute,id-f323b3ba-82f8-4db7-8ea6-6a895869ec49,network,smoke]

  • tempest.scenario.test_network_basic_ops.TestNetworkBasicOps.test_subnet_details[compute,id-d8bb918e-e2df-48b2-97cd-b73c95450980,network,slow]

  • tempest.scenario.test_network_basic_ops.TestNetworkBasicOps.test_update_instance_port_admin_state[compute,id-f5dfcc22-45fd-409f-954c-5bd500d7890b,network,slow]

  • tempest.scenario.test_network_basic_ops.TestNetworkBasicOps.test_update_router_admin_state[compute,id-04b9fe4e-85e8-4aea-b937-ea93885ac59f,network,slow]

Tempest volume (smoke) (mandatory)

  • tempest.api.volume.test_volumes_actions.VolumesActionsTest.test_attach_detach_volume_to_instance[compute,id-fff42874-7db5-4487-a8e1-ddda5fb5288d,smoke]

  • tempest.scenario.test_volume_boot_pattern.TestVolumeBootPattern.test_volume_boot_pattern[compute,id-557cd2c2-4eb8-4dce-98be-f86765ff311b,image,volume]

Tempest Neutron Trunk ports(mandatory)

  • neutron.tests.tempest.api.test_trunk_negative.TrunkTestMtusJSON (skippable)

  • neutron.tests.tempest.api.test_trunk.TrunkTestMtusJSON (skippable)

  • neutron.tests.tempest.api.test_trunk.TrunkTestInheritJSONBase (skippable)

  • neutron.tests.tempest.api.test_trunk_details.TestTrunkDetailsJSON.test_port_resource_empty_trunk_details

  • neutron.tests.tempest.api.test_trunk.TrunksSearchCriteriaTest.test_list_no_pagination_limit_0

  • neutron.tests.tempest.scenario.test_trunk.TrunkTest.test_subport_connectivity (skippable)

  • neutron.tests.tempest.api.test_trunk.TrunksSearchCriteriaTest.test_list_pagination

  • neutron.tests.tempest.api.test_trunk.TrunksSearchCriteriaTest.test_list_pagination_page_reverse_asc

  • neutron.tests.tempest.api.test_trunk.TrunksSearchCriteriaTest.test_list_pagination_page_reverse_desc

  • neutron.tests.tempest.api.test_trunk.TrunksSearchCriteriaTest.test_list_pagination_page_reverse_with_href_links

  • neutron.tests.tempest.api.test_trunk.TrunksSearchCriteriaTest.test_list_pagination_with_href_links

  • neutron.tests.tempest.api.test_trunk_details.TestTrunkDetailsJSON.test_port_resource_trunk_details_no_subports

  • neutron.tests.tempest.api.test_trunk.TrunkTestJSON.test_add_subport

  • neutron.tests.tempest.api.test_trunk.TrunksSearchCriteriaTest.test_list_pagination_with_marker

  • neutron.tests.tempest.api.test_trunk.TrunksSearchCriteriaTest.test_list_sorts_asc

  • neutron.tests.tempest.api.test_trunk.TrunksSearchCriteriaTest.test_list_sorts_desc

  • neutron.tests.tempest.api.test_trunk_negative.TrunkTestJSON.test_add_subport_duplicate_segmentation_details

  • neutron.tests.tempest.api.test_trunk.TrunkTestJSON.test_create_show_delete_trunk

  • neutron.tests.tempest.api.test_trunk_negative.TrunkTestJSON.test_add_subport_passing_dict

  • neutron.tests.tempest.api.test_trunk_details.TestTrunkDetailsJSON.test_port_resource_trunk_details_with_subport

  • neutron.tests.tempest.api.test_trunk.TrunkTestJSON.test_create_trunk_empty_subports_list

  • neutron.tests.tempest.api.test_trunk_negative.TrunkTestJSON.test_add_subport_port_id_disabled_trunk

  • neutron.tests.tempest.api.test_trunk.TrunkTestJSON.test_create_trunk_subports_not_specified

  • neutron.tests.tempest.api.test_trunk_negative.TrunkTestJSON.test_add_subport_port_id_uses_trunk_port_id

  • neutron.tests.tempest.api.test_trunk_negative.TrunkTestJSON.test_create_subport_invalid_inherit_network_segmentation_type (skippable)

  • neutron.tests.tempest.api.test_trunk.TrunkTestJSON.test_create_update_trunk

  • neutron.tests.tempest.api.test_trunk.TrunkTestJSON.test_create_update_trunk_with_description

  • neutron.tests.tempest.api.test_trunk_negative.TrunkTestJSON.test_create_subport_missing_segmentation_id

  • neutron.tests.tempest.api.test_trunk.TrunkTestJSON.test_delete_trunk_with_subport_is_allowed

  • neutron.tests.tempest.api.test_trunk_negative.TrunkTestJSON.test_create_subport_nonexistent_port_id

  • neutron.tests.tempest.api.test_trunk_negative.TrunkTestJSON.test_create_subport_nonexistent_trunk

  • neutron.tests.tempest.api.test_trunk.TrunkTestJSON.test_get_subports

  • neutron.tests.tempest.api.test_trunk_negative.TrunkTestJSON.test_create_trunk_duplicate_subport_segmentation_ids

  • neutron.tests.tempest.api.test_trunk.TrunkTestJSON.test_list_trunks

  • neutron.tests.tempest.api.test_trunk_negative.TrunkTestJSON.test_create_trunk_nonexistent_port_id

  • neutron.tests.tempest.api.test_trunk_negative.TrunkTestJSON.test_create_trunk_nonexistent_subport_port_id

  • neutron.tests.tempest.scenario.test_trunk.TrunkTest.test_trunk_subport_lifecycle

  • neutron.tests.tempest.api.test_trunk_negative.TrunkTestJSON.test_create_trunk_with_subport_missing_port_id

  • neutron.tests.tempest.api.test_trunk.TrunkTestJSON.test_remove_subport

  • neutron.tests.tempest.api.test_trunk_negative.TrunkTestJSON.test_create_trunk_with_subport_missing_segmentation_id

  • neutron.tests.tempest.api.test_trunk.TrunkTestJSON.test_show_trunk_has_project_id

  • neutron.tests.tempest.api.test_trunk_negative.TrunkTestJSON.test_create_trunk_with_subport_missing_segmentation_type

  • neutron.tests.tempest.api.test_trunk_negative.TrunkTestJSON.test_delete_port_in_use_by_subport

  • neutron.tests.tempest.api.test_trunk_negative.TrunkTestJSON.test_delete_port_in_use_by_trunk

  • neutron.tests.tempest.api.test_trunk_negative.TrunkTestJSON.test_delete_trunk_disabled_trunk

  • neutron.tests.tempest.api.test_trunk_negative.TrunkTestJSON.test_remove_subport_not_found

  • neutron.tests.tempest.api.test_trunk_negative.TrunkTestJSON.test_remove_subport_passing_dict

  • neutron.tests.tempest.api.test_trunk_negative.TrunkTestJSON.test_remove_subport_port_id_disabled_trunk

Tempest BGPVPN Tempest tests(optional: BGPVPNs is an optional feature)

  • networking_bgpvpn_tempest.tests.api.test_bgpvpn_basic

  • networking_bgpvpn_tempest.tests.api.test_create_bgpvpn

  • networking_bgpvpn_tempest.tests.api.test_create_bgpvpn_as_non_admin_fail

  • networking_bgpvpn_tempest.tests.api.test_delete_bgpvpn_as_non_admin_fail

  • networking_bgpvpn_tempest.tests.api.test_show_bgpvpn_as_non_owner_fail

  • networking_bgpvpn_tempest.tests.api.test_list_bgpvpn_as_non_owner_fail

  • networking_bgpvpn_tempest.tests.api.test_show_netassoc_as_non_owner_fail

  • networking_bgpvpn_tempest.tests.api.test_list_netassoc_as_non_owner_fail

  • networking_bgpvpn_tempest.tests.api.test_associate_disassociate_network

  • networking_bgpvpn_tempest.tests.api.test_update_route_target

  • networking_bgpvpn_tempest.tests.api.test_update_route_target_non_admin_fail

  • networking_bgpvpn_tempest.tests.api.test_create_bgpvpn_with_invalid_routetargets

  • networking_bgpvpn_tempest.tests.api.test_update_bgpvpn_invalid_routetargets

  • networking_bgpvpn_tempest.tests.api.test_associate_invalid_network

  • networking_bgpvpn_tempest.tests.api.test_disassociate_invalid_network

  • networking_bgpvpn_tempest.tests.api.test_associate_disassociate_router

  • networking_bgpvpn_tempest.tests.api.test_attach_associated_subnet_to_associated_router

Security: Patrole RBAC tests, image and network service (mandatory)

  • patrole_tempest_plugin.tests.api.network.test_agents_rbac.AgentsRbacTest.test_show_agent
  • patrole_tempest_plugin.tests.api.network.test_subnetpools_rbac.SubnetPoolsRbacTest.test_create_subnetpool
  • patrole_tempest_plugin.tests.api.image.test_image_resource_types_rbac.ImageResourceTypesRbacTest.test_add_metadef_resource_type
  • patrole_tempest_plugin.tests.api.image.test_image_namespace_tags_rbac.NamespaceTagsRbacTest.test_create_namespace_tag
  • patrole_tempest_plugin.tests.api.image.test_images_rbac.BasicOperationsImagesRbacTest.test_communitize_image
  • patrole_tempest_plugin.tests.api.image.test_image_namespace_rbac.ImageNamespacesRbacTest.test_create_metadef_namespace
  • patrole_tempest_plugin.tests.api.image.test_images_member_rbac.ImagesMemberRbacTest.test_add_image_member
  • patrole_tempest_plugin.tests.api.network.test_security_groups_rbac.SecGroupRbacTest.test_create_security_group
  • patrole_tempest_plugin.tests.api.network.test_agents_rbac.AgentsRbacTest.test_update_agent
  • patrole_tempest_plugin.tests.api.image.test_image_namespace_objects_rbac.ImageNamespacesObjectsRbacTest.test_create_metadef_object_in_namespace
  • patrole_tempest_plugin.tests.api.image.test_image_resource_types_rbac.ImageResourceTypesRbacTest.test_get_metadef_resource_type
  • patrole_tempest_plugin.tests.api.image.test_image_namespace_property_rbac.NamespacesPropertyRbacTest.test_add_md_properties
  • patrole_tempest_plugin.tests.api.network.test_subnetpools_rbac.SubnetPoolsRbacTest.test_create_subnetpool_shared
  • patrole_tempest_plugin.tests.api.image.test_images_rbac.BasicOperationsImagesRbacTest.test_create_image
  • patrole_tempest_plugin.tests.api.network.test_subnets_rbac.SubnetsRbacTest.test_create_subnet
  • patrole_tempest_plugin.tests.api.image.test_image_namespace_tags_rbac.NamespaceTagsRbacTest.test_create_namespace_tags
  • patrole_tempest_plugin.tests.api.image.test_image_namespace_rbac.ImageNamespacesRbacTest.test_list_metadef_namespaces
  • patrole_tempest_plugin.tests.api.image.test_image_resource_types_rbac.ImageResourceTypesRbacTest.test_list_metadef_resource_types
  • patrole_tempest_plugin.tests.api.network.test_security_groups_rbac.SecGroupRbacTest.test_create_security_group_rule
  • patrole_tempest_plugin.tests.api.image.test_images_member_rbac.ImagesMemberRbacTest.test_delete_image_member
  • patrole_tempest_plugin.tests.api.image.test_image_namespace_objects_rbac.ImageNamespacesObjectsRbacTest.test_list_metadef_objects_in_namespace
  • patrole_tempest_plugin.tests.api.image.test_images_rbac.BasicOperationsImagesRbacTest.test_create_image_tag
  • patrole_tempest_plugin.tests.api.image.test_image_namespace_tags_rbac.NamespaceTagsRbacTest.test_list_namespace_tags
  • patrole_tempest_plugin.tests.api.network.test_subnetpools_rbac.SubnetPoolsRbacTest.test_delete_subnetpool
  • patrole_tempest_plugin.tests.api.network.test_ports_rbac.PortsRbacTest.test_create_port
  • patrole_tempest_plugin.tests.api.image.test_image_namespace_property_rbac.NamespacesPropertyRbacTest.test_get_md_properties
  • patrole_tempest_plugin.tests.api.image.test_image_namespace_rbac.ImageNamespacesRbacTest.test_modify_metadef_namespace
  • patrole_tempest_plugin.tests.api.network.test_floating_ips_rbac.FloatingIpsRbacTest.test_create_floating_ip
  • patrole_tempest_plugin.tests.api.image.test_images_member_rbac.ImagesMemberRbacTest.test_list_image_members
  • patrole_tempest_plugin.tests.api.network.test_security_groups_rbac.SecGroupRbacTest.test_delete_security_group
  • patrole_tempest_plugin.tests.api.network.test_agents_rbac.L3AgentSchedulerRbacTest.test_create_router_on_l3_agent
  • patrole_tempest_plugin.tests.api.image.test_image_namespace_tags_rbac.NamespaceTagsRbacTest.test_show_namespace_tag
  • patrole_tempest_plugin.tests.api.network.test_subnets_rbac.SubnetsRbacTest.test_delete_subnet
  • patrole_tempest_plugin.tests.api.network.test_subnetpools_rbac.SubnetPoolsRbacTest.test_show_subnetpool
  • patrole_tempest_plugin.tests.api.image.test_image_namespace_property_rbac.NamespacesPropertyRbacTest.test_get_md_property
  • patrole_tempest_plugin.tests.api.image.test_image_namespace_objects_rbac.ImageNamespacesObjectsRbacTest.test_show_metadef_object_in_namespace
  • patrole_tempest_plugin.tests.api.network.test_security_groups_rbac.SecGroupRbacTest.test_delete_security_group_rule
  • patrole_tempest_plugin.tests.api.image.test_images_member_rbac.ImagesMemberRbacTest.test_show_image_member
  • patrole_tempest_plugin.tests.api.image.test_images_rbac.BasicOperationsImagesRbacTest.test_deactivate_image
  • patrole_tempest_plugin.tests.api.network.test_ports_rbac.PortsRbacTest.test_create_port_allowed_address_pairs
  • patrole_tempest_plugin.tests.api.network.test_subnets_rbac.SubnetsRbacTest.test_list_subnets
  • patrole_tempest_plugin.tests.api.network.test_security_groups_rbac.SecGroupRbacTest.test_list_security_group_rules
  • patrole_tempest_plugin.tests.api.image.test_image_namespace_tags_rbac.NamespaceTagsRbacTest.test_update_namespace_tag
  • patrole_tempest_plugin.tests.api.network.test_subnetpools_rbac.SubnetPoolsRbacTest.test_update_subnetpool
  • patrole_tempest_plugin.tests.api.image.test_image_namespace_property_rbac.NamespacesPropertyRbacTest.test_modify_md_properties
  • patrole_tempest_plugin.tests.api.network.test_floating_ips_rbac.FloatingIpsRbacTest.test_create_floating_ip_floatingip_address
  • patrole_tempest_plugin.tests.api.image.test_images_rbac.BasicOperationsImagesRbacTest.test_delete_image
  • patrole_tempest_plugin.tests.api.network.test_subnets_rbac.SubnetsRbacTest.test_show_subnet
  • patrole_tempest_plugin.tests.api.image.test_image_namespace_objects_rbac.ImageNamespacesObjectsRbacTest.test_update_metadef_object_in_namespace
  • patrole_tempest_plugin.tests.api.image.test_images_member_rbac.ImagesMemberRbacTest.test_update_image_member
  • patrole_tempest_plugin.tests.api.network.test_security_groups_rbac.SecGroupRbacTest.test_list_security_groups
  • patrole_tempest_plugin.tests.api.network.test_agents_rbac.L3AgentSchedulerRbacTest.test_delete_router_from_l3_agent
  • patrole_tempest_plugin.tests.api.network.test_ports_rbac.PortsRbacTest.test_create_port_binding_host_id
  • patrole_tempest_plugin.tests.api.image.test_images_rbac.BasicOperationsImagesRbacTest.test_delete_image_tag
  • patrole_tempest_plugin.tests.api.network.test_subnetpools_rbac.SubnetPoolsRbacTest.test_update_subnetpool_is_default
  • patrole_tempest_plugin.tests.api.network.test_subnets_rbac.SubnetsRbacTest.test_update_subnet
  • patrole_tempest_plugin.tests.api.network.test_agents_rbac.L3AgentSchedulerRbacTest.test_list_routers_on_l3_agent
  • patrole_tempest_plugin.tests.api.network.test_security_groups_rbac.SecGroupRbacTest.test_show_security_group_rule
  • patrole_tempest_plugin.tests.api.network.test_ports_rbac.PortsRbacTest.test_create_port_binding_profile
  • patrole_tempest_plugin.tests.api.network.test_floating_ips_rbac.FloatingIpsRbacTest.test_delete_floating_ip
  • patrole_tempest_plugin.tests.api.network.test_security_groups_rbac.SecGroupRbacTest.test_show_security_groups
  • patrole_tempest_plugin.tests.api.network.test_ports_rbac.PortsRbacTest.test_create_port_device_owner
  • patrole_tempest_plugin.tests.api.image.test_images_rbac.BasicOperationsImagesRbacTest.test_download_image
  • patrole_tempest_plugin.tests.api.network.test_security_groups_rbac.SecGroupRbacTest.test_update_security_group
  • patrole_tempest_plugin.tests.api.image.test_images_rbac.BasicOperationsImagesRbacTest.test_list_images
  • patrole_tempest_plugin.tests.api.network.test_floating_ips_rbac.FloatingIpsRbacTest.test_show_floating_ip
  • patrole_tempest_plugin.tests.api.network.test_ports_rbac.PortsRbacTest.test_create_port_fixed_ips
  • patrole_tempest_plugin.tests.api.image.test_images_rbac.BasicOperationsImagesRbacTest.test_publicize_image
  • patrole_tempest_plugin.tests.api.network.test_agents_rbac.DHCPAgentSchedulersRbacTest.test_add_dhcp_agent_to_network
  • patrole_tempest_plugin.tests.api.network.test_ports_rbac.PortsRbacTest.test_create_port_mac_address
  • patrole_tempest_plugin.tests.api.image.test_images_rbac.BasicOperationsImagesRbacTest.test_reactivate_image
  • patrole_tempest_plugin.tests.api.network.test_floating_ips_rbac.FloatingIpsRbacTest.test_update_floating_ip
  • patrole_tempest_plugin.tests.api.image.test_images_rbac.BasicOperationsImagesRbacTest.test_show_image
  • patrole_tempest_plugin.tests.api.network.test_ports_rbac.PortsRbacTest.test_create_port_security_enabled
  • patrole_tempest_plugin.tests.api.network.test_agents_rbac.DHCPAgentSchedulersRbacTest.test_delete_network_from_dhcp_agent
  • patrole_tempest_plugin.tests.api.image.test_images_rbac.BasicOperationsImagesRbacTest.test_update_image
  • patrole_tempest_plugin.tests.api.network.test_agents_rbac.DHCPAgentSchedulersRbacTest.test_list_networks_hosted_by_one_dhcp_agent
  • patrole_tempest_plugin.tests.api.network.test_ports_rbac.PortsRbacTest.test_delete_port
  • patrole_tempest_plugin.tests.api.image.test_images_rbac.BasicOperationsImagesRbacTest.test_upload_image
  • patrole_tempest_plugin.tests.api.network.test_ports_rbac.PortsRbacTest.test_show_port
  • patrole_tempest_plugin.tests.api.network.test_routers_rbac.RouterRbacTest.test_add_router_interface
  • patrole_tempest_plugin.tests.api.network.test_ports_rbac.PortsRbacTest.test_show_port_binding_host_id
  • patrole_tempest_plugin.tests.api.network.test_ports_rbac.PortsRbacTest.test_show_port_binding_profile
  • patrole_tempest_plugin.tests.api.network.test_ports_rbac.PortsRbacTest.test_show_port_binding_vif_details
  • patrole_tempest_plugin.tests.api.network.test_ports_rbac.PortsRbacTest.test_show_port_binding_vif_type
  • patrole_tempest_plugin.tests.api.network.test_routers_rbac.RouterRbacTest.test_create_high_availability_router
  • patrole_tempest_plugin.tests.api.network.test_ports_rbac.PortsRbacTest.test_update_port
  • patrole_tempest_plugin.tests.api.network.test_ports_rbac.PortsRbacTest.test_update_port_allowed_address_pairs
  • patrole_tempest_plugin.tests.api.network.test_routers_rbac.RouterRbacTest.test_create_router
  • patrole_tempest_plugin.tests.api.network.test_ports_rbac.PortsRbacTest.test_update_port_binding_host_id
  • patrole_tempest_plugin.tests.api.network.test_networks_rbac.NetworksRbacTest.test_create_network
  • patrole_tempest_plugin.tests.api.network.test_ports_rbac.PortsRbacTest.test_update_port_binding_profile
  • patrole_tempest_plugin.tests.api.network.test_networks_rbac.NetworksRbacTest.test_create_network_provider_network_type
  • patrole_tempest_plugin.tests.api.network.test_ports_rbac.PortsRbacTest.test_update_port_device_owner
  • patrole_tempest_plugin.tests.api.network.test_networks_rbac.NetworksRbacTest.test_create_network_provider_segmentation_id
  • patrole_tempest_plugin.tests.api.network.test_networks_rbac.NetworksRbacTest.test_create_network_router_external
  • patrole_tempest_plugin.tests.api.network.test_ports_rbac.PortsRbacTest.test_update_port_fixed_ips
  • patrole_tempest_plugin.tests.api.network.test_networks_rbac.NetworksRbacTest.test_create_network_shared
  • patrole_tempest_plugin.tests.api.network.test_routers_rbac.RouterRbacTest.test_create_router_enable_snat
  • patrole_tempest_plugin.tests.api.network.test_ports_rbac.PortsRbacTest.test_update_port_mac_address
  • patrole_tempest_plugin.tests.api.network.test_networks_rbac.NetworksRbacTest.test_create_subnet
  • patrole_tempest_plugin.tests.api.network.test_ports_rbac.PortsRbacTest.test_update_port_security_enabled
  • patrole_tempest_plugin.tests.api.network.test_networks_rbac.NetworksRbacTest.test_delete_network
  • patrole_tempest_plugin.tests.api.network.test_networks_rbac.NetworksRbacTest.test_delete_subnet
  • patrole_tempest_plugin.tests.api.network.test_networks_rbac.NetworksRbacTest.test_list_dhcp_agents_on_hosting_network
  • patrole_tempest_plugin.tests.api.network.test_networks_rbac.NetworksRbacTest.test_show_network
  • patrole_tempest_plugin.tests.api.network.test_routers_rbac.RouterRbacTest.test_create_router_external_fixed_ips
  • patrole_tempest_plugin.tests.api.network.test_networks_rbac.NetworksRbacTest.test_show_network_provider_network_type
  • patrole_tempest_plugin.tests.api.network.test_networks_rbac.NetworksRbacTest.test_show_network_provider_physical_network
  • patrole_tempest_plugin.tests.api.network.test_networks_rbac.NetworksRbacTest.test_show_network_provider_segmentation_id
  • patrole_tempest_plugin.tests.api.network.test_networks_rbac.NetworksRbacTest.test_show_network_router_external
  • patrole_tempest_plugin.tests.api.network.test_networks_rbac.NetworksRbacTest.test_show_subnet
  • patrole_tempest_plugin.tests.api.network.test_routers_rbac.RouterRbacTest.test_delete_router
  • patrole_tempest_plugin.tests.api.network.test_networks_rbac.NetworksRbacTest.test_update_network
  • patrole_tempest_plugin.tests.api.network.test_networks_rbac.NetworksRbacTest.test_update_network_router_external
  • patrole_tempest_plugin.tests.api.network.test_networks_rbac.NetworksRbacTest.test_update_network_shared
  • patrole_tempest_plugin.tests.api.network.test_networks_rbac.NetworksRbacTest.test_update_subnet
  • patrole_tempest_plugin.tests.api.network.test_service_providers_rbac.ServiceProvidersRbacTest.test_list_service_providers
  • patrole_tempest_plugin.tests.api.network.test_routers_rbac.RouterRbacTest.test_remove_router_interface
  • patrole_tempest_plugin.tests.api.network.test_routers_rbac.RouterRbacTest.test_show_router
  • patrole_tempest_plugin.tests.api.network.test_routers_rbac.RouterRbacTest.test_update_high_availability_router
  • patrole_tempest_plugin.tests.api.network.test_routers_rbac.RouterRbacTest.test_update_router
  • patrole_tempest_plugin.tests.api.network.test_routers_rbac.RouterRbacTest.test_update_router_enable_snat
  • patrole_tempest_plugin.tests.api.network.test_routers_rbac.RouterRbacTest.test_update_router_external_fixed_ips
  • patrole_tempest_plugin.tests.api.network.test_routers_rbac.RouterRbacTest.test_update_router_external_gateway_info
  • patrole_tempest_plugin.tests.api.network.test_routers_rbac.RouterRbacTest.test_update_router_external_gateway_info_network_id

OPNFV SNAPS smoke tests (optional: long term support unclear)

  • test_add_rule (snaps.openstack.tests.create_security_group_tests.CreateSecurityGroupTests)
  • test_create_delete_group (snaps.openstack.tests.create_security_group_tests.CreateSecurityGroupTests)
  • test_create_group_admin_user_to_new_project (snaps.openstack.tests.create_security_group_tests.CreateSecurityGroupTests)
  • test_create_group_new_user_to_admin_project (snaps.openstack.tests.create_security_group_tests.CreateSecurityGroupTests)
  • test_create_group_with_one_complex_rule (snaps.openstack.tests.create_security_group_tests.CreateSecurityGroupTests)
  • test_create_group_with_one_simple_rule (snaps.openstack.tests.create_security_group_tests.CreateSecurityGroupTests)
  • test_create_group_with_several_rules (snaps.openstack.tests.create_security_group_tests.CreateSecurityGroupTests)
  • test_create_group_without_rules (snaps.openstack.tests.create_security_group_tests.CreateSecurityGroupTests)
  • test_remove_rule_by_id (snaps.openstack.tests.create_security_group_tests.CreateSecurityGroupTests)
  • test_remove_rule_by_setting (snaps.openstack.tests.create_security_group_tests.CreateSecurityGroupTests)
  • test_create_delete_image (snaps.openstack.tests.create_image_tests.CreateImageSuccessTests)
  • test_create_image_clean_file (snaps.openstack.tests.create_image_tests.CreateImageSuccessTests)
  • test_create_image_clean_url (snaps.openstack.tests.create_image_tests.CreateImageSuccessTests)
  • test_create_image_clean_url_properties (snaps.openstack.tests.create_image_tests.CreateImageSuccessTests)
  • test_create_same_image (snaps.openstack.tests.create_image_tests.CreateImageSuccessTests)
  • test_create_same_image_new_settings (snaps.openstack.tests.create_image_tests.CreateImageSuccessTests)
  • test_bad_image_file (snaps.openstack.tests.create_image_tests.CreateImageNegativeTests)
  • test_bad_image_image_type (snaps.openstack.tests.create_image_tests.CreateImageNegativeTests)
  • test_bad_image_name (snaps.openstack.tests.create_image_tests.CreateImageNegativeTests)
  • test_bad_image_url (snaps.openstack.tests.create_image_tests.CreateImageNegativeTests)
  • test_create_three_part_image_from_file_3_creators (snaps.openstack.tests.create_image_tests.CreateMultiPartImageTests)
  • test_create_three_part_image_from_url (snaps.openstack.tests.create_image_tests.CreateMultiPartImageTests)
  • test_create_three_part_image_from_url_3_creators (snaps.openstack.tests.create_image_tests.CreateMultiPartImageTests)
  • test_create_delete_keypair (snaps.openstack.tests.create_keypairs_tests.CreateKeypairsTests)
  • test_create_keypair_from_file (snaps.openstack.tests.create_keypairs_tests.CreateKeypairsTests)
  • test_create_keypair_large_key (snaps.openstack.tests.create_keypairs_tests.CreateKeypairsTests)
  • test_create_keypair_only (snaps.openstack.tests.create_keypairs_tests.CreateKeypairsTests)
  • test_create_keypair_save_both (snaps.openstack.tests.create_keypairs_tests.CreateKeypairsTests)
  • test_create_keypair_save_pub_only (snaps.openstack.tests.create_keypairs_tests.CreateKeypairsTests)
  • test_create_keypair_exist_files_delete (snaps.openstack.tests.create_keypairs_tests.CreateKeypairsCleanupTests)
  • test_create_keypair_exist_files_keep (snaps.openstack.tests.create_keypairs_tests.CreateKeypairsCleanupTests)
  • test_create_keypair_gen_files_delete_1 (snaps.openstack.tests.create_keypairs_tests.CreateKeypairsCleanupTests)
  • test_create_keypair_gen_files_delete_2 (snaps.openstack.tests.create_keypairs_tests.CreateKeypairsCleanupTests)
  • test_create_keypair_gen_files_keep (snaps.openstack.tests.create_keypairs_tests.CreateKeypairsCleanupTests)
  • test_create_delete_network (snaps.openstack.tests.create_network_tests.CreateNetworkSuccessTests)
  • test_create_network_router_admin_user_to_new_project (snaps.openstack.tests.create_network_tests.CreateNetworkSuccessTests)
  • test_create_network_router_new_user_to_admin_project (snaps.openstack.tests.create_network_tests.CreateNetworkSuccessTests)
  • test_create_network_with_router (snaps.openstack.tests.create_network_tests.CreateNetworkSuccessTests)
  • test_create_network_without_router (snaps.openstack.tests.create_network_tests.CreateNetworkSuccessTests)
  • test_create_networks_same_name (snaps.openstack.tests.create_network_tests.CreateNetworkSuccessTests)
  • test_create_delete_router (snaps.openstack.tests.create_router_tests.CreateRouterSuccessTests)
  • test_create_router_admin_state_True (snaps.openstack.tests.create_router_tests.CreateRouterSuccessTests)
  • test_create_router_admin_state_false (snaps.openstack.tests.create_router_tests.CreateRouterSuccessTests)
  • test_create_router_admin_user_to_new_project (snaps.openstack.tests.create_router_tests.CreateRouterSuccessTests)
  • test_create_router_external_network (snaps.openstack.tests.create_router_tests.CreateRouterSuccessTests)
  • test_create_router_new_user_as_admin_project (snaps.openstack.tests.create_router_tests.CreateRouterSuccessTests)
  • test_create_router_private_network (snaps.openstack.tests.create_router_tests.CreateRouterSuccessTests)
  • test_create_router_vanilla (snaps.openstack.tests.create_router_tests.CreateRouterSuccessTests)
  • test_create_router_with_ext_port (snaps.openstack.tests.create_router_tests.CreateRouterSuccessTests)
  • test_create_router_admin_ports (snaps.openstack.tests.create_router_tests.CreateRouterNegativeTests)
  • test_create_router_invalid_gateway_name (snaps.openstack.tests.create_router_tests.CreateRouterNegativeTests)
  • test_create_router_noname (snaps.openstack.tests.create_router_tests.CreateRouterNegativeTests)
  • test_create_delete_qos (snaps.openstack.tests.create_qos_tests.CreateQoSTests)
  • test_create_qos (snaps.openstack.tests.create_qos_tests.CreateQoSTests)
  • test_create_same_qos (snaps.openstack.tests.create_qos_tests.CreateQoSTests)
  • test_create_delete_volume_type (snaps.openstack.tests.create_volume_type_tests.CreateSimpleVolumeTypeSuccessTests)
  • test_create_same_volume_type (snaps.openstack.tests.create_volume_type_tests.CreateSimpleVolumeTypeSuccessTests)
  • test_create_volume_type (snaps.openstack.tests.create_volume_type_tests.CreateSimpleVolumeTypeSuccessTests)
  • test_volume_type_with_encryption (snaps.openstack.tests.create_volume_type_tests.CreateVolumeTypeComplexTests)
  • test_volume_type_with_qos (snaps.openstack.tests.create_volume_type_tests.CreateVolumeTypeComplexTests)
  • test_volume_type_with_qos_and_encryption (snaps.openstack.tests.create_volume_type_tests.CreateVolumeTypeComplexTests)
  • test_create_delete_volume (snaps.openstack.tests.create_volume_tests.CreateSimpleVolumeSuccessTests)
  • test_create_same_volume (snaps.openstack.tests.create_volume_tests.CreateSimpleVolumeSuccessTests)
  • test_create_volume_simple (snaps.openstack.tests.create_volume_tests.CreateSimpleVolumeSuccessTests)
  • test_create_volume_bad_image (snaps.openstack.tests.create_volume_tests.CreateSimpleVolumeFailureTests)
  • test_create_volume_bad_size (snaps.openstack.tests.create_volume_tests.CreateSimpleVolumeFailureTests)
  • test_create_volume_bad_type (snaps.openstack.tests.create_volume_tests.CreateSimpleVolumeFailureTests)
  • test_bad_volume_type (snaps.openstack.tests.create_volume_tests.CreateVolumeWithTypeTests)
  • test_valid_volume_type (snaps.openstack.tests.create_volume_tests.CreateVolumeWithTypeTests)
  • test_bad_image_name (snaps.openstack.tests.create_volume_tests.CreateVolumeWithImageTests)
  • test_valid_volume_image (snaps.openstack.tests.create_volume_tests.CreateVolumeWithImageTests)
  • test_check_vm_ip_dhcp (snaps.openstack.tests.create_instance_tests.SimpleHealthCheck)
  • test_ping_via_router (snaps.openstack.tests.create_instance_tests.CreateInstanceTwoNetTests)
  • test_create_admin_instance (snaps.openstack.tests.create_instance_tests.CreateInstanceSimpleTests)
  • test_create_delete_instance (snaps.openstack.tests.create_instance_tests.CreateInstanceSimpleTests)
  • test_set_allowed_address_pairs (snaps.openstack.tests.create_instance_tests.CreateInstancePortManipulationTests)
  • test_set_allowed_address_pairs_bad_ip (snaps.openstack.tests.create_instance_tests.CreateInstancePortManipulationTests)
  • test_set_allowed_address_pairs_bad_mac (snaps.openstack.tests.create_instance_tests.CreateInstancePortManipulationTests)
  • test_set_custom_invalid_ip_one_subnet (snaps.openstack.tests.create_instance_tests.CreateInstancePortManipulationTests)
  • test_set_custom_invalid_mac (snaps.openstack.tests.create_instance_tests.CreateInstancePortManipulationTests)
  • test_set_custom_mac_and_ip (snaps.openstack.tests.create_instance_tests.CreateInstancePortManipulationTests)
  • test_set_custom_valid_ip_one_subnet (snaps.openstack.tests.create_instance_tests.CreateInstancePortManipulationTests)
  • test_set_custom_valid_mac (snaps.openstack.tests.create_instance_tests.CreateInstancePortManipulationTests)
  • test_set_one_port_two_ip_one_subnet (snaps.openstack.tests.create_instance_tests.CreateInstancePortManipulationTests)
  • test_set_one_port_two_ip_two_subnets (snaps.openstack.tests.create_instance_tests.CreateInstancePortManipulationTests)
  • test_add_invalid_security_group (snaps.openstack.tests.create_instance_tests.InstanceSecurityGroupTests)
  • test_add_same_security_group (snaps.openstack.tests.create_instance_tests.InstanceSecurityGroupTests)
  • test_add_security_group (snaps.openstack.tests.create_instance_tests.InstanceSecurityGroupTests)
  • test_remove_security_group (snaps.openstack.tests.create_instance_tests.InstanceSecurityGroupTests)
  • test_remove_security_group_never_added (snaps.openstack.tests.create_instance_tests.InstanceSecurityGroupTests)
  • test_deploy_vm_to_each_compute_node (snaps.openstack.tests.create_instance_tests.CreateInstanceOnComputeHost)
  • test_create_instance_from_three_part_image (snaps.openstack.tests.create_instance_tests.CreateInstanceFromThreePartImage)
  • test_create_instance_with_one_volume (snaps.openstack.tests.create_instance_tests.CreateInstanceVolumeTests)
  • test_create_instance_with_two_volumes (snaps.openstack.tests.create_instance_tests.CreateInstanceVolumeTests)
  • test_create_delete_stack (snaps.openstack.tests.create_stack_tests.CreateStackSuccessTests)
  • test_create_same_stack (snaps.openstack.tests.create_stack_tests.CreateStackSuccessTests)
  • test_create_stack_short_timeout (snaps.openstack.tests.create_stack_tests.CreateStackSuccessTests)
  • test_create_stack_template_dict (snaps.openstack.tests.create_stack_tests.CreateStackSuccessTests)
  • test_create_stack_template_file (snaps.openstack.tests.create_stack_tests.CreateStackSuccessTests)
  • test_retrieve_network_creators (snaps.openstack.tests.create_stack_tests.CreateStackSuccessTests)
  • test_retrieve_vm_inst_creators (snaps.openstack.tests.create_stack_tests.CreateStackSuccessTests)
  • test_retrieve_volume_creator (snaps.openstack.tests.create_stack_tests.CreateStackVolumeTests)
  • test_retrieve_volume_type_creator (snaps.openstack.tests.create_stack_tests.CreateStackVolumeTests)
  • test_retrieve_flavor_creator (snaps.openstack.tests.create_stack_tests.CreateStackFlavorTests)
  • test_retrieve_keypair_creator (snaps.openstack.tests.create_stack_tests.CreateStackKeypairTests)
  • test_retrieve_security_group_creator (snaps.openstack.tests.create_stack_tests.CreateStackSecurityGroupTests)
  • test_bad_stack_file (snaps.openstack.tests.create_stack_tests.CreateStackNegativeTests)
  • test_missing_dependencies (snaps.openstack.tests.create_stack_tests.CreateStackNegativeTests)
  • test_single_port_static (snaps.openstack.tests.create_instance_tests.CreateInstanceSingleNetworkTests)
  • test_ssh_client_fip_after_active (snaps.openstack.tests.create_instance_tests.CreateInstanceSingleNetworkTests)
  • test_ssh_client_fip_after_init (snaps.openstack.tests.create_instance_tests.CreateInstanceSingleNetworkTests)
  • test_ssh_client_fip_after_reboot (snaps.openstack.tests.create_instance_tests.CreateInstanceSingleNetworkTests)
  • test_ssh_client_fip_before_active (snaps.openstack.tests.create_instance_tests.CreateInstanceSingleNetworkTests)
  • test_ssh_client_fip_reverse_engineer (snaps.openstack.tests.create_instance_tests.CreateInstanceSingleNetworkTests)
  • test_ssh_client_fip_second_creator (snaps.openstack.tests.create_instance_tests.CreateInstanceSingleNetworkTests)
  • test_connect_via_ssh_heat_vm (snaps.openstack.tests.create_stack_tests.CreateStackFloatingIpTests)
  • test_connect_via_ssh_heat_vm_derived (snaps.openstack.tests.create_stack_tests.CreateStackFloatingIpTests)
  • test_apply_simple_playbook (snaps.provisioning.tests.ansible_utils_tests.AnsibleProvisioningTests)
  • test_apply_template_playbook (snaps.provisioning.tests.ansible_utils_tests.AnsibleProvisioningTests)

VNF testing vIMS (optional: no offline support)

VNF testing vEPC(optional: no offline support)

Non-functional tests

High-availability of one controller (restart) (mandatory)

High-availability of message queue (mandatory)

High-availability of Neutron L3 agent (optional: the L3 agent is not available on systems with SDN controller)

High-availability of OpenStack database (mandatory)

Stress testing (optional: stability of OPNFV reference platforms)

  • No labels

2 Comments

  1. Dan Xu

    1. For trunk port, there are 9 sub test cases always skipped for all installers. How to review them if trunk port is mandatory? Like identity v2, add some description in the documents?
    2. For patrole, there are also some sub test cases skipped and the number of skipped test cases is different for each installers. Most of them are skipped for lacking some extension services like 'dvr', 'metering' ...
    3. I would suggest to remove snaps_smoke or make it optional.

  2. Georg Kunz

    For 1: I see two options: i) adding a feature to Dovetail to handle skipped test cases ( Unable to render Jira issues macro, execution error. ). We then mark those tests as "skippable". Or ii) run only the tests we want to include as part of a tempest_custom test. I have done the latter for the BGPVPN tests, too, because one test fails due to a bug in ODL.

    For 2: we have to identify the minimum set of tests that pass on all installers and update this page accordingly. Then, similar thoughts a for 1) apply.

    For 3: agreed