Testing has been done with Train from the cloud-archive on Bionic: ====== Totals ====== Ran: 92 tests in 670.0555 sec. - Passed: 84 - Skipped: 8 - Expected Fail: 0 - Unexpected Success: 0 - Failed: 0 Sum of execute time for each test: 1064.1721 sec. Full run output: {0} tempest.api.compute.flavors.test_flavors.FlavorsV2TestJSON.test_get_flavor [0.250465s] ... ok {0} tempest.api.compute.flavors.test_flavors.FlavorsV2TestJSON.test_list_flavors [0.067122s] ... ok {0} tempest.api.compute.security_groups.test_security_group_rules.SecurityGroupRulesTestJSON.test_security_group_rules_create [8.447302s] ... ok {2} tempest.api.compute.security_groups.test_security_groups.SecurityGroupsTestJSON.test_security_groups_create_list_delete [27.527204s] ... ok {0} tempest.api.compute.security_groups.test_security_group_rules.SecurityGroupRulesTestJSON.test_security_group_rules_list [13.964956s] ... ok {1} tempest.api.compute.servers.test_create_server.ServersTestBootFromVolume.test_list_servers [0.188142s] ... ok {1} tempest.api.compute.servers.test_create_server.ServersTestBootFromVolume.test_verify_server_details [0.000813s] ... ok {0} tempest.api.compute.servers.test_create_server.ServersTestJSON.test_list_servers [0.207650s] ... ok {0} tempest.api.compute.servers.test_create_server.ServersTestJSON.test_verify_server_details [0.000813s] ... ok {3} tempest.api.compute.servers.test_attach_interfaces.AttachInterfacesUnderV243Test.test_add_remove_fixed_ip [145.387993s] ... ok {2} tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_reboot_server_hard [38.660777s] ... ok {3} tempest.api.identity.admin.v3.test_credentials.CredentialsTestJSON.test_credentials_create_get_update_delete [0.165239s] ... ok {1} tempest.api.compute.servers.test_server_addresses.ServerAddressesTestJSON.test_list_server_addresses [0.081378s] ... ok {1} tempest.api.compute.servers.test_server_addresses.ServerAddressesTestJSON.test_list_server_addresses_by_network [0.136202s] ... ok {3} tempest.api.identity.admin.v3.test_endpoints.EndPointsTestJSON.test_update_endpoint [0.560030s] ... ok {1} tempest.api.compute.test_versions.TestVersions.test_get_version_details [1.422782s] ... ok {1} tempest.api.compute.test_versions.TestVersions.test_list_api_versions [0.008012s] ... ok {0} tempest.api.compute.servers.test_create_server.ServersTestManualDisk.test_list_servers [0.173896s] ... ok {0} tempest.api.compute.servers.test_create_server.ServersTestManualDisk.test_verify_server_details [0.001013s] ... ok {3} tempest.api.identity.admin.v3.test_policies.PoliciesTestJSON.test_create_update_delete_policy [0.947055s] ... ok {1} setUpClass (tempest.api.identity.admin.v2.test_services.ServicesTestJSON) ... SKIPPED: Identity api v2 is not enabled {1} setUpClass (tempest.api.identity.admin.v2.test_users.UsersTestJSON) ... SKIPPED: Identity api v2 is not enabled {2} tempest.api.identity.admin.v3.test_domains.DomainsTestJSON.test_create_update_delete_domain [1.180824s] ... ok {3} tempest.api.identity.v3.test_api_discovery.TestApiDiscovery.test_api_media_types [0.445982s] ... ok {3} tempest.api.identity.v3.test_api_discovery.TestApiDiscovery.test_api_version_resources [0.069975s] ... ok {3} tempest.api.identity.v3.test_api_discovery.TestApiDiscovery.test_api_version_statuses [0.074048s] ... ok {3} tempest.api.identity.v3.test_api_discovery.TestApiDiscovery.test_list_api_versions [0.091837s] ... ok {1} tempest.api.identity.admin.v3.test_trusts.TrustsV3TestJSON.test_get_trusts_all [9.422309s] ... ok {3} tempest.api.identity.v3.test_domains.DefaultDomainTestJSON.test_default_domain_exists [0.585443s] ... ok {2} tempest.api.identity.admin.v3.test_groups.GroupsV3TestJSON.test_group_users_add_list_delete [10.152086s] ... ok {0} tempest.api.identity.admin.v3.test_services.ServicesTestJSON.test_create_update_get_service [2.978838s] ... ok {3} tempest.api.image.v2.test_images.BasicOperationsImagesTest.test_delete_image [0.387216s] ... ok {3} tempest.api.image.v2.test_images.BasicOperationsImagesTest.test_register_upload_get_image_file [3.743299s] ... ok {3} tempest.api.image.v2.test_images.BasicOperationsImagesTest.test_update_image [0.133700s] ... ok {0} setUpClass (tempest.api.identity.v2.test_api_discovery.TestApiDiscovery) ... SKIPPED: Identity api v2 is not enabled {2} tempest.api.identity.admin.v3.test_regions.RegionsTestJSON.test_create_region_with_specific_id [0.407849s] ... ok {0} tempest.api.image.v2.test_versions.VersionsTest.test_list_versions [0.008272s] ... ok {1} tempest.api.network.test_networks.NetworksTest.test_create_update_delete_network_subnet [14.042493s] ... ok {1} tempest.api.network.test_networks.NetworksTest.test_external_network_visibility [0.524950s] ... ok {1} tempest.api.network.test_networks.NetworksTest.test_list_networks [0.143180s] ... ok {0} setUpClass (tempest.api.network.test_networks.NetworksIpV6Test) ... SKIPPED: IPv6 Tests are disabled. {1} tempest.api.network.test_networks.NetworksTest.test_list_subnets [0.075275s] ... ok {1} tempest.api.network.test_networks.NetworksTest.test_show_network [0.177693s] ... ok {1} tempest.api.network.test_networks.NetworksTest.test_show_subnet [0.067821s] ... ok {3} tempest.api.network.test_subnetpools_extensions.SubnetPoolsTestJSON.test_create_list_show_update_delete_subnetpools [0.509547s] ... ok {1} setUpClass (tempest.api.network.test_ports.PortsIpV6TestJSON) ... SKIPPED: IPv6 Tests are disabled. {0} tempest.api.network.test_versions.NetworksApiDiscovery.test_api_version_resources [0.011744s] ... ok {0} tempest.api.network.test_versions.NetworksApiDiscovery.test_show_api_v2_details [0.388548s] ... ok {2} tempest.api.identity.admin.v3.test_roles.RolesV3TestJSON.test_role_create_update_show_list [2.385142s] ... ok {3} tempest.api.object_storage.test_container_services.ContainerTest.test_create_container [4.541239s] ... ok {0} tempest.api.object_storage.test_account_quotas.AccountQuotasTest.test_admin_modify_quota [1.548389s] ... ok {0} tempest.api.object_storage.test_account_quotas.AccountQuotasTest.test_upload_valid_object [0.370410s] ... ok {2} tempest.api.network.test_extensions.ExtensionsTestJSON.test_list_show_extensions [0.995627s] ... ok {3} tempest.api.object_storage.test_container_services.ContainerTest.test_list_container_contents [3.698979s] ... ok {1} tempest.api.network.test_ports.PortsTestJSON.test_create_port_in_allowed_allocation_pools [9.825380s] ... ok {3} tempest.api.object_storage.test_container_services.ContainerTest.test_list_container_metadata [4.888161s] ... ok {3} tempest.api.volume.test_versions.VersionsTest.test_list_versions [0.012059s] ... ok {0} tempest.api.object_storage.test_container_quotas.ContainerQuotasTest.test_upload_large_object [4.443590s] ... ok {1} tempest.api.network.test_ports.PortsTestJSON.test_create_port_with_no_securitygroups [15.109875s] ... ok {0} tempest.api.object_storage.test_container_quotas.ContainerQuotasTest.test_upload_too_many_objects [4.200234s] ... ok {1} tempest.api.network.test_ports.PortsTestJSON.test_create_update_delete_port [3.522311s] ... ok {1} tempest.api.network.test_ports.PortsTestJSON.test_list_ports [0.119389s] ... ok {1} tempest.api.network.test_ports.PortsTestJSON.test_show_port [0.151355s] ... ok {0} tempest.api.object_storage.test_container_quotas.ContainerQuotasTest.test_upload_valid_object [4.360343s] ... ok {1} setUpClass (tempest.api.network.test_routers.RoutersIpV6Test) ... SKIPPED: IPv6 Tests are disabled. {2} tempest.api.network.test_floating_ips.FloatingIPTestJSON.test_create_floating_ip_specifying_a_fixed_ip_address [6.078950s] ... ok {1} tempest.api.network.test_security_groups.SecGroupTest.test_create_list_update_show_delete_security_group [2.966712s] ... ok {1} tempest.api.network.test_security_groups.SecGroupTest.test_create_show_delete_security_group_rule [2.622082s] ... ok {1} tempest.api.network.test_security_groups.SecGroupTest.test_list_security_groups [0.079269s] ... ok {2} tempest.api.network.test_floating_ips.FloatingIPTestJSON.test_create_list_show_update_delete_floating_ip [18.593815s] ... ok {1} tempest.api.object_storage.test_account_services.AccountTest.test_list_account_metadata [1.490822s] ... ok {1} tempest.api.object_storage.test_account_services.AccountTest.test_list_containers [0.055313s] ... ok {3} tempest.api.volume.test_volumes_get.VolumesGetTest.test_volume_create_get_update_delete [35.118899s] ... ok {2} setUpClass (tempest.api.network.test_networks.BulkNetworkOpsIpV6Test) ... SKIPPED: IPv6 Tests are disabled. {1} tempest.api.object_storage.test_object_services.ObjectTest.test_create_object [0.375879s] ... ok {1} tempest.api.object_storage.test_object_services.ObjectTest.test_get_object [0.151073s] ... ok {1} tempest.api.object_storage.test_object_services.ObjectTest.test_list_object_metadata [0.193903s] ... ok {1} tempest.api.object_storage.test_object_services.ObjectTest.test_update_object_metadata [0.568654s] ... ok {2} tempest.api.network.test_networks.BulkNetworkOpsTest.test_bulk_create_delete_network [7.817346s] ... ok {3} tempest.api.volume.test_volumes_get.VolumesGetTest.test_volume_create_get_update_delete_from_image [32.632185s] ... ok {2} tempest.api.network.test_networks.BulkNetworkOpsTest.test_bulk_create_delete_port [5.982298s] ... ok {3} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volume_list [0.066575s] ... ok {2} tempest.api.network.test_networks.BulkNetworkOpsTest.test_bulk_create_delete_subnet [8.010892s] ... ok {2} tempest.api.network.test_routers.RoutersTest.test_add_multiple_router_interfaces [79.761855s] ... ok {0} tempest.scenario.test_network_basic_ops.TestNetworkBasicOps.test_network_basic_ops [190.794510s] ... ok {2} tempest.api.network.test_routers.RoutersTest.test_add_remove_router_interface_with_port_id [47.387369s] ... ok {3} tempest.scenario.test_server_multinode.TestServerMultinode.test_schedule_to_all_nodes [115.373828s] ... ok {2} tempest.api.network.test_routers.RoutersTest.test_add_remove_router_interface_with_subnet_id [41.256262s] ... ok {2} tempest.api.network.test_routers.RoutersTest.test_create_show_list_update_delete_router [17.531809s] ... ok {2} setUpClass (tempest.api.network.test_security_groups.SecGroupIPv6Test) ... SKIPPED: IPv6 Tests are disabled. {0} tempest.scenario.test_server_basic_ops.TestServerBasicOps.test_server_basic_ops [73.682779s] ... ok {2} tempest.api.volume.test_volumes_actions.VolumesActionsTest.test_attach_detach_volume_to_instance [31.584750s] ... ok