Skip to content

Navigation Menu

Sign in
Appearance settings

Search code, repositories, users, issues, pull requests...

Provide feedback

We read every piece of feedback, and take your input very seriously.

Saved searches

Use saved searches to filter your results more quickly
Appearance settings

[4.10/master] Smoketest Health#1836

Closed
yadvr wants to merge 1 commit intoapache:masterapache/cloudstack:masterfrom
shapeblue:4.10-latest-trillian-testshapeblue/cloudstack:4.10-latest-trillian-testCopy head branch name to clipboard
Closed

[4.10/master] Smoketest Health#1836
yadvr wants to merge 1 commit intoapache:masterapache/cloudstack:masterfrom
shapeblue:4.10-latest-trillian-testshapeblue/cloudstack:4.10-latest-trillian-testCopy head branch name to clipboard

Conversation

@yadvr
Copy link
Member

@yadvr yadvr commented Dec 19, 2016

@blueorangutan package

@yadvr
dummy commit
05a2589 
Signed-off-by: Rohit Yadav <rohit.yadav@shapeblue.com>
@blueorangutan
Copy link

blueorangutan commented Dec 19, 2016

@rhtyd a Jenkins job has been kicked to build packages. I'll keep you posted as I make progress.

@blueorangutan
Copy link

blueorangutan commented Dec 19, 2016

Packaging result: ✔centos6 ✔centos7 ✔debian. JID-400

@yadvr
Copy link
Member Author

yadvr commented Dec 19, 2016

@blueorangutan test

@blueorangutan
Copy link

blueorangutan commented Dec 19, 2016

@rhtyd a Trillian-Jenkins test job (centos7 mgmt + kvm-centos7) has been kicked to run smoke tests

@blueorangutan
Copy link

blueorangutan commented Dec 19, 2016

Trillian test result (tid-689)
Environment: kvm-centos7 (x2), Advanced Networking with Mgmt server 7
Total time taken: 30449 seconds
Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr1836-t689-kvm-centos7.zip
Test completed. 44 look ok, 5 have error(s)

Test Result Time (s) Test File
test_02_redundant_VPC_default_routes Failure 869.15 test_vpc_redundant.py
test_04_rvpc_privategw_static_routes Failure 350.55 test_privategw_acl.py
test_09_delete_detached_volume Error 10.21 test_volumes.py
test_08_resize_volume Error 5.09 test_volumes.py
test_07_resize_fail Error 10.25 test_volumes.py
test_06_download_detached_volume Error 5.10 test_volumes.py
test_05_detach_volume Error 5.08 test_volumes.py
test_04_delete_attached_volume Error 5.09 test_volumes.py
test_03_download_attached_volume Error 5.09 test_volumes.py
test_01_create_volume Error 279.90 test_volumes.py
ContextSuite context=TestTemplates>:setup Error 349.73 test_templates.py
ContextSuite context=TestListIdsParams>:setup Error 0.00 test_list_ids_parameter.py
test_01_vpc_site2site_vpn Success 159.76 test_vpc_vpn.py
test_01_vpc_remote_access_vpn Success 66.32 test_vpc_vpn.py
test_01_redundant_vpc_site2site_vpn Success 241.62 test_vpc_vpn.py
test_02_VPC_default_routes Success 440.34 test_vpc_router_nics.py
test_01_VPC_nics_after_destroy Success 790.25 test_vpc_router_nics.py
test_05_rvpc_multi_tiers Success 496.20 test_vpc_redundant.py
test_04_rvpc_network_garbage_collector_nics Success 1386.27 test_vpc_redundant.py
test_03_create_redundant_VPC_1tier_2VMs_2IPs_2PF_ACL_reboot_routers Success 549.72 test_vpc_redundant.py
test_01_create_redundant_VPC_2tiers_4VMs_4IPs_4PF_ACL Success 1273.59 test_vpc_redundant.py
test_02_attach_volume Success 48.68 test_volumes.py
test_deploy_vm_multiple Success 328.33 test_vm_life_cycle.py
test_deploy_vm Success 0.03 test_vm_life_cycle.py
test_advZoneVirtualRouter Success 0.02 test_vm_life_cycle.py
test_10_attachAndDetach_iso Success 26.65 test_vm_life_cycle.py
test_09_expunge_vm Success 125.21 test_vm_life_cycle.py
test_08_migrate_vm Success 35.89 test_vm_life_cycle.py
test_07_restore_vm Success 0.12 test_vm_life_cycle.py
test_06_destroy_vm Success 125.81 test_vm_life_cycle.py
test_03_reboot_vm Success 125.85 test_vm_life_cycle.py
test_02_start_vm Success 10.17 test_vm_life_cycle.py
test_01_stop_vm Success 125.83 test_vm_life_cycle.py
test_CreateTemplateWithDuplicateName Success 80.70 test_templates.py
test_01_create_template Success 40.41 test_templates.py
test_10_destroy_cpvm Success 161.63 test_ssvm.py
test_09_destroy_ssvm Success 168.97 test_ssvm.py
test_08_reboot_cpvm Success 131.37 test_ssvm.py
test_07_reboot_ssvm Success 133.56 test_ssvm.py
test_06_stop_cpvm Success 131.47 test_ssvm.py
test_05_stop_ssvm Success 134.17 test_ssvm.py
test_04_cpvm_internals Success 0.97 test_ssvm.py
test_03_ssvm_internals Success 3.32 test_ssvm.py
test_02_list_cpvm_vm Success 0.12 test_ssvm.py
test_01_list_sec_storage_vm Success 0.13 test_ssvm.py
test_01_snapshot_root_disk Success 11.24 test_snapshots.py
test_04_change_offering_small Success 234.57 test_service_offerings.py
test_03_delete_service_offering Success 0.04 test_service_offerings.py
test_02_edit_service_offering Success 0.06 test_service_offerings.py
test_01_create_service_offering Success 0.11 test_service_offerings.py
test_02_sys_template_ready Success 0.13 test_secondary_storage.py
test_01_sys_vm_start Success 0.18 test_secondary_storage.py
test_09_reboot_router Success 35.32 test_routers.py
test_08_start_router Success 30.31 test_routers.py
test_07_stop_router Success 10.17 test_routers.py
test_06_router_advanced Success 0.06 test_routers.py
test_05_router_basic Success 0.05 test_routers.py
test_04_restart_network_wo_cleanup Success 5.68 test_routers.py
test_03_restart_network_cleanup Success 60.51 test_routers.py
test_02_router_internal_adv Success 0.85 test_routers.py
test_01_router_internal_basic Success 0.45 test_routers.py
test_router_dns_guestipquery Success 106.76 test_router_dns.py
test_router_dns_externalipquery Success 0.06 test_router_dns.py
test_router_dhcphosts Success 394.10 test_router_dhcphosts.py
test_router_dhcp_opts Success 21.82 test_router_dhcphosts.py
test_01_updatevolumedetail Success 0.10 test_resource_detail.py
test_01_reset_vm_on_reboot Success 166.60 test_reset_vm_on_reboot.py
test_createRegion Success 0.04 test_regions.py
test_create_pvlan_network Success 5.21 test_pvlan.py
test_dedicatePublicIpRange Success 0.41 test_public_ip_range.py
test_03_vpc_privategw_restart_vpc_cleanup Success 681.04 test_privategw_acl.py
test_02_vpc_privategw_static_routes Success 586.68 test_privategw_acl.py
test_01_vpc_privategw_acl Success 87.32 test_privategw_acl.py
test_01_primary_storage_nfs Success 35.81 test_primary_storage.py
test_createPortablePublicIPRange Success 15.19 test_portable_publicip.py
test_createPortablePublicIPAcquire Success 15.45 test_portable_publicip.py
test_isolate_network_password_server Success 57.29 test_password_server.py
test_UpdateStorageOverProvisioningFactor Success 0.13 test_over_provisioning.py
test_oobm_zchange_password Success 30.72 test_outofbandmanagement.py
test_oobm_multiple_mgmt_server_ownership Success 16.32 test_outofbandmanagement.py
test_oobm_issue_power_status Success 10.24 test_outofbandmanagement.py
test_oobm_issue_power_soft Success 15.36 test_outofbandmanagement.py
test_oobm_issue_power_reset Success 15.34 test_outofbandmanagement.py
test_oobm_issue_power_on Success 15.32 test_outofbandmanagement.py
test_oobm_issue_power_off Success 15.32 test_outofbandmanagement.py
test_oobm_issue_power_cycle Success 15.31 test_outofbandmanagement.py
test_oobm_enabledisable_across_clusterzones Success 92.57 test_outofbandmanagement.py
test_oobm_enable_feature_valid Success 5.16 test_outofbandmanagement.py
test_oobm_enable_feature_invalid Success 0.09 test_outofbandmanagement.py
test_oobm_disable_feature_valid Success 5.17 test_outofbandmanagement.py
test_oobm_disable_feature_invalid Success 0.10 test_outofbandmanagement.py
test_oobm_configure_invalid_driver Success 0.07 test_outofbandmanagement.py
test_oobm_configure_default_driver Success 0.07 test_outofbandmanagement.py
test_oobm_background_powerstate_sync Success 29.45 test_outofbandmanagement.py
test_extendPhysicalNetworkVlan Success 15.38 test_non_contigiousvlan.py
test_01_nic Success 585.97 test_nic.py
test_releaseIP Success 278.02 test_network.py
test_reboot_router Success 489.50 test_network.py
test_public_ip_user_account Success 10.25 test_network.py
test_public_ip_admin_account Success 40.29 test_network.py
test_network_rules_acquired_public_ip_3_Load_Balancer_Rule Success 66.82 test_network.py
test_network_rules_acquired_public_ip_2_nat_rule Success 61.70 test_network.py
test_network_rules_acquired_public_ip_1_static_nat_rule Success 121.09 test_network.py
test_delete_account Success 293.12 test_network.py
test_02_port_fwd_on_non_src_nat Success 55.69 test_network.py
test_01_port_fwd_on_src_nat Success 111.70 test_network.py
test_nic_secondaryip_add_remove Success 202.78 test_multipleips_per_nic.py
login_test_saml_user Success 19.23 test_login.py
test_assign_and_removal_lb Success 133.22 test_loadbalance.py
test_02_create_lb_rule_non_nat Success 187.18 test_loadbalance.py
test_01_create_lb_rule_src_nat Success 217.52 test_loadbalance.py
test_07_list_default_iso Success 0.06 test_iso.py
test_05_iso_permissions Success 0.06 test_iso.py
test_04_extract_Iso Success 5.19 test_iso.py
test_03_delete_iso Success 95.15 test_iso.py
test_02_edit_iso Success 0.06 test_iso.py
test_01_create_iso Success 21.00 test_iso.py
test_04_rvpc_internallb_haproxy_stats_on_all_interfaces Success 237.97 test_internal_lb.py
test_03_vpc_internallb_haproxy_stats_on_all_interfaces Success 183.91 test_internal_lb.py
test_02_internallb_roundrobin_1RVPC_3VM_HTTP_port80 Success 520.34 test_internal_lb.py
test_01_internallb_roundrobin_1VPC_3VM_HTTP_port80 Success 425.31 test_internal_lb.py
test_dedicateGuestVlanRange Success 10.30 test_guest_vlan_range.py
test_UpdateConfigParamWithScope Success 0.14 test_global_settings.py
test_rolepermission_lifecycle_update Success 6.17 test_dynamicroles.py
test_rolepermission_lifecycle_list Success 6.00 test_dynamicroles.py
test_rolepermission_lifecycle_delete Success 5.91 test_dynamicroles.py
test_rolepermission_lifecycle_create Success 5.92 test_dynamicroles.py
test_rolepermission_lifecycle_concurrent_updates Success 6.01 test_dynamicroles.py
test_role_lifecycle_update_role_inuse Success 5.93 test_dynamicroles.py
test_role_lifecycle_update Success 10.98 test_dynamicroles.py
test_role_lifecycle_list Success 5.91 test_dynamicroles.py
test_role_lifecycle_delete Success 10.94 test_dynamicroles.py
test_role_lifecycle_create Success 5.91 test_dynamicroles.py
test_role_inuse_deletion Success 5.87 test_dynamicroles.py
test_role_account_acls_multiple_mgmt_servers Success 8.07 test_dynamicroles.py
test_role_account_acls Success 8.39 test_dynamicroles.py
test_default_role_deletion Success 6.00 test_dynamicroles.py
test_04_create_fat_type_disk_offering Success 0.07 test_disk_offerings.py
test_03_delete_disk_offering Success 0.04 test_disk_offerings.py
test_02_edit_disk_offering Success 0.05 test_disk_offerings.py
test_02_create_sparse_type_disk_offering Success 0.07 test_disk_offerings.py
test_01_create_disk_offering Success 0.11 test_disk_offerings.py
test_deployvm_userdispersing Success 20.58 test_deploy_vms_with_varied_deploymentplanners.py
test_deployvm_userconcentrated Success 20.57 test_deploy_vms_with_varied_deploymentplanners.py
test_deployvm_firstfit Success 85.82 test_deploy_vms_with_varied_deploymentplanners.py
test_deployvm_userdata_post Success 35.71 test_deploy_vm_with_userdata.py
test_deployvm_userdata Success 96.34 test_deploy_vm_with_userdata.py
test_02_deploy_vm_root_resize Success 5.99 test_deploy_vm_root_resize.py
test_01_deploy_vm_root_resize Success 5.98 test_deploy_vm_root_resize.py
test_00_deploy_vm_root_resize Success 227.64 test_deploy_vm_root_resize.py
test_deploy_vm_from_iso Success 202.45 test_deploy_vm_iso.py
test_DeployVmAntiAffinityGroup Success 121.29 test_affinity_groups.py
test_03_delete_vm_snapshots Skipped 0.00 test_vm_snapshots.py
test_02_revert_vm_snapshots Skipped 0.00 test_vm_snapshots.py
test_01_test_vm_volume_snapshot Skipped 0.00 test_vm_snapshots.py
test_01_create_vm_snapshots Skipped 0.00 test_vm_snapshots.py
test_static_role_account_acls Skipped 0.02 test_staticroles.py
test_11_ss_nfs_version_on_ssvm Skipped 0.02 test_ssvm.py
test_01_scale_vm Skipped 0.00 test_scale_vm.py
test_01_primary_storage_iscsi Skipped 0.04 test_primary_storage.py
test_nested_virtualization_vmware Skipped 0.00 test_nested_virtualization.py
test_06_copy_iso Skipped 0.00 test_iso.py
test_deploy_vgpu_enabled_vm Skipped 0.03 test_deploy_vgpu_enabled_vm.py
test_3d_gpu_support Skipped 0.04 test_deploy_vgpu_enabled_vm.py

@yadvr
Copy link
Member Author

yadvr commented Dec 21, 2016

@blueorangutan package

@blueorangutan
Copy link

blueorangutan commented Dec 21, 2016

@rhtyd a Jenkins job has been kicked to build packages. I'll keep you posted as I make progress.

@blueorangutan
Copy link

blueorangutan commented Dec 21, 2016

Packaging result: ✔centos6 ✔centos7 ✔debian. JID-408

@yadvr
Copy link
Member Author

yadvr commented Dec 21, 2016

@blueorangutan test

@blueorangutan
Copy link

blueorangutan commented Dec 21, 2016

@rhtyd a Trillian-Jenkins test job (centos7 mgmt + kvm-centos7) has been kicked to run smoke tests

@blueorangutan
Copy link

blueorangutan commented Dec 22, 2016

Trillian test result (tid-707)
Environment: kvm-centos7 (x2), Advanced Networking with Mgmt server 7
Total time taken: 31664 seconds
Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr1836-t707-kvm-centos7.zip
Test completed. 45 look ok, 4 have error(s)

Test Result Time (s) Test File
test_02_redundant_VPC_default_routes Failure 847.87 test_vpc_redundant.py
test_10_attachAndDetach_iso Failure 683.85 test_vm_life_cycle.py
test_04_rvpc_privategw_static_routes Failure 359.76 test_privategw_acl.py
test_09_delete_detached_volume Error 10.15 test_volumes.py
test_08_resize_volume Error 5.06 test_volumes.py
test_07_resize_fail Error 10.19 test_volumes.py
test_06_download_detached_volume Error 5.07 test_volumes.py
test_05_detach_volume Error 5.07 test_volumes.py
test_04_delete_attached_volume Error 5.07 test_volumes.py
test_03_download_attached_volume Error 5.06 test_volumes.py
test_01_create_volume Error 249.45 test_volumes.py
test_01_vpc_site2site_vpn Success 149.26 test_vpc_vpn.py
test_01_vpc_remote_access_vpn Success 66.03 test_vpc_vpn.py
test_01_redundant_vpc_site2site_vpn Success 249.76 test_vpc_vpn.py
test_02_VPC_default_routes Success 464.36 test_vpc_router_nics.py
test_01_VPC_nics_after_destroy Success 817.64 test_vpc_router_nics.py
test_05_rvpc_multi_tiers Success 512.60 test_vpc_redundant.py
test_04_rvpc_network_garbage_collector_nics Success 1396.17 test_vpc_redundant.py
test_03_create_redundant_VPC_1tier_2VMs_2IPs_2PF_ACL_reboot_routers Success 547.10 test_vpc_redundant.py
test_01_create_redundant_VPC_2tiers_4VMs_4IPs_4PF_ACL Success 1281.34 test_vpc_redundant.py
test_02_attach_volume Success 48.66 test_volumes.py
test_deploy_vm_multiple Success 357.37 test_vm_life_cycle.py
test_deploy_vm Success 0.02 test_vm_life_cycle.py
test_advZoneVirtualRouter Success 0.02 test_vm_life_cycle.py
test_09_expunge_vm Success 125.18 test_vm_life_cycle.py
test_08_migrate_vm Success 76.11 test_vm_life_cycle.py
test_07_restore_vm Success 0.09 test_vm_life_cycle.py
test_06_destroy_vm Success 125.73 test_vm_life_cycle.py
test_03_reboot_vm Success 125.63 test_vm_life_cycle.py
test_02_start_vm Success 5.10 test_vm_life_cycle.py
test_01_stop_vm Success 125.65 test_vm_life_cycle.py
test_CreateTemplateWithDuplicateName Success 75.54 test_templates.py
test_08_list_system_templates Success 0.03 test_templates.py
test_07_list_public_templates Success 0.03 test_templates.py
test_05_template_permissions Success 0.05 test_templates.py
test_04_extract_template Success 5.16 test_templates.py
test_03_delete_template Success 5.08 test_templates.py
test_02_edit_template Success 90.08 test_templates.py
test_01_create_template Success 50.40 test_templates.py
test_10_destroy_cpvm Success 166.55 test_ssvm.py
test_09_destroy_ssvm Success 163.07 test_ssvm.py
test_08_reboot_cpvm Success 101.24 test_ssvm.py
test_07_reboot_ssvm Success 133.41 test_ssvm.py
test_06_stop_cpvm Success 136.36 test_ssvm.py
test_05_stop_ssvm Success 133.46 test_ssvm.py
test_04_cpvm_internals Success 0.99 test_ssvm.py
test_03_ssvm_internals Success 3.27 test_ssvm.py
test_02_list_cpvm_vm Success 0.09 test_ssvm.py
test_01_list_sec_storage_vm Success 0.09 test_ssvm.py
test_01_snapshot_root_disk Success 11.03 test_snapshots.py
test_04_change_offering_small Success 239.35 test_service_offerings.py
test_03_delete_service_offering Success 0.03 test_service_offerings.py
test_02_edit_service_offering Success 0.04 test_service_offerings.py
test_01_create_service_offering Success 0.08 test_service_offerings.py
test_02_sys_template_ready Success 0.09 test_secondary_storage.py
test_01_sys_vm_start Success 0.12 test_secondary_storage.py
test_09_reboot_router Success 35.26 test_routers.py
test_08_start_router Success 30.22 test_routers.py
test_07_stop_router Success 10.12 test_routers.py
test_06_router_advanced Success 0.04 test_routers.py
test_05_router_basic Success 0.03 test_routers.py
test_04_restart_network_wo_cleanup Success 5.53 test_routers.py
test_03_restart_network_cleanup Success 55.44 test_routers.py
test_02_router_internal_adv Success 1.03 test_routers.py
test_01_router_internal_basic Success 0.55 test_routers.py
test_router_dns_guestipquery Success 76.67 test_router_dns.py
test_router_dns_externalipquery Success 0.06 test_router_dns.py
test_router_dhcphosts Success 362.75 test_router_dhcphosts.py
test_router_dhcp_opts Success 21.39 test_router_dhcphosts.py
test_01_updatevolumedetail Success 0.06 test_resource_detail.py
test_01_reset_vm_on_reboot Success 185.99 test_reset_vm_on_reboot.py
test_createRegion Success 0.03 test_regions.py
test_create_pvlan_network Success 5.16 test_pvlan.py
test_dedicatePublicIpRange Success 0.33 test_public_ip_range.py
test_03_vpc_privategw_restart_vpc_cleanup Success 674.01 test_privategw_acl.py
test_02_vpc_privategw_static_routes Success 560.13 test_privategw_acl.py
test_01_vpc_privategw_acl Success 81.58 test_privategw_acl.py
test_01_primary_storage_nfs Success 35.66 test_primary_storage.py
test_createPortablePublicIPRange Success 15.14 test_portable_publicip.py
test_createPortablePublicIPAcquire Success 15.32 test_portable_publicip.py
test_isolate_network_password_server Success 88.86 test_password_server.py
test_UpdateStorageOverProvisioningFactor Success 0.09 test_over_provisioning.py
test_oobm_zchange_password Success 30.50 test_outofbandmanagement.py
test_oobm_multiple_mgmt_server_ownership Success 16.32 test_outofbandmanagement.py
test_oobm_issue_power_status Success 20.31 test_outofbandmanagement.py
test_oobm_issue_power_soft Success 15.24 test_outofbandmanagement.py
test_oobm_issue_power_reset Success 15.25 test_outofbandmanagement.py
test_oobm_issue_power_on Success 10.51 test_outofbandmanagement.py
test_oobm_issue_power_off Success 15.24 test_outofbandmanagement.py
test_oobm_issue_power_cycle Success 15.27 test_outofbandmanagement.py
test_oobm_enabledisable_across_clusterzones Success 77.21 test_outofbandmanagement.py
test_oobm_enable_feature_valid Success 5.12 test_outofbandmanagement.py
test_oobm_enable_feature_invalid Success 0.08 test_outofbandmanagement.py
test_oobm_disable_feature_valid Success 5.14 test_outofbandmanagement.py
test_oobm_disable_feature_invalid Success 0.08 test_outofbandmanagement.py
test_oobm_configure_invalid_driver Success 0.06 test_outofbandmanagement.py
test_oobm_configure_default_driver Success 0.06 test_outofbandmanagement.py
test_oobm_background_powerstate_sync Success 23.32 test_outofbandmanagement.py
test_extendPhysicalNetworkVlan Success 15.23 test_non_contigiousvlan.py
test_01_nic Success 644.98 test_nic.py
test_releaseIP Success 287.33 test_network.py
test_reboot_router Success 478.38 test_network.py
test_public_ip_user_account Success 10.19 test_network.py
test_public_ip_admin_account Success 40.19 test_network.py
test_network_rules_acquired_public_ip_3_Load_Balancer_Rule Success 66.50 test_network.py
test_network_rules_acquired_public_ip_2_nat_rule Success 61.32 test_network.py
test_network_rules_acquired_public_ip_1_static_nat_rule Success 123.40 test_network.py
test_delete_account Success 302.14 test_network.py
test_02_port_fwd_on_non_src_nat Success 55.47 test_network.py
test_01_port_fwd_on_src_nat Success 111.61 test_network.py
test_nic_secondaryip_add_remove Success 237.08 test_multipleips_per_nic.py
login_test_saml_user Success 17.79 test_login.py
test_assign_and_removal_lb Success 132.89 test_loadbalance.py
test_02_create_lb_rule_non_nat Success 186.96 test_loadbalance.py
test_01_create_lb_rule_src_nat Success 207.44 test_loadbalance.py
test_03_list_snapshots Success 0.06 test_list_ids_parameter.py
test_02_list_templates Success 0.03 test_list_ids_parameter.py
test_01_list_volumes Success 0.02 test_list_ids_parameter.py
test_07_list_default_iso Success 0.04 test_iso.py
test_05_iso_permissions Success 0.04 test_iso.py
test_04_extract_Iso Success 5.27 test_iso.py
test_03_delete_iso Success 95.11 test_iso.py
test_02_edit_iso Success 0.04 test_iso.py
test_01_create_iso Success 20.67 test_iso.py
test_04_rvpc_internallb_haproxy_stats_on_all_interfaces Success 222.82 test_internal_lb.py
test_03_vpc_internallb_haproxy_stats_on_all_interfaces Success 177.04 test_internal_lb.py
test_02_internallb_roundrobin_1RVPC_3VM_HTTP_port80 Success 520.88 test_internal_lb.py
test_01_internallb_roundrobin_1VPC_3VM_HTTP_port80 Success 403.06 test_internal_lb.py
test_dedicateGuestVlanRange Success 10.20 test_guest_vlan_range.py
test_UpdateConfigParamWithScope Success 0.11 test_global_settings.py
test_rolepermission_lifecycle_update Success 5.79 test_dynamicroles.py
test_rolepermission_lifecycle_list Success 5.67 test_dynamicroles.py
test_rolepermission_lifecycle_delete Success 5.58 test_dynamicroles.py
test_rolepermission_lifecycle_create Success 5.59 test_dynamicroles.py
test_rolepermission_lifecycle_concurrent_updates Success 5.75 test_dynamicroles.py
test_role_lifecycle_update_role_inuse Success 5.60 test_dynamicroles.py
test_role_lifecycle_update Success 10.66 test_dynamicroles.py
test_role_lifecycle_list Success 5.61 test_dynamicroles.py
test_role_lifecycle_delete Success 5.61 test_dynamicroles.py
test_role_lifecycle_create Success 5.61 test_dynamicroles.py
test_role_inuse_deletion Success 5.59 test_dynamicroles.py
test_role_account_acls_multiple_mgmt_servers Success 6.99 test_dynamicroles.py
test_role_account_acls Success 7.02 test_dynamicroles.py
test_default_role_deletion Success 5.85 test_dynamicroles.py
test_04_create_fat_type_disk_offering Success 0.05 test_disk_offerings.py
test_03_delete_disk_offering Success 0.03 test_disk_offerings.py
test_02_edit_disk_offering Success 0.04 test_disk_offerings.py
test_02_create_sparse_type_disk_offering Success 0.13 test_disk_offerings.py
test_01_create_disk_offering Success 0.08 test_disk_offerings.py
test_deployvm_userdispersing Success 20.40 test_deploy_vms_with_varied_deploymentplanners.py
test_deployvm_userconcentrated Success 45.52 test_deploy_vms_with_varied_deploymentplanners.py
test_deployvm_firstfit Success 45.42 test_deploy_vms_with_varied_deploymentplanners.py
test_deployvm_userdata_post Success 10.29 test_deploy_vm_with_userdata.py
test_deployvm_userdata Success 45.47 test_deploy_vm_with_userdata.py
test_02_deploy_vm_root_resize Success 5.67 test_deploy_vm_root_resize.py
test_01_deploy_vm_root_resize Success 5.65 test_deploy_vm_root_resize.py
test_00_deploy_vm_root_resize Success 252.34 test_deploy_vm_root_resize.py
test_deploy_vm_from_iso Success 202.16 test_deploy_vm_iso.py
test_DeployVmAntiAffinityGroup Success 70.68 test_affinity_groups.py
test_03_delete_vm_snapshots Skipped 0.00 test_vm_snapshots.py
test_02_revert_vm_snapshots Skipped 0.00 test_vm_snapshots.py
test_01_test_vm_volume_snapshot Skipped 0.00 test_vm_snapshots.py
test_01_create_vm_snapshots Skipped 0.00 test_vm_snapshots.py
test_06_copy_template Skipped 0.00 test_templates.py
test_static_role_account_acls Skipped 0.02 test_staticroles.py
test_11_ss_nfs_version_on_ssvm Skipped 0.02 test_ssvm.py
test_01_scale_vm Skipped 0.00 test_scale_vm.py
test_01_primary_storage_iscsi Skipped 0.03 test_primary_storage.py
test_nested_virtualization_vmware Skipped 0.00 test_nested_virtualization.py
test_06_copy_iso Skipped 0.00 test_iso.py
test_deploy_vgpu_enabled_vm Skipped 0.02 test_deploy_vgpu_enabled_vm.py
test_3d_gpu_support Skipped 0.03 test_deploy_vgpu_enabled_vm.py

@yadvr
Copy link
Member Author

yadvr commented Dec 23, 2016

@blueorangutan package

@blueorangutan
Copy link

blueorangutan commented Dec 23, 2016

@rhtyd a Jenkins job has been kicked to build packages. I'll keep you posted as I make progress.

@blueorangutan
Copy link

blueorangutan commented Dec 23, 2016

Packaging result: ✔centos6 ✔centos7 ✔debian. JID-418

@yadvr
Copy link
Member Author

yadvr commented Dec 24, 2016

@blueorangutan package

@blueorangutan
Copy link

blueorangutan commented Dec 24, 2016

@rhtyd a Jenkins job has been kicked to build packages. I'll keep you posted as I make progress.

@blueorangutan
Copy link

blueorangutan commented Dec 24, 2016

Packaging result: ✔centos6 ✔centos7 ✔debian. JID-424

@yadvr
Copy link
Member Author

yadvr commented Dec 24, 2016

@blueorangutan test matrix

@blueorangutan
Copy link

blueorangutan commented Dec 24, 2016

@rhtyd a Trillian-Jenkins matrix job (centos6 mgmt + xs65sp1, centos7 mgmt + vmware55u3, centos7 mgmt + kvmcentos7) has been kicked to run smoke tests

@blueorangutan
Copy link

blueorangutan commented Dec 24, 2016

Trillian test result (tid-730)
Environment: kvm-centos7 (x2), Advanced Networking with Mgmt server 7
Total time taken: 42472 seconds
Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr1836-t730-kvm-centos7.zip
Intermitten failure detected: /marvin/tests/smoke/test_privategw_acl.py
Intermitten failure detected: /marvin/tests/smoke/test_routers_network_ops.py
Intermitten failure detected: /marvin/tests/smoke/test_volumes.py
Intermitten failure detected: /marvin/tests/smoke/test_vpc_redundant.py
Test completed. 46 look ok, 3 have error(s)

Test Result Time (s) Test File
test_02_redundant_VPC_default_routes Failure 863.59 test_vpc_redundant.py
test_04_rvpc_privategw_static_routes Failure 360.42 test_privategw_acl.py
test_01_create_volume Error 249.64 test_volumes.py
test_01_vpc_site2site_vpn Success 149.90 test_vpc_vpn.py
test_01_vpc_remote_access_vpn Success 61.16 test_vpc_vpn.py
test_01_redundant_vpc_site2site_vpn Success 225.56 test_vpc_vpn.py
test_02_VPC_default_routes Success 439.62 test_vpc_router_nics.py
test_01_VPC_nics_after_destroy Success 824.37 test_vpc_router_nics.py
test_05_rvpc_multi_tiers Success 505.08 test_vpc_redundant.py
test_04_rvpc_network_garbage_collector_nics Success 1329.49 test_vpc_redundant.py
test_03_create_redundant_VPC_1tier_2VMs_2IPs_2PF_ACL_reboot_routers Success 537.50 test_vpc_redundant.py
test_01_create_redundant_VPC_2tiers_4VMs_4IPs_4PF_ACL Success 1273.47 test_vpc_redundant.py
test_09_delete_detached_volume Success 156.46 test_volumes.py
test_08_resize_volume Success 156.35 test_volumes.py
test_07_resize_fail Success 161.39 test_volumes.py
test_06_download_detached_volume Success 156.42 test_volumes.py
test_05_detach_volume Success 236.19 test_volumes.py
test_04_delete_attached_volume Success 146.07 test_volumes.py
test_03_download_attached_volume Success 151.16 test_volumes.py
test_02_attach_volume Success 184.71 test_volumes.py
test_deploy_vm_multiple Success 383.21 test_vm_life_cycle.py
test_deploy_vm Success 0.03 test_vm_life_cycle.py
test_advZoneVirtualRouter Success 0.02 test_vm_life_cycle.py
test_10_attachAndDetach_iso Success 26.58 test_vm_life_cycle.py
test_09_expunge_vm Success 125.23 test_vm_life_cycle.py
test_08_migrate_vm Success 35.84 test_vm_life_cycle.py
test_07_restore_vm Success 0.12 test_vm_life_cycle.py
test_06_destroy_vm Success 125.76 test_vm_life_cycle.py
test_03_reboot_vm Success 125.84 test_vm_life_cycle.py
test_02_start_vm Success 10.15 test_vm_life_cycle.py
test_01_stop_vm Success 125.76 test_vm_life_cycle.py
test_CreateTemplateWithDuplicateName Success 80.64 test_templates.py
test_08_list_system_templates Success 0.04 test_templates.py
test_07_list_public_templates Success 0.04 test_templates.py
test_05_template_permissions Success 0.08 test_templates.py
test_04_extract_template Success 5.15 test_templates.py
test_03_delete_template Success 5.10 test_templates.py
test_02_edit_template Success 90.11 test_templates.py
test_01_create_template Success 45.43 test_templates.py
test_10_destroy_cpvm Success 161.47 test_ssvm.py
test_09_destroy_ssvm Success 198.28 test_ssvm.py
test_08_reboot_cpvm Success 101.42 test_ssvm.py
test_07_reboot_ssvm Success 103.13 test_ssvm.py
test_06_stop_cpvm Success 131.43 test_ssvm.py
test_05_stop_ssvm Success 133.21 test_ssvm.py
test_04_cpvm_internals Success 0.94 test_ssvm.py
test_03_ssvm_internals Success 2.99 test_ssvm.py
test_02_list_cpvm_vm Success 0.11 test_ssvm.py
test_01_list_sec_storage_vm Success 0.12 test_ssvm.py
test_01_snapshot_root_disk Success 16.27 test_snapshots.py
test_04_change_offering_small Success 209.53 test_service_offerings.py
test_03_delete_service_offering Success 0.04 test_service_offerings.py
test_02_edit_service_offering Success 0.10 test_service_offerings.py
test_01_create_service_offering Success 0.07 test_service_offerings.py
test_02_sys_template_ready Success 0.12 test_secondary_storage.py
test_01_sys_vm_start Success 0.17 test_secondary_storage.py
test_09_reboot_router Success 35.29 test_routers.py
test_08_start_router Success 35.31 test_routers.py
test_07_stop_router Success 10.15 test_routers.py
test_06_router_advanced Success 0.05 test_routers.py
test_05_router_basic Success 0.04 test_routers.py
test_04_restart_network_wo_cleanup Success 5.61 test_routers.py
test_03_restart_network_cleanup Success 60.54 test_routers.py
test_02_router_internal_adv Success 0.84 test_routers.py
test_01_router_internal_basic Success 0.45 test_routers.py
test_router_dns_guestipquery Success 76.64 test_router_dns.py
test_router_dns_externalipquery Success 0.09 test_router_dns.py
test_router_dhcphosts Success 362.14 test_router_dhcphosts.py
test_router_dhcp_opts Success 21.47 test_router_dhcphosts.py
test_01_updatevolumedetail Success 0.08 test_resource_detail.py
test_01_reset_vm_on_reboot Success 130.93 test_reset_vm_on_reboot.py
test_createRegion Success 0.04 test_regions.py
test_create_pvlan_network Success 5.20 test_pvlan.py
test_dedicatePublicIpRange Success 0.42 test_public_ip_range.py
test_03_vpc_privategw_restart_vpc_cleanup Success 710.82 test_privategw_acl.py
test_02_vpc_privategw_static_routes Success 560.95 test_privategw_acl.py
test_01_vpc_privategw_acl Success 82.08 test_privategw_acl.py
test_01_primary_storage_nfs Success 35.74 test_primary_storage.py
test_createPortablePublicIPRange Success 15.18 test_portable_publicip.py
test_createPortablePublicIPAcquire Success 15.50 test_portable_publicip.py
test_isolate_network_password_server Success 59.55 test_password_server.py
test_UpdateStorageOverProvisioningFactor Success 0.12 test_over_provisioning.py
test_oobm_zchange_password Success 30.62 test_outofbandmanagement.py
test_oobm_multiple_mgmt_server_ownership Success 16.34 test_outofbandmanagement.py
test_oobm_issue_power_status Success 10.24 test_outofbandmanagement.py
test_oobm_issue_power_soft Success 15.32 test_outofbandmanagement.py
test_oobm_issue_power_reset Success 15.33 test_outofbandmanagement.py
test_oobm_issue_power_on Success 15.31 test_outofbandmanagement.py
test_oobm_issue_power_off Success 15.31 test_outofbandmanagement.py
test_oobm_issue_power_cycle Success 15.31 test_outofbandmanagement.py
test_oobm_enabledisable_across_clusterzones Success 87.61 test_outofbandmanagement.py
test_oobm_enable_feature_valid Success 5.15 test_outofbandmanagement.py
test_oobm_enable_feature_invalid Success 0.09 test_outofbandmanagement.py
test_oobm_disable_feature_valid Success 5.18 test_outofbandmanagement.py
test_oobm_disable_feature_invalid Success 0.11 test_outofbandmanagement.py
test_oobm_configure_invalid_driver Success 0.07 test_outofbandmanagement.py
test_oobm_configure_default_driver Success 0.07 test_outofbandmanagement.py
test_oobm_background_powerstate_sync Success 23.41 test_outofbandmanagement.py
test_extendPhysicalNetworkVlan Success 15.30 test_non_contigiousvlan.py
test_01_nic Success 534.74 test_nic.py
test_releaseIP Success 278.16 test_network.py
test_reboot_router Success 504.06 test_network.py
test_public_ip_user_account Success 10.24 test_network.py
test_public_ip_admin_account Success 40.27 test_network.py
test_network_rules_acquired_public_ip_3_Load_Balancer_Rule Success 66.83 test_network.py
test_network_rules_acquired_public_ip_2_nat_rule Success 61.49 test_network.py
test_network_rules_acquired_public_ip_1_static_nat_rule Success 123.66 test_network.py
test_delete_account Success 278.02 test_network.py
test_02_port_fwd_on_non_src_nat Success 55.61 test_network.py
test_01_port_fwd_on_src_nat Success 109.74 test_network.py
test_nic_secondaryip_add_remove Success 202.49 test_multipleips_per_nic.py
login_test_saml_user Success 19.07 test_login.py
test_assign_and_removal_lb Success 132.80 test_loadbalance.py
test_02_create_lb_rule_non_nat Success 186.83 test_loadbalance.py
test_01_create_lb_rule_src_nat Success 207.36 test_loadbalance.py
test_03_list_snapshots Success 0.10 test_list_ids_parameter.py
test_02_list_templates Success 0.04 test_list_ids_parameter.py
test_01_list_volumes Success 0.03 test_list_ids_parameter.py
test_07_list_default_iso Success 0.06 test_iso.py
test_05_iso_permissions Success 0.06 test_iso.py
test_04_extract_Iso Success 5.15 test_iso.py
test_03_delete_iso Success 95.12 test_iso.py
test_02_edit_iso Success 0.06 test_iso.py
test_01_create_iso Success 20.99 test_iso.py
test_04_rvpc_internallb_haproxy_stats_on_all_interfaces Success 212.79 test_internal_lb.py
test_03_vpc_internallb_haproxy_stats_on_all_interfaces Success 138.22 test_internal_lb.py
test_02_internallb_roundrobin_1RVPC_3VM_HTTP_port80 Success 540.02 test_internal_lb.py
test_01_internallb_roundrobin_1VPC_3VM_HTTP_port80 Success 441.27 test_internal_lb.py
test_dedicateGuestVlanRange Success 10.26 test_guest_vlan_range.py
test_UpdateConfigParamWithScope Success 0.13 test_global_settings.py
test_rolepermission_lifecycle_update Success 6.10 test_dynamicroles.py
test_rolepermission_lifecycle_list Success 5.96 test_dynamicroles.py
test_rolepermission_lifecycle_delete Success 5.84 test_dynamicroles.py
test_rolepermission_lifecycle_create Success 5.87 test_dynamicroles.py
test_rolepermission_lifecycle_concurrent_updates Success 5.96 test_dynamicroles.py
test_role_lifecycle_update_role_inuse Success 5.87 test_dynamicroles.py
test_role_lifecycle_update Success 10.95 test_dynamicroles.py
test_role_lifecycle_list Success 5.86 test_dynamicroles.py
test_role_lifecycle_delete Success 11.09 test_dynamicroles.py
test_role_lifecycle_create Success 5.87 test_dynamicroles.py
test_role_inuse_deletion Success 5.86 test_dynamicroles.py
test_role_account_acls_multiple_mgmt_servers Success 8.13 test_dynamicroles.py
test_role_account_acls Success 8.23 test_dynamicroles.py
test_default_role_deletion Success 5.96 test_dynamicroles.py
test_04_create_fat_type_disk_offering Success 0.06 test_disk_offerings.py
test_03_delete_disk_offering Success 0.03 test_disk_offerings.py
test_02_edit_disk_offering Success 0.04 test_disk_offerings.py
test_02_create_sparse_type_disk_offering Success 0.06 test_disk_offerings.py
test_01_create_disk_offering Success 0.10 test_disk_offerings.py
test_deployvm_userdispersing Success 20.57 test_deploy_vms_with_varied_deploymentplanners.py
test_deployvm_userconcentrated Success 106.07 test_deploy_vms_with_varied_deploymentplanners.py
test_deployvm_firstfit Success 55.69 test_deploy_vms_with_varied_deploymentplanners.py
test_deployvm_userdata_post Success 10.40 test_deploy_vm_with_userdata.py
test_deployvm_userdata Success 45.70 test_deploy_vm_with_userdata.py
test_02_deploy_vm_root_resize Success 6.16 test_deploy_vm_root_resize.py
test_01_deploy_vm_root_resize Success 5.96 test_deploy_vm_root_resize.py
test_00_deploy_vm_root_resize Success 227.75 test_deploy_vm_root_resize.py
test_deploy_vm_from_iso Success 207.40 test_deploy_vm_iso.py
test_DeployVmAntiAffinityGroup Success 56.02 test_affinity_groups.py
test_03_delete_vm_snapshots Skipped 0.00 test_vm_snapshots.py
test_02_revert_vm_snapshots Skipped 0.00 test_vm_snapshots.py
test_01_test_vm_volume_snapshot Skipped 0.00 test_vm_snapshots.py
test_01_create_vm_snapshots Skipped 0.00 test_vm_snapshots.py
test_06_copy_template Skipped 0.00 test_templates.py
test_static_role_account_acls Skipped 0.02 test_staticroles.py
test_11_ss_nfs_version_on_ssvm Skipped 0.02 test_ssvm.py
test_01_scale_vm Skipped 0.00 test_scale_vm.py
test_01_primary_storage_iscsi Skipped 0.03 test_primary_storage.py
test_nested_virtualization_vmware Skipped 0.00 test_nested_virtualization.py
test_06_copy_iso Skipped 0.00 test_iso.py
test_deploy_vgpu_enabled_vm Skipped 0.03 test_deploy_vgpu_enabled_vm.py
test_3d_gpu_support Skipped 0.03 test_deploy_vgpu_enabled_vm.py

@blueorangutan
Copy link

blueorangutan commented Dec 24, 2016

Trillian test result (tid-729)
Environment: xenserver-65sp1 (x2), Advanced Networking with Mgmt server 6
Total time taken: 43743 seconds
Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr1836-t729-xenserver-65sp1.zip
Intermitten failure detected: /marvin/tests/smoke/test_primary_storage.py
Intermitten failure detected: /marvin/tests/smoke/test_privategw_acl.py
Intermitten failure detected: /marvin/tests/smoke/test_routers_network_ops.py
Intermitten failure detected: /marvin/tests/smoke/test_vpc_redundant.py
Test completed. 46 look ok, 3 have error(s)

Test Result Time (s) Test File
test_05_rvpc_multi_tiers Failure 542.11 test_vpc_redundant.py
test_04_rvpc_network_garbage_collector_nics Failure 1371.62 test_vpc_redundant.py
test_01_create_redundant_VPC_2tiers_4VMs_4IPs_4PF_ACL Failure 563.55 test_vpc_redundant.py
test_04_rvpc_privategw_static_routes Failure 841.27 test_privategw_acl.py
test_01_primary_storage_iscsi Error 3.36 test_primary_storage.py
test_01_vpc_site2site_vpn Success 312.07 test_vpc_vpn.py
test_01_vpc_remote_access_vpn Success 161.99 test_vpc_vpn.py
test_01_redundant_vpc_site2site_vpn Success 563.88 test_vpc_vpn.py
test_02_VPC_default_routes Success 325.32 test_vpc_router_nics.py
test_01_VPC_nics_after_destroy Success 675.62 test_vpc_router_nics.py
test_03_create_redundant_VPC_1tier_2VMs_2IPs_2PF_ACL_reboot_routers Success 846.67 test_vpc_redundant.py
test_02_redundant_VPC_default_routes Success 1049.17 test_vpc_redundant.py
test_09_delete_detached_volume Success 15.79 test_volumes.py
test_08_resize_volume Success 91.04 test_volumes.py
test_07_resize_fail Success 101.17 test_volumes.py
test_06_download_detached_volume Success 20.42 test_volumes.py
test_05_detach_volume Success 100.34 test_volumes.py
test_04_delete_attached_volume Success 10.26 test_volumes.py
test_03_download_attached_volume Success 15.36 test_volumes.py
test_02_attach_volume Success 10.76 test_volumes.py
test_01_create_volume Success 397.76 test_volumes.py
test_03_delete_vm_snapshots Success 280.21 test_vm_snapshots.py
test_02_revert_vm_snapshots Success 207.56 test_vm_snapshots.py
test_01_create_vm_snapshots Success 100.97 test_vm_snapshots.py
test_deploy_vm_multiple Success 273.33 test_vm_life_cycle.py
test_deploy_vm Success 0.03 test_vm_life_cycle.py
test_advZoneVirtualRouter Success 0.03 test_vm_life_cycle.py
test_10_attachAndDetach_iso Success 31.95 test_vm_life_cycle.py
test_09_expunge_vm Success 125.28 test_vm_life_cycle.py
test_08_migrate_vm Success 66.33 test_vm_life_cycle.py
test_07_restore_vm Success 0.16 test_vm_life_cycle.py
test_06_destroy_vm Success 10.19 test_vm_life_cycle.py
test_03_reboot_vm Success 20.28 test_vm_life_cycle.py
test_02_start_vm Success 25.30 test_vm_life_cycle.py
test_01_stop_vm Success 35.38 test_vm_life_cycle.py
test_CreateTemplateWithDuplicateName Success 131.21 test_templates.py
test_08_list_system_templates Success 0.03 test_templates.py
test_07_list_public_templates Success 0.04 test_templates.py
test_05_template_permissions Success 0.06 test_templates.py
test_04_extract_template Success 5.25 test_templates.py
test_03_delete_template Success 5.12 test_templates.py
test_02_edit_template Success 90.18 test_templates.py
test_01_create_template Success 60.67 test_templates.py
test_10_destroy_cpvm Success 196.84 test_ssvm.py
test_09_destroy_ssvm Success 258.93 test_ssvm.py
test_08_reboot_cpvm Success 121.71 test_ssvm.py
test_07_reboot_ssvm Success 143.93 test_ssvm.py
test_06_stop_cpvm Success 136.79 test_ssvm.py
test_05_stop_ssvm Success 169.05 test_ssvm.py
test_04_cpvm_internals Success 1.02 test_ssvm.py
test_03_ssvm_internals Success 3.49 test_ssvm.py
test_02_list_cpvm_vm Success 0.13 test_ssvm.py
test_01_list_sec_storage_vm Success 0.14 test_ssvm.py
test_01_snapshot_root_disk Success 21.63 test_snapshots.py
test_04_change_offering_small Success 86.11 test_service_offerings.py
test_03_delete_service_offering Success 0.05 test_service_offerings.py
test_02_edit_service_offering Success 0.12 test_service_offerings.py
test_01_create_service_offering Success 0.10 test_service_offerings.py
test_02_sys_template_ready Success 0.16 test_secondary_storage.py
test_01_sys_vm_start Success 0.20 test_secondary_storage.py
test_01_scale_vm Success 5.29 test_scale_vm.py
test_09_reboot_router Success 75.70 test_routers.py
test_08_start_router Success 50.53 test_routers.py
test_07_stop_router Success 15.26 test_routers.py
test_06_router_advanced Success 0.07 test_routers.py
test_05_router_basic Success 0.05 test_routers.py
test_04_restart_network_wo_cleanup Success 5.56 test_routers.py
test_03_restart_network_cleanup Success 146.43 test_routers.py
test_02_router_internal_adv Success 0.80 test_routers.py
test_01_router_internal_basic Success 0.44 test_routers.py
test_router_dns_guestipquery Success 48.94 test_router_dns.py
test_router_dns_externalipquery Success 0.07 test_router_dns.py
test_router_dhcphosts Success 108.08 test_router_dhcphosts.py
test_router_dhcp_opts Success 31.65 test_router_dhcphosts.py
test_01_updatevolumedetail Success 0.10 test_resource_detail.py
test_01_reset_vm_on_reboot Success 50.58 test_reset_vm_on_reboot.py
test_createRegion Success 0.05 test_regions.py
test_create_pvlan_network Success 5.26 test_pvlan.py
test_dedicatePublicIpRange Success 0.57 test_public_ip_range.py
test_03_vpc_privategw_restart_vpc_cleanup Success 930.94 test_privategw_acl.py
test_02_vpc_privategw_static_routes Success 603.69 test_privategw_acl.py
test_01_vpc_privategw_acl Success 163.54 test_privategw_acl.py
test_01_primary_storage_nfs Success 38.78 test_primary_storage.py
test_createPortablePublicIPRange Success 15.25 test_portable_publicip.py
test_createPortablePublicIPAcquire Success 15.64 test_portable_publicip.py
test_isolate_network_password_server Success 36.19 test_password_server.py
test_UpdateStorageOverProvisioningFactor Success 0.16 test_over_provisioning.py
test_oobm_zchange_password Success 30.89 test_outofbandmanagement.py
test_oobm_multiple_mgmt_server_ownership Success 16.41 test_outofbandmanagement.py
test_oobm_issue_power_status Success 10.37 test_outofbandmanagement.py
test_oobm_issue_power_soft Success 15.54 test_outofbandmanagement.py
test_oobm_issue_power_reset Success 15.44 test_outofbandmanagement.py
test_oobm_issue_power_on Success 15.63 test_outofbandmanagement.py
test_oobm_issue_power_off Success 10.42 test_outofbandmanagement.py
test_oobm_issue_power_cycle Success 15.41 test_outofbandmanagement.py
test_oobm_enabledisable_across_clusterzones Success 82.99 test_outofbandmanagement.py
test_oobm_enable_feature_valid Success 5.22 test_outofbandmanagement.py
test_oobm_enable_feature_invalid Success 0.11 test_outofbandmanagement.py
test_oobm_disable_feature_valid Success 5.27 test_outofbandmanagement.py
test_oobm_disable_feature_invalid Success 0.13 test_outofbandmanagement.py
test_oobm_configure_invalid_driver Success 0.09 test_outofbandmanagement.py
test_oobm_configure_default_driver Success 0.12 test_outofbandmanagement.py
test_oobm_background_powerstate_sync Success 29.54 test_outofbandmanagement.py
test_extendPhysicalNetworkVlan Success 15.41 test_non_contigiousvlan.py
test_01_nic Success 622.17 test_nic.py
test_releaseIP Success 309.25 test_network.py
test_reboot_router Success 641.30 test_network.py
test_public_ip_user_account Success 10.32 test_network.py
test_public_ip_admin_account Success 40.36 test_network.py
test_network_rules_acquired_public_ip_3_Load_Balancer_Rule Success 86.93 test_network.py
test_network_rules_acquired_public_ip_2_nat_rule Success 76.77 test_network.py
test_network_rules_acquired_public_ip_1_static_nat_rule Success 103.38 test_network.py
test_delete_account Success 344.02 test_network.py
test_02_port_fwd_on_non_src_nat Success 70.89 test_network.py
test_01_port_fwd_on_src_nat Success 83.93 test_network.py
test_nic_secondaryip_add_remove Success 228.52 test_multipleips_per_nic.py
login_test_saml_user Success 19.59 test_login.py
test_assign_and_removal_lb Success 148.84 test_loadbalance.py
test_02_create_lb_rule_non_nat Success 207.77 test_loadbalance.py
test_01_create_lb_rule_src_nat Success 208.37 test_loadbalance.py
test_03_list_snapshots Success 0.13 test_list_ids_parameter.py
test_02_list_templates Success 0.05 test_list_ids_parameter.py
test_01_list_volumes Success 0.03 test_list_ids_parameter.py
test_07_list_default_iso Success 0.07 test_iso.py
test_05_iso_permissions Success 0.07 test_iso.py
test_04_extract_Iso Success 5.22 test_iso.py
test_03_delete_iso Success 95.23 test_iso.py
test_02_edit_iso Success 0.07 test_iso.py
test_01_create_iso Success 21.16 test_iso.py
test_04_rvpc_internallb_haproxy_stats_on_all_interfaces Success 490.70 test_internal_lb.py
test_03_vpc_internallb_haproxy_stats_on_all_interfaces Success 314.41 test_internal_lb.py
test_02_internallb_roundrobin_1RVPC_3VM_HTTP_port80 Success 996.71 test_internal_lb.py
test_01_internallb_roundrobin_1VPC_3VM_HTTP_port80 Success 664.59 test_internal_lb.py
test_dedicateGuestVlanRange Success 10.34 test_guest_vlan_range.py
test_UpdateConfigParamWithScope Success 0.17 test_global_settings.py
test_rolepermission_lifecycle_update Success 6.33 test_dynamicroles.py
test_rolepermission_lifecycle_list Success 6.16 test_dynamicroles.py
test_rolepermission_lifecycle_delete Success 5.98 test_dynamicroles.py
test_rolepermission_lifecycle_create Success 6.03 test_dynamicroles.py
test_rolepermission_lifecycle_concurrent_updates Success 6.17 test_dynamicroles.py
test_role_lifecycle_update_role_inuse Success 6.06 test_dynamicroles.py
test_role_lifecycle_update Success 11.36 test_dynamicroles.py
test_role_lifecycle_list Success 6.06 test_dynamicroles.py
test_role_lifecycle_delete Success 11.17 test_dynamicroles.py
test_role_lifecycle_create Success 6.04 test_dynamicroles.py
test_role_inuse_deletion Success 5.97 test_dynamicroles.py
test_role_account_acls_multiple_mgmt_servers Success 8.66 test_dynamicroles.py
test_role_account_acls Success 8.89 test_dynamicroles.py
test_default_role_deletion Success 6.29 test_dynamicroles.py
test_04_create_fat_type_disk_offering Success 0.10 test_disk_offerings.py
test_03_delete_disk_offering Success 0.05 test_disk_offerings.py
test_02_edit_disk_offering Success 0.06 test_disk_offerings.py
test_02_create_sparse_type_disk_offering Success 0.10 test_disk_offerings.py
test_01_create_disk_offering Success 0.14 test_disk_offerings.py
test_deployvm_userdispersing Success 45.91 test_deploy_vms_with_varied_deploymentplanners.py
test_deployvm_userconcentrated Success 111.49 test_deploy_vms_with_varied_deploymentplanners.py
test_deployvm_firstfit Success 186.92 test_deploy_vms_with_varied_deploymentplanners.py
test_deployvm_userdata_post Success 91.10 test_deploy_vm_with_userdata.py
test_deployvm_userdata Success 126.41 test_deploy_vm_with_userdata.py
test_02_deploy_vm_root_resize Success 5.99 test_deploy_vm_root_resize.py
test_01_deploy_vm_root_resize Success 6.21 test_deploy_vm_root_resize.py
test_00_deploy_vm_root_resize Success 6.11 test_deploy_vm_root_resize.py
test_deploy_vm_from_iso Success 177.72 test_deploy_vm_iso.py
test_DeployVmAntiAffinityGroup Success 141.75 test_affinity_groups.py
test_01_test_vm_volume_snapshot Skipped 0.00 test_vm_snapshots.py
test_06_copy_template Skipped 0.00 test_templates.py
test_static_role_account_acls Skipped 0.03 test_staticroles.py
test_11_ss_nfs_version_on_ssvm Skipped 0.02 test_ssvm.py
test_nested_virtualization_vmware Skipped 0.00 test_nested_virtualization.py
test_06_copy_iso Skipped 0.00 test_iso.py
test_deploy_vgpu_enabled_vm Skipped 0.03 test_deploy_vgpu_enabled_vm.py
test_3d_gpu_support Skipped 0.04 test_deploy_vgpu_enabled_vm.py

@blueorangutan
Copy link

blueorangutan commented Dec 24, 2016

Trillian test result (tid-731)
Environment: vmware-55u3 (x2), Advanced Networking with Mgmt server 7
Total time taken: 47259 seconds
Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr1836-t731-vmware-55u3.zip
Intermitten failure detected: /marvin/tests/smoke/test_privategw_acl.py
Intermitten failure detected: /marvin/tests/smoke/test_routers_network_ops.py
Intermitten failure detected: /marvin/tests/smoke/test_volumes.py
Intermitten failure detected: /marvin/tests/smoke/test_vpc_redundant.py
Test completed. 47 look ok, 2 have error(s)

Test Result Time (s) Test File
test_04_rvpc_privategw_static_routes Failure 922.86 test_privategw_acl.py
test_06_download_detached_volume Error 55.41 test_volumes.py
test_01_vpc_site2site_vpn Success 440.66 test_vpc_vpn.py
test_01_vpc_remote_access_vpn Success 186.74 test_vpc_vpn.py
test_01_redundant_vpc_site2site_vpn Success 606.16 test_vpc_vpn.py
test_02_VPC_default_routes Success 343.38 test_vpc_router_nics.py
test_01_VPC_nics_after_destroy Success 940.35 test_vpc_router_nics.py
test_05_rvpc_multi_tiers Success 694.04 test_vpc_redundant.py
test_04_rvpc_network_garbage_collector_nics Success 1536.99 test_vpc_redundant.py
test_03_create_redundant_VPC_1tier_2VMs_2IPs_2PF_ACL_reboot_routers Success 722.10 test_vpc_redundant.py
test_02_redundant_VPC_default_routes Success 655.88 test_vpc_redundant.py
test_01_create_redundant_VPC_2tiers_4VMs_4IPs_4PF_ACL Success 1397.71 test_vpc_redundant.py
test_09_delete_detached_volume Success 30.73 test_volumes.py
test_05_detach_volume Success 105.24 test_volumes.py
test_04_delete_attached_volume Success 10.32 test_volumes.py
test_03_download_attached_volume Success 20.21 test_volumes.py
test_02_attach_volume Success 53.70 test_volumes.py
test_01_create_volume Success 450.19 test_volumes.py
test_03_delete_vm_snapshots Success 275.13 test_vm_snapshots.py
test_02_revert_vm_snapshots Success 200.46 test_vm_snapshots.py
test_01_test_vm_volume_snapshot Success 165.99 test_vm_snapshots.py
test_01_create_vm_snapshots Success 161.73 test_vm_snapshots.py
test_deploy_vm_multiple Success 241.84 test_vm_life_cycle.py
test_deploy_vm Success 0.02 test_vm_life_cycle.py
test_advZoneVirtualRouter Success 0.02 test_vm_life_cycle.py
test_10_attachAndDetach_iso Success 26.63 test_vm_life_cycle.py
test_09_expunge_vm Success 125.11 test_vm_life_cycle.py
test_08_migrate_vm Success 75.92 test_vm_life_cycle.py
test_07_restore_vm Success 0.07 test_vm_life_cycle.py
test_06_destroy_vm Success 10.11 test_vm_life_cycle.py
test_03_reboot_vm Success 5.10 test_vm_life_cycle.py
test_02_start_vm Success 20.16 test_vm_life_cycle.py
test_01_stop_vm Success 5.08 test_vm_life_cycle.py
test_CreateTemplateWithDuplicateName Success 246.94 test_templates.py
test_08_list_system_templates Success 0.02 test_templates.py
test_07_list_public_templates Success 0.02 test_templates.py
test_05_template_permissions Success 0.06 test_templates.py
test_04_extract_template Success 15.29 test_templates.py
test_03_delete_template Success 5.10 test_templates.py
test_02_edit_template Success 90.21 test_templates.py
test_01_create_template Success 126.03 test_templates.py
test_10_destroy_cpvm Success 236.41 test_ssvm.py
test_09_destroy_ssvm Success 268.39 test_ssvm.py
test_08_reboot_cpvm Success 156.50 test_ssvm.py
test_07_reboot_ssvm Success 158.46 test_ssvm.py
test_06_stop_cpvm Success 201.56 test_ssvm.py
test_05_stop_ssvm Success 208.38 test_ssvm.py
test_04_cpvm_internals Success 1.04 test_ssvm.py
test_03_ssvm_internals Success 3.21 test_ssvm.py
test_02_list_cpvm_vm Success 0.09 test_ssvm.py
test_01_list_sec_storage_vm Success 0.09 test_ssvm.py
test_01_snapshot_root_disk Success 26.00 test_snapshots.py
test_04_change_offering_small Success 92.28 test_service_offerings.py
test_03_delete_service_offering Success 0.03 test_service_offerings.py
test_02_edit_service_offering Success 0.06 test_service_offerings.py
test_01_create_service_offering Success 0.07 test_service_offerings.py
test_02_sys_template_ready Success 0.08 test_secondary_storage.py
test_01_sys_vm_start Success 0.11 test_secondary_storage.py
test_09_reboot_router Success 125.75 test_routers.py
test_08_start_router Success 115.93 test_routers.py
test_07_stop_router Success 25.18 test_routers.py
test_06_router_advanced Success 0.04 test_routers.py
test_05_router_basic Success 0.03 test_routers.py
test_04_restart_network_wo_cleanup Success 5.51 test_routers.py
test_03_restart_network_cleanup Success 125.69 test_routers.py
test_02_router_internal_adv Success 0.86 test_routers.py
test_01_router_internal_basic Success 0.47 test_routers.py
test_router_dns_guestipquery Success 76.60 test_router_dns.py
test_router_dns_externalipquery Success 0.06 test_router_dns.py
test_router_dhcphosts Success 215.42 test_router_dhcphosts.py
test_router_dhcp_opts Success 21.25 test_router_dhcphosts.py
test_01_updatevolumedetail Success 5.08 test_resource_detail.py
test_01_reset_vm_on_reboot Success 35.30 test_reset_vm_on_reboot.py
test_createRegion Success 0.03 test_regions.py
test_create_pvlan_network Success 5.15 test_pvlan.py
test_dedicatePublicIpRange Success 0.29 test_public_ip_range.py
test_03_vpc_privategw_restart_vpc_cleanup Success 1121.57 test_privategw_acl.py
test_02_vpc_privategw_static_routes Success 725.21 test_privategw_acl.py
test_01_vpc_privategw_acl Success 186.96 test_privategw_acl.py
test_01_primary_storage_nfs Success 37.34 test_primary_storage.py
test_createPortablePublicIPRange Success 15.16 test_portable_publicip.py
test_createPortablePublicIPAcquire Success 15.45 test_portable_publicip.py
test_isolate_network_password_server Success 91.90 test_password_server.py
test_UpdateStorageOverProvisioningFactor Success 0.09 test_over_provisioning.py
test_oobm_zchange_password Success 30.51 test_outofbandmanagement.py
test_oobm_multiple_mgmt_server_ownership Success 16.26 test_outofbandmanagement.py
test_oobm_issue_power_status Success 10.18 test_outofbandmanagement.py
test_oobm_issue_power_soft Success 15.25 test_outofbandmanagement.py
test_oobm_issue_power_reset Success 15.26 test_outofbandmanagement.py
test_oobm_issue_power_on Success 15.25 test_outofbandmanagement.py
test_oobm_issue_power_off Success 15.27 test_outofbandmanagement.py
test_oobm_issue_power_cycle Success 15.22 test_outofbandmanagement.py
test_oobm_enabledisable_across_clusterzones Success 82.27 test_outofbandmanagement.py
test_oobm_enable_feature_valid Success 5.18 test_outofbandmanagement.py
test_oobm_enable_feature_invalid Success 0.15 test_outofbandmanagement.py
test_oobm_disable_feature_valid Success 0.17 test_outofbandmanagement.py
test_oobm_disable_feature_invalid Success 0.15 test_outofbandmanagement.py
test_oobm_configure_invalid_driver Success 0.11 test_outofbandmanagement.py
test_oobm_configure_default_driver Success 0.10 test_outofbandmanagement.py
test_oobm_background_powerstate_sync Success 23.34 test_outofbandmanagement.py
test_extendPhysicalNetworkVlan Success 15.25 test_non_contigiousvlan.py
test_01_nic Success 574.39 test_nic.py
test_releaseIP Success 287.28 test_network.py
test_reboot_router Success 668.86 test_network.py
test_public_ip_user_account Success 10.18 test_network.py
test_public_ip_admin_account Success 40.20 test_network.py
test_network_rules_acquired_public_ip_3_Load_Balancer_Rule Success 71.37 test_network.py
test_network_rules_acquired_public_ip_2_nat_rule Success 61.39 test_network.py
test_network_rules_acquired_public_ip_1_static_nat_rule Success 124.81 test_network.py
test_delete_account Success 317.24 test_network.py
test_02_port_fwd_on_non_src_nat Success 55.51 test_network.py
test_01_port_fwd_on_src_nat Success 111.62 test_network.py
test_nested_virtualization_vmware Success 382.94 test_nested_virtualization.py
test_nic_secondaryip_add_remove Success 222.08 test_multipleips_per_nic.py
login_test_saml_user Success 17.83 test_login.py
test_assign_and_removal_lb Success 148.22 test_loadbalance.py
test_02_create_lb_rule_non_nat Success 207.19 test_loadbalance.py
test_01_create_lb_rule_src_nat Success 208.36 test_loadbalance.py
test_03_list_snapshots Success 0.06 test_list_ids_parameter.py
test_02_list_templates Success 0.03 test_list_ids_parameter.py
test_01_list_volumes Success 0.02 test_list_ids_parameter.py
test_07_list_default_iso Success 0.04 test_iso.py
test_05_iso_permissions Success 0.04 test_iso.py
test_04_extract_Iso Success 5.13 test_iso.py
test_03_delete_iso Success 95.17 test_iso.py
test_02_edit_iso Success 0.06 test_iso.py
test_01_create_iso Success 20.69 test_iso.py
test_04_rvpc_internallb_haproxy_stats_on_all_interfaces Success 645.67 test_internal_lb.py
test_03_vpc_internallb_haproxy_stats_on_all_interfaces Success 433.46 test_internal_lb.py
test_02_internallb_roundrobin_1RVPC_3VM_HTTP_port80 Success 1033.00 test_internal_lb.py
test_01_internallb_roundrobin_1VPC_3VM_HTTP_port80 Success 845.39 test_internal_lb.py
test_dedicateGuestVlanRange Success 10.19 test_guest_vlan_range.py
test_UpdateConfigParamWithScope Success 0.10 test_global_settings.py
test_rolepermission_lifecycle_update Success 5.79 test_dynamicroles.py
test_rolepermission_lifecycle_list Success 5.75 test_dynamicroles.py
test_rolepermission_lifecycle_delete Success 5.59 test_dynamicroles.py
test_rolepermission_lifecycle_create Success 5.62 test_dynamicroles.py
test_rolepermission_lifecycle_concurrent_updates Success 5.79 test_dynamicroles.py
test_role_lifecycle_update_role_inuse Success 5.62 test_dynamicroles.py
test_role_lifecycle_update Success 10.69 test_dynamicroles.py
test_role_lifecycle_list Success 5.60 test_dynamicroles.py
test_role_lifecycle_delete Success 10.67 test_dynamicroles.py
test_role_lifecycle_create Success 5.61 test_dynamicroles.py
test_role_inuse_deletion Success 5.58 test_dynamicroles.py
test_role_account_acls_multiple_mgmt_servers Success 6.95 test_dynamicroles.py
test_role_account_acls Success 7.04 test_dynamicroles.py
test_default_role_deletion Success 5.66 test_dynamicroles.py
test_04_create_fat_type_disk_offering Success 0.05 test_disk_offerings.py
test_03_delete_disk_offering Success 0.03 test_disk_offerings.py
test_02_edit_disk_offering Success 0.03 test_disk_offerings.py
test_02_create_sparse_type_disk_offering Success 0.05 test_disk_offerings.py
test_01_create_disk_offering Success 0.08 test_disk_offerings.py
test_deployvm_userdispersing Success 60.56 test_deploy_vms_with_varied_deploymentplanners.py
test_deployvm_userconcentrated Success 110.99 test_deploy_vms_with_varied_deploymentplanners.py
test_deployvm_firstfit Success 246.70 test_deploy_vms_with_varied_deploymentplanners.py
test_deployvm_userdata_post Success 30.35 test_deploy_vm_with_userdata.py
test_deployvm_userdata Success 151.00 test_deploy_vm_with_userdata.py
test_02_deploy_vm_root_resize Success 5.58 test_deploy_vm_root_resize.py
test_01_deploy_vm_root_resize Success 5.57 test_deploy_vm_root_resize.py
test_00_deploy_vm_root_resize Success 5.68 test_deploy_vm_root_resize.py
test_deploy_vm_from_iso Success 247.44 test_deploy_vm_iso.py
test_3d_gpu_support Success 484.54 test_deploy_vgpu_enabled_vm.py
test_DeployVmAntiAffinityGroup Success 181.93 test_affinity_groups.py
test_08_resize_volume Skipped 5.07 test_volumes.py
test_07_resize_fail Skipped 10.17 test_volumes.py
test_06_copy_template Skipped 0.00 test_templates.py
test_static_role_account_acls Skipped 0.01 test_staticroles.py
test_11_ss_nfs_version_on_ssvm Skipped 0.01 test_ssvm.py
test_01_scale_vm Skipped 66.31 test_scale_vm.py
test_01_primary_storage_iscsi Skipped 0.02 test_primary_storage.py
test_06_copy_iso Skipped 0.00 test_iso.py
test_deploy_vgpu_enabled_vm Skipped 0.71 test_deploy_vgpu_enabled_vm.py

@yadvr
Copy link
Member Author

yadvr commented Dec 26, 2016

@blueorangutan package

@blueorangutan
Copy link

blueorangutan commented Dec 26, 2016

@rhtyd a Jenkins job has been kicked to build packages. I'll keep you posted as I make progress.

@blueorangutan
Copy link

blueorangutan commented Dec 26, 2016

Packaging result: ✔centos6 ✔centos7 ✔debian. JID-430

@yadvr
Copy link
Member Author

yadvr commented Dec 27, 2016

@blueorangutan test matrix

@blueorangutan
Copy link

blueorangutan commented Dec 27, 2016

@rhtyd a Trillian-Jenkins matrix job (centos6 mgmt + xs65sp1, centos7 mgmt + vmware55u3, centos7 mgmt + kvmcentos7) has been kicked to run smoke tests

@blueorangutan
Copy link

blueorangutan commented Dec 27, 2016

Trillian test result (tid-741)
Environment: kvm-centos7 (x2), Advanced Networking with Mgmt server 7
Total time taken: 43945 seconds
Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr1836-t741-kvm-centos7.zip
Intermitten failure detected: /marvin/tests/smoke/test_privategw_acl.py
Intermitten failure detected: /marvin/tests/smoke/test_routers_network_ops.py
Intermitten failure detected: /marvin/tests/smoke/test_volumes.py
Intermitten failure detected: /marvin/tests/smoke/test_vpc_redundant.py
Test completed. 46 look ok, 3 have error(s)

Test Result Time (s) Test File
test_02_redundant_VPC_default_routes Failure 858.99 test_vpc_redundant.py
test_01_create_redundant_VPC_2tiers_4VMs_4IPs_4PF_ACL Failure 363.39 test_vpc_redundant.py
test_04_rvpc_privategw_static_routes Failure 436.59 test_privategw_acl.py
test_01_create_volume Error 280.11 test_volumes.py
test_01_vpc_site2site_vpn Success 150.01 test_vpc_vpn.py
test_01_vpc_remote_access_vpn Success 66.24 test_vpc_vpn.py
test_01_redundant_vpc_site2site_vpn Success 256.36 test_vpc_vpn.py
test_02_VPC_default_routes Success 491.13 test_vpc_router_nics.py
test_01_VPC_nics_after_destroy Success 872.22 test_vpc_router_nics.py
test_05_rvpc_multi_tiers Success 510.75 test_vpc_redundant.py
test_04_rvpc_network_garbage_collector_nics Success 1404.12 test_vpc_redundant.py
test_03_create_redundant_VPC_1tier_2VMs_2IPs_2PF_ACL_reboot_routers Success 572.82 test_vpc_redundant.py
test_09_delete_detached_volume Success 156.63 test_volumes.py
test_08_resize_volume Success 156.30 test_volumes.py
test_07_resize_fail Success 161.34 test_volumes.py
test_06_download_detached_volume Success 156.34 test_volumes.py
test_05_detach_volume Success 236.17 test_volumes.py
test_04_delete_attached_volume Success 151.19 test_volumes.py
test_03_download_attached_volume Success 156.26 test_volumes.py
test_02_attach_volume Success 184.58 test_volumes.py
test_deploy_vm_multiple Success 328.63 test_vm_life_cycle.py
test_deploy_vm Success 0.03 test_vm_life_cycle.py
test_advZoneVirtualRouter Success 0.03 test_vm_life_cycle.py
test_10_attachAndDetach_iso Success 26.82 test_vm_life_cycle.py
test_09_expunge_vm Success 125.24 test_vm_life_cycle.py
test_08_migrate_vm Success 40.93 test_vm_life_cycle.py
test_07_restore_vm Success 0.13 test_vm_life_cycle.py
test_06_destroy_vm Success 125.81 test_vm_life_cycle.py
test_03_reboot_vm Success 125.87 test_vm_life_cycle.py
test_02_start_vm Success 10.17 test_vm_life_cycle.py
test_01_stop_vm Success 125.77 test_vm_life_cycle.py
test_CreateTemplateWithDuplicateName Success 156.44 test_templates.py
test_08_list_system_templates Success 0.04 test_templates.py
test_07_list_public_templates Success 0.04 test_templates.py
test_05_template_permissions Success 0.07 test_templates.py
test_04_extract_template Success 5.14 test_templates.py
test_03_delete_template Success 5.11 test_templates.py
test_02_edit_template Success 90.21 test_templates.py
test_01_create_template Success 130.99 test_templates.py
test_10_destroy_cpvm Success 161.42 test_ssvm.py
test_09_destroy_ssvm Success 253.44 test_ssvm.py
test_08_reboot_cpvm Success 131.78 test_ssvm.py
test_07_reboot_ssvm Success 103.07 test_ssvm.py
test_06_stop_cpvm Success 161.84 test_ssvm.py
test_05_stop_ssvm Success 133.27 test_ssvm.py
test_04_cpvm_internals Success 1.19 test_ssvm.py
test_03_ssvm_internals Success 3.01 test_ssvm.py
test_02_list_cpvm_vm Success 0.12 test_ssvm.py
test_01_list_sec_storage_vm Success 0.12 test_ssvm.py
test_01_snapshot_root_disk Success 16.30 test_snapshots.py
test_04_change_offering_small Success 239.73 test_service_offerings.py
test_03_delete_service_offering Success 0.06 test_service_offerings.py
test_02_edit_service_offering Success 0.08 test_service_offerings.py
test_01_create_service_offering Success 0.10 test_service_offerings.py
test_02_sys_template_ready Success 0.12 test_secondary_storage.py
test_01_sys_vm_start Success 0.19 test_secondary_storage.py
test_09_reboot_router Success 70.52 test_routers.py
test_08_start_router Success 40.51 test_routers.py
test_07_stop_router Success 10.15 test_routers.py
test_06_router_advanced Success 0.05 test_routers.py
test_05_router_basic Success 0.04 test_routers.py
test_04_restart_network_wo_cleanup Success 5.62 test_routers.py
test_03_restart_network_cleanup Success 80.88 test_routers.py
test_02_router_internal_adv Success 1.25 test_routers.py
test_01_router_internal_basic Success 0.68 test_routers.py
test_router_dns_guestipquery Success 77.10 test_router_dns.py
test_router_dns_externalipquery Success 0.14 test_router_dns.py
test_router_dhcphosts Success 362.92 test_router_dhcphosts.py
test_router_dhcp_opts Success 21.82 test_router_dhcphosts.py
test_01_updatevolumedetail Success 5.10 test_resource_detail.py
test_01_reset_vm_on_reboot Success 130.96 test_reset_vm_on_reboot.py
test_createRegion Success 0.04 test_regions.py
test_create_pvlan_network Success 5.22 test_pvlan.py
test_dedicatePublicIpRange Success 0.46 test_public_ip_range.py
test_03_vpc_privategw_restart_vpc_cleanup Success 727.01 test_privategw_acl.py
test_02_vpc_privategw_static_routes Success 597.90 test_privategw_acl.py
test_01_vpc_privategw_acl Success 87.26 test_privategw_acl.py
test_01_primary_storage_nfs Success 35.79 test_primary_storage.py
test_createPortablePublicIPRange Success 15.19 test_portable_publicip.py
test_createPortablePublicIPAcquire Success 15.41 test_portable_publicip.py
test_isolate_network_password_server Success 59.51 test_password_server.py
test_UpdateStorageOverProvisioningFactor Success 0.12 test_over_provisioning.py
test_oobm_zchange_password Success 30.70 test_outofbandmanagement.py
test_oobm_multiple_mgmt_server_ownership Success 16.33 test_outofbandmanagement.py
test_oobm_issue_power_status Success 10.26 test_outofbandmanagement.py
test_oobm_issue_power_soft Success 10.32 test_outofbandmanagement.py
test_oobm_issue_power_reset Success 15.32 test_outofbandmanagement.py
test_oobm_issue_power_on Success 15.35 test_outofbandmanagement.py
test_oobm_issue_power_off Success 15.33 test_outofbandmanagement.py
test_oobm_issue_power_cycle Success 15.35 test_outofbandmanagement.py
test_oobm_enabledisable_across_clusterzones Success 92.59 test_outofbandmanagement.py
test_oobm_enable_feature_valid Success 5.15 test_outofbandmanagement.py
test_oobm_enable_feature_invalid Success 0.09 test_outofbandmanagement.py
test_oobm_disable_feature_valid Success 5.21 test_outofbandmanagement.py
test_oobm_disable_feature_invalid Success 0.12 test_outofbandmanagement.py
test_oobm_configure_invalid_driver Success 0.20 test_outofbandmanagement.py
test_oobm_configure_default_driver Success 0.21 test_outofbandmanagement.py
test_oobm_background_powerstate_sync Success 23.45 test_outofbandmanagement.py
test_extendPhysicalNetworkVlan Success 15.29 test_non_contigiousvlan.py
test_01_nic Success 530.08 test_nic.py
test_releaseIP Success 268.53 test_network.py
test_reboot_router Success 514.18 test_network.py
test_public_ip_user_account Success 10.25 test_network.py
test_public_ip_admin_account Success 40.27 test_network.py
test_network_rules_acquired_public_ip_3_Load_Balancer_Rule Success 66.74 test_network.py
test_network_rules_acquired_public_ip_2_nat_rule Success 61.52 test_network.py
test_network_rules_acquired_public_ip_1_static_nat_rule Success 120.56 test_network.py
test_delete_account Success 272.74 test_network.py
test_02_port_fwd_on_non_src_nat Success 55.65 test_network.py
test_01_port_fwd_on_src_nat Success 111.75 test_network.py
test_nic_secondaryip_add_remove Success 242.70 test_multipleips_per_nic.py
login_test_saml_user Success 19.17 test_login.py
test_assign_and_removal_lb Success 133.09 test_loadbalance.py
test_02_create_lb_rule_non_nat Success 186.83 test_loadbalance.py
test_01_create_lb_rule_src_nat Success 219.17 test_loadbalance.py
test_03_list_snapshots Success 0.09 test_list_ids_parameter.py
test_02_list_templates Success 0.04 test_list_ids_parameter.py
test_01_list_volumes Success 0.03 test_list_ids_parameter.py
test_07_list_default_iso Success 0.06 test_iso.py
test_05_iso_permissions Success 0.06 test_iso.py
test_04_extract_Iso Success 5.16 test_iso.py
test_03_delete_iso Success 95.18 test_iso.py
test_02_edit_iso Success 0.05 test_iso.py
test_01_create_iso Success 21.00 test_iso.py
test_04_rvpc_internallb_haproxy_stats_on_all_interfaces Success 209.64 test_internal_lb.py
test_03_vpc_internallb_haproxy_stats_on_all_interfaces Success 152.58 test_internal_lb.py
test_02_internallb_roundrobin_1RVPC_3VM_HTTP_port80 Success 504.93 test_internal_lb.py
test_01_internallb_roundrobin_1VPC_3VM_HTTP_port80 Success 431.27 test_internal_lb.py
test_dedicateGuestVlanRange Success 10.28 test_guest_vlan_range.py
test_UpdateConfigParamWithScope Success 0.14 test_global_settings.py
test_rolepermission_lifecycle_update Success 6.17 test_dynamicroles.py
test_rolepermission_lifecycle_list Success 5.96 test_dynamicroles.py
test_rolepermission_lifecycle_delete Success 5.91 test_dynamicroles.py
test_rolepermission_lifecycle_create Success 6.01 test_dynamicroles.py
test_rolepermission_lifecycle_concurrent_updates Success 6.04 test_dynamicroles.py
test_role_lifecycle_update_role_inuse Success 5.90 test_dynamicroles.py
test_role_lifecycle_update Success 11.26 test_dynamicroles.py
test_role_lifecycle_list Success 5.93 test_dynamicroles.py
test_role_lifecycle_delete Success 10.92 test_dynamicroles.py
test_role_lifecycle_create Success 5.89 test_dynamicroles.py
test_role_inuse_deletion Success 5.88 test_dynamicroles.py
test_role_account_acls_multiple_mgmt_servers Success 8.06 test_dynamicroles.py
test_role_account_acls Success 8.44 test_dynamicroles.py
test_default_role_deletion Success 6.00 test_dynamicroles.py
test_04_create_fat_type_disk_offering Success 0.07 test_disk_offerings.py
test_03_delete_disk_offering Success 0.04 test_disk_offerings.py
test_02_edit_disk_offering Success 0.05 test_disk_offerings.py
test_02_create_sparse_type_disk_offering Success 0.07 test_disk_offerings.py
test_01_create_disk_offering Success 0.11 test_disk_offerings.py
test_deployvm_userdispersing Success 20.56 test_deploy_vms_with_varied_deploymentplanners.py
test_deployvm_userconcentrated Success 60.88 test_deploy_vms_with_varied_deploymentplanners.py
test_deployvm_firstfit Success 66.06 test_deploy_vms_with_varied_deploymentplanners.py
test_deployvm_userdata_post Success 35.51 test_deploy_vm_with_userdata.py
test_deployvm_userdata Success 65.89 test_deploy_vm_with_userdata.py
test_02_deploy_vm_root_resize Success 5.96 test_deploy_vm_root_resize.py
test_01_deploy_vm_root_resize Success 5.96 test_deploy_vm_root_resize.py
test_00_deploy_vm_root_resize Success 237.55 test_deploy_vm_root_resize.py
test_deploy_vm_from_iso Success 212.41 test_deploy_vm_iso.py
test_DeployVmAntiAffinityGroup Success 101.67 test_affinity_groups.py
test_03_delete_vm_snapshots Skipped 0.00 test_vm_snapshots.py
test_02_revert_vm_snapshots Skipped 0.00 test_vm_snapshots.py
test_01_test_vm_volume_snapshot Skipped 0.00 test_vm_snapshots.py
test_01_create_vm_snapshots Skipped 0.00 test_vm_snapshots.py
test_06_copy_template Skipped 0.00 test_templates.py
test_static_role_account_acls Skipped 0.02 test_staticroles.py
test_11_ss_nfs_version_on_ssvm Skipped 0.02 test_ssvm.py
test_01_scale_vm Skipped 0.00 test_scale_vm.py
test_01_primary_storage_iscsi Skipped 0.03 test_primary_storage.py
test_nested_virtualization_vmware Skipped 0.00 test_nested_virtualization.py
test_06_copy_iso Skipped 0.00 test_iso.py
test_deploy_vgpu_enabled_vm Skipped 0.03 test_deploy_vgpu_enabled_vm.py
test_3d_gpu_support Skipped 0.03 test_deploy_vgpu_enabled_vm.py

@blueorangutan
Copy link

blueorangutan commented Dec 27, 2016

Trillian test result (tid-740)
Environment: xenserver-65sp1 (x2), Advanced Networking with Mgmt server 6
Total time taken: 48925 seconds
Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr1836-t740-xenserver-65sp1.zip
Intermitten failure detected: /marvin/tests/smoke/test_privategw_acl.py
Intermitten failure detected: /marvin/tests/smoke/test_routers_network_ops.py
Intermitten failure detected: /marvin/tests/smoke/test_volumes.py
Intermitten failure detected: /marvin/tests/smoke/test_vpc_redundant.py
Intermitten failure detected: /marvin/tests/smoke/test_vpc_vpn.py
Test completed. 46 look ok, 3 have error(s)

Test Result Time (s) Test File
test_05_rvpc_multi_tiers Failure 541.09 test_vpc_redundant.py
test_04_rvpc_network_garbage_collector_nics Failure 1380.54 test_vpc_redundant.py
test_01_create_redundant_VPC_2tiers_4VMs_4IPs_4PF_ACL Failure 614.45 test_vpc_redundant.py
test_04_rvpc_privategw_static_routes Failure 748.84 test_privategw_acl.py
test_06_download_detached_volume Error 25.30 test_volumes.py
test_01_vpc_site2site_vpn Success 340.98 test_vpc_vpn.py
test_01_vpc_remote_access_vpn Success 146.35 test_vpc_vpn.py
test_01_redundant_vpc_site2site_vpn Success 593.61 test_vpc_vpn.py
test_02_VPC_default_routes Success 319.04 test_vpc_router_nics.py
test_01_VPC_nics_after_destroy Success 703.39 test_vpc_router_nics.py
test_03_create_redundant_VPC_1tier_2VMs_2IPs_2PF_ACL_reboot_routers Success 864.03 test_vpc_redundant.py
test_02_redundant_VPC_default_routes Success 1108.30 test_vpc_redundant.py
test_09_delete_detached_volume Success 15.61 test_volumes.py
test_08_resize_volume Success 115.93 test_volumes.py
test_07_resize_fail Success 121.00 test_volumes.py
test_05_detach_volume Success 100.27 test_volumes.py
test_04_delete_attached_volume Success 15.21 test_volumes.py
test_03_download_attached_volume Success 20.29 test_volumes.py
test_02_attach_volume Success 15.73 test_volumes.py
test_01_create_volume Success 402.72 test_volumes.py
test_03_delete_vm_snapshots Success 280.31 test_vm_snapshots.py
test_02_revert_vm_snapshots Success 223.48 test_vm_snapshots.py
test_01_create_vm_snapshots Success 130.72 test_vm_snapshots.py
test_deploy_vm_multiple Success 333.25 test_vm_life_cycle.py
test_deploy_vm Success 0.02 test_vm_life_cycle.py
test_advZoneVirtualRouter Success 0.02 test_vm_life_cycle.py
test_10_attachAndDetach_iso Success 36.96 test_vm_life_cycle.py
test_09_expunge_vm Success 125.20 test_vm_life_cycle.py
test_08_migrate_vm Success 65.95 test_vm_life_cycle.py
test_07_restore_vm Success 0.10 test_vm_life_cycle.py
test_06_destroy_vm Success 5.10 test_vm_life_cycle.py
test_03_reboot_vm Success 10.15 test_vm_life_cycle.py
test_02_start_vm Success 20.21 test_vm_life_cycle.py
test_01_stop_vm Success 25.22 test_vm_life_cycle.py
test_CreateTemplateWithDuplicateName Success 151.11 test_templates.py
test_08_list_system_templates Success 0.02 test_templates.py
test_07_list_public_templates Success 0.03 test_templates.py
test_05_template_permissions Success 0.04 test_templates.py
test_04_extract_template Success 5.14 test_templates.py
test_03_delete_template Success 5.10 test_templates.py
test_02_edit_template Success 90.12 test_templates.py
test_01_create_template Success 60.83 test_templates.py
test_10_destroy_cpvm Success 191.76 test_ssvm.py
test_09_destroy_ssvm Success 258.97 test_ssvm.py
test_08_reboot_cpvm Success 141.75 test_ssvm.py
test_07_reboot_ssvm Success 144.53 test_ssvm.py
test_06_stop_cpvm Success 161.69 test_ssvm.py
test_05_stop_ssvm Success 133.81 test_ssvm.py
test_04_cpvm_internals Success 1.09 test_ssvm.py
test_03_ssvm_internals Success 3.40 test_ssvm.py
test_02_list_cpvm_vm Success 0.10 test_ssvm.py
test_01_list_sec_storage_vm Success 0.11 test_ssvm.py
test_01_snapshot_root_disk Success 31.30 test_snapshots.py
test_04_change_offering_small Success 101.33 test_service_offerings.py
test_03_delete_service_offering Success 0.08 test_service_offerings.py
test_02_edit_service_offering Success 0.11 test_service_offerings.py
test_01_create_service_offering Success 0.07 test_service_offerings.py
test_02_sys_template_ready Success 0.10 test_secondary_storage.py
test_01_sys_vm_start Success 0.13 test_secondary_storage.py
test_01_scale_vm Success 5.19 test_scale_vm.py
test_09_reboot_router Success 55.39 test_routers.py
test_08_start_router Success 45.38 test_routers.py
test_07_stop_router Success 10.14 test_routers.py
test_06_router_advanced Success 0.04 test_routers.py
test_05_router_basic Success 0.03 test_routers.py
test_04_restart_network_wo_cleanup Success 5.49 test_routers.py
test_03_restart_network_cleanup Success 120.79 test_routers.py
test_02_router_internal_adv Success 0.80 test_routers.py
test_01_router_internal_basic Success 0.47 test_routers.py
test_router_dns_guestipquery Success 49.85 test_router_dns.py
test_router_dns_externalipquery Success 0.08 test_router_dns.py
test_router_dhcphosts Success 118.10 test_router_dhcphosts.py
test_router_dhcp_opts Success 31.39 test_router_dhcphosts.py
test_01_updatevolumedetail Success 0.11 test_resource_detail.py
test_01_reset_vm_on_reboot Success 40.68 test_reset_vm_on_reboot.py
test_createRegion Success 0.18 test_regions.py
test_create_pvlan_network Success 5.33 test_pvlan.py
test_dedicatePublicIpRange Success 0.43 test_public_ip_range.py
test_03_vpc_privategw_restart_vpc_cleanup Success 893.65 test_privategw_acl.py
test_02_vpc_privategw_static_routes Success 711.99 test_privategw_acl.py
test_01_vpc_privategw_acl Success 177.97 test_privategw_acl.py
test_01_primary_storage_nfs Success 38.74 test_primary_storage.py
test_01_primary_storage_iscsi Success 77.64 test_primary_storage.py
test_createPortablePublicIPRange Success 15.18 test_portable_publicip.py
test_createPortablePublicIPAcquire Success 16.22 test_portable_publicip.py
test_isolate_network_password_server Success 35.95 test_password_server.py
test_UpdateStorageOverProvisioningFactor Success 0.11 test_over_provisioning.py
test_oobm_zchange_password Success 30.68 test_outofbandmanagement.py
test_oobm_multiple_mgmt_server_ownership Success 16.33 test_outofbandmanagement.py
test_oobm_issue_power_status Success 10.28 test_outofbandmanagement.py
test_oobm_issue_power_soft Success 15.37 test_outofbandmanagement.py
test_oobm_issue_power_reset Success 15.35 test_outofbandmanagement.py
test_oobm_issue_power_on Success 15.30 test_outofbandmanagement.py
test_oobm_issue_power_off Success 15.31 test_outofbandmanagement.py
test_oobm_issue_power_cycle Success 15.36 test_outofbandmanagement.py
test_oobm_enabledisable_across_clusterzones Success 87.59 test_outofbandmanagement.py
test_oobm_enable_feature_valid Success 5.15 test_outofbandmanagement.py
test_oobm_enable_feature_invalid Success 0.10 test_outofbandmanagement.py
test_oobm_disable_feature_valid Success 0.15 test_outofbandmanagement.py
test_oobm_disable_feature_invalid Success 0.09 test_outofbandmanagement.py
test_oobm_configure_invalid_driver Success 0.07 test_outofbandmanagement.py
test_oobm_configure_default_driver Success 0.08 test_outofbandmanagement.py
test_oobm_background_powerstate_sync Success 23.38 test_outofbandmanagement.py
test_extendPhysicalNetworkVlan Success 15.31 test_non_contigiousvlan.py
test_01_nic Success 600.44 test_nic.py
test_releaseIP Success 288.21 test_network.py
test_reboot_router Success 549.20 test_network.py
test_public_ip_user_account Success 10.23 test_network.py
test_public_ip_admin_account Success 40.28 test_network.py
test_network_rules_acquired_public_ip_3_Load_Balancer_Rule Success 86.58 test_network.py
test_network_rules_acquired_public_ip_2_nat_rule Success 76.57 test_network.py
test_network_rules_acquired_public_ip_1_static_nat_rule Success 100.11 test_network.py
test_delete_account Success 277.89 test_network.py
test_02_port_fwd_on_non_src_nat Success 70.71 test_network.py
test_01_port_fwd_on_src_nat Success 83.76 test_network.py
test_nic_secondaryip_add_remove Success 172.06 test_multipleips_per_nic.py
login_test_saml_user Success 18.11 test_login.py
test_assign_and_removal_lb Success 149.04 test_loadbalance.py
test_02_create_lb_rule_non_nat Success 207.44 test_loadbalance.py
test_01_create_lb_rule_src_nat Success 208.23 test_loadbalance.py
test_03_list_snapshots Success 0.07 test_list_ids_parameter.py
test_02_list_templates Success 0.03 test_list_ids_parameter.py
test_01_list_volumes Success 0.02 test_list_ids_parameter.py
test_07_list_default_iso Success 0.04 test_iso.py
test_05_iso_permissions Success 0.05 test_iso.py
test_04_extract_Iso Success 5.16 test_iso.py
test_03_delete_iso Success 95.12 test_iso.py
test_02_edit_iso Success 0.05 test_iso.py
test_01_create_iso Success 20.73 test_iso.py
test_04_rvpc_internallb_haproxy_stats_on_all_interfaces Success 459.49 test_internal_lb.py
test_03_vpc_internallb_haproxy_stats_on_all_interfaces Success 308.50 test_internal_lb.py
test_02_internallb_roundrobin_1RVPC_3VM_HTTP_port80 Success 917.87 test_internal_lb.py
test_01_internallb_roundrobin_1VPC_3VM_HTTP_port80 Success 672.41 test_internal_lb.py
test_dedicateGuestVlanRange Success 10.23 test_guest_vlan_range.py
test_UpdateConfigParamWithScope Success 0.12 test_global_settings.py
test_rolepermission_lifecycle_update Success 5.91 test_dynamicroles.py
test_rolepermission_lifecycle_list Success 5.80 test_dynamicroles.py
test_rolepermission_lifecycle_delete Success 5.64 test_dynamicroles.py
test_rolepermission_lifecycle_create Success 5.68 test_dynamicroles.py
test_rolepermission_lifecycle_concurrent_updates Success 5.80 test_dynamicroles.py
test_role_lifecycle_update_role_inuse Success 5.70 test_dynamicroles.py
test_role_lifecycle_update Success 10.80 test_dynamicroles.py
test_role_lifecycle_list Success 5.67 test_dynamicroles.py
test_role_lifecycle_delete Success 10.69 test_dynamicroles.py
test_role_lifecycle_create Success 5.66 test_dynamicroles.py
test_role_inuse_deletion Success 5.66 test_dynamicroles.py
test_role_account_acls_multiple_mgmt_servers Success 7.46 test_dynamicroles.py
test_role_account_acls Success 7.64 test_dynamicroles.py
test_default_role_deletion Success 5.87 test_dynamicroles.py
test_04_create_fat_type_disk_offering Success 0.10 test_disk_offerings.py
test_03_delete_disk_offering Success 0.05 test_disk_offerings.py
test_02_edit_disk_offering Success 0.07 test_disk_offerings.py
test_02_create_sparse_type_disk_offering Success 0.09 test_disk_offerings.py
test_01_create_disk_offering Success 0.12 test_disk_offerings.py
test_deployvm_userdispersing Success 45.84 test_deploy_vms_with_varied_deploymentplanners.py
test_deployvm_userconcentrated Success 106.11 test_deploy_vms_with_varied_deploymentplanners.py
test_deployvm_firstfit Success 176.50 test_deploy_vms_with_varied_deploymentplanners.py
test_deployvm_userdata_post Success 20.35 test_deploy_vm_with_userdata.py
test_deployvm_userdata Success 161.57 test_deploy_vm_with_userdata.py
test_02_deploy_vm_root_resize Success 5.64 test_deploy_vm_root_resize.py
test_01_deploy_vm_root_resize Success 5.70 test_deploy_vm_root_resize.py
test_00_deploy_vm_root_resize Success 5.79 test_deploy_vm_root_resize.py
test_deploy_vm_from_iso Success 182.56 test_deploy_vm_iso.py
test_DeployVmAntiAffinityGroup Success 383.94 test_affinity_groups.py
test_01_test_vm_volume_snapshot Skipped 0.00 test_vm_snapshots.py
test_06_copy_template Skipped 0.00 test_templates.py
test_static_role_account_acls Skipped 0.02 test_staticroles.py
test_11_ss_nfs_version_on_ssvm Skipped 0.02 test_ssvm.py
test_nested_virtualization_vmware Skipped 0.00 test_nested_virtualization.py
test_06_copy_iso Skipped 0.00 test_iso.py
test_deploy_vgpu_enabled_vm Skipped 0.02 test_deploy_vgpu_enabled_vm.py
test_3d_gpu_support Skipped 0.03 test_deploy_vgpu_enabled_vm.py

@blueorangutan
Copy link

blueorangutan commented Apr 19, 2017

@rhtyd a Trillian-Jenkins matrix job (centos6 mgmt + xs65sp1, centos7 mgmt + vmware55u3, centos7 mgmt + kvmcentos7) has been kicked to run smoke tests

@blueorangutan
Copy link

blueorangutan commented Apr 19, 2017

Trillian test result (tid-1011)
Environment: kvm-centos7 (x2), Advanced Networking with Mgmt server 7
Total time taken: 38114 seconds
Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr1836-t1011-kvm-centos7.zip
Intermitten failure detected: /marvin/tests/smoke/test_password_server.py
Intermitten failure detected: /marvin/tests/smoke/test_privategw_acl.py
Intermitten failure detected: /marvin/tests/smoke/test_routers_network_ops.py
Intermitten failure detected: /marvin/tests/smoke/test_vpc_redundant.py
Intermitten failure detected: /marvin/tests/smoke/test_vpc_router_nics.py
Test completed. 49 look ok, 1 have error(s)

Test Result Time (s) Test File
test_04_rvpc_privategw_static_routes Failure 1027.56 test_privategw_acl.py
test_01_vpc_site2site_vpn Success 189.35 test_vpc_vpn.py
test_01_vpc_remote_access_vpn Success 65.74 test_vpc_vpn.py
test_01_redundant_vpc_site2site_vpn Success 279.65 test_vpc_vpn.py
test_02_VPC_default_routes Success 301.80 test_vpc_router_nics.py
test_01_VPC_nics_after_destroy Success 509.09 test_vpc_router_nics.py
test_05_rvpc_multi_tiers Success 535.25 test_vpc_redundant.py
test_04_rvpc_network_garbage_collector_nics Success 1364.98 test_vpc_redundant.py
test_03_create_redundant_VPC_1tier_2VMs_2IPs_2PF_ACL_reboot_routers Success 619.68 test_vpc_redundant.py
test_02_redundant_VPC_default_routes Success 784.14 test_vpc_redundant.py
test_01_create_redundant_VPC_2tiers_4VMs_4IPs_4PF_ACL Success 1343.84 test_vpc_redundant.py
test_09_delete_detached_volume Success 156.26 test_volumes.py
test_08_resize_volume Success 155.96 test_volumes.py
test_07_resize_fail Success 161.03 test_volumes.py
test_06_download_detached_volume Success 155.95 test_volumes.py
test_05_detach_volume Success 150.50 test_volumes.py
test_04_delete_attached_volume Success 145.79 test_volumes.py
test_03_download_attached_volume Success 155.95 test_volumes.py
test_02_attach_volume Success 88.98 test_volumes.py
test_01_create_volume Success 711.49 test_volumes.py
test_03_delete_vm_snapshots Success 275.13 test_vm_snapshots.py
test_02_revert_vm_snapshots Success 100.78 test_vm_snapshots.py
test_01_create_vm_snapshots Success 168.81 test_vm_snapshots.py
test_deploy_vm_multiple Success 256.90 test_vm_life_cycle.py
test_deploy_vm Success 0.02 test_vm_life_cycle.py
test_advZoneVirtualRouter Success 0.02 test_vm_life_cycle.py
test_10_attachAndDetach_iso Success 27.29 test_vm_life_cycle.py
test_09_expunge_vm Success 125.13 test_vm_life_cycle.py
test_08_migrate_vm Success 30.61 test_vm_life_cycle.py
test_07_restore_vm Success 0.11 test_vm_life_cycle.py
test_06_destroy_vm Success 125.64 test_vm_life_cycle.py
test_03_reboot_vm Success 125.59 test_vm_life_cycle.py
test_02_start_vm Success 25.20 test_vm_life_cycle.py
test_01_stop_vm Success 40.22 test_vm_life_cycle.py
test_CreateTemplateWithDuplicateName Success 155.78 test_templates.py
test_08_list_system_templates Success 0.02 test_templates.py
test_07_list_public_templates Success 0.02 test_templates.py
test_05_template_permissions Success 0.03 test_templates.py
test_04_extract_template Success 5.15 test_templates.py
test_03_delete_template Success 5.07 test_templates.py
test_02_edit_template Success 90.11 test_templates.py
test_01_create_template Success 100.52 test_templates.py
test_10_destroy_cpvm Success 191.66 test_ssvm.py
test_09_destroy_ssvm Success 164.17 test_ssvm.py
test_08_reboot_cpvm Success 131.80 test_ssvm.py
test_07_reboot_ssvm Success 133.71 test_ssvm.py
test_06_stop_cpvm Success 131.64 test_ssvm.py
test_05_stop_ssvm Success 163.67 test_ssvm.py
test_04_cpvm_internals Success 1.20 test_ssvm.py
test_03_ssvm_internals Success 3.57 test_ssvm.py
test_02_list_cpvm_vm Success 0.07 test_ssvm.py
test_01_list_sec_storage_vm Success 0.08 test_ssvm.py
test_02_list_snapshots_with_removed_data_store Success 81.64 test_snapshots.py
test_01_snapshot_root_disk Success 15.99 test_snapshots.py
test_04_change_offering_small Success 209.54 test_service_offerings.py
test_03_delete_service_offering Success 0.02 test_service_offerings.py
test_02_edit_service_offering Success 0.05 test_service_offerings.py
test_01_create_service_offering Success 0.07 test_service_offerings.py
test_02_sys_template_ready Success 0.13 test_secondary_storage.py
test_01_sys_vm_start Success 0.22 test_secondary_storage.py
test_09_reboot_router Success 45.31 test_routers.py
test_08_start_router Success 35.22 test_routers.py
test_07_stop_router Success 15.12 test_routers.py
test_06_router_advanced Success 0.04 test_routers.py
test_05_router_basic Success 0.02 test_routers.py
test_04_restart_network_wo_cleanup Success 5.72 test_routers.py
test_03_restart_network_cleanup Success 70.46 test_routers.py
test_02_router_internal_adv Success 1.39 test_routers.py
test_01_router_internal_basic Success 0.87 test_routers.py
test_router_dns_guestipquery Success 76.78 test_router_dns.py
test_router_dns_externalipquery Success 0.06 test_router_dns.py
test_router_dhcphosts Success 277.88 test_router_dhcphosts.py
test_router_dhcp_opts Success 21.85 test_router_dhcphosts.py
test_01_updatevolumedetail Success 0.08 test_resource_detail.py
test_01_reset_vm_on_reboot Success 180.98 test_reset_vm_on_reboot.py
test_createRegion Success 0.03 test_regions.py
test_create_pvlan_network Success 5.14 test_pvlan.py
test_dedicatePublicIpRange Success 0.29 test_public_ip_range.py
test_03_vpc_privategw_restart_vpc_cleanup Success 488.12 test_privategw_acl.py
test_02_vpc_privategw_static_routes Success 384.98 test_privategw_acl.py
test_01_vpc_privategw_acl Success 91.63 test_privategw_acl.py
test_03_migration_options_storage_tags Success 70.98 test_primary_storage.py
test_02_edit_primary_storage_tags Success 0.07 test_primary_storage.py
test_01_primary_storage_nfs Success 35.71 test_primary_storage.py
test_01_deploy_vms_storage_tags Success 30.79 test_primary_storage.py
test_createPortablePublicIPRange Success 15.13 test_portable_publicip.py
test_createPortablePublicIPAcquire Success 15.34 test_portable_publicip.py
test_isolate_network_password_server Success 90.17 test_password_server.py
test_UpdateStorageOverProvisioningFactor Success 0.10 test_over_provisioning.py
test_oobm_zchange_password Success 30.93 test_outofbandmanagement.py
test_oobm_multiple_mgmt_server_ownership Success 16.25 test_outofbandmanagement.py
test_oobm_issue_power_status Success 10.17 test_outofbandmanagement.py
test_oobm_issue_power_soft Success 15.25 test_outofbandmanagement.py
test_oobm_issue_power_reset Success 15.35 test_outofbandmanagement.py
test_oobm_issue_power_on Success 10.27 test_outofbandmanagement.py
test_oobm_issue_power_off Success 15.30 test_outofbandmanagement.py
test_oobm_issue_power_cycle Success 15.42 test_outofbandmanagement.py
test_oobm_enabledisable_across_clusterzones Success 92.36 test_outofbandmanagement.py
test_oobm_enable_feature_valid Success 5.12 test_outofbandmanagement.py
test_oobm_enable_feature_invalid Success 0.10 test_outofbandmanagement.py
test_oobm_disable_feature_valid Success 0.14 test_outofbandmanagement.py
test_oobm_disable_feature_invalid Success 0.10 test_outofbandmanagement.py
test_oobm_configure_invalid_driver Success 0.06 test_outofbandmanagement.py
test_oobm_configure_default_driver Success 0.05 test_outofbandmanagement.py
test_oobm_background_powerstate_sync Success 29.31 test_outofbandmanagement.py
test_extendPhysicalNetworkVlan Success 15.36 test_non_contigiousvlan.py
test_01_nic Success 423.43 test_nic.py
test_releaseIP Success 277.80 test_network.py
test_reboot_router Success 398.37 test_network.py
test_public_ip_user_account Success 10.20 test_network.py
test_public_ip_admin_account Success 40.30 test_network.py
test_network_rules_acquired_public_ip_3_Load_Balancer_Rule Success 67.14 test_network.py
test_network_rules_acquired_public_ip_2_nat_rule Success 61.67 test_network.py
test_network_rules_acquired_public_ip_1_static_nat_rule Success 123.92 test_network.py
test_delete_account Success 297.06 test_network.py
test_02_port_fwd_on_non_src_nat Success 55.83 test_network.py
test_01_port_fwd_on_src_nat Success 111.91 test_network.py
test_nic_secondaryip_add_remove Success 257.06 test_multipleips_per_nic.py
test_list_zones_metrics Success 0.16 test_metrics_api.py
test_list_volumes_metrics Success 5.34 test_metrics_api.py
test_list_vms_metrics Success 181.15 test_metrics_api.py
test_list_pstorage_metrics Success 0.18 test_metrics_api.py
test_list_infrastructure_metrics Success 0.23 test_metrics_api.py
test_list_hosts_metrics Success 0.25 test_metrics_api.py
test_list_clusters_metrics Success 0.22 test_metrics_api.py
login_test_saml_user Success 17.84 test_login.py
test_assign_and_removal_lb Success 148.14 test_loadbalance.py
test_02_create_lb_rule_non_nat Success 187.19 test_loadbalance.py
test_01_create_lb_rule_src_nat Success 217.75 test_loadbalance.py
test_03_list_snapshots Success 0.05 test_list_ids_parameter.py
test_02_list_templates Success 0.03 test_list_ids_parameter.py
test_01_list_volumes Success 0.02 test_list_ids_parameter.py
test_07_list_default_iso Success 0.08 test_iso.py
test_05_iso_permissions Success 0.07 test_iso.py
test_04_extract_Iso Success 5.19 test_iso.py
test_03_delete_iso Success 95.14 test_iso.py
test_02_edit_iso Success 0.04 test_iso.py
test_01_create_iso Success 20.68 test_iso.py
test_04_rvpc_internallb_haproxy_stats_on_all_interfaces Success 227.49 test_internal_lb.py
test_03_vpc_internallb_haproxy_stats_on_all_interfaces Success 173.91 test_internal_lb.py
test_02_internallb_roundrobin_1RVPC_3VM_HTTP_port80 Success 514.23 test_internal_lb.py
test_01_internallb_roundrobin_1VPC_3VM_HTTP_port80 Success 423.03 test_internal_lb.py
test_dedicateGuestVlanRange Success 10.33 test_guest_vlan_range.py
test_UpdateConfigParamWithScope Success 0.15 test_global_settings.py
test_rolepermission_lifecycle_update Success 5.89 test_dynamicroles.py
test_rolepermission_lifecycle_list Success 5.67 test_dynamicroles.py
test_rolepermission_lifecycle_delete Success 5.60 test_dynamicroles.py
test_rolepermission_lifecycle_create Success 5.63 test_dynamicroles.py
test_rolepermission_lifecycle_concurrent_updates Success 5.69 test_dynamicroles.py
test_role_lifecycle_update_role_inuse Success 5.62 test_dynamicroles.py
test_role_lifecycle_update Success 5.74 test_dynamicroles.py
test_role_lifecycle_list Success 5.64 test_dynamicroles.py
test_role_lifecycle_delete Success 10.62 test_dynamicroles.py
test_role_lifecycle_create Success 5.65 test_dynamicroles.py
test_role_inuse_deletion Success 5.58 test_dynamicroles.py
test_role_account_acls_multiple_mgmt_servers Success 7.54 test_dynamicroles.py
test_role_account_acls Success 7.44 test_dynamicroles.py
test_default_role_deletion Success 5.80 test_dynamicroles.py
test_04_create_fat_type_disk_offering Success 0.05 test_disk_offerings.py
test_03_delete_disk_offering Success 0.04 test_disk_offerings.py
test_02_edit_disk_offering Success 0.04 test_disk_offerings.py
test_02_create_sparse_type_disk_offering Success 0.05 test_disk_offerings.py
test_01_create_disk_offering Success 0.08 test_disk_offerings.py
test_deployvm_userdispersing Success 20.45 test_deploy_vms_with_varied_deploymentplanners.py
test_deployvm_userconcentrated Success 20.44 test_deploy_vms_with_varied_deploymentplanners.py
test_deployvm_firstfit Success 75.66 test_deploy_vms_with_varied_deploymentplanners.py
test_deployvm_userdata_post Success 10.34 test_deploy_vm_with_userdata.py
test_deployvm_userdata Success 55.58 test_deploy_vm_with_userdata.py
test_02_deploy_vm_root_resize Success 5.70 test_deploy_vm_root_resize.py
test_01_deploy_vm_root_resize Success 5.65 test_deploy_vm_root_resize.py
test_00_deploy_vm_root_resize Success 236.94 test_deploy_vm_root_resize.py
test_deploy_vm_from_iso Success 211.94 test_deploy_vm_iso.py
test_DeployVmAntiAffinityGroup Success 95.89 test_affinity_groups.py
test_change_service_offering_for_vm_with_snapshots Skipped 0.00 test_vm_snapshots.py
test_06_copy_template Skipped 0.00 test_templates.py
test_static_role_account_acls Skipped 0.01 test_staticroles.py
test_11_ss_nfs_version_on_ssvm Skipped 0.01 test_ssvm.py
test_01_scale_vm Skipped 0.00 test_scale_vm.py
test_01_primary_storage_iscsi Skipped 0.02 test_primary_storage.py
test_nested_virtualization_vmware Skipped 0.00 test_nested_virtualization.py
test_06_copy_iso Skipped 0.00 test_iso.py
test_deploy_vgpu_enabled_vm Skipped 0.03 test_deploy_vgpu_enabled_vm.py
test_3d_gpu_support Skipped 0.03 test_deploy_vgpu_enabled_vm.py

Additional tests completed. 1 look ok, 0 have error(s)

Test Result Time (s) Test File

@blueorangutan
Copy link

blueorangutan commented Apr 19, 2017

Trillian test result (tid-1012)
Environment: vmware-55u3 (x2), Advanced Networking with Mgmt server 7
Total time taken: 46073 seconds
Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr1836-t1012-vmware-55u3.zip
Intermitten failure detected: /marvin/tests/smoke/test_internal_lb.py
Intermitten failure detected: /marvin/tests/smoke/test_network.py
Intermitten failure detected: /marvin/tests/smoke/test_privategw_acl.py
Intermitten failure detected: /marvin/tests/smoke/test_routers_network_ops.py
Intermitten failure detected: /marvin/tests/smoke/test_routers.py
Intermitten failure detected: /marvin/tests/smoke/test_vpc_redundant.py
Intermitten failure detected: /marvin/tests/smoke/test_vpc_vpn.py
Test completed. 46 look ok, 4 have error(s)

Test Result Time (s) Test File
test_01_vpc_site2site_vpn Failure 95.88 test_vpc_vpn.py
test_04_rvpc_privategw_static_routes Failure 439.69 test_privategw_acl.py
test_03_vpc_privategw_restart_vpc_cleanup Failure 288.25 test_privategw_acl.py
test_02_vpc_privategw_static_routes Failure 197.25 test_privategw_acl.py
test_01_vpc_privategw_acl Failure 96.63 test_privategw_acl.py
test_02_internallb_roundrobin_1RVPC_3VM_HTTP_port80 Failure 639.65 test_internal_lb.py
test_01_create_redundant_VPC_2tiers_4VMs_4IPs_4PF_ACL Error 202.24 test_vpc_redundant.py
test_01_vpc_remote_access_vpn Success 156.73 test_vpc_vpn.py
test_01_redundant_vpc_site2site_vpn Success 548.42 test_vpc_vpn.py
test_02_VPC_default_routes Success 314.82 test_vpc_router_nics.py
test_01_VPC_nics_after_destroy Success 676.66 test_vpc_router_nics.py
test_05_rvpc_multi_tiers Success 642.34 test_vpc_redundant.py
test_04_rvpc_network_garbage_collector_nics Success 1514.60 test_vpc_redundant.py
test_03_create_redundant_VPC_1tier_2VMs_2IPs_2PF_ACL_reboot_routers Success 724.54 test_vpc_redundant.py
test_02_redundant_VPC_default_routes Success 640.14 test_vpc_redundant.py
test_09_delete_detached_volume Success 31.30 test_volumes.py
test_06_download_detached_volume Success 70.68 test_volumes.py
test_05_detach_volume Success 110.56 test_volumes.py
test_04_delete_attached_volume Success 15.25 test_volumes.py
test_03_download_attached_volume Success 15.37 test_volumes.py
test_02_attach_volume Success 53.81 test_volumes.py
test_01_create_volume Success 445.43 test_volumes.py
test_change_service_offering_for_vm_with_snapshots Success 663.80 test_vm_snapshots.py
test_03_delete_vm_snapshots Success 280.31 test_vm_snapshots.py
test_02_revert_vm_snapshots Success 194.94 test_vm_snapshots.py
test_01_create_vm_snapshots Success 128.88 test_vm_snapshots.py
test_deploy_vm_multiple Success 227.63 test_vm_life_cycle.py
test_deploy_vm Success 0.04 test_vm_life_cycle.py
test_advZoneVirtualRouter Success 0.02 test_vm_life_cycle.py
test_10_attachAndDetach_iso Success 27.00 test_vm_life_cycle.py
test_09_expunge_vm Success 125.26 test_vm_life_cycle.py
test_08_migrate_vm Success 66.30 test_vm_life_cycle.py
test_07_restore_vm Success 0.15 test_vm_life_cycle.py
test_06_destroy_vm Success 10.20 test_vm_life_cycle.py
test_03_reboot_vm Success 5.21 test_vm_life_cycle.py
test_02_start_vm Success 20.28 test_vm_life_cycle.py
test_01_stop_vm Success 10.16 test_vm_life_cycle.py
test_CreateTemplateWithDuplicateName Success 267.01 test_templates.py
test_08_list_system_templates Success 0.03 test_templates.py
test_07_list_public_templates Success 0.05 test_templates.py
test_05_template_permissions Success 0.06 test_templates.py
test_04_extract_template Success 21.26 test_templates.py
test_03_delete_template Success 5.12 test_templates.py
test_02_edit_template Success 90.18 test_templates.py
test_01_create_template Success 131.03 test_templates.py
test_10_destroy_cpvm Success 261.94 test_ssvm.py
test_09_destroy_ssvm Success 263.90 test_ssvm.py
test_08_reboot_cpvm Success 156.53 test_ssvm.py
test_07_reboot_ssvm Success 158.69 test_ssvm.py
test_06_stop_cpvm Success 171.95 test_ssvm.py
test_05_stop_ssvm Success 209.01 test_ssvm.py
test_04_cpvm_internals Success 1.20 test_ssvm.py
test_03_ssvm_internals Success 3.60 test_ssvm.py
test_02_list_cpvm_vm Success 0.15 test_ssvm.py
test_01_list_sec_storage_vm Success 0.19 test_ssvm.py
test_02_list_snapshots_with_removed_data_store Success 208.21 test_snapshots.py
test_01_snapshot_root_disk Success 26.43 test_snapshots.py
test_04_change_offering_small Success 91.94 test_service_offerings.py
test_03_delete_service_offering Success 0.04 test_service_offerings.py
test_02_edit_service_offering Success 0.09 test_service_offerings.py
test_01_create_service_offering Success 0.14 test_service_offerings.py
test_02_sys_template_ready Success 0.20 test_secondary_storage.py
test_01_sys_vm_start Success 0.27 test_secondary_storage.py
test_09_reboot_router Success 130.85 test_routers.py
test_08_start_router Success 105.73 test_routers.py
test_07_stop_router Success 20.23 test_routers.py
test_06_router_advanced Success 0.06 test_routers.py
test_05_router_basic Success 0.05 test_routers.py
test_04_restart_network_wo_cleanup Success 5.67 test_routers.py
test_03_restart_network_cleanup Success 186.29 test_routers.py
test_02_router_internal_adv Success 1.12 test_routers.py
test_01_router_internal_basic Success 0.57 test_routers.py
test_router_dns_guestipquery Success 77.02 test_router_dns.py
test_router_dns_externalipquery Success 0.09 test_router_dns.py
test_router_dhcphosts Success 106.45 test_router_dhcphosts.py
test_router_dhcp_opts Success 21.73 test_router_dhcphosts.py
test_01_updatevolumedetail Success 0.10 test_resource_detail.py
test_01_reset_vm_on_reboot Success 30.39 test_reset_vm_on_reboot.py
test_createRegion Success 0.04 test_regions.py
test_create_pvlan_network Success 5.27 test_pvlan.py
test_dedicatePublicIpRange Success 0.45 test_public_ip_range.py
test_03_migration_options_storage_tags Success 36.84 test_primary_storage.py
test_02_edit_primary_storage_tags Success 0.11 test_primary_storage.py
test_01_primary_storage_nfs Success 38.21 test_primary_storage.py
test_01_deploy_vms_storage_tags Success 47.06 test_primary_storage.py
test_createPortablePublicIPRange Success 15.21 test_portable_publicip.py
test_createPortablePublicIPAcquire Success 15.51 test_portable_publicip.py
test_isolate_network_password_server Success 59.84 test_password_server.py
test_UpdateStorageOverProvisioningFactor Success 0.23 test_over_provisioning.py
test_oobm_zchange_password Success 31.18 test_outofbandmanagement.py
test_oobm_multiple_mgmt_server_ownership Success 11.50 test_outofbandmanagement.py
test_oobm_issue_power_status Success 10.38 test_outofbandmanagement.py
test_oobm_issue_power_soft Success 15.44 test_outofbandmanagement.py
test_oobm_issue_power_reset Success 15.43 test_outofbandmanagement.py
test_oobm_issue_power_on Success 15.38 test_outofbandmanagement.py
test_oobm_issue_power_off Success 15.40 test_outofbandmanagement.py
test_oobm_issue_power_cycle Success 15.40 test_outofbandmanagement.py
test_oobm_enabledisable_across_clusterzones Success 82.86 test_outofbandmanagement.py
test_oobm_enable_feature_valid Success 5.18 test_outofbandmanagement.py
test_oobm_enable_feature_invalid Success 0.12 test_outofbandmanagement.py
test_oobm_disable_feature_valid Success 0.17 test_outofbandmanagement.py
test_oobm_disable_feature_invalid Success 0.12 test_outofbandmanagement.py
test_oobm_configure_invalid_driver Success 0.12 test_outofbandmanagement.py
test_oobm_configure_default_driver Success 0.14 test_outofbandmanagement.py
test_oobm_background_powerstate_sync Success 29.50 test_outofbandmanagement.py
test_extendPhysicalNetworkVlan Success 15.37 test_non_contigiousvlan.py
test_01_nic Success 460.10 test_nic.py
test_releaseIP Success 328.57 test_network.py
test_reboot_router Success 645.49 test_network.py
test_public_ip_user_account Success 10.32 test_network.py
test_public_ip_admin_account Success 40.37 test_network.py
test_network_rules_acquired_public_ip_3_Load_Balancer_Rule Success 76.85 test_network.py
test_network_rules_acquired_public_ip_2_nat_rule Success 61.79 test_network.py
test_network_rules_acquired_public_ip_1_static_nat_rule Success 124.85 test_network.py
test_delete_account Success 313.58 test_network.py
test_02_port_fwd_on_non_src_nat Success 55.73 test_network.py
test_01_port_fwd_on_src_nat Success 112.03 test_network.py
test_nested_virtualization_vmware Success 379.65 test_nested_virtualization.py
test_nic_secondaryip_add_remove Success 177.59 test_multipleips_per_nic.py
test_list_zones_metrics Success 0.32 test_metrics_api.py
test_list_volumes_metrics Success 5.58 test_metrics_api.py
test_list_vms_metrics Success 177.25 test_metrics_api.py
test_list_pstorage_metrics Success 0.38 test_metrics_api.py
test_list_infrastructure_metrics Success 0.62 test_metrics_api.py
test_list_hosts_metrics Success 0.50 test_metrics_api.py
test_list_clusters_metrics Success 0.42 test_metrics_api.py
login_test_saml_user Success 19.63 test_login.py
test_assign_and_removal_lb Success 148.48 test_loadbalance.py
test_02_create_lb_rule_non_nat Success 207.30 test_loadbalance.py
test_01_create_lb_rule_src_nat Success 208.26 test_loadbalance.py
test_03_list_snapshots Success 0.09 test_list_ids_parameter.py
test_02_list_templates Success 0.04 test_list_ids_parameter.py
test_01_list_volumes Success 0.03 test_list_ids_parameter.py
test_07_list_default_iso Success 0.07 test_iso.py
test_05_iso_permissions Success 0.07 test_iso.py
test_04_extract_Iso Success 5.16 test_iso.py
test_03_delete_iso Success 95.22 test_iso.py
test_02_edit_iso Success 0.10 test_iso.py
test_01_create_iso Success 21.11 test_iso.py
test_04_rvpc_internallb_haproxy_stats_on_all_interfaces Success 597.19 test_internal_lb.py
test_03_vpc_internallb_haproxy_stats_on_all_interfaces Success 384.57 test_internal_lb.py
test_01_internallb_roundrobin_1VPC_3VM_HTTP_port80 Success 786.53 test_internal_lb.py
test_dedicateGuestVlanRange Success 10.42 test_guest_vlan_range.py
test_UpdateConfigParamWithScope Success 0.18 test_global_settings.py
test_rolepermission_lifecycle_update Success 6.67 test_dynamicroles.py
test_rolepermission_lifecycle_list Success 6.78 test_dynamicroles.py
test_rolepermission_lifecycle_delete Success 6.14 test_dynamicroles.py
test_rolepermission_lifecycle_create Success 6.06 test_dynamicroles.py
test_rolepermission_lifecycle_concurrent_updates Success 6.15 test_dynamicroles.py
test_role_lifecycle_update_role_inuse Success 6.22 test_dynamicroles.py
test_role_lifecycle_update Success 11.23 test_dynamicroles.py
test_role_lifecycle_list Success 5.95 test_dynamicroles.py
test_role_lifecycle_delete Success 11.03 test_dynamicroles.py
test_role_lifecycle_create Success 6.03 test_dynamicroles.py
test_role_inuse_deletion Success 5.99 test_dynamicroles.py
test_role_account_acls_multiple_mgmt_servers Success 8.25 test_dynamicroles.py
test_role_account_acls Success 8.82 test_dynamicroles.py
test_default_role_deletion Success 6.00 test_dynamicroles.py
test_04_create_fat_type_disk_offering Success 0.08 test_disk_offerings.py
test_03_delete_disk_offering Success 0.04 test_disk_offerings.py
test_02_edit_disk_offering Success 0.06 test_disk_offerings.py
test_02_create_sparse_type_disk_offering Success 0.10 test_disk_offerings.py
test_01_create_disk_offering Success 0.12 test_disk_offerings.py
test_deployvm_userdispersing Success 61.24 test_deploy_vms_with_varied_deploymentplanners.py
test_deployvm_userconcentrated Success 111.48 test_deploy_vms_with_varied_deploymentplanners.py
test_deployvm_firstfit Success 181.68 test_deploy_vms_with_varied_deploymentplanners.py
test_deployvm_userdata_post Success 25.59 test_deploy_vm_with_userdata.py
test_deployvm_userdata Success 217.28 test_deploy_vm_with_userdata.py
test_02_deploy_vm_root_resize Success 5.87 test_deploy_vm_root_resize.py
test_01_deploy_vm_root_resize Success 5.88 test_deploy_vm_root_resize.py
test_00_deploy_vm_root_resize Success 6.13 test_deploy_vm_root_resize.py
test_deploy_vm_from_iso Success 192.70 test_deploy_vm_iso.py
test_3d_gpu_support Success 481.37 test_deploy_vgpu_enabled_vm.py
test_DeployVmAntiAffinityGroup Success 177.08 test_affinity_groups.py
test_08_resize_volume Skipped 5.11 test_volumes.py
test_07_resize_fail Skipped 10.30 test_volumes.py
test_06_copy_template Skipped 0.00 test_templates.py
test_static_role_account_acls Skipped 0.02 test_staticroles.py
test_11_ss_nfs_version_on_ssvm Skipped 0.03 test_ssvm.py
test_01_scale_vm Skipped 63.33 test_scale_vm.py
test_01_primary_storage_iscsi Skipped 0.05 test_primary_storage.py
test_06_copy_iso Skipped 0.00 test_iso.py
test_deploy_vgpu_enabled_vm Skipped 1.43 test_deploy_vgpu_enabled_vm.py

Additional tests completed. 1 look ok, 0 have error(s)

Test Result Time (s) Test File

@blueorangutan
Copy link

blueorangutan commented Apr 20, 2017

Trillian test result (tid-1010)
Environment: xenserver-65sp1 (x2), Advanced Networking with Mgmt server 6
Total time taken: 51052 seconds
Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr1836-t1010-xenserver-65sp1.zip
Intermitten failure detected: /marvin/tests/smoke/test_password_server.py
Intermitten failure detected: /marvin/tests/smoke/test_primary_storage.py
Intermitten failure detected: /marvin/tests/smoke/test_privategw_acl.py
Intermitten failure detected: /marvin/tests/smoke/test_routers_network_ops.py
Intermitten failure detected: /marvin/tests/smoke/test_vpc_redundant.py
Test completed. 47 look ok, 3 have error(s)

Test Result Time (s) Test File
test_05_rvpc_multi_tiers Failure 572.03 test_vpc_redundant.py
test_04_rvpc_network_garbage_collector_nics Failure 1447.35 test_vpc_redundant.py
test_01_create_redundant_VPC_2tiers_4VMs_4IPs_4PF_ACL Failure 585.12 test_vpc_redundant.py
test_04_rvpc_privategw_static_routes Failure 1149.83 test_privategw_acl.py
test_03_vpc_privategw_restart_vpc_cleanup Error 795.25 test_privategw_acl.py
test_01_primary_storage_nfs Error 0.18 test_primary_storage.py
ContextSuite context=TestStorageTags>:setup Error 0.38 test_primary_storage.py
test_01_vpc_site2site_vpn Success 342.31 test_vpc_vpn.py
test_01_vpc_remote_access_vpn Success 167.02 test_vpc_vpn.py
test_01_redundant_vpc_site2site_vpn Success 609.35 test_vpc_vpn.py
test_02_VPC_default_routes Success 386.17 test_vpc_router_nics.py
test_01_VPC_nics_after_destroy Success 761.21 test_vpc_router_nics.py
test_03_create_redundant_VPC_1tier_2VMs_2IPs_2PF_ACL_reboot_routers Success 870.48 test_vpc_redundant.py
test_02_redundant_VPC_default_routes Success 1115.06 test_vpc_redundant.py
test_09_delete_detached_volume Success 20.91 test_volumes.py
test_08_resize_volume Success 106.25 test_volumes.py
test_07_resize_fail Success 116.57 test_volumes.py
test_06_download_detached_volume Success 20.50 test_volumes.py
test_05_detach_volume Success 105.33 test_volumes.py
test_04_delete_attached_volume Success 15.32 test_volumes.py
test_03_download_attached_volume Success 20.44 test_volumes.py
test_02_attach_volume Success 16.11 test_volumes.py
test_01_create_volume Success 393.56 test_volumes.py
test_change_service_offering_for_vm_with_snapshots Success 355.80 test_vm_snapshots.py
test_03_delete_vm_snapshots Success 280.33 test_vm_snapshots.py
test_02_revert_vm_snapshots Success 252.01 test_vm_snapshots.py
test_01_create_vm_snapshots Success 100.92 test_vm_snapshots.py
test_deploy_vm_multiple Success 228.71 test_vm_life_cycle.py
test_deploy_vm Success 0.03 test_vm_life_cycle.py
test_advZoneVirtualRouter Success 0.02 test_vm_life_cycle.py
test_10_attachAndDetach_iso Success 27.07 test_vm_life_cycle.py
test_09_expunge_vm Success 185.31 test_vm_life_cycle.py
test_08_migrate_vm Success 71.45 test_vm_life_cycle.py
test_07_restore_vm Success 0.12 test_vm_life_cycle.py
test_06_destroy_vm Success 10.18 test_vm_life_cycle.py
test_03_reboot_vm Success 10.19 test_vm_life_cycle.py
test_02_start_vm Success 20.26 test_vm_life_cycle.py
test_01_stop_vm Success 30.31 test_vm_life_cycle.py
test_CreateTemplateWithDuplicateName Success 247.09 test_templates.py
test_08_list_system_templates Success 0.04 test_templates.py
test_07_list_public_templates Success 0.05 test_templates.py
test_05_template_permissions Success 0.07 test_templates.py
test_04_extract_template Success 5.18 test_templates.py
test_03_delete_template Success 5.12 test_templates.py
test_02_edit_template Success 90.15 test_templates.py
test_01_create_template Success 90.93 test_templates.py
test_10_destroy_cpvm Success 211.92 test_ssvm.py
test_09_destroy_ssvm Success 231.72 test_ssvm.py
test_08_reboot_cpvm Success 156.79 test_ssvm.py
test_07_reboot_ssvm Success 144.03 test_ssvm.py
test_06_stop_cpvm Success 201.94 test_ssvm.py
test_05_stop_ssvm Success 169.19 test_ssvm.py
test_04_cpvm_internals Success 1.27 test_ssvm.py
test_03_ssvm_internals Success 3.56 test_ssvm.py
test_02_list_cpvm_vm Success 0.17 test_ssvm.py
test_01_list_sec_storage_vm Success 0.15 test_ssvm.py
test_02_list_snapshots_with_removed_data_store Success 144.62 test_snapshots.py
test_01_snapshot_root_disk Success 41.85 test_snapshots.py
test_04_change_offering_small Success 121.30 test_service_offerings.py
test_03_delete_service_offering Success 0.05 test_service_offerings.py
test_02_edit_service_offering Success 0.08 test_service_offerings.py
test_01_create_service_offering Success 0.11 test_service_offerings.py
test_02_sys_template_ready Success 0.13 test_secondary_storage.py
test_01_sys_vm_start Success 0.26 test_secondary_storage.py
test_01_scale_vm Success 5.24 test_scale_vm.py
test_09_reboot_router Success 100.92 test_routers.py
test_08_start_router Success 65.62 test_routers.py
test_07_stop_router Success 15.21 test_routers.py
test_06_router_advanced Success 0.08 test_routers.py
test_05_router_basic Success 0.04 test_routers.py
test_04_restart_network_wo_cleanup Success 5.59 test_routers.py
test_03_restart_network_cleanup Success 156.25 test_routers.py
test_02_router_internal_adv Success 0.84 test_routers.py
test_01_router_internal_basic Success 0.43 test_routers.py
test_router_dns_guestipquery Success 48.96 test_router_dns.py
test_router_dns_externalipquery Success 0.07 test_router_dns.py
test_router_dhcphosts Success 103.26 test_router_dhcphosts.py
test_router_dhcp_opts Success 31.69 test_router_dhcphosts.py
test_01_updatevolumedetail Success 0.11 test_resource_detail.py
test_01_reset_vm_on_reboot Success 171.79 test_reset_vm_on_reboot.py
test_createRegion Success 0.06 test_regions.py
test_create_pvlan_network Success 5.37 test_pvlan.py
test_dedicatePublicIpRange Success 0.79 test_public_ip_range.py
test_02_vpc_privategw_static_routes Success 609.29 test_privategw_acl.py
test_01_vpc_privategw_acl Success 147.96 test_privategw_acl.py
test_01_primary_storage_iscsi Success 90.08 test_primary_storage.py
test_createPortablePublicIPRange Success 15.36 test_portable_publicip.py
test_createPortablePublicIPAcquire Success 15.79 test_portable_publicip.py
test_isolate_network_password_server Success 36.80 test_password_server.py
test_UpdateStorageOverProvisioningFactor Success 0.20 test_over_provisioning.py
test_oobm_zchange_password Success 31.46 test_outofbandmanagement.py
test_oobm_multiple_mgmt_server_ownership Success 16.48 test_outofbandmanagement.py
test_oobm_issue_power_status Success 5.73 test_outofbandmanagement.py
test_oobm_issue_power_soft Success 15.47 test_outofbandmanagement.py
test_oobm_issue_power_reset Success 15.47 test_outofbandmanagement.py
test_oobm_issue_power_on Success 15.46 test_outofbandmanagement.py
test_oobm_issue_power_off Success 10.51 test_outofbandmanagement.py
test_oobm_issue_power_cycle Success 10.43 test_outofbandmanagement.py
test_oobm_enabledisable_across_clusterzones Success 93.31 test_outofbandmanagement.py
test_oobm_enable_feature_valid Success 5.31 test_outofbandmanagement.py
test_oobm_enable_feature_invalid Success 0.18 test_outofbandmanagement.py
test_oobm_disable_feature_valid Success 5.28 test_outofbandmanagement.py
test_oobm_disable_feature_invalid Success 0.11 test_outofbandmanagement.py
test_oobm_configure_invalid_driver Success 0.09 test_outofbandmanagement.py
test_oobm_configure_default_driver Success 0.11 test_outofbandmanagement.py
test_oobm_background_powerstate_sync Success 29.51 test_outofbandmanagement.py
test_extendPhysicalNetworkVlan Success 15.42 test_non_contigiousvlan.py
test_01_nic Success 748.41 test_nic.py
test_releaseIP Success 400.17 test_network.py
test_reboot_router Success 616.08 test_network.py
test_public_ip_user_account Success 10.67 test_network.py
test_public_ip_admin_account Success 40.51 test_network.py
test_network_rules_acquired_public_ip_3_Load_Balancer_Rule Success 92.36 test_network.py
test_network_rules_acquired_public_ip_2_nat_rule Success 81.98 test_network.py
test_network_rules_acquired_public_ip_1_static_nat_rule Success 103.85 test_network.py
test_delete_account Success 253.27 test_network.py
test_02_port_fwd_on_non_src_nat Success 71.02 test_network.py
test_01_port_fwd_on_src_nat Success 84.00 test_network.py
test_nic_secondaryip_add_remove Success 280.21 test_multipleips_per_nic.py
test_list_zones_metrics Success 0.43 test_metrics_api.py
test_list_volumes_metrics Success 5.67 test_metrics_api.py
test_list_vms_metrics Success 192.28 test_metrics_api.py
test_list_pstorage_metrics Success 0.35 test_metrics_api.py
test_list_infrastructure_metrics Success 0.48 test_metrics_api.py
test_list_hosts_metrics Success 0.39 test_metrics_api.py
test_list_clusters_metrics Success 0.51 test_metrics_api.py
login_test_saml_user Success 19.56 test_login.py
test_assign_and_removal_lb Success 149.65 test_loadbalance.py
test_02_create_lb_rule_non_nat Success 207.86 test_loadbalance.py
test_01_create_lb_rule_src_nat Success 208.65 test_loadbalance.py
test_03_list_snapshots Success 0.07 test_list_ids_parameter.py
test_02_list_templates Success 0.04 test_list_ids_parameter.py
test_01_list_volumes Success 0.05 test_list_ids_parameter.py
test_07_list_default_iso Success 0.06 test_iso.py
test_05_iso_permissions Success 0.07 test_iso.py
test_04_extract_Iso Success 5.15 test_iso.py
test_03_delete_iso Success 95.26 test_iso.py
test_02_edit_iso Success 0.12 test_iso.py
test_01_create_iso Success 21.15 test_iso.py
test_04_rvpc_internallb_haproxy_stats_on_all_interfaces Success 581.97 test_internal_lb.py
test_03_vpc_internallb_haproxy_stats_on_all_interfaces Success 315.23 test_internal_lb.py
test_02_internallb_roundrobin_1RVPC_3VM_HTTP_port80 Success 930.67 test_internal_lb.py
test_01_internallb_roundrobin_1VPC_3VM_HTTP_port80 Success 784.32 test_internal_lb.py
test_dedicateGuestVlanRange Success 10.38 test_guest_vlan_range.py
test_UpdateConfigParamWithScope Success 0.16 test_global_settings.py
test_rolepermission_lifecycle_update Success 6.38 test_dynamicroles.py
test_rolepermission_lifecycle_list Success 6.10 test_dynamicroles.py
test_rolepermission_lifecycle_delete Success 5.94 test_dynamicroles.py
test_rolepermission_lifecycle_create Success 6.22 test_dynamicroles.py
test_rolepermission_lifecycle_concurrent_updates Success 6.27 test_dynamicroles.py
test_role_lifecycle_update_role_inuse Success 6.01 test_dynamicroles.py
test_role_lifecycle_update Success 11.13 test_dynamicroles.py
test_role_lifecycle_list Success 5.98 test_dynamicroles.py
test_role_lifecycle_delete Success 11.05 test_dynamicroles.py
test_role_lifecycle_create Success 6.00 test_dynamicroles.py
test_role_inuse_deletion Success 5.93 test_dynamicroles.py
test_role_account_acls_multiple_mgmt_servers Success 8.22 test_dynamicroles.py
test_role_account_acls Success 8.40 test_dynamicroles.py
test_default_role_deletion Success 6.14 test_dynamicroles.py
test_04_create_fat_type_disk_offering Success 0.09 test_disk_offerings.py
test_03_delete_disk_offering Success 0.05 test_disk_offerings.py
test_02_edit_disk_offering Success 0.08 test_disk_offerings.py
test_02_create_sparse_type_disk_offering Success 0.09 test_disk_offerings.py
test_01_create_disk_offering Success 0.16 test_disk_offerings.py
test_deployvm_userdispersing Success 207.55 test_deploy_vms_with_varied_deploymentplanners.py
test_deployvm_userconcentrated Success 61.28 test_deploy_vms_with_varied_deploymentplanners.py
test_deployvm_firstfit Success 277.62 test_deploy_vms_with_varied_deploymentplanners.py
test_deployvm_userdata_post Success 141.86 test_deploy_vm_with_userdata.py
test_deployvm_userdata Success 161.83 test_deploy_vm_with_userdata.py
test_02_deploy_vm_root_resize Success 6.03 test_deploy_vm_root_resize.py
test_01_deploy_vm_root_resize Success 6.30 test_deploy_vm_root_resize.py
test_00_deploy_vm_root_resize Success 6.07 test_deploy_vm_root_resize.py
test_deploy_vm_from_iso Success 192.73 test_deploy_vm_iso.py
test_DeployVmAntiAffinityGroup Success 600.96 test_affinity_groups.py
test_06_copy_template Skipped 0.00 test_templates.py
test_static_role_account_acls Skipped 0.03 test_staticroles.py
test_11_ss_nfs_version_on_ssvm Skipped 0.03 test_ssvm.py
test_nested_virtualization_vmware Skipped 0.00 test_nested_virtualization.py
test_06_copy_iso Skipped 0.00 test_iso.py
test_deploy_vgpu_enabled_vm Skipped 0.04 test_deploy_vgpu_enabled_vm.py
test_3d_gpu_support Skipped 0.03 test_deploy_vgpu_enabled_vm.py

Additional tests completed. 1 look ok, 0 have error(s)

Test Result Time (s) Test File

@yadvr
Copy link
Member Author

yadvr commented Apr 21, 2017

@blueorangutan package

@blueorangutan
Copy link

blueorangutan commented Apr 21, 2017

@rhtyd a Jenkins job has been kicked to build packages. I'll keep you posted as I make progress.

@blueorangutan
Copy link

blueorangutan commented Apr 21, 2017

Packaging result: ✔centos6 ✔centos7 ✔debian. JID-669

@yadvr
Copy link
Member Author

yadvr commented Apr 23, 2017

@blueorangutan package

@blueorangutan
Copy link

blueorangutan commented Apr 23, 2017

@rhtyd a Jenkins job has been kicked to build packages. I'll keep you posted as I make progress.

@blueorangutan
Copy link

blueorangutan commented Apr 23, 2017

Packaging result: ✔centos6 ✔centos7 ✔debian. JID-672

@yadvr
Copy link
Member Author

yadvr commented Apr 23, 2017

/cc @karuturi running some tests given several failures in recent/last set of tests
@blueorangutan test matrix

@blueorangutan
Copy link

blueorangutan commented Apr 23, 2017

@rhtyd a Trillian-Jenkins matrix job (centos6 mgmt + xs65sp1, centos7 mgmt + vmware55u3, centos7 mgmt + kvmcentos7) has been kicked to run smoke tests

@blueorangutan
Copy link

blueorangutan commented Apr 24, 2017

Trillian test result (tid-1030)
Environment: kvm-centos7 (x2), Advanced Networking with Mgmt server 7
Total time taken: 32319 seconds
Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr1836-t1030-kvm-centos7.zip
Intermitten failure detected: /marvin/tests/smoke/test_deploy_virtio_scsi_vm.py
Intermitten failure detected: /marvin/tests/smoke/test_privategw_acl.py
Test completed. 49 look ok, 3 have error(s)

Test Result Time (s) Test File
test_04_rvpc_privategw_static_routes Failure 344.23 test_privategw_acl.py
ContextSuite context=TestDeployVirtioSCSIVM>:setup Error 0.00 test_deploy_virtio_scsi_vm.py
test_01_vpc_site2site_vpn Success 139.07 test_vpc_vpn.py
test_01_vpc_remote_access_vpn Success 55.73 test_vpc_vpn.py
test_01_redundant_vpc_site2site_vpn Success 259.92 test_vpc_vpn.py
test_02_VPC_default_routes Success 274.19 test_vpc_router_nics.py
test_01_VPC_nics_after_destroy Success 606.63 test_vpc_router_nics.py
test_05_rvpc_multi_tiers Success 524.67 test_vpc_redundant.py
test_04_rvpc_network_garbage_collector_nics Success 1324.05 test_vpc_redundant.py
test_03_create_redundant_VPC_1tier_2VMs_2IPs_2PF_ACL_reboot_routers Success 576.38 test_vpc_redundant.py
test_02_redundant_VPC_default_routes Success 747.91 test_vpc_redundant.py
test_01_create_redundant_VPC_2tiers_4VMs_4IPs_4PF_ACL Success 1287.22 test_vpc_redundant.py
test_09_delete_detached_volume Success 156.21 test_volumes.py
test_08_resize_volume Success 156.26 test_volumes.py
test_07_resize_fail Success 161.16 test_volumes.py
test_06_download_detached_volume Success 155.94 test_volumes.py
test_05_detach_volume Success 145.53 test_volumes.py
test_04_delete_attached_volume Success 150.90 test_volumes.py
test_03_download_attached_volume Success 155.98 test_volumes.py
test_02_attach_volume Success 119.18 test_volumes.py
test_01_create_volume Success 620.43 test_volumes.py
test_03_delete_vm_snapshots Success 275.16 test_vm_snapshots.py
test_02_revert_vm_snapshots Success 100.70 test_vm_snapshots.py
test_01_create_vm_snapshots Success 133.64 test_vm_snapshots.py
test_deploy_vm_multiple Success 287.16 test_vm_life_cycle.py
test_deploy_vm Success 0.02 test_vm_life_cycle.py
test_advZoneVirtualRouter Success 0.01 test_vm_life_cycle.py
test_10_attachAndDetach_iso Success 26.80 test_vm_life_cycle.py
test_09_expunge_vm Success 125.21 test_vm_life_cycle.py
test_08_migrate_vm Success 30.62 test_vm_life_cycle.py
test_07_restore_vm Success 0.08 test_vm_life_cycle.py
test_06_destroy_vm Success 130.68 test_vm_life_cycle.py
test_03_reboot_vm Success 125.70 test_vm_life_cycle.py
test_02_start_vm Success 10.13 test_vm_life_cycle.py
test_01_stop_vm Success 40.26 test_vm_life_cycle.py
test_CreateTemplateWithDuplicateName Success 110.85 test_templates.py
test_08_list_system_templates Success 0.04 test_templates.py
test_07_list_public_templates Success 0.04 test_templates.py
test_05_template_permissions Success 0.07 test_templates.py
test_04_extract_template Success 5.12 test_templates.py
test_03_delete_template Success 5.07 test_templates.py
test_02_edit_template Success 90.11 test_templates.py
test_01_create_template Success 70.43 test_templates.py
test_10_destroy_cpvm Success 166.56 test_ssvm.py
test_09_destroy_ssvm Success 163.00 test_ssvm.py
test_08_reboot_cpvm Success 131.63 test_ssvm.py
test_07_reboot_ssvm Success 102.96 test_ssvm.py
test_06_stop_cpvm Success 131.74 test_ssvm.py
test_05_stop_ssvm Success 133.22 test_ssvm.py
test_04_cpvm_internals Success 1.18 test_ssvm.py
test_03_ssvm_internals Success 2.90 test_ssvm.py
test_02_list_cpvm_vm Success 0.08 test_ssvm.py
test_01_list_sec_storage_vm Success 0.09 test_ssvm.py
test_02_list_snapshots_with_removed_data_store Success 81.45 test_snapshots.py
test_01_snapshot_root_disk Success 11.04 test_snapshots.py
test_04_change_offering_small Success 241.46 test_service_offerings.py
test_03_delete_service_offering Success 0.03 test_service_offerings.py
test_02_edit_service_offering Success 0.05 test_service_offerings.py
test_01_create_service_offering Success 0.07 test_service_offerings.py
test_02_sys_template_ready Success 0.10 test_secondary_storage.py
test_01_sys_vm_start Success 0.13 test_secondary_storage.py
test_09_reboot_router Success 50.33 test_routers.py
test_08_start_router Success 35.23 test_routers.py
test_07_stop_router Success 10.13 test_routers.py
test_06_router_advanced Success 0.04 test_routers.py
test_05_router_basic Success 0.03 test_routers.py
test_04_restart_network_wo_cleanup Success 5.66 test_routers.py
test_03_restart_network_cleanup Success 65.43 test_routers.py
test_02_router_internal_adv Success 0.83 test_routers.py
test_01_router_internal_basic Success 0.45 test_routers.py
test_router_dns_guestipquery Success 76.75 test_router_dns.py
test_router_dns_externalipquery Success 0.06 test_router_dns.py
test_router_dhcphosts Success 235.76 test_router_dhcphosts.py
test_router_dhcp_opts Success 21.73 test_router_dhcphosts.py
test_01_updatevolumedetail Success 0.08 test_resource_detail.py
test_01_reset_vm_on_reboot Success 160.84 test_reset_vm_on_reboot.py
test_createRegion Success 0.02 test_regions.py
test_create_pvlan_network Success 5.14 test_pvlan.py
test_dedicatePublicIpRange Success 0.30 test_public_ip_range.py
test_03_vpc_privategw_restart_vpc_cleanup Success 488.48 test_privategw_acl.py
test_02_vpc_privategw_static_routes Success 388.82 test_privategw_acl.py
test_01_vpc_privategw_acl Success 101.69 test_privategw_acl.py
test_03_migration_options_storage_tags Success 161.41 test_primary_storage.py
test_02_edit_primary_storage_tags Success 0.08 test_primary_storage.py
test_01_primary_storage_nfs Success 35.89 test_primary_storage.py
test_01_deploy_vms_storage_tags Success 30.77 test_primary_storage.py
test_createPortablePublicIPRange Success 15.15 test_portable_publicip.py
test_createPortablePublicIPAcquire Success 15.34 test_portable_publicip.py
test_isolate_network_password_server Success 59.15 test_password_server.py
test_UpdateStorageOverProvisioningFactor Success 0.09 test_over_provisioning.py
test_oobm_zchange_password Success 30.59 test_outofbandmanagement.py
test_oobm_multiple_mgmt_server_ownership Success 16.25 test_outofbandmanagement.py
test_oobm_issue_power_status Success 10.19 test_outofbandmanagement.py
test_oobm_issue_power_soft Success 15.26 test_outofbandmanagement.py
test_oobm_issue_power_reset Success 15.24 test_outofbandmanagement.py
test_oobm_issue_power_on Success 15.24 test_outofbandmanagement.py
test_oobm_issue_power_off Success 15.26 test_outofbandmanagement.py
test_oobm_issue_power_cycle Success 15.24 test_outofbandmanagement.py
test_oobm_enabledisable_across_clusterzones Success 77.12 test_outofbandmanagement.py
test_oobm_enable_feature_valid Success 5.11 test_outofbandmanagement.py
test_oobm_enable_feature_invalid Success 0.07 test_outofbandmanagement.py
test_oobm_disable_feature_valid Success 5.13 test_outofbandmanagement.py
test_oobm_disable_feature_invalid Success 0.10 test_outofbandmanagement.py
test_oobm_configure_invalid_driver Success 0.06 test_outofbandmanagement.py
test_oobm_configure_default_driver Success 0.05 test_outofbandmanagement.py
test_oobm_background_powerstate_sync Success 23.30 test_outofbandmanagement.py
test_extendPhysicalNetworkVlan Success 15.23 test_non_contigiousvlan.py
test_01_nic Success 413.19 test_nic.py
test_releaseIP Success 267.22 test_network.py
test_reboot_router Success 377.50 test_network.py
test_public_ip_user_account Success 10.19 test_network.py
test_public_ip_admin_account Success 40.19 test_network.py
test_network_rules_acquired_public_ip_3_Load_Balancer_Rule Success 66.72 test_network.py
test_network_rules_acquired_public_ip_2_nat_rule Success 61.77 test_network.py
test_network_rules_acquired_public_ip_1_static_nat_rule Success 120.64 test_network.py
test_delete_account Success 347.26 test_network.py
test_02_port_fwd_on_non_src_nat Success 55.47 test_network.py
test_01_port_fwd_on_src_nat Success 108.67 test_network.py
test_nic_secondaryip_add_remove Success 211.93 test_multipleips_per_nic.py
test_list_zones_metrics Success 0.16 test_metrics_api.py
test_list_volumes_metrics Success 5.35 test_metrics_api.py
test_list_vms_metrics Success 241.54 test_metrics_api.py
test_list_pstorage_metrics Success 0.17 test_metrics_api.py
test_list_infrastructure_metrics Success 0.31 test_metrics_api.py
test_list_hosts_metrics Success 0.42 test_metrics_api.py
test_list_clusters_metrics Success 0.30 test_metrics_api.py
login_test_saml_user Success 17.82 test_login.py
test_assign_and_removal_lb Success 134.18 test_loadbalance.py
test_02_create_lb_rule_non_nat Success 187.12 test_loadbalance.py
test_01_create_lb_rule_src_nat Success 218.42 test_loadbalance.py
test_03_list_snapshots Success 0.05 test_list_ids_parameter.py
test_02_list_templates Success 0.02 test_list_ids_parameter.py
test_01_list_volumes Success 0.02 test_list_ids_parameter.py
test_07_list_default_iso Success 0.09 test_iso.py
test_05_iso_permissions Success 0.04 test_iso.py
test_04_extract_Iso Success 5.17 test_iso.py
test_03_delete_iso Success 95.11 test_iso.py
test_02_edit_iso Success 0.05 test_iso.py
test_01_create_iso Success 20.66 test_iso.py
test_04_rvpc_internallb_haproxy_stats_on_all_interfaces Success 172.77 test_internal_lb.py
test_03_vpc_internallb_haproxy_stats_on_all_interfaces Success 132.52 test_internal_lb.py
test_02_internallb_roundrobin_1RVPC_3VM_HTTP_port80 Success 511.73 test_internal_lb.py
test_01_internallb_roundrobin_1VPC_3VM_HTTP_port80 Success 448.62 test_internal_lb.py
test_dedicateGuestVlanRange Success 10.19 test_guest_vlan_range.py
test_UpdateConfigParamWithScope Success 0.13 test_global_settings.py
test_rolepermission_lifecycle_update Success 5.78 test_dynamicroles.py
test_rolepermission_lifecycle_list Success 5.70 test_dynamicroles.py
test_rolepermission_lifecycle_delete Success 5.60 test_dynamicroles.py
test_rolepermission_lifecycle_create Success 5.63 test_dynamicroles.py
test_rolepermission_lifecycle_concurrent_updates Success 5.74 test_dynamicroles.py
test_role_lifecycle_update_role_inuse Success 5.61 test_dynamicroles.py
test_role_lifecycle_update Success 10.66 test_dynamicroles.py
test_role_lifecycle_list Success 5.60 test_dynamicroles.py
test_role_lifecycle_delete Success 10.68 test_dynamicroles.py
test_role_lifecycle_create Success 5.62 test_dynamicroles.py
test_role_inuse_deletion Success 5.59 test_dynamicroles.py
test_role_account_acls_multiple_mgmt_servers Success 7.02 test_dynamicroles.py
test_role_account_acls Success 7.52 test_dynamicroles.py
test_default_role_deletion Success 5.70 test_dynamicroles.py
test_04_create_fat_type_disk_offering Success 0.04 test_disk_offerings.py
test_03_delete_disk_offering Success 0.03 test_disk_offerings.py
test_02_edit_disk_offering Success 0.03 test_disk_offerings.py
test_02_create_sparse_type_disk_offering Success 0.05 test_disk_offerings.py
test_01_create_disk_offering Success 0.07 test_disk_offerings.py
test_deployvm_userdispersing Success 20.42 test_deploy_vms_with_varied_deploymentplanners.py
test_deployvm_userconcentrated Success 50.59 test_deploy_vms_with_varied_deploymentplanners.py
test_deployvm_firstfit Success 55.46 test_deploy_vms_with_varied_deploymentplanners.py
test_deployvm_userdata_post Success 5.30 test_deploy_vm_with_userdata.py
test_deployvm_userdata Success 45.45 test_deploy_vm_with_userdata.py
test_02_deploy_vm_root_resize Success 5.64 test_deploy_vm_root_resize.py
test_01_deploy_vm_root_resize Success 5.66 test_deploy_vm_root_resize.py
test_00_deploy_vm_root_resize Success 256.93 test_deploy_vm_root_resize.py
test_deploy_vm_from_iso Success 201.72 test_deploy_vm_iso.py
test_DeployVmAntiAffinityGroup Success 126.07 test_affinity_groups.py
test_change_service_offering_for_vm_with_snapshots Skipped 0.00 test_vm_snapshots.py
test_06_copy_template Skipped 0.00 test_templates.py
test_static_role_account_acls Skipped 0.01 test_staticroles.py
test_11_ss_nfs_version_on_ssvm Skipped 0.01 test_ssvm.py
test_01_scale_vm Skipped 0.00 test_scale_vm.py
test_01_primary_storage_iscsi Skipped 0.05 test_primary_storage.py
test_nested_virtualization_vmware Skipped 0.00 test_nested_virtualization.py
test_06_copy_iso Skipped 0.00 test_iso.py
test_deploy_vgpu_enabled_vm Skipped 0.02 test_deploy_vgpu_enabled_vm.py
test_3d_gpu_support Skipped 0.03 test_deploy_vgpu_enabled_vm.py

@serg38
Copy link

serg38 commented Apr 24, 2017

@rhtyd @karuturi @nathanejohnson test_deploy_virtio_scsi_vm fails because template is no longer available at URL hardcoded in the test
http://dl.openvm.eu/cloudstack/ubuntu/vanilla/16.04/x86_64/ubuntu-16.04-server-cloudimg-amd64-disk1-kvm.qcow2.bz2

@nathanejohnson
Copy link
Member

nathanejohnson commented Apr 24, 2017

@serg @karuturi @rhtyd

Can someone suggest an more appropriate url? I need a modern template to run parts of the test, something new enough to have support out of the box for virtio scsi.

@blueorangutan
Copy link

blueorangutan commented Apr 24, 2017

Trillian test result (tid-1031)
Environment: vmware-55u3 (x2), Advanced Networking with Mgmt server 7
Total time taken: 52555 seconds
Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr1836-t1031-vmware-55u3.zip
Intermitten failure detected: /marvin/tests/smoke/test_deploy_virtio_scsi_vm.py
Intermitten failure detected: /marvin/tests/smoke/test_internal_lb.py
Intermitten failure detected: /marvin/tests/smoke/test_network.py
Intermitten failure detected: /marvin/tests/smoke/test_privategw_acl.py
Intermitten failure detected: /marvin/tests/smoke/test_routers_network_ops.py
Intermitten failure detected: /marvin/tests/smoke/test_vpc_redundant.py
Intermitten failure detected: /marvin/tests/smoke/test_vpc_vpn.py
Test completed. 47 look ok, 4 have error(s)

Test Result Time (s) Test File
test_01_redundant_vpc_site2site_vpn Failure 642.68 test_vpc_vpn.py
test_04_rvpc_privategw_static_routes Failure 984.38 test_privategw_acl.py
test_02_internallb_roundrobin_1RVPC_3VM_HTTP_port80 Failure 699.90 test_internal_lb.py
test_06_verify_guest_lspci_again Error 0.00 test_deploy_virtio_scsi_vm.py
test_05_change_vm_ostype_restart Error 0.00 test_deploy_virtio_scsi_vm.py
test_04_verify_guest_lspci Error 0.00 test_deploy_virtio_scsi_vm.py
test_03_verify_libvirt_attach_disk Error 0.00 test_deploy_virtio_scsi_vm.py
test_02_verify_libvirt_after_restart Error 0.00 test_deploy_virtio_scsi_vm.py
test_01_verify_libvirt Error 0.00 test_deploy_virtio_scsi_vm.py
ContextSuite context=TestDeployVirtioSCSIVM>:teardown Error 0.00 test_deploy_virtio_scsi_vm.py
test_01_vpc_site2site_vpn Success 446.35 test_vpc_vpn.py
test_01_vpc_remote_access_vpn Success 156.47 test_vpc_vpn.py
test_02_VPC_default_routes Success 399.54 test_vpc_router_nics.py
test_01_VPC_nics_after_destroy Success 711.10 test_vpc_router_nics.py
test_05_rvpc_multi_tiers Success 750.42 test_vpc_redundant.py
test_04_rvpc_network_garbage_collector_nics Success 1523.20 test_vpc_redundant.py
test_03_create_redundant_VPC_1tier_2VMs_2IPs_2PF_ACL_reboot_routers Success 763.48 test_vpc_redundant.py
test_02_redundant_VPC_default_routes Success 692.75 test_vpc_redundant.py
test_01_create_redundant_VPC_2tiers_4VMs_4IPs_4PF_ACL Success 1459.35 test_vpc_redundant.py
test_09_delete_detached_volume Success 30.81 test_volumes.py
test_06_download_detached_volume Success 60.60 test_volumes.py
test_05_detach_volume Success 110.33 test_volumes.py
test_04_delete_attached_volume Success 20.24 test_volumes.py
test_03_download_attached_volume Success 20.31 test_volumes.py
test_02_attach_volume Success 58.91 test_volumes.py
test_01_create_volume Success 530.83 test_volumes.py
test_change_service_offering_for_vm_with_snapshots Success 555.10 test_vm_snapshots.py
test_03_delete_vm_snapshots Success 280.19 test_vm_snapshots.py
test_02_revert_vm_snapshots Success 235.30 test_vm_snapshots.py
test_01_create_vm_snapshots Success 161.70 test_vm_snapshots.py
test_deploy_vm_multiple Success 312.78 test_vm_life_cycle.py
test_deploy_vm Success 0.03 test_vm_life_cycle.py
test_advZoneVirtualRouter Success 0.02 test_vm_life_cycle.py
test_10_attachAndDetach_iso Success 26.74 test_vm_life_cycle.py
test_09_expunge_vm Success 125.18 test_vm_life_cycle.py
test_08_migrate_vm Success 66.01 test_vm_life_cycle.py
test_07_restore_vm Success 0.10 test_vm_life_cycle.py
test_06_destroy_vm Success 10.15 test_vm_life_cycle.py
test_03_reboot_vm Success 5.14 test_vm_life_cycle.py
test_02_start_vm Success 20.20 test_vm_life_cycle.py
test_01_stop_vm Success 10.14 test_vm_life_cycle.py
test_CreateTemplateWithDuplicateName Success 281.78 test_templates.py
test_08_list_system_templates Success 0.03 test_templates.py
test_07_list_public_templates Success 0.03 test_templates.py
test_05_template_permissions Success 0.06 test_templates.py
test_04_extract_template Success 25.40 test_templates.py
test_03_delete_template Success 5.09 test_templates.py
test_02_edit_template Success 90.17 test_templates.py
test_01_create_template Success 196.24 test_templates.py
test_10_destroy_cpvm Success 266.81 test_ssvm.py
test_09_destroy_ssvm Success 268.74 test_ssvm.py
test_08_reboot_cpvm Success 126.44 test_ssvm.py
test_07_reboot_ssvm Success 158.19 test_ssvm.py
test_06_stop_cpvm Success 181.75 test_ssvm.py
test_05_stop_ssvm Success 173.56 test_ssvm.py
test_04_cpvm_internals Success 1.10 test_ssvm.py
test_03_ssvm_internals Success 3.19 test_ssvm.py
test_02_list_cpvm_vm Success 0.12 test_ssvm.py
test_01_list_sec_storage_vm Success 0.12 test_ssvm.py
test_02_list_snapshots_with_removed_data_store Success 192.32 test_snapshots.py
test_01_snapshot_root_disk Success 66.40 test_snapshots.py
test_04_change_offering_small Success 96.85 test_service_offerings.py
test_03_delete_service_offering Success 0.09 test_service_offerings.py
test_02_edit_service_offering Success 0.08 test_service_offerings.py
test_01_create_service_offering Success 0.10 test_service_offerings.py
test_02_sys_template_ready Success 0.13 test_secondary_storage.py
test_01_sys_vm_start Success 0.18 test_secondary_storage.py
test_09_reboot_router Success 125.76 test_routers.py
test_08_start_router Success 110.71 test_routers.py
test_07_stop_router Success 25.22 test_routers.py
test_06_router_advanced Success 0.05 test_routers.py
test_05_router_basic Success 0.04 test_routers.py
test_04_restart_network_wo_cleanup Success 5.65 test_routers.py
test_03_restart_network_cleanup Success 196.25 test_routers.py
test_02_router_internal_adv Success 1.23 test_routers.py
test_01_router_internal_basic Success 0.61 test_routers.py
test_router_dns_guestipquery Success 76.84 test_router_dns.py
test_router_dns_externalipquery Success 0.08 test_router_dns.py
test_router_dhcphosts Success 178.92 test_router_dhcphosts.py
test_router_dhcp_opts Success 21.60 test_router_dhcphosts.py
test_01_updatevolumedetail Success 5.16 test_resource_detail.py
test_01_reset_vm_on_reboot Success 35.41 test_reset_vm_on_reboot.py
test_createRegion Success 0.04 test_regions.py
test_create_pvlan_network Success 5.22 test_pvlan.py
test_dedicatePublicIpRange Success 0.44 test_public_ip_range.py
test_03_vpc_privategw_restart_vpc_cleanup Success 1053.45 test_privategw_acl.py
test_02_vpc_privategw_static_routes Success 696.96 test_privategw_acl.py
test_01_vpc_privategw_acl Success 242.86 test_privategw_acl.py
test_03_migration_options_storage_tags Success 37.39 test_primary_storage.py
test_02_edit_primary_storage_tags Success 0.10 test_primary_storage.py
test_01_primary_storage_nfs Success 37.24 test_primary_storage.py
test_01_deploy_vms_storage_tags Success 41.48 test_primary_storage.py
test_createPortablePublicIPRange Success 15.22 test_portable_publicip.py
test_createPortablePublicIPAcquire Success 20.47 test_portable_publicip.py
test_isolate_network_password_server Success 59.76 test_password_server.py
test_UpdateStorageOverProvisioningFactor Success 0.12 test_over_provisioning.py
test_oobm_zchange_password Success 30.70 test_outofbandmanagement.py
test_oobm_multiple_mgmt_server_ownership Success 16.41 test_outofbandmanagement.py
test_oobm_issue_power_status Success 10.22 test_outofbandmanagement.py
test_oobm_issue_power_soft Success 15.31 test_outofbandmanagement.py
test_oobm_issue_power_reset Success 15.34 test_outofbandmanagement.py
test_oobm_issue_power_on Success 15.34 test_outofbandmanagement.py
test_oobm_issue_power_off Success 15.35 test_outofbandmanagement.py
test_oobm_issue_power_cycle Success 15.30 test_outofbandmanagement.py
test_oobm_enabledisable_across_clusterzones Success 82.56 test_outofbandmanagement.py
test_oobm_enable_feature_valid Success 5.15 test_outofbandmanagement.py
test_oobm_enable_feature_invalid Success 0.10 test_outofbandmanagement.py
test_oobm_disable_feature_valid Success 5.22 test_outofbandmanagement.py
test_oobm_disable_feature_invalid Success 0.09 test_outofbandmanagement.py
test_oobm_configure_invalid_driver Success 0.07 test_outofbandmanagement.py
test_oobm_configure_default_driver Success 0.07 test_outofbandmanagement.py
test_oobm_background_powerstate_sync Success 18.47 test_outofbandmanagement.py
test_extendPhysicalNetworkVlan Success 15.32 test_non_contigiousvlan.py
test_01_nic Success 545.52 test_nic.py
test_releaseIP Success 283.03 test_network.py
test_reboot_router Success 584.56 test_network.py
test_public_ip_user_account Success 10.24 test_network.py
test_public_ip_admin_account Success 40.28 test_network.py
test_network_rules_acquired_public_ip_3_Load_Balancer_Rule Success 71.77 test_network.py
test_network_rules_acquired_public_ip_2_nat_rule Success 61.61 test_network.py
test_network_rules_acquired_public_ip_1_static_nat_rule Success 124.63 test_network.py
test_delete_account Success 247.58 test_network.py
test_02_port_fwd_on_non_src_nat Success 55.63 test_network.py
test_01_port_fwd_on_src_nat Success 111.85 test_network.py
test_nested_virtualization_vmware Success 353.42 test_nested_virtualization.py
test_nic_secondaryip_add_remove Success 277.91 test_multipleips_per_nic.py
test_list_zones_metrics Success 0.23 test_metrics_api.py
test_list_volumes_metrics Success 5.47 test_metrics_api.py
test_list_vms_metrics Success 196.92 test_metrics_api.py
test_list_pstorage_metrics Success 0.35 test_metrics_api.py
test_list_infrastructure_metrics Success 0.45 test_metrics_api.py
test_list_hosts_metrics Success 0.38 test_metrics_api.py
test_list_clusters_metrics Success 0.34 test_metrics_api.py
login_test_saml_user Success 19.15 test_login.py
test_assign_and_removal_lb Success 148.60 test_loadbalance.py
test_02_create_lb_rule_non_nat Success 207.28 test_loadbalance.py
test_01_create_lb_rule_src_nat Success 207.89 test_loadbalance.py
test_03_list_snapshots Success 0.12 test_list_ids_parameter.py
test_02_list_templates Success 0.04 test_list_ids_parameter.py
test_01_list_volumes Success 0.03 test_list_ids_parameter.py
test_07_list_default_iso Success 0.07 test_iso.py
test_05_iso_permissions Success 0.06 test_iso.py
test_04_extract_Iso Success 5.26 test_iso.py
test_03_delete_iso Success 95.12 test_iso.py
test_02_edit_iso Success 0.15 test_iso.py
test_01_create_iso Success 20.97 test_iso.py
test_04_rvpc_internallb_haproxy_stats_on_all_interfaces Success 600.34 test_internal_lb.py
test_03_vpc_internallb_haproxy_stats_on_all_interfaces Success 525.24 test_internal_lb.py
test_01_internallb_roundrobin_1VPC_3VM_HTTP_port80 Success 861.25 test_internal_lb.py
test_dedicateGuestVlanRange Success 10.26 test_guest_vlan_range.py
test_UpdateConfigParamWithScope Success 0.13 test_global_settings.py
test_rolepermission_lifecycle_update Success 6.11 test_dynamicroles.py
test_rolepermission_lifecycle_list Success 5.98 test_dynamicroles.py
test_rolepermission_lifecycle_delete Success 5.86 test_dynamicroles.py
test_rolepermission_lifecycle_create Success 5.87 test_dynamicroles.py
test_rolepermission_lifecycle_concurrent_updates Success 6.04 test_dynamicroles.py
test_role_lifecycle_update_role_inuse Success 5.87 test_dynamicroles.py
test_role_lifecycle_update Success 11.00 test_dynamicroles.py
test_role_lifecycle_list Success 5.87 test_dynamicroles.py
test_role_lifecycle_delete Success 10.93 test_dynamicroles.py
test_role_lifecycle_create Success 5.89 test_dynamicroles.py
test_role_inuse_deletion Success 5.86 test_dynamicroles.py
test_role_account_acls_multiple_mgmt_servers Success 8.26 test_dynamicroles.py
test_role_account_acls Success 8.34 test_dynamicroles.py
test_default_role_deletion Success 5.96 test_dynamicroles.py
test_04_create_fat_type_disk_offering Success 0.09 test_disk_offerings.py
test_03_delete_disk_offering Success 0.03 test_disk_offerings.py
test_02_edit_disk_offering Success 0.05 test_disk_offerings.py
test_02_create_sparse_type_disk_offering Success 0.09 test_disk_offerings.py
test_01_create_disk_offering Success 0.10 test_disk_offerings.py
test_deployvm_userdispersing Success 70.84 test_deploy_vms_with_varied_deploymentplanners.py
test_deployvm_userconcentrated Success 101.06 test_deploy_vms_with_varied_deploymentplanners.py
test_deployvm_firstfit Success 201.52 test_deploy_vms_with_varied_deploymentplanners.py
test_deployvm_userdata_post Success 35.55 test_deploy_vm_with_userdata.py
test_deployvm_userdata Success 206.62 test_deploy_vm_with_userdata.py
test_02_deploy_vm_root_resize Success 5.83 test_deploy_vm_root_resize.py
test_01_deploy_vm_root_resize Success 5.84 test_deploy_vm_root_resize.py
test_00_deploy_vm_root_resize Success 5.94 test_deploy_vm_root_resize.py
test_deploy_vm_from_iso Success 368.34 test_deploy_vm_iso.py
test_3d_gpu_support Success 540.54 test_deploy_vgpu_enabled_vm.py
test_DeployVmAntiAffinityGroup Success 171.66 test_affinity_groups.py
test_08_resize_volume Skipped 10.17 test_volumes.py
test_07_resize_fail Skipped 10.27 test_volumes.py
test_06_copy_template Skipped 0.00 test_templates.py
test_static_role_account_acls Skipped 0.02 test_staticroles.py
test_11_ss_nfs_version_on_ssvm Skipped 0.02 test_ssvm.py
test_01_scale_vm Skipped 66.36 test_scale_vm.py
test_01_primary_storage_iscsi Skipped 0.03 test_primary_storage.py
test_06_copy_iso Skipped 0.00 test_iso.py
test_deploy_vgpu_enabled_vm Skipped 1.07 test_deploy_vgpu_enabled_vm.py

@borisstoyanov
Copy link
Contributor

borisstoyanov commented Apr 26, 2017

@blueorangutan test centos6 mgmt + xs65sp1

@yadvr
Copy link
Member Author

yadvr commented May 9, 2017

@blueorangutan package

@blueorangutan
Copy link

blueorangutan commented May 9, 2017

Packaging result: ✔centos6 ✔centos7 ✔debian. JID-701

@yadvr
Copy link
Member Author

yadvr commented May 9, 2017

@blueorangutan test matrix

@yadvr
Copy link
Member Author

yadvr commented May 15, 2017

(tests did not run :( )
@blueorangutan package

@blueorangutan
Copy link

blueorangutan commented May 15, 2017

Packaging result: ✔centos6 ✔centos7 ✔debian. JID-724

@yadvr
Copy link
Member Author

yadvr commented May 16, 2017

@blueorangutan test matrix

@blueorangutan
Copy link

blueorangutan commented May 16, 2017

Trillian test result (tid-1093)
Environment: kvm-centos7 (x2), Advanced Networking with Mgmt server 7
Total time taken: 31524 seconds
Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr1836-t1093-kvm-centos7.zip
Intermitten failure detected: /marvin/tests/smoke/test_privategw_acl.py
Test completed. 50 look ok, 1 have error(s)

Test Result Time (s) Test File
test_04_rvpc_privategw_static_routes Failure 345.03 test_privategw_acl.py
test_01_vpc_site2site_vpn Success 154.54 test_vpc_vpn.py
test_01_vpc_remote_access_vpn Success 60.82 test_vpc_vpn.py
test_01_redundant_vpc_site2site_vpn Success 255.11 test_vpc_vpn.py
test_02_VPC_default_routes Success 252.89 test_vpc_router_nics.py
test_01_VPC_nics_after_destroy Success 532.68 test_vpc_router_nics.py
test_05_rvpc_multi_tiers Success 516.88 test_vpc_redundant.py
test_04_rvpc_network_garbage_collector_nics Success 1428.99 test_vpc_redundant.py
test_03_create_redundant_VPC_1tier_2VMs_2IPs_2PF_ACL_reboot_routers Success 548.56 test_vpc_redundant.py
test_02_redundant_VPC_default_routes Success 742.83 test_vpc_redundant.py
test_01_create_redundant_VPC_2tiers_4VMs_4IPs_4PF_ACL Success 1302.46 test_vpc_redundant.py
test_09_delete_detached_volume Success 156.21 test_volumes.py
test_08_resize_volume Success 156.24 test_volumes.py
test_07_resize_fail Success 156.14 test_volumes.py
test_06_download_detached_volume Success 156.12 test_volumes.py
test_05_detach_volume Success 145.60 test_volumes.py
test_04_delete_attached_volume Success 150.96 test_volumes.py
test_03_download_attached_volume Success 156.06 test_volumes.py
test_02_attach_volume Success 89.05 test_volumes.py
test_01_create_volume Success 616.22 test_volumes.py
test_03_delete_vm_snapshots Success 275.21 test_vm_snapshots.py
test_02_revert_vm_snapshots Success 110.68 test_vm_snapshots.py
test_01_create_vm_snapshots Success 163.67 test_vm_snapshots.py
test_deploy_vm_multiple Success 272.19 test_vm_life_cycle.py
test_deploy_vm Success 0.02 test_vm_life_cycle.py
test_advZoneVirtualRouter Success 0.02 test_vm_life_cycle.py
test_10_attachAndDetach_iso Success 26.64 test_vm_life_cycle.py
test_09_expunge_vm Success 125.11 test_vm_life_cycle.py
test_08_migrate_vm Success 60.86 test_vm_life_cycle.py
test_07_restore_vm Success 0.10 test_vm_life_cycle.py
test_06_destroy_vm Success 125.74 test_vm_life_cycle.py
test_03_reboot_vm Success 125.69 test_vm_life_cycle.py
test_02_start_vm Success 10.13 test_vm_life_cycle.py
test_01_stop_vm Success 30.21 test_vm_life_cycle.py
test_CreateTemplateWithDuplicateName Success 90.65 test_templates.py
test_08_list_system_templates Success 0.04 test_templates.py
test_07_list_public_templates Success 0.04 test_templates.py
test_05_template_permissions Success 0.06 test_templates.py
test_04_extract_template Success 5.21 test_templates.py
test_03_delete_template Success 5.10 test_templates.py
test_02_edit_template Success 90.16 test_templates.py
test_01_create_template Success 80.50 test_templates.py
test_10_destroy_cpvm Success 131.35 test_ssvm.py
test_09_destroy_ssvm Success 163.34 test_ssvm.py
test_08_reboot_cpvm Success 101.37 test_ssvm.py
test_07_reboot_ssvm Success 133.53 test_ssvm.py
test_06_stop_cpvm Success 131.58 test_ssvm.py
test_05_stop_ssvm Success 134.08 test_ssvm.py
test_04_cpvm_internals Success 0.98 test_ssvm.py
test_03_ssvm_internals Success 3.57 test_ssvm.py
test_02_list_cpvm_vm Success 0.09 test_ssvm.py
test_01_list_sec_storage_vm Success 0.10 test_ssvm.py
test_02_list_snapshots_with_removed_data_store Success 81.52 test_snapshots.py
test_01_snapshot_root_disk Success 11.05 test_snapshots.py
test_04_change_offering_small Success 239.42 test_service_offerings.py
test_03_delete_service_offering Success 0.03 test_service_offerings.py
test_02_edit_service_offering Success 0.04 test_service_offerings.py
test_01_create_service_offering Success 0.13 test_service_offerings.py
test_02_sys_template_ready Success 0.14 test_secondary_storage.py
test_01_sys_vm_start Success 0.18 test_secondary_storage.py
test_09_reboot_router Success 40.28 test_routers.py
test_08_start_router Success 35.27 test_routers.py
test_07_stop_router Success 10.16 test_routers.py
test_06_router_advanced Success 0.05 test_routers.py
test_05_router_basic Success 0.03 test_routers.py
test_04_restart_network_wo_cleanup Success 5.74 test_routers.py
test_03_restart_network_cleanup Success 60.41 test_routers.py
test_02_router_internal_adv Success 1.02 test_routers.py
test_01_router_internal_basic Success 0.55 test_routers.py
test_router_dns_guestipquery Success 76.69 test_router_dns.py
test_router_dns_externalipquery Success 0.06 test_router_dns.py
test_router_dhcphosts Success 266.52 test_router_dhcphosts.py
test_router_dhcp_opts Success 21.48 test_router_dhcphosts.py
test_01_updatevolumedetail Success 0.08 test_resource_detail.py
test_01_reset_vm_on_reboot Success 166.05 test_reset_vm_on_reboot.py
test_createRegion Success 0.03 test_regions.py
test_create_pvlan_network Success 5.18 test_pvlan.py
test_dedicatePublicIpRange Success 0.39 test_public_ip_range.py
test_03_vpc_privategw_restart_vpc_cleanup Success 509.38 test_privategw_acl.py
test_02_vpc_privategw_static_routes Success 384.02 test_privategw_acl.py
test_01_vpc_privategw_acl Success 86.63 test_privategw_acl.py
test_03_migration_options_storage_tags Success 65.95 test_primary_storage.py
test_02_edit_primary_storage_tags Success 0.08 test_primary_storage.py
test_01_primary_storage_nfs Success 35.74 test_primary_storage.py
test_01_deploy_vms_storage_tags Success 30.85 test_primary_storage.py
test_createPortablePublicIPRange Success 15.14 test_portable_publicip.py
test_createPortablePublicIPAcquire Success 15.37 test_portable_publicip.py
test_isolate_network_password_server Success 59.36 test_password_server.py
test_UpdateStorageOverProvisioningFactor Success 0.09 test_over_provisioning.py
test_oobm_zchange_password Success 30.56 test_outofbandmanagement.py
test_oobm_multiple_mgmt_server_ownership Success 11.37 test_outofbandmanagement.py
test_oobm_issue_power_status Success 5.24 test_outofbandmanagement.py
test_oobm_issue_power_soft Success 10.27 test_outofbandmanagement.py
test_oobm_issue_power_reset Success 15.26 test_outofbandmanagement.py
test_oobm_issue_power_on Success 15.27 test_outofbandmanagement.py
test_oobm_issue_power_off Success 15.31 test_outofbandmanagement.py
test_oobm_issue_power_cycle Success 15.38 test_outofbandmanagement.py
test_oobm_enabledisable_across_clusterzones Success 87.48 test_outofbandmanagement.py
test_oobm_enable_feature_valid Success 5.14 test_outofbandmanagement.py
test_oobm_enable_feature_invalid Success 0.12 test_outofbandmanagement.py
test_oobm_disable_feature_valid Success 5.18 test_outofbandmanagement.py
test_oobm_disable_feature_invalid Success 0.12 test_outofbandmanagement.py
test_oobm_configure_invalid_driver Success 0.09 test_outofbandmanagement.py
test_oobm_configure_default_driver Success 0.09 test_outofbandmanagement.py
test_oobm_background_powerstate_sync Success 23.93 test_outofbandmanagement.py
test_extendPhysicalNetworkVlan Success 15.25 test_non_contigiousvlan.py
test_01_nic Success 428.49 test_nic.py
test_releaseIP Success 181.90 test_network.py
test_reboot_router Success 448.29 test_network.py
test_public_ip_user_account Success 10.21 test_network.py
test_public_ip_admin_account Success 40.23 test_network.py
test_network_rules_acquired_public_ip_3_Load_Balancer_Rule Success 66.50 test_network.py
test_network_rules_acquired_public_ip_2_nat_rule Success 61.43 test_network.py
test_network_rules_acquired_public_ip_1_static_nat_rule Success 120.22 test_network.py
test_delete_account Success 292.30 test_network.py
test_02_port_fwd_on_non_src_nat Success 55.55 test_network.py
test_01_port_fwd_on_src_nat Success 116.96 test_network.py
test_nic_secondaryip_add_remove Success 257.42 test_multipleips_per_nic.py
test_list_zones_metrics Success 0.21 test_metrics_api.py
test_list_volumes_metrics Success 5.41 test_metrics_api.py
test_list_vms_metrics Success 186.34 test_metrics_api.py
test_list_pstorage_metrics Success 0.24 test_metrics_api.py
test_list_infrastructure_metrics Success 0.37 test_metrics_api.py
test_list_hosts_metrics Success 0.27 test_metrics_api.py
test_list_clusters_metrics Success 0.30 test_metrics_api.py
login_test_saml_user Success 17.83 test_login.py
test_assign_and_removal_lb Success 133.64 test_loadbalance.py
test_02_create_lb_rule_non_nat Success 187.20 test_loadbalance.py
test_01_create_lb_rule_src_nat Success 228.47 test_loadbalance.py
test_03_list_snapshots Success 0.06 test_list_ids_parameter.py
test_02_list_templates Success 0.03 test_list_ids_parameter.py
test_01_list_volumes Success 0.02 test_list_ids_parameter.py
test_07_list_default_iso Success 0.07 test_iso.py
test_05_iso_permissions Success 0.07 test_iso.py
test_04_extract_Iso Success 5.14 test_iso.py
test_03_delete_iso Success 95.16 test_iso.py
test_02_edit_iso Success 0.07 test_iso.py
test_01_create_iso Success 20.68 test_iso.py
test_04_rvpc_internallb_haproxy_stats_on_all_interfaces Success 207.38 test_internal_lb.py
test_03_vpc_internallb_haproxy_stats_on_all_interfaces Success 142.63 test_internal_lb.py
test_02_internallb_roundrobin_1RVPC_3VM_HTTP_port80 Success 524.06 test_internal_lb.py
test_01_internallb_roundrobin_1VPC_3VM_HTTP_port80 Success 409.02 test_internal_lb.py
test_dedicateGuestVlanRange Success 10.23 test_guest_vlan_range.py
test_UpdateConfigParamWithScope Success 0.10 test_global_settings.py
test_rolepermission_lifecycle_update Success 5.81 test_dynamicroles.py
test_rolepermission_lifecycle_list Success 5.70 test_dynamicroles.py
test_rolepermission_lifecycle_delete Success 5.58 test_dynamicroles.py
test_rolepermission_lifecycle_create Success 5.64 test_dynamicroles.py
test_rolepermission_lifecycle_concurrent_updates Success 5.70 test_dynamicroles.py
test_role_lifecycle_update_role_inuse Success 5.64 test_dynamicroles.py
test_role_lifecycle_update Success 5.66 test_dynamicroles.py
test_role_lifecycle_list Success 5.61 test_dynamicroles.py
test_role_lifecycle_delete Success 5.61 test_dynamicroles.py
test_role_lifecycle_create Success 5.62 test_dynamicroles.py
test_role_inuse_deletion Success 5.59 test_dynamicroles.py
test_role_account_acls_multiple_mgmt_servers Success 7.04 test_dynamicroles.py
test_role_account_acls Success 7.37 test_dynamicroles.py
test_default_role_deletion Success 5.69 test_dynamicroles.py
test_04_create_fat_type_disk_offering Success 0.06 test_disk_offerings.py
test_03_delete_disk_offering Success 0.03 test_disk_offerings.py
test_02_edit_disk_offering Success 0.04 test_disk_offerings.py
test_02_create_sparse_type_disk_offering Success 0.06 test_disk_offerings.py
test_01_create_disk_offering Success 0.09 test_disk_offerings.py
test_deployvm_userdispersing Success 20.52 test_deploy_vms_with_varied_deploymentplanners.py
test_deployvm_userconcentrated Success 20.57 test_deploy_vms_with_varied_deploymentplanners.py
test_deployvm_firstfit Success 80.71 test_deploy_vms_with_varied_deploymentplanners.py
test_deployvm_userdata_post Success 10.30 test_deploy_vm_with_userdata.py
test_deployvm_userdata Success 95.76 test_deploy_vm_with_userdata.py
test_02_deploy_vm_root_resize Success 0.07 test_deploy_vm_root_resize.py
test_01_deploy_vm_root_resize Success 0.07 test_deploy_vm_root_resize.py
test_00_deploy_vm_root_resize Success 226.49 test_deploy_vm_root_resize.py
test_deploy_vm_from_iso Success 216.95 test_deploy_vm_iso.py
test_06_verify_guest_lspci_again Success 40.44 test_deploy_virtio_scsi_vm.py
test_05_change_vm_ostype_restart Success 10.87 test_deploy_virtio_scsi_vm.py
test_04_verify_guest_lspci Success 40.45 test_deploy_virtio_scsi_vm.py
test_03_verify_libvirt_attach_disk Success 10.74 test_deploy_virtio_scsi_vm.py
test_02_verify_libvirt_after_restart Success 131.73 test_deploy_virtio_scsi_vm.py
test_01_verify_libvirt Success 0.58 test_deploy_virtio_scsi_vm.py
test_DeployVmAntiAffinityGroup Success 55.62 test_affinity_groups.py
test_change_service_offering_for_vm_with_snapshots Skipped 0.00 test_vm_snapshots.py
test_06_copy_template Skipped 0.00 test_templates.py
test_static_role_account_acls Skipped 0.02 test_staticroles.py
test_11_ss_nfs_version_on_ssvm Skipped 0.02 test_ssvm.py
test_01_scale_vm Skipped 0.00 test_scale_vm.py
test_01_primary_storage_iscsi Skipped 0.03 test_primary_storage.py
test_nested_virtualization_vmware Skipped 0.00 test_nested_virtualization.py
test_06_copy_iso Skipped 0.00 test_iso.py
test_deploy_vgpu_enabled_vm Skipped 0.02 test_deploy_vgpu_enabled_vm.py
test_3d_gpu_support Skipped 0.02 test_deploy_vgpu_enabled_vm.py

@blueorangutan
Copy link

blueorangutan commented May 16, 2017

Trillian test result (tid-1095)
Environment: xenserver-65sp1 (x2), Advanced Networking with Mgmt server 6
Total time taken: 40512 seconds
Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr1836-t1095-xenserver-65sp1.zip
Intermitten failure detected: /marvin/tests/smoke/test_privategw_acl.py
Intermitten failure detected: /marvin/tests/smoke/test_routers_network_ops.py
Intermitten failure detected: /marvin/tests/smoke/test_vpc_redundant.py
Test completed. 49 look ok, 2 have error(s)

Test Result Time (s) Test File
test_05_rvpc_multi_tiers Failure 474.81 test_vpc_redundant.py
test_04_rvpc_network_garbage_collector_nics Failure 1331.37 test_vpc_redundant.py
test_01_create_redundant_VPC_2tiers_4VMs_4IPs_4PF_ACL Failure 575.26 test_vpc_redundant.py
test_04_rvpc_privategw_static_routes Failure 735.49 test_privategw_acl.py
test_01_vpc_site2site_vpn Success 297.27 test_vpc_vpn.py
test_01_vpc_remote_access_vpn Success 152.34 test_vpc_vpn.py
test_01_redundant_vpc_site2site_vpn Success 533.75 test_vpc_vpn.py
test_02_VPC_default_routes Success 295.83 test_vpc_router_nics.py
test_01_VPC_nics_after_destroy Success 679.99 test_vpc_router_nics.py
test_03_create_redundant_VPC_1tier_2VMs_2IPs_2PF_ACL_reboot_routers Success 830.57 test_vpc_redundant.py
test_02_redundant_VPC_default_routes Success 1034.78 test_vpc_redundant.py
test_09_delete_detached_volume Success 15.77 test_volumes.py
test_08_resize_volume Success 96.10 test_volumes.py
test_07_resize_fail Success 101.15 test_volumes.py
test_06_download_detached_volume Success 20.42 test_volumes.py
test_05_detach_volume Success 100.40 test_volumes.py
test_04_delete_attached_volume Success 10.27 test_volumes.py
test_03_download_attached_volume Success 15.46 test_volumes.py
test_02_attach_volume Success 10.91 test_volumes.py
test_01_create_volume Success 392.38 test_volumes.py
test_change_service_offering_for_vm_with_snapshots Success 423.01 test_vm_snapshots.py
test_03_delete_vm_snapshots Success 280.28 test_vm_snapshots.py
test_02_revert_vm_snapshots Success 214.51 test_vm_snapshots.py
test_01_create_vm_snapshots Success 130.74 test_vm_snapshots.py
test_deploy_vm_multiple Success 268.72 test_vm_life_cycle.py
test_deploy_vm Success 0.05 test_vm_life_cycle.py
test_advZoneVirtualRouter Success 0.03 test_vm_life_cycle.py
test_10_attachAndDetach_iso Success 26.83 test_vm_life_cycle.py
test_09_expunge_vm Success 125.40 test_vm_life_cycle.py
test_08_migrate_vm Success 61.45 test_vm_life_cycle.py
test_07_restore_vm Success 0.10 test_vm_life_cycle.py
test_06_destroy_vm Success 15.21 test_vm_life_cycle.py
test_03_reboot_vm Success 10.22 test_vm_life_cycle.py
test_02_start_vm Success 20.36 test_vm_life_cycle.py
test_01_stop_vm Success 25.28 test_vm_life_cycle.py
test_CreateTemplateWithDuplicateName Success 136.46 test_templates.py
test_08_list_system_templates Success 0.04 test_templates.py
test_07_list_public_templates Success 0.05 test_templates.py
test_05_template_permissions Success 0.10 test_templates.py
test_04_extract_template Success 5.18 test_templates.py
test_03_delete_template Success 5.11 test_templates.py
test_02_edit_template Success 90.14 test_templates.py
test_01_create_template Success 75.85 test_templates.py
test_10_destroy_cpvm Success 226.86 test_ssvm.py
test_09_destroy_ssvm Success 198.57 test_ssvm.py
test_08_reboot_cpvm Success 141.51 test_ssvm.py
test_07_reboot_ssvm Success 144.14 test_ssvm.py
test_06_stop_cpvm Success 136.55 test_ssvm.py
test_05_stop_ssvm Success 169.04 test_ssvm.py
test_04_cpvm_internals Success 0.89 test_ssvm.py
test_03_ssvm_internals Success 3.41 test_ssvm.py
test_02_list_cpvm_vm Success 0.15 test_ssvm.py
test_01_list_sec_storage_vm Success 0.17 test_ssvm.py
test_02_list_snapshots_with_removed_data_store Success 126.62 test_snapshots.py
test_01_snapshot_root_disk Success 27.42 test_snapshots.py
test_04_change_offering_small Success 86.10 test_service_offerings.py
test_03_delete_service_offering Success 0.05 test_service_offerings.py
test_02_edit_service_offering Success 0.07 test_service_offerings.py
test_01_create_service_offering Success 0.14 test_service_offerings.py
test_02_sys_template_ready Success 0.13 test_secondary_storage.py
test_01_sys_vm_start Success 0.22 test_secondary_storage.py
test_01_scale_vm Success 5.33 test_scale_vm.py
test_09_reboot_router Success 70.75 test_routers.py
test_08_start_router Success 60.66 test_routers.py
test_07_stop_router Success 15.23 test_routers.py
test_06_router_advanced Success 0.06 test_routers.py
test_05_router_basic Success 0.06 test_routers.py
test_04_restart_network_wo_cleanup Success 5.47 test_routers.py
test_03_restart_network_cleanup Success 116.03 test_routers.py
test_02_router_internal_adv Success 0.77 test_routers.py
test_01_router_internal_basic Success 0.50 test_routers.py
test_router_dns_guestipquery Success 48.88 test_router_dns.py
test_router_dns_externalipquery Success 0.07 test_router_dns.py
test_router_dhcphosts Success 108.07 test_router_dhcphosts.py
test_router_dhcp_opts Success 26.65 test_router_dhcphosts.py
test_01_updatevolumedetail Success 0.11 test_resource_detail.py
test_01_reset_vm_on_reboot Success 116.18 test_reset_vm_on_reboot.py
test_createRegion Success 0.08 test_regions.py
test_create_pvlan_network Success 5.30 test_pvlan.py
test_dedicatePublicIpRange Success 1.07 test_public_ip_range.py
test_03_vpc_privategw_restart_vpc_cleanup Success 905.62 test_privategw_acl.py
test_02_vpc_privategw_static_routes Success 664.45 test_privategw_acl.py
test_01_vpc_privategw_acl Success 148.57 test_privategw_acl.py
test_03_migration_options_storage_tags Success 50.89 test_primary_storage.py
test_02_edit_primary_storage_tags Success 0.12 test_primary_storage.py
test_01_primary_storage_nfs Success 38.85 test_primary_storage.py
test_01_primary_storage_iscsi Success 77.94 test_primary_storage.py
test_01_deploy_vms_storage_tags Success 31.39 test_primary_storage.py
test_createPortablePublicIPRange Success 15.25 test_portable_publicip.py
test_createPortablePublicIPAcquire Success 15.66 test_portable_publicip.py
test_isolate_network_password_server Success 61.19 test_password_server.py
test_UpdateStorageOverProvisioningFactor Success 0.15 test_over_provisioning.py
test_oobm_zchange_password Success 30.87 test_outofbandmanagement.py
test_oobm_multiple_mgmt_server_ownership Success 16.50 test_outofbandmanagement.py
test_oobm_issue_power_status Success 10.44 test_outofbandmanagement.py
test_oobm_issue_power_soft Success 15.40 test_outofbandmanagement.py
test_oobm_issue_power_reset Success 15.58 test_outofbandmanagement.py
test_oobm_issue_power_on Success 15.45 test_outofbandmanagement.py
test_oobm_issue_power_off Success 15.52 test_outofbandmanagement.py
test_oobm_issue_power_cycle Success 15.45 test_outofbandmanagement.py
test_oobm_enabledisable_across_clusterzones Success 78.11 test_outofbandmanagement.py
test_oobm_enable_feature_valid Success 0.17 test_outofbandmanagement.py
test_oobm_enable_feature_invalid Success 0.10 test_outofbandmanagement.py
test_oobm_disable_feature_valid Success 5.19 test_outofbandmanagement.py
test_oobm_disable_feature_invalid Success 0.16 test_outofbandmanagement.py
test_oobm_configure_invalid_driver Success 0.11 test_outofbandmanagement.py
test_oobm_configure_default_driver Success 0.08 test_outofbandmanagement.py
test_oobm_background_powerstate_sync Success 29.60 test_outofbandmanagement.py
test_extendPhysicalNetworkVlan Success 15.38 test_non_contigiousvlan.py
test_01_nic Success 521.21 test_nic.py
test_releaseIP Success 288.89 test_network.py
test_reboot_router Success 590.63 test_network.py
test_public_ip_user_account Success 10.33 test_network.py
test_public_ip_admin_account Success 40.43 test_network.py
test_network_rules_acquired_public_ip_3_Load_Balancer_Rule Success 86.80 test_network.py
test_network_rules_acquired_public_ip_2_nat_rule Success 76.72 test_network.py
test_network_rules_acquired_public_ip_1_static_nat_rule Success 103.14 test_network.py
test_delete_account Success 228.08 test_network.py
test_02_port_fwd_on_non_src_nat Success 60.87 test_network.py
test_01_port_fwd_on_src_nat Success 83.96 test_network.py
test_nic_secondaryip_add_remove Success 152.85 test_multipleips_per_nic.py
test_list_zones_metrics Success 0.31 test_metrics_api.py
test_list_volumes_metrics Success 5.63 test_metrics_api.py
test_list_vms_metrics Success 217.34 test_metrics_api.py
test_list_pstorage_metrics Success 0.40 test_metrics_api.py
test_list_infrastructure_metrics Success 0.66 test_metrics_api.py
test_list_hosts_metrics Success 0.42 test_metrics_api.py
test_list_clusters_metrics Success 0.41 test_metrics_api.py
login_test_saml_user Success 19.39 test_login.py
test_assign_and_removal_lb Success 149.06 test_loadbalance.py
test_02_create_lb_rule_non_nat Success 207.68 test_loadbalance.py
test_01_create_lb_rule_src_nat Success 208.28 test_loadbalance.py
test_03_list_snapshots Success 0.07 test_list_ids_parameter.py
test_02_list_templates Success 0.07 test_list_ids_parameter.py
test_01_list_volumes Success 0.04 test_list_ids_parameter.py
test_07_list_default_iso Success 0.06 test_iso.py
test_05_iso_permissions Success 0.07 test_iso.py
test_04_extract_Iso Success 5.14 test_iso.py
test_03_delete_iso Success 95.24 test_iso.py
test_02_edit_iso Success 0.06 test_iso.py
test_01_create_iso Success 21.12 test_iso.py
test_04_rvpc_internallb_haproxy_stats_on_all_interfaces Success 436.17 test_internal_lb.py
test_03_vpc_internallb_haproxy_stats_on_all_interfaces Success 274.97 test_internal_lb.py
test_02_internallb_roundrobin_1RVPC_3VM_HTTP_port80 Success 926.02 test_internal_lb.py
test_01_internallb_roundrobin_1VPC_3VM_HTTP_port80 Success 680.20 test_internal_lb.py
test_dedicateGuestVlanRange Success 10.35 test_guest_vlan_range.py
test_UpdateConfigParamWithScope Success 0.17 test_global_settings.py
test_rolepermission_lifecycle_update Success 6.37 test_dynamicroles.py
test_rolepermission_lifecycle_list Success 6.17 test_dynamicroles.py
test_rolepermission_lifecycle_delete Success 5.99 test_dynamicroles.py
test_rolepermission_lifecycle_create Success 5.93 test_dynamicroles.py
test_rolepermission_lifecycle_concurrent_updates Success 6.09 test_dynamicroles.py
test_role_lifecycle_update_role_inuse Success 6.00 test_dynamicroles.py
test_role_lifecycle_update Success 11.24 test_dynamicroles.py
test_role_lifecycle_list Success 6.02 test_dynamicroles.py
test_role_lifecycle_delete Success 11.05 test_dynamicroles.py
test_role_lifecycle_create Success 6.02 test_dynamicroles.py
test_role_inuse_deletion Success 5.98 test_dynamicroles.py
test_role_account_acls_multiple_mgmt_servers Success 8.34 test_dynamicroles.py
test_role_account_acls Success 8.25 test_dynamicroles.py
test_default_role_deletion Success 6.14 test_dynamicroles.py
test_04_create_fat_type_disk_offering Success 0.10 test_disk_offerings.py
test_03_delete_disk_offering Success 0.04 test_disk_offerings.py
test_02_edit_disk_offering Success 0.06 test_disk_offerings.py
test_02_create_sparse_type_disk_offering Success 0.10 test_disk_offerings.py
test_01_create_disk_offering Success 0.09 test_disk_offerings.py
test_deployvm_userdispersing Success 101.41 test_deploy_vms_with_varied_deploymentplanners.py
test_deployvm_userconcentrated Success 45.95 test_deploy_vms_with_varied_deploymentplanners.py
test_deployvm_firstfit Success 176.81 test_deploy_vms_with_varied_deploymentplanners.py
test_deployvm_userdata_post Success 20.52 test_deploy_vm_with_userdata.py
test_deployvm_userdata Success 121.50 test_deploy_vm_with_userdata.py
test_02_deploy_vm_root_resize Success 0.10 test_deploy_vm_root_resize.py
test_01_deploy_vm_root_resize Success 0.08 test_deploy_vm_root_resize.py
test_00_deploy_vm_root_resize Success 177.24 test_deploy_vm_root_resize.py
test_deploy_vm_from_iso Success 157.51 test_deploy_vm_iso.py
test_DeployVmAntiAffinityGroup Success 338.66 test_affinity_groups.py
test_06_copy_template Skipped 0.00 test_templates.py
test_static_role_account_acls Skipped 0.03 test_staticroles.py
test_11_ss_nfs_version_on_ssvm Skipped 0.03 test_ssvm.py
test_nested_virtualization_vmware Skipped 0.00 test_nested_virtualization.py
test_06_copy_iso Skipped 0.00 test_iso.py
test_06_verify_guest_lspci_again Skipped 0.00 test_deploy_virtio_scsi_vm.py
test_05_change_vm_ostype_restart Skipped 0.00 test_deploy_virtio_scsi_vm.py
test_04_verify_guest_lspci Skipped 0.00 test_deploy_virtio_scsi_vm.py
test_03_verify_libvirt_attach_disk Skipped 0.00 test_deploy_virtio_scsi_vm.py
test_02_verify_libvirt_after_restart Skipped 0.00 test_deploy_virtio_scsi_vm.py
test_01_verify_libvirt Skipped 0.00 test_deploy_virtio_scsi_vm.py
test_deploy_vgpu_enabled_vm Skipped 0.04 test_deploy_vgpu_enabled_vm.py
test_3d_gpu_support Skipped 0.04 test_deploy_vgpu_enabled_vm.py

@blueorangutan
Copy link

blueorangutan commented May 16, 2017

Trillian test result (tid-1096)
Environment: vmware-55u3 (x2), Advanced Networking with Mgmt server 7
Total time taken: 47289 seconds
Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr1836-t1096-vmware-55u3.zip
Intermitten failure detected: /marvin/tests/smoke/test_deploy_vm_root_resize.py
Intermitten failure detected: /marvin/tests/smoke/test_privategw_acl.py
Intermitten failure detected: /marvin/tests/smoke/test_routers_network_ops.py
Intermitten failure detected: /marvin/tests/smoke/test_routers.py
Intermitten failure detected: /marvin/tests/smoke/test_templates.py
Intermitten failure detected: /marvin/tests/smoke/test_volumes.py
Intermitten failure detected: /marvin/tests/smoke/test_vpc_redundant.py
Test completed. 46 look ok, 6 have error(s)

Test Result Time (s) Test File
test_01_create_volume Failure 194.54 test_volumes.py
test_04_rvpc_privategw_static_routes Failure 954.50 test_privategw_acl.py
test_02_vpc_privategw_static_routes Failure 136.72 test_privategw_acl.py
test_02_redundant_VPC_default_routes Error 247.31 test_vpc_redundant.py
test_09_reboot_router Error 5.11 test_routers.py
test_08_start_router Error 160.96 test_routers.py
ContextSuite context=TestDeployVmRootSize>:setup Error 0.00 test_deploy_vm_root_resize.py
test_01_vpc_site2site_vpn Success 506.60 test_vpc_vpn.py
test_01_vpc_remote_access_vpn Success 176.85 test_vpc_vpn.py
test_01_redundant_vpc_site2site_vpn Success 628.24 test_vpc_vpn.py
test_02_VPC_default_routes Success 319.00 test_vpc_router_nics.py
test_01_VPC_nics_after_destroy Success 710.99 test_vpc_router_nics.py
test_05_rvpc_multi_tiers Success 675.69 test_vpc_redundant.py
test_04_rvpc_network_garbage_collector_nics Success 1548.54 test_vpc_redundant.py
test_03_create_redundant_VPC_1tier_2VMs_2IPs_2PF_ACL_reboot_routers Success 693.77 test_vpc_redundant.py
test_01_create_redundant_VPC_2tiers_4VMs_4IPs_4PF_ACL Success 1427.29 test_vpc_redundant.py
test_09_delete_detached_volume Success 35.87 test_volumes.py
test_06_download_detached_volume Success 90.66 test_volumes.py
test_05_detach_volume Success 110.29 test_volumes.py
test_04_delete_attached_volume Success 15.26 test_volumes.py
test_03_download_attached_volume Success 25.31 test_volumes.py
test_02_attach_volume Success 64.88 test_volumes.py
test_change_service_offering_for_vm_with_snapshots Success 447.89 test_vm_snapshots.py
test_03_delete_vm_snapshots Success 275.14 test_vm_snapshots.py
test_02_revert_vm_snapshots Success 229.06 test_vm_snapshots.py
test_01_create_vm_snapshots Success 129.20 test_vm_snapshots.py
test_deploy_vm_multiple Success 292.87 test_vm_life_cycle.py
test_deploy_vm Success 0.03 test_vm_life_cycle.py
test_advZoneVirtualRouter Success 0.02 test_vm_life_cycle.py
test_10_attachAndDetach_iso Success 26.83 test_vm_life_cycle.py
test_09_expunge_vm Success 125.18 test_vm_life_cycle.py
test_08_migrate_vm Success 66.05 test_vm_life_cycle.py
test_07_restore_vm Success 0.14 test_vm_life_cycle.py
test_06_destroy_vm Success 10.16 test_vm_life_cycle.py
test_03_reboot_vm Success 5.13 test_vm_life_cycle.py
test_02_start_vm Success 20.22 test_vm_life_cycle.py
test_01_stop_vm Success 10.21 test_vm_life_cycle.py
test_CreateTemplateWithDuplicateName Success 377.31 test_templates.py
test_08_list_system_templates Success 0.03 test_templates.py
test_07_list_public_templates Success 0.04 test_templates.py
test_05_template_permissions Success 0.07 test_templates.py
test_04_extract_template Success 21.16 test_templates.py
test_03_delete_template Success 5.10 test_templates.py
test_02_edit_template Success 90.15 test_templates.py
test_01_create_template Success 136.14 test_templates.py
test_10_destroy_cpvm Success 206.80 test_ssvm.py
test_09_destroy_ssvm Success 208.72 test_ssvm.py
test_08_reboot_cpvm Success 156.59 test_ssvm.py
test_07_reboot_ssvm Success 158.68 test_ssvm.py
test_06_stop_cpvm Success 236.96 test_ssvm.py
test_05_stop_ssvm Success 203.86 test_ssvm.py
test_04_cpvm_internals Success 1.31 test_ssvm.py
test_03_ssvm_internals Success 3.75 test_ssvm.py
test_02_list_cpvm_vm Success 0.13 test_ssvm.py
test_01_list_sec_storage_vm Success 0.15 test_ssvm.py
test_02_list_snapshots_with_removed_data_store Success 248.15 test_snapshots.py
test_01_snapshot_root_disk Success 36.33 test_snapshots.py
test_04_change_offering_small Success 91.81 test_service_offerings.py
test_03_delete_service_offering Success 0.04 test_service_offerings.py
test_02_edit_service_offering Success 0.08 test_service_offerings.py
test_01_create_service_offering Success 0.13 test_service_offerings.py
test_02_sys_template_ready Success 0.13 test_secondary_storage.py
test_01_sys_vm_start Success 0.18 test_secondary_storage.py
test_07_stop_router Success 30.26 test_routers.py
test_06_router_advanced Success 0.05 test_routers.py
test_05_router_basic Success 0.04 test_routers.py
test_04_restart_network_wo_cleanup Success 5.65 test_routers.py
test_03_restart_network_cleanup Success 166.06 test_routers.py
test_02_router_internal_adv Success 1.07 test_routers.py
test_01_router_internal_basic Success 0.55 test_routers.py
test_router_dns_guestipquery Success 76.61 test_router_dns.py
test_router_dns_externalipquery Success 0.08 test_router_dns.py
test_router_dhcphosts Success 115.90 test_router_dhcphosts.py
test_router_dhcp_opts Success 21.65 test_router_dhcphosts.py
test_01_updatevolumedetail Success 5.10 test_resource_detail.py
test_01_reset_vm_on_reboot Success 30.40 test_reset_vm_on_reboot.py
test_createRegion Success 0.04 test_regions.py
test_create_pvlan_network Success 5.21 test_pvlan.py
test_dedicatePublicIpRange Success 0.47 test_public_ip_range.py
test_03_vpc_privategw_restart_vpc_cleanup Success 1154.19 test_privategw_acl.py
test_01_vpc_privategw_acl Success 207.88 test_privategw_acl.py
test_03_migration_options_storage_tags Success 36.56 test_primary_storage.py
test_02_edit_primary_storage_tags Success 0.10 test_primary_storage.py
test_01_primary_storage_nfs Success 37.49 test_primary_storage.py
test_01_deploy_vms_storage_tags Success 51.76 test_primary_storage.py
test_createPortablePublicIPRange Success 15.19 test_portable_publicip.py
test_createPortablePublicIPAcquire Success 15.45 test_portable_publicip.py
test_isolate_network_password_server Success 92.46 test_password_server.py
test_UpdateStorageOverProvisioningFactor Success 0.13 test_over_provisioning.py
test_oobm_zchange_password Success 25.74 test_outofbandmanagement.py
test_oobm_multiple_mgmt_server_ownership Success 16.40 test_outofbandmanagement.py
test_oobm_issue_power_status Success 5.26 test_outofbandmanagement.py
test_oobm_issue_power_soft Success 15.41 test_outofbandmanagement.py
test_oobm_issue_power_reset Success 10.40 test_outofbandmanagement.py
test_oobm_issue_power_on Success 15.38 test_outofbandmanagement.py
test_oobm_issue_power_off Success 10.35 test_outofbandmanagement.py
test_oobm_issue_power_cycle Success 15.33 test_outofbandmanagement.py
test_oobm_enabledisable_across_clusterzones Success 87.78 test_outofbandmanagement.py
test_oobm_enable_feature_valid Success 5.18 test_outofbandmanagement.py
test_oobm_enable_feature_invalid Success 5.17 test_outofbandmanagement.py
test_oobm_disable_feature_valid Success 5.31 test_outofbandmanagement.py
test_oobm_disable_feature_invalid Success 5.18 test_outofbandmanagement.py
test_oobm_configure_invalid_driver Success 0.09 test_outofbandmanagement.py
test_oobm_configure_default_driver Success 0.09 test_outofbandmanagement.py
test_oobm_background_powerstate_sync Success 23.47 test_outofbandmanagement.py
test_extendPhysicalNetworkVlan Success 15.31 test_non_contigiousvlan.py
test_01_nic Success 540.34 test_nic.py
test_releaseIP Success 303.26 test_network.py
test_reboot_router Success 735.66 test_network.py
test_public_ip_user_account Success 10.33 test_network.py
test_public_ip_admin_account Success 40.33 test_network.py
test_network_rules_acquired_public_ip_3_Load_Balancer_Rule Success 76.88 test_network.py
test_network_rules_acquired_public_ip_2_nat_rule Success 61.68 test_network.py
test_network_rules_acquired_public_ip_1_static_nat_rule Success 124.76 test_network.py
test_delete_account Success 292.89 test_network.py
test_02_port_fwd_on_non_src_nat Success 55.67 test_network.py
test_01_port_fwd_on_src_nat Success 112.25 test_network.py
test_nested_virtualization_vmware Success 318.67 test_nested_virtualization.py
test_nic_secondaryip_add_remove Success 283.11 test_multipleips_per_nic.py
test_list_zones_metrics Success 0.24 test_metrics_api.py
test_list_volumes_metrics Success 5.67 test_metrics_api.py
test_list_vms_metrics Success 211.93 test_metrics_api.py
test_list_pstorage_metrics Success 0.28 test_metrics_api.py
test_list_infrastructure_metrics Success 0.46 test_metrics_api.py
test_list_hosts_metrics Success 0.45 test_metrics_api.py
test_list_clusters_metrics Success 0.59 test_metrics_api.py
login_test_saml_user Success 19.30 test_login.py
test_assign_and_removal_lb Success 148.54 test_loadbalance.py
test_02_create_lb_rule_non_nat Success 207.33 test_loadbalance.py
test_01_create_lb_rule_src_nat Success 207.94 test_loadbalance.py
test_03_list_snapshots Success 0.11 test_list_ids_parameter.py
test_02_list_templates Success 0.04 test_list_ids_parameter.py
test_01_list_volumes Success 0.03 test_list_ids_parameter.py
test_07_list_default_iso Success 0.06 test_iso.py
test_05_iso_permissions Success 0.07 test_iso.py
test_04_extract_Iso Success 5.30 test_iso.py
test_03_delete_iso Success 95.19 test_iso.py
test_02_edit_iso Success 0.06 test_iso.py
test_01_create_iso Success 21.00 test_iso.py
test_04_rvpc_internallb_haproxy_stats_on_all_interfaces Success 611.05 test_internal_lb.py
test_03_vpc_internallb_haproxy_stats_on_all_interfaces Success 409.88 test_internal_lb.py
test_02_internallb_roundrobin_1RVPC_3VM_HTTP_port80 Success 1094.01 test_internal_lb.py
test_01_internallb_roundrobin_1VPC_3VM_HTTP_port80 Success 908.00 test_internal_lb.py
test_dedicateGuestVlanRange Success 10.24 test_guest_vlan_range.py
test_UpdateConfigParamWithScope Success 0.14 test_global_settings.py
test_rolepermission_lifecycle_update Success 6.17 test_dynamicroles.py
test_rolepermission_lifecycle_list Success 6.01 test_dynamicroles.py
test_rolepermission_lifecycle_delete Success 5.96 test_dynamicroles.py
test_rolepermission_lifecycle_create Success 6.07 test_dynamicroles.py
test_rolepermission_lifecycle_concurrent_updates Success 6.00 test_dynamicroles.py
test_role_lifecycle_update_role_inuse Success 5.91 test_dynamicroles.py
test_role_lifecycle_update Success 11.01 test_dynamicroles.py
test_role_lifecycle_list Success 5.92 test_dynamicroles.py
test_role_lifecycle_delete Success 5.92 test_dynamicroles.py
test_role_lifecycle_create Success 5.94 test_dynamicroles.py
test_role_inuse_deletion Success 6.11 test_dynamicroles.py
test_role_account_acls_multiple_mgmt_servers Success 8.65 test_dynamicroles.py
test_role_account_acls Success 8.50 test_dynamicroles.py
test_default_role_deletion Success 6.05 test_dynamicroles.py
test_04_create_fat_type_disk_offering Success 0.09 test_disk_offerings.py
test_03_delete_disk_offering Success 0.04 test_disk_offerings.py
test_02_edit_disk_offering Success 0.06 test_disk_offerings.py
test_02_create_sparse_type_disk_offering Success 0.08 test_disk_offerings.py
test_01_create_disk_offering Success 0.11 test_disk_offerings.py
test_deployvm_userdispersing Success 71.25 test_deploy_vms_with_varied_deploymentplanners.py
test_deployvm_userconcentrated Success 106.37 test_deploy_vms_with_varied_deploymentplanners.py
test_deployvm_firstfit Success 246.84 test_deploy_vms_with_varied_deploymentplanners.py
test_deployvm_userdata_post Success 30.54 test_deploy_vm_with_userdata.py
test_deployvm_userdata Success 176.58 test_deploy_vm_with_userdata.py
test_deploy_vm_from_iso Success 227.60 test_deploy_vm_iso.py
test_3d_gpu_support Success 515.56 test_deploy_vgpu_enabled_vm.py
test_DeployVmAntiAffinityGroup Success 272.28 test_affinity_groups.py
test_08_resize_volume Skipped 5.10 test_volumes.py
test_07_resize_fail Skipped 10.23 test_volumes.py
test_06_copy_template Skipped 0.00 test_templates.py
test_static_role_account_acls Skipped 0.02 test_staticroles.py
test_11_ss_nfs_version_on_ssvm Skipped 0.02 test_ssvm.py
test_01_scale_vm Skipped 66.31 test_scale_vm.py
test_01_primary_storage_iscsi Skipped 0.04 test_primary_storage.py
test_06_copy_iso Skipped 0.00 test_iso.py
test_06_verify_guest_lspci_again Skipped 0.00 test_deploy_virtio_scsi_vm.py
test_05_change_vm_ostype_restart Skipped 0.00 test_deploy_virtio_scsi_vm.py
test_04_verify_guest_lspci Skipped 0.00 test_deploy_virtio_scsi_vm.py
test_03_verify_libvirt_attach_disk Skipped 0.00 test_deploy_virtio_scsi_vm.py
test_02_verify_libvirt_after_restart Skipped 0.00 test_deploy_virtio_scsi_vm.py
test_01_verify_libvirt Skipped 0.00 test_deploy_virtio_scsi_vm.py
test_deploy_vgpu_enabled_vm Skipped 1.18 test_deploy_vgpu_enabled_vm.py

@yadvr yadvr mentioned this pull request May 18, 2017
Merged
@yadvr yadvr closed this May 18, 2017
@yadvr
Copy link
Member Author

yadvr commented May 18, 2017

Will create a new PR, this has too many comments now.

@yadvr
Copy link
Member Author

yadvr commented May 18, 2017

New: #2114

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

No reviews

Assignees

No one assigned

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

6 participants

@yadvr @blueorangutan @serg38 @karuturi @nathanejohnson @borisstoyanov
Morty Proxy This is a proxified and sanitized view of the page, visit original site.