No missing expected images.
Compose FAILS proposed Rawhide gating check! 5 of 47 required tests failed openQA tests matching unsatisfied gating requirements shown with **GATING** below
Failed openQA tests: 28/131 (x86_64), 3/23 (i386), 1/2 (arm)
New failures (same test not failed in Rawhide-20181205.n.0):
ID: 316407 Test: x86_64 Server-dvd-iso server_role_deploy_domain_controller **GATING** URL: https://openqa.fedoraproject.org/tests/316407 ID: 316408 Test: x86_64 Server-dvd-iso server_realmd_join_kickstart **GATING** URL: https://openqa.fedoraproject.org/tests/316408 ID: 316411 Test: x86_64 Server-dvd-iso realmd_join_cockpit URL: https://openqa.fedoraproject.org/tests/316411 ID: 316412 Test: x86_64 Server-dvd-iso realmd_join_sssd **GATING** URL: https://openqa.fedoraproject.org/tests/316412 ID: 316413 Test: x86_64 Server-dvd-iso server_freeipa_replication_master URL: https://openqa.fedoraproject.org/tests/316413 ID: 316414 Test: x86_64 Server-dvd-iso server_freeipa_replication_replica URL: https://openqa.fedoraproject.org/tests/316414 ID: 316415 Test: x86_64 Server-dvd-iso server_freeipa_replication_client URL: https://openqa.fedoraproject.org/tests/316415 ID: 316424 Test: x86_64 Everything-boot-iso install_default@uefi **GATING** URL: https://openqa.fedoraproject.org/tests/316424 ID: 316425 Test: x86_64 Everything-boot-iso install_default **GATING** URL: https://openqa.fedoraproject.org/tests/316425 ID: 316492 Test: x86_64 universal install_blivet_ext3@uefi URL: https://openqa.fedoraproject.org/tests/316492
Old failures (same test failed in Rawhide-20181205.n.0):
ID: 316419 Test: x86_64 Server-dvd-iso modularity_tests URL: https://openqa.fedoraproject.org/tests/316419 ID: 316430 Test: x86_64 Workstation-live-iso base_services_start URL: https://openqa.fedoraproject.org/tests/316430 ID: 316438 Test: x86_64 Workstation-live-iso desktop_notifications_postinstall URL: https://openqa.fedoraproject.org/tests/316438 ID: 316440 Test: x86_64 Workstation-boot-iso memory_check@uefi URL: https://openqa.fedoraproject.org/tests/316440 ID: 316441 Test: x86_64 Workstation-boot-iso memory_check URL: https://openqa.fedoraproject.org/tests/316441 ID: 316443 Test: i386 Workstation-boot-iso install_default URL: https://openqa.fedoraproject.org/tests/316443 ID: 316444 Test: i386 Workstation-boot-iso memory_check URL: https://openqa.fedoraproject.org/tests/316444 ID: 316459 Test: arm Minimal-raw_xz-raw.xz install_arm_image_deployment_upload URL: https://openqa.fedoraproject.org/tests/316459 ID: 316510 Test: x86_64 universal upgrade_kde_64bit URL: https://openqa.fedoraproject.org/tests/316510 ID: 316511 Test: x86_64 universal upgrade_desktop_encrypted_64bit URL: https://openqa.fedoraproject.org/tests/316511 ID: 316515 Test: x86_64 universal upgrade_minimal_64bit URL: https://openqa.fedoraproject.org/tests/316515 ID: 316516 Test: x86_64 universal upgrade_desktop_64bit URL: https://openqa.fedoraproject.org/tests/316516 ID: 316517 Test: x86_64 universal upgrade_server_64bit URL: https://openqa.fedoraproject.org/tests/316517 ID: 316518 Test: x86_64 universal upgrade_server_domain_controller URL: https://openqa.fedoraproject.org/tests/316518 ID: 316519 Test: x86_64 universal upgrade_realmd_client URL: https://openqa.fedoraproject.org/tests/316519 ID: 316525 Test: x86_64 universal install_shrink_ext4 URL: https://openqa.fedoraproject.org/tests/316525 ID: 316526 Test: x86_64 universal install_shrink_ntfs URL: https://openqa.fedoraproject.org/tests/316526 ID: 316527 Test: x86_64 universal install_european_language URL: https://openqa.fedoraproject.org/tests/316527 ID: 316528 Test: x86_64 universal install_cyrillic_language URL: https://openqa.fedoraproject.org/tests/316528 ID: 316529 Test: x86_64 universal install_arabic_language URL: https://openqa.fedoraproject.org/tests/316529 ID: 316530 Test: x86_64 universal install_asian_language URL: https://openqa.fedoraproject.org/tests/316530 ID: 316539 Test: i386 universal upgrade_desktop_32bit URL: https://openqa.fedoraproject.org/tests/316539
Soft failed openQA tests: 3/131 (x86_64), 2/23 (i386) (Tests completed, but using a workaround for a known bug)
New soft failures (same test not soft failed in Rawhide-20181205.n.0):
ID: 316427 Test: x86_64 Workstation-live-iso install_default_upload URL: https://openqa.fedoraproject.org/tests/316427 ID: 316428 Test: x86_64 Workstation-live-iso install_default@uefi URL: https://openqa.fedoraproject.org/tests/316428 ID: 316447 Test: x86_64 KDE-live-iso install_no_user URL: https://openqa.fedoraproject.org/tests/316447
Old soft failures (same test soft failed in Rawhide-20181205.n.0):
ID: 316422 Test: i386 Server-boot-iso install_default URL: https://openqa.fedoraproject.org/tests/316422 ID: 316423 Test: i386 Server-dvd-iso install_default URL: https://openqa.fedoraproject.org/tests/316423
Passed openQA tests: 100/131 (x86_64), 18/23 (i386)
New passes (same test not passed in Rawhide-20181205.n.0):
ID: 316437 Test: x86_64 Workstation-live-iso desktop_notifications_live URL: https://openqa.fedoraproject.org/tests/316437 ID: 316446 Test: x86_64 KDE-live-iso install_default@uefi URL: https://openqa.fedoraproject.org/tests/316446 ID: 316533 Test: x86_64 universal install_rescue_encrypted@uefi URL: https://openqa.fedoraproject.org/tests/316533
Skipped non-gating openQA tests: 1 of 156
Installed system changes in test x86_64 Server-boot-iso install_default@uefi: Used mem changed from 170 MiB to 199 MiB System load changed from 1.58 to 1.14 Previous test data: https://openqa.fedoraproject.org/tests/316161#downloads Current test data: https://openqa.fedoraproject.org/tests/316395#downloads
Installed system changes in test x86_64 Server-dvd-iso install_default_upload: System load changed from 1.28 to 1.66 Previous test data: https://openqa.fedoraproject.org/tests/316163#downloads Current test data: https://openqa.fedoraproject.org/tests/316397#downloads
Installed system changes in test x86_64 Server-dvd-iso install_default@uefi: System load changed from 1.31 to 1.05 Previous test data: https://openqa.fedoraproject.org/tests/316164#downloads Current test data: https://openqa.fedoraproject.org/tests/316398#downloads
Installed system changes in test i386 Server-boot-iso install_default: Used mem changed from 122 MiB to 135 MiB Previous test data: https://openqa.fedoraproject.org/tests/316188#downloads Current test data: https://openqa.fedoraproject.org/tests/316422#downloads
Installed system changes in test i386 Everything-boot-iso install_default: Used mem changed from 90 MiB to 102 MiB System load changed from 0.39 to 0.25 Previous test data: https://openqa.fedoraproject.org/tests/316192#downloads Current test data: https://openqa.fedoraproject.org/tests/316426#downloads
Installed system changes in test x86_64 Workstation-live-iso install_default_upload: 1 packages(s) added since previous compose: NetworkManager-config-connectivity-fedora 1 packages(s) removed since previous compose: boost-regex Previous test data: https://openqa.fedoraproject.org/tests/316193#downloads Current test data: https://openqa.fedoraproject.org/tests/316427#downloads
Installed system changes in test x86_64 Workstation-live-iso install_default@uefi: Used mem changed from 1027 MiB to 1244 MiB Used Swap grew from 0 to 11 MiB 1 packages(s) added since previous compose: NetworkManager-config-connectivity-fedora 1 packages(s) removed since previous compose: boost-regex System load changed from 1.71 to 2.28 Average CPU usage changed from 3.54285714 to 33.66666667 Previous test data: https://openqa.fedoraproject.org/tests/316194#downloads Current test data: https://openqa.fedoraproject.org/tests/316428#downloads
Installed system changes in test x86_64 Workstation-boot-iso install_default@uefi: System load changed from 1.55 to 1.67 Previous test data: https://openqa.fedoraproject.org/tests/316205#downloads Current test data: https://openqa.fedoraproject.org/tests/316439#downloads
Installed system changes in test x86_64 Workstation-boot-iso install_default: System load changed from 1.85 to 2.20 Average CPU usage changed from 5.36190476 to 31.66666667 Previous test data: https://openqa.fedoraproject.org/tests/316208#downloads Current test data: https://openqa.fedoraproject.org/tests/316442#downloads
Installed system changes in test x86_64 KDE-live-iso install_default@uefi: System load changed from 1.74 to 1.90 Previous test data: https://openqa.fedoraproject.org/tests/316213#downloads Current test data: https://openqa.fedoraproject.org/tests/316446#downloads
Installed system changes in test x86_64 universal install_package_set_kde: System load changed from 1.85 to 2.09 Average CPU usage changed from 15.56190476 to 39.02380952 Previous test data: https://openqa.fedoraproject.org/tests/316265#downloads Current test data: https://openqa.fedoraproject.org/tests/316498#downloads
Installed system changes in test i386 universal install_package_set_minimal: System load changed from 0.39 to 0.24 Previous test data: https://openqa.fedoraproject.org/tests/316309#downloads Current test data: https://openqa.fedoraproject.org/tests/316542#downloads
Installed system changes in test i386 universal install_package_set_kde: System load changed from 0.51 to 0.78 Previous test data: https://openqa.fedoraproject.org/tests/316317#downloads Current test data: https://openqa.fedoraproject.org/tests/316550#downloads
On Thu, 2018-12-06 at 15:25 +0000, Fedora compose checker wrote:
No missing expected images.
Compose FAILS proposed Rawhide gating check! 5 of 47 required tests failed openQA tests matching unsatisfied gating requirements shown with **GATING** below
So - this is a new feature of check-compose I wrote yesterday :)
As part of the 'NoMoreAlpha' change from a few releases back:
https://fedoraproject.org/wiki/Changes/NoMoreAlpha
we planned to start gating Rawhide composes - only syncing them out to become the current public state of the 'Rawhide' tree if they pass some subset of the automated compose tests. However, this has not yet been implemented.
An initial gating policy was actually committed to the Fedora Greenwave config some months back by Ralph Bean, and since then it's been possible to ask Greenwave whether a given compose passes or fails the policy - but nothing was hooked up beyond that; no-one's been doing anything with that information.
Ultimately the idea is that the Greenwave decision should be hooked into the compose sync process, but I thought before we go that far, it'd be useful to know just how often composes actually *do* meet the requirements. So I enhanced check-compose to request the decision from Greenwave and include it in the output, like this. This should help us get an idea just how often we'd be refusing to sync composes if we turned gating on.
The failures that fail the gating check today are down to https://bugzilla.redhat.com/show_bug.cgi?id=1654537 and the Everything netinst tests for both x86_64 and UEFI failing because of the network not being up in the guest for some reason. The FreeIPA bug I'm hopeful we can get fixed soon, I'm not sure what's going on with the netinst failure, I'll have to look into that. (It's a bit tricky because, when the network in the guest doesn't work, we don't get any logs from the test...)
Eagle-eyed readers may not a slight bug in the new feature: Greenwave reports *5* failed requirements, but the details below show only *4* tests with **GATING**. This is because the other failed test - the FreeIPA server test - doesn't show up in the check-compose output for some reason. If you re-run check-compose now, it *does* show up, so this is likely some kind of ordering issue to do with exactly what state that job is in when check-compose runs (my working theory is that it's in 'uploading' state - that could cause it to fall between some code cracks). I'll see if I can fix that.
Thanks folks!
devel@lists.stg.fedoraproject.org
-
Adam Williamson -
Fedora compose checker