Missing expected images:
Workstation live i386 Cloud_base raw-xz x86_64 Cloud_base raw-xz i386 Atomic raw-xz x86_64 Kde raw-xz armhfp Minimal raw-xz armhfp Workstation live x86_64
Images in this compose but not Rawhide-20160323.n.0:
Workstation raw-xz armhfp Robotics live x86_64 Robotics live i386 Cinnamon live i386 Soas live i386 Soas live x86_64 Cinnamon live x86_64 Jam_kde live i386 Jam_kde live x86_64
Images in Rawhide-20160323.n.0 but not this:
Soas raw-xz armhfp Workstation live i386 Mate live i386 Astronomy_kde live i386 Mate live x86_64 Xfce raw-xz armhfp Lxde raw-xz armhfp Astronomy_kde live x86_64 Server raw-xz armhfp Workstation live x86_64 Minimal raw-xz armhfp Docker_base docker x86_64
Failed openQA tests: 37 of 74
ID: 10935 Test: i386 universal install_package_set_kde URL: https://openqa.fedoraproject.org/tests/10935 ID: 10934 Test: i386 universal upgrade_2_desktop_32bit URL: https://openqa.fedoraproject.org/tests/10934 ID: 10933 Test: i386 universal upgrade_desktop_32bit URL: https://openqa.fedoraproject.org/tests/10933 ID: 10932 Test: i386 universal install_lvmthin URL: https://openqa.fedoraproject.org/tests/10932 ID: 10931 Test: i386 universal install_ext3 URL: https://openqa.fedoraproject.org/tests/10931 ID: 10930 Test: i386 universal install_btrfs URL: https://openqa.fedoraproject.org/tests/10930 ID: 10929 Test: i386 universal install_software_raid URL: https://openqa.fedoraproject.org/tests/10929 ID: 10928 Test: i386 universal install_simple_encrypted URL: https://openqa.fedoraproject.org/tests/10928 ID: 10927 Test: i386 universal install_scsi_updates_img URL: https://openqa.fedoraproject.org/tests/10927 ID: 10926 Test: i386 universal install_repository_http_graphical URL: https://openqa.fedoraproject.org/tests/10926 ID: 10925 Test: i386 universal install_package_set_minimal URL: https://openqa.fedoraproject.org/tests/10925 ID: 10922 Test: x86_64 universal install_repository_http_graphical URL: https://openqa.fedoraproject.org/tests/10922 ID: 10917 Test: x86_64 universal install_european_language URL: https://openqa.fedoraproject.org/tests/10917 ID: 10914 Test: x86_64 universal install_updates_img_local URL: https://openqa.fedoraproject.org/tests/10914 ID: 10913 Test: x86_64 universal upgrade_2_desktop_64bit URL: https://openqa.fedoraproject.org/tests/10913 ID: 10909 Test: x86_64 universal install_kickstart_hdd URL: https://openqa.fedoraproject.org/tests/10909 ID: 10908 Test: x86_64 universal install_no_swap@uefi URL: https://openqa.fedoraproject.org/tests/10908 ID: 10905 Test: x86_64 universal install_ext3@uefi URL: https://openqa.fedoraproject.org/tests/10905 ID: 10904 Test: x86_64 universal install_btrfs@uefi URL: https://openqa.fedoraproject.org/tests/10904 ID: 10902 Test: x86_64 universal install_software_raid@uefi URL: https://openqa.fedoraproject.org/tests/10902 ID: 10901 Test: x86_64 universal install_multi_empty@uefi URL: https://openqa.fedoraproject.org/tests/10901 ID: 10899 Test: x86_64 universal install_simple_encrypted@uefi URL: https://openqa.fedoraproject.org/tests/10899 ID: 10898 Test: x86_64 universal install_package_set_kde URL: https://openqa.fedoraproject.org/tests/10898 ID: 10897 Test: x86_64 universal install_no_swap URL: https://openqa.fedoraproject.org/tests/10897 ID: 10895 Test: x86_64 universal install_xfs URL: https://openqa.fedoraproject.org/tests/10895 ID: 10894 Test: x86_64 universal install_ext3 URL: https://openqa.fedoraproject.org/tests/10894 ID: 10891 Test: x86_64 universal install_software_raid URL: https://openqa.fedoraproject.org/tests/10891 ID: 10890 Test: x86_64 universal install_multi_empty URL: https://openqa.fedoraproject.org/tests/10890 ID: 10888 Test: x86_64 universal install_simple_encrypted URL: https://openqa.fedoraproject.org/tests/10888 ID: 10887 Test: x86_64 universal install_multi@uefi URL: https://openqa.fedoraproject.org/tests/10887 ID: 10886 Test: x86_64 universal install_multi URL: https://openqa.fedoraproject.org/tests/10886 ID: 10885 Test: x86_64 universal install_scsi_updates_img URL: https://openqa.fedoraproject.org/tests/10885 ID: 10882 Test: i386 Server-dvd-iso install_default URL: https://openqa.fedoraproject.org/tests/10882 ID: 10879 Test: i386 Everything-boot-iso install_default URL: https://openqa.fedoraproject.org/tests/10879 ID: 10871 Test: i386 Workstation-boot-iso install_default URL: https://openqa.fedoraproject.org/tests/10871 ID: 10868 Test: i386 KDE-live-iso install_default URL: https://openqa.fedoraproject.org/tests/10868 ID: 10867 Test: i386 Server-boot-iso install_default URL: https://openqa.fedoraproject.org/tests/10867
Passed openQA tests: 37 of 74
On Tue, 2016-03-29 at 05:58 +0000, Fedora compose checker wrote:
Missing expected images:
Workstation live i386 Cloud_base raw-xz x86_64 Cloud_base raw-xz i386 Atomic raw-xz x86_64 Kde raw-xz armhfp Minimal raw-xz armhfp Workstation live x86_64
Images in this compose but not Rawhide-20160323.n.0:
Workstation raw-xz armhfp Robotics live x86_64 Robotics live i386 Cinnamon live i386 Soas live i386 Soas live x86_64 Cinnamon live x86_64 Jam_kde live i386 Jam_kde live x86_64
Images in Rawhide-20160323.n.0 but not this:
Soas raw-xz armhfp Workstation live i386 Mate live i386 Astronomy_kde live i386 Mate live x86_64 Xfce raw-xz armhfp Lxde raw-xz armhfp Astronomy_kde live x86_64 Server raw-xz armhfp Workstation live x86_64 Minimal raw-xz armhfp Docker_base docker x86_64
Failed openQA tests: 37 of 74
I mentioned this on qa-devel, but - a lot of the failed x86_64 tests are openQA needle match issues (i.e. we aren't hitting an obvious bug, but rather the appearance of something changed enough that the screenshot matching thingy openQA uses doesn't match any more). In this case it's not entirely clear whether the changed rendering is 'intended' or not (some bits of text in anaconda look somewhat different and it's not obvious whether this would actually be how the anaconda devs want it to look now, or if they'd consider it a bug and it's some kind of change in GTK+ or something else like that which anaconda wasn't accounting for). So I'll talk to the anaconda devs and maybe GNOME folks in the morning before deciding what to do about it for openQA. For now let's say it seems that the 2016-03-28 Rawhide compose is broadly workable on x86_64 at least. We probably won't re- run the tests for this compose even if we wind up updating the needles, so more 'accurate' results will come for a future compose.
On Mon, 2016-03-28 at 23:05 -0700, Adam Williamson wrote:
Failed openQA tests: 37 of 74
I mentioned this on qa-devel, but - a lot of the failed x86_64 tests are openQA needle match issues (i.e. we aren't hitting an obvious bug, but rather the appearance of something changed enough that the screenshot matching thingy openQA uses doesn't match any more). In this case it's not entirely clear whether the changed rendering is 'intended' or not (some bits of text in anaconda look somewhat different and it's not obvious whether this would actually be how the anaconda devs want it to look now, or if they'd consider it a bug and it's some kind of change in GTK+ or something else like that which anaconda wasn't accounting for). So I'll talk to the anaconda devs and maybe GNOME folks in the morning before deciding what to do about it for openQA. For now let's say it seems that the 2016-03-28 Rawhide compose is broadly workable on x86_64 at least. We probably won't re- run the tests for this compose even if we wind up updating the needles, so more 'accurate' results will come for a future compose.
So I talked this over with anaconda folks and updated the needles; the Rawhide-20160329.n.0 tests are re-running now and you'll get an updated compose check report for it in a few hours with updated openQA results. There are still several test fails which probably indicate genuine bugs, I'm gonna start looking into and reporting those soon.
On Tue, 2016-03-29 at 12:16 -0700, Adam Williamson wrote:
So I talked this over with anaconda folks and updated the needles; the Rawhide-20160329.n.0 tests are re-running now and you'll get an updated compose check report for it in a few hours with updated openQA results. There are still several test fails which probably indicate genuine bugs, I'm gonna start looking into and reporting those soon.
One of the issues is a crash during volume creation when encryption is enabled. This causes all tests that use encryption (which includes the European language install test) to fail. I've filed this as https://bugzilla.redhat.com/show_bug.cgi?id=1322099%C2%A0.