On Fri, 2022-06-17 at 19:33 +0000, Dan Čermák wrote:

Sounds like a great addition Adam!

Just to double check: if you have not enabled gating, then openQA will not be run at all?

No, the two are separable. We can enable the tests before we turn on gating. Right now, the tests are already running, but only on the stg/lab instance of openQA - https://openqa.stg.fedoraproject.org/group_overview/2 (that shows all update tests, not just Rawhide ones). We can turn them on in production without turning on gating. Although when we don't gate, there can be an effect where an update that makes the tests fail gets pushed stable, and then *all* subsequent updates start failing the same way - this happened recently with the 389-ds-base update that broke FreeIPA deployment, after that was pushed stable, all Rawhide updates failed the FreeIPA tests until the fixed 389-ds-base reached a compose yesterday. This is one big reason I would like to enable gating. :D Without gating, I have to run around cleaning up cases like that manually - getting the issues fixed as fast as possible and then re- running failed tests once the fix lands.