On Fri, 13 Jan 2017 00:32:06 +0100, Adam Williamson adamwill@fedoraproject.org wrote:
Hi folks! So I finally got around to that 'think about USB test coverage' item that's been on my todo list forever.
I propose we add a table to the Installation Validation page. The purpose is simply to check that writing images is working with mediawriter in the major supported environments: Windows, macOS , and the supported stable Fedora releases. So it could just look like this:
Windows macOS Fedora 24 Fedora 25
QA:Testcase_USB_fmw
with the intent being that we at least check that writing any one release blocking image with mediawriter in each environment.
We could split Windows into 7, 8 and 10 or something, but not sure if it's really necessary...
Thoughts?
I'd consider focusing on using checkisomd5 as the main way to test if FMW works ok. First the offline one and then online one running from the flash drive before bootup.
If the integrity check passes, all other errors are either in the compose process or the packages. Anything above this I would consider testing the actual written image, not FMW.