#363: Require spins to go through smoke testing before being published -------------------------+---------------------------------- Reporter: adamwill | Owner: Type: enhancement | Status: new Priority: minor | Milestone: Undetermined Future Component: Test cases | Version: Keywords: | Blocked By: Blocking: | -------------------------+---------------------------------- = problem =

Sometimes, we publish spins that are completely DOA.

= analysis =

There is no mandatory testing of any Fedora images beyond netinst, DVD and the two release blocking desktop live spins, as things stand, but we publish rather more spins than that. In practice we test Xfce, LXDE, SoaS and AMI images to some extent, but others are rarely touched.

= enhancement recommendation =

viking-ice has suggested that we should produce some kind of validation matrix which has very basic, generic smoke tests: basically, does the image at least boot up sanely? We would require there to be a PASS for these mandatory smoke tests present in that matrix for a spin image to be published on the spins page. QA does not commit to doing the actual testing; we may do so if we have time, but ultimately, if a spin owner wants to have their spin published, it's their responsibility to get the testing done, either by poking QA, doing it themselves, or getting someone else to do it.