Greetings,
As you may know, the Fedora QA plans and tracks test execution against Fedora milestones using the wiki. While the wiki has proven quite valuable for content-driven test documentation (e.g. test plans and test cases), recording test results has it's drawbacks.
First, in our current implementation, it relies on careful mediawiki table edits. The table edits are too easy to mess up and aren't tremendously inviting to new contributors. * https://fedoraproject.org/wiki/QA:Fedora_11_Alpha_Install_Test_Results * https://fedoraproject.org/wiki/QA/Test_Days/2009-02-19 * https://fedoraproject.org/wiki/QA/Test_Days/2009-02-12
Second, the wiki-based implementation lacks ability to sort, query and organize test results. We can use categories for organizing plans and cases, but this mechanism isn't suitable for results.
As a long-term solution, we'd be looking to a web application. However, in the short term (now to F12) with limited resources, we're interested in what off-the-shelf components we can use to help provide a better QA assessment.
One solution that fits nicely with the current mediawiki setup is the semantic extension to mediawiki. The laptop.org testers are using this currently and were kind enough to share their findings (https://www.redhat.com/archives/fedora-test-list/2009-February/msg00756.html). One important note from the laptop.org folks was that enabling the semantic mediawiki extension could introduce a performance impact to the wiki.
I'm in the process of setting up a private mediawiki+semantic instance as a proof of concept. But a few questions for the infrastructure team ...
* I'm curious if others in fedora-infrastructure@ have experience with the semantic extension? * Is there a defined process for reviewing mediawiki extensions for the fedoraproject wiki? * Should the semantic performance impact be significant, is hosting a separate Fedora QA mediawiki (with semantic enabled) a possibility?
Thanks, James
On Tue, 3 Mar 2009, James Laska wrote:
I'm in the process of setting up a private mediawiki+semantic instance as a proof of concept. But a few questions for the infrastructure team ...
* I'm curious if others in fedora-infrastructure@ have experience with the semantic extension?
I personally don't.
* Is there a defined process for reviewing mediawiki extensions for the fedoraproject wiki?
Needs to be packaged for Fedora then open a ticket.
* Should the semantic performance impact be significant, is hosting a separate Fedora QA mediawiki (with semantic enabled) a possibility?
That is possible, for example we have a smolt wiki seperate from the normal mediawiki install. The question of performance is, does it only impact pages deciding to use semantic or everything? We have lots of way to test the actual impact of using it.
-Mike
On Tue, 2009-03-03 at 13:10 -0600, Mike McGrath wrote:
* Should the semantic performance impact be significant, is hosting a separate Fedora QA mediawiki (with semanticenabled) a
possibility?That is possible, for example we have a smolt wiki seperate from the normal mediawiki install. The question of performance is, does it only impact pages deciding to use semantic or everything? We have lots of way to test the actual impact of using it.
Good question. The feedback I have so far is it affects everything.
Thanks, James
On Tue, 3 Mar 2009, James Laska wrote:
On Tue, 2009-03-03 at 13:10 -0600, Mike McGrath wrote:
* Should the semantic performance impact be significant, is hosting a separate Fedora QA mediawiki (with semanticenabled) a
possibility?That is possible, for example we have a smolt wiki seperate from the normal mediawiki install. The question of performance is, does it only impact pages deciding to use semantic or everything? We have lots of way to test the actual impact of using it.
Good question. The feedback I have so far is it affects everything.
I just did some speed tests against the laptop.org instance you linked to. At this point I don't think thats a blocker but we may find something out later.
-Mike
On Tue, 2009-03-03 at 15:57 -0600, Mike McGrath wrote:
On Tue, 3 Mar 2009, James Laska wrote:
On Tue, 2009-03-03 at 13:10 -0600, Mike McGrath wrote:
* Should the semantic performance impact be significant, is hosting a separate Fedora QA mediawiki (with semanticenabled) a
possibility?That is possible, for example we have a smolt wiki seperate from the normal mediawiki install. The question of performance is, does it only impact pages deciding to use semantic or everything? We have lots of way to test the actual impact of using it.
Good question. The feedback I have so far is it affects everything.
I just did some speed tests against the laptop.org instance you linked to. At this point I don't think thats a blocker but we may find something out later.
Package review in progress for both extensions ...
mediawiki-semantic-forms - https://bugzilla.redhat.com/show_bug.cgi?id=490171
mediawiki-semantic - https://bugzilla.redhat.com/show_bug.cgi?id=490001
I'm playing with the system locally to get more comfortable in this framework. Is it possible to get a dump of a subset of content from the fedoraproject.org/wiki so I can get a better sense how things will look in production?
Thanks, James
On Mon, 16 Mar 2009, James Laska wrote:
On Tue, 2009-03-03 at 15:57 -0600, Mike McGrath wrote:
On Tue, 3 Mar 2009, James Laska wrote:
On Tue, 2009-03-03 at 13:10 -0600, Mike McGrath wrote:
* Should the semantic performance impact be significant, is hosting a separate Fedora QA mediawiki (with semanticenabled) a
possibility?That is possible, for example we have a smolt wiki seperate from the normal mediawiki install. The question of performance is, does it only impact pages deciding to use semantic or everything? We have lots of way to test the actual impact of using it.
Good question. The feedback I have so far is it affects everything.
I just did some speed tests against the laptop.org instance you linked to. At this point I don't think thats a blocker but we may find something out later.
Package review in progress for both extensions ...
mediawiki-semantic-forms - https://bugzilla.redhat.com/show_bug.cgi?id=490171
mediawiki-semantic - https://bugzilla.redhat.com/show_bug.cgi?id=490001
I'm playing with the system locally to get more comfortable in this framework. Is it possible to get a dump of a subset of content from the fedoraproject.org/wiki so I can get a better sense how things will look in production?
Yeah we can do that no problem. Can it wait until after the beta launches though? (the 24th) It'll just be easier that way.
-Mike
On Mon, 2009-03-16 at 14:25 -0500, Mike McGrath wrote:
On Mon, 16 Mar 2009, James Laska wrote:
On Tue, 2009-03-03 at 15:57 -0600, Mike McGrath wrote:
On Tue, 3 Mar 2009, James Laska wrote:
On Tue, 2009-03-03 at 13:10 -0600, Mike McGrath wrote:
* Should the semantic performance impact be significant, is hosting a separate Fedora QA mediawiki (with semanticenabled) a
possibility?That is possible, for example we have a smolt wiki seperate from the normal mediawiki install. The question of performance is, does it only impact pages deciding to use semantic or everything? We have lots of way to test the actual impact of using it.
Good question. The feedback I have so far is it affects everything.
I just did some speed tests against the laptop.org instance you linked to. At this point I don't think thats a blocker but we may find something out later.
Package review in progress for both extensions ...
mediawiki-semantic-forms - https://bugzilla.redhat.com/show_bug.cgi?id=490171
mediawiki-semantic - https://bugzilla.redhat.com/show_bug.cgi?id=490001
I'm playing with the system locally to get more comfortable in this framework. Is it possible to get a dump of a subset of content from the fedoraproject.org/wiki so I can get a better sense how things will look in production?
Yeah we can do that no problem. Can it wait until after the beta launches though? (the 24th) It'll just be easier that way.
Still swamped on my end, but having a snapshot of the current fedora wiki database that I can load into a test instance would help speed up efforts to identify whether semantic is the short-term (F12) solution for QA.
Any updates on grabbing a db snapshot of the fedoraproject.org wiki? Does this seem possible?
Thanks, James
infrastructure@lists.fedoraproject.org
-
James Laska -
Mike McGrath