Hi Tagoh,

On 02/15/2013 09:03 AM, Akira TAGOH wrote:

Hi,

I'm sending this mail to share it and a future plan for that, also asking for comments if any.

• Background

The amount of the test cases are growing up every time to cover more and more. that's basically good to make sure no regressions. though the human resources are limited so some test cases might needs to be cleaned up, polished, or integrated if possible. That said, current page[1] is being messed up due to this and is hard to obtain the necessary information and interests, what languages we've tested and what languages we have issues. this is relevant to what languages the community would support in a certain release. which we aren't explicitly saying anything so far and possibly giving different result per releases due to the resource limitation.

• Proposal of changes

I want to update it to the language-based matrix instead of tester-based. you can find the draft page out here: http://fedoraproject.org/wiki/User:Tagoh/Draft/I18n_Test_Day

This would makes more visible to see the above interests.

• Future plan

I eventually want to use this matrix to indicate certified languages list on a release once we have enough tester resources and test cases. I think that would helps for people who are looking for their language support in Fedora. also helps to improve the quality of the release, if, for instance, we can add sort of `90% of cerfified languages in previous release at least needs to be passed all of testing' to the release criteria.

Though I don't mean this should be applied with this proposal at the same time. it's just an rough idea yet for long-term plan and guess there may be someone who disagree with it :)

Anyway, any comments are welcome!

Really appreciate your proposal. But there is a concern here: On test day, when all testers access the page [1] simultaneously, it would again increase the load to that page. This will result in testers facing difficulty to update the wiki page with the results. ie, the same problem we face in [2]. Infact, the new language matrix implemented from Fedora 18 [3] was introduced to eliminate this load on the main test page on the test day.

Maybe, it would be a better idea to distribute the load by providing the test cases for each package on different pages and later collect all the test results in a report format similar to Fedora 18 report [4] ?

Thanks

[1] - http://fedoraproject.org/wiki/User:Tagoh/Draft/I18n_Test_Day [2] - https://fedoraproject.org/wiki/Test_Day:2012-09-18_i18n [3] - https://fedoraproject.org/wiki/Test_Day:2012-09-28_l10n#Test_Matrix [4] - https://fedoraproject.org/wiki/FLTG/Reports/Test_Day_Reports#Fedora_18_Test_...

[1] - https://fedoraproject.org/wiki/Test_Day:2012-09-18_i18n

-- Akira TAGOH