FAQ Search Today's Posts Mark Forums Read
» Video Reviews

» Linux Archive

Linux-archive is a website aiming to archive linux email lists and to make them easily accessible for linux users/developers.


» Sponsor

» Partners

» Sponsor

Go Back   Linux Archive > Redhat > Fedora Infrastructure

 
 
LinkBack Thread Tools
 
Old 03-03-2009, 05:45 PM
James Laska
 
Default Improving QA test result submission and organization

Greetings,

As you may know, the Fedora QA plans and tracks test execution against
Fedora milestones using the wiki. While the wiki has proven quite
valuable for content-driven test documentation (e.g. test plans and test
cases), recording test results has it's drawbacks.

First, in our current implementation, it relies on careful mediawiki
table edits. The table edits are too easy to mess up and aren't
tremendously inviting to new contributors.
* https://fedoraproject.org/wiki/QA:Fedora_11_Alpha_Install_Test_Results
* https://fedoraproject.org/wiki/QA/Test_Days/2009-02-19
* https://fedoraproject.org/wiki/QA/Test_Days/2009-02-12

Second, the wiki-based implementation lacks ability to sort, query and
organize test results. We can use categories for organizing plans and
cases, but this mechanism isn't suitable for results.

As a long-term solution, we'd be looking to a web application. However,
in the short term (now to F12) with limited resources, we're interested
in what off-the-shelf components we can use to help provide a better QA
assessment.

One solution that fits nicely with the current mediawiki setup is the
semantic extension to mediawiki. The laptop.org testers are using this
currently and were kind enough to share their findings
(https://www.redhat.com/archives/fedora-test-list/2009-February/msg00756.html). One important note from the laptop.org folks was that enabling the semantic mediawiki extension could introduce a performance impact to the wiki.

I'm in the process of setting up a private mediawiki+semantic instance
as a proof of concept. But a few questions for the infrastructure
team ...

* I'm curious if others in fedora-infrastructure@ have experience
with the semantic extension?
* Is there a defined process for reviewing mediawiki extensions
for the fedoraproject wiki?
* Should the semantic performance impact be significant, is
hosting a separate Fedora QA mediawiki (with semantic enabled) a
possibility?

Thanks,
James

--
==========================================
James Laska -- jlaska@redhat.com
Quality Engineering -- Red Hat, Inc.
==========================================
_______________________________________________
Fedora-infrastructure-list mailing list
Fedora-infrastructure-list@redhat.com
https://www.redhat.com/mailman/listinfo/fedora-infrastructure-list
 
Old 03-03-2009, 06:10 PM
Mike McGrath
 
Default Improving QA test result submission and organization

On Tue, 3 Mar 2009, James Laska wrote:
>
> I'm in the process of setting up a private mediawiki+semantic instance
> as a proof of concept. But a few questions for the infrastructure
> team ...
>
> * I'm curious if others in fedora-infrastructure@ have experience
> with the semantic extension?

I personally don't.

> * Is there a defined process for reviewing mediawiki extensions
> for the fedoraproject wiki?

Needs to be packaged for Fedora then open a ticket.

> * Should the semantic performance impact be significant, is
> hosting a separate Fedora QA mediawiki (with semantic enabled) a
> possibility?
>

That is possible, for example we have a smolt wiki seperate from the
normal mediawiki install. The question of performance is, does it only
impact pages deciding to use semantic or everything? We have lots of way
to test the actual impact of using it.

-Mike

_______________________________________________
Fedora-infrastructure-list mailing list
Fedora-infrastructure-list@redhat.com
https://www.redhat.com/mailman/listinfo/fedora-infrastructure-list
 
Old 03-03-2009, 08:19 PM
James Laska
 
Default Improving QA test result submission and organization

On Tue, 2009-03-03 at 13:10 -0600, Mike McGrath wrote:
> > * Should the semantic performance impact be significant, is
> > hosting a separate Fedora QA mediawiki (with semantic
> enabled) a
> > possibility?
> >
>
> That is possible, for example we have a smolt wiki seperate from the
> normal mediawiki install. The question of performance is, does it
> only
> impact pages deciding to use semantic or everything? We have lots of
> way to test the actual impact of using it.

Good question. The feedback I have so far is it affects everything.

Thanks,
James
_______________________________________________
Fedora-infrastructure-list mailing list
Fedora-infrastructure-list@redhat.com
https://www.redhat.com/mailman/listinfo/fedora-infrastructure-list
 
Old 03-03-2009, 08:57 PM
Mike McGrath
 
Default Improving QA test result submission and organization

On Tue, 3 Mar 2009, James Laska wrote:

> On Tue, 2009-03-03 at 13:10 -0600, Mike McGrath wrote:
> > > * Should the semantic performance impact be significant, is
> > > hosting a separate Fedora QA mediawiki (with semantic
> > enabled) a
> > > possibility?
> > >
> >
> > That is possible, for example we have a smolt wiki seperate from the
> > normal mediawiki install. The question of performance is, does it
> > only
> > impact pages deciding to use semantic or everything? We have lots of
> > way to test the actual impact of using it.
>
> Good question. The feedback I have so far is it affects everything.
>

I just did some speed tests against the laptop.org instance you linked to.
At this point I don't think thats a blocker but we may find something out
later.

-Mike

_______________________________________________
Fedora-infrastructure-list mailing list
Fedora-infrastructure-list@redhat.com
https://www.redhat.com/mailman/listinfo/fedora-infrastructure-list
 
Old 03-16-2009, 05:17 PM
James Laska
 
Default Improving QA test result submission and organization

On Tue, 2009-03-03 at 15:57 -0600, Mike McGrath wrote:
> On Tue, 3 Mar 2009, James Laska wrote:
>
> > On Tue, 2009-03-03 at 13:10 -0600, Mike McGrath wrote:
> > > > * Should the semantic performance impact be significant, is
> > > > hosting a separate Fedora QA mediawiki (with semantic
> > > enabled) a
> > > > possibility?
> > > >
> > >
> > > That is possible, for example we have a smolt wiki seperate from the
> > > normal mediawiki install. The question of performance is, does it
> > > only
> > > impact pages deciding to use semantic or everything? We have lots of
> > > way to test the actual impact of using it.
> >
> > Good question. The feedback I have so far is it affects everything.
> >
>
> I just did some speed tests against the laptop.org instance you linked to.
> At this point I don't think thats a blocker but we may find something out
> later.

Package review in progress for both extensions ...

mediawiki-semantic-forms -
https://bugzilla.redhat.com/show_bug.cgi?id=490171

mediawiki-semantic - https://bugzilla.redhat.com/show_bug.cgi?id=490001

I'm playing with the system locally to get more comfortable in this
framework. Is it possible to get a dump of a subset of content from the
fedoraproject.org/wiki so I can get a better sense how things will look
in production?

Thanks,
James

--
==========================================
James Laska -- jlaska@redhat.com
Quality Engineering -- Red Hat, Inc.
==========================================
_______________________________________________
Fedora-infrastructure-list mailing list
Fedora-infrastructure-list@redhat.com
https://www.redhat.com/mailman/listinfo/fedora-infrastructure-list
 
Old 03-16-2009, 06:25 PM
Mike McGrath
 
Default Improving QA test result submission and organization

On Mon, 16 Mar 2009, James Laska wrote:

> On Tue, 2009-03-03 at 15:57 -0600, Mike McGrath wrote:
> > On Tue, 3 Mar 2009, James Laska wrote:
> >
> > > On Tue, 2009-03-03 at 13:10 -0600, Mike McGrath wrote:
> > > > > * Should the semantic performance impact be significant, is
> > > > > hosting a separate Fedora QA mediawiki (with semantic
> > > > enabled) a
> > > > > possibility?
> > > > >
> > > >
> > > > That is possible, for example we have a smolt wiki seperate from the
> > > > normal mediawiki install. The question of performance is, does it
> > > > only
> > > > impact pages deciding to use semantic or everything? We have lots of
> > > > way to test the actual impact of using it.
> > >
> > > Good question. The feedback I have so far is it affects everything.
> > >
> >
> > I just did some speed tests against the laptop.org instance you linked to.
> > At this point I don't think thats a blocker but we may find something out
> > later.
>
> Package review in progress for both extensions ...
>
> mediawiki-semantic-forms -
> https://bugzilla.redhat.com/show_bug.cgi?id=490171
>
> mediawiki-semantic - https://bugzilla.redhat.com/show_bug.cgi?id=490001
>
> I'm playing with the system locally to get more comfortable in this
> framework. Is it possible to get a dump of a subset of content from the
> fedoraproject.org/wiki so I can get a better sense how things will look
> in production?
>

Yeah we can do that no problem. Can it wait until after the beta launches
though? (the 24th) It'll just be easier that way.

-Mike

_______________________________________________
Fedora-infrastructure-list mailing list
Fedora-infrastructure-list@redhat.com
https://www.redhat.com/mailman/listinfo/fedora-infrastructure-list
 

Thread Tools




All times are GMT. The time now is 10:01 PM.

VBulletin, Copyright ©2000 - 2014, Jelsoft Enterprises Ltd.
Content Relevant URLs by vBSEO ©2007, Crawlability, Inc.
Copyright 2007 - 2008, www.linux-archive.org