Posted 1 year, 10 months ago at 15:25. 0 comments
We’re changing things up a little bit this week. Our bi-weekly testday is returning after a holiday hiatus, and this time we’re going to be focused on improving test case coverage either by writing new test cases, or by shoring up existing ones.
More information about this testday can be found in the Mozilla wiki.
Axel has even offered to show up to help any l10n contributors improve our somewhat-woeful l10n test case situation.
Hope to see everyone in IRC!
Current Tunes: A Tribe Called Quest - Scenario (Young Nation Mix) | Filed under Litmus, Mozilla, QA
Posted 1 year, 11 months ago at 14:26. 0 comments
After having a conversation with Tomcat this morning, I just wanted to clear up a potential point of confusion for our community testers in relation to the testing coverage statistics we provide in Litmus. The chances of seeing high coverage values for subgroups in Litmus increases on testdays when our testing focus is particularly targeted, but there are still several ways to provide helpful testing feedback under those circumstances.
Here’s a simple plan of attack:
- Obviously, the first option is to choose subgroups that don’t yet have 100% coverage;
- Failing that, if you have another machine running a different operating system, try running some tests from that machine if the coverage statistics are lower;
- If we are also testing different locales, download a different locale and use it for testing;
- Try installing an extension or theme (preferably one of the more popular ones), and then test with it installed;
- Regardless of coverage statistics, pick a subgroup that interests you and test it anyway; and finally,
- Pick ANY FUNCTIONAL AREA that interests you and do your own testing around it, regardless of whether this area is covered in Litmus or not. Just be sure to report back to the QA team if you find anything!
Current Tunes: DJ Shadow - What Does Your Soul Lool Like, Pt. 1 | Filed under Litmus, Mozilla, QA
Posted 2 years ago at 00:52. 0 comments
Lots of discussion and decision-making last week, only some of which was fueled by well-deserved booze. Here’s a wrap-up of the salient points as they pertain to me.
Build/Release:
- There are lots of releases planned prior to Christmas, although nothing quite as whiz-bang as Firefox 2. I’ll be helping out wherever I can with the various RCs, alphas, and partner builds, even if it’s just to continue handling the daily flood of tinderbox requests so that others don’t have to.
- Continued work to get our Mac tinderbox “ref” platform implemented across all our current tinderboxen, along with integrating the new Intel xserves into the mix when they arrive. Man, I really wish Apple were making this easier for me, but software updates, in conjunction with having multiple Apple build IDs for the same software version, are really biting my ass right now.
QA:
- davel is leaving Mozilla soon and we wish him well. Much of the unit testing work that he was championing will be taken over by robcee. Again, I’ll be helping out where I can, likely wherever interaction with the build team is required. I already have one foot in each camp anyway.
Litmus:
- There was much talk at the summit about where (specifically, on which products) Mozilla should be focusing its energies. Nothing is set in stone yet, but things will be changing. As our product focus changes, we need to be able to uplift community members to continue testing products that we cannot supply adequate QA resources for. This means implementing product-based admin privileges in Litmus, which was on file but not a priority before.
- Zach and I will be improving the new Litmus install story over the next few months to make it as easy as possible for a 3rd party to install Litmus and use it for their own needs. The aim here is to encourage more people to adopt Litmus as a tool and ease our burden of development. There are lots of other build, release, and QA tools that need writing, so I’d love to get Litmus into maintenance mode ASAP.
- Now that I’ve had my ideas for the test runs interface vetted by the QA team, I can plow ahead and get them done. Hooray for in-person whiteboarding!
Current Tunes: Orbital - Lush 3-4 (Warrior Drift Psychick Warriors Ov Gaia) | Filed under Build/Release, Litmus, Mozilla, QA
Posted 2 years ago at 11:22. 0 comments
Our most recent community testday was a resounding success.
We had around 35 people actively testing, many of whom were joining us for the first time. This was largely due to our collaboration with Seneca college in Toronto. Thanks to all the Seneca students who showed up to help with testing, and thanks to robcee for leading that particular charge.
The testday generated over 1000 results. For those keeping score at home, that’s triple our previous record for testday result submission. We got lots of good coverage on Linux (which is rare for us on testday), and also received lots of valuable feedback on testcases and on Litmus itself. So much feedback, in fact, that I needed to whip up a quick interface to view results with comments in the middle of testday. We also debuted the new report interface for testday statistics after the testday.
Thanks again to everyone who helped make this past testday a success. We hope you’ll decide to come back and join us for the next one.
Current Tunes: Spiritualized - I Think I'm In Love (The Chemical Brothers Remix) | Filed under Litmus, Mozilla, QA
Posted 2 years, 1 month ago at 15:55. 2 comments
Sorry for the lack of notice again — I swear we’re trying to get better at this — but we’re having another community testday tomorrow, this time focused on the BonEcho 2.0RC2prerelease candidate builds. If you have some spare time on a lazy Friday before the Canadian long weekend, why not drop by IRC/Litmus and help out?
Current Tunes: Jhelisa - Friendly Pressure (Acapella) | Filed under Mozilla, QA
Posted 2 years, 3 months ago at 17:36. 1 comment
The Mozilla QA team has setup a Google calendar so it will be easier to keep track of upcoming testing events (.ics).
Our next testday is scheduled for this Friday, August 25th, where our focus will be on kicking the tires of some Firefox 2.0b2 candidates. Come join us in IRC, or test with Litmus at your leisure.
Current Tunes: The Pogues - Bright Lights | Filed under Litmus, Mozilla, QA
Posted 2 years, 5 months ago at 08:41. 0 comments
The Mozilla QA Team is hosting another community test day on Friday, June 23rd (tomorrow). The focus this time around will be on Add-ons in Bon Echo, formerly of Themes/Extensions fame. Specifically, we will be testing extension compatibility and the upgrade path from Firefox 1.5 to 2.0b1. More information can be found here.
As always, we like to encourage people to interact with us directly in IRC during testday, but don’t consider that a barrier to entry. If you’d rather test on your own, we encourage people to use Litmus and welcome any feedback via the Mozilla QA blog.
Current Tunes: Trespassers William - Anchor | Filed under Mozilla, QA
