If you think a bug might affect users in the 57 release, please set the correct tracking and status flags for Release Management.

update maemkit to optionally run a complete reftest.list file instead of chunking by default

RESOLVED FIXED

Status

Testing
General
RESOLVED FIXED
7 years ago
7 years ago

People

(Reporter: jmaher, Unassigned)

Tracking

Trunk
ARM
Maemo
Points:
---

Firefox Tracking Flags

(Not tracked)

Details

(Whiteboard: [mobile_unittests])

Attachments

(1 attachment)

(Reporter)

Description

7 years ago
Created attachment 489493 [details] [diff] [review]
optionally don't split the reftest.list (1.0)

currently maemkit chunks all the reftest include files to run them 1 by 1.  In some cases it will also split a large list of tests in a single .list file into multiple .list files.

I have a patch that adds a option to maemkit.cfg where we can run the reftest.list as it was originally intended.  This is good for tests like crashtests and jsreftest where (on the n900) we can run the whole test suite end to end with no OOM or crashing of the browser.

In addition I removed an extra directory that was being inserted in the list of tests to run which is causing an error for crashtests.
Attachment #489493 - Flags: review?(aki)

Comment 1

7 years ago
Is this included in the tarball in bug 608784 ?
(Reporter)

Comment 2

7 years ago
yes, that is why the crashtests are green now!

Comment 3

7 years ago
K, should we dup this?
(Reporter)

Comment 4

7 years ago
well the patch is unique, I just wanted to minimize the staging runs.  The over test run results look great for this patch!
(Reporter)

Comment 5

7 years ago
odd, why do we show green and 0 failures on tinderbox MobileTest when the log shows 2 failures:
http://tinderbox.mozilla.org/showlog.cgi?log=MobileTest/1289571754.1289573261.25089.gz#err0

If we have some magic going on to ignore X failures, it would be nice to remove it.

Updated

7 years ago
Attachment #489493 - Flags: review?(aki) → review+

Comment 6

7 years ago
(In reply to comment #5)
> odd, why do we show green and 0 failures on tinderbox MobileTest when the log
> shows 2 failures:
> http://tinderbox.mozilla.org/showlog.cgi?log=MobileTest/1289571754.1289573261.25089.gz#err0
> 
> If we have some magic going on to ignore X failures, it would be nice to remove
> it.

Yes, as noted on the front of the mobile tinderbox page:

http://tinderbox.mozilla.org/showbuilds.cgi?tree=Mobile

Unit tests:
# passed / # failed / # known / [mobileFailCount]
mobileFailCount is subtracted from #failed.
mobileFailCount is added to #known.

This has been true since day 1.

We can get rid of it; new bug?
(Reporter)

Comment 7

7 years ago
pushed:
http://hg.mozilla.org/qa/maemkit/pushloghtml?changeset=ba8623e3b181
Blocks: 611745
(Reporter)

Updated

7 years ago
Status: NEW → RESOLVED
Last Resolved: 7 years ago
Resolution: --- → FIXED
You need to log in before you can comment on or make changes to this bug.