Closed Bug 916120 Opened 7 years ago Closed 6 years ago

Run reftests on B2G Desktop builds

Categories

(Release Engineering :: General, defect)

defect
Not set
normal

Tracking

(Not tracked)

RESOLVED FIXED

People

(Reporter: catlee, Assigned: ahal)

References

Details

(Whiteboard: [b2g])

Attachments

(2 files)

We need to start running reftests on B2G desktop builds (opt and debug)

We can run all tests on the linux64 builds, and perhaps some subset on other platforms.

Debug builds are being stood up in bug 916111, but we can get started on testing the opt builds now.
Depends on: 916350
Depends on: 943463
Assignee: nobody → ahalberstadt
Status: NEW → ASSIGNED
Comment on attachment 8348242 [details] [diff] [review]
Patch 1.0 - add reftest to b2g desktop mozharness script

Review of attachment 8348242 [details] [diff] [review]:
-----------------------------------------------------------------

lgtm!
Attachment #8348242 - Flags: review?(mdas) → review+
https://hg.mozilla.org/build/mozharness/rev/aac653fee868

I ran the above on Ash, no problems.
Depends on: 951223
I merged this into production.
Depends on: 957629
Depends on: 958518
Depends on: 958533
Depends on: 963572
Reftest sanity is now running across all branches. Now it'll be a matter of getting the rest of the suite green on Cedar.
Attachment #8348242 - Flags: checked-in+
Note: this patch should only affect cedar

The b2g desktop reftest logs are being truncated because they are bigger than 50mb. This is because there are a lot of test failures (and for reftest, each failure means dumping two screenshots to the log).

The easiest way to fix this is to increase the chunks. I propose 10, just because that is how many the emulator runs. 10 is likely overkill, but we can always tone it back down before pushing them across other branches if needed.
Attachment #8366808 - Flags: review?(aki)
Attachment #8366808 - Flags: review?(aki) → review+
buildbot-config patch was in production as of ~3pm PT! :)
Attachment #8366808 - Flags: checked-in+
The logs are now ~33mb, though for some they still aren't loading in tbpl. I disabled verbosity to see if that helps.
Closing this because b2g desktop reftest sanity is running across the board and there are no longer immediate plans to run the full suite of reftests on b2g desktop (will be replaced by mulet).
Status: ASSIGNED → RESOLVED
Closed: 6 years ago
Resolution: --- → FIXED
Component: General Automation → General
You need to log in before you can comment on or make changes to this bug.