Get green set of Mn tests running on cedar so we can get them going on m-c

RESOLVED FIXED in Firefox 18

Status

defect
RESOLVED FIXED
7 years ago
7 years ago

People

(Reporter: ahal, Assigned: ahal)

Tracking

unspecified
mozilla19
Points:
---
Dependency tree / graph

Firefox Tracking Flags

(firefox18 fixed, firefox19 fixed)

Details

Attachments

(4 attachments, 2 obsolete attachments)

We've had Mn tests running on cedar for quite some time. There are still some random oranges. We should try to get them green, or failing that just get a small subset of them running on m-c

https://tbpl.mozilla.org/?tree=Cedar
Posted patch Patch for 808783 (obsolete) — Splinter Review
Disabling three tests that are consistently failing or random orange.
Attachment #678468 - Flags: review?(ahalberstadt)
Comment on attachment 678468 [details] [diff] [review]
Patch for 808783

Review of attachment 678468 [details] [diff] [review]:
-----------------------------------------------------------------

Thanks! I'll get this landed on cedar.
Attachment #678468 - Flags: review?(ahalberstadt) → review+
Unfortunately I re-trigged and an we had a new failure. This disables it and switches some of the manifests to use the "disabled = <reason>" format.
Attachment #678535 - Flags: review?(rwood)
Attachment #678468 - Attachment is obsolete: true
Comment on attachment 678535 [details] [diff] [review]
Patch 1.0 - Disable failing marionette tests

Looks good!
Attachment #678535 - Flags: review?(rwood) → review+
This also modifies marionette to honour the built-in 'disabled' attribute as opposed to 'skip'.
Attachment #678782 - Flags: review?(jgriffin)
Attachment #678535 - Attachment is obsolete: true
Comment on attachment 678782 [details] [diff] [review]
[checked in] Patch 2.0 - Disable tests and update marionette's manifest parser

Review of attachment 678782 [details] [diff] [review]:
-----------------------------------------------------------------

Looks good.  Do we need to try this on cedar before landing?
Attachment #678782 - Flags: review?(jgriffin) → review+
https://hg.mozilla.org/integration/mozilla-inbound/rev/a22328aa1130
Assignee: nobody → ahalberstadt
Target Milestone: --- → mozilla19
https://hg.mozilla.org/mozilla-central/rev/a22328aa1130
Status: NEW → RESOLVED
Closed: 7 years ago
Resolution: --- → FIXED
Reopening as another random orange is showing up in the telephony tests, causing the emulator to crash.  Must disable another telephony test.
Status: RESOLVED → REOPENED
Resolution: FIXED → ---
Disabling test_incoming_answer_hangup.js as sometimes it also causes the emulator to crash.
Attachment #680642 - Flags: review?(ahalberstadt)
Comment on attachment 680642 [details] [diff] [review]
[checked in] Another patch for 808783

Review of attachment 680642 [details] [diff] [review]:
-----------------------------------------------------------------

Lgtm
Attachment #680642 - Flags: review?(ahalberstadt) → review+
Whiteboard: [automation-needed-in-aurora]
https://hg.mozilla.org/mozilla-central/rev/3052145ed25c
Status: REOPENED → RESOLVED
Closed: 7 years ago7 years ago
Resolution: --- → FIXED
Reopening as test_incoming_reject.js is now randomorange and causing the emulator to crash. Will attach patch to disable that test also.
Status: RESOLVED → REOPENED
Resolution: FIXED → ---
Attachment #682107 - Flags: review?(ahalberstadt)
Attachment #682107 - Flags: review?(ahalberstadt) → review+
Keywords: checkin-needed
Attachment #678782 - Attachment description: Patch 2.0 - Disable tests and update marionette's manifest parser → [checked in] Patch 2.0 - Disable tests and update marionette's manifest parser
Attachment #680642 - Attachment description: Another patch for 808783 → [checked in] Another patch for 808783
Attachment #682107 - Attachment description: Nov15 patch for 808783 → [checked in] Nov15 patch for 808783
https://hg.mozilla.org/mozilla-central/rev/c794e4ef27fc
Status: REOPENED → RESOLVED
Closed: 7 years ago7 years ago
Resolution: --- → FIXED
After disabling test_incoming_reject.js, the very next telephony test in the list caused the emulator to crash. Therefore reopening this issue yet again. This time I will make a patch to disable all remaining WebTelephony tests until the issue (Bug 811167) is resolved.
Status: RESOLVED → REOPENED
Resolution: FIXED → ---
Attachment #682569 - Flags: review?(ahalberstadt) → review+
Keywords: checkin-needed
Comment on attachment 682569 [details] [diff] [review]
[checked in] Patch to disable remaining WebTelepony tests

(In reply to Ryan VanderMeulen from comment #25)
> https://hg.mozilla.org/integration/mozilla-inbound/rev/212ebdca04a8

https://hg.mozilla.org/releases/mozilla-aurora/rev/df5ab2adf761
Attachment #682569 - Attachment description: Patch to disable remaining WebTelepony tests → [checked in] Patch to disable remaining WebTelepony tests
https://hg.mozilla.org/mozilla-central/rev/212ebdca04a8
Status: REOPENED → RESOLVED
Closed: 7 years ago7 years ago
Resolution: --- → FIXED
You need to log in before you can comment on or make changes to this bug.