Closed Bug 1150579 Opened 5 years ago Closed 5 years ago

Turn on Mulet reftests on TaskCluster prod

Categories

(Firefox OS Graveyard :: Runtime, defect)

x86_64
Linux
defect
Not set

Tracking

(firefox40 fixed)

RESOLVED FIXED
2.2 S10 (17apr)
Tracking Status
firefox40 --- fixed

People

(Reporter: gerard-majax, Assigned: gerard-majax)

References

Details

(Whiteboard: [systemsfe])

Attachments

(1 file, 2 obsolete files)

No description provided.
Attached patch Switch Mulet reftests ON (obsolete) — Splinter Review
Attachment #8587493 - Flags: review?(jlal)
Comment on attachment 8587493 [details] [diff] [review]
Switch Mulet reftests ON

formalizing the r+ I already gave on you irc..
Attachment #8587493 - Flags: review?(jlal) → review+
Whiteboard: [systemsfe]
Target Milestone: --- → 2.2 S9 (3apr)
This try has a lot of retriggers to check how usable it is: https://treeherder.allizom.org/#/jobs?repo=try&revision=7b52379388d1
(In reply to Alexandre LISSY :gerard-majax from comment #3)
> This try has a lot of retriggers to check how usable it is:
> https://treeherder.allizom.org/#/jobs?repo=try&revision=7b52379388d1

Reported failures on R1, R3, R5 and R6 are nearly all instances of bug 1140394.

There is one real intermittent on R1, but the rate is low enough I think.
Keywords: checkin-needed
Ryan, I'll let you judge whether the impact of bug 1140394 described above will make your daily job bad enough or not. If you think it's bad enough, I'll investigate and fix this before we turn on those tests.
Flags: needinfo?(ryanvm)
I think the biggest issue with bug 1140394 is that it occurs in a basically unstarrable way. I'd be more inclined to tolerate it if we at least had a way to make the failures show up as suggestable on Treeherder.
Flags: needinfo?(ryanvm)
(In reply to Ryan VanderMeulen [:RyanVM UTC-4] from comment #6)
> I think the biggest issue with bug 1140394 is that it occurs in a basically
> unstarrable way. I'd be more inclined to tolerate it if we at least had a
> way to make the failures show up as suggestable on Treeherder.

Ok, this is something I missed but I understand easily :). According to Ted in bug 1140394 comment 8, we are being blocked by resolution of bug 798300.
Ugh :(
Keywords: checkin-needed
Blocks: 1094369
No longer depends on: 1094369
Depends on: 1153574
Ryan, after re-enabling many of the disabled reftests and finding a workaround for bug 1140394, I get this: https://treeherder.allizom.org/#/jobs?repo=try&revision=8d65013d65a1

It seems pretty stable green for me, and the two only oranges are bug 1153584. Those may have the same unstarrable issue as you feared about, but it seems to be only tied to high load. Plus, in bug 1153584 I'm asking if we could convert those 5xx errors into "blue" infra failures.

My current plan is:
 - land reftests changes from bug 1153574
 - land mozharness stdout workaround for bug 1140394

And then we could turn on the switch.
Flags: needinfo?(ryanvm)
sgtm, thanks for tracking this all down :)
Flags: needinfo?(ryanvm)
Depends on: 1140394
So the deps got fixed. Let's do a last round of retriggers.
Attached patch Switch Mulet reftests ON (obsolete) — Splinter Review
Rebasing on top of current master
Attachment #8587493 - Attachment is obsolete: true
Attachment #8592193 - Flags: review+
Attachment #8592193 - Attachment is obsolete: true
Attachment #8592205 - Flags: review+
One must read bug 1140494 and not bug 1130494 in the above comment 17.
Keywords: checkin-needed
https://hg.mozilla.org/mozilla-central/rev/06783f130730
Status: NEW → RESOLVED
Closed: 5 years ago
Flags: in-testsuite+
Resolution: --- → FIXED
Target Milestone: 2.2 S9 (3apr) → 2.2 S10 (17apr)
You need to log in before you can comment on or make changes to this bug.