1373945 - Intermittent dom/tests/mochitest/beacon/test_beaconPreflightWithCustomContentType.html | SendBeacon should have succeeded after preflight! - got "red", expected "green"

Status: RESOLVED INCOMPLETE

(Core :: DOM: Core & HTML, defect, P3)

Description

[Sebastian Hengst [:aryx] (needinfo me if it's about an intermittent or backout)]

https://treeherder.mozilla.org/logviewer.html#?job_id=107840176&repo=autoland

[task 2017-06-17T00:07:35.794052Z] 00:07:35     INFO -  155 INFO TEST-START | dom/tests/mochitest/beacon/test_beaconPreflightWithCustomContentType.html
[task 2017-06-17T00:07:49.744647Z] 00:07:49     INFO -  Buffered messages logged at 00:07:33
[task 2017-06-17T00:07:49.744768Z] 00:07:49     INFO -  156 INFO TEST-PASS | dom/tests/mochitest/beacon/test_beaconPreflightWithCustomContentType.html | sending the beacon should start successfully
[task 2017-06-17T00:07:49.746213Z] 00:07:49     INFO -  Buffered messages finished
[task 2017-06-17T00:07:49.746321Z] 00:07:49     INFO -  157 INFO TEST-UNEXPECTED-FAIL | dom/tests/mochitest/beacon/test_beaconPreflightWithCustomContentType.html | SendBeacon should have succeeded after preflight! - got "red", expected "green"
[task 2017-06-17T00:07:49.747346Z] 00:07:49     INFO -      SimpleTest.is@SimpleTest/SimpleTest.js:312:5
[task 2017-06-17T00:07:49.747462Z] 00:07:49     INFO -      queryIfBeaconSucceeded/xhr.onload@dom/tests/mochitest/beacon/test_beaconPreflightWithCustomContentType.html:29:5

Comment 1

[Intermittent Failures Robot]

1 failures in 814 pushes (0.001 failures/push) were associated with this bug in the last 7 days.   

Repository breakdown:
* autoland: 1

Platform breakdown:
* android-4-3-armv7-api15: 1

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1373945&startday=2017-06-12&endday=2017-06-18&tree=all

Comment 2

[Intermittent Failures Robot]

8 failures in 892 pushes (0.009 failures/push) were associated with this bug in the last 7 days.   

Repository breakdown:
* mozilla-inbound: 5
* mozilla-central: 2
* autoland: 1

Platform breakdown:
* android-4-3-armv7-api15: 8

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1373945&startday=2017-06-19&endday=2017-06-25&tree=all

Comment 3

[Intermittent Failures Robot]

12 failures in 718 pushes (0.017 failures/push) were associated with this bug in the last 7 days.   

Repository breakdown:
* mozilla-inbound: 4
* mozilla-central: 4
* autoland: 4

Platform breakdown:
* android-4-3-armv7-api15: 12

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1373945&startday=2017-06-26&endday=2017-07-02&tree=all

Comment 4

[Intermittent Failures Robot]

5 failures in 656 pushes (0.008 failures/push) were associated with this bug in the last 7 days.   

Repository breakdown:
* autoland: 3
* mozilla-inbound: 2

Platform breakdown:
* android-4-3-armv7-api15: 5

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1373945&startday=2017-07-03&endday=2017-07-09&tree=all

Comment 5

[Intermittent Failures Robot]

7 failures in 720 pushes (0.01 failures/push) were associated with this bug in the last 7 days.   

Repository breakdown:
* mozilla-inbound: 4
* autoland: 2
* mozilla-central: 1

Platform breakdown:
* android-4-3-armv7-api15: 7

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1373945&startday=2017-07-10&endday=2017-07-16&tree=all

Comment 6

[Intermittent Failures Robot]

1 failures in 822 pushes (0.001 failures/push) were associated with this bug in the last 7 days.   

Repository breakdown:
* mozilla-inbound: 1

Platform breakdown:
* android-4-3-armv7-api15: 1

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1373945&startday=2017-07-17&endday=2017-07-23&tree=all

Comment 7

[Intermittent Failures Robot]

7 failures in 1008 pushes (0.007 failures/push) were associated with this bug in the last 7 days.   

Repository breakdown:
* autoland: 4
* oak: 1
* mozilla-inbound: 1
* mozilla-central: 1

Platform breakdown:
* android-4-3-armv7-api15: 7

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1373945&startday=2017-07-24&endday=2017-07-30&tree=all

Comment 8

[Intermittent Failures Robot]

17 failures in 888 pushes (0.019 failures/push) were associated with this bug in the last 7 days.   

Repository breakdown:
* autoland: 10
* mozilla-inbound: 6
* mozilla-central: 1

Platform breakdown:
* android-4-3-armv7-api15: 17

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1373945&startday=2017-07-31&endday=2017-08-06&tree=all

Comment 9

[Intermittent Failures Robot]

9 failures in 901 pushes (0.01 failures/push) were associated with this bug in the last 7 days.   

Repository breakdown:
* mozilla-inbound: 4
* autoland: 4
* mozilla-beta: 1

Platform breakdown:
* android-4-3-armv7-api15: 9

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1373945&startday=2017-08-07&endday=2017-08-13&tree=all

Comment 10

[Intermittent Failures Robot]

19 failures in 949 pushes (0.02 failures/push) were associated with this bug in the last 7 days.   

Repository breakdown:
* autoland: 7
* mozilla-central: 5
* mozilla-beta: 4
* mozilla-inbound: 3

Platform breakdown:
* android-4-3-armv7-api15: 19

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1373945&startday=2017-08-14&endday=2017-08-20&tree=all

Comment 11

[Intermittent Failures Robot]

12 failures in 908 pushes (0.013 failures/push) were associated with this bug in the last 7 days.   

Repository breakdown:
* mozilla-inbound: 5
* autoland: 5
* mozilla-central: 2

Platform breakdown:
* android-4-3-armv7-api15: 12

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1373945&startday=2017-08-21&endday=2017-08-27&tree=all

Comment 12

[Joel Maher ( :jmaher ) (UTC -8)]

22 failures in the last 7 days (heavily weighted on debug):
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1373945

while this is in core::dom, I suspect this is related to the general android issues.

:gbrown, you might want to be aware of this and track it.

Comment 13

[Geoff Brown [:gbrown]]

I don't see any connection to any other active Android issues. I think this is just timing: there's a setInterval(2000) in the test, which isn't a lot of time on Android Debug.

We could try increasing the interval, but we tried that for a very similar case in bug 1296845, without success. Probably best to just skip on Android.

Comment 14

[Intermittent Failures Robot]

34 failures in 939 pushes (0.036 failures/push) were associated with this bug in the last 7 days.   

** This failure happened more than 30 times this week! Resolving this bug is a high priority. **

** Try to resolve this bug as soon as possible. If unresolved for 2 weeks, the affected test(s) may be disabled. ** 

Repository breakdown:
* autoland: 21
* mozilla-inbound: 7
* mozilla-central: 4
* mozilla-beta: 2

Platform breakdown:
* android-4-3-armv7-api-16: 17
* android-4-3-armv7-api16: 13
* android-4-3-armv7-api15: 4

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1373945&startday=2017-08-28&endday=2017-09-03&tree=all

Comment 15

[Hsin-Yi Tsai (she/her) [:hsinyi]]

Joel, could you help make it skip as comment 13 suggested?

Comment 16

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/mozilla-inbound/rev/7b30671832a4
Skip test_beaconPreflightWithCustomContentType.html on Android, for intermittent failures; r=me,test-only

Comment 17

[Sebastian Hengst [:aryx] (needinfo me if it's about an intermittent or backout)]

https://hg.mozilla.org/mozilla-central/rev/7b30671832a4

Comment 18

[Ryan VanderMeulen [:RyanVM]]

https://hg.mozilla.org/releases/mozilla-beta/rev/218531662248

Comment 19

[Intermittent Failures Robot]

13 failures in 924 pushes (0.014 failures/push) were associated with this bug in the last 7 days.   

Repository breakdown:
* autoland: 9
* mozilla-central: 2
* try: 1
* mozilla-inbound: 1

Platform breakdown:
* android-4-3-armv7-api16: 13

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1373945&startday=2017-09-04&endday=2017-09-10&tree=all

Comment 20

[BugBot [:suhaib / :marco/ :calixte]]

https://wiki.mozilla.org/Bug_Triage#Intermittent_Test_Failure_Cleanup
For more information, please visit BugBot documentation.