1562126 - Perma fail TEST-UNEXPECTED-PASS | /xhr/send-after-setting-document-domain.htm | All tests ran - expected TIMEOUT

Status: RESOLVED FIXED

(Core :: DOM: Networking, defect, P5)

Description

[Treeherder Bug Filer]

Filed by: apavel [at] mozilla.com
Parsed log: https://treeherder.mozilla.org/logviewer.html#?job_id=253854517&repo=autoland
Full log: https://queue.taskcluster.net/v1/task/AUp0FH4JTbW0hPlUu2t9tQ/runs/0/artifacts/public/logs/live_backing.log

---

[task 2019-06-28T04:03:44.923Z] 04:03:44 INFO - TEST-START | /xhr/send-after-setting-document-domain.htm
[task 2019-06-28T04:03:44.979Z] 04:03:44 INFO - Closing window 2147484377
[task 2019-06-28T04:03:46.571Z] 04:03:46 INFO -
[task 2019-06-28T04:03:46.571Z] 04:03:46 INFO - TEST-UNEXPECTED-PASS | /xhr/send-after-setting-document-domain.htm | All tests ran - expected TIMEOUT
[task 2019-06-28T04:03:46.571Z] 04:03:46 INFO - TEST-INFO | expected TIMEOUT
[task 2019-06-28T04:03:46.803Z] 04:03:46 INFO - TEST-UNEXPECTED-OK | /xhr/send-after-setting-document-domain.htm | expected TIMEOUT
[task 2019-06-28T04:03:46.803Z] 04:03:46 INFO - TEST-INFO expected TIMEOUT | took 1878ms
[task 2019-06-28T04:03:47.554Z] 04:03:47 INFO - Closing logging queue
[task 2019-06-28T04:03:47.556Z] 04:03:47 INFO - queue closed
[task 2019-06-28T04:03:47.578Z] 04:03:47 INFO - Setting up ssl
[task 2019-06-28T04:03:47.599Z] 04:03:47 INFO - certutil |
[task 2019-06-28T04:03:47.626Z] 04:03:47 INFO - certutil |
[task 2019-06-28T04:03:47.642Z] 04:03:47 INFO - certutil |
[task 2019-06-28T04:03:47.642Z] 04:03:47 INFO - Certificate Nickname Trust Attributes
[task 2019-06-28T04:03:47.642Z] 04:03:47 INFO - SSL,S/MIME,JAR/XPI
[task 2019-06-28T04:03:47.642Z] 04:03:47 INFO -
[task 2019-06-28T04:03:47.642Z] 04:03:47 INFO - web-platform-tests CT,,
[task 2019-06-28T04:03:47.642Z] 04:03:47 INFO -
[task 2019-06-28T04:03:49.413Z] 04:03:49 INFO - adb Granting important runtime permissions to org.mozilla.geckoview.test
[task 2019-06-28T04:03:50.966Z] 04:03:50 INFO - adb launch_application: am start -W -n org.mozilla.geckoview.test/org.mozilla.geckoview.test.TestRunnerActivity -a android.intent.action.MAIN --es env9 MOZ_PROCESS_LOG=/tmp/tmphc2ns5pidlog --es env8 MOZ_CRASHREPORTER_NO_REPORT=1 --es args "-no-remote -profile /sdcard/tests/profile --marionette about:blank" --es env3 STYLO_THREADS=4 --es env2 MOZ_HIDE_RESULTS_TABLE=1 --es env1 R_LOG_VERBOSE=1 --es env0 MOZ_CRASHREPORTER=1 --es env7 MOZ_DISABLE_NONLOCAL_CONNECTIONS=1 --es env6 R_LOG_DESTINATION=stderr --es env5 MOZ_CRASHREPORTER_SHUTDOWN=1 --es env4 MOZ_LOG=signaling:3,mtransport:4,DataChannel:4,jsep:4 --ez use_multiprocess True --es env10 R_LOG_LEVEL=6
[task 2019-06-28T04:03:53.118Z] 04:03:53 INFO - Starting runner

Comment 1

[Intermittent Failures Robot]

6 failures in 4409 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 5
• try: 1

Platform breakdown:

• android-em-7-0-x86_64: 6

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1562126&startday=2019-06-24&endday=2019-06-30&tree=all

Comment 2

[Intermittent Failures Robot]

11 failures in 3501 pushes (0.003 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 8
• mozilla-inbound: 3

Platform breakdown:

• android-em-7-0-x86_64: 11

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1562126&startday=2019-07-01&endday=2019-07-07&tree=all

Comment 3

[Cristina Coroiu [:ccoroiu]]

Started to perma fail:
https://treeherder.mozilla.org/#/jobs?repo=autoland&searchStr=android%2C7.0%2Cx86-64%2Copt%2Cweb%2Cplatform%2Ctests%2Ctest-android-em-7.0-x86_64%2Fopt-web-platform-tests-e10s-15%2Cw%28wpt15%29&tochange=58fced48cd5dcf0f87c1d8345e011f6961af78cf&fromchange=e00934d477363c275f103a82d96020696b0469d6&selectedJob=255640713

Comment 4

[Intermittent Failures Robot]

40 failures in 1090 pushes (0.037 failures/push) were associated with this bug yesterday.

Repository breakdown:

• autoland: 31
• mozilla-central: 3
• try: 3
• mozilla-inbound: 3

Platform breakdown:

• android-em-7-0-x86_64: 40

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1562126&startday=2019-07-09&endday=2019-07-09&tree=all

Comment 5

[Andreea Pavel [:apavel]]

Attachment: Bug 1562126 - disabled test on android opt r=jmaher

Comment 6

[Maja Frydrychowicz :impossibus (was :maja_zf) (needinfo me)]

This is a permanent "TEST-UNEXPECTED-PASS", meaning that the failure expectation should be removed, rather than disabling the test.

Since this is suddenly passing on opt, and was previously disabled on debug, I thought I'd check if it works on debug now, too. As it turns out, it does! Here's a try push with all the metadata removed -- /xhr/send-after-setting-document-domain.htm is totally stable on Android:

https://treeherder.mozilla.org/#/jobs?repo=try&tier=1%2C2%2C3&revision=be032cbc940128aa646e481f5c933bb4e05ffb51

Comment 7

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/mozilla-inbound/rev/9dc7d6f2191c
Enable xhr/send-after-setting-document-domain.htm; a=testonly

Comment 8

[Cosmin Sabou [:CosminS]]

https://hg.mozilla.org/mozilla-central/rev/9dc7d6f2191c

Comment 9

[Intermittent Failures Robot]

33 failures in 1024 pushes (0.032 failures/push) were associated with this bug yesterday.

Repository breakdown:

• autoland: 19
• mozilla-inbound: 3
• mozilla-central: 11

Platform breakdown:

• android-em-7-0-x86_64: 33

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1562126&startday=2019-07-10&endday=2019-07-10&tree=all

Comment 10

[Intermittent Failures Robot]

79 failures in 4710 pushes (0.017 failures/push) were associated with this bug in the last 7 days.

This is the #22 most frequent failure this week.

** This failure happened more than 75 times this week! Resolving this bug is a very high priority. **

** Try to resolve this bug as soon as possible. If unresolved for 1 week, the affected test(s) may be disabled. **

Repository breakdown:

• autoland: 52
• mozilla-inbound: 7
• mozilla-central: 15
• try: 5

Platform breakdown:

• android-em-7-0-x86_64: 79

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1562126&startday=2019-07-08&endday=2019-07-14&tree=all