1546858 - Mass wpt failures

Status: RESOLVED FIXED

(Testing :: web-platform-tests, defect)

Description

[Narcis Beleuzu [:NarcisB]]

Mass wpt failures caused by :
https://treeherder.mozilla.org/#/jobs?repo=mozilla-inbound&resultStatus=testfailed%2Cbusted%2Cexception%2Crunnable&classifiedState=unclassified&revision=a9e8bb1d8a1617763205dc0ef46ec4fd663113cf

Somehow the tests didn`t start to fail from that push and got merged around into m-c.
e.g: https://treeherder.mozilla.org/#/jobs?repo=mozilla-inbound&resultStatus=success%2Ctestfailed%2Cbusted%2Cexception%2Crunnable&searchStr=linux%2Cshippable%2Copt%2Cweb%2Cplatform%2Ctests%2Ctest-linux32-shippable%2Fopt-web-platform-tests-e10s-2%2Cw%28wpt2%29&fromchange=a9e8bb1d8a1617763205dc0ef46ec4fd663113cf&tochange=9d57a72036d3ce614762bdb48bdcd1311bc72f12

All the failures seems to be caused by Bug 1532639
Failures:

1. On style-src-multiple-policies-multiple-hashing-algorithms.html - https://treeherder.mozilla.org/logviewer.html#/jobs?job_id=242466989&repo=mozilla-central&lineNumber=2028

2. On report-cross-origin-no-cookies.sub.html - https://treeherder.mozilla.org/logviewer.html#/jobs?job_id=242466937&repo=mozilla-central&lineNumber=1637

3. On no-default-src.sub.html - https://treeherder.mozilla.org/logviewer.html#/jobs?job_id=242466898&repo=mozilla-central&lineNumber=1746

4. On po-observe.html - https://treeherder.mozilla.org/logviewer.html#/jobs?job_id=242466792&repo=mozilla-central&lineNumber=5436

5. On event-timing-retrievability.html - https://treeherder.mozilla.org/logviewer.html#/jobs?job_id=242450777&repo=mozilla-central&lineNumber=55042

Comment 1

[Intermittent Failures Robot]

101 failures in 521 pushes (0.194 failures/push) were associated with this bug yesterday.

Repository breakdown:

• mozilla-central: 101

Platform breakdown:

• linux64: 14
• linux64-qr: 5
• linux32: 4
• osx-10-10: 2
• android-em-7-0-x86: 2
• linux64-ccov: 4
• osx-10-10-shippable: 5
• windows7-32: 10
• windows10-64: 10
• windows10-64-qr: 7
• windows10-64-ccov: 4
• linux32-shippable: 4
• linux64-shippable-qr: 4
• linux64-shippable: 6
• windows7-32-shippable: 7
• windows10-64-shippable-qr: 5
• windows10-64-shippable: 8

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1546858&startday=2019-04-24&endday=2019-04-24&tree=all

Comment 2

[James Graham [:jgraham]]

Attachment: Bug 1546858 - Force the wpt manifest job to rebuild the manifest,

If we use the downloaded manifest then any bug that leads to an error in the manifest
may be propogated forward. Instead force the manifest to be built from scratch in CI.

Comment 3

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/mozilla-inbound/rev/4243e8a01b2e
Force the wpt manifest job to rebuild the manifest, r=Aryx

Comment 4

[Raul Gurzau (:RaulG)]

https://hg.mozilla.org/mozilla-central/rev/4243e8a01b2e

Comment 5

[Intermittent Failures Robot]

1398 failures in 577 pushes (2.423 failures/push) were associated with this bug yesterday.

** This test has failed more than 150 times in the last 21 days. It should be disabled until it can be fixed. **

Repository breakdown:

• mozilla-inbound: 224
• autoland: 781
• mozilla-central: 251
• try: 142

Platform breakdown:

• windows7-32: 116
• linux32-shippable: 153
• osx-10-10: 72
• linux32: 193
• linux64: 182
• windows10-64: 66
• osx-10-10-shippable: 82
• linux64-shippable: 111
• windows7-32-shippable: 141
• windows10-64-shippable: 119
• linux64-qr: 34
• android-em-7-0-x86: 8
• linux64-ccov: 6
• windows10-64-qr: 22
• linux64-shippable-qr: 19
• windows10-64-shippable-qr: 25
• windows10-64-ccov: 6
• macosx64-devedition: 6
• linux32-devedition: 8
• linux64-devedition: 8
• windows10-64-devedition: 9
• windows7-32-devedition: 10
• android-hw-p2-8-0-android-aarch64: 1
• android-em-7-0-x86_64: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1546858&startday=2019-04-25&endday=2019-04-25&tree=all

Comment 6

[Intermittent Failures Robot]

1501 failures in 3031 pushes (0.495 failures/push) were associated with this bug in the last 7 days.

This is the #2 most frequent failure this week.

** This failure happened more than 75 times this week! Resolving this bug is a very high priority. **

** Try to resolve this bug as soon as possible. If unresolved for 1 week, the affected test(s) may be disabled. **

Repository breakdown:

• mozilla-central: 354
• mozilla-inbound: 224
• autoland: 781
• try: 142

Platform breakdown:

• linux64: 196
• linux64-qr: 39
• linux32: 197
• osx-10-10: 74
• android-em-7-0-x86: 10
• linux64-ccov: 10
• osx-10-10-shippable: 87
• windows7-32: 126
• windows10-64: 76
• windows10-64-qr: 29
• windows10-64-ccov: 10
• linux32-shippable: 157
• linux64-shippable-qr: 23
• linux64-shippable: 117
• windows7-32-shippable: 148
• windows10-64-shippable-qr: 30
• windows10-64-shippable: 129
• macosx64-devedition: 6
• linux32-devedition: 8
• linux64-devedition: 8
• windows10-64-devedition: 9
• windows7-32-devedition: 10
• android-hw-p2-8-0-android-aarch64: 1
• android-em-7-0-x86_64: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1546858&startday=2019-04-22&endday=2019-04-28&tree=all