1573036 - Intermittent /cookie-store/serviceworker_cookieStore_subscriptions.tentative.https.html | getChangeSubscriptions returns subscriptions passed to subscribeToChanges - promise_test: Unhandled rejection with value: object "ReferenceError

Status: NEW

(Testing :: web-platform-tests, defect, P5)

Description

[Treeherder Bug Filer]

Filed by: aciure [at] mozilla.com
Parsed log: https://treeherder.mozilla.org/logviewer.html#?job_id=261014270&repo=mozilla-inbound
Full log: https://queue.taskcluster.net/v1/task/ZUYGDHh0TJ-31ACbR_QURg/runs/0/artifacts/public/logs/live_backing.log

---

[task 2019-08-11T10:16:05.515Z] 10:16:05 INFO - TEST-START | /cookie-store/serviceworker_cookieStore_subscriptions.tentative.https.html
[task 2019-08-11T10:16:05.517Z] 10:16:05 INFO - Closing window 88
[task 2019-08-11T10:16:05.981Z] 10:16:05 INFO -
[task 2019-08-11T10:16:05.981Z] 10:16:05 INFO - TEST-UNEXPECTED-FAIL | /cookie-store/serviceworker_cookieStore_subscriptions.tentative.https.html | getChangeSubscriptions returns subscriptions passed to subscribeToChanges - promise_test: Unhandled rejection with value: object "ReferenceError: cookieStore is not defined"
[task 2019-08-11T10:16:05.981Z] 10:16:05 INFO - @https://web-platform.test:8443/cookie-store/serviceworker_cookieStore_subscriptions.js:41:13
[task 2019-08-11T10:16:05.982Z] 10:16:05 INFO - TEST-INFO | expected TIMEOUT
[task 2019-08-11T10:16:05.982Z] 10:16:05 INFO -
[task 2019-08-11T10:16:05.982Z] 10:16:05 INFO - TEST-UNEXPECTED-FAIL | /cookie-store/serviceworker_cookieStore_subscriptions.tentative.https.html | subscribeToChanges rejects when called outside the install handler - promise_test: Unhandled rejection with value: object "ReferenceError: cookieStore is not defined"
[task 2019-08-11T10:16:05.982Z] 10:16:05 INFO - @https://web-platform.test:8443/cookie-store/serviceworker_cookieStore_subscriptions.js:59:13
[task 2019-08-11T10:16:05.982Z] 10:16:05 INFO - TEST-INFO | expected NOTRUN
[task 2019-08-11T10:16:05.982Z] 10:16:05 INFO -
[task 2019-08-11T10:16:05.982Z] 10:16:05 INFO - TEST-UNEXPECTED-FAIL | /cookie-store/serviceworker_cookieStore_subscriptions.tentative.https.html | cookiechange dispatched with cookie change that matches subscription - promise_test: Unhandled rejection with value: object "ReferenceError: cookieStore is not defined"
[task 2019-08-11T10:16:05.982Z] 10:16:05 INFO - @https://web-platform.test:8443/cookie-store/serviceworker_cookieStore_subscriptions.js:85:13
[task 2019-08-11T10:16:05.983Z] 10:16:05 INFO - TEST-INFO | expected NOTRUN
[task 2019-08-11T10:16:05.984Z] 10:16:05 INFO - TEST-UNEXPECTED-OK | /cookie-store/serviceworker_cookieStore_subscriptions.tentative.https.html | expected TIMEOUT
[task 2019-08-11T10:16:05.984Z] 10:16:05 INFO - TEST-INFO expected TIMEOUT | took 467ms
[task 2019-08-11T10:16:06.028Z] 10:16:06 INFO - PID 1679 | 1565518566001 Marionette INFO Stopped listening on port 50114
[task 2019-08-11T10:16:06.655Z] 10:16:06 INFO - Browser exited with return code 0
[task 2019-08-11T10:16:06.655Z] 10:16:06 INFO - PROCESS LEAKS None
[task 2019-08-11T10:16:06.655Z] 10:16:06 INFO - Closing logging queue
[task 2019-08-11T10:16:06.655Z] 10:16:06 INFO - queue closed
[task 2019-08-11T10:16:06.672Z] 10:16:06 INFO - Setting up ssl
[task 2019-08-11T10:16:06.702Z] 10:16:06 INFO - certutil |
[task 2019-08-11T10:16:06.736Z] 10:16:06 INFO - certutil |
[task 2019-08-11T10:16:06.768Z] 10:16:06 INFO - certutil |
[task 2019-08-11T10:16:06.768Z] 10:16:06 INFO - Certificate Nickname Trust Attributes
[task 2019-08-11T10:16:06.768Z] 10:16:06 INFO - SSL,S/MIME,JAR/XPI
[task 2019-08-11T10:16:06.768Z] 10:16:06 INFO -
[task 2019-08-11T10:16:06.768Z] 10:16:06 INFO - web-platform-tests CT,,
[task 2019-08-11T10:16:06.768Z] 10:16:06 INFO -
[task 2019-08-11T10:16:06.805Z] 10:16:06 INFO - Application command: /Users/cltbld/tasks/task_1565513151/build/application/Firefox Nightly.app/Contents/MacOS/firefox --marionette about:blank -foreground -profile /var/folders/xw/hxmp5vg531z5tmgx1wj26y_0000017/T/tmpwt2MGr.mozrunner
[task 2019-08-11T10:16:06.813Z] 10:16:06 INFO - Starting runner
[task 2019-08-11T10:16:07.409Z] 10:16:07 INFO - PID 1721 | 1565518567398 [e-mail] WARN Loading extension '[e-mail]': Reading manifest: Invalid extension permission: mozillaAddons
[task 2019-08-11T10:16:07.409Z] 10:16:07 INFO - PID 1721 | 1565518567398 [e-mail] WARN Loading extension '[e-mail]': Reading manifest: Invalid extension permission: telemetry
[task 2019-08-11T10:16:07.409Z] 10:16:07 INFO - PID 1721 | 1565518567399 [e-mail] WARN Loading extension '[e-mail]': Reading manifest: Invalid extension permission: resource://pdf.js/
[task 2019-08-11T10:16:07.409Z] 10:16:07 INFO - PID 1721 | 1565518567399 [e-mail] WARN Loading extension '[e-mail]': Reading manifest: Invalid extension permission: about:reader*
[task 2019-08-11T10:16:09.632Z] 10:16:09 INFO - PID 1721 | 1565518569612 Marionette INFO Listening on port 50114

Comment 1

[Andrei Ciure[:andrei_ciure]]

Updated the condition: https://hg.mozilla.org/try/rev/14213ec7332c7e49579e39723869f399708d3e8c and got this on try:

https://treeherder.mozilla.org/#/jobs?repo=try&revision=ae79a8357733f1b1038a8962156c393668de72cc&selectedJob=261026059

Comment 2

[Andrei Ciure[:andrei_ciure]]

:jgraham can you take a look, it started from the wptsync push:

https://treeherder.mozilla.org/#/jobs?repo=mozilla-inbound&searchStr=os%2Cx%2C10.14%2Cshippable%2Copt%2Cweb%2Cplatform%2Ctests%2Ctest-macosx1014-64-shippable%2Fopt-web-platform-tests-e10s-3%2Cw%28wpt3%29&revision=6fa808aa39e185c731d41fed02db2b2b7ef50ccb

Comment 3

[Intermittent Failures Robot]

33 failures in 4666 pushes (0.007 failures/push) were associated with this bug in the last 7 days.

** This failure happened more than 30 times this week! Resolving this bug is a high priority. **

** Try to resolve this bug as soon as possible. If unresolved for 2 weeks, the affected test(s) may be disabled. **

Repository breakdown:

• mozilla-inbound: 15
• autoland: 7
• mozilla-central: 11

Platform breakdown:

• linux64: 4
• macosx1014-64: 3
• windows7-32: 4
• windows10-64: 4
• macosx1014-64-shippable: 8
• linux64-shippable: 3
• windows7-32-shippable: 3
• windows10-64-shippable: 3
• windows10-64-ccov: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1573036&startday=2019-08-05&endday=2019-08-11&tree=all

Comment 4

[James Graham [:jgraham]]

The default value has to go last because the conditions are evaluated in-order. So the file you want is like

 [serviceworker_cookieStore_subscriptions.tentative.https.html]
   expected:
     if (os == "mac") and not debug and (version == "OS X 10.14"): [OK, TIMEOUT]
     TIMEOUT

   [getChangeSubscriptions returns subscriptions passed to subscribeToChanges]
     expected:
       if (os == "mac") and not debug and (version == "OS X 10.14"): [FAIL, NOTRUN]
       TIMEOUT
 
   [subscribeToChanges rejects when called outside the install handler]
     expected:
       if (os == "mac") and not debug and (version == "OS X 10.14"): [FAIL, NOTRUN]
       NOTRUN

   [cookiechange dispatched with cookie change that matches subscription]
     expected:
       if (os == "mac") and not debug and (version == "OS X 10.14"): [FAIL, NOTRUN]
       NOTRUN

(I'm pretty sure there's some magic to ensure that versions 10.14 and 10.14.5 compare equal).

Comment 5

[Intermittent Failures Robot]

42 failures in 1102 pushes (0.038 failures/push) were associated with this bug yesterday.

Repository breakdown:

• try: 35
• mozilla-inbound: 1
• autoland: 4
• mozilla-central: 2

Platform breakdown:

• linux64: 28
• linux64-shippable-qr: 8
• linux64-devedition: 1
• linux64-shippable: 4
• linux64-ccov: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1573036&startday=2019-08-13&endday=2019-08-13&tree=all

Comment 6

[Intermittent Failures Robot]

72 failures in 4839 pushes (0.015 failures/push) were associated with this bug in the last 7 days.

This is the #29 most frequent failure this week.

** This failure happened more than 30 times this week! Resolving this bug is a high priority. **

** Try to resolve this bug as soon as possible. If unresolved for 2 weeks, the affected test(s) may be disabled. **

Repository breakdown:

• autoland: 19
• mozilla-central: 11
• try: 38
• mozilla-inbound: 4

Platform breakdown:

• linux64-shippable: 11
• linux64: 33
• linux32-shippable: 10
• windows10-64: 3
• linux64-shippable-qr: 10
• linux64-devedition: 1
• linux64-ccov: 2
• macosx1014-64: 1
• linux64-qr: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1573036&startday=2019-08-12&endday=2019-08-18&tree=all

Comment 7

[Alexandru Michis [:malexandru]]

James, this has 36 total failures in the last 7 days: https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?startday=2019-08-14&endday=2019-08-21&tree=trunk&bug=1573036

The failures appear on:

• linux64 opt/linux32-shippable opt
• linux64-ccov debug
• linux64-qr opt
• linux64-shippable opt/linux64-shippable-qr opt
• macosx1014-64 debug
• windows10-64 debug

Any updates on it? There have been changes to the expectations to include the 10.14.5 version but the failure rate seems to remain the same.

Comment 8

[Intermittent Failures Robot]

57 failures in 5073 pushes (0.011 failures/push) were associated with this bug in the last 7 days.

This is the #46 most frequent failure this week.

** This test has failed more than 150 times in the last 21 days. It should be disabled until it can be fixed. **

Repository breakdown:

• mozilla-central: 19
• try: 13
• mozilla-inbound: 8
• autoland: 17

Platform breakdown:

• linux64-qr: 1
• windows10-64: 12
• macosx1014-64: 5
• linux32-shippable: 6
• linux64-shippable: 8
• linux64-shippable-qr: 5
• linux64: 14
• linux64-ccov: 5
• windows10-64-qr: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1573036&startday=2019-08-19&endday=2019-08-25&tree=all

Comment 9

[Razvan Maries]

Attachment: Bug 1573036 - Disabled serviceworker_cookieStore_subscriptions.tentative.https.html on Linux and Windows10. r?#intermittent-reviewers

Comment 10

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/autoland/rev/0c92114a077e
Disabled serviceworker_cookieStore_subscriptions.tentative.https.html on Linux and Windows10. r=intermittent-reviewers,jmaher

Comment 11

[Alexandru Michis [:malexandru]]

https://hg.mozilla.org/mozilla-central/rev/0c92114a077e

Comment 12

[James Graham [:jgraham]]

I'm not really sure why this ended up disabled rather than with multiple expected statuses for linux too?

Comment 13

[Intermittent Failures Robot]

16 failures in 5047 pushes (0.003 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-inbound: 3
• autoland: 4
• mozilla-beta: 1
• mozilla-central: 4
• try: 4

Platform breakdown:

• windows10-64: 4
• linux32-shippable: 1
• linux64-devedition: 1
• macosx1014-64: 6
• linux64: 2
• windows10-64-qr: 2

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1573036&startday=2019-08-26&endday=2019-09-01&tree=all

Comment 14

[Intermittent Failures Robot]

10 failures in 4408 pushes (0.002 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 6
• mozilla-inbound: 1
• try: 2
• mozilla-beta: 1

Platform breakdown:

• windows10-64: 3
• macosx1014-64: 5
• windows10-64-qr: 2

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1573036&startday=2019-09-02&endday=2019-09-08&tree=all

Comment 15

[Intermittent Failures Robot]

9 failures in 4637 pushes (0.002 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-beta: 1
• autoland: 5
• mozilla-central: 2
• try: 1

Platform breakdown:

• macosx1014-64: 9

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1573036&startday=2019-09-09&endday=2019-09-15&tree=all

Comment 16

[Intermittent Failures Robot]

8 failures in 4350 pushes (0.002 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 4
• mozilla-beta: 2
• mozilla-inbound: 2

Platform breakdown:

• macosx1014-64: 7
• windows10-64: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1573036&startday=2019-09-16&endday=2019-09-22&tree=all

Comment 17

[Intermittent Failures Robot]

9 failures in 4530 pushes (0.002 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 1
• try: 1
• autoland: 5
• mozilla-inbound: 1
• mozilla-beta: 1

Platform breakdown:

• macosx1014-64: 8
• windows10-64: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1573036&startday=2019-09-23&endday=2019-09-29&tree=all

Comment 18

[Intermittent Failures Robot]

16 failures in 4292 pushes (0.004 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-inbound: 2
• autoland: 10
• try: 1
• mozilla-beta: 2
• mozilla-central: 1

Platform breakdown:

• macosx1014-64: 11
• windows7-32: 1
• windows10-64: 3
• windows10-64-qr: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1573036&startday=2019-09-30&endday=2019-10-06&tree=all

Comment 19

[Intermittent Failures Robot]

13 failures in 3801 pushes (0.003 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 1
• autoland: 5
• mozilla-inbound: 1
• try: 4
• mozilla-beta: 2

Platform breakdown:

• macosx1014-64: 11
• windows10-64: 1
• windows10-64-qr: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1573036&startday=2019-10-07&endday=2019-10-13&tree=all

Comment 20

[Intermittent Failures Robot]

2 failures in 3964 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-beta: 1
• mozilla-release: 1

Platform breakdown:

• macosx1014-64: 1
• windows10-64-qr: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1573036&startday=2019-10-14&endday=2019-10-20&tree=all

Comment 21

[Intermittent Failures Robot]

11 failures in 4182 pushes (0.003 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• try: 6
• mozilla-beta: 5

Platform breakdown:

• macosx1014-64: 11

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1573036&startday=2019-10-21&endday=2019-10-27&tree=all

Comment 22

[Intermittent Failures Robot]

7 failures in 4314 pushes (0.002 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-release: 1
• mozilla-beta: 4
• try: 2

Platform breakdown:

• macosx1014-64: 6
• windows10-64: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1573036&startday=2019-10-28&endday=2019-11-03&tree=all

Comment 23

[Intermittent Failures Robot]

6 failures in 4850 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• try: 5
• mozilla-release: 1

Platform breakdown:

• macosx1014-64: 6

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1573036&startday=2019-11-04&endday=2019-11-10&tree=all

Comment 24

[Intermittent Failures Robot]

5 failures in 4207 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• try: 3
• mozilla-beta: 2

Platform breakdown:

• macosx1014-64: 5

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1573036&startday=2019-11-11&endday=2019-11-17&tree=all

Comment 25

[Intermittent Failures Robot]

8 failures in 5444 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• try: 4
• mozilla-beta: 4

Platform breakdown:

• macosx1014-64: 8

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1573036&startday=2019-11-18&endday=2019-11-24&tree=all

Comment 26

[Intermittent Failures Robot]

8 failures in 4331 pushes (0.002 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-release: 4
• try: 4

Platform breakdown:

• macosx1014-64: 7
• windows10-64: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1573036&startday=2019-11-25&endday=2019-12-01&tree=all

Comment 27

[Intermittent Failures Robot]

4 failures in 5144 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• try: 1
• mozilla-beta: 3

Platform breakdown:

• macosx1014-64: 4

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1573036&startday=2019-12-02&endday=2019-12-08&tree=all