1662816 - Intermittent /intersection-observer/timestamp.html | Generate notifications. - assert_between_inclusive: Notification to top window observer is within the expected range. expected a number greater than or equal to 630.22 and less than or equal to 673.18 b

Status: RESOLVED FIXED

(Core :: Layout, defect, P5)

Description

[Treeherder Bug Filer]

Filed by: rmaries [at] mozilla.com
Parsed log: https://treeherder.mozilla.org/logviewer.html#?job_id=314686953&repo=autoland
Full log: https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/azjEErTZRcmgR4TO2VYVCQ/runs/0/artifacts/public/logs/live_backing.log

---

[task 2020-09-02T12:02:03.547Z] 12:02:03 INFO - TEST-START | /intersection-observer/timestamp.html
[task 2020-09-02T12:02:03.548Z] 12:02:03 INFO - Clearing pref dom.IntersectionObserverExplicitDocumentRoot.enabled
[task 2020-09-02T12:02:03.563Z] 12:02:03 INFO - Clearing pref dom.IntersectionObserver.enabled
[task 2020-09-02T12:02:03.592Z] 12:02:03 INFO - Setting pref dom.IntersectionObserverExplicitDocumentRoot.enabled (true)
[task 2020-09-02T12:02:03.628Z] 12:02:03 INFO - Setting pref privacy.reduceTimerPrecision (false)
[task 2020-09-02T12:02:03.676Z] 12:02:03 INFO - Setting pref dom.IntersectionObserver.enabled (true)
[task 2020-09-02T12:02:03.692Z] 12:02:03 INFO - Closing window 108
[task 2020-09-02T12:02:03.732Z] 12:02:03 INFO - .
[task 2020-09-02T12:02:03.733Z] 12:02:03 INFO - TEST-OK | /mathml/presentation-markup/direction/direction.html | took 1210ms
[task 2020-09-02T12:02:03.741Z] 12:02:03 INFO - Restarting browser for new test group
[task 2020-09-02T12:02:03.809Z] 12:02:03 INFO - PID 15172 | 1599048123803 Marionette INFO Stopped listening on port 44418
[task 2020-09-02T12:02:04.154Z] 12:02:04 INFO - PID 15172 | ###!!! [Parent][RunMessage] Error: Channel closing: too late to send/recv, messages will be lost
[task 2020-09-02T12:02:04.182Z] 12:02:04 INFO - PID 15172 | ###!!! [Parent][RunMessage] Error: Channel closing: too late to send/recv, messages will be lost
[task 2020-09-02T12:02:04.283Z] 12:02:04 INFO - PID 15172 | [2020-09-02T12:02:04Z WARN xulstore::persist] tried to remove key that isn't in the store
[task 2020-09-02T12:02:04.285Z] 12:02:04 INFO - PID 15172 | [2020-09-02T12:02:04Z WARN xulstore::persist] tried to remove key that isn't in the store
[task 2020-09-02T12:02:04.505Z] 12:02:04 INFO - PID 15172 | [Child 15307, Main Thread] WARNING: Extra shutdown CC: 'i < NORMAL_SHUTDOWN_COLLECTIONS', file /builds/worker/checkouts/gecko/xpcom/base/nsCycleCollector.cpp, line 3359
[task 2020-09-02T12:02:04.526Z] 12:02:04 INFO - PID 15172 | [Child 15307, Main Thread] WARNING: NS_ENSURE_TRUE(Preferences::InitStaticMembers()) failed: file /builds/worker/checkouts/gecko/modules/libpref/Preferences.cpp, line 4286
[task 2020-09-02T12:02:04.647Z] 12:02:04 INFO - PID 15172 | [Child 15332, Main Thread] WARNING: Extra shutdown CC: 'i < NORMAL_SHUTDOWN_COLLECTIONS', file /builds/worker/checkouts/gecko/xpcom/base/nsCycleCollector.cpp, line 3359
[task 2020-09-02T12:02:04.703Z] 12:02:04 INFO - PID 15172 | [Child 15332, Main Thread] WARNING: NS_ENSURE_TRUE(Preferences::InitStaticMembers()) failed: file /builds/worker/checkouts/gecko/modules/libpref/Preferences.cpp, line 4286
[task 2020-09-02T12:02:04.948Z] 12:02:04 INFO -
[task 2020-09-02T12:02:04.948Z] 12:02:04 INFO - TEST-PASS | /intersection-observer/timestamp.html | Check that timestamps correspond to the to execution context that created the observer.
[task 2020-09-02T12:02:04.948Z] 12:02:04 INFO - TEST-PASS | /intersection-observer/timestamp.html | First rAF after iframe is loaded.
[task 2020-09-02T12:02:04.948Z] 12:02:04 INFO - TEST-UNEXPECTED-FAIL | /intersection-observer/timestamp.html | Generate notifications. - assert_between_inclusive: Notification to top window observer is within the expected range. expected a number greater than or equal to 630.22 and less than or equal to 673.18 but got 619.88
[task 2020-09-02T12:02:04.948Z] 12:02:04 INFO - step2@http://web-platform.test:8000/intersection-observer/timestamp.html:87:27
[task 2020-09-02T12:02:04.948Z] 12:02:04 INFO - Test.prototype.step@http://web-platform.test:8000/resources/testharness.js:1977:25
[task 2020-09-02T12:02:04.948Z] 12:02:04 INFO - Test.prototype.step_func_done/<@http://web-platform.test:8000/resources/testharness.js:2018:32
[task 2020-09-02T12:02:04.949Z] 12:02:04 INFO - Test.prototype.step_timeout/<@http://web-platform.test:8000/resources/testharness.js:2036:22
[task 2020-09-02T12:02:04.949Z] 12:02:04 INFO - Test.prototype.step@http://web-platform.test:8000/resources/testharness.js:1977:25
[task 2020-09-02T12:02:04.949Z] 12:02:04 INFO - Test.prototype.step_func/<@http://web-platform.test:8000/resources/testharness.js:2002:35

Comment 1

[Intermittent Failures Robot]

12 failures in 2984 pushes (0.004 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 11
• mozilla-central: 1

Platform breakdown:

• linux1804-64: 7
• windows7-32: 1
• linux1804-64-qr: 3
• linux1804-64-asan: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1662816&startday=2020-08-31&endday=2020-09-06&tree=all

Comment 2

[Intermittent Failures Robot]

25 failures in 3410 pushes (0.007 failures/push) were associated with this bug in the last 7 days.

This is the #40 most frequent failure this week.

Repository breakdown:

• autoland: 11
• mozilla-central: 9
• try: 5

Platform breakdown:

• android-em-7-0-x86_64: 2
• linux1804-64: 8
• linux1804-64-qr: 8
• linux1804-64-shippable-qr: 2
• windows7-32: 1
• macosx1014-64: 1
• linux1804-64-asan: 3

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1662816&startday=2020-09-07&endday=2020-09-13&tree=all

Comment 3

[Intermittent Failures Robot]

24 failures in 3760 pushes (0.006 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• try: 2
• mozilla-central: 9
• autoland: 13

Platform breakdown:

• linux1804-64-asan: 7
• linux1804-64-qr: 6
• macosx1014-64: 2
• linux1804-64: 7
• linux1804-64-shippable-qr: 1
• linux1804-64-shippable: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1662816&startday=2020-09-14&endday=2020-09-20&tree=all

Comment 4

[Intermittent Failures Robot]

10 failures in 4019 pushes (0.002 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 4
• autoland: 6

Platform breakdown:

• linux1804-64-qr: 4
• linux1804-64: 4
• windows7-32: 2

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1662816&startday=2020-09-21&endday=2020-09-27&tree=all

Comment 5

[Intermittent Failures Robot]

10 failures in 4195 pushes (0.002 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-beta: 2
• mozilla-central: 6
• autoland: 2

Platform breakdown:

• linux1804-64-asan: 2
• linux1804-64-shippable-qr: 2
• linux1804-64-qr: 2
• linux1804-64: 4

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1662816&startday=2020-09-28&endday=2020-10-04&tree=all

Comment 6

[Intermittent Failures Robot]

12 failures in 4130 pushes (0.003 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 8
• try: 3
• mozilla-central: 1

Platform breakdown:

• linux1804-64-qr: 5
• android-em-7-0-x86_64: 3
• linux1804-64: 1
• linux1804-64-asan: 1
• linux1804-64-shippable-qr: 2

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1662816&startday=2020-10-05&endday=2020-10-11&tree=all

Comment 7

[Intermittent Failures Robot]

4 failures in 3694 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• try: 2
• mozilla-central: 1
• autoland: 1

Platform breakdown:

• windows10-64: 1
• linux1804-64-shippable-qr: 1
• linux1804-64: 1
• android-em-7-0-x86_64: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1662816&startday=2020-10-12&endday=2020-10-18&tree=all

Comment 8

[Intermittent Failures Robot]

9 failures in 4230 pushes (0.002 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 5
• mozilla-release: 2
• mozilla-central: 1
• try: 1

Platform breakdown:

• linux1804-64: 5
• linux1804-64-shippable-qr: 2
• linux1804-64-asan: 1
• linux1804-64-qr: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1662816&startday=2020-10-19&endday=2020-10-25&tree=all

Comment 9

[Intermittent Failures Robot]

5 failures in 4275 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-release: 1
• autoland: 2
• try: 2

Platform breakdown:

• linux1804-32-shippable: 1
• linux1804-64-qr: 2
• linux1804-64-shippable-qr: 1
• linux1804-64: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1662816&startday=2020-10-26&endday=2020-11-01&tree=all

Comment 10

[Intermittent Failures Robot]

3 failures in 4128 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 2
• try: 1

Platform breakdown:

• linux1804-64-shippable-qr: 1
• linux1804-64-qr: 1
• android-em-7-0-x86_64: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1662816&startday=2020-11-02&endday=2020-11-08&tree=all

Comment 11

[Intermittent Failures Robot]

9 failures in 4040 pushes (0.002 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 7
• try: 2

Platform breakdown:

• linux1804-64-qr: 2
• linux1804-64: 4
• linux1804-64-shippable-qr: 2
• windows10-64: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1662816&startday=2020-11-09&endday=2020-11-15&tree=all

Comment 12

[Intermittent Failures Robot]

6 failures in 4810 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 2
• autoland: 4

Platform breakdown:

• linux1804-64: 4
• linux1804-64-qr: 1
• linux1804-64-shippable-qr: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1662816&startday=2020-11-16&endday=2020-11-22&tree=all

Comment 13

[Intermittent Failures Robot]

5 failures in 1479 pushes (0.003 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 3
• mozilla-central: 2

Platform breakdown:

• linux1804-64: 2
• macosx1014-64-qr: 1
• linux1804-64-qr: 1
• linux1804-64-shippable-qr: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1662816&startday=2020-11-23&endday=2020-11-29&tree=all

Comment 14

[Intermittent Failures Robot]

48 failures in 3712 pushes (0.013 failures/push) were associated with this bug in the last 7 days.

This is the #21 most frequent failure this week.

** This failure happened more than 30 times this week! Resolving this bug is a high priority. **

** Try to resolve this bug as soon as possible. If unresolved for 2 weeks, the affected test(s) may be disabled. **

Repository breakdown:

• autoland: 41
• mozilla-central: 4
• mozilla-release: 1
• try: 1
• mozilla-beta: 1

Platform breakdown:

• android-em-7-0-x86_64-qr: 11
• linux1804-64-qr: 3
• windows10-64-shippable-qr: 4
• linux1804-64: 10
• windows10-64-qr: 8
• linux1804-64-shippable-qr: 5
• windows10-64: 3
• macosx1014-64-qr: 1
• windows7-32: 3

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1662816&startday=2020-11-30&endday=2020-12-06&tree=all

Comment 15

[Andreea Pavel [:apavel]]

There are 57 total failures in the last 7 days on

• android-em-7-0-x86_64-qr debug and opt
• linux1804-64 debug
• linux1804-64-qr opt
• linux1804-64-shippable-qr opt
• windows10-64 debug
• windows10-64-qr opt and debug

Recent failure log: https://treeherder.mozilla.org/logviewer?job_id=323980903&repo=mozilla-central&lineNumber=16485

[task 2020-12-08T22:22:27.084Z] 22:22:27 INFO - TEST-START | /intersection-observer/timestamp.html
[task 2020-12-08T22:22:27.089Z] 22:22:27 INFO - Clearing pref dom.IntersectionObserverExplicitDocumentRoot.enabled
[task 2020-12-08T22:22:27.099Z] 22:22:27 INFO - Clearing pref dom.IntersectionObserver.enabled
[task 2020-12-08T22:22:27.118Z] 22:22:27 INFO - Setting pref dom.IntersectionObserverExplicitDocumentRoot.enabled (true)
[task 2020-12-08T22:22:27.137Z] 22:22:27 INFO - Setting pref privacy.reduceTimerPrecision (false)
[task 2020-12-08T22:22:27.156Z] 22:22:27 INFO - Setting pref dom.IntersectionObserver.enabled (true)
[task 2020-12-08T22:22:27.161Z] 22:22:27 INFO - Closing window 119
[task 2020-12-08T22:22:27.299Z] 22:22:27 INFO - PID 8968 | [Parent 220, IPDL Background] WARNING: Cannot record shutdown step, mConnection is nullptr: file /builds/worker/checkouts/gecko/dom/localstorage/ActorsParent.cpp:8027
[task 2020-12-08T22:22:27.358Z] 22:22:27 INFO - PID 8968 | JavaScript error: , line 0: NotFoundError: No such JSWindowActor 'MarionetteEvents'
[task 2020-12-08T22:22:27.478Z] 22:22:27 INFO - PID 8968 | [Parent 220, IPDL Background] WARNING: Cannot record shutdown step, mConnection is nullptr: file /builds/worker/checkouts/gecko/dom/localstorage/ActorsParent.cpp:8027
[task 2020-12-08T22:22:27.701Z] 22:22:27 INFO -
[task 2020-12-08T22:22:27.701Z] 22:22:27 INFO - TEST-PASS | /intersection-observer/timestamp.html | Check that timestamps correspond to the to execution context that created the observer.
[task 2020-12-08T22:22:27.701Z] 22:22:27 INFO - TEST-PASS | /intersection-observer/timestamp.html | First rAF after iframe is loaded.
[task 2020-12-08T22:22:27.701Z] 22:22:27 INFO - TEST-UNEXPECTED-FAIL | /intersection-observer/timestamp.html | Generate notifications. - assert_between_inclusive: Notification to top window observer is within the expected range. expected a number greater than or equal to 304.38 and less than or equal to 324.2 but got 303.7
[task 2020-12-08T22:22:27.701Z] 22:22:27 INFO - step2@http://web-platform.test:8000/intersection-observer/timestamp.html:87:27
[task 2020-12-08T22:22:27.701Z] 22:22:27 INFO - Test.prototype.step@http://web-platform.test:8000/resources/testharness.js:2044:25
[task 2020-12-08T22:22:27.701Z] 22:22:27 INFO - Test.prototype.step_func_done/<@http://web-platform.test:8000/resources/testharness.js:2085:32
[task 2020-12-08T22:22:27.701Z] 22:22:27 INFO - Test.prototype.step_timeout/<@http://web-platform.test:8000/resources/testharness.js:2103:22
[task 2020-12-08T22:22:27.701Z] 22:22:27 INFO - Test.prototype.step@http://web-platform.test:8000/resources/testharness.js:2044:25
[task 2020-12-08T22:22:27.701Z] 22:22:27 INFO - Test.prototype.step_func/<@http://web-platform.test:8000/resources/testharness.js:2069:35
[task 2020-12-08T22:22:27.701Z] 22:22:27 INFO - TEST-OK | /intersection-observer/timestamp.html | took 616ms

Sean can you take a look?

Comment 16

[Intermittent Failures Robot]

15 failures in 705 pushes (0.021 failures/push) were associated with this bug yesterday.

Repository breakdown:

• autoland: 12
• mozilla-central: 2
• try: 1

Platform breakdown:

• windows10-64-shippable-qr: 1
• windows10-64-qr: 2
• linux1804-64-qr: 2
• android-em-7-0-x86_64-qr: 6
• windows7-32: 1
• windows10-64: 1
• android-em-7-0-x86_64: 1
• linux1804-64-shippable-qr: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1662816&startday=2020-12-11&endday=2020-12-11&tree=all

Comment 17

[Narcis Beleuzu [:NarcisB]]

There have been 61 failures in the last 7 days.

• 23 failures on android-em-7-0-x86_64
• 17 failures on windows10-64
• 16 failures on linux1804-64
• 4 failures on windows7-32
• 1 failure on macosx1014-64

Daniel, can you please take a look?

Comment 18

[Daniel Holbert [:dholbert]]

The test failure text quoted in 15 says (emphasis added):
"expected a number greater than or equal to 304.38 and less than or equal to 324.2 but got 303.7

Without having investigated super-thoroughly, this looks like a pretty near miss and not a catastrophic failure. Could even be a bug in the test's kinda-arbitrary-looking upper and lower bounds, but it would take some additional investigation to determine that.

Until someone has time to investigate, we should probably just annotate this as a known failure. (The test has one other annotated known failure, too.)

Comment 19

[Daniel Holbert [:dholbert]]

Actually, this failure (Generate notifications...) is just a version of the test's already-annotated failure. It's just that the annotated failure has some "only on these platforms" limitations/configurations, which are a bit too specific and need broadening, I think. (It looks like they were added in an ad-hoc way in bug 1664225.

Based on the existing annotation, combined with the failures noted here: it looks like this just intermittently fails on all platforms/configurations, so we should just drop the platform-specific qualifiers.

Comment 20

[Daniel Holbert [:dholbert]]

Attachment: Bug 1662816: Remove qualifiers on intermittent-failure annotation for intersection-observer/timestamp.html. r?emilio

Comment 21

[Daniel Holbert [:dholbert]]

Try run: https://treeherder.mozilla.org/jobs?repo=try&revision=6fb1b07ac2d99aab39ed6d9412b2e3efa366b146

Comment 22

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/autoland/rev/9482a52c5b88
Remove qualifiers on intermittent-failure annotation for intersection-observer/timestamp.html. r=emilio

Comment 23

[Intermittent Failures Robot]

63 failures in 4060 pushes (0.016 failures/push) were associated with this bug in the last 7 days.

This is the #8 most frequent failure this week.

** This failure happened more than 30 times this week! Resolving this bug is a high priority. **

** Try to resolve this bug as soon as possible. If unresolved for 2 weeks, the affected test(s) may be disabled. **

Repository breakdown:

• autoland: 39
• mozilla-central: 17
• try: 6
• mozilla-release: 1

Platform breakdown:

• windows10-64-qr: 8
• android-em-7-0-x86_64-qr: 21
• android-em-7-0-x86_64-shippable-qr: 1
• android-em-7-0-x86_64-shippable: 1
• linux1804-64-qr: 5
• linux1804-64: 6
• windows10-64: 6
• android-em-7-0-x86_64: 2
• linux1804-64-shippable-qr: 4
• windows7-32-shippable: 1
• windows10-64-shippable-qr: 3
• macosx1014-64-qr: 1
• windows7-32: 4

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1662816&startday=2020-12-07&endday=2020-12-13&tree=all

Comment 24

[Natalia Csoregi [:nataliaCs]]

https://hg.mozilla.org/mozilla-central/rev/9482a52c5b88

Comment 25

[Intermittent Failures Robot]

1 failures in 3421 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• try: 1

Platform breakdown:

• windows7-32: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1662816&startday=2020-12-14&endday=2020-12-20&tree=all