1665302 - Intermittent devtools/client/inspector/boxmodel/test/browser_boxmodel_editablemodel_border.js | Should have the right value in the box model. - Got "3", expected "0"

Status: RESOLVED FIXED

(DevTools :: Inspector, defect, P5)

Description

[Treeherder Bug Filer]

Filed by: rmaries [at] mozilla.com
Parsed log: https://treeherder.mozilla.org/logviewer.html#?job_id=315813087&repo=autoland
Full log: https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/PtuDzuk1TDiycZccEYctNA/runs/0/artifacts/public/logs/live_backing.log

---

[task 2020-09-16T08:46:48.754Z] 08:46:48     INFO - TEST-START | devtools/client/inspector/boxmodel/test/browser_boxmodel_editablemodel_border.js
[task 2020-09-16T08:46:51.525Z] 08:46:51     INFO - TEST-PASS | devtools/client/inspector/boxmodel/test/browser_boxmodel_editablemodel_border.js | Should have the right border - 
[task 2020-09-16T08:46:51.525Z] 08:46:51     INFO - Buffered messages finished
[task 2020-09-16T08:46:51.526Z] 08:46:51     INFO - TEST-UNEXPECTED-FAIL | devtools/client/inspector/boxmodel/test/browser_boxmodel_editablemodel_border.js | Should have the right value in the box model. - Got "3", expected "0"
[task 2020-09-16T08:46:51.527Z] 08:46:51     INFO - Stack trace:
[task 2020-09-16T08:46:51.527Z] 08:46:51     INFO - chrome://mochikit/content/browser-test.js:test_is:1332
[task 2020-09-16T08:46:51.527Z] 08:46:51     INFO - chrome://mochitests/content/browser/devtools/client/inspector/boxmodel/test/browser_boxmodel_editablemodel_border.js:null:73
[task 2020-09-16T08:46:51.527Z] 08:46:51     INFO - chrome://mochikit/content/browser-test.js:Tester_execTest/<:1069
[task 2020-09-16T08:46:51.527Z] 08:46:51     INFO - chrome://mochikit/content/browser-test.js:Tester_execTest:1109
[task 2020-09-16T08:46:51.527Z] 08:46:51     INFO - chrome://mochikit/content/browser-test.js:nextTest/<:932
[task 2020-09-16T08:46:51.528Z] 08:46:51     INFO - chrome://mochikit/content/tests/SimpleTest/SimpleTest.js:SimpleTest.waitForFocus/waitForFocusInner/focusedOrLoaded/<:1037
[task 2020-09-16T08:46:51.528Z] 08:46:51     INFO - Leaving test bound 
[task 2020-09-16T08:46:51.741Z] 08:46:51     INFO - Removing tab.
[task 2020-09-16T08:46:51.742Z] 08:46:51     INFO - Waiting for event: 'TabClose' on [object XULElement].
[task 2020-09-16T08:46:51.763Z] 08:46:51     INFO - Got event: 'TabClose' on [object XULElement].
[task 2020-09-16T08:46:51.791Z] 08:46:51     INFO - Tab removed and finished closing```

Comment 1

[Intermittent Failures Robot]

6 failures in 3760 pushes (0.002 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 5
• try: 1

Platform breakdown:

• linux1804-64-asan: 3
• macosx1014-64: 1
• linux1804-64: 2

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1665302&startday=2020-09-14&endday=2020-09-20&tree=all

Comment 2

[Intermittent Failures Robot]

2 failures in 4019 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 1
• mozilla-beta: 1

Platform breakdown:

• linux1804-64-ccov: 1
• linux1804-64: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1665302&startday=2020-09-21&endday=2020-09-27&tree=all

Comment 3

[Intermittent Failures Robot]

12 failures in 4195 pushes (0.003 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 7
• mozilla-central: 1
• try: 4

Platform breakdown:

• linux1804-64: 12

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1665302&startday=2020-09-28&endday=2020-10-04&tree=all

Comment 4

[Intermittent Failures Robot]

10 failures in 4130 pushes (0.002 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 8
• mozilla-central: 1
• mozilla-beta: 1

Platform breakdown:

• linux1804-64: 8
• macosx1014-64: 2

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1665302&startday=2020-10-05&endday=2020-10-11&tree=all

Comment 5

[Intermittent Failures Robot]

6 failures in 3694 pushes (0.002 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-beta: 1
• autoland: 3
• try: 1
• mozilla-central: 1

Platform breakdown:

• windows10-64: 1
• macosx1014-64: 2
• linux1804-64-asan: 1
• linux1804-64: 2

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1665302&startday=2020-10-12&endday=2020-10-18&tree=all

Comment 6

[Intermittent Failures Robot]

12 failures in 4230 pushes (0.003 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 9
• mozilla-beta: 1
• try: 1
• mozilla-central: 1

Platform breakdown:

• linux1804-64: 11
• windows10-64-ccov: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1665302&startday=2020-10-19&endday=2020-10-25&tree=all

Comment 7

[Intermittent Failures Robot]

5 failures in 4275 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 2
• autoland: 3

Platform breakdown:

• windows10-64-ccov: 1
• linux1804-64: 3
• macosx1014-64: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1665302&startday=2020-10-26&endday=2020-11-01&tree=all

Comment 8

[Intermittent Failures Robot]

18 failures in 4128 pushes (0.004 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 16
• try: 1
• mozilla-central: 1

Platform breakdown:

• linux1804-64: 16
• windows10-64: 1
• macosx1014-64-qr: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1665302&startday=2020-11-02&endday=2020-11-08&tree=all

Comment 9

[Intermittent Failures Robot]

20 failures in 4040 pushes (0.005 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 16
• try: 2
• mozilla-central: 2

Platform breakdown:

• linux1804-64: 20

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1665302&startday=2020-11-09&endday=2020-11-15&tree=all

Comment 10

[Intermittent Failures Robot]

23 failures in 4810 pushes (0.005 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• try: 2
• mozilla-release: 1
• autoland: 15
• mozilla-central: 2
• mozilla-beta: 3

Platform breakdown:

• linux1804-64: 20
• windows10-64: 2
• linux1804-64-ccov: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1665302&startday=2020-11-16&endday=2020-11-22&tree=all

Comment 11

[Intermittent Failures Robot]

19 failures in 1479 pushes (0.013 failures/push) were associated with this bug in the last 7 days.

This is the #27 most frequent failure this week.

Repository breakdown:

• autoland: 12
• mozilla-central: 4
• try: 2
• mozilla-beta: 1

Platform breakdown:

• linux1804-64: 17
• windows10-64: 1
• windows10-64-ccov-qr: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1665302&startday=2020-11-23&endday=2020-11-29&tree=all

Comment 12

[Intermittent Failures Robot]

27 failures in 3712 pushes (0.007 failures/push) were associated with this bug in the last 7 days.

This is the #47 most frequent failure this week.

Repository breakdown:

• autoland: 18
• mozilla-central: 5
• try: 2
• mozilla-beta: 2

Platform breakdown:

• linux1804-64: 27

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1665302&startday=2020-11-30&endday=2020-12-06&tree=all

Comment 13

[Intermittent Failures Robot]

14 failures in 4060 pushes (0.003 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• try: 3
• mozilla-central: 6
• autoland: 5

Platform breakdown:

• linux1804-64: 13
• windows10-64-ccov-qr: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1665302&startday=2020-12-07&endday=2020-12-13&tree=all

Comment 14

[Intermittent Failures Robot]

13 failures in 3421 pushes (0.004 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 8
• mozilla-beta: 1
• mozilla-central: 3
• mozilla-release: 1

Platform breakdown:

• linux1804-64: 13

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1665302&startday=2020-12-14&endday=2020-12-20&tree=all

Comment 15

[Intermittent Failures Robot]

10 failures in 1450 pushes (0.007 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 6
• mozilla-central: 3
• try: 1

Platform breakdown:

• linux1804-64: 10

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1665302&startday=2020-12-21&endday=2020-12-27&tree=all

Comment 16

[Intermittent Failures Robot]

3 failures in 525 pushes (0.006 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 2
• autoland: 1

Platform breakdown:

• linux1804-64: 3

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1665302&startday=2020-12-28&endday=2021-01-03&tree=all

Comment 17

[Intermittent Failures Robot]

11 failures in 2956 pushes (0.004 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 2
• mozilla-central: 6
• mozilla-beta: 1
• try: 2

Platform breakdown:

• linux1804-64: 11

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1665302&startday=2021-01-04&endday=2021-01-10&tree=all

Comment 18

[Intermittent Failures Robot]

15 failures in 3810 pushes (0.004 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 2
• mozilla-beta: 4
• autoland: 8
• try: 1

Platform breakdown:

• linux1804-64: 14
• windows10-64: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1665302&startday=2021-01-11&endday=2021-01-17&tree=all

Comment 19

[Intermittent Failures Robot]

30 failures in 3488 pushes (0.009 failures/push) were associated with this bug in the last 7 days.

This is the #43 most frequent failure this week.

** This failure happened more than 30 times this week! Resolving this bug is a high priority. **

** Try to resolve this bug as soon as possible. If unresolved for 2 weeks, the affected test(s) may be disabled. **

Repository breakdown:

• mozilla-central: 5
• try: 3
• autoland: 22

Platform and build breakdown:

• linux1804-64: 27
  • debug: 27
• windows10-64: 2
  • asan: 2
• linux1804-64-ccov: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1665302&startday=2021-01-18&endday=2021-01-24&tree=all

Comment 20

[Intermittent Failures Robot]

33 failures in 3891 pushes (0.008 failures/push) were associated with this bug in the last 7 days.

This is the #34 most frequent failure this week.

** This failure happened more than 30 times this week! Resolving this bug is a high priority. **

** Try to resolve this bug as soon as possible. If unresolved for 2 weeks, the affected test(s) may be disabled. **

Repository breakdown:

• autoland: 19
• try: 8
• mozilla-central: 5
• mozilla-beta: 1

Platform and build breakdown:

• linux1804-64: 29
  • debug: 29
• windows10-64: 2
  • asan: 2
• linux1804-64-asan: 2
  • opt: 2

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1665302&startday=2021-01-25&endday=2021-01-31&tree=all

Comment 21

[Dorel Luca [:dluca]]

This bug failed 39 times in the last 7 days. Occurs on linux1804-64, linux1804-64-asan, windows10-64 on asan, opt and debug.

Recent log:
https://treeherder.mozilla.org/logviewer?job_id=328987820&repo=mozilla-central&lineNumber=4033

Julian: Can you please take a look at this bug?

Comment 22

[Intermittent Failures Robot]

40 failures in 3966 pushes (0.01 failures/push) were associated with this bug in the last 7 days.

This is the #25 most frequent failure this week.

** This failure happened more than 30 times this week! Resolving this bug is a high priority. **

** Try to resolve this bug as soon as possible. If unresolved for 2 weeks, the affected test(s) may be disabled. **

Repository breakdown:

• try: 4
• autoland: 33
• mozilla-central: 2
• mozilla-beta: 1

Platform and build breakdown:

• linux1804-64: 38
  • debug: 38
• windows10-64: 2
  • asan: 2

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1665302&startday=2021-02-01&endday=2021-02-07&tree=all

Comment 23

[Julian Descottes [:jdescottes]]

Attachment: Bug 1665302 - [devtools] Wait for span text content in boxmodel tests

Boxmodel spans are rendered with react and might not be updated synchronously.

Comment 24

[Julian Descottes [:jdescottes]]

Not 100% sure but this might be triggered by a delay with react rendering. All the boxmodel tests seem to intermittently fail when asserting the text content of spans rendered with React.

Trying a patch that replaces the synchronous asserts with a helper based on waitUntil. We'll see if it fixes it.
Try at https://treeherder.mozilla.org/jobs?repo=try&revision=b4ec4f9b443277dc042983caba15e9e5b9aa9c1a&test_paths=devtools%2Fclient%2Finspector%2Fboxmodel%2Ftest

Comment 25

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/autoland/rev/30a2d6eb61cb
[devtools] Wait for span text content in boxmodel tests r=nchevobbe

Comment 26

[Andreea Pavel [:apavel]]

https://hg.mozilla.org/mozilla-central/rev/30a2d6eb61cb

Comment 27

[Intermittent Failures Robot]

18 failures in 4322 pushes (0.004 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 13
• try: 2
• mozilla-central: 3

Platform and build breakdown:

• linux1804-64: 14
  • debug: 14
• windows10-64: 2
  • asan: 2
• linux1804-64-asan: 2
  • opt: 2

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1665302&startday=2021-02-08&endday=2021-02-14&tree=all

Comment 28

[Julian Descottes [:jdescottes]]

No new failure since the patch landed, looks like this was indeed an issue about tests not waiting for React rendering.