1739215 - Perma [tier2] TEST-UNEXPECTED-PASS | devtools/client/webconsole/test/browser/browser_webconsole_location_styleeditor_link.js | We expect at least one assertion to fail because this test file is marked as fail-if in the manifest. -

Status: RESOLVED FIXED

(DevTools :: Console, defect, P5)

Description

[Treeherder Bug Filer]

Filed by: abutkovits [at] mozilla.com
Parsed log: https://treeherder.mozilla.org/logviewer?job_id=356914926&repo=autoland
Full log: https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/aPSBZeWmSiiIVSWvpeHwtg/runs/0/artifacts/public/logs/live_backing.log

---

[task 2021-11-03T20:22:25.143Z] 20:22:25     INFO - TEST-PASS | devtools/client/webconsole/test/browser/browser_webconsole_location_styleeditor_link.js | correct column is selected - 
[task 2021-11-03T20:22:25.145Z] 20:22:25     INFO - TEST-PASS | devtools/client/webconsole/test/browser/browser_webconsole_location_styleeditor_link.js | correct stylesheet is selected in the editor - 
[task 2021-11-03T20:22:25.145Z] 20:22:25     INFO - Leaving test bound 
[task 2021-11-03T20:22:25.146Z] 20:22:25     INFO - Removing tab.
[task 2021-11-03T20:22:25.147Z] 20:22:25     INFO - Waiting for event: 'TabClose' on [object XULElement].
[task 2021-11-03T20:22:25.148Z] 20:22:25     INFO - Got event: 'TabClose' on [object XULElement].
[task 2021-11-03T20:22:25.149Z] 20:22:25     INFO - Tab removed and finished closing
[task 2021-11-03T20:22:25.150Z] 20:22:25     INFO - Buffered messages logged at 20:22:25
[task 2021-11-03T20:22:25.151Z] 20:22:25     INFO - TEST-PASS | devtools/client/webconsole/test/browser/browser_webconsole_location_styleeditor_link.js | The main process DevToolsServer has no pending connection when the test ends - 
[task 2021-11-03T20:22:25.152Z] 20:22:25     INFO - Buffered messages finished
[task 2021-11-03T20:22:25.154Z] 20:22:25     INFO - TEST-UNEXPECTED-PASS | devtools/client/webconsole/test/browser/browser_webconsole_location_styleeditor_link.js | We expect at least one assertion to fail because this test file is marked as fail-if in the manifest. - 
[task 2021-11-03T20:22:25.154Z] 20:22:25     INFO - TEST-INFO | expected FAIL
[task 2021-11-03T20:22:25.155Z] 20:22:25     INFO - GECKO(1539) | MEMORY STAT | vsize 4341MB | residentFast 750MB | heapAllocated 356MB
[task 2021-11-03T20:22:25.156Z] 20:22:25     INFO - TEST-OK | devtools/client/webconsole/test/browser/browser_webconsole_location_styleeditor_link.js | took 3128ms
[task 2021-11-03T20:22:25.157Z] 20:22:25     INFO - checking window state

Comment 1

[BugBot [:suhaib / :marco/ :calixte]]

Set release status flags based on info from the regressing bug 1738124

Comment 2

[Intermittent Failures Robot]

25 failures in 643 pushes (0.039 failures/push) were associated with this bug yesterday.

Repository breakdown:

• autoland: 15
• mozilla-central: 4
• try: 6

Platform and build breakdown:

• linux1804-64-qr: 13
  • opt: 12
  • debug: 1
• linux1804-64-shippable-qr: 11
  • opt: 11
• macosx1015-64-qr: 1
  • debug: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1739215&startday=2021-11-04&endday=2021-11-04&tree=all

Comment 3

[Intermittent Failures Robot]

18 failures in 510 pushes (0.035 failures/push) were associated with this bug yesterday.

Repository breakdown:

• autoland: 14
• try: 1
• mozilla-central: 3

Platform and build breakdown:

• linux1804-64-qr: 9
  • opt: 9
• linux1804-64-shippable-qr: 9
  • opt: 9

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1739215&startday=2021-11-05&endday=2021-11-05&tree=all

Comment 4

[Cosmin Sabou [:CosminS]]

Nicolas, could you have a look over this perma UNEXPECTED-PASS that started with Bug 1738124?
It's linux1804-64-qr/shippable-qr only. Thank you.

Comment 5

[Intermittent Failures Robot]

81 failures in 3030 pushes (0.027 failures/push) were associated with this bug in the last 7 days.

This is the #8 most frequent failure this week.

** This failure happened more than 75 times this week! Resolving this bug is a very high priority. **

** Try to resolve this bug as soon as possible. If unresolved for 1 week, the affected test(s) may be disabled. **

Repository breakdown:

• autoland: 62
• mozilla-central: 12
• try: 7

Platform and build breakdown:

• linux1804-64-qr: 45
  • opt: 44
  • debug: 1
• linux1804-64-shippable-qr: 35
  • opt: 35
• macosx1015-64-qr: 1
  • debug: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1739215&startday=2021-11-01&endday=2021-11-07&tree=all

Comment 6

[Nicolas Chevobbe [:nchevobbe]]

I think the test isn't failing the a11y task anymore because I switched to Element.click in the test (instead of sendMouseEvent, see https://hg.mozilla.org/mozilla-central/rev/78a47686ea96#l3.16), and the task does not run the assertion for .click calls.
I'll revert that

Comment 7

[Nicolas Chevobbe [:nchevobbe]]

Attachment: Bug 1739215 - [devtools] Revert `click` to `sendMouseEvent` in browser_webconsole_location_styleeditor_link.js. r=bomsy.

The test is tagged as fail-if= a11y_checks, but as patch for Bug 1738124 switched
to Element.click, we don't get the expected failure anymore (since the a11y_check
task does not perform assertion on element.click).
Let's revert to the original behavior so we can still see that the test need
some a11y work.

Comment 8

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/autoland/rev/3d3edc0f6450
[devtools] Revert `click` to `sendMouseEvent` in  browser_webconsole_location_styleeditor_link.js. r=bomsy.

Comment 9

[Narcis Beleuzu [:NarcisB]]

https://hg.mozilla.org/mozilla-central/rev/3d3edc0f6450

Comment 10

[Intermittent Failures Robot]

20 failures in 566 pushes (0.035 failures/push) were associated with this bug yesterday.

Repository breakdown:

• mozilla-central: 2
• autoland: 6
• try: 12

Platform and build breakdown:

• linux1804-64-shippable-qr: 4
  • opt: 4
• linux1804-64-qr: 7
  • opt: 6
  • debug: 1
• macosx1015-64-qr: 2
  • debug: 1
  • opt: 1
• windows10-64-2004-qr: 2
  • debug: 1
  • opt: 1
• windows10-64-2004-asan-qr: 1
  • opt: 1
• linux1804-64-asan-qr: 1
  • opt: 1
• linux1804-64-devedition-qr: 1
  • opt: 1
• macosx1015-64-devedition-qr: 1
  • opt: 1
• windows10-64-2004-devedition-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1739215&startday=2021-11-08&endday=2021-11-08&tree=all

Comment 11

[Intermittent Failures Robot]

21 failures in 2723 pushes (0.008 failures/push) were associated with this bug in the last 7 days.

This is the #47 most frequent failure this week.

Repository breakdown:

• mozilla-central: 2
• autoland: 6
• try: 13

Platform and build breakdown:

• linux1804-64-shippable-qr: 4
  • opt: 4
• linux1804-64-qr: 8
  • opt: 7
  • debug: 1
• macosx1015-64-qr: 2
  • debug: 1
  • opt: 1
• windows10-64-2004-qr: 2
  • debug: 1
  • opt: 1
• windows10-64-2004-asan-qr: 1
  • opt: 1
• linux1804-64-asan-qr: 1
  • opt: 1
• linux1804-64-devedition-qr: 1
  • opt: 1
• macosx1015-64-devedition-qr: 1
  • opt: 1
• windows10-64-2004-devedition-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1739215&startday=2021-11-08&endday=2021-11-14&tree=all