1786427 - Intermittent browser/components/urlbar/tests/browser/browser_quickactions.js | single tracking bug

Status: RESOLVED FIXED

(Firefox :: Address Bar, defect, P5)

Description

[Treeherder Bug Filer]

Filed by: mlaza [at] mozilla.com
Parsed log: https://treeherder.mozilla.org/logviewer?job_id=388126986&repo=autoland
Full log: https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/ZHGp9fyVSXCf1-klaT9x1w/runs/0/artifacts/public/logs/live_backing.log
Reftest URL: https://hg.mozilla.org/mozilla-central/raw-file/tip/layout/tools/reftest/reftest-analyzer.xhtml#logurl=https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/ZHGp9fyVSXCf1-klaT9x1w/runs/0/artifacts/public/logs/live_backing.log&only_show_unexpected=1

---

[task 2022-08-22T21:35:18.761Z] 21:35:18     INFO - TEST-PASS | browser/components/urlbar/tests/browser/browser_quickactions.js | The command "themes" passed completed its test - true == true - 
[task 2022-08-22T21:35:18.761Z] 21:35:18     INFO - Leaving test bound test_pages
[task 2022-08-22T21:35:18.761Z] 21:35:18     INFO - Buffered messages finished
[task 2022-08-22T21:35:18.761Z] 21:35:18     INFO - TEST-UNEXPECTED-FAIL | browser/components/urlbar/tests/browser/browser_quickactions.js | This test exceeded the timeout threshold. It should be rewritten or split up. If that's not possible, use requestLongerTimeout(N), but only as a last resort. - 
[task 2022-08-22T21:35:18.762Z] 21:35:18     INFO - GECKO(1540) | MEMORY STAT vsizeMaxContiguous not supported in this build configuration.
[task 2022-08-22T21:35:18.762Z] 21:35:18     INFO - GECKO(1540) | MEMORY STAT | vsize 16012MB | residentFast 318MB | heapAllocated 149MB
[task 2022-08-22T21:35:18.763Z] 21:35:18     INFO - TEST-OK | browser/components/urlbar/tests/browser/browser_quickactions.js | took 46260ms

Comment 1

[BugBot [:suhaib / :marco/ :calixte]]

:daleharvey, since you are the author of the regressor, bug 1783152, could you take a look?
For more information, please visit auto_nag documentation.

Comment 2

[BugBot [:suhaib / :marco/ :calixte]]

Set release status flags based on info from the regressing bug 1783152

Comment 3

[Intermittent Failures Robot]

16 failures in 612 pushes (0.026 failures/push) were associated with this bug yesterday.

Repository breakdown:

• autoland: 14
• mozilla-central: 2

Platform and build breakdown:

• macosx1015-64-qr: 6
  • opt: 3
  • debug: 3
• macosx1015-64-shippable-qr: 2
  • opt: 2
• windows10-64-2004-shippable-qr: 1
  • opt: 1
• linux1804-64-qr: 2
  • debug: 1
  • opt: 1
• linux1804-64-asan-qr: 1
  • opt: 1
• windows10-64-2004-qr: 2
  • opt: 2
• windows10-32-2004-qr: 2
  • opt: 2

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1786427&startday=2022-08-25&endday=2022-08-25&tree=all

Comment 4

[Intermittent Failures Robot]

32 failures in 3293 pushes (0.01 failures/push) were associated with this bug in the last 7 days.

This is the #33 most frequent failure this week.

** This failure happened more than 30 times this week! Resolving this bug is a high priority. **

** Try to resolve this bug as soon as possible. If unresolved for 2 weeks, the affected test(s) may be disabled. **

Repository breakdown:

• autoland: 27
• mozilla-central: 4
• try: 1

Platform and build breakdown:

• macosx1015-64-qr: 15
  • opt: 8
  • debug: 7
• windows10-64-2004-qr: 4
  • opt: 4
• macosx1015-64-shippable-qr: 4
  • opt: 4
• windows10-64-2004-shippable-qr: 3
  • opt: 3
• linux1804-64-qr: 2
  • debug: 1
  • opt: 1
• windows10-32-2004-qr: 3
  • opt: 3
• linux1804-64-asan-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1786427&startday=2022-08-22&endday=2022-08-28&tree=all

Comment 5

[Intermittent Failures Robot]

33 failures in 3537 pushes (0.009 failures/push) were associated with this bug in the last 7 days.

This is the #44 most frequent failure this week.

** This failure happened more than 30 times this week! Resolving this bug is a high priority. **

** Try to resolve this bug as soon as possible. If unresolved for 2 weeks, the affected test(s) may be disabled. **

Repository breakdown:

• try: 3
• autoland: 26
• mozilla-central: 4

Platform and build breakdown:

• windows10-64-2004-qr: 3
  • opt: 3
• macosx1015-64-qr: 17
  • debug: 10
  • opt: 7
• macosx1015-64-shippable-qr: 4
  • opt: 4
• windows7-32-shippable-qr: 1
  • opt: 1
• windows10-64-2004-shippable-qr: 6
  • opt: 6
• windows10-64-2004-devedition-qr: 1
  • opt: 1
• windows10-32-2004-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1786427&startday=2022-08-29&endday=2022-09-04&tree=all

Comment 6

[Intermittent Failures Robot]

47 failures in 3616 pushes (0.013 failures/push) were associated with this bug in the last 7 days.

This is the #21 most frequent failure this week.

** This failure happened more than 30 times this week! Resolving this bug is a high priority. **

** Try to resolve this bug as soon as possible. If unresolved for 2 weeks, the affected test(s) may be disabled. **

Repository breakdown:

• autoland: 36
• try: 8
• mozilla-central: 3

Platform and build breakdown:

• macosx1015-64-qr: 21
  • opt: 10
  • debug: 11
• macosx1015-64-shippable-qr: 11
  • opt: 11
• linux1804-64-qr: 1
  • opt: 1
• windows10-64-2004-qr: 5
  • opt: 5
• windows10-64-2004-shippable-qr: 4
  • opt: 4
• windows10-32-2004-qr: 2
  • opt: 2
• windows10-64-2004-devedition-qr: 3
  • opt: 3

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1786427&startday=2022-09-05&endday=2022-09-11&tree=all

Comment 7

[Marian-Vasile Laza]

There have been 52 total failures in the last 7 days, recent failure log.
Affected platforms are:

• macosx1015-64-qr
• macosx1015-64-shippable-qr
• windows10-32-2004-qr
• windows10-64-2004-shippable-qr

Comment 8

[Andreea Pavel [:apavel]]

Attachment: Bug 1786427 - disable browser_quickactions.js on mac and win opt r?#intermittent-reviewers

Comment 9

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/autoland/rev/81fb44f0231e
disable browser_quickactions.js on mac and win opt r=intermittent-reviewers,jmaher DONTBUILD

Comment 10

[Andreea Pavel [:apavel]]

https://hg.mozilla.org/mozilla-central/rev/81fb44f0231e

Comment 11

[Intermittent Failures Robot]

30 failures in 3023 pushes (0.01 failures/push) were associated with this bug in the last 7 days.

This is the #24 most frequent failure this week.

** This failure happened more than 30 times this week! Resolving this bug is a high priority. **

** Try to resolve this bug as soon as possible. If unresolved for 2 weeks, the affected test(s) may be disabled. **

Repository breakdown:

• autoland: 24
• mozilla-central: 4
• try: 2

Platform and build breakdown:

• windows10-64-2004-qr: 3
  • opt: 3
• macosx1015-64-qr: 16
  • opt: 10
  • debug: 6
• macosx1015-64-shippable-qr: 5
  • opt: 5
• windows10-64-2004-shippable-qr: 4
  • opt: 4
• windows10-64-2004-devedition-qr: 1
  • opt: 1
• windows10-32-2004-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1786427&startday=2022-09-12&endday=2022-09-18&tree=all

Comment 12

[Intermittent Failures Robot]

10 failures in 2909 pushes (0.003 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 8
• try: 1
• mozilla-beta: 1

Platform and build breakdown:

• macosx1015-64-qr: 10
  • debug: 10

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1786427&startday=2022-09-19&endday=2022-09-25&tree=all

Comment 13

[Dale Harvey (:daleharvey)]

Hey Daisuke, it looks like these failres are from opening the devtools, I can / am taking a look but pinging in case you already know whats up. Cheers

Comment 14

[Daisuke Akatsuka (:daisuke)]

Hi Dale!

I investigated which tests take time in my local.

• basic:174 ms
• test_label_command:77
• enter_search_mode_button:157
• enter_search_mode_key:105
• test_disabled:83
• test_screenshot_disabled:87
• match_in_phrase:76
• test_screenshot:138
• test_other_search_mode:53
• test_no_quickactions_suggestions:163
• test_quickactions_disabled:175
• test_pages:4526
• test_about_pages_refocused:7356
• test_about_addons_pages_refocused:2923
• test_inspector:2252
• test_viewsource:597
• test_refresh:140
• test_clear:134
• test_update:150
• test_show_in_zero_prefix:116
• test_whitespace:213

As the above results, it seems that the following tests take time especially.

• test_about_pages_refocused: 7356,
• test_about_addons_pages_refocused:2923,
• test_inspector:2252

It seems that it take time for tests opening new tab. (test_inspector is by another reason though)
If we can reuse tabs for above tests, it might be able to reduce the time.
If you don’t mind, may I take a look at this one?

Comment 15

[Dale Harvey (:daleharvey)]

Sure feel free to assign yourself. The test file is already getting quite long so it would probably be a good idea to split it out into seperate files if the problem is the runtime of the tests and the alternative is doing something complicated

Comment 16

[Daisuke Akatsuka (:daisuke)]

Okay. I will extract the tests for refocusing to a separate file.

Comment 17

[Daisuke Akatsuka (:daisuke)]

Attachment: Bug 1786427: Extract tab refocus tests to a separate file.

Comment 18

[Daisuke Akatsuka (:daisuke)]

Attachment: Bug 1786427: Extract inspector tests to a separate file.

Depends on D158181

Comment 19

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/autoland/rev/57574d06d256
Extract tab refocus tests to a separate file. r=daleharvey
https://hg.mozilla.org/integration/autoland/rev/c01a94293432
Extract inspector tests to a separate file. r=daleharvey

Comment 20

[Andreea Pavel [:apavel]]

https://hg.mozilla.org/mozilla-central/rev/57574d06d256
https://hg.mozilla.org/mozilla-central/rev/c01a94293432

Comment 21

[Intermittent Failures Robot]

9 failures in 2041 pushes (0.004 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 2
• autoland: 5
• try: 1
• mozilla-beta: 1

Platform and build breakdown:

• macosx1015-64-qr: 9
  • debug: 9

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1786427&startday=2022-09-26&endday=2022-10-02&tree=all

Comment 22

[Intermittent Failures Robot]

1 failures in 2449 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-beta: 1

Platform and build breakdown:

• macosx1015-64-qr: 1
  • debug: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1786427&startday=2022-10-03&endday=2022-10-09&tree=all