1831974 - Intermittent browser/components/newtab/test/browser/browser_aboutwelcome_multistage_mr.js | single tracking bug

Status: RESOLVED FIXED

(Firefox :: New Tab Page, defect, P5)

Description

[Treeherder Bug Filer]

Filed by: imoraru [at] mozilla.com
Parsed log: https://treeherder.mozilla.org/logviewer?job_id=414966444&repo=autoland
Full log: https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/fmK281wuR3uvcKaPUnB49A/runs/0/artifacts/public/logs/live_backing.log
Reftest URL: https://hg.mozilla.org/mozilla-central/raw-file/tip/layout/tools/reftest/reftest-analyzer.xhtml#logurl=https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/fmK281wuR3uvcKaPUnB49A/runs/0/artifacts/public/logs/live_backing.log&only_show_unexpected=1

---

[task 2023-05-08T20:50:12.047Z] 20:50:12     INFO - TEST-PASS | browser/components/newtab/test/browser/browser_aboutwelcome_multistage_mr.js | Found the <panel-list>. - {} == true - 
[task 2023-05-08T20:50:12.047Z] 20:50:12     INFO - Buffered messages finished
[task 2023-05-08T20:50:12.048Z] 20:50:12     INFO - TEST-UNEXPECTED-FAIL | browser/components/newtab/test/browser/browser_aboutwelcome_multistage_mr.js | Panel should be tightly anchored to the bottom of the button shadow node. - -413.9666748046875 == 0 - got -413.9666748046875, expected 0 (operator ==)
[task 2023-05-08T20:50:12.048Z] 20:50:12     INFO - Stack trace:
[task 2023-05-08T20:50:12.048Z] 20:50:12     INFO - @chrome://mochitests/content/browser/browser/components/newtab/test/browser/browser_aboutwelcome_multistage_mr.js:535:14
[task 2023-05-08T20:50:12.049Z] 20:50:12     INFO - async*execute@resource://specialpowers/SpecialPowersSandbox.sys.mjs:139:12
[task 2023-05-08T20:50:12.049Z] 20:50:12     INFO - _spawnTask@resource://specialpowers/SpecialPowersChild.sys.mjs:1648:15
[task 2023-05-08T20:50:12.049Z] 20:50:12     INFO - receiveMessage@resource://specialpowers/SpecialPowersChild.sys.mjs:261:21
[task 2023-05-08T20:50:12.049Z] 20:50:12     INFO - JSActor query*receiveMessage@resource://specialpowers/SpecialPowersParent.sys.mjs:1388:14
[task 2023-05-08T20:50:12.049Z] 20:50:12     INFO - JSActor query*spawn@resource://specialpowers/SpecialPowersChild.sys.mjs:1579:17
[task 2023-05-08T20:50:12.049Z] 20:50:12     INFO - test_aboutwelcome_embedded_migration@chrome://mochitests/content/browser/browser/components/newtab/test/browser/browser_aboutwelcome_multistage_mr.js:478:23
[task 2023-05-08T20:50:12.049Z] 20:50:12     INFO - async*handleTask@chrome://mochikit/content/browser-test.js:1133:26
[task 2023-05-08T20:50:12.049Z] 20:50:12     INFO - _runTaskBasedTest@chrome://mochikit/content/browser-test.js:1205:18
[task 2023-05-08T20:50:12.049Z] 20:50:12     INFO - async*Tester_execTest@chrome://mochikit/content/browser-test.js:1347:14
[task 2023-05-08T20:50:12.049Z] 20:50:12     INFO - nextTest/<@chrome://mochikit/content/browser-test.js:1116:14
[task 2023-05-08T20:50:12.049Z] 20:50:12     INFO - SimpleTest.waitForFocus/<@chrome://mochikit/content/tests/SimpleTest/SimpleTest.js:1056:13
[task 2023-05-08T20:50:12.050Z] 20:50:12     INFO - TEST-PASS | browser/components/newtab/test/browser/browser_aboutwelcome_multistage_mr.js | Should have sent telemetry for clicking the 'Import' button. - true == true - 
[task 2023-05-08T20:50:12.050Z] 20:50:12     INFO - GECKO(1594) | console.debug: AboutWelcomeParent:
[task 2023-05-08T20:50:12.050Z] 20:50:12     INFO - GECKO(1594) |   Received content event: AWPage:TELEMETRY_EVENT
[task 2023-05-08T20:50:12.967Z] 20:50:12     INFO - GECKO(1594) | console.debug: AboutWelcomeParent:
[task 2023-05-08T20:50:12.967Z] 20:50:12     INFO - GECKO(1594) |   Received content event: AWPage:EVALUATE_SCREEN_TARGETING
[task 2023-05-08T20:50:12.976Z] 20:50:12     INFO - GECKO(1594) | console.debug: AboutWelcomeParent:
[task 2023-05-08T20:50:12.976Z] 20:50:12     INFO - GECKO(1594) |   Received content event: AWPage:TELEMETRY_EVENT
[task 2023-05-08T20:50:12.977Z] 20:50:12     INFO - GECKO(1594) | console.debug: AboutWelcomeParent:
[task 2023-05-08T20:50:12.979Z] 20:50:12     INFO - GECKO(1594) |   Received content event: AWPage:ADD_SCREEN_IMPRESSION
[task 2023-05-08T20:50:13.023Z] 20:50:13     INFO - TEST-PASS | browser/components/newtab/test/browser/browser_aboutwelcome_multistage_mr.js | Should have sent telemetry for clicking the 'Continue' button. - true == true - 
[task 2023-05-08T20:50:13.236Z] 20:50:13     INFO - GECKO(1594) | console.debug: AboutWelcomeParent:
[task 2023-05-08T20:50:13.236Z] 20:50:13     INFO - GECKO(1594) |   Terminate reason is welcome-tab-closed
[task 2023-05-08T20:50:13.269Z] 20:50:13     INFO - Leaving test bound test_aboutwelcome_embedded_migration
[task 2023-05-08T20:50:13.828Z] 20:50:13     INFO - GECKO(1594) | MEMORY STAT vsizeMaxContiguous not supported in this build configuration.
[task 2023-05-08T20:50:13.829Z] 20:50:13     INFO - GECKO(1594) | MEMORY STAT | vsize 7877MB | residentFast 310MB | heapAllocated 142MB
[task 2023-05-08T20:50:13.829Z] 20:50:13     INFO - TEST-OK | browser/components/newtab/test/browser/browser_aboutwelcome_multistage_mr.js | took 18573ms
[task 2023-05-08T20:50:13.903Z] 20:50:13     INFO - checking window state
[task 2023-05-08T20:50:14.126Z] 20:50:14     INFO - GECKO(1594) | Completed ShutdownLeaks collections in process 1594
[task 2023-05-08T20:50:14.127Z] 20:50:14     INFO - TEST-START | Shutdown
[task 2023-05-08T20:50:14.127Z] 20:50:14     INFO - Browser Chrome Test Summary
[task 2023-05-08T20:50:14.128Z] 20:50:14     INFO - Passed:  27
[task 2023-05-08T20:50:14.128Z] 20:50:14     INFO - Failed:  1
[task 2023-05-08T20:50:14.129Z] 20:50:14     INFO - Todo:    0
[task 2023-05-08T20:50:14.129Z] 20:50:14     INFO - Mode:    e10s
[task 2023-05-08T20:50:14.130Z] 20:50:14     INFO - *** End BrowserChrome Test Results ***

Comment 1

[BugBot [:suhaib / :marco/ :calixte]]

:aminomancer, since you are the author of the regressor, bug 1829043, could you take a look?

For more information, please visit BugBot documentation.

Comment 2

[Shane Hughes [:aminomancer]]

Negin is fixing this failure in her patch for bug 1829039. It shouldn't be affected by bug 1829043, which just adds telemetry

Comment 3

[Shane Hughes [:aminomancer]]

We still haven't found a fix for this failure so I'll reopen it until we have a patch for it

Comment 4

[BugBot [:suhaib / :marco/ :calixte]]

Set release status flags based on info from the regressing bug 1829043

Comment 5

[Intermittent Failures Robot]

2 failures in 3946 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 2

Platform and build breakdown:

• macosx1015-64-qr: 2
  • debug: 2

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1831974&startday=2023-05-22&endday=2023-05-28&tree=all

Comment 6

[Intermittent Failures Robot]

3 failures in 3471 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 3

Platform and build breakdown:

• linux1804-64-tsan-qr: 1
  • opt: 1
• macosx1015-64-qr: 2
  • debug: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1831974&startday=2023-05-29&endday=2023-06-04&tree=all

Comment 7

[Serban Stanca [:SerbanS]]

This is failing quite frequent. It looks like the failure rate has increased significant from two days now, as it can be seen in orange factor. Backfills and retriggers were not so conclusive but my guess will be Bug 1839727.

Hello Mike! Could you please take a look at this? Could this be related with your changes in browser_aboutwelcome_multistage_mr.js?

Thank you!

Comment 8

[Intermittent Failures Robot]

44 failures in 815 pushes (0.054 failures/push) were associated with this bug yesterday.

Repository breakdown:

• autoland: 43
• mozilla-central: 1

Platform and build breakdown:

• linux1804-64-qr: 35
  • opt: 35
• linux1804-64-shippable-qr: 6
  • opt: 6
• macosx1015-64-qr: 1
  • opt: 1
• windows7-32-qr: 1
  • opt: 1
• linux1804-64-asan-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1831974&startday=2023-06-28&endday=2023-06-28&tree=all

Comment 9

[Mike Conley (:mconley) (:⚙️)]

Looking.

Comment 10

[Intermittent Failures Robot]

35 failures in 668 pushes (0.052 failures/push) were associated with this bug yesterday.

Repository breakdown:

• autoland: 23
• mozilla-central: 7
• try: 5

Platform and build breakdown:

• linux1804-64-qr: 20
  • opt: 20
• linux1804-64-shippable-qr: 13
  • opt: 13
• linux1804-64-devedition-qr: 1
  • opt: 1
• linux1804-64-asan-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1831974&startday=2023-06-29&endday=2023-06-29&tree=all

Comment 11

[Intermittent Failures Robot]

16 failures in 390 pushes (0.041 failures/push) were associated with this bug yesterday.

Repository breakdown:

• autoland: 8
• try: 3
• mozilla-central: 5

Platform and build breakdown:

• linux1804-64-qr: 6
  • opt: 6
• linux1804-64-shippable-qr: 9
  • opt: 9
• linux1804-64-asan-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1831974&startday=2023-06-30&endday=2023-06-30&tree=all

Comment 12

[Noemi Erli[:noemi_erli]]

In the past week, we had 114 occurrences of this failure:

• 6 x linux1804-64-asan-qr opt
• 68 x linux1804-64-qr opt
• 36 x linux1804-64-shippable-qr opt
• 2 x macosx1015-64-qr opt and debug
• 1 x windows7-32-qr opt
• 1 x linux1804-64-devedition-qr opt
  Recent failure log: https://treeherder.mozilla.org/logviewer?job_id=421299561&repo=try&lineNumber=8549

[task 2023-07-02T12:20:33.220Z] 12:20:33     INFO - Buffered messages finished
[task 2023-07-02T12:20:33.220Z] 12:20:33     INFO - TEST-UNEXPECTED-FAIL | browser/components/newtab/test/browser/browser_aboutwelcome_multistage_mr.js | Test timed out - 
[task 2023-07-02T12:20:33.227Z] 12:20:33     INFO - GECKO(8313) | MEMORY STAT | vsize 3173MB | residentFast 412MB | heapAllocated 218MB
[task 2023-07-02T12:20:33.227Z] 12:20:33     INFO - TEST-OK | browser/components/newtab/test/browser/browser_aboutwelcome_multistage_mr.js | took 47513ms
[task 2023-07-02T12:20:33.228Z] 12:20:33     INFO - Not taking screenshot here: see the one that was previously logged
[task 2023-07-02T12:20:33.228Z] 12:20:33     INFO - TEST-UNEXPECTED-FAIL | browser/components/newtab/test/browser/browser_aboutwelcome_multistage_mr.js | Found a tab after previous test timed out: about:welcome - 
[task 2023-07-02T12:20:33.270Z] 12:20:33     INFO - checking window state
[task 2023-07-02T12:20:33.287Z] 12:20:33     INFO - GECKO(8313) | console.debug: AboutWelcomeParent:
[task 2023-07-02T12:20:33.291Z] 12:20:33     INFO - GECKO(8313) |   Terminate reason is welcome-tab-closed

Comment 13

[Intermittent Failures Robot]

116 failures in 3594 pushes (0.032 failures/push) were associated with this bug in the last 7 days.

This is the #1 most frequent failure this week.

** This failure happened more than 75 times this week! Resolving this bug is a very high priority. **

** Try to resolve this bug as soon as possible. If unresolved for 1 week, the affected test(s) may be disabled. **

Repository breakdown:

• autoland: 91
• mozilla-central: 16
• try: 9

Platform and build breakdown:

• linux1804-64-qr: 69
  • opt: 69
• linux1804-64-asan-qr: 6
  • opt: 6
• linux1804-64-shippable-qr: 37
  • opt: 37
• macosx1015-64-qr: 2
  • opt: 1
  • debug: 1
• windows7-32-qr: 1
  • opt: 1
• linux1804-64-devedition-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1831974&startday=2023-06-26&endday=2023-07-02&tree=all

Comment 14

[Intermittent Failures Robot]

17 failures in 222 pushes (0.077 failures/push) were associated with this bug yesterday.

Repository breakdown:

• try: 2
• autoland: 11
• mozilla-central: 4

Platform and build breakdown:

• macosx1015-64-qr: 1
  • debug: 1
• linux1804-64-qr: 8
  • opt: 8
• linux1804-64-shippable-qr: 7
  • opt: 7
• linux1804-64-devedition-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1831974&startday=2023-07-03&endday=2023-07-03&tree=all

Comment 15

[Mike Conley (:mconley) (:⚙️)]

Attachment: Bug 1831974 - Wait for history to update with back/forward state before continuing in browser_aboutwelcome_multistage_mr test. r?negin!

Comment 16

[Intermittent Failures Robot]

28 failures in 523 pushes (0.054 failures/push) were associated with this bug yesterday.

** This test has failed more than 150 times in the last 21 days. It should be disabled until it can be fixed. **

Repository breakdown:

• autoland: 17
• mozilla-beta: 4
• mozilla-central: 6
• try: 1

Platform and build breakdown:

• linux1804-64-shippable-qr: 13
  • opt: 13
• linux1804-64-qr: 11
  • opt: 11
• linux1804-64-asan-qr: 1
  • opt: 1
• linux1804-64-devedition-qr: 3
  • opt: 3

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1831974&startday=2023-07-04&endday=2023-07-04&tree=all

Comment 17

[Intermittent Failures Robot]

37 failures in 590 pushes (0.063 failures/push) were associated with this bug yesterday.

Repository breakdown:

• autoland: 26
• mozilla-central: 8
• try: 2
• mozilla-beta: 1

Platform and build breakdown:

• linux1804-64-asan-qr: 4
  • opt: 4
• linux1804-64-qr: 18
  • opt: 18
• linux1804-64-shippable-qr: 13
  • opt: 13
• linux1804-64-devedition-qr: 2
  • opt: 2

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1831974&startday=2023-07-05&endday=2023-07-05&tree=all

Comment 18

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/autoland/rev/63978e9fd6f4
Wait for history to update with back/forward state before continuing in browser_aboutwelcome_multistage_mr test. r=negin

Comment 19

[Intermittent Failures Robot]

34 failures in 704 pushes (0.048 failures/push) were associated with this bug yesterday.

Repository breakdown:

• autoland: 21
• mozilla-central: 3
• try: 4
• mozilla-beta: 6

Platform and build breakdown:

• linux1804-64-qr: 16
  • opt: 16
• linux1804-64-shippable-qr: 13
  • opt: 13
• linux1804-64-devedition-qr: 4
  • opt: 4
• macosx1015-64-shippable-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1831974&startday=2023-07-06&endday=2023-07-06&tree=all

Comment 20

[Noemi Erli[:noemi_erli]]

https://hg.mozilla.org/mozilla-central/rev/63978e9fd6f4

Comment 21

[BugBot [:suhaib / :marco/ :calixte]]

Since nightly and release are affected, beta will likely be affected too.
For more information, please visit BugBot documentation.

Comment 22

[BugBot [:suhaib / :marco/ :calixte]]

The patch landed in nightly and beta is affected.
:mconley, is this bug important enough to require an uplift?

• If yes, please nominate the patch for beta approval.
• If no, please set status-firefox116 to wontfix.

For more information, please visit BugBot documentation.

Comment 23

[Mike Conley (:mconley) (:⚙️)]

Comment on attachment 9342241 [details]
Bug 1831974 - Wait for history to update with back/forward state before continuing in browser_aboutwelcome_multistage_mr test. r?negin!

Beta/Release Uplift Approval Request

• User impact if declined: None, but it might make our tree sheriffs sadder if this doesn't land.
• Is this code covered by automated tests?: No
• Has the fix been verified in Nightly?: No
• Needs manual test from QE?: No
• If yes, steps to reproduce:
• List of other uplifts needed: None
• Risk to taking this patch: Low
• Why is the change risky/not risky? (and alternatives if risky): This is a test-only fix for an intermittent test failure.
• String changes made/needed: None.
• Is Android affected?: No

Comment 24

[Dianna Smith [:diannaS]]

Comment on attachment 9342241 [details]
Bug 1831974 - Wait for history to update with back/forward state before continuing in browser_aboutwelcome_multistage_mr test. r?negin!

Approved for 116.0b3

Comment 25

[Pulsebot]

https://hg.mozilla.org/releases/mozilla-beta/rev/c0dd38ad92aa

Comment 26

[Dianna Smith [:diannaS]]

https://hg.mozilla.org/releases/mozilla-beta/rev/c0dd38ad92aa

Comment 27

[Intermittent Failures Robot]

116 failures in 2956 pushes (0.039 failures/push) were associated with this bug in the last 7 days.

This is the #3 most frequent failure this week.

** This failure happened more than 75 times this week! Resolving this bug is a very high priority. **

** Try to resolve this bug as soon as possible. If unresolved for 1 week, the affected test(s) may be disabled. **

Repository breakdown:

• try: 9
• autoland: 75
• mozilla-central: 21
• mozilla-beta: 11

Platform and build breakdown:

• macosx1015-64-qr: 1
  • debug: 1
• linux1804-64-qr: 53
  • opt: 53
• linux1804-64-shippable-qr: 46
  • opt: 46
• linux1804-64-devedition-qr: 10
  • opt: 10
• linux1804-64-asan-qr: 5
  • opt: 5
• macosx1015-64-shippable-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1831974&startday=2023-07-03&endday=2023-07-09&tree=all