Closed Bug 1390007 Opened 7 years ago Closed 7 years ago

Various browser_onboarding browser-chrome tests are going to permafail when Gecko 57 merges to Beta on 2017-09-20

Categories

(Firefox :: New Tab Page, defect, P2)

Product:
Firefox
Component:
New Tab Page
Platform:
Unspecified
All
Type:
defect

Tracking

()

Status:
VERIFIED WORKSFORME
Tracking Flags:
Tracking Status
firefox57 + verified

People

(Reporter: RyanVM, Unassigned)

References

Details

[Tracking Requested - why for this release]: Permafailing test on the next merge day.

Fischer, can you please take a look? Thanks!

https://treeherder.mozilla.org/logviewer.html#?job_id=122811609&repo=try

TEST-UNEXPECTED-FAIL | browser/extensions/onboarding/test/browser/browser_onboarding_tours.js | Uncaught exception - Should open onboarding overlay - timed out after 30 tries.

Screenshot:
https://queue.taskcluster.net/v1/task/TtdVV0GFQjyJ_fT82-t8tg/runs/0/artifacts/public/test_info//mozilla-test-fail-screenshot_CJuQEm.png
Flags: needinfo?(fliu)
Flags: needinfo?(fliu)
Whiteboard: [photon-onboarding]
Flags: needinfo?(fliu)
the first fail is occured during `test_hide_onboarding_tours`, I need to deal with `browser_onboarding_tours.js` while update bug 1366056, so I may handle this in bug 1366056.
Flags: needinfo?(fliu)
See Also: → 1366056
browser_onboarding_select_default_tour.js is also failing now since bug 1383505 landed. I assume it's the same root cause.

https://treeherder.mozilla.org/logviewer.html#?job_id=123439903&repo=try
Summary: browser_onboarding_tours.js is going to permafail when Gecko 57 merges to Beta on 2017-09-20 → browser_onboarding_tours.js and browser_onboarding_select_default_tour.js are going to permafail when Gecko 57 merges to Beta on 2017-09-20
Unfortunately, bug 1366056 appears to have only changed which tests fail.

https://treeherder.mozilla.org/logviewer.html#?job_id=124770520&repo=try
Flags: needinfo?(gasolin)
Summary: browser_onboarding_tours.js and browser_onboarding_select_default_tour.js are going to permafail when Gecko 57 merges to Beta on 2017-09-20 → Various browser_onboarding browser-chrome tests are going to permafail when Gecko 57 merges to Beta on 2017-09-20
will investigate, what's setting need to be done to mimic the beta channel?
Flags: needinfo?(gasolin) → needinfo?(ryanvm)
Priority: -- → P2
Applying https://hg.mozilla.org/try/rev/9701715e2023391ad98b3dbb9632f34c1b0c4347 should be enough to reproduce locally.
Flags: needinfo?(ryanvm)
I think the reason is `activity-stream` is disabled besides nightly and current beta still use default newtab, which has issue  bug 1393564 (Cannot click onboarding icon in old new tab) now. After fix bug 1393564 we should able to run most tests.
Depends on: 1393564
These timeouts are still happening with bug 1393564 fixed.
Flags: needinfo?(gasolin)
Flags: qe-verify-
This appears to have gone away on its own. I haven't attempted to bisect the fix (nor do I plan to), so just resolving this as WFM.
Status: NEW → RESOLVED
Closed: 7 years ago
status-firefox57: affected → fixed
Flags: needinfo?(gasolin)
Resolution: --- → WORKSFORME
Status: RESOLVED → VERIFIED
status-firefox57: fixed → verified
remove whiteboard tag due to its worksforme
Whiteboard: [photon-onboarding]
You need to log in before you can comment on or make changes to this bug.