1685623 - Perma accessible/tests/browser/mac/browser_app.js | Context menu on link contains fourteen items - Got 15, expected 14

Status: RESOLVED FIXED

(Core :: Disability Access APIs, defect, P5)

Description

[Treeherder Bug Filer]

Filed by: abutkovits [at] mozilla.com
Parsed log: https://treeherder.mozilla.org/logviewer?job_id=326118819&repo=autoland
Full log: https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/a6djPSjsSP-GVs93FxXfHw/runs/0/artifacts/public/logs/live_backing.log
Reftest URL: https://hg.mozilla.org/mozilla-central/raw-file/tip/layout/tools/reftest/reftest-analyzer.xhtml#logurl=https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/a6djPSjsSP-GVs93FxXfHw/runs/0/artifacts/public/logs/live_backing.log&only_show_unexpected=1

---

[task 2021-01-07T22:20:44.570Z] 22:20:44     INFO - TEST-START | accessible/tests/browser/mac/browser_app.js
[task 2021-01-07T22:20:47.625Z] 22:20:47     INFO - TEST-INFO | started process screencapture
[task 2021-01-07T22:20:47.787Z] 22:20:47     INFO - TEST-INFO | screencapture: exit 0
[task 2021-01-07T22:20:47.787Z] 22:20:47     INFO - Buffered messages logged at 22:20:44
[task 2021-01-07T22:20:47.787Z] 22:20:47     INFO - Entering test bound 
[task 2021-01-07T22:20:47.787Z] 22:20:47     INFO - Console message: [JavaScript Error: "The character encoding of the HTML document was not declared. The document will render with garbled text in some browser configurations if the document contains characters from outside the US-ASCII range. The character encoding of the page must be declared in the document or in the transfer protocol." {file: "data:text/html,<title>Two</title>" line: 0}]
[task 2021-01-07T22:20:47.787Z] 22:20:47     INFO - Console message: [JavaScript Error: "The character encoding of the HTML document was not declared. The document will render with garbled text in some browser configurations if the document contains characters from outside the US-ASCII range. The character encoding of the page must be declared in the document or in the transfer protocol." {file: "data:text/html,<title>Three</title>" line: 0}]
[task 2021-01-07T22:20:47.788Z] 22:20:47     INFO - Console message: [JavaScript Error: "The character encoding of the HTML document was not declared. The document will render with garbled text in some browser configurations if the document contains characters from outside the US-ASCII range. The character encoding of the page must be declared in the document or in the transfer protocol." {file: "data:text/html,<title>Four</title>" line: 0}]
[task 2021-01-07T22:20:47.788Z] 22:20:47     INFO - Buffered messages logged at 22:20:45
[task 2021-01-07T22:20:47.789Z] 22:20:47     INFO - TEST-PASS | accessible/tests/browser/mac/browser_app.js | We now have 4 open tabs - 
[task 2021-01-07T22:20:47.790Z] 22:20:47     INFO - TEST-PASS | accessible/tests/browser/mac/browser_app.js | Correct role for tablist - 
[task 2021-01-07T22:20:47.790Z] 22:20:47     INFO - TEST-PASS | accessible/tests/browser/mac/browser_app.js | 4 items in AXTabs - 
[task 2021-01-07T22:20:47.790Z] 22:20:47     INFO - TEST-PASS | accessible/tests/browser/mac/browser_app.js | one selected tab - 
[task 2021-01-07T22:20:47.791Z] 22:20:47     INFO - TEST-PASS | accessible/tests/browser/mac/browser_app.js | Correct role for tab - 
[task 2021-01-07T22:20:47.791Z] 22:20:47     INFO - TEST-PASS | accessible/tests/browser/mac/browser_app.js | Correct subrole for tab - 
[task 2021-01-07T22:20:47.791Z] 22:20:47     INFO - TEST-PASS | accessible/tests/browser/mac/browser_app.js | Correct title for tab - 
[task 2021-01-07T22:20:47.791Z] 22:20:47     INFO - TEST-PASS | accessible/tests/browser/mac/browser_app.js | Correct title for tab - 
[task 2021-01-07T22:20:47.791Z] 22:20:47     INFO - TEST-PASS | accessible/tests/browser/mac/browser_app.js | [u'AXShowMenu', u'AXScrollToVisible', u'AXPress'] - 
[task 2021-01-07T22:20:47.792Z] 22:20:47     INFO - TEST-PASS | accessible/tests/browser/mac/browser_app.js | Has switch action - 
[task 2021-01-07T22:20:47.792Z] 22:20:47     INFO - TEST-PASS | accessible/tests/browser/mac/browser_app.js | one selected tab - 
[task 2021-01-07T22:20:47.797Z] 22:20:47     INFO - TEST-PASS | accessible/tests/browser/mac/browser_app.js | Correct title for tab - 
[task 2021-01-07T22:20:47.797Z] 22:20:47     INFO - Leaving test bound 
[task 2021-01-07T22:20:47.798Z] 22:20:47     INFO - Entering test bound 
[task 2021-01-07T22:20:47.798Z] 22:20:47     INFO - TEST-PASS | accessible/tests/browser/mac/browser_app.js | Root with no popups has 5 children - 
[task 2021-01-07T22:20:47.798Z] 22:20:47     INFO - Buffered messages logged at 22:20:46
[task 2021-01-07T22:20:47.798Z] 22:20:47     INFO - TEST-PASS | accessible/tests/browser/mac/browser_app.js | Root has 6 children - 
[task 2021-01-07T22:20:47.799Z] 22:20:47     INFO - TEST-PASS | accessible/tests/browser/mac/browser_app.js | Root has 5 children - 
[task 2021-01-07T22:20:47.799Z] 22:20:47     INFO - TEST-PASS | accessible/tests/browser/mac/browser_app.js | Root has 6 children - 
[task 2021-01-07T22:20:47.799Z] 22:20:47     INFO - TEST-PASS | accessible/tests/browser/mac/browser_app.js | Root has 5 children - 
[task 2021-01-07T22:20:47.799Z] 22:20:47     INFO - Leaving test bound 
[task 2021-01-07T22:20:47.799Z] 22:20:47     INFO - Entering test bound 
[task 2021-01-07T22:20:47.799Z] 22:20:47     INFO - Buffered messages logged at 22:20:47
[task 2021-01-07T22:20:47.800Z] 22:20:47     INFO - TEST-PASS | accessible/tests/browser/mac/browser_app.js | Location bar has correct value - 
[task 2021-01-07T22:20:47.800Z] 22:20:47     INFO - Leaving test bound 
[task 2021-01-07T22:20:47.800Z] 22:20:47     INFO - Entering test bound 
[task 2021-01-07T22:20:47.800Z] 22:20:47     INFO - Console message: [JavaScript Error: "The character encoding of the HTML document was not declared. The document will render with garbled text in some browser configurations if the document contains characters from outside the US-ASCII range. The character encoding of the page must be declared in the document or in the transfer protocol." {file: "data:text/html,<a id="exampleLink" href="https://example.com">link</a>" line: 0}]
[task 2021-01-07T22:20:47.800Z] 22:20:47     INFO - Buffered messages finished
[task 2021-01-07T22:20:47.800Z] 22:20:47     INFO - TEST-UNEXPECTED-FAIL | accessible/tests/browser/mac/browser_app.js | Context menu on link contains fourteen items - Got 15, expected 14```

Comment 1

[Andreea Pavel [:apavel]]

Tier1 failure log: https://treeherder.mozilla.org/logviewer?job_id=326125475&repo=autoland&lineNumber=1560

Comment 2

[Morgan Reschenberg [:morgan]]

huh.. sometimes the context menu includes the search engine and sometimes it doesn't. I'll look into this ASAP

Comment 3

[Morgan Reschenberg [:morgan]]

Attachment: Bug 1685623: Account for search engine initialization race r?eeejay

Comment 4

[BugBot [:suhaib / :marco/ :calixte]]

Set release status flags based on info from the regressing bug 1681292

Comment 5

[Intermittent Failures Robot]

21 failures in 606 pushes (0.035 failures/push) were associated with this bug yesterday.

Repository breakdown:

• mozilla-central: 9
• autoland: 12

Platform breakdown:

• macosx1014-64-qr: 16
• macosx1014-64-shippable-qr: 5

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1685623&startday=2021-01-08&endday=2021-01-08&tree=all

Comment 6

[Intermittent Failures Robot]

51 failures in 2956 pushes (0.017 failures/push) were associated with this bug in the last 7 days.

This is the #9 most frequent failure this week.

** This failure happened more than 30 times this week! Resolving this bug is a high priority. **

** Try to resolve this bug as soon as possible. If unresolved for 2 weeks, the affected test(s) may be disabled. **

Repository breakdown:

• autoland: 36
• mozilla-central: 15

Platform breakdown:

• macosx1014-64-qr: 43
• macosx1014-64-shippable-qr: 8

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1685623&startday=2021-01-04&endday=2021-01-10&tree=all

Comment 7

[Morgan Reschenberg [:morgan]]

This might be the same issue as bug 1648813, I have a patch there waiting for r+. I'll keep an eye on the failures data here after that lands to see if it fixes anything.

Comment 8

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/autoland/rev/9d385fd24914
Account for search engine initialization race r=eeejay

Comment 9

[Intermittent Failures Robot]

15 failures in 515 pushes (0.029 failures/push) were associated with this bug yesterday.

Repository breakdown:

• autoland: 10
• mozilla-central: 4
• try: 1

Platform breakdown:

• macosx1014-64-qr: 13
• macosx1014-64-shippable-qr: 2

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1685623&startday=2021-01-11&endday=2021-01-11&tree=all

Comment 10

[Narcis Beleuzu [:NarcisB]]

https://hg.mozilla.org/mozilla-central/rev/9d385fd24914

Comment 11

[Intermittent Failures Robot]

18 failures in 3810 pushes (0.005 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 10
• mozilla-central: 6
• try: 2

Platform breakdown:

• macosx1014-64-qr: 15
• macosx1014-64-shippable-qr: 3

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1685623&startday=2021-01-11&endday=2021-01-17&tree=all