test failure in accessible/tests/browser/fission/browser_nested_iframe.js on apple silicon
Categories
(Core :: Disability Access APIs, defect)
Tracking
()
People
(Reporter: bhearsum, Assigned: Jamie)
References
Details
Attachments
(1 file)
Last week we turned on tests for Apple Silicon (OSX 11.2.3 on new Apple based hardware). We are using the simplified new test config process:
https://firefox-source-docs.mozilla.org/testing/ci-configs/index.html
As the tests are live, we are now filing bugs to help close the loop and hope to fix any issues over the next 7 weeks. As the process outlines, there are tier-3 jobs running on m-c which run these skipped tests and will expect a failure/timeout/crash- if it doesn't fail, then the job will turn orange.
Here is a link to a job that shows the test failing: https://treeherder.mozilla.org/jobs?repo=mozilla-central&tier=1%2C2%2C3&searchStr=macosx1100&revision=eac40293649628d32911c909219d514bebb8ce63&test_paths=accessible%2Ftests%2Fbrowser%2Ffission&selectedTaskRun=ThbuiqsjQ6OfktSHXf85EQ.0
Assignee | ||
Comment 2•3 years ago
|
||
If I'm reading this correctly, this shows that the test passed, even though it was marked as an expected failure on Apple silicon. Is this just an incorrect annotation in the manifest? If not, are you able to provide a link to a job where this fails?
Updated•3 years ago
|
Reporter | ||
Comment 3•3 years ago
|
||
(In reply to James Teh [:Jamie] from comment #2)
If I'm reading this correctly, this shows that the test passed, even though it was marked as an expected failure on Apple silicon. Is this just an incorrect annotation in the manifest? If not, are you able to provide a link to a job where this fails?
Hi James, sorry for the confusion. The log is from a "failures" job, which runs all the tests that are annotated as failures, and considers them "passing" if they fail. Here's some specific parts of the log that appear to show some failure-related log messages:
[task 2021-09-07T12:44:00.718Z] 12:44:00 INFO - TEST-PASS | accessible/tests/browser/fission/browser_nested_iframe.js | Wrong index in parent of [DOM node id: default-iframe-id, role: internal frame, address: [xpconnect wrapped nsIAccessible]] -
[task 2021-09-07T12:44:00.718Z] 12:44:00 INFO - TEST-PASS | accessible/tests/browser/fission/browser_nested_iframe.js | Wrong next sibling of [DOM node id: default-iframe-id, role: internal frame, address: [xpconnect wrapped nsIAccessible]] -
[task 2021-09-07T12:44:00.718Z] 12:44:00 INFO - TEST-PASS | accessible/tests/browser/fission/browser_nested_iframe.js | Wrong previous sibling of [DOM node id: default-iframe-id, role: internal frame, address: [xpconnect wrapped nsIAccessible]] -
[task 2021-09-07T12:44:00.719Z] 12:44:00 INFO - TEST-PASS | accessible/tests/browser/fission/browser_nested_iframe.js | Wrong value of property 'role' for [DOM node id: default-iframe-id, role: internal frame, address: [xpconnect wrapped nsIAccessible]]. -
[task 2021-09-07T12:44:00.719Z] 12:44:00 INFO - TEST-PASS | accessible/tests/browser/fission/browser_nested_iframe.js | Wrong first child of [DOM node id: default-iframe-id, role: internal frame, address: [xpconnect wrapped nsIAccessible]] -
[task 2021-09-07T12:44:00.719Z] 12:44:00 INFO - TEST-PASS | accessible/tests/browser/fission/browser_nested_iframe.js | Wrong last child of [DOM node id: default-iframe-id, role: internal frame, address: [xpconnect wrapped nsIAccessible]] -
[task 2021-09-07T12:44:00.720Z] 12:44:00 INFO - TEST-PASS | accessible/tests/browser/fission/browser_nested_iframe.js | Wrong parent of [DOM node id: default-iframe-body-id, role: document, name: 'data:text/html;charset=utf-8,%3Cbody%20id%3D%22de...%2B%2B%2B%253C%252Fhtml%253E%22%2F%3E%3C%2Fbody%3E', address: [xpconnect wrapped (nsIAccessible, nsIAccessibleDocument)]] -
[task 2021-09-07T12:44:00.720Z] 12:44:00 INFO - TEST-PASS | accessible/tests/browser/fission/browser_nested_iframe.js | Wrong index in parent of [DOM node id: default-iframe-body-id, role: document, name: 'data:text/html;charset=utf-8,%3Cbody%20id%3D%22de...%2B%2B%2B%253C%252Fhtml%253E%22%2F%3E%3C%2Fbody%3E', address: [xpconnect wrapped (nsIAccessible, nsIAccessibleDocument)]] -
[task 2021-09-07T12:44:00.720Z] 12:44:00 INFO - TEST-PASS | accessible/tests/browser/fission/browser_nested_iframe.js | Wrong next sibling of [DOM node id: default-iframe-body-id, role: document, name: 'data:text/html;charset=utf-8,%3Cbody%20id%3D%22de...%2B%2B%2B%253C%252Fhtml%253E%22%2F%3E%3C%2Fbody%3E', address: [xpconnect wrapped (nsIAccessible, nsIAccessibleDocument)]] -
[task 2021-09-07T12:44:00.721Z] 12:44:00 INFO - TEST-PASS | accessible/tests/browser/fission/browser_nested_iframe.js | Wrong previous sibling of [DOM node id: default-iframe-body-id, role: document, name: 'data:text/html;charset=utf-8,%3Cbody%20id%3D%22de...%2B%2B%2B%253C%252Fhtml%253E%22%2F%3E%3C%2Fbody%3E', address: [xpconnect wrapped (nsIAccessible, nsIAccessibleDocument)]] -
[task 2021-09-07T12:44:00.721Z] 12:44:00 INFO - TEST-PASS | accessible/tests/browser/fission/browser_nested_iframe.js | Wrong value of property 'role' for [DOM node id: default-iframe-body-id, role: document, name: 'data:text/html;charset=utf-8,%3Cbody%20id%3D%22de...%2B%2B%2B%253C%252Fhtml%253E%22%2F%3E%3C%2Fbody%3E', address: [xpconnect wrapped (nsIAccessible, nsIAccessibleDocument)]]. -
[task 2021-09-07T12:44:00.722Z] 12:44:00 INFO - TEST-PASS | accessible/tests/browser/fission/browser_nested_iframe.js | Wrong first child of [DOM node id: default-iframe-body-id, role: document, name: 'data:text/html;charset=utf-8,%3Cbody%20id%3D%22de...%2B%2B%2B%253C%252Fhtml%253E%22%2F%3E%3C%2Fbody%3E', address: [xpconnect wrapped (nsIAccessible, nsIAccessibleDocument)]] -
[task 2021-09-07T12:44:00.722Z] 12:44:00 INFO - TEST-PASS | accessible/tests/browser/fission/browser_nested_iframe.js | Wrong last child of [DOM node id: default-iframe-body-id, role: document, name: 'data:text/html;charset=utf-8,%3Cbody%20id%3D%22de...%2B%2B%2B%253C%252Fhtml%253E%22%2F%3E%3C%2Fbody%3E', address: [xpconnect wrapped (nsIAccessible, nsIAccessibleDocument)]] -
[task 2021-09-07T12:44:00.723Z] 12:44:00 INFO - TEST-PASS | accessible/tests/browser/fission/browser_nested_iframe.js | Wrong parent of [DOM node id: nested-iframe, role: internal frame, address: [xpconnect wrapped nsIAccessible]] -
[task 2021-09-07T12:44:00.723Z] 12:44:00 INFO - TEST-PASS | accessible/tests/browser/fission/browser_nested_iframe.js | Wrong index in parent of [DOM node id: nested-iframe, role: internal frame, address: [xpconnect wrapped nsIAccessible]] -
[task 2021-09-07T12:44:00.723Z] 12:44:00 INFO - TEST-PASS | accessible/tests/browser/fission/browser_nested_iframe.js | Wrong next sibling of [DOM node id: nested-iframe, role: internal frame, address: [xpconnect wrapped nsIAccessible]] -
[task 2021-09-07T12:44:00.723Z] 12:44:00 INFO - TEST-PASS | accessible/tests/browser/fission/browser_nested_iframe.js | Wrong previous sibling of [DOM node id: nested-iframe, role: internal frame, address: [xpconnect wrapped nsIAccessible]] -
[task 2021-09-07T12:44:00.724Z] 12:44:00 INFO - TEST-PASS | accessible/tests/browser/fission/browser_nested_iframe.js | Wrong value of property 'role' for [DOM node id: nested-iframe, role: internal frame, address: [xpconnect wrapped nsIAccessible]]. -
[task 2021-09-07T12:44:00.724Z] 12:44:00 INFO - TEST-PASS | accessible/tests/browser/fission/browser_nested_iframe.js | Wrong first child of [DOM node id: nested-iframe, role: internal frame, address: [xpconnect wrapped nsIAccessible]] -
[task 2021-09-07T12:44:00.724Z] 12:44:00 INFO - TEST-PASS | accessible/tests/browser/fission/browser_nested_iframe.js | Wrong last child of [DOM node id: nested-iframe, role: internal frame, address: [xpconnect wrapped nsIAccessible]] -
[task 2021-09-07T12:44:00.724Z] 12:44:00 INFO - TEST-PASS | accessible/tests/browser/fission/browser_nested_iframe.js | Wrong parent of [DOM node id: nested-iframe-body, role: document, name: 'Accessibility Nested Iframe Frame Test', address: [xpconnect wrapped (nsIAccessible, nsIAccessibleDocument)]] -
[task 2021-09-07T12:44:00.724Z] 12:44:00 INFO - TEST-PASS | accessible/tests/browser/fission/browser_nested_iframe.js | Wrong index in parent of [DOM node id: nested-iframe-body, role: document, name: 'Accessibility Nested Iframe Frame Test', address: [xpconnect wrapped (nsIAccessible, nsIAccessibleDocument)]] -
[task 2021-09-07T12:44:00.725Z] 12:44:00 INFO - TEST-PASS | accessible/tests/browser/fission/browser_nested_iframe.js | Wrong next sibling of [DOM node id: nested-iframe-body, role: document, name: 'Accessibility Nested Iframe Frame Test', address: [xpconnect wrapped (nsIAccessible, nsIAccessibleDocument)]] -
[task 2021-09-07T12:44:00.725Z] 12:44:00 INFO - TEST-PASS | accessible/tests/browser/fission/browser_nested_iframe.js | Wrong previous sibling of [DOM node id: nested-iframe-body, role: document, name: 'Accessibility Nested Iframe Frame Test', address: [xpconnect wrapped (nsIAccessible, nsIAccessibleDocument)]] -
[task 2021-09-07T12:44:00.725Z] 12:44:00 INFO - TEST-PASS | accessible/tests/browser/fission/browser_nested_iframe.js | Wrong value of property 'role' for [DOM node id: nested-iframe-body, role: document, name: 'Accessibility Nested Iframe Frame Test', address: [xpconnect wrapped (nsIAccessible, nsIAccessibleDocument)]]. -
[task 2021-09-07T12:44:00.725Z] 12:44:00 INFO - TEST-PASS | accessible/tests/browser/fission/browser_nested_iframe.js | Wrong first child of [DOM node id: nested-iframe-body, role: document, name: 'Accessibility Nested Iframe Frame Test', address: [xpconnect wrapped (nsIAccessible, nsIAccessibleDocument)]] -
[task 2021-09-07T12:44:00.726Z] 12:44:00 INFO - TEST-PASS | accessible/tests/browser/fission/browser_nested_iframe.js | Wrong last child of [DOM node id: nested-iframe-body, role: document, name: 'Accessibility Nested Iframe Frame Test', address: [xpconnect wrapped (nsIAccessible, nsIAccessibleDocument)]] -
[task 2021-09-07T12:44:00.726Z] 12:44:00 INFO - TEST-PASS | accessible/tests/browser/fission/browser_nested_iframe.js | Wrong parent of [DOM node id: table, role: table, address: [xpconnect wrapped nsIAccessible]] -
[task 2021-09-07T12:44:00.726Z] 12:44:00 INFO - TEST-PASS | accessible/tests/browser/fission/browser_nested_iframe.js | Wrong index in parent of [DOM node id: table, role: table, address: [xpconnect wrapped nsIAccessible]] -
[task 2021-09-07T12:44:00.726Z] 12:44:00 INFO - TEST-PASS | accessible/tests/browser/fission/browser_nested_iframe.js | Wrong next sibling of [DOM node id: table, role: table, address: [xpconnect wrapped nsIAccessible]] -
[task 2021-09-07T12:44:00.727Z] 12:44:00 INFO - TEST-PASS | accessible/tests/browser/fission/browser_nested_iframe.js | Wrong previous sibling of [DOM node id: table, role: table, address: [xpconnect wrapped nsIAccessible]] -
[task 2021-09-07T12:44:00.727Z] 12:44:00 INFO - TEST-PASS | accessible/tests/browser/fission/browser_nested_iframe.js | Wrong value of property 'role' for [DOM node id: table, role: table, address: [xpconnect wrapped nsIAccessible]]. -
[task 2021-09-07T12:44:00.727Z] 12:44:00 INFO - TEST-PASS | accessible/tests/browser/fission/browser_nested_iframe.js | Wrong first child of [DOM node id: table, role: table, address: [xpconnect wrapped nsIAccessible]] -
[task 2021-09-07T12:44:00.727Z] 12:44:00 INFO - TEST-PASS | accessible/tests/browser/fission/browser_nested_iframe.js | Wrong last child of [DOM node id: table, role: table, address: [xpconnect wrapped nsIAccessible]] -
[task 2021-09-07T12:44:00.727Z] 12:44:00 INFO - TEST-PASS | accessible/tests/browser/fission/browser_nested_iframe.js | Wrong parent of [role: row, address: [xpconnect wrapped nsIAccessible]] -
[task 2021-09-07T12:44:00.727Z] 12:44:00 INFO - TEST-PASS | accessible/tests/browser/fission/browser_nested_iframe.js | Wrong index in parent of [role: row, address: [xpconnect wrapped nsIAccessible]] -
[task 2021-09-07T12:44:00.728Z] 12:44:00 INFO - TEST-PASS | accessible/tests/browser/fission/browser_nested_iframe.js | Wrong next sibling of [role: row, address: [xpconnect wrapped nsIAccessible]] -
[task 2021-09-07T12:44:00.728Z] 12:44:00 INFO - TEST-PASS | accessible/tests/browser/fission/browser_nested_iframe.js | Wrong previous sibling of [role: row, address: [xpconnect wrapped nsIAccessible]] -
[task 2021-09-07T12:44:00.728Z] 12:44:00 INFO - TEST-PASS | accessible/tests/browser/fission/browser_nested_iframe.js | Wrong value of property 'role' for [role: row, address: [xpconnect wrapped nsIAccessible]]. -
[task 2021-09-07T12:44:00.728Z] 12:44:00 INFO - TEST-PASS | accessible/tests/browser/fission/browser_nested_iframe.js | Wrong first child of [role: row, address: [xpconnect wrapped nsIAccessible]] -
[task 2021-09-07T12:44:00.728Z] 12:44:00 INFO - TEST-PASS | accessible/tests/browser/fission/browser_nested_iframe.js | Wrong last child of [role: row, address: [xpconnect wrapped nsIAccessible]] -
[task 2021-09-07T12:44:00.729Z] 12:44:00 INFO - TEST-PASS | accessible/tests/browser/fission/browser_nested_iframe.js | Wrong parent of [role: cell, address: [xpconnect wrapped nsIAccessible]] -
[task 2021-09-07T12:44:00.729Z] 12:44:00 INFO - TEST-PASS | accessible/tests/browser/fission/browser_nested_iframe.js | Wrong index in parent of [role: cell, address: [xpconnect wrapped nsIAccessible]] -
[task 2021-09-07T12:44:00.729Z] 12:44:00 INFO - TEST-PASS | accessible/tests/browser/fission/browser_nested_iframe.js | Wrong next sibling of [role: cell, address: [xpconnect wrapped nsIAccessible]] -
[task 2021-09-07T12:44:00.729Z] 12:44:00 INFO - TEST-PASS | accessible/tests/browser/fission/browser_nested_iframe.js | Wrong previous sibling of [role: cell, address: [xpconnect wrapped nsIAccessible]] -
[task 2021-09-07T12:44:00.729Z] 12:44:00 INFO - TEST-PASS | accessible/tests/browser/fission/browser_nested_iframe.js | Wrong value of property 'role' for [role: cell, address: [xpconnect wrapped nsIAccessible]]. -
[task 2021-09-07T12:44:00.731Z] 12:44:00 INFO - TEST-PASS | accessible/tests/browser/fission/browser_nested_iframe.js | Wrong first child of [role: cell, address: [xpconnect wrapped nsIAccessible]] -
[task 2021-09-07T12:44:00.731Z] 12:44:00 INFO - TEST-PASS | accessible/tests/browser/fission/browser_nested_iframe.js | Wrong last child of [role: cell, address: [xpconnect wrapped nsIAccessible]] -
[task 2021-09-07T12:44:00.731Z] 12:44:00 INFO - TEST-PASS | accessible/tests/browser/fission/browser_nested_iframe.js | Wrong parent of [role: text leaf, name: 'cell1', address: [xpconnect wrapped nsIAccessible]] -
[task 2021-09-07T12:44:00.731Z] 12:44:00 INFO - TEST-PASS | accessible/tests/browser/fission/browser_nested_iframe.js | Wrong index in parent of [role: text leaf, name: 'cell1', address: [xpconnect wrapped nsIAccessible]] -
[task 2021-09-07T12:44:00.731Z] 12:44:00 INFO - TEST-PASS | accessible/tests/browser/fission/browser_nested_iframe.js | Wrong next sibling of [role: text leaf, name: 'cell1', address: [xpconnect wrapped nsIAccessible]] -
[task 2021-09-07T12:44:00.731Z] 12:44:00 INFO - TEST-PASS | accessible/tests/browser/fission/browser_nested_iframe.js | Wrong previous sibling of [role: text leaf, name: 'cell1', address: [xpconnect wrapped nsIAccessible]] -
[task 2021-09-07T12:44:00.731Z] 12:44:00 INFO - TEST-PASS | accessible/tests/browser/fission/browser_nested_iframe.js | Wrong value of property 'role' for [role: text leaf, name: 'cell1', address: [xpconnect wrapped nsIAccessible]]. -
[task 2021-09-07T12:44:00.732Z] 12:44:00 INFO - TEST-PASS | accessible/tests/browser/fission/browser_nested_iframe.js | Wrong first child of [role: text leaf, name: 'cell1', address: [xpconnect wrapped nsIAccessible]] -
[task 2021-09-07T12:44:00.732Z] 12:44:00 INFO - TEST-PASS | accessible/tests/browser/fission/browser_nested_iframe.js | Wrong last child of [role: text leaf, name: 'cell1', address: [xpconnect wrapped nsIAccessible]] -
[task 2021-09-07T12:44:00.732Z] 12:44:00 INFO - TEST-PASS | accessible/tests/browser/fission/browser_nested_iframe.js | Wrong parent of [role: cell, address: [xpconnect wrapped nsIAccessible]] -
[task 2021-09-07T12:44:00.732Z] 12:44:00 INFO - TEST-PASS | accessible/tests/browser/fission/browser_nested_iframe.js | Wrong index in parent of [role: cell, address: [xpconnect wrapped nsIAccessible]] -
[task 2021-09-07T12:44:00.732Z] 12:44:00 INFO - TEST-PASS | accessible/tests/browser/fission/browser_nested_iframe.js | Wrong next sibling of [role: cell, address: [xpconnect wrapped nsIAccessible]] -
[task 2021-09-07T12:44:00.732Z] 12:44:00 INFO - TEST-PASS | accessible/tests/browser/fission/browser_nested_iframe.js | Wrong previous sibling of [role: cell, address: [xpconnect wrapped nsIAccessible]] -
[task 2021-09-07T12:44:00.733Z] 12:44:00 INFO - TEST-PASS | accessible/tests/browser/fission/browser_nested_iframe.js | Wrong value of property 'role' for [role: cell, address: [xpconnect wrapped nsIAccessible]]. -
[task 2021-09-07T12:44:00.733Z] 12:44:00 INFO - TEST-PASS | accessible/tests/browser/fission/browser_nested_iframe.js | Wrong first child of [role: cell, address: [xpconnect wrapped nsIAccessible]] -
[task 2021-09-07T12:44:00.733Z] 12:44:00 INFO - TEST-PASS | accessible/tests/browser/fission/browser_nested_iframe.js | Wrong last child of [role: cell, address: [xpconnect wrapped nsIAccessible]] -
[task 2021-09-07T12:44:00.733Z] 12:44:00 INFO - TEST-PASS | accessible/tests/browser/fission/browser_nested_iframe.js | Wrong parent of [role: text leaf, name: 'cell2', address: [xpconnect wrapped nsIAccessible]] -
[task 2021-09-07T12:44:00.733Z] 12:44:00 INFO - TEST-PASS | accessible/tests/browser/fission/browser_nested_iframe.js | Wrong index in parent of [role: text leaf, name: 'cell2', address: [xpconnect wrapped nsIAccessible]] -
[task 2021-09-07T12:44:00.733Z] 12:44:00 INFO - TEST-PASS | accessible/tests/browser/fission/browser_nested_iframe.js | Wrong next sibling of [role: text leaf, name: 'cell2', address: [xpconnect wrapped nsIAccessible]] -
[task 2021-09-07T12:44:00.734Z] 12:44:00 INFO - TEST-PASS | accessible/tests/browser/fission/browser_nested_iframe.js | Wrong previous sibling of [role: text leaf, name: 'cell2', address: [xpconnect wrapped nsIAccessible]] -
[task 2021-09-07T12:44:00.734Z] 12:44:00 INFO - TEST-PASS | accessible/tests/browser/fission/browser_nested_iframe.js | Wrong value of property 'role' for [role: text leaf, name: 'cell2', address: [xpconnect wrapped nsIAccessible]]. -
[task 2021-09-07T12:44:00.734Z] 12:44:00 INFO - TEST-PASS | accessible/tests/browser/fission/browser_nested_iframe.js | Wrong first child of [role: text leaf, name: 'cell2', address: [xpconnect wrapped nsIAccessible]] -
[task 2021-09-07T12:44:00.734Z] 12:44:00 INFO - TEST-PASS | accessible/tests/browser/fission/browser_nested_iframe.js | Wrong last child of [role: text leaf, name: 'cell2', address: [xpconnect wrapped nsIAccessible]] -
[task 2021-09-07T12:44:00.734Z] 12:44:00 INFO - TEST-PASS | accessible/tests/browser/fission/browser_nested_iframe.js | Wrong parent of [DOM node id: ul, role: list, address: [xpconnect wrapped nsIAccessible]] -
[task 2021-09-07T12:44:00.734Z] 12:44:00 INFO - TEST-PASS | accessible/tests/browser/fission/browser_nested_iframe.js | Wrong index in parent of [DOM node id: ul, role: list, address: [xpconnect wrapped nsIAccessible]] -
[task 2021-09-07T12:44:00.735Z] 12:44:00 INFO - TEST-PASS | accessible/tests/browser/fission/browser_nested_iframe.js | Wrong next sibling of [DOM node id: ul, role: list, address: [xpconnect wrapped nsIAccessible]] -
[task 2021-09-07T12:44:00.735Z] 12:44:00 INFO - TEST-PASS | accessible/tests/browser/fission/browser_nested_iframe.js | Wrong previous sibling of [DOM node id: ul, role: list, address: [xpconnect wrapped nsIAccessible]] -
[task 2021-09-07T12:44:00.735Z] 12:44:00 INFO - TEST-PASS | accessible/tests/browser/fission/browser_nested_iframe.js | Wrong value of property 'role' for [DOM node id: ul, role: list, address: [xpconnect wrapped nsIAccessible]]. -
[task 2021-09-07T12:44:00.735Z] 12:44:00 INFO - TEST-PASS | accessible/tests/browser/fission/browser_nested_iframe.js | Wrong first child of [DOM node id: ul, role: list, address: [xpconnect wrapped nsIAccessible]] -
[task 2021-09-07T12:44:00.735Z] 12:44:00 INFO - TEST-PASS | accessible/tests/browser/fission/browser_nested_iframe.js | Wrong last child of [DOM node id: ul, role: list, address: [xpconnect wrapped nsIAccessible]] -
[task 2021-09-07T12:44:00.735Z] 12:44:00 INFO - TEST-PASS | accessible/tests/browser/fission/browser_nested_iframe.js | Wrong parent of [DOM node id: li, role: listitem, name: '• item1', address: [xpconnect wrapped nsIAccessible]] -
[task 2021-09-07T12:44:00.736Z] 12:44:00 INFO - TEST-PASS | accessible/tests/browser/fission/browser_nested_iframe.js | Wrong index in parent of [DOM node id: li, role: listitem, name: '• item1', address: [xpconnect wrapped nsIAccessible]] -
[task 2021-09-07T12:44:00.736Z] 12:44:00 INFO - TEST-PASS | accessible/tests/browser/fission/browser_nested_iframe.js | Wrong next sibling of [DOM node id: li, role: listitem, name: '• item1', address: [xpconnect wrapped nsIAccessible]] -
[task 2021-09-07T12:44:00.736Z] 12:44:00 INFO - TEST-PASS | accessible/tests/browser/fission/browser_nested_iframe.js | Wrong previous sibling of [DOM node id: li, role: listitem, name: '• item1', address: [xpconnect wrapped nsIAccessible]] -
[task 2021-09-07T12:44:00.736Z] 12:44:00 INFO - TEST-PASS | accessible/tests/browser/fission/browser_nested_iframe.js | Wrong value of property 'role' for [DOM node id: li, role: listitem, name: '• item1', address: [xpconnect wrapped nsIAccessible]]. -
[task 2021-09-07T12:44:00.736Z] 12:44:00 INFO - TEST-PASS | accessible/tests/browser/fission/browser_nested_iframe.js | Wrong first child of [DOM node id: li, role: listitem, name: '• item1', address: [xpconnect wrapped nsIAccessible]] -
[task 2021-09-07T12:44:00.736Z] 12:44:00 INFO - TEST-PASS | accessible/tests/browser/fission/browser_nested_iframe.js | Wrong last child of [DOM node id: li, role: listitem, name: '• item1', address: [xpconnect wrapped nsIAccessible]] -
[task 2021-09-07T12:44:00.737Z] 12:44:00 INFO - TEST-PASS | accessible/tests/browser/fission/browser_nested_iframe.js | Wrong parent of [role: list item marker, name: '• ', address: [xpconnect wrapped nsIAccessible]] -
[task 2021-09-07T12:44:00.737Z] 12:44:00 INFO - TEST-PASS | accessible/tests/browser/fission/browser_nested_iframe.js | Wrong index in parent of [role: list item marker, name: '• ', address: [xpconnect wrapped nsIAccessible]] -
[task 2021-09-07T12:44:00.737Z] 12:44:00 INFO - TEST-PASS | accessible/tests/browser/fission/browser_nested_iframe.js | Wrong next sibling of [role: list item marker, name: '• ', address: [xpconnect wrapped nsIAccessible]] -
[task 2021-09-07T12:44:00.737Z] 12:44:00 INFO - TEST-PASS | accessible/tests/browser/fission/browser_nested_iframe.js | Wrong previous sibling of [role: list item marker, name: '• ', address: [xpconnect wrapped nsIAccessible]] -
[task 2021-09-07T12:44:00.737Z] 12:44:00 INFO - TEST-PASS | accessible/tests/browser/fission/browser_nested_iframe.js | Wrong value of property 'role' for [role: list item marker, name: '• ', address: [xpconnect wrapped nsIAccessible]]. -
[task 2021-09-07T12:44:00.737Z] 12:44:00 INFO - TEST-PASS | accessible/tests/browser/fission/browser_nested_iframe.js | Wrong first child of [role: list item marker, name: '• ', address: [xpconnect wrapped nsIAccessible]] -
[task 2021-09-07T12:44:00.738Z] 12:44:00 INFO - TEST-PASS | accessible/tests/browser/fission/browser_nested_iframe.js | Wrong last child of [role: list item marker, name: '• ', address: [xpconnect wrapped nsIAccessible]] -
[task 2021-09-07T12:44:00.738Z] 12:44:00 INFO - TEST-PASS | accessible/tests/browser/fission/browser_nested_iframe.js | Wrong parent of [role: text leaf, name: 'item1', address: [xpconnect wrapped nsIAccessible]] -
[task 2021-09-07T12:44:00.738Z] 12:44:00 INFO - TEST-PASS | accessible/tests/browser/fission/browser_nested_iframe.js | Wrong index in parent of [role: text leaf, name: 'item1', address: [xpconnect wrapped nsIAccessible]] -
[task 2021-09-07T12:44:00.738Z] 12:44:00 INFO - TEST-PASS | accessible/tests/browser/fission/browser_nested_iframe.js | Wrong next sibling of [role: text leaf, name: 'item1', address: [xpconnect wrapped nsIAccessible]] -
[task 2021-09-07T12:44:00.738Z] 12:44:00 INFO - TEST-PASS | accessible/tests/browser/fission/browser_nested_iframe.js | Wrong previous sibling of [role: text leaf, name: 'item1', address: [xpconnect wrapped nsIAccessible]] -
[task 2021-09-07T12:44:00.738Z] 12:44:00 INFO - TEST-PASS | accessible/tests/browser/fission/browser_nested_iframe.js | Wrong value of property 'role' for [role: text leaf, name: 'item1', address: [xpconnect wrapped nsIAccessible]]. -
[task 2021-09-07T12:44:00.739Z] 12:44:00 INFO - TEST-PASS | accessible/tests/browser/fission/browser_nested_iframe.js | Wrong first child of [role: text leaf, name: 'item1', address: [xpconnect wrapped nsIAccessible]] -
[task 2021-09-07T12:44:00.739Z] 12:44:00 INFO - TEST-PASS | accessible/tests/browser/fission/browser_nested_iframe.js | Wrong last child of [role: text leaf, name: 'item1', address: [xpconnect wrapped nsIAccessible]] -
[task 2021-09-07T12:44:00.739Z] 12:44:00 INFO - TEST-PASS | accessible/tests/browser/fission/browser_nested_iframe.js | Document for nested IFRAME matches. -
[task 2021-09-07T12:44:00.739Z] 12:44:00 INFO - TEST-PASS | accessible/tests/browser/fission/browser_nested_iframe.js | Nested IFRAME document's parent
(If you remove the annotation for this test and push to try, it should fail in one of the regular jobs as TEST-UNEXPECTED-FAIL
.)
Assignee | ||
Comment 4•3 years ago
|
||
I'll run my own try push when I get a chance, but this log only shows assertions passing, which agrees with my assessment in comment 2. The "Wrong" assertion messages are a bit misleading. They're meant to indicate what the problem was if the assertion fails.
Assignee | ||
Comment 5•3 years ago
|
||
S4 because it looks like this is some automated testing quirk and is unlikely to affect users in reality.
Assignee | ||
Comment 6•3 years ago
|
||
Are the test-macosx1100-64-shippable-qr jobs on Apple Silicon? How do we differentiate between Mac OS 11 jobs on Intel vs Apple Silicon... or do we only run OS 11 on Apple Silicon?
The Taskcluster logs are confusing:
[taskcluster 2021-09-07T11:52:16.789Z] Worker Type (releng-hardware/gecko-t-osx-1100-m1) settings:
[taskcluster 2021-09-07T11:52:16.789Z] {
[taskcluster 2021-09-07T11:52:16.789Z] "arch": "x86_64",
This seems to suggest the architecture is x86_64, not arm64.
Assignee | ||
Comment 7•3 years ago
|
||
I can't get any macosx1100 jobs to show up when I run mach try fuzzy. Is there something special I have to do?
Reporter | ||
Comment 8•3 years ago
|
||
(In reply to James Teh [:Jamie] from comment #7)
I can't get any macosx1100 jobs to show up when I run mach try fuzzy. Is there something special I have to do?
You probably need --full
(or pull the latest mozilla-central -- we just upgraded them to Tier 1).
(In reply to James Teh [:Jamie] from comment #6)
Are the test-macosx1100-64-shippable-qr jobs on Apple Silicon? How do we differentiate between Mac OS 11 jobs on Intel vs Apple Silicon... or do we only run OS 11 on Apple Silicon?
The Taskcluster logs are confusing:
[taskcluster 2021-09-07T11:52:16.789Z] Worker Type (releng-hardware/gecko-t-osx-1100-m1) settings: [taskcluster 2021-09-07T11:52:16.789Z] { [taskcluster 2021-09-07T11:52:16.789Z] "arch": "x86_64",
This seems to suggest the architecture is x86_64, not arm64.
Based on the monitoring that CloudOps was doing, we were pretty certain they were arm64. I'll check with them.
Reporter | ||
Comment 9•3 years ago
|
||
And just to be clear: we're not supposed to have any x86_64 jobs on these machines. If we do, that's a bug :)
Assignee | ||
Comment 10•3 years ago
|
||
Comment 11•3 years ago
|
||
(In reply to James Teh [:Jamie] from comment #6)
Are the test-macosx1100-64-shippable-qr jobs on Apple Silicon? How do we differentiate between Mac OS 11 jobs on Intel vs Apple Silicon... or do we only run OS 11 on Apple Silicon?
The Taskcluster logs are confusing:
[taskcluster 2021-09-07T11:52:16.789Z] Worker Type (releng-hardware/gecko-t-osx-1100-m1) settings: [taskcluster 2021-09-07T11:52:16.789Z] { [taskcluster 2021-09-07T11:52:16.789Z] "arch": "x86_64",
This seems to suggest the architecture is x86_64, not arm64.
I'm sorry for the confusion here. This is because puppet_agent was executing as x86_64 when it configured the worker. Puppet was not yet available as arm64 when I set these up (https://tickets.puppetlabs.com/browse/PA-3495 a few weeks ago it because available as a universal build).
The tasks are executing in a tree of arm64 processes. I checked for this task log and confirmed no processes were seen running as x86_64 and these were running as arm64 (checked for the task runner's process tree at 1 minute intervals):
bash,Firefox,generic-worker-simple,launchd,livelog,Python,ssltunnel,start-worker,xpcshell
(you could view it here, however I think only releng/ops has access to the worker metrics: https://hillvalley-b40313e5.influxcloud.net/sources/0/chronograf/data-explorer?query=SELECT%20mean%28%22pid%22%29%20AS%20%22mean_pid%22%20FROM%20%22relops_workers%22.%22six_month%22.%22worker.arch%22%20WHERE%20time%20%3E%20%3AdashboardTime%3A%20AND%20time%20%3C%20%3AupperDashboardTime%3A%20AND%20%28%22host%22%3D%27macmini-m1-20%27%20OR%20%22host%22%3D%27V-MM020%27%29%20GROUP%20BY%20time%28%3Ainterval%3A%29%2C%20%22arch%22%2C%20%22basename%22%20FILL%28null%29)
Comment 12•3 years ago
|
||
We do only run MacOS 11 on Apple Silicon for try
We have MacOS 10.15 as the latest we test on x86_64. (I don't know when we'd move to 11 on those. releng may know?)
Assignee | ||
Comment 13•3 years ago
•
|
||
My try run in comment 10 shows success with the annotation removed. That seems to support my thinking in comment 2: this isn't a failure any more. We do have some low frequency intermittents on this test which I haven't been able to track down (bug 1659435, bug 1728036), so I wonder if one of those happened to trigger when this was marked as a failure.
Unless I'm missing something, I suggest we re-enable this test. We'll probably see some intermittent failures, but they should be no more prevalent than on any other platform. :bhearsum, does this seem reasonable?
Reporter | ||
Comment 14•3 years ago
|
||
(In reply to James Teh [:Jamie] from comment #13)
My try run in comment 10 shows success with the annotation removed. That seems to support my thinking in comment 2: this isn't a failure any more. We do have some low frequency intermittents on this test which I haven't been able to track down (bug 1659435, bug 1728036), so I wonder if one of those happened to trigger when this was marked as a failure.
Unless I'm missing something, I suggest we re-enable this test. We'll probably see some intermittent failures, but they should be no more prevalent than on any other platform. :bhearsum, does this seem reasonable?
Thanks for looking into this. That sounds good to me - it's possible either I misinterpreted things, or something changed since I filed this.
Assignee | ||
Comment 15•3 years ago
|
||
This passes for me on try.
We do have some low frequency intermittent failures for this test, but they apply to all platforms.
Updated•3 years ago
|
Comment 16•3 years ago
|
||
Comment 17•3 years ago
|
||
bugherder |
Comment 18•3 years ago
|
||
Setting status-firefox93=wontfix because (I assume) we don't need to uplift this test fix to Beta 93.
Description
•