Open Bug 1525773 Opened 9 months ago Updated 2 months ago

windows/aarch64 - browser/tools/mozscreenshots/browser_screenshots_cropping.js errors

Categories

(Testing :: mozscreenshots, defect, P5)

ARM64
Windows
defect

Tracking

(Not tracked)

People

(Reporter: intermittent-bug-filer, Unassigned, NeedInfo)

References

(Blocks 1 open bug)

Details

(Keywords: leave-open)

Attachments

(1 file)

#[markdown(off)]
Filed by: egao [at] mozilla.com

https://treeherder.mozilla.org/logviewer.html#?job_id=226341286&repo=try

https://queue.taskcluster.net/v1/task/D5_da5JEQjazCQ-IFfzx7Q/runs/0/artifacts/public/logs/live_backing.log

Combining several reported failures from win10/aarch64.

18:22:16 INFO - TEST-UNEXPECTED-FAIL | browser/tools/mozscreenshots/browser_screenshots_cropping.js | The image should be cropped to the upper left quadrant - Got 47, expected 0
18:22:16 INFO - Stack trace:
18:22:16 INFO - chrome://mochikit/content/browser-test.js:test_is:1315
18:22:16 INFO - chrome://mochitests/content/browser/browser/tools/mozscreenshots/browser_screenshots_cropping.js:crop:58
18:22:16 INFO - chrome://mochikit/content/browser-test.js:Tester_execTest/<:1106
18:22:16 INFO - chrome://mochikit/content/browser-test.js:Tester_execTest:1097
18:22:16 INFO - chrome://mochikit/content/browser-test.js:nextTest/<:995
18:22:16 INFO - chrome://mochikit/content/tests/SimpleTest/SimpleTest.js:SimpleTest.waitForFocus/waitForFocusInner/focusedOrLoaded/<:803

18:22:16 INFO - Stack trace:
18:22:16 INFO - chrome://mochikit/content/browser-test.js:test_is:1315
18:22:16 INFO - chrome://mochitests/content/browser/browser/tools/mozscreenshots/browser_screenshots_cropping.js:crop:67
18:22:16 INFO - chrome://mochikit/content/browser-test.js:Tester_execTest/<:1106
18:22:16 INFO - chrome://mochikit/content/browser-test.js:Tester_execTest:1097
18:22:16 INFO - chrome://mochikit/content/browser-test.js:nextTest/<:995
18:22:16 INFO - chrome://mochikit/content/tests/SimpleTest/SimpleTest.js:SimpleTest.waitForFocus/waitForFocusInner/focusedOrLoaded/<:803

18:22:16 INFO - TEST-UNEXPECTED-FAIL | browser/tools/mozscreenshots/browser_screenshots_cropping.js | The image should be not be cropped, and the cropping region should be clipped to the size of the image - Got 108, expected 0
18:22:16 INFO - Stack trace:
18:22:16 INFO - chrome://mochikit/content/browser-test.js:test_is:1315
18:22:16 INFO - chrome://mochitests/content/browser/browser/tools/mozscreenshots/browser_screenshots_cropping.js:crop:76
18:22:16 INFO - chrome://mochikit/content/browser-test.js:Tester_execTest/<:1106
18:22:16 INFO - chrome://mochikit/content/browser-test.js:Tester_execTest:1097
18:22:16 INFO - chrome://mochikit/content/browser-test.js:nextTest/<:995
18:22:16 INFO - chrome://mochikit/content/tests/SimpleTest/SimpleTest.js:SimpleTest.waitForFocus/waitForFocusInner/focusedOrLoaded/<:803

18:22:16 INFO - TEST-UNEXPECTED-FAIL | browser/tools/mozscreenshots/browser_screenshots_cropping.js | The image should be contain squares across the diagonal - Got 18, expected 0
18:22:16 INFO - Stack trace:
18:22:16 INFO - chrome://mochikit/content/browser-test.js:test_is:1315
18:22:16 INFO - chrome://mochitests/content/browser/browser/tools/mozscreenshots/browser_screenshots_cropping.js:crop:85
18:22:16 INFO - chrome://mochikit/content/browser-test.js:Tester_execTest/<:1106
18:22:16 INFO - chrome://mochikit/content/browser-test.js:Tester_execTest:1097
18:22:16 INFO - chrome://mochikit/content/browser-test.js:nextTest/<:995
18:22:16 INFO - chrome://mochikit/content/tests/SimpleTest/SimpleTest.js:SimpleTest.waitForFocus/waitForFocusInner/focusedOrLoaded/<:803

I cannot reproduce this on my normal windows10 laptop, I suspect this has to do with aarch64.

:aswan, I see you modified this recently, do you know of any quirks with this test? would it need specific resolution or pixel depth?

Flags: needinfo?(aswan)
Summary: TEST-UNEXPECTED-FAIL | browser/tools/mozscreenshots/browser_screenshots_cropping.js errors → windows/aarch64 - browser/tools/mozscreenshots/browser_screenshots_cropping.js errors

My changes were just about changing the packing of the test extension, I don't know much about how it actually works.
Looks like the test was originally written by a student who Jared mentored, maybe Jared knows something about the test?

Flags: needinfo?(aswan) → needinfo?(jaws)
Blocks: 1403686
Component: General → mozscreenshots
Product: Firefox → Testing

Comment 3 shows only 1 failure out of 2658 pushes, and that was on Try server. We should see if this occurs anymore and then just close this as invalid if the failure rate doesn't pick up.

oh, this is a new platform we are standing up and have a single machine on try that we ran this test on. We should have more machines available on try next week.

Duplicate of this bug: 1531603

Good candidate to be disabled for windows10-aarch64 owing to lack of movement on this test.

With this test disabled, try reports green run for ss on windows10-aarch64.

https://treeherder.mozilla.org/#/jobs?repo=try&group_state=expanded&revision=2af89cb516064b6796cb08aa243217c266572149

OS: Unspecified → Windows
Hardware: Unspecified → ARM64
Pushed by egao@mozilla.com:
https://hg.mozilla.org/integration/autoland/rev/94eda5f3c165
remove windows10-aarch64 skip clause from browser/tools/mozscreenshots/browser.ini r=jmaher
You need to log in before you can comment on or make changes to this bug.