1536362 - windows/aarch64 - modify expected outcome of async-scrolling/bg-fixed-transformed-image.html

Status: RESOLVED FIXED

(Testing :: Reftest, enhancement, P5)

Description

[Edwin Takahashi (:egao | infrequent contributor)]

Disable async-scrolling/bg-fixed-transformed-image.html due to consistent failures experienced on windows10-aarch64.

This ticket is meant to track the disabling of this test from the reftest suite; work should be done in the parent ticket 1530884.

Comment 1

[Edwin Takahashi (:egao | infrequent contributor)]

Attachment: Bug 1536362, 1536363, 1536365, 1536355, 1537997, 1537993, 1538001, 1538005, 1538009, 1538012, 1538017, 1538022, 1534717 - add conditions to reftests, crashtests and wpt reftets that experience issues on windows10-aarch64

• reftest/gizmo.mp4.seek.html
• dom/media/test/reftest/vtt_update_display_after_removed_cue.html
• async-scrolling/bg-fixed-transformed-image.html
• 1383981.html, 1383981-2.html, 1383981-3.html

Comment 2

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/autoland/rev/54cb3fe39194
1536363, 1536365, 1536355, 1537997, 1537993, 1538001, 1538005, 1538009, 1538012, 1538017, 1538022, 1534717 - add conditions to reftests, crashtests and wpt reftets that experience issues on windows10-aarch64 r=jmaher,gbrown

Comment 3

[Natalia Csoregi [:nataliaCs]]

Backed out for spidermonkey bustage

backout: https://hg.mozilla.org/integration/autoland/rev/529782921812aaf0558fbb22384b3051174657d3

push: https://treeherder.mozilla.org/#/jobs?repo=autoland&revision=54cb3fe39194b439a52cc0ed016e50c4bfdb6a8e&group_state=expanded

failure log: https://treeherder.mozilla.org/logviewer.html#/jobs?job_id=235704735&repo=autoland&lineNumber=34538

[task 2019-03-24T05:41:17.089Z] Passed: ran 346 tests.
[task 2019-03-24T05:41:17.118Z] in directory /builds/worker/workspace/build/src/obj-spider, running ['setarch', 'x86_64', '-R', 'make', 'check-jstests']
[task 2019-03-24T05:41:17.126Z] make -C js/src check-jstests
[task 2019-03-24T05:41:17.191Z] make[1]: Entering directory '/builds/worker/workspace/build/src/obj-spider/js/src'
[task 2019-03-24T05:41:17.191Z] ../../dist/bin/run-mozilla.sh /builds/worker/workspace/build/src/obj-spider/virtualenvs/init/bin/python -u /builds/worker/workspace/build/src/js/src/tests/jstests.py
[task 2019-03-24T05:41:17.191Z] --no-progress --format=automation --timeout 300
[task 2019-03-24T05:41:17.191Z]
[task 2019-03-24T05:41:17.191Z] ../../dist/bin/js
[task 2019-03-24T05:41:40.836Z] Traceback (most recent call last):
[task 2019-03-24T05:41:40.836Z] File "/builds/worker/workspace/build/src/js/src/tests/jstests.py", line 568, in <module>
[task 2019-03-24T05:41:40.836Z] sys.exit(main())
[task 2019-03-24T05:41:40.836Z] File "/builds/worker/workspace/build/src/js/src/tests/jstests.py", line 556, in main
[task 2019-03-24T05:41:40.836Z] for out in run_all_tests(test_gen, prefix, results.pb, options):
[task 2019-03-24T05:41:40.836Z] File "/builds/worker/workspace/build/src/js/src/tests/lib/tasks_unix.py", line 215, in run_all_tests
[task 2019-03-24T05:41:40.836Z] tests = list(tests)
[task 2019-03-24T05:41:40.836Z] File "/builds/worker/workspace/build/src/js/src/tests/jstests.py", line 512, in <genexpr>
[task 2019-03-24T05:41:40.836Z] test_gen = (test for test in test_gen for i in range(options.repeat))
[task 2019-03-24T05:41:40.836Z] File "/builds/worker/workspace/build/src/js/src/tests/jstests.py", line 509, in <genexpr>
[task 2019-03-24T05:41:40.836Z] test_gen = ( for _ in test_gen if not .slow)
[task 2019-03-24T05:41:40.836Z] File "/builds/worker/workspace/build/src/js/src/tests/jstests.py", line 502, in <genexpr>
[task 2019-03-24T05:41:40.837Z] test_gen = ( for _ in test_gen if not _.random)
[task 2019-03-24T05:41:40.837Z] File "/builds/worker/workspace/build/src/js/src/tests/lib/manifest.py", line 442, in load_reftests
[task 2019-03-24T05:41:40.837Z] xul_tester)
[task 2019-03-24T05:41:40.837Z] File "/builds/worker/workspace/build/src/js/src/tests/lib/manifest.py", line 388, in _apply_external_manifests
[task 2019-03-24T05:41:40.837Z] _parse_one(testcase, entry["terms"], xul_tester)
[task 2019-03-24T05:41:40.837Z] File "/builds/worker/workspace/build/src/js/src/tests/lib/manifest.py", line 151, in _parse_one
[task 2019-03-24T05:41:40.837Z] if xul_tester.test(cond):
[task 2019-03-24T05:41:40.837Z] File "/builds/worker/workspace/build/src/js/src/tests/lib/manifest.py", line 115, in test
[task 2019-03-24T05:41:40.837Z] cond, out, err))
[task 2019-03-24T05:41:40.837Z] Exception: Failed to test XUL condition '(/^Windows\x20NT\x2010\.0/.test(http.oscpu))&&(/^aarch64-msvc/.test(xulRuntime.XPCOMABI))'; output was '', stderr was '-e:1:8 ReferenceError: http is not defined\nStack:\n @-e:1:8\n'
[task 2019-03-24T05:41:41.181Z] Makefile:64: recipe for target 'check-jstests' failed
[task 2019-03-24T05:41:41.181Z] make[1]: *** [check-jstests] Error 1
[task 2019-03-24T05:41:41.181Z] make[1]: Leaving directory '/builds/worker/workspace/build/src/obj-spider/js/src'
[task 2019-03-24T05:41:41.181Z] Makefile:311: recipe for target 'check-jstests' failed
[task 2019-03-24T05:41:41.181Z] make: *** [check-jstests] Error 2
[task 2019-03-24T05:41:41.185Z] + BUILD_STATUS=2
[task 2019-03-24T05:41:41.185Z] + mkdir -p /builds/worker/artifacts/
[task 2019-03-24T05:41:41.186Z] + cp -rL /builds/worker/workspace/build/src/obj-spider/dist/bin/js /builds/worker/workspace/build/src/obj-spider/dist/bin/jsapi-tests /builds/worker/workspace/build/src/obj-spider/dist/bin/js-gdb.py /builds/worker/artifacts/
[task 2019-03-24T05:41:41.413Z] + gzip -c /builds/worker/workspace/clang/bin/llvm-symbolizer
[task 2019-03-24T05:41:41.582Z] + exit 2
[taskcluster 2019-03-24 05:41:42.094Z] === Task Finished ===
[taskcluster 2019-03-24 05:41:52.085Z] Unsuccessful task run with exit code: 2 completed in 1185.899 seconds

Comment 4

[Edwin Takahashi (:egao | infrequent contributor)]

Attachment: Bug 1536362, 1536363, 1536365, 1536355, 1537997, 1537993, 1538001, 1538005, 1538009, 1538012, 1538017, 1538022, 1534717 - add conditions to reftests, crashtests and wpt reftets that experience issues on windows10-aarch64

Disable or change the expected outcomes of:

• reftests
• jsreftests
• crashtest
• web-platform-reftests

Comment 5

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/autoland/rev/27b4670e5e9c
1536363, 1536365, 1536355, 1537997, 1537993, 1538001, 1538005, 1538009, 1538012, 1538017, 1538022, 1534717 - add conditions to reftests, crashtests and wpt reftets that experience issues on windows10-aarch64 r=jmaher

Comment 6

[Edwin Takahashi (:egao | infrequent contributor)]

I have pushed an updated try run:

https://treeherder.mozilla.org/#/jobs?repo=try&group_state=expanded&revision=c791ae193f31917dfb71dacd788208b3b7d0ca0c

This passes the asan tests for SM.

Comment 7

[Raul Gurzau (:RaulG)]

https://hg.mozilla.org/mozilla-central/rev/27b4670e5e9c