1530088 - Intermittent raptor-main TEST-UNEXPECTED-FAIL: no raptor test results were found for raptor-wasm-godot-chrome

Status: RESOLVED INVALID

(Testing :: Raptor, defect, P5)

Description

[Treeherder Bug Filer]

#[markdown(off)]
Filed by: cbrindusan [at] mozilla.com

https://treeherder.mozilla.org/logviewer.html#?job_id=230066041&repo=mozilla-central

https://queue.taskcluster.net/v1/task/NNl3cnkwTEiNvx2Ps-P3Jg/runs/0/artifacts/public/logs/live_backing.log

11:22:41 INFO - Calling ['/Users/cltbld/tasks/task_1550920498/build/venv/bin/python', u'/Users/cltbld/tasks/task_1550920498/build/tests/raptor/raptor/raptor.py', u'--test', 'raptor-wasm-godot', u'--binary', u'/Users/cltbld/tasks/task_1550920498/mozharness/mozharness/mozilla/testing/chrome/chrome-mac/Chromium.app/Contents/MacOS/Chromium', u'--app', 'chrome', u'--symbolsPath', 'https://queue.taskcluster.net/v1/task/ArF2Sw4oTM-Um4a7jti9XA/artifacts/public/build/target.crashreporter-symbols.zip', u'--log-tbpl-level=debug'] with output_timeout 3600
11:22:42 INFO - raptor-main raptor-start
11:22:42 INFO - raptor-main received command line arguments: Namespace(activity=None, app='chrome', binary='/Users/cltbld/tasks/task_1550920498/mozharness/mozharness/mozilla/testing/chrome/chrome-mac/Chromium.app/Contents/MacOS/Chromium', debug_mode=False, gecko_profile=False, gecko_profile_entries=None, gecko_profile_interval=None, host='127.0.0.1', is_release_build=False, log_errorsummary=None, log_grouped=None, log_html=None, log_mach=None, log_mach_buffer=None, log_mach_level=None, log_mach_screenshot=None, log_mach_verbose=None, log_raw=None, log_raw_level=None, log_tbpl=None, log_tbpl_buffer=None, log_tbpl_compact=None, log_tbpl_level='debug', log_unittest=None, log_xunit=None, obj_path=None, page_cycles=None, page_timeout=None, power_test=False, run_local=False, symbols_path='https://queue.taskcluster.net/v1/task/ArF2Sw4oTM-Um4a7jti9XA/artifacts/public/build/target.crashreporter-symbols.zip', test='raptor-wasm-godot')
11:22:42 INFO - raptor-manifest /Users/cltbld/tasks/task_1550920498/build/tests/raptor/raptor/raptor.ini
11:22:42 INFO - raptor-manifest configuring settings for test raptor-wasm-godot-chrome
11:22:42 INFO - raptor-main raptor tests scheduled to run:
11:22:42 INFO - raptor-main raptor-wasm-godot-chrome
11:22:42 INFO - raptor-main main raptor init, config is: {'binary': '/Users/cltbld/tasks/task_1550920498/mozharness/mozharness/mozilla/testing/chrome/chrome-mac/Chromium.app/Contents/MacOS/Chromium', 'symbols_path': 'https://queue.taskcluster.net/v1/task/ArF2Sw4oTM-Um4a7jti9XA/artifacts/public/build/target.crashreporter-symbols.zip', 'app': 'chrome', 'gecko_profile_entries': None, 'power_test': False, 'run_local': False, 'platform': 'mac', 'host': '127.0.0.1', 'is_release_build': False, 'gecko_profile_interval': None, 'processor': 'x86_64', 'gecko_profile': False, 'obj_path': None}
11:22:42 INFO - raptor-main Merging profile: /Users/cltbld/tasks/task_1550920498/build/tests/raptor/raptor/profile_data/base
11:22:42 INFO - raptor-main Merging profile: /Users/cltbld/tasks/task_1550920498/build/tests/raptor/raptor/profile_data/common
11:22:42 INFO - raptor-main Merging profile: /Users/cltbld/tasks/task_1550920498/build/tests/raptor/raptor/profile_data/perf
11:22:42 INFO - raptor-main Merging profile: /Users/cltbld/tasks/task_1550920498/build/tests/raptor/raptor/profile_data/raptor
11:22:42 INFO - raptor-main creating browser runner using mozrunner
11:22:42 INFO - raptor-control-server raptor control server running on port 50390...
11:22:42 INFO - raptor-main starting raptor test: raptor-wasm-godot-chrome
11:22:42 INFO - raptor-main test settings: {'newtab_per_cycle': 'true', 'alert_threshold': '2.0', 'gecko_profile_entries': '8000000', 'here': '/Users/cltbld/tasks/task_1550920498/build/tests/raptor/raptor/tests', 'path': '/Users/cltbld/tasks/task_1550920498/build/tests/raptor/raptor/tests/raptor-wasm-godot-chrome', 'gecko_profile_interval': '1', 'unit': 'ms', 'ancestor-manifest': '/Users/cltbld/tasks/task_1550920498/build/tests/raptor/raptor/raptor.ini', 'name': 'raptor-wasm-godot-chrome', 'type': 'benchmark', 'page_cycles': '5', 'apps': 'chrome', 'test_url': 'http://localhost:<port>/wasm-godot/index.html', 'manifest': '/Users/cltbld/tasks/task_1550920498/build/tests/raptor/raptor/tests/raptor-wasm-godot.ini', 'page_timeout': '120000', 'expected': 'pass', 'lower_is_better': 'true', 'relpath': 'tests/raptor-wasm-godot-chrome'}
11:22:42 INFO - raptor-main raptor config: {'binary': '/Users/cltbld/tasks/task_1550920498/mozharness/mozharness/mozilla/testing/chrome/chrome-mac/Chromium.app/Contents/MacOS/Chromium', 'local_profile_dir': '/var/folders/qs/rqzkbdd969172mly6kqw8pjw00000x/T/tmpu_dud9.mozrunner/Default', 'symbols_path': 'https://queue.taskcluster.net/v1/task/ArF2Sw4oTM-Um4a7jti9XA/artifacts/public/build/target.crashreporter-symbols.zip', 'app': 'chrome', 'gecko_profile_entries': None, 'power_test': False, 'run_local': False, 'platform': 'mac', 'host': '127.0.0.1', 'is_release_build': False, 'gecko_profile_interval': None, 'processor': 'x86_64', 'gecko_profile': False, 'obj_path': None}
11:22:42 INFO - raptor-benchmark bench_dir contains:
11:22:42 INFO - raptor-benchmark ['ARES-6', 'MotionMark', 'resources', 'six-speed', 'Speedometer', 'StyleBench', 'SunSpider', 'wasm-godot', 'webaudio']
11:22:42 INFO - raptor-benchmark writing wptserve headers file
11:22:42 INFO - raptor-benchmark wrote wpt headers file: /Users/cltbld/tasks/task_1550920498/build/tests/raptor/raptor/tests/webkit/PerformanceTests/__dir__.headers
11:22:42 INFO - raptor-benchmark starting webserver on '127.0.0.1:50391'
11:22:42 INFO - raptor-benchmark serving benchmarks from here: /Users/cltbld/tasks/task_1550920498/build/tests/raptor/raptor/tests/webkit/PerformanceTests
11:22:42 INFO - raptor-gen-test-config writing test settings into background js, so webext can get it
11:22:42 INFO - raptor-gen-test-config finished writing test config to /Users/cltbld/tasks/task_1550920498/build/tests/raptor/webext/raptor/auto_gen_test_config.js
11:22:42 INFO - raptor-main installing webext /Users/cltbld/tasks/task_1550920498/build/tests/raptor/webext/raptor
11:22:42 INFO - raptor-main starting chrome
11:22:42 INFO - Application command: /Users/cltbld/tasks/task_1550920498/mozharness/mozharness/mozilla/testing/chrome/chrome-mac/Chromium.app/Contents/MacOS/Chromium --user-data-dir=/var/folders/qs/rqzkbdd969172mly6kqw8pjw00000x/T/tmpu_dud9.mozrunner --profile-directory=Default --no-first-run --load-extension=/Users/cltbld/tasks/task_1550920498/build/tests/raptor/webext/raptor
11:22:43 INFO - 127.0.0.1 - - [23/Feb/2019 03:22:43] "POST / HTTP/1.1" 200 -
11:22:43 INFO - raptor-control-server received webext_status: raptor runner.js is loaded!
11:22:43 INFO - 127.0.0.1 - - [23/Feb/2019 03:22:43] "GET /raptor-wasm-godot-chrome.json HTTP/1.1" 200 -
11:22:43 INFO - raptor-control-server reading test settings from raptor-wasm-godot-chrome.json
11:22:43 INFO - raptor-control-server sent test settings to web ext runner
11:22:43 INFO - 127.0.0.1 - - [23/Feb/2019 03:22:43] "POST / HTTP/1.1" 200 -
11:22:43 INFO - raptor-control-server received webext_status: * pausing 30 seconds to let browser settle... *
11:23:13 INFO - 127.0.0.1 - - [23/Feb/2019 03:23:13] "POST / HTTP/1.1" 200 -
11:23:13 INFO - raptor-control-server received webext_status: running 5 pagecycles of http://localhost:50391/wasm-godot/index.html
11:23:13 INFO - 127.0.0.1 - - [23/Feb/2019 03:23:13] "POST / HTTP/1.1" 200 -
11:23:13 INFO - raptor-control-server received webext_status: opened new empty tab 3
11:23:14 INFO - 127.0.0.1 - - [23/Feb/2019 03:23:14] "POST / HTTP/1.1" 200 -
11:23:14 INFO - raptor-control-server received webext_status: begin pagecycle 1
11:23:14 INFO - 127.0.0.1 - - [23/Feb/2019 03:23:14] "POST / HTTP/1.1" 200 -
11:23:14 INFO - raptor-control-server received webext_status: closing Tab 3
11:23:14 INFO - 127.0.0.1 - - [23/Feb/2019 03:23:14] "POST / HTTP/1.1" 200 -
11:23:14 INFO - raptor-control-server received webext_status: Open new tab
11:23:14 INFO - 127.0.0.1 - - [23/Feb/2019 03:23:14] "POST / HTTP/1.1" 200 -
11:23:14 INFO - raptor-control-server received webext_status: Removed tab 3
11:23:14 INFO - 127.0.0.1 - - [23/Feb/2019 03:23:14] "POST / HTTP/1.1" 200 -
11:23:14 INFO - raptor-control-server received webext_status: opened new empty tab 5
11:23:15 INFO - 127.0.0.1 - - [23/Feb/2019 03:23:15] "POST / HTTP/1.1" 200 -
11:23:15 INFO - raptor-control-server received webext_status: update tab 5
11:23:15 INFO - 127.0.0.1 - - [23/Feb/2019 03:23:15] "POST / HTTP/1.1" 200 -
11:23:15 INFO - raptor-control-server received webext_status: test tab updated 5
11:23:19 INFO - 127.0.0.1 - - [23/Feb/2019 03:23:19] "POST / HTTP/1.1" 200 -
11:23:19 INFO - raptor-control-server received webext_status: results received
11:23:20 INFO - 127.0.0.1 - - [23/Feb/2019 03:23:20] "POST / HTTP/1.1" 200 -
11:23:20 INFO - raptor-control-server received webext_status: begin pagecycle 2
11:23:20 INFO - 127.0.0.1 - - [23/Feb/2019 03:23:20] "POST / HTTP/1.1" 200 -
11:23:20 INFO - raptor-control-server received webext_status: closing Tab 5
11:23:20 INFO - 127.0.0.1 - - [23/Feb/2019 03:23:20] "POST / HTTP/1.1" 200 -
11:23:20 INFO - raptor-control-server received webext_status: Open new tab
11:23:20 INFO - 127.0.0.1 - - [23/Feb/2019 03:23:20] "POST / HTTP/1.1" 200 -
11:23:20 INFO - raptor-control-server received webext_status: Removed tab 5
11:23:20 INFO - 127.0.0.1 - - [23/Feb/2019 03:23:20] "POST / HTTP/1.1" 200 -
11:23:20 INFO - raptor-control-server received webext_status: opened new empty tab 7
11:23:21 INFO - 127.0.0.1 - - [23/Feb/2019 03:23:21] "POST / HTTP/1.1" 200 -
11:23:21 INFO - raptor-control-server received webext_status: update tab 7
11:23:21 INFO - 127.0.0.1 - - [23/Feb/2019 03:23:21] "POST / HTTP/1.1" 200 -
11:23:21 INFO - raptor-control-server received webext_status: test tab updated 7
11:23:26 INFO - 127.0.0.1 - - [23/Feb/2019 03:23:26] "POST / HTTP/1.1" 200 -
11:23:26 INFO - raptor-control-server received webext_status: results received
11:23:27 INFO - 127.0.0.1 - - [23/Feb/2019 03:23:27] "POST / HTTP/1.1" 200 -
11:23:27 INFO - raptor-control-server received webext_status: begin pagecycle 3
11:23:27 INFO - 127.0.0.1 - - [23/Feb/2019 03:23:27] "POST / HTTP/1.1" 200 -
11:23:27 INFO - raptor-control-server received webext_status: closing Tab 7
11:23:27 INFO - 127.0.0.1 - - [23/Feb/2019 03:23:27] "POST / HTTP/1.1" 200 -
11:23:27 INFO - raptor-control-server received webext_status: Open new tab
11:23:27 INFO - 127.0.0.1 - - [23/Feb/2019 03:23:27] "POST / HTTP/1.1" 200 -
11:23:27 INFO - raptor-control-server received webext_status: Removed tab 7
11:23:27 INFO - 127.0.0.1 - - [23/Feb/2019 03:23:27] "POST / HTTP/1.1" 200 -
11:23:27 INFO - raptor-control-server received webext_status: opened new empty tab 9
11:23:28 INFO - 127.0.0.1 - - [23/Feb/2019 03:23:28] "POST / HTTP/1.1" 200 -
11:23:28 INFO - raptor-control-server received webext_status: update tab 9
11:23:28 INFO - 127.0.0.1 - - [23/Feb/2019 03:23:28] "POST / HTTP/1.1" 200 -
11:23:28 INFO - raptor-control-server received webext_status: test tab updated 9
11:23:32 INFO - 127.0.0.1 - - [23/Feb/2019 03:23:32] "POST / HTTP/1.1" 200 -
11:23:32 INFO - raptor-control-server received webext_status: results received
11:23:33 INFO - 127.0.0.1 - - [23/Feb/2019 03:23:33] "POST / HTTP/1.1" 200 -
11:23:33 INFO - raptor-control-server received webext_status: begin pagecycle 4
11:23:33 INFO - 127.0.0.1 - - [23/Feb/2019 03:23:33] "POST / HTTP/1.1" 200 -
11:23:33 INFO - raptor-control-server received webext_status: closing Tab 9
11:23:33 INFO - 127.0.0.1 - - [23/Feb/2019 03:23:33] "POST / HTTP/1.1" 200 -
11:23:33 INFO - raptor-control-server received webext_status: Open new tab
11:23:33 INFO - 127.0.0.1 - - [23/Feb/2019 03:23:33] "POST / HTTP/1.1" 200 -
11:23:33 INFO - raptor-control-server received webext_status: Removed tab 9
11:23:33 INFO - 127.0.0.1 - - [23/Feb/2019 03:23:33] "POST / HTTP/1.1" 200 -
11:23:33 INFO - raptor-control-server received webext_status: opened new empty tab 11
11:23:34 INFO - 127.0.0.1 - - [23/Feb/2019 03:23:34] "POST / HTTP/1.1" 200 -
11:23:34 INFO - raptor-control-server received webext_status: update tab 11
11:23:34 INFO - 127.0.0.1 - - [23/Feb/2019 03:23:34] "POST / HTTP/1.1" 200 -
11:23:34 INFO - raptor-control-server received webext_status: test tab updated 11
11:23:40 INFO - PID 1735 | [1741:779:0223/032340.563529:ERROR:logger.cc(46)] Too many GL errors, not reporting any more for this context. use --disable-gl-error-limit to see all errors.
11:23:43 INFO - 127.0.0.1 - - [23/Feb/2019 03:23:43] "POST / HTTP/1.1" 200 -
11:23:43 INFO - raptor-control-server received webext_status: results received
11:23:44 INFO - 127.0.0.1 - - [23/Feb/2019 03:23:44] "POST / HTTP/1.1" 200 -
11:23:44 INFO - raptor-control-server received webext_status: begin pagecycle 5
11:23:44 INFO - 127.0.0.1 - - [23/Feb/2019 03:23:44] "POST / HTTP/1.1" 200 -
11:23:44 INFO - raptor-control-server received webext_status: closing Tab 11
11:23:44 INFO - 127.0.0.1 - - [23/Feb/2019 03:23:44] "POST / HTTP/1.1" 200 -
11:23:44 INFO - raptor-control-server received webext_status: Open new tab
11:23:44 INFO - 127.0.0.1 - - [23/Feb/2019 03:23:44] "POST / HTTP/1.1" 200 -
11:23:44 INFO - raptor-control-server received webext_status: Removed tab 11
11:23:44 INFO - 127.0.0.1 - - [23/Feb/2019 03:23:44] "POST / HTTP/1.1" 200 -
11:23:44 INFO - raptor-control-server received webext_status: opened new empty tab 13
11:23:45 INFO - 127.0.0.1 - - [23/Feb/2019 03:23:45] "POST / HTTP/1.1" 200 -
11:23:45 INFO - raptor-control-server received webext_status: update tab 13
11:23:45 INFO - 127.0.0.1 - - [23/Feb/2019 03:23:45] "POST / HTTP/1.1" 200 -
11:23:45 INFO - raptor-control-server received webext_status: test tab updated 13
11:23:51 INFO - PID 1735 | [1741:779:0223/032351.129594:ERROR:logger.cc(46)] Too many GL errors, not reporting any more for this context. use --disable-gl-error-limit to see all errors.
11:25:44 INFO - 127.0.0.1 - - [23/Feb/2019 03:25:44] "POST / HTTP/1.1" 200 -
11:25:44 INFO - raptor-control-server received webext_raptor-page-timeout: [u'raptor-wasm-godot-chrome', u'http://localhost:50391/wasm-godot/index.html']
11:25:44 INFO - 127.0.0.1 - - [23/Feb/2019 03:25:44] "POST / HTTP/1.1" 200 -
11:25:44 INFO - raptor-control-server received webext_status: __raptor_shutdownBrowser
11:25:44 INFO - raptor-control-server shutting down browser (pid: 1735)
11:25:44 INFO - 127.0.0.1 - - [23/Feb/2019 03:25:44] "POST / HTTP/1.1" 200 -
11:25:44 INFO - raptor-control-server received webext_status: Removed tab 13
11:26:01 INFO - raptor-main removing webext /Users/cltbld/tasks/task_1550920498/build/tests/raptor/webext/raptor
11:26:01 INFO - results-handler summarizing raptor test results
11:26:01 INFO - raptor-output error: no raptor test results found for raptor-wasm-godot-chrome
11:26:01 INFO - raptor-output error: no summarized raptor results found for raptor-wasm-godot-chrome
11:26:01 INFO - raptor-control-server shutting down control server
11:26:01 INFO - raptor-main finished
11:26:01 INFO - raptor-main TEST-UNEXPECTED-FAIL: no raptor test results were found for raptor-wasm-godot-chrome

Comment 1

[Intermittent Failures Robot]

2 failures in 2602 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 2

Platform breakdown:

• macosx64-nightly: 2

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1530088&startday=2019-02-18&endday=2019-02-24&tree=all

Comment 2

[Intermittent Failures Robot]

2 failures in 2981 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 2

Platform breakdown:

• macosx64-nightly: 2

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1530088&startday=2019-02-25&endday=2019-03-03&tree=all

Comment 3

[Intermittent Failures Robot]

9 failures in 2818 pushes (0.003 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 9

Platform breakdown:

• macosx64-nightly: 9

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1530088&startday=2019-03-04&endday=2019-03-10&tree=all

Comment 4

[Intermittent Failures Robot]

16 failures in 2771 pushes (0.006 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 16

Platform breakdown:

• macosx64-nightly: 16

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1530088&startday=2019-03-11&endday=2019-03-17&tree=all

Comment 5

[Intermittent Failures Robot]

12 failures in 2561 pushes (0.005 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 12

Platform breakdown:

• macosx64-nightly: 12

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1530088&startday=2019-03-18&endday=2019-03-24&tree=all

Comment 6

[Intermittent Failures Robot]

27 failures in 3910 pushes (0.007 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 27

Platform breakdown:

• macosx64-nightly: 1
• osx-10-10-shippable: 26

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1530088&startday=2019-03-25&endday=2019-03-31&tree=all

Comment 7

[Intermittent Failures Robot]

41 failures in 2843 pushes (0.014 failures/push) were associated with this bug in the last 7 days.

** This failure happened more than 30 times this week! Resolving this bug is a high priority. **

** Try to resolve this bug as soon as possible. If unresolved for 2 weeks, the affected test(s) may be disabled. **

Repository breakdown:

• mozilla-central: 41

Platform breakdown:

• osx-10-10-shippable: 37
• windows7-32-shippable: 2
• windows10-64-shippable: 2

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1530088&startday=2019-04-01&endday=2019-04-07&tree=all

Comment 8

[Intermittent Failures Robot]

9 failures in 3025 pushes (0.003 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 9

Platform breakdown:

• osx-10-10-shippable: 6
• windows10-64-shippable: 3

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1530088&startday=2019-04-08&endday=2019-04-14&tree=all

Comment 9

[Robert Wood [:rwood]]

Obsolete, test names were changed to *-chromium