1781769 - Perma Btime [tier 2] raptor-main Critical: test 'twitch-animation' could not be found for chrome

Status: RESOLVED FIXED

(Testing :: Raptor, defect, P5)

Description

[Treeherder Bug Filer]

Filed by: ctuns [at] mozilla.com
Parsed log: https://treeherder.mozilla.org/logviewer?job_id=385563925&repo=mozilla-central
Full log: https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/KxnvVKQ_Rgy1MzCQXsjOeQ/runs/0/artifacts/public/logs/live_backing.log

---

[task 2022-07-27T11:36:49.061Z] 11:36:49     INFO -                 '"task": "UBuzyT_IRRqzc6Ygjd8Tcw"}]',
[task 2022-07-27T11:36:49.061Z] 11:36:49     INFO -  'MOZ_FETCHES_DIR': '/opt/worker/tasks/task_165892169903906/fetches',
[task 2022-07-27T11:36:49.061Z] 11:36:49     INFO -  'MOZ_NODE_PATH': '/usr/local/bin/node',
[task 2022-07-27T11:36:49.061Z] 11:36:49     INFO -  'MOZ_SCM_LEVEL': '3',
[task 2022-07-27T11:36:49.061Z] 11:36:49     INFO -  'MOZ_UPLOAD_DIR': '/opt/worker/tasks/task_165892169903906/build/blobber_upload_dir',
[task 2022-07-27T11:36:49.061Z] 11:36:49     INFO -  'PATH': '/opt/worker/tasks/task_165892169903906/build/venv/bin:/usr/local/bin:/usr/bin:/bin:/usr/sbin:/sbin',
[task 2022-07-27T11:36:49.061Z] 11:36:49     INFO -  'PWD': '/opt/worker',
[task 2022-07-27T11:36:49.061Z] 11:36:49     INFO -  'PYTHON': '/usr/local/bin/python3',
[task 2022-07-27T11:36:49.061Z] 11:36:49     INFO -  'PYTHONPATH': '/opt/worker/tasks/task_165892169903906/build/tests/raptor',
[task 2022-07-27T11:36:49.061Z] 11:36:49     INFO -  'REQUIRE_GPU': '0',
[task 2022-07-27T11:36:49.061Z] 11:36:49     INFO -  'RUN_ID': '0',
[task 2022-07-27T11:36:49.061Z] 11:36:49     INFO -  'RUST_BACKTRACE': 'full',
[task 2022-07-27T11:36:49.061Z] 11:36:49     INFO -  'SCCACHE_DISABLE': '1',
[task 2022-07-27T11:36:49.061Z] 11:36:49     INFO -  'SCRIPTSPATH': '/opt/worker/tasks/task_165892169903906/mozharness',
[task 2022-07-27T11:36:49.061Z] 11:36:49     INFO -  'SHELL': '/bin/bash',
[task 2022-07-27T11:36:49.061Z] 11:36:49     INFO -  'SHLVL': '1',
[task 2022-07-27T11:36:49.061Z] 11:36:49     INFO -  'SSH_AUTH_SOCK': '/private/tmp/com.apple.launchd.10CxAxTdS6/Listeners',
[task 2022-07-27T11:36:49.061Z] 11:36:49     INFO -  'TASKCLUSTER_PROXY_URL': 'http://localhost:8080',
[task 2022-07-27T11:36:49.061Z] 11:36:49     INFO -  'TASKCLUSTER_ROOT_URL': 'https://firefox-ci-tc.services.mozilla.com',
[task 2022-07-27T11:36:49.061Z] 11:36:49     INFO -  'TASK_ID': 'KxnvVKQ_Rgy1MzCQXsjOeQ',
[task 2022-07-27T11:36:49.061Z] 11:36:49     INFO -  'TMPDIR': '/var/folders/yd/wh778c817ynfkm9q05607zr4000014/T/',
[task 2022-07-27T11:36:49.061Z] 11:36:49     INFO -  'USER': 'cltbld',
[task 2022-07-27T11:36:49.061Z] 11:36:49     INFO -  'VIRTUAL_ENV': '/opt/worker/tasks/task_165892169903906/build/venv',
[task 2022-07-27T11:36:49.061Z] 11:36:49     INFO -  'XPC_FLAGS': '0x0',
[task 2022-07-27T11:36:49.061Z] 11:36:49     INFO -  'XPC_SERVICE_NAME': '0',
[task 2022-07-27T11:36:49.061Z] 11:36:49     INFO -  '_': '/usr/local/bin/start-worker',
[task 2022-07-27T11:36:49.061Z] 11:36:49     INFO -  '__CF_USER_TEXT_ENCODING': '0x24:0x0:0x0'}
[task 2022-07-27T11:36:49.062Z] 11:36:49     INFO - Calling ['/opt/worker/tasks/task_165892169903906/build/venv/bin/python', '/opt/worker/tasks/task_165892169903906/build/tests/raptor/raptor/raptor.py', '--browsertime-node', '/opt/worker/tasks/task_165892169903906/fetches/node/bin/node', '--browsertime-browsertimejs', '/opt/worker/tasks/task_165892169903906/fetches/browsertime/node_modules/browsertime/bin/browsertime.js', '--browsertime-chromedriver', '/opt/worker/tasks/task_165892169903906/fetches/{}chromedriver', '--browsertime-ffmpeg', '/opt/worker/tasks/task_165892169903906/fetches/ffmpeg-4.1.1-macos64-static/bin/ffmpeg', '--browsertime-geckodriver', '/opt/worker/tasks/task_165892169903906/fetches/geckodriver', '--browsertime', '--app', 'chrome', '--binary', '/Applications/Google Chrome.app/Contents/MacOS/Google Chrome', '--test', 'twitch-animation', '--symbolsPath', 'https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/bWe72dUySzKNPunZka62QQ/artifacts/public/build/target.crashreporter-symbols.zip', '--conditioned-profile', 'settled', '--host', '127.0.0.1', '--log-tbpl-level=debug'] with output_timeout 3600
[task 2022-07-27T11:36:49.569Z] 11:36:49     INFO -  Fission enabled through browser preferences
[task 2022-07-27T11:36:49.569Z] 11:36:49     INFO -  raptor-main Info: Python version: 3.7.9 (v3.7.9:13c94747c7, Aug 15 2020, 01:31:08)
[task 2022-07-27T11:36:49.570Z] 11:36:49     INFO -  [Clang 6.0 (clang-600.0.57)]
[task 2022-07-27T11:36:49.570Z] 11:36:49     INFO -  raptor-main Info: raptor-start
[task 2022-07-27T11:36:49.571Z] 11:36:49     INFO -  raptor-main Info: received command line arguments: Namespace(activity=None, app='chrome', binary='/Applications/Google Chrome.app/Contents/MacOS/Google Chrome', browser_cycles=None, browsertime=True, browsertime_browsertimejs='/opt/worker/tasks/task_165892169903906/fetches/browsertime/node_modules/browsertime/bin/browsertime.js', browsertime_chromedriver='/opt/worker/tasks/task_165892169903906/fetches/{}chromedriver', browsertime_existing_results=None, browsertime_ffmpeg='/opt/worker/tasks/task_165892169903906/fetches/ffmpeg-4.1.1-macos64-static/bin/ffmpeg', browsertime_geckodriver='/opt/worker/tasks/task_165892169903906/fetches/geckodriver', browsertime_no_ffwindowrecorder=False, browsertime_node='/opt/worker/tasks/task_165892169903906/fetches/node/bin/node', browsertime_user_args=[], browsertime_video=False, browsertime_vismet_script=None, browsertime_visualmetrics=False, chimera=False, clean=False, cold=False, collect_perfstats=False, conditioned_profile='settled', cpu_test=False, debug_mode=False, device_name=None, disable_perf_tuning=False, e10s=True, enable_marionette_trace=False, environment={}, extra_prefs={'fission.autostart': True}, fission=True, fission_mobile=False, gecko_profile=False, gecko_profile_entries=None, gecko_profile_extra_threads=[], gecko_profile_features=None, gecko_profile_interval=None, gecko_profile_threads=None, host='127.0.0.1', installerpath=None, intent=None, is_release_build=False, live_sites=False, log_errorsummary=None, log_grouped=None, log_html=None, log_mach=None, log_mach_buffer=None, log_mach_level=None, log_mach_screenshot=None, log_mach_verbose=None, log_raw=None, log_raw_level=None, log_tbpl=None, log_tbpl_buffer=None, log_tbpl_compact=None, log_tbpl_level='debug', log_unittest=None, log_xunit=None, memory_test=False, noinstall=False, obj_path=None, page_cycles=None, page_timeout=None, post_startup_delay=30000, power_test=False, project='mozilla-central', run_local=False, symbols_path='https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/bWe72dUySzKNPunZka62QQ/artifacts/public/build/target.crashreporter-symbols.zip', test='twitch-animation', test_bytecode_cache=False, test_url_params=None, verbose=False, webext=False)
[task 2022-07-27T11:36:49.572Z] 11:36:49     INFO -  raptor-manifest Info: /opt/worker/tasks/task_165892169903906/build/tests/raptor/raptor/raptor.ini
[task 2022-07-27T11:36:49.577Z] 11:36:49 CRITICAL -  raptor-main Critical: test 'twitch-animation' could not be found for chrome
[task 2022-07-27T11:36:49.651Z] 11:36:49    ERROR - Return code: 1
[task 2022-07-27T11:36:49.652Z] 11:36:49  WARNING - setting return code to 1
[task 2022-07-27T11:36:49.652Z] 11:36:49     INFO - Copying Raptor results to upload dir:
[task 2022-07-27T11:36:49.652Z] 11:36:49     INFO - /opt/worker/tasks/task_165892169903906/build/blobber_upload_dir/perfherder-data.json
[task 2022-07-27T11:36:49.652Z] 11:36:49     INFO - Copying raptor results from /opt/worker/tasks/task_165892169903906/build/raptor.json to /opt/worker/tasks/task_165892169903906/build/blobber_upload_dir/perfherder-data.json
[task 2022-07-27T11:36:49.652Z] 11:36:49 CRITICAL - Error copying results /opt/worker/tasks/task_165892169903906/build/raptor.json to upload dir /opt/worker/tasks/task_165892169903906/build/blobber_upload_dir/perfherder-data.json
[task 2022-07-27T11:36:49.652Z] 11:36:49     INFO - [Errno 2] No such file or directory: '/opt/worker/tasks/task_165892169903906/build/raptor.json'
[task 2022-07-27T11:36:49.653Z] 11:36:49     INFO - Running post-action listener: _package_coverage_data
[task 2022-07-27T11:36:49.653Z] 11:36:49     INFO - Running post-action listener: _resource_record_post_action
[task 2022-07-27T11:36:49.653Z] 11:36:49     INFO - Running post-action listener: process_java_coverage_data
[task 2022-07-27T11:36:49.653Z] 11:36:49     INFO - Running post-action listener: stop_device
[task 2022-07-27T11:36:49.653Z] 11:36:49     INFO - [mozharness: 2022-07-27 11:36:49.653788Z] Finished run-tests step (success)
[task 2022-07-27T11:36:49.653Z] 11:36:49     INFO - Running post-run listener: _resource_record_post_run
[task 2022-07-27T11:36:49.716Z] 11:36:49     INFO - Total resource usage - Wall time: 34s; CPU: 14%; Read bytes: 7458816; Write bytes: 462995456; Read time: 403; Write time: 631
[task 2022-07-27T11:36:49.716Z] 11:36:49     INFO - TinderboxPrint: CPU usage<br/>13.6%
[task 2022-07-27T11:36:49.716Z] 11:36:49     INFO - TinderboxPrint: I/O read bytes / time<br/>7,458,816 / 403
[task 2022-07-27T11:36:49.716Z] 11:36:49     INFO - TinderboxPrint: I/O write bytes / time<br/>462,995,456 / 631
[task 2022-07-27T11:36:49.716Z] 11:36:49     INFO - TinderboxPrint: CPU idle<br/>348.3 (86.4%)
[task 2022-07-27T11:36:49.716Z] 11:36:49     INFO - TinderboxPrint: CPU system<br/>5.3 (1.3%)
[task 2022-07-27T11:36:49.716Z] 11:36:49     INFO - TinderboxPrint: CPU user<br/>49.4 (12.3%)
[task 2022-07-27T11:36:49.716Z] 11:36:49     INFO - TinderboxPrint: Swap in / out<br/>441,618,432 / 0
[task 2022-07-27T11:36:49.716Z] 11:36:49     INFO - install-chromium-distribution - Wall time: 0s; CPU: Can't collect data; Read bytes: 0; Write bytes: 0; Read time: 0; Write time: 0
[task 2022-07-27T11:36:49.717Z] 11:36:49     INFO - install - Wall time: 33s; CPU: 14%; Read bytes: 440669696; Write bytes: 449257472; Read time: 29807; Write time: 612
[task 2022-07-27T11:36:49.717Z] 11:36:49     INFO - run-tests - Wall time: 1s; CPU: Can't collect data; Read bytes: 0; Write bytes: 0; Read time: 0; Write time: 0
[task 2022-07-27T11:36:49.726Z] 11:36:49  WARNING - returning nonzero exit status 1
[taskcluster 2022-07-27T11:36:49.752Z]    Exit Code: 1
[taskcluster 2022-07-27T11:36:49.752Z]    User Time: 1m7.321885s
[taskcluster 2022-07-27T11:36:49.752Z]  Kernel Time: 17.347073s
[taskcluster 2022-07-27T11:36:49.752Z]    Wall Time: 1m46.195237s
[taskcluster 2022-07-27T11:36:49.752Z]       Result: FAILED
[taskcluster 2022-07-27T11:36:49.752Z] === Task Finished ===
[taskcluster 2022-07-27T11:36:49.752Z] Task Duration: 1m46.201511s
[taskcluster 2022-07-27T11:36:49.856Z] Uploading artifact public/logs/localconfig.json from file logs/localconfig.json with content encoding "gzip", mime type "application/json" and expiry 2023-07-27T10:33:12.037Z
[taskcluster 2022-07-27T11:36:50.154Z] Uploading artifact public/test_info/resource-usage.json from file build/blobber_upload_dir/resource-usage.json with content encoding "gzip", mime type "application/json" and expiry 2023-07-27T10:33:12.037Z
[taskcluster 2022-07-27T11:36:50.352Z] Uploading redirect artifact public/logs/live.log to URL https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/KxnvVKQ_Rgy1MzCQXsjOeQ/runs/0/artifacts/public%2Flogs%2Flive_backing.log with mime type "text/plain; charset=utf-8" and expiry 2023-07-27T10:33:12.037Z
[taskcluster:error] exit status 1

Comment 1

[Greg Mierzwinski [:sparky]]

:jrmuizel, you'll either need to disable this test on chrome browsers, or enable it on those browsers by adding the chrome app to the manifest file.

To disable it, you'll need to add this to here: https://searchfox.org/mozilla-central/source/taskcluster/ci/test/browsertime-desktop.yml#236

apps:
    by-subtest:
        twitch-animation: [firefox]
        default: [firefox, chrome, chromium]

Comment 2

[Jeff Muizelaar [:jrmuizel]]

Attachment: Bug 1781769. Don't run twitch-animation on Chrome.

Comment 3

[BugBot [:suhaib / :marco/ :calixte]]

Set release status flags based on info from the regressing bug 1780826

Comment 4

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/autoland/rev/e539aaccbcb1
Don't run twitch-animation on Chrome. r=sparky,perftest-reviewers

Comment 5

[Norisz Fay [:noriszfay]]

https://hg.mozilla.org/mozilla-central/rev/e539aaccbcb1

Comment 6

[Intermittent Failures Robot]

10 failures in 3245 pushes (0.003 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 10

Platform and build breakdown:

• linux1804-64-shippable-qr: 2
  • opt: 2
• windows10-64-shippable-qr: 6
  • opt: 6
• macosx1015-64-shippable-qr: 2
  • opt: 2

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1781769&startday=2022-07-25&endday=2022-07-31&tree=all