1728402 - Permanent [Tier 2] raptor-main Critical: test 'raptor-youtube-playback-h264' could not be found for firefox

Status: RESOLVED FIXED

(Testing :: Raptor, defect, P5)

Description

[Treeherder Bug Filer]

Filed by: ccozmuta [at] mozilla.com
Parsed log: https://treeherder.mozilla.org/logviewer?job_id=350086457&repo=mozilla-central
Full log: https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/K4FGZeMhRheImSRRCmoL_g/runs/0/artifacts/public/logs/live_backing.log

---

[task 2021-08-31T17:40:01.942Z] 17:40:01     INFO - Running command: ['/Users/cltbld/tasks/task_1630431533/build/venv/bin/python', '--version']
[task 2021-08-31T17:40:01.942Z] 17:40:01     INFO - Copy/paste: /Users/cltbld/tasks/task_1630431533/build/venv/bin/python --version
[task 2021-08-31T17:40:01.949Z] 17:40:01     INFO -  Python 3.7.4
[task 2021-08-31T17:40:02.052Z] 17:40:01     INFO - Return code: 0
[task 2021-08-31T17:40:02.052Z] 17:40:01     INFO - ENV: MOZ_UPLOAD_DIR is now /Users/cltbld/tasks/task_1630431533/build/blobber_upload_dir
[task 2021-08-31T17:40:02.052Z] 17:40:01     INFO - ENV: MINIDUMP_STACKWALK is now /Users/cltbld/tasks/task_1630431533/fetches/minidump_stackwalk/minidump_stackwalk
[task 2021-08-31T17:40:02.052Z] 17:40:01     INFO - ENV: MINIDUMP_SAVE_PATH is now /Users/cltbld/tasks/task_1630431533/build/blobber_upload_dir
[task 2021-08-31T17:40:02.052Z] 17:40:01     INFO - ENV: RUST_BACKTRACE is now full
[task 2021-08-31T17:40:02.052Z] 17:40:01     INFO - Running command: ['/Users/cltbld/tasks/task_1630431533/build/venv/bin/python', '/Users/cltbld/tasks/task_1630431533/build/tests/raptor/raptor/raptor.py', '--power-test', '--enable-webrender', '--setpref=extensions.logging.enabled=true', '--setpref=fission.autostart=true', '--app', 'firefox', '--binary', '/Users/cltbld/tasks/task_1630431533/build/application/Firefox Nightly.app/Contents/MacOS/firefox', '--test', 'raptor-youtube-playback-h264', '--symbolsPath', 'https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/MBmt_BBsRnW3ImAtpu8TNQ/artifacts/public/build/target.crashreporter-symbols.zip', '--host', '127.0.0.1', '--log-tbpl-level=debug'] in /Users/cltbld/tasks/task_1630431533/build
[task 2021-08-31T17:40:02.052Z] 17:40:01     INFO - Copy/paste: /Users/cltbld/tasks/task_1630431533/build/venv/bin/python /Users/cltbld/tasks/task_1630431533/build/tests/raptor/raptor/raptor.py --power-test --enable-webrender --setpref=extensions.logging.enabled=true --setpref=fission.autostart=true --app firefox --binary "/Users/cltbld/tasks/task_1630431533/build/application/Firefox Nightly.app/Contents/MacOS/firefox" --test raptor-youtube-playback-h264 --symbolsPath https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/MBmt_BBsRnW3ImAtpu8TNQ/artifacts/public/build/target.crashreporter-symbols.zip --host 127.0.0.1 --log-tbpl-level=debug
[task 2021-08-31T17:40:02.052Z] 17:40:01     INFO - Using env: {'Apple_PubSub_Socket_Render': '/private/tmp/com.apple.launchd.v7BwiZPs7X/Render',
[task 2021-08-31T17:40:02.052Z] 17:40:01     INFO -  'EXTERNALTOOLSPATH': '/Users/cltbld/tasks/task_1630431533/mozharness/external_tools',
[task 2021-08-31T17:40:02.052Z] 17:40:01     INFO -  'EXTRA_MOZHARNESS_CONFIG': '{"installer_url": '
[task 2021-08-31T17:40:02.052Z] 17:40:01     INFO -                             '"https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/MBmt_BBsRnW3ImAtpu8TNQ/artifacts/public/build/target.dmg", '
[task 2021-08-31T17:40:02.054Z] 17:40:01     INFO -                             '"test_packages_url": '
[task 2021-08-31T17:40:02.055Z] 17:40:01     INFO -                             '"https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/MBmt_BBsRnW3ImAtpu8TNQ/artifacts/public/build/target.test_packages.json"}',
[task 2021-08-31T17:40:02.055Z] 17:40:01     INFO -  'GECKO_HEAD_REPOSITORY': 'https://hg.mozilla.org/mozilla-central',
[task 2021-08-31T17:40:02.055Z] 17:40:01     INFO -  'GECKO_HEAD_REV': '86d5ab060da872600c5e17557c316f806bdb1811',
[task 2021-08-31T17:40:02.055Z] 17:40:01     INFO -  'HOME': '/Users/cltbld',
[task 2021-08-31T17:40:02.055Z] 17:40:01     INFO -  'LANG': 'en_US.UTF-8',
[task 2021-08-31T17:40:02.055Z] 17:40:01     INFO -  'LC_ALL': 'en_US.UTF-8',
[task 2021-08-31T17:40:02.055Z] 17:40:01     INFO -  'LOGNAME': 'cltbld',
[task 2021-08-31T17:40:02.055Z] 17:40:01     INFO -  'MINIDUMP_SAVE_PATH': '/Users/cltbld/tasks/task_1630431533/build/blobber_upload_dir',
[task 2021-08-31T17:40:02.055Z] 17:40:01     INFO -  'MINIDUMP_STACKWALK': '/Users/cltbld/tasks/task_1630431533/fetches/minidump_stackwalk/minidump_stackwalk',
[task 2021-08-31T17:40:02.055Z] 17:40:01     INFO -  'MOZ_AUTOMATION': '1',
[task 2021-08-31T17:40:02.055Z] 17:40:01     INFO -  'MOZ_FETCHES': '[{"artifact": "public/build/fix-stacks.tar.xz", "extract": '
[task 2021-08-31T17:40:02.055Z] 17:40:01     INFO -                 'true, "task": "ZTPzAD-yROGhHwMo23gAhQ"}, {"artifact": '
[task 2021-08-31T17:40:02.055Z] 17:40:01     INFO -                 '"public/build/minidump_stackwalk.tar.xz", "extract": true, '
[task 2021-08-31T17:40:02.055Z] 17:40:01     INFO -                 '"task": "VIf0C5UMTr-L0HC0K8zv6A"}]',
[task 2021-08-31T17:40:02.055Z] 17:40:01     INFO -  'MOZ_FETCHES_DIR': '/Users/cltbld/tasks/task_1630431533/fetches',
[task 2021-08-31T17:40:02.055Z] 17:40:01     INFO -  'MOZ_NODE_PATH': '/usr/local/bin/node',
[task 2021-08-31T17:40:02.055Z] 17:40:01     INFO -  'MOZ_SCM_LEVEL': '3',
[task 2021-08-31T17:40:02.055Z] 17:40:01     INFO -  'MOZ_UPLOAD_DIR': '/Users/cltbld/tasks/task_1630431533/build/blobber_upload_dir',
[task 2021-08-31T17:40:02.055Z] 17:40:01     INFO -  'PATH': '/Users/cltbld/tasks/task_1630431533/build/venv/bin:/usr/local/bin:/usr/bin:/bin:/usr/sbin:/sbin',
[task 2021-08-31T17:40:02.055Z] 17:40:01     INFO -  'PWD': '/Users/cltbld',
[task 2021-08-31T17:40:02.056Z] 17:40:01     INFO -  'PYTHON': '/usr/local/bin/python3',
[task 2021-08-31T17:40:02.056Z] 17:40:01     INFO -  'PYTHONPATH': '/Users/cltbld/tasks/task_1630431533/build/tests/raptor',
[task 2021-08-31T17:40:02.056Z] 17:40:01     INFO -  'RUST_BACKTRACE': 'full',
[task 2021-08-31T17:40:02.056Z] 17:40:01     INFO -  'SCCACHE_DISABLE': '1',
[task 2021-08-31T17:40:02.056Z] 17:40:01     INFO -  'SCRIPTSPATH': '/Users/cltbld/tasks/task_1630431533/mozharness',
[task 2021-08-31T17:40:02.056Z] 17:40:01     INFO -  'SHELL': '/bin/bash',
[task 2021-08-31T17:40:02.056Z] 17:40:01     INFO -  'SHLVL': '1',
[task 2021-08-31T17:40:02.056Z] 17:40:01     INFO -  'SSH_AUTH_SOCK': '/private/tmp/com.apple.launchd.jkHFjRlajd/Listeners',
[task 2021-08-31T17:40:02.056Z] 17:40:01     INFO -  'TASKCLUSTER_ROOT_URL': 'https://firefox-ci-tc.services.mozilla.com',
[task 2021-08-31T17:40:02.056Z] 17:40:01     INFO -  'TASK_ID': 'K4FGZeMhRheImSRRCmoL_g',
[task 2021-08-31T17:40:02.056Z] 17:40:01     INFO -  'TMPDIR': '/var/folders/tn/_vsdcf552mld_85dlscpgsp0000017/T/',
[task 2021-08-31T17:40:02.056Z] 17:40:01     INFO -  'USER': 'cltbld',
[task 2021-08-31T17:40:02.056Z] 17:40:01     INFO -  'VIRTUAL_ENV': '/Users/cltbld/tasks/task_1630431533/build/venv',
[task 2021-08-31T17:40:02.056Z] 17:40:01     INFO -  'XPC_FLAGS': '0x0',
[task 2021-08-31T17:40:02.056Z] 17:40:01     INFO -  'XPC_SERVICE_NAME': '0',
[task 2021-08-31T17:40:02.056Z] 17:40:01     INFO -  '_': '/usr/local/bin/generic-worker',
[task 2021-08-31T17:40:02.056Z] 17:40:01     INFO -  '__CF_USER_TEXT_ENCODING': '0x27:0:0'}
[task 2021-08-31T17:40:02.056Z] 17:40:01     INFO - Calling ['/Users/cltbld/tasks/task_1630431533/build/venv/bin/python', '/Users/cltbld/tasks/task_1630431533/build/tests/raptor/raptor/raptor.py', '--power-test', '--enable-webrender', '--setpref=extensions.logging.enabled=true', '--setpref=fission.autostart=true', '--app', 'firefox', '--binary', '/Users/cltbld/tasks/task_1630431533/build/application/Firefox Nightly.app/Contents/MacOS/firefox', '--test', 'raptor-youtube-playback-h264', '--symbolsPath', 'https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/MBmt_BBsRnW3ImAtpu8TNQ/artifacts/public/build/target.crashreporter-symbols.zip', '--host', '127.0.0.1', '--log-tbpl-level=debug'] with output_timeout 3600
[task 2021-08-31T17:40:02.511Z] 17:40:02     INFO -  raptor-main Info: Python version: 3.7.4 (v3.7.4:e09359112e, Jul  8 2019, 14:54:52)
[task 2021-08-31T17:40:02.511Z] 17:40:02     INFO -  [Clang 6.0 (clang-600.0.57)]
[task 2021-08-31T17:40:02.512Z] 17:40:02     INFO -  raptor-main Info: raptor-start
[task 2021-08-31T17:40:02.513Z] 17:40:02     INFO -  raptor-main Info: received command line arguments: Namespace(activity=None, app='firefox', binary='/Users/cltbld/tasks/task_1630431533/build/application/Firefox Nightly.app/Contents/MacOS/firefox', browser_cycles=None, browsertime=False, browsertime_browsertimejs=None, browsertime_chromedriver=None, browsertime_ffmpeg=None, browsertime_geckodriver=None, browsertime_no_ffwindowrecorder=False, browsertime_node=None, browsertime_video=False, browsertime_vismet_script=None, browsertime_visualmetrics=False, chimera=False, cold=False, conditioned_profile=None, cpu_test=False, debug_mode=False, device_name=None, disable_perf_tuning=False, e10s=True, enable_fission=True, enable_marionette_trace=False, enable_webrender=True, environment={}, extra_prefs={'extensions.logging.enabled': True, 'fission.autostart': True}, gecko_profile=False, gecko_profile_entries=None, gecko_profile_extra_threads=[], gecko_profile_features=None, gecko_profile_interval=None, gecko_profile_threads=None, host='127.0.0.1', installerpath=None, intent=None, is_release_build=False, live_sites=False, log_errorsummary=None, log_grouped=None, log_html=None, log_mach=None, log_mach_buffer=None, log_mach_level=None, log_mach_screenshot=None, log_mach_verbose=None, log_raw=None, log_raw_level=None, log_tbpl=None, log_tbpl_buffer=None, log_tbpl_compact=None, log_tbpl_level='debug', log_unittest=None, log_xunit=None, memory_test=False, noinstall=False, obj_path=None, page_cycles=None, page_timeout=None, post_startup_delay=30000, power_test=True, project='mozilla-central', run_local=False, symbols_path='https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/MBmt_BBsRnW3ImAtpu8TNQ/artifacts/public/build/target.crashreporter-symbols.zip', test='raptor-youtube-playback-h264', test_url_params=None, verbose=False)
[task 2021-08-31T17:40:02.513Z] 17:40:02     INFO -  raptor-manifest Info: /Users/cltbld/tasks/task_1630431533/build/tests/raptor/raptor/raptor.ini
[task 2021-08-31T17:40:02.518Z] 17:40:02 CRITICAL -  raptor-main Critical: test 'raptor-youtube-playback-h264' could not be found for firefox
[task 2021-08-31T17:40:02.571Z] 17:40:02    ERROR - Return code: 1
[task 2021-08-31T17:40:02.571Z] 17:40:02  WARNING - setting return code to 1
[task 2021-08-31T17:40:02.571Z] 17:40:02     INFO - Copying Raptor results to upload dir:
[task 2021-08-31T17:40:02.571Z] 17:40:02     INFO - /Users/cltbld/tasks/task_1630431533/build/blobber_upload_dir/perfherder-data.json
[task 2021-08-31T17:40:02.571Z] 17:40:02     INFO - Copying raptor results from /Users/cltbld/tasks/task_1630431533/build/raptor.json to /Users/cltbld/tasks/task_1630431533/build/blobber_upload_dir/perfherder-data.json
[task 2021-08-31T17:40:02.571Z] 17:40:02 CRITICAL - Error copying results /Users/cltbld/tasks/task_1630431533/build/raptor.json to upload dir /Users/cltbld/tasks/task_1630431533/build/blobber_upload_dir/perfherder-data.json
[task 2021-08-31T17:40:02.572Z] 17:40:02     INFO - [Errno 2] No such file or directory: '/Users/cltbld/tasks/task_1630431533/build/raptor.json'
[task 2021-08-31T17:40:02.573Z] 17:40:02     INFO - Running post-action listener: _package_coverage_data
[task 2021-08-31T17:40:02.573Z] 17:40:02     INFO - Running post-action listener: _resource_record_post_action
[task 2021-08-31T17:40:02.573Z] 17:40:02     INFO - Running post-action listener: process_java_coverage_data
[task 2021-08-31T17:40:02.573Z] 17:40:02     INFO - Running post-action listener: stop_device
[task 2021-08-31T17:40:02.573Z] 17:40:02     INFO - [mozharness: 2021-08-31 17:40:02.573262Z] Finished run-tests step (success)
[task 2021-08-31T17:40:02.573Z] 17:40:02     INFO - Running post-run listener: _resource_record_post_run
[task 2021-08-31T17:40:02.632Z] 17:40:02     INFO - Total resource usage - Wall time: 29s; CPU: 12%; Read bytes: 446649856; Write bytes: 445407232; Read time: 25756; Write time: 689
[task 2021-08-31T17:40:02.632Z] 17:40:02     INFO - TinderboxPrint: CPU usage<br/>12.5%
[task 2021-08-31T17:40:02.632Z] 17:40:02     INFO - TinderboxPrint: I/O read bytes / time<br/>446,649,856 / 25,756
[task 2021-08-31T17:40:02.632Z] 17:40:02     INFO - TinderboxPrint: I/O write bytes / time<br/>445,407,232 / 689
[task 2021-08-31T17:40:02.632Z] 17:40:02     INFO - TinderboxPrint: CPU idle<br/>301.5 (87.5%)
[task 2021-08-31T17:40:02.632Z] 17:40:02     INFO - TinderboxPrint: CPU user<br/>42.1 (12.2%)
[task 2021-08-31T17:40:02.632Z] 17:40:02     INFO - TinderboxPrint: Swap in / out<br/>444,809,216 / 0
[task 2021-08-31T17:40:02.632Z] 17:40:02     INFO - install-chromium-distribution - Wall time: 0s; CPU: Can't collect data; Read bytes: 0; Write bytes: 0; Read time: 0; Write time: 0
[task 2021-08-31T17:40:02.633Z] 17:40:02     INFO - install - Wall time: 29s; CPU: 12%; Read bytes: 446649856; Write bytes: 445407232; Read time: 25756; Write time: 689
[task 2021-08-31T17:40:02.633Z] 17:40:02     INFO - run-tests - Wall time: 1s; CPU: Can't collect data; Read bytes: 0; Write bytes: 0; Read time: 0; Write time: 0
[task 2021-08-31T17:40:02.640Z] 17:40:02  WARNING - returning nonzero exit status 1
[taskcluster 2021-08-31T17:40:02.664Z]    Exit Code: 1
[taskcluster 2021-08-31T17:40:02.664Z]    User Time: 44.374838s
[taskcluster 2021-08-31T17:40:02.664Z]  Kernel Time: 6.473958s
[taskcluster 2021-08-31T17:40:02.664Z]    Wall Time: 1m8.868830393s
[taskcluster 2021-08-31T17:40:02.664Z]       Result: FAILED
[taskcluster 2021-08-31T17:40:02.664Z] === Task Finished ===

Comment 1

[Alexandru Ionescu (needinfo me) [:alexandrui]]

Please backout the patch, we're going to fix it.

Comment 2

[Alexandru Ionescu (needinfo me) [:alexandrui]]

Sorry, this error wasn't caught by taskgraph nor perfdocs.

Comment 3

[Cristian Tuns]

Fixed by the bug 1727919

Comment 4

[Intermittent Failures Robot]

12 failures in 3084 pushes (0.004 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 12

Platform and build breakdown:

• macosx1015-64-shippable-qr: 12
  • opt: 12

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1728402&startday=2021-08-30&endday=2021-09-05&tree=all