Closed Bug 1694243 Opened 5 years ago Closed 4 years ago

Intermittent Automation Error: mozprocess timed out after 600 seconds running ['c:\\mozilla-build\\python\\python.exe', '-u', 'C:\\Users\\task_1614019684\\mozharness\\external_tools\\tooltool.py', 'fetch', '-m', 'C:\\Users\\task_1614019684\\build\\tests\\

Categories

(Release Engineering :: General, defect, P5)

Tracking

(Not tracked)

RESOLVED INACTIVE

People

(Reporter: intermittent-bug-filer, Unassigned)

Details

(Keywords: intermittent-failure)

Filed by: malexandru [at] mozilla.com
Parsed log: https://treeherder.mozilla.org/logviewer?job_id=330786887&repo=mozilla-central
Full log: https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/EgUNG-QBQ0-YqHpy49exVQ/runs/0/artifacts/public/logs/live_backing.log


[taskcluster 2021-02-22T19:19:03.283Z] Worker Type (releng-hardware/gecko-t-win10-64-1803-hw) settings:
[taskcluster 2021-02-22T19:19:03.283Z]   {
[taskcluster 2021-02-22T19:19:03.283Z]     "config": {
[taskcluster 2021-02-22T19:19:03.283Z]       "deploymentId": ""
[taskcluster 2021-02-22T19:19:03.283Z]     },
[taskcluster 2021-02-22T19:19:03.283Z]     "generic-worker": {
[taskcluster 2021-02-22T19:19:03.283Z]       "engine": "multiuser",
[taskcluster 2021-02-22T19:19:03.283Z]       "go-arch": "amd64",
[taskcluster 2021-02-22T19:19:03.283Z]       "go-os": "windows",
[taskcluster 2021-02-22T19:19:03.283Z]       "go-version": "go1.10.8",
[taskcluster 2021-02-22T19:19:03.283Z]       "release": "https://github.com/taskcluster/generic-worker/releases/tag/v16.2.0",
[taskcluster 2021-02-22T19:19:03.283Z]       "revision": "b321a877c8f1616d8912399f599c325171f15e95",
[taskcluster 2021-02-22T19:19:03.283Z]       "source": "https://github.com/taskcluster/generic-worker/commits/b321a877c8f1616d8912399f599c325171f15e95",
[taskcluster 2021-02-22T19:19:03.283Z]       "version": "16.2.0"
[taskcluster 2021-02-22T19:19:03.283Z]     }
[taskcluster 2021-02-22T19:19:03.283Z]   }
[taskcluster 2021-02-22T19:19:03.283Z] Task ID: EgUNG-QBQ0-YqHpy49exVQ
[taskcluster 2021-02-22T19:19:03.283Z] === Task Starting ===
[taskcluster 2021-02-22T19:19:04.072Z] Uploading redirect artifact public/logs/live.log to URL https://firefoxci-websocktunnel.services.mozilla.com/mdc2.T-W1064-MS-418.60099/log/XGRtWdpSSxOLIj6YW9N7wA with mime type "text/plain; charset=utf-8" and expiry 2021-02-22T19:54:03.961Z
[taskcluster 2021-02-22T19:19:04.147Z] [mounts] Downloading task PD-FExiORU2hpgeQlpSWng artifact public/build/mozharness.zip to C:\downloads\K2h1w70PTC61jxQF0NecDQ
[taskcluster 2021-02-22T19:19:05.491Z] [mounts] Downloaded 6829236 bytes with SHA256 6864366d2a0adad519dc39756652af78d37ca252bd5183256688efc9798e64e8 from task PD-FExiORU2hpgeQlpSWng artifact public/build/mozharness.zip to C:\downloads\K2h1w70PTC61jxQF0NecDQ
[taskcluster:warn 2021-02-22T19:19:05.492Z] [mounts] Download C:\downloads\K2h1w70PTC61jxQF0NecDQ of task PD-FExiORU2hpgeQlpSWng artifact public/build/mozharness.zip has SHA256 6864366d2a0adad519dc39756652af78d37ca252bd5183256688efc9798e64e8 but task payload does not declare a required value, so content authenticity cannot be verified
[taskcluster 2021-02-22T19:19:05.492Z] [mounts] Creating directory C:\Users\task_1614019684\mozharness with permissions 0700
[taskcluster 2021-02-22T19:19:05.492Z] [mounts] Extracting zip file C:\downloads\K2h1w70PTC61jxQF0NecDQ to 'C:\Users\task_1614019684\mozharness'
[taskcluster 2021-02-22T19:19:05.743Z] [mounts] Granting task_1614019684 full control of directory 'C:\Users\task_1614019684\mozharness'
[taskcluster:warn 2021-02-22T19:19:05.816Z] [mounts] No SHA256 specified in task mounts for urlcontent:https://hg.mozilla.org/mozilla-central/raw-file/aefea952b6974c29eb0503b419c3f3f236165921/taskcluster/scripts/run-task - SHA256 from downloaded file C:\downloads\CheblJQFRhWmUyeZ0dXDXA is ce115c4ec883f2e4f1544079d68b8e96260fda231a8523db60bc55daceefd754.
[taskcluster 2021-02-22T19:19:05.816Z] [mounts] Creating directory C:\Users\task_1614019684 with permissions 0700
[taskcluster 2021-02-22T19:19:05.816Z] [mounts] Copying C:\downloads\CheblJQFRhWmUyeZ0dXDXA to C:\Users\task_1614019684\run-task
[taskcluster 2021-02-22T19:19:05.824Z] [mounts] Granting task_1614019684 full control of file 'C:\Users\task_1614019684\run-task'
[taskcluster:warn 2021-02-22T19:19:05.837Z] [mounts] No SHA256 specified in task mounts for urlcontent:https://hg.mozilla.org/mozilla-central/raw-file/aefea952b6974c29eb0503b419c3f3f236165921/taskcluster/scripts/misc/fetch-content - SHA256 from downloaded file C:\downloads\P6WznWh3SoG790TgpgIzXw is c3e084f90d9b034149c9be7ada12fc0ee41c0e66080ce463654e6ab3ff634c0d.
[taskcluster 2021-02-22T19:19:05.837Z] [mounts] Creating directory C:\Users\task_1614019684 with permissions 0700
[taskcluster 2021-02-22T19:19:05.837Z] [mounts] Copying C:\downloads\P6WznWh3SoG790TgpgIzXw to C:\Users\task_1614019684\fetch-content
[taskcluster 2021-02-22T19:19:05.839Z] [mounts] Granting task_1614019684 full control of file 'C:\Users\task_1614019684\fetch-content'
[taskcluster 2021-02-22T19:19:05.851Z] Executing command 0: C:/mozilla-build/python3/python3.exe run-task -- c:\mozilla-build\python\python.exe -u mozharness\scripts\talos_script.py --cfg mozharness\configs\talos\windows_config.py --suite=tabswitch --use-talos-json --setpref=media.peerconnection.mtransport_process=false --setpref=network.process.enabled=false --download-symbols ondemand
C:\Users\task_1614019684>C:/mozilla-build/python3/python3.exe run-task -- c:\mozilla-build\python\python.exe -u mozharness\scripts\talos_script.py --cfg mozharness\configs\talos\windows_config.py --suite=tabswitch --use-talos-json --setpref=media.peerconnection.mtransport_process=false --setpref=network.process.enabled=false --download-symbols ondemand 
[setup 2021-02-22T19:19:06.027Z] run-task started in C:\Users\task_1614019684
[setup 2021-02-22T19:19:06.028Z] MOZ_FETCHES_DIR is C:/Users/task_1614019684/fetches
[fetches 2021-02-22T19:19:06.028Z] fetching artifacts
[fetches 2021-02-22T19:19:06.035Z] executing ['C:\\mozilla-build\\python3\\python3.exe', '-u', 'fetch-content', 'task-artifacts']
[fetches 2021-02-22T19:19:06.154Z] attempt 1/5
[fetches 2021-02-22T19:19:06.154Z] Downloading https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/e9THQV-5TRCRT43lLsqW2w/artifacts/public/build/fix-stacks.tar.bz2 to C:\Users\task_1614019684\fetches\fix-stacks.tar.bz2
[fetches 2021-02-22T19:19:06.154Z] attempt 1/5
[fetches 2021-02-22T19:19:06.154Z] Downloading https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/YkDho06XSOyYTp4wGlu0Ng/artifacts/public/build/minidump_stackwalk.tar.xz to C:\Users\task_1614019684\fetches\minidump_stackwalk.tar.xz
[fetches 2021-02-22T19:19:06.154Z] Downloading https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/e9THQV-5TRCRT43lLsqW2w/artifacts/public/build/fix-stacks.tar.bz2
[fetches 2021-02-22T19:19:06.155Z] Downloading https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/YkDho06XSOyYTp4wGlu0Ng/artifacts/public/build/minidump_stackwalk.tar.xz
[fetches 2021-02-22T19:19:07.088Z] https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/YkDho06XSOyYTp4wGlu0Ng/artifacts/public/build/minidump_stackwalk.tar.xz resolved to 490088 bytes with sha256 dd105d64c4933dab63bcad52b4cb8571ff2a53c54981f739bb1e523366613c07 in 0.933s
[fetches 2021-02-22T19:19:07.089Z] Extracting C:\Users\task_1614019684\fetches\minidump_stackwalk.tar.xz to C:\Users\task_1614019684\fetches
[fetches 2021-02-22T19:19:07.266Z] C:\Users\task_1614019684\fetches\minidump_stackwalk.tar.xz extracted in 0.177s
[fetches 2021-02-22T19:19:07.267Z] Removing C:\Users\task_1614019684\fetches\minidump_stackwalk.tar.xz
[fetches 2021-02-22T19:19:07.289Z] https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/e9THQV-5TRCRT43lLsqW2w/artifacts/public/build/fix-stacks.tar.bz2 resolved to 1171693 bytes with sha256 aef551b500c9a669e318d43efcf717c617f54a72f1895385929d03fea9cc63d9 in 1.135s
[fetches 2021-02-22T19:19:07.290Z] Extracting C:\Users\task_1614019684\fetches\fix-stacks.tar.bz2 to C:\Users\task_1614019684\fetches
[fetches 2021-02-22T19:19:07.401Z] C:\Users\task_1614019684\fetches\fix-stacks.tar.bz2 extracted in 0.111s
[fetches 2021-02-22T19:19:07.402Z] Removing C:\Users\task_1614019684\fetches\fix-stacks.tar.bz2
[fetches 2021-02-22T19:19:07.403Z] PERFHERDER_DATA: {"framework": {"name": "build_metrics"}, "suites": [{"name": "fetch_content", "value": 1.25, "lowerIsBetter": true, "shouldAlert": false, "subtests": []}]}
[fetches 2021-02-22T19:19:07.417Z] finished fetching artifacts
[task 2021-02-22T19:19:07.417Z] executing ['c:\\mozilla-build\\python\\python.exe', '-u', 'mozharness\\scripts\\talos_script.py', '--cfg', 'mozharness\\configs\\talos\\windows_config.py', '--suite=tabswitch', '--use-talos-json', '--setpref=media.peerconnection.mtransport_process=false', '--setpref=network.process.enabled=false', '--download-symbols', 'ondemand']
[task 2021-02-22T19:19:07.686Z] 19:19:07     INFO - ConsoleLogger online at 20210222 19:19:07Z in C:\Users\task_1614019684
[task 2021-02-22T19:19:07.686Z] 19:19:07     INFO - Run as mozharness\scripts\talos_script.py --cfg mozharness\configs\talos\windows_config.py --suite=tabswitch --use-talos-json --setpref=media.peerconnection.mtransport_process=false --setpref=network.process.enabled=false --download-symbols ondemand
[task 2021-02-22T19:19:07.687Z] 19:19:07     INFO - Dumping config to C:\Users\task_1614019684\logs\localconfig.json.
[task 2021-02-22T19:19:07.690Z] 19:19:07     INFO - {'append_to_log': False,
[task 2021-02-22T19:19:07.690Z] 19:19:07     INFO -  'base_work_dir': 'C:\\Users\\task_1614019684',
[task 2021-02-22T19:19:07.690Z] 19:19:07     INFO -  'code_coverage': False,
[task 2021-02-22T19:19:07.690Z] 19:19:07     INFO -  'config_files': ('mozharness\\configs\\talos\\windows_config.py',),
[task 2021-02-22T19:19:07.690Z] 19:19:07     INFO -  'default_actions': ('clobber',
[task 2021-02-22T19:19:07.690Z] 19:19:07     INFO -                      'download-and-extract',
[task 2021-02-22T19:19:07.690Z] 19:19:07     INFO -                      'populate-webroot',
[task 2021-02-22T19:19:07.691Z] 19:19:07     INFO -                      'create-virtualenv',
[task 2021-02-22T19:19:07.691Z] 19:19:07     INFO -                      'install',
[task 2021-02-22T19:19:07.691Z] 19:19:07     INFO -                      'run-tests'),
[task 2021-02-22T19:19:07.691Z] 19:19:07     INFO -  'disable_ccov_upload': False,
[task 2021-02-22T19:19:07.691Z] 19:19:07     INFO -  'download_symbols': 'ondemand',
[task 2021-02-22T19:19:07.691Z] 19:19:07     INFO -  'e10s': True,
[task 2021-02-22T19:19:07.691Z] 19:19:07     INFO -  'enable_fission': False,
[task 2021-02-22T19:19:07.691Z] 19:19:07     INFO -  'enable_webrender': False,
[task 2021-02-22T19:19:07.691Z] 19:19:07     INFO -  'exes': {'hg': 'C:\\Program Files\\Mercurial\\hg',
[task 2021-02-22T19:19:07.691Z] 19:19:07     INFO -           'python': 'c:\\mozilla-build\\python\\python.exe',
[task 2021-02-22T19:19:07.691Z] 19:19:07     INFO -           'tooltool.py': ('c:\\mozilla-build\\python\\python.exe',
[task 2021-02-22T19:19:07.691Z] 19:19:07     INFO -                           'C:\\mozilla-build\\tooltool.py')},
[task 2021-02-22T19:19:07.691Z] 19:19:07     INFO -  'extra_prefs': ('media.peerconnection.mtransport_process=false',
[task 2021-02-22T19:19:07.691Z] 19:19:07     INFO -                  'network.process.enabled=false'),
[task 2021-02-22T19:19:07.691Z] 19:19:07     INFO -  'find_links': ('https://pypi.pub.build.mozilla.org/pub/',),
[task 2021-02-22T19:19:07.691Z] 19:19:07     INFO -  'gecko_profile': False,
[task 2021-02-22T19:19:07.691Z] 19:19:07     INFO -  'gecko_profile_interval': 0,
[task 2021-02-22T19:19:07.691Z] 19:19:07     INFO -  'installer_path': 'installer.exe',
[task 2021-02-22T19:19:07.692Z] 19:19:07     INFO -  u'installer_url': u'https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/PD-FExiORU2hpgeQlpSWng/artifacts/public/build/target.zip',
[task 2021-02-22T19:19:07.692Z] 19:19:07     INFO -  'java_code_coverage': False,
[task 2021-02-22T19:19:07.692Z] 19:19:07     INFO -  'log_level': 'info',
[task 2021-02-22T19:19:07.692Z] 19:19:07     INFO -  'log_name': 'talos',
[task 2021-02-22T19:19:07.692Z] 19:19:07     INFO -  'log_to_console': True,
[task 2021-02-22T19:19:07.692Z] 19:19:07     INFO -  'opt_config_files': (),
[task 2021-02-22T19:19:07.692Z] 19:19:07     INFO -  'per_test_coverage': False,
[task 2021-02-22T19:19:07.692Z] 19:19:07     INFO -  'pip_index': False,
[task 2021-02-22T19:19:07.692Z] 19:19:07     INFO -  'suite': 'tabswitch',
[task 2021-02-22T19:19:07.692Z] 19:19:07     INFO -  'system_bits': '32',
[task 2021-02-22T19:19:07.692Z] 19:19:07     INFO -  u'test_packages_url': u'https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/PD-FExiORU2hpgeQlpSWng/artifacts/public/build/target.test_packages.json',
[task 2021-02-22T19:19:07.692Z] 19:19:07     INFO -  'title': 'T-W1064-MS-418',
[task 2021-02-22T19:19:07.692Z] 19:19:07     INFO -  'tooltool_cache': 'c:\\build\\tooltool_cache',
[task 2021-02-22T19:19:07.692Z] 19:19:07     INFO -  'use_talos_json': True,
[task 2021-02-22T19:19:07.692Z] 19:19:07     INFO -  'verify': False,
[task 2021-02-22T19:19:07.692Z] 19:19:07     INFO -  'virtualenv_path': 'C:\\Users\\task_1614019684\\build/venv',
[task 2021-02-22T19:19:07.692Z] 19:19:07     INFO -  'volatile_config': {'actions': None, 'add_actions': None, 'no_actions': None},
[task 2021-02-22T19:19:07.692Z] 19:19:07     INFO -  'work_dir': 'build'}
[task 2021-02-22T19:19:07.692Z] 19:19:07     INFO - [mozharness: 2021-02-22 19:19:07.692000Z] Running clobber step.
[task 2021-02-22T19:19:07.693Z] 19:19:07     INFO - Running pre-action listener: _resource_record_pre_action
[task 2021-02-22T19:19:07.693Z] 19:19:07     INFO - Running main action method: clobber
[task 2021-02-22T19:19:07.693Z] 19:19:07     INFO - rmtree: C:\Users\task_1614019684\build
[task 2021-02-22T19:19:07.693Z] 19:19:07     INFO - Using _rmtree_windows ...
[task 2021-02-22T19:19:07.693Z] 19:19:07     INFO - retry: Calling _rmtree_windows with args: ('C:\\Users\\task_1614019684\\build',), kwargs: {}, attempt #1
[task 2021-02-22T19:19:07.693Z] 19:19:07     INFO - Running post-action listener: _resource_record_post_action
[task 2021-02-22T19:19:07.693Z] 19:19:07     INFO - [mozharness: 2021-02-22 19:19:07.693000Z] Finished clobber step (success)
[task 2021-02-22T19:19:07.693Z] 19:19:07     INFO - [mozharness: 2021-02-22 19:19:07.693000Z] Running download-and-extract step.
[task 2021-02-22T19:19:07.693Z] 19:19:07     INFO - Running pre-action listener: _resource_record_pre_action
[task 2021-02-22T19:19:07.693Z] 19:19:07     INFO - Running main action method: download_and_extract
[task 2021-02-22T19:19:07.694Z] 19:19:07     INFO - mkdir: C:\Users\task_1614019684\build\tests
[task 2021-02-22T19:19:07.694Z] 19:19:07     INFO - Downloading https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/PD-FExiORU2hpgeQlpSWng/artifacts/public/build/target.test_packages.json to C:\Users\task_1614019684\build\target.test_packages.json
[task 2021-02-22T19:19:07.694Z] 19:19:07     INFO - retry: Calling _download_file with args: (), kwargs: {'url': u'https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/PD-FExiORU2hpgeQlpSWng/artifacts/public/build/target.test_packages.json', 'file_name': u'C:\\Users\\task_1614019684\\build\\target.test_packages.json'}, attempt #1
[task 2021-02-22T19:19:08.366Z] 19:19:08     INFO - Downloaded 1683 bytes.
[task 2021-02-22T19:19:08.366Z] 19:19:08     INFO - Reading from file C:\Users\task_1614019684\build\target.test_packages.json
[task 2021-02-22T19:19:08.367Z] 19:19:08     INFO - Downloading packages: [u'target.common.tests.tar.gz', u'target.talos.tests.tar.gz'] for test suite categories: ['common', 'talos']
[task 2021-02-22T19:19:08.367Z] 19:19:08     INFO - Downloading and extracting to C:\Users\task_1614019684\build\tests these dirs * from https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/PD-FExiORU2hpgeQlpSWng/artifacts/public/build/target.common.tests.tar.gz
[task 2021-02-22T19:19:08.367Z] 19:19:08     INFO - retry: Calling fetch_url_into_memory with args: (), kwargs: {'url': u'https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/PD-FExiORU2hpgeQlpSWng/artifacts/public/build/target.common.tests.tar.gz'}, attempt #1
[task 2021-02-22T19:19:08.367Z] 19:19:08     INFO - Fetch https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/PD-FExiORU2hpgeQlpSWng/artifacts/public/build/target.common.tests.tar.gz into memory
[task 2021-02-22T19:19:09.848Z] 19:19:09     INFO - Content-Length response header: 14899427
[task 2021-02-22T19:19:09.848Z] 19:19:09     INFO - Bytes received: 14899427
[task 2021-02-22T19:19:11.315Z] 19:19:11     INFO - Downloading and extracting to C:\Users\task_1614019684\build\tests these dirs * from https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/PD-FExiORU2hpgeQlpSWng/artifacts/public/build/target.talos.tests.tar.gz
[task 2021-02-22T19:19:11.315Z] 19:19:11     INFO - retry: Calling fetch_url_into_memory with args: (), kwargs: {'url': u'https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/PD-FExiORU2hpgeQlpSWng/artifacts/public/build/target.talos.tests.tar.gz'}, attempt #1
[task 2021-02-22T19:19:11.315Z] 19:19:11     INFO - Fetch https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/PD-FExiORU2hpgeQlpSWng/artifacts/public/build/target.talos.tests.tar.gz into memory
[task 2021-02-22T19:19:12.800Z] 19:19:12     INFO - Content-Length response header: 19122977
[task 2021-02-22T19:19:12.800Z] 19:19:12     INFO - Bytes received: 19122977
[task 2021-02-22T19:19:13.887Z] 19:19:13     INFO - Downloading https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/PD-FExiORU2hpgeQlpSWng/artifacts/public/build/target.zip to C:\Users\task_1614019684\build\target.zip
[task 2021-02-22T19:19:13.887Z] 19:19:13     INFO - retry: Calling _download_file with args: (), kwargs: {'url': u'https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/PD-FExiORU2hpgeQlpSWng/artifacts/public/build/target.zip', 'file_name': u'C:\\Users\\task_1614019684\\build\\target.zip'}, attempt #1
[task 2021-02-22T19:19:15.735Z] 19:19:15     INFO - Downloaded 82412898 bytes.
[task 2021-02-22T19:19:16.256Z] 19:19:16     INFO - Running post-action listener: _resource_record_post_action
[task 2021-02-22T19:19:16.256Z] 19:19:16     INFO - Running post-action listener: find_tests_for_coverage
[task 2021-02-22T19:19:16.256Z] 19:19:16     INFO - Running post-action listener: find_tests_for_verification
[task 2021-02-22T19:19:16.256Z] 19:19:16     INFO - Running post-action listener: set_extra_try_arguments
[task 2021-02-22T19:19:16.256Z] 19:19:16     INFO - Running post-action listener: setup_coverage_tools
[task 2021-02-22T19:19:16.256Z] 19:19:16     INFO - [mozharness: 2021-02-22 19:19:16.256000Z] Finished download-and-extract step (success)
[task 2021-02-22T19:19:16.257Z] 19:19:16     INFO - [mozharness: 2021-02-22 19:19:16.256000Z] Running populate-webroot step.
[task 2021-02-22T19:19:16.257Z] 19:19:16     INFO - Running pre-action listener: _resource_record_pre_action
[task 2021-02-22T19:19:16.257Z] 19:19:16     INFO - Running main action method: populate_webroot
[task 2021-02-22T19:19:16.258Z] 19:19:16     INFO - {u'suites': {u'bcv': {u'tests': [u'basic_compositor_video']},
[task 2021-02-22T19:19:16.258Z] 19:19:16     INFO -              u'chromez': {u'tests': [u'about_preferences_basic',
[task 2021-02-22T19:19:16.259Z] 19:19:16     INFO -                                      u'tresize',
[task 2021-02-22T19:19:16.259Z] 19:19:16     INFO -                                      u'about_newtab_with_snippets']},
[task 2021-02-22T19:19:16.259Z] 19:19:16     INFO -              u'damp': {u'pagesets_name': u'tp5n.zip', u'tests': [u'damp']},
[task 2021-02-22T19:19:16.259Z] 19:19:16     INFO -              u'dromaeojs': {u'tests': [u'dromaeo_css', u'kraken']},
[task 2021-02-22T19:19:16.259Z] 19:19:16     INFO -              u'flex': {u'tests': [u'tart_flex', u'ts_paint_flex']},
[task 2021-02-22T19:19:16.259Z] 19:19:16     INFO -              u'g1': {u'pagesets_name': u'tp5n.zip',
[task 2021-02-22T19:19:16.259Z] 19:19:16     INFO -                      u'tests': [u'tp5o_scroll']},
[task 2021-02-22T19:19:16.259Z] 19:19:16     INFO -              u'g3': {u'tests': [u'dromaeo_dom']},
[task 2021-02-22T19:19:16.259Z] 19:19:16     INFO -              u'g4': {u'tests': [u'displaylist_mutate',
[task 2021-02-22T19:19:16.259Z] 19:19:16     INFO -                                 u'rasterflood_svg',
[task 2021-02-22T19:19:16.259Z] 19:19:16     INFO -                                 u'rasterflood_gradient']},
[task 2021-02-22T19:19:16.259Z] 19:19:16     INFO -              u'g5': {u'pagesets_name': u'tp5n.zip',
[task 2021-02-22T19:19:16.260Z] 19:19:16     INFO -                      u'tests': [u'ts_paint_webext', u'tp5o_webext']},
[task 2021-02-22T19:19:16.260Z] 19:19:16     INFO -              u'h1': {u'tests': [u'ts_paint_heavy']},
[task 2021-02-22T19:19:16.260Z] 19:19:16     INFO -              u'motionmark': {u'benchmark_zip': u'jetstream.zip',
[task 2021-02-22T19:19:16.260Z] 19:19:16     INFO -                              u'tests': [u'motionmark_animometer',
[task 2021-02-22T19:19:16.260Z] 19:19:16     INFO -                                         u'motionmark_htmlsuite',
[task 2021-02-22T19:19:16.260Z] 19:19:16     INFO -                                         u'JetStream',
[task 2021-02-22T19:19:16.260Z] 19:19:16     INFO -                                         u'ARES6']},
[task 2021-02-22T19:19:16.260Z] 19:19:16     INFO -              u'other': {u'_comment': u'Bug 1220362 - Disabled startup_about_home_paint_cached for high frequency intermittents',
[task 2021-02-22T19:19:16.260Z] 19:19:16     INFO -                         u'tests': [u'a11yr',
[task 2021-02-22T19:19:16.260Z] 19:19:16     INFO -                                    u'ts_paint',
[task 2021-02-22T19:19:16.260Z] 19:19:16     INFO -                                    u'twinopen',
[task 2021-02-22T19:19:16.260Z] 19:19:16     INFO -                                    u'sessionrestore',
[task 2021-02-22T19:19:16.260Z] 19:19:16     INFO -                                    u'sessionrestore_no_auto_restore',
[task 2021-02-22T19:19:16.260Z] 19:19:16     INFO -                                    u'tabpaint',
[task 2021-02-22T19:19:16.260Z] 19:19:16     INFO -                                    u'cpstartup',
[task 2021-02-22T19:19:16.260Z] 19:19:16     INFO -                                    u'startup_about_home_paint',
[task 2021-02-22T19:19:16.260Z] 19:19:16     INFO -                                    u'pdfpaint']},
[task 2021-02-22T19:19:16.261Z] 19:19:16     INFO -              u'perf-reftest': {u'tests': [u'perf_reftest']},
[task 2021-02-22T19:19:16.261Z] 19:19:16     INFO -              u'perf-reftest-singletons': {u'tests': [u'perf_reftest_singletons']},
[task 2021-02-22T19:19:16.261Z] 19:19:16     INFO -              u'realworld-webextensions': {u'tests': [u'startup_about_home_paint_realworld_webextensions'],
[task 2021-02-22T19:19:16.261Z] 19:19:16     INFO -                                           u'webextensions_zip': u'webextensions.zip'},
[task 2021-02-22T19:19:16.261Z] 19:19:16     INFO -              u'sessionrestore-many-windows': {u'tests': [u'sessionrestore_many_windows']},
[task 2021-02-22T19:19:16.261Z] 19:19:16     INFO -              u'svgr': {u'tests': [u'tsvgx',
[task 2021-02-22T19:19:16.261Z] 19:19:16     INFO -                                   u'tsvgr_opacity',
[task 2021-02-22T19:19:16.261Z] 19:19:16     INFO -                                   u'tscrollx',
[task 2021-02-22T19:19:16.261Z] 19:19:16     INFO -                                   u'tsvg_static',
[task 2021-02-22T19:19:16.261Z] 19:19:16     INFO -                                   u'tart']},
[task 2021-02-22T19:19:16.261Z] 19:19:16     INFO -              u'tabswitch': {u'pagesets_name': u'tp5n.zip',
[task 2021-02-22T19:19:16.261Z] 19:19:16     INFO -                             u'tests': [u'tabswitch']},
[task 2021-02-22T19:19:16.261Z] 19:19:16     INFO -              u'tp5o': {u'pagesets_name': u'tp5n.zip', u'tests': [u'tp5o']},
[task 2021-02-22T19:19:16.261Z] 19:19:16     INFO -              u'webgl': {u'tests': [u'glterrain',
[task 2021-02-22T19:19:16.261Z] 19:19:16     INFO -                                    u'glvideo',
[task 2021-02-22T19:19:16.261Z] 19:19:16     INFO -                                    u'motionmark_webgl']},
[task 2021-02-22T19:19:16.262Z] 19:19:16     INFO -              u'xperf': {u'pagesets_name': u'tp5n.zip',
[task 2021-02-22T19:19:16.262Z] 19:19:16     INFO -                         u'talos_options': [u'--xperf_path',
[task 2021-02-22T19:19:16.262Z] 19:19:16     INFO -                                            u'"c:/Program Files (x86)/Windows Kits/10/Windows Performance Toolkit/xperf.exe"'],
[task 2021-02-22T19:19:16.262Z] 19:19:16     INFO -                         u'tests': [u'tp5n']}}}
[task 2021-02-22T19:19:16.262Z] 19:19:16     INFO - Downloading {'dest': 'C:\\Users\\task_1614019684\\build\\tests\\talos\\talos\\tests', 'name': u'tp5n.zip', 'manifest': 'tp5n-pageset.manifest'} with tooltool...
[task 2021-02-22T19:19:16.265Z] 19:19:16     INFO - retry: Calling run_command with args: (['c:\\mozilla-build\\python\\python.exe', '-u', 'C:\\Users\\task_1614019684\\mozharness\\external_tools\\tooltool.py', 'fetch', '-m', 'C:\\Users\\task_1614019684\\build\\tests\\talos\\tp5n-pageset.manifest', '-o', '-c', 'c:\\build\\tooltool_cache'],), kwargs: {'output_timeout': 600, 'error_list': [{'substr': 'command not found', 'level': 'error'}, {'regex': <_sre.SRE_Pattern object at 0x00000000033AF408>, 'level': 'warning'}, {'regex': <_sre.SRE_Pattern object at 0x00000000035D9CB0>, 'level': 'error'}, {'substr': 'Traceback (most recent call last)', 'level': 'error'}, {'substr': 'SyntaxError: ', 'level': 'error'}, {'substr': 'TypeError: ', 'level': 'error'}, {'substr': 'NameError: ', 'level': 'error'}, {'substr': 'ZeroDivisionError: ', 'level': 'error'}, {'regex': <_sre.SRE_Pattern object at 0x00000000035F2188>, 'level': 'critical'}, {'regex': <_sre.SRE_Pattern object at 0x000000000389DB28>, 'level': 'critical'}, {'substr': 'ERROR - ', 'level': 'error'}], 'cwd': 'C:\\Users\\task_1614019684\\build\\tests\\talos\\talos\\tests', 'privileged': False}, attempt #1
[task 2021-02-22T19:19:16.265Z] 19:19:16     INFO - Running command: ['c:\\mozilla-build\\python\\python.exe', '-u', 'C:\\Users\\task_1614019684\\mozharness\\external_tools\\tooltool.py', 'fetch', '-m', 'C:\\Users\\task_1614019684\\build\\tests\\talos\\tp5n-pageset.manifest', '-o', '-c', 'c:\\build\\tooltool_cache'] in C:\Users\task_1614019684\build\tests\talos\talos\tests
[task 2021-02-22T19:19:16.265Z] 19:19:16     INFO - Copy/paste: c:\mozilla-build\python\python.exe -u C:\Users\task_1614019684\mozharness\external_tools\tooltool.py fetch -m C:\Users\task_1614019684\build\tests\talos\tp5n-pageset.manifest -o -c c:\build\tooltool_cache
[task 2021-02-22T19:19:16.265Z] 19:19:16     INFO - Calling ['c:\\mozilla-build\\python\\python.exe', '-u', 'C:\\Users\\task_1614019684\\mozharness\\external_tools\\tooltool.py', 'fetch', '-m', 'C:\\Users\\task_1614019684\\build\\tests\\talos\\tp5n-pageset.manifest', '-o', '-c', 'c:\\build\\tooltool_cache'] with output_timeout 600
[task 2021-02-22T19:19:16.348Z] 19:19:16     INFO -  INFO - File tp5n.zip not present in local cache folder c:\build\tooltool_cache
[task 2021-02-22T19:19:16.348Z] 19:19:16     INFO -  INFO - Attempting to fetch from 'https://tooltool.mozilla-releng.net/'...
[task 2021-02-22T19:29:16.361Z] 19:29:16     INFO - Automation Error: mozprocess timed out after 600 seconds running ['c:\\mozilla-build\\python\\python.exe', '-u', 'C:\\Users\\task_1614019684\\mozharness\\external_tools\\tooltool.py', 'fetch', '-m', 'C:\\Users\\task_1614019684\\build\\tests\\talos\\tp5n-pageset.manifest', '-o', '-c', 'c:\\build\\tooltool_cache']
[task 2021-02-22T19:29:16.365Z] 19:29:16    ERROR - timed out after 600 seconds of no output
[task 2021-02-22T19:29:16.365Z] 19:29:16    ERROR - Return code: 572
[task 2021-02-22T19:29:16.365Z] 19:29:16     INFO - retry: Failed, sleeping 60 seconds before retrying
[task 2021-02-22T19:30:16.365Z] 19:30:16     INFO - retry: Calling run_command with args: (['c:\\mozilla-build\\python\\python.exe', '-u', 'C:\\Users\\task_1614019684\\mozharness\\external_tools\\tooltool.py', 'fetch', '-m', 'C:\\Users\\task_1614019684\\build\\tests\\talos\\tp5n-pageset.manifest', '-o', '-c', 'c:\\build\\tooltool_cache'],), kwargs: {'output_timeout': 600, 'error_list': [{'substr': 'command not found', 'level': 'error'}, {'regex': <_sre.SRE_Pattern object at 0x00000000033AF408>, 'level': 'warning'}, {'regex': <_sre.SRE_Pattern object at 0x00000000035D9CB0>, 'level': 'error'}, {'substr': 'Traceback (most recent call last)', 'level': 'error'}, {'substr': 'SyntaxError: ', 'level': 'error'}, {'substr': 'TypeError: ', 'level': 'error'}, {'substr': 'NameError: ', 'level': 'error'}, {'substr': 'ZeroDivisionError: ', 'level': 'error'}, {'regex': <_sre.SRE_Pattern object at 0x00000000035F2188>, 'level': 'critical'}, {'regex': <_sre.SRE_Pattern object at 0x000000000389DB28>, 'level': 'critical'}, {'substr': 'ERROR - ', 'level': 'error'}], 'cwd': 'C:\\Users\\task_1614019684\\build\\tests\\talos\\talos\\tests', 'privileged': False}, attempt #2
[task 2021-02-22T19:30:16.365Z] 19:30:16     INFO - Running command: ['c:\\mozilla-build\\python\\python.exe', '-u', 'C:\\Users\\task_1614019684\\mozharness\\external_tools\\tooltool.py', 'fetch', '-m', 'C:\\Users\\task_1614019684\\build\\tests\\talos\\tp5n-pageset.manifest', '-o', '-c', 'c:\\build\\tooltool_cache'] in C:\Users\task_1614019684\build\tests\talos\talos\tests
[task 2021-02-22T19:30:16.365Z] 19:30:16     INFO - Copy/paste: c:\mozilla-build\python\python.exe -u C:\Users\task_1614019684\mozharness\external_tools\tooltool.py fetch -m C:\Users\task_1614019684\build\tests\talos\tp5n-pageset.manifest -o -c c:\build\tooltool_cache
[task 2021-02-22T19:30:16.365Z] 19:30:16     INFO - Calling ['c:\\mozilla-build\\python\\python.exe', '-u', 'C:\\Users\\task_1614019684\\mozharness\\external_tools\\tooltool.py', 'fetch', '-m', 'C:\\Users\\task_1614019684\\build\\tests\\talos\\tp5n-pageset.manifest', '-o', '-c', 'c:\\build\\tooltool_cache'] with output_timeout 600
[task 2021-02-22T19:30:16.447Z] 19:30:16     INFO -  INFO - File tp5n.zip not present in local cache folder c:\build\tooltool_cache
[task 2021-02-22T19:30:16.447Z] 19:30:16     INFO -  INFO - Attempting to fetch from 'https://tooltool.mozilla-releng.net/'...
[taskcluster:error] Aborting task...
[taskcluster 2021-02-22T19:39:06.017Z] SUCCESS: The process with PID 6812 (child process of PID 4772) has been terminated.
[taskcluster 2021-02-22T19:39:06.017Z] SUCCESS: The process with PID 4772 (child process of PID 9648) has been terminated.
[taskcluster 2021-02-22T19:39:06.017Z] SUCCESS: The process with PID 9880 (child process of PID 10020) has been terminated.
[taskcluster 2021-02-22T19:39:06.017Z] SUCCESS: The process with PID 9648 (child process of PID 10020) has been terminated.
[taskcluster 2021-02-22T19:39:06.017Z] SUCCESS: The process with PID 10020 (child process of PID 6224) has been terminated.
[taskcluster 2021-02-22T19:39:06.017Z] 
[taskcluster 2021-02-22T19:39:06.017Z] === Task Finished ===
[taskcluster 2021-02-22T19:39:06.017Z] Task Duration: 20m0.1666688s
[taskcluster 2021-02-22T19:39:06.155Z] Uploading artifact public/logs/localconfig.json from file logs\localconfig.json with content encoding "gzip", mime type "application/octet-stream" and expiry 2022-02-22T17:39:54.635Z
[taskcluster:error] Uploading error artifact public/test_info from file build/blobber_upload_dir with message "Could not read directory 'C:\\Users\\task_1614019684\\build\\blobber_upload_dir'", reason "file-missing-on-worker" and expiry 2022-02-22T17:39:54.635Z
[taskcluster:error] TASK FAILURE during artifact upload: file-missing-on-worker: Could not read directory 'C:\Users\task_1614019684\build\blobber_upload_dir'
[taskcluster 2021-02-22T19:39:06.886Z] Uploading redirect artifact public/logs/live.log to URL https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/EgUNG-QBQ0-YqHpy49exVQ/runs/0/artifacts/public/logs/live_backing.log with mime type "text/plain; charset=utf-8" and expiry 2022-02-22T17:39:54.635Z
[taskcluster:error] Task aborted - max run time exceeded
[taskcluster:error] file-missing-on-worker: Could not read directory 'C:\Users\task_1614019684\build\blobber_upload_dir'```
Component: Talos → Applications: ToolTool
Product: Testing → Release Engineering
QA Contact: bhearsum

I think this bug outlived its usefuless. Please reopen if I'm wrong.

Status: NEW → RESOLVED
Closed: 4 years ago
Resolution: --- → INACTIVE
Component: Applications: ToolTool → General
You need to log in before you can comment on or make changes to this bug.