1612700 - Intermittent raptor-main Critical: TEST-UNEXPECTED-FAIL: no raptor test results were found for raptor-tp6-netflix-firefox-cold

Status: RESOLVED DUPLICATE of bug 1609295

(Testing :: Raptor, defect, P5)

Description

[Treeherder Bug Filer]

Filed by: csabou [at] mozilla.com
Parsed log: https://treeherder.mozilla.org/logviewer.html#?job_id=287156256&repo=mozilla-central
Full log: https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/Qq_n8z29TaC3rQVwtAZSMA/runs/0/artifacts/public/logs/live_backing.log

---

[task 2020-02-02T01:13:40.832Z] 01:13:40 INFO - raptor-mitmproxy Info: Firefox policies file contents:
[task 2020-02-02T01:13:40.833Z] 01:13:40 INFO - raptor-mitmproxy Info: {
[task 2020-02-02T01:13:40.833Z] 01:13:40 INFO - "policies": {
[task 2020-02-02T01:13:40.834Z] 01:13:40 INFO - "Certificates": {
[task 2020-02-02T01:13:40.834Z] 01:13:40 INFO - "Install": ["C:\Users\task_1580595149\.mitmproxy\mitmproxy-ca-cert.cer"]
[task 2020-02-02T01:13:40.834Z] 01:13:40 INFO - },
[task 2020-02-02T01:13:40.834Z] 01:13:40 INFO - "Proxy": {
[task 2020-02-02T01:13:40.835Z] 01:13:40 INFO - "Mode": "manual",
[task 2020-02-02T01:13:40.835Z] 01:13:40 INFO - "HTTPProxy": "127.0.0.1:49807",
[task 2020-02-02T01:13:40.835Z] 01:13:40 INFO - "SSLProxy": "127.0.0.1:49807",
[task 2020-02-02T01:13:40.835Z] 01:13:40 INFO - "Passthrough": "127.0.0.1",
[task 2020-02-02T01:13:40.836Z] 01:13:40 INFO - "Locked": true
[task 2020-02-02T01:13:40.836Z] 01:13:40 INFO - }
[task 2020-02-02T01:13:40.836Z] 01:13:40 INFO - }
[task 2020-02-02T01:13:40.836Z] 01:13:40 INFO - }
[task 2020-02-02T01:13:40.837Z] 01:13:40 INFO - raptor-mitmproxy Info: Verified mitmproxy CA certificate is installed in Firefox
[task 2020-02-02T01:13:40.837Z] 01:13:40 INFO - raptor-perftest Info: Playback recording date: 2019-06-18
[task 2020-02-02T01:13:40.837Z] 01:13:40 INFO - raptor-webext Info: setting test-specific Firefox preferences
[task 2020-02-02T01:13:40.837Z] 01:13:40 INFO - raptor-webext Info: starting web extension test: raptor-tp6-netflix-firefox-cold
[task 2020-02-02T01:13:40.838Z] 01:13:40 INFO - raptor-webext Info: test settings: {'expected_browser_cycles': 25, 'alert_threshold': '2.0', 'playback_pageset_manifest': 'mitm4-linux-firefox-netflix.manifest', 'browser_cycles': '25', 'here': 'C:\Users\task_1580595149\build\tests\raptor\raptor\tests\tp6\desktop', 'expected': 'pass', 'measure': ['fnbpaint', 'fcp', 'dcf', 'loadtime'], 'path': 'C:\Users\task_1580595149\build\tests\raptor\raptor\tests\tp6\desktop\raptor-tp6-netflix-firefox-cold', 'cold': True, 'manifest_relpath': 'tests\tp6\desktop\raptor-tp6-18-cold.ini', 'unit': 'ms', 'preferences': '{"media.autoplay.default": 1,\r\n"media.eme.enabled": true}', 'alert_on': ['fcp', 'loadtime'], 'name': 'raptor-tp6-netflix-firefox-cold', 'playback_recordings': 'netflix.mp', 'page_cycles': 1, 'apps': 'firefox', 'test_url': 'https://www.netflix.com/title/80117263', 'manifest': 'C:\Users\task_1580595149\build\tests\raptor\raptor\tests\tp6\desktop\raptor-tp6-18-cold.ini', 'ancestor_manifest': 'raptor.ini', 'page_timeout': '60000', 'playback': 'mitmproxy', 'browser_cycle': 1, 'lower_is_better': True, 'type': 'pageload', 'relpath': 'tests\tp6\desktop\raptor-tp6-netflix-firefox-cold'}
[task 2020-02-02T01:13:40.838Z] 01:13:40 INFO - raptor-webext Info: web extension config: {'subtest_alert_on': ['fcp', 'loadtime'], 'e10s': True, 'app': 'firefox', 'symbols_path': 'https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/dJsMTWKPSm6S3zsl96UGxQ/artifacts/public/build/target.crashreporter-symbols.zip', 'power_test': False, 'playback_binary_zip': None, 'run_local': False, 'playback_files': ['C:\Users\task_1580595149\testing\mozproxy\netflix.mp'], 'gecko_profile_interval': None, 'binary': 'C:\Users\task_1580595149\build\application\firefox\firefox.exe', 'local_profile_dir': 'c:\users\task_1580595149\appdata\local\temp\tmpsdtrwc', 'playback_binary_manifest': 'mitmproxy-rel-bin-4.0.4-{platform}.manifest', 'enable_control_server_wait': False, 'no_conditioned_profile': False, 'platform': 'win', 'playback_version': '4.0.4', 'enable_webrender': False, 'gecko_profile': False, 'gecko_profile_entries': None, 'playback_pageset_manifest': 'C:\Users\task_1580595149\build\tests\raptor\raptor\playback\mitm4-linux-firefox-netflix.manifest', 'playback_pageset_zip': None, 'playback_tool': 'mitmproxy', 'host': '127.0.0.1', 'enable_fission': False, 'memory_test': False, 'extra_prefs': {}, 'obj_path': None, 'device_name': None, 'cpu_test': False, 'is_release_build': False, 'processor': 'x86_64'}
[task 2020-02-02T01:13:40.838Z] 01:13:40 INFO - raptor-gen-test-config Info: writing test settings into background js, so webext can get it
[task 2020-02-02T01:13:40.838Z] 01:13:40 INFO - raptor-gen-test-config Info: finished writing test config to C:\Users\task_1580595149\build\tests\raptor\webext\raptor\auto_gen_test_config.js
[task 2020-02-02T01:13:40.839Z] 01:13:40 INFO - raptor-webext Info: installing webext C:\Users\task_1580595149\build\tests\raptor\raptor\webextension....\webext\raptor
[task 2020-02-02T01:13:41.200Z] 01:13:41 INFO - raptor-webext-desktop Info: starting firefox
[task 2020-02-02T01:13:41.200Z] 01:13:41 INFO - Application command: C:\Users\task_1580595149\build\application\firefox\firefox.exe --wait-for-browser -profile c:\users\task_1580595149\appdata\local\temp\tmpsdtrwc
[task 2020-02-02T01:16:48.755Z] 01:16:48 CRITICAL - raptor-perftest Critical: Tests failed to finish! Application timed out.
[task 2020-02-02T01:16:48.755Z] 01:16:48 ERROR - raptor-perftest Error: Test failed to finish. Application timed out after 170 seconds
[task 2020-02-02T01:16:48.755Z] 01:16:48 INFO - raptor-mitmproxy Info: Stopping mitmproxy playback, killing process 4400
[task 2020-02-02T01:16:48.778Z] 01:16:48 INFO - raptor-mitmproxy Info: Successfully killed the mitmproxy playback process with exit code 572
[task 2020-02-02T01:16:48.778Z] 01:16:48 INFO - raptor-mitmproxy Info: Turning off the browser proxy
[task 2020-02-02T01:16:48.778Z] 01:16:48 INFO - raptor-mitmproxy Info: writing: C:\Users\task_1580595149\build\application\firefox\distribution\policies.json
[task 2020-02-02T01:16:48.779Z] 01:16:48 INFO - raptor-webext Info: removing webext C:\Users\task_1580595149\build\tests\raptor\raptor\webextension....\webext\raptor
[task 2020-02-02T01:16:48.783Z] 01:16:48 INFO - perftest-results-handler Info: summarizing raptor test results
[task 2020-02-02T01:16:48.783Z] 01:16:48 INFO - perftest-output Error: no raptor test results found for raptor-tp6-netflix-firefox-cold
[task 2020-02-02T01:16:48.783Z] 01:16:48 INFO - perftest-output Info: error: no raptor test results found, so no need to combine browser cycles
[task 2020-02-02T01:16:48.783Z] 01:16:48 INFO - perftest-output Error: no summarized raptor results found for raptor-tp6-netflix-firefox-cold
[task 2020-02-02T01:16:50.670Z] 01:16:50 INFO - perftest-results-handler Critical: PERFHERDER_DATA was seen 0 times, expected 1.
[task 2020-02-02T01:16:50.670Z] 01:16:50 INFO - raptor-control-server Info: shutting down control server
[task 2020-02-02T01:16:50.830Z] 01:16:50 INFO - raptor-webext Info: finished
[task 2020-02-02T01:16:50.830Z] 01:16:50 ERROR - raptor-main Critical: TEST-UNEXPECTED-FAIL: no raptor test results were found for raptor-tp6-netflix-firefox-cold
[task 2020-02-02T01:17:00.562Z] 01:17:00 ERROR - Return code: 1
[task 2020-02-02T01:17:00.562Z] 01:17:00 WARNING - setting return code to 1

Comment 1

[Intermittent Failures Robot]

2 failures in 2190 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 2

Platform breakdown:

• windows10-64-ref-hw-2017: 2

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1612700&startday=2020-01-27&endday=2020-02-02&tree=all

Comment 3

[Intermittent Failures Robot]

1 failures in 3364 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 1

Platform breakdown:

• windows10-64-ref-hw-2017: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1612700&startday=2020-02-03&endday=2020-02-09&tree=all