Closed
Bug 1695052
Opened 5 years ago
Closed 5 years ago
Intermittent raptor-main Critical: TEST-UNEXPECTED-FAIL: test 'raptor-sunspider-firefox' timed out loading test page: waiting for pending metrics
Categories
(Testing :: Raptor, defect, P5)
Testing
Raptor
Tracking
(Not tracked)
RESOLVED
INCOMPLETE
People
(Reporter: intermittent-bug-filer, Unassigned)
Details
(Keywords: intermittent-failure)
Filed by: btara [at] mozilla.com
Parsed log: https://treeherder.mozilla.org/logviewer?job_id=331238597&repo=autoland
Full log: https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/a7AEsl0SS42yANWJrwje1g/runs/0/artifacts/public/logs/live_backing.log
...
[task 2021-02-25T21:18:24.613Z] 21:18:24 INFO - PID 2797 | console.info: "[raptor-runnerjs] results pending..."
[task 2021-02-25T21:18:24.871Z] 21:18:24 INFO - PID 2797 | console.info: "[raptor-runnerjs] results pending..."
[task 2021-02-25T21:18:25.113Z] 21:18:25 INFO - PID 2797 | console.info: "[raptor-runnerjs] results pending..."
[task 2021-02-25T21:18:25.168Z] 21:18:25 INFO - PID 2797 | console.info: "[raptor-runnerjs] received message from http://127.0.0.1:54683/SunSpider/sunspider-1.0.1/sunspider-1.0.1/driver.html?raptor"
[task 2021-02-25T21:18:25.169Z] 21:18:25 INFO - PID 2797 | console.info: "[raptor-runnerjs] result: sunspider [object Object]"
[task 2021-02-25T21:18:25.169Z] 21:18:25 INFO - PID 2797 | console.info: "[raptor-runnerjs] received results from benchmark"
[task 2021-02-25T21:18:25.169Z] 21:18:25 INFO - PID 2797 | console.error: "ERROR: [raptor-runnerjs] raptor-page-timeout on http://127.0.0.1:54683/SunSpider/sunspider-1.0.1/sunspider-1.0.1/driver.html?raptor"
[task 2021-02-25T21:18:25.184Z] 21:18:25 INFO - PID 2797 | console.info: "[raptor-benchmarkjs] Response: confirmed sunspider"
[task 2021-02-25T21:18:25.184Z] 21:18:25 INFO - raptor-control-server Info: received webext_raptor-page-timeout: [u'raptor-sunspider-firefox', u'http://127.0.0.1:54683/SunSpider/sunspider-1.0.1/sunspider-1.0.1/driver.html?raptor', 5]
[task 2021-02-25T21:18:25.186Z] 21:18:25 INFO - PID 2797 | console.info: "[raptor-runnerjs] capturing screenshot"
[task 2021-02-25T21:18:25.221Z] 21:18:25 INFO - raptor-control-server Info: received webext_screenshot
[task 2021-02-25T21:18:25.221Z] 21:18:25 INFO - perftest-results-handler Info: received screenshot
[task 2021-02-25T21:18:25.225Z] 21:18:25 INFO - raptor-control-server Info: received webext_status: closing Tab: 2
[task 2021-02-25T21:18:25.240Z] 21:18:25 INFO - PID 2797 | console.info: "[raptor-benchmarkjs] raptor benchmark content loaded"
[task 2021-02-25T21:18:25.247Z] 21:18:25 INFO - raptor-control-server Info: received webext_status: closed tab: 2
[task 2021-02-25T21:18:25.255Z] 21:18:25 INFO - raptor-control-server Info: received request to shutdown the browser
[task 2021-02-25T21:18:25.255Z] 21:18:25 INFO - raptor-control-server Info: shutting down browser (pid: 2797)
[task 2021-02-25T21:18:25.255Z] 21:18:25 INFO - PID 2797 | console.info: "[raptor-runnerjs] benchmark test finished"
[task 2021-02-25T21:18:25.363Z] 21:18:25 INFO - raptor-control-server Info: received webext_status: results received
[task 2021-02-25T21:18:25.371Z] 21:18:25 INFO - raptor-control-server Info: received webext_results: {u'expected_browser_cycles': 1, u'subtest_unit': u'ms', u'name': u'raptor-sunspider-firefox', u'lower_is_better': True, u'measurements': {u'sunspider': [[{u'math-spectral-norm': [3, 2, 1, 2, 3, 2, 1, 2, 2, 2], u'bitops-3bit-bits-in-byte': [1, 1, 1, 1, 1, 2, 1, 1, 1, 1], u'date-format-xparb': [16, 13, 15, 15, 15, 14, 18, 19, 14, 16], u'3d-morph': [16, 11, 11, 11, 11, 16, 11, 10, 10, 11], u'controlflow-recursive': [2, 2, 2, 3, 3, 3, 3, 3, 3, 2], u'string-base64': [4, 4, 5, 5, 5, 6, 5, 7, 5, 4], u'3d-raytrace': [15, 11, 10, 11, 10, 19, 11, 10, 10, 11], u'access-nsieve': [5, 5, 5, 5, 5, 6, 5, 4, 5, 5], u'crypto-md5': [10, 6, 6, 6, 6, 7, 6, 6, 7, 6], u'bitops-nsieve-bits': [5, 5, 5, 5, 6, 10, 5, 7, 5, 6], u'access-binary-trees': [3, 2, 10, 2, 2, 3, 3, 3, 10, 2], u'bitops-bitwise-and': [3, 2, 3, 2, 2, 3, 2, 4, 3, 3], u'string-validate-input': [8, 8, 8, 9, 8, 8, 9, 8, 16, 8], u'access-fannkuch': [10, 10, 9, 9, 9, 10, 9, 9, 10, 9], u'string-fasta': [12, 12, 12, 12, 12, 11, 12, 11, 18, 17], u'regexp-dna': [7, 7, 8, 7, 10, 8, 7, 7, 8, 7], u'math-partial-sums': [6, 7, 7, 7, 7, 7, 7, 8, 8, 7], u'access-nbody': [3, 5, 3, 3, 3, 6, 4, 3, 3, 3], u'string-tagcloud': [12, 15, 13, 13, 20, 12, 13, 13, 12, 12], u'date-format-tofte': [12, 17, 13, 14, 13, 12, 12, 13, 13, 12], u'string-unpack-code': [31, 30, 32, 33, 30, 26, 30, 29, 28, 31], u'crypto-aes': [8, 8, 8, 9, 23, 8, 8, 13, 8, 8], u'crypto-sha1': [4, 5, 5, 4, 4, 5, 4, 4, 8, 5], u'bitops-bits-in-byte': [3, 2, 3, 2, 3, 3, 3, 2, 3, 2], u'math-cordic': [3, 3, 3, 3, 3, 3, 3, 3, 3, 4], u'3d-cube': [8, 8, 7, 12, 8, 8, 7, 11, 7, 9]}], [{u'math-spectral-norm': [2, 2, 2, 2, 2, 2, 1, 2, 2, 2], u'bitops-3bit-bits-in-byte': [2, 1, 2, 2, 2, 2, 1, 1, 1, 1], u'date-format-xparb': [14, 14, 14, 14, 14, 22, 15, 14, 14, 13], u'3d-morph': [11, 11, 11, 10, 11, 10, 11, 11, 11, 11], u'controlflow-recursive': [3, 2, 3, 2, 2, 3, 3, 3, 2, 3], u'string-base64': [5, 4, 7, 8, 4, 4, 6, 4, 5, 4], u'3d-raytrace': [12, 11, 14, 11, 11, 11, 15, 12, 11, 11], u'access-nsieve': [5, 5, 5, 5, 5, 5, 5, 5, 5, 5], u'crypto-md5': [5, 7, 6, 6, 6, 6, 6, 10, 6, 6], u'bitops-nsieve-bits': [5, 5, 6, 6, 5, 5, 9, 5, 5, 6], u'access-binary-trees': [10, 3, 3, 2, 3, 3, 10, 3, 2, 2], u'bitops-bitwise-and': [3, 3, 2, 2, 2, 3, 4, 3, 2, 2], u'string-validate-input': [13, 8, 8, 9, 9, 9, 18, 9, 8, 8], u'access-fannkuch': [9, 10, 10, 9, 9, 10, 9, 9, 10, 9], u'string-fasta': [12, 12, 12, 17, 12, 11, 12, 12, 11, 11], u'regexp-dna': [7, 7, 7, 8, 8, 7, 8, 7, 9, 7], u'math-partial-sums': [7, 8, 7, 7, 7, 7, 7, 7, 7, 7], u'access-nbody': [3, 6, 3, 5, 3, 3, 3, 4, 5, 4], u'string-tagcloud': [12, 13, 14, 13, 13, 14, 14, 20, 13, 17], u'date-format-tofte': [13, 14, 13, 12, 34, 12, 13, 12, 13, 17], u'string-unpack-code': [30, 33, 29, 32, 44, 29, 28, 29, 32, 31], u'crypto-aes': [7, 9, 12, 7, 8, 22, 8, 8, 8, 8], u'crypto-sha1': [4, 4, 4, 5, 4, 4, 4, 5, 5, 4], u'bitops-bits-in-byte': [2, 2, 2, 2, 3, 3, 3, 2, 2, 2], u'math-cordic': [3, 3, 4, 3, 3, 3, 3, 4, 3, 3], u'3d-cube': [8, 7, 6, 15, 7, 9, 8, 7, 15, 7]}], [{u'math-spectral-norm': [2, 1, 2, 1, 2, 1, 2, 2, 2, 1], u'bitops-3bit-bits-in-byte': [1, 1, 1, 0, 1, 1, 1, 1, 0, 1], u'date-format-xparb': [14, 17, 14, 14, 14, 14, 14, 15, 15, 13], u'3d-morph': [10, 11, 11, 10, 10, 10, 10, 11, 10, 11], u'controlflow-recursive': [3, 2, 2, 3, 3, 4, 2, 2, 2, 2], u'string-base64': [6, 5, 4, 5, 5, 4, 5, 5, 5, 4], u'3d-raytrace': [19, 10, 10, 11, 10, 11, 11, 12, 11, 11], u'access-nsieve': [8, 4, 5, 4, 4, 5, 4, 5, 5, 5], u'crypto-md5': [6, 5, 6, 6, 6, 10, 6, 6, 6, 9], u'bitops-nsieve-bits': [6, 5, 6, 5, 6, 6, 8, 7, 5, 6], u'access-binary-trees': [2, 2, 2, 10, 2, 2, 11, 3, 3, 2], u'bitops-bitwise-and': [5, 2, 3, 2, 3, 3, 2, 14, 2, 2], u'string-validate-input': [13, 7, 7, 15, 7, 8, 11, 8, 7, 8], u'access-fannkuch': [9, 9, 9, 8, 9, 9, 9, 10, 10, 9], u'string-fasta': [11, 11, 11, 11, 12, 11, 11, 11, 11, 11], u'regexp-dna': [8, 7, 8, 8, 10, 10, 8, 8, 9, 8], u'math-partial-sums': [7, 7, 6, 7, 7, 7, 6, 7, 7, 7], u'access-nbody': [5, 2, 2, 3, 2, 3, 3, 3, 2, 2], u'string-tagcloud': [13, 13, 15, 13, 14, 19, 13, 20, 13, 13], u'date-format-tofte': [11, 12, 11, 12, 12, 11, 18, 13, 12, 15], u'string-unpack-code': [27, 31, 29, 31, 44, 36, 31, 35, 32, 31], u'crypto-aes': [8, 9, 15, 8, 10, 18, 8, 8, 8, 7], u'crypto-sha1': [4, 4, 4, 4, 6, 5, 4, 4, 5, 5], u'bitops-bits-in-byte': [2, 2, 2, 2, 3, 2, 2, 2, 3, 2], u'math-cordic': [3, 3, 3, 2, 3, 3, 3, 3, 3, 3], u'3d-cube': [7, 6, 7, 6, 6, 7, 11, 7, 22, 8]}], [{u'math-spectral-norm': [1, 1, 2, 1, 2, 2, 2, 2, 2, 2], u'bitops-3bit-bits-in-byte': [1, 1, 1, 1, 1, 1, 1, 1, 1, 2], u'date-format-xparb': [14, 17, 14, 14, 16, 16, 16, 14, 14, 14], u'3d-morph': [10, 11, 11, 11, 10, 10, 10, 11, 11, 12], u'controlflow-recursive': [2, 3, 2, 3, 2, 3, 3, 2, 2, 5], u'string-base64': [5, 5, 5, 4, 15, 5, 5, 4, 8, 7], u'3d-raytrace': [11, 12, 11, 11, 11, 10, 16, 11, 16, 11], u'access-nsieve': [5, 4, 5, 6, 5, 6, 5, 5, 5, 5], u'crypto-md5': [7, 6, 7, 6, 6, 10, 9, 6, 7, 6], u'bitops-nsieve-bits': [6, 5, 6, 5, 6, 14, 5, 5, 5, 9], u'access-binary-trees': [10, 3, 2, 10, 2, 3, 3, 3, 3, 3], u'bitops-bitwise-and': [3, 2, 3, 2, 3, 4, 2, 4, 2, 5], u'string-validate-input': [15, 8, 8, 8, 8, 9, 8, 9, 13, 9], u'access-fannkuch': [10, 10, 10, 10, 10, 10, 10, 10, 10, 10], u'string-fasta': [11, 12, 11, 11, 11, 12, 11, 17, 13, 17], u'regexp-dna': [7, 7, 8, 7, 8, 9, 10, 8, 9, 8], u'math-partial-sums': [7, 7, 8, 7, 7, 7, 7, 8, 7, 7], u'access-nbody': [3, 3, 3, 3, 3, 3, 5, 3, 3, 3], u'string-tagcloud': [14, 13, 16, 13, 13, 17, 13, 20, 13, 12], u'date-format-tofte': [13, 13, 17, 12, 13, 12, 17, 13, 13, 16], u'string-unpack-code': [27, 33, 30, 30, 59, 33, 31, 30, 33, 32], u'crypto-aes': [8, 8, 8, 7, 8, 12, 9, 8, 9, 12], u'crypto-sha1': [5, 4, 4, 4, 4, 5, 4, 5, 4, 5], u'bitops-bits-in-byte': [2, 2, 3, 2, 2, 5, 3, 2, 2, 3], u'math-cordic': [3, 4, 3, 4, 3, 3, 4, 4, 3, 3], u'3d-cube': [8, 7, 7, 8, 12, 14, 7, 8, 22, 7]}], [{u'math-spectral-norm': [1, 2, 1, 3, 2, 2, 1, 1, 1, 1], u'bitops-3bit-bits-in-byte': [1, 1, 1, 1, 1, 1, 1, 1, 1, 1], u'date-format-xparb': [14, 16, 13, 14, 14, 20, 14, 15, 14, 14], u'3d-morph': [10, 10, 10, 10, 10, 10, 11, 10, 10, 10], u'controlflow-recursive': [3, 2, 2, 2, 3, 2, 3, 2, 2, 2], u'string-base64': [5, 4, 7, 4, 5, 4, 5, 4, 4, 4], u'3d-raytrace': [19, 10, 11, 11, 11, 11, 11, 10, 12, 16], u'access-nsieve': [5, 5, 7, 4, 5, 5, 5, 5, 4, 4], u'crypto-md5': [6, 5, 5, 6, 7, 5, 9, 6, 6, 10], u'bitops-nsieve-bits': [10, 5, 5, 5, 6, 5, 6, 5, 5, 6], u'access-binary-trees': [2, 2, 2, 10, 2, 15, 2, 2, 15, 2], u'bitops-bitwise-and': [2, 3, 2, 2, 2, 4, 2, 2, 3, 4], u'string-validate-input': [13, 7, 8, 13, 8, 7, 7, 9, 12, 8], u'access-fannkuch': [9, 9, 9, 10, 9, 10, 9, 9, 14, 9], u'string-fasta': [11, 16, 12, 17, 11, 11, 17, 11, 20, 11], u'regexp-dna': [8, 10, 7, 10, 8, 8, 9, 7, 8, 7], u'math-partial-sums': [7, 6, 6, 6, 7, 7, 7, 7, 7, 7], u'access-nbody': [5, 3, 2, 3, 3, 3, 2, 2, 3, 3], u'string-tagcloud': [12, 12, 14, 13, 13, 13, 13, 20, 15, 14], u'date-format-tofte': [13, 12, 13, 12, 39, 12, 13, 13, 13, 14], u'string-unpack-code': [27, 36, 29, 31, 43, 28, 34, 37, 31, 34], u'crypto-aes': [8, 8, 18, 8, 8, 8, 7, 9, 9, 8], u'crypto-sha1': [7, 4, 4, 4, 4, 4, 7, 5, 6, 5], u'bitops-bits-in-byte': [2, 2, 2, 2, 2, 2, 2, 2, 2, 2], u'math-cordic': [2, 3, 3, 3, 3, 3, 3, 3, 3, 3], u'3d-cube': [6, 7, 7, 7, 8, 7, 15, 7, 7, 12]}]]}, u'browser_cycle': u'1', u'subtest_lower_is_better': True, u'cold': False, u'browser': u'Firefox 88.0a1 20210225194956', u'type': u'benchmark', u'page': u'http://127.0.0.1:54683/SunSpider/sunspider-1.0.1/sunspider-1.0.1/driver.html?raptor', u'unit': u'ms', u'alert_threshold': 2}
[task 2021-02-25T21:18:25.371Z] 21:18:25 INFO - perftest-results-handler Info: received results in RaptorResultsHandler.add
[task 2021-02-25T21:18:25.371Z] 21:18:25 INFO - PID 2797 | console.error: "ERROR: [raptor-runnerjs] failed to clear raptor alarm raptor-page-timeout"
[task 2021-02-25T21:18:25.371Z] 21:18:25 INFO - PID 2797 | console.info: "[raptor-runnerjs] Verifying results:"
[task 2021-02-25T21:18:25.371Z] 21:18:25 INFO - PID 2797 | console.info: "[raptor-runnerjs] [object Object]"
[task 2021-02-25T21:18:25.371Z] 21:18:25 INFO - PID 2797 | console.info: "[raptor-runnerjs] have 5 results for sunspider, as expected"
[task 2021-02-25T21:18:25.371Z] 21:18:25 INFO - raptor-control-server Info: received webext_status: Not closing last Tab: 1
[task 2021-02-25T21:18:25.372Z] 21:18:25 INFO - raptor-control-server Info: received request to shutdown the browser
[task 2021-02-25T21:18:25.372Z] 21:18:25 INFO - raptor-control-server Info: shutting down browser (pid: 2797)
[task 2021-02-25T21:18:25.373Z] 21:18:25 INFO - PID 2797 | console.info: "[raptor-runnerjs] benchmark test finished"
[task 2021-02-25T21:18:25.374Z] 21:18:25 INFO - raptor-control-server Info: received webext_status: ended page cycle 6
[task 2021-02-25T21:18:25.375Z] 21:18:25 INFO - raptor-control-server Info: received webext_status: ended page cycle 6
[task 2021-02-25T21:18:25.379Z] 21:18:25 INFO - raptor-control-server Info: received webext_status: ended page cycle 6
[task 2021-02-25T21:18:25.379Z] 21:18:25 INFO - raptor-control-server Info: received webext_status: ended page cycle 6
[task 2021-02-25T21:18:25.380Z] 21:18:25 INFO - raptor-control-server Info: received webext_status: ended page cycle 6
[task 2021-02-25T21:18:27.125Z] 21:18:27 INFO - raptor-webext Info: removing webext /home/cltbld/tasks/task_161428700791325/build/tests/raptor/raptor/webextension/../../webext/raptor
[task 2021-02-25T21:18:27.125Z] 21:18:27 INFO - perftest-results-handler Info: summarizing raptor test results
[task 2021-02-25T21:18:27.125Z] 21:18:27 INFO - perftest-output Info: screen captures can be found locally at: /home/cltbld/tasks/task_161428700791325/build/screenshots.html
[task 2021-02-25T21:18:27.133Z] 21:18:27 INFO - perftest-output Info: PERFHERDER_DATA: {"framework": {"name": "raptor"}, "application": {"version": "88.0a1", "name": "firefox"}, "suites": [{"value": 211.41999999999993, "extraOptions": ["nocondprof", "webrender"], "name": "raptor-sunspider-firefox", "tags": ["benchmark", "warm"], "lowerIsBetter": true, "subtests": [{"name": "3d-cube", "lowerIsBetter": true, "alertThreshold": 2.0, "replicates": [8.0, 8.0, 7.0, 12.0, 8.0, 8.0, 7.0, 11.0, 7.0, 9.0, 8.0, 7.0, 6.0, 15.0, 7.0, 9.0, 8.0, 7.0, 15.0, 7.0, 7.0, 6.0, 7.0, 6.0, 6.0, 7.0, 11.0, 7.0, 22.0, 8.0, 8.0, 7.0, 7.0, 8.0, 12.0, 14.0, 7.0, 8.0, 22.0, 7.0, 6.0, 7.0, 7.0, 7.0, 8.0, 7.0, 15.0, 7.0, 7.0, 12.0], "value": 8.88, "unit": "ms"}, {"name": "3d-morph", "lowerIsBetter": true, "alertThreshold": 2.0, "replicates": [16.0, 11.0, 11.0, 11.0, 11.0, 16.0, 11.0, 10.0, 10.0, 11.0, 11.0, 11.0, 11.0, 10.0, 11.0, 10.0, 11.0, 11.0, 11.0, 11.0, 10.0, 11.0, 11.0, 10.0, 10.0, 10.0, 10.0, 11.0, 10.0, 11.0, 10.0, 11.0, 11.0, 11.0, 10.0, 10.0, 10.0, 11.0, 11.0, 12.0, 10.0, 10.0, 10.0, 10.0, 10.0, 10.0, 11.0, 10.0, 10.0, 10.0], "value": 10.76, "unit": "ms"}, {"name": "3d-raytrace", "lowerIsBetter": true, "alertThreshold": 2.0, "replicates": [15.0, 11.0, 10.0, 11.0, 10.0, 19.0, 11.0, 10.0, 10.0, 11.0, 12.0, 11.0, 14.0, 11.0, 11.0, 11.0, 15.0, 12.0, 11.0, 11.0, 19.0, 10.0, 10.0, 11.0, 10.0, 11.0, 11.0, 12.0, 11.0, 11.0, 11.0, 12.0, 11.0, 11.0, 11.0, 10.0, 16.0, 11.0, 16.0, 11.0, 19.0, 10.0, 11.0, 11.0, 11.0, 11.0, 11.0, 10.0, 12.0, 16.0], "value": 11.9, "unit": "ms"}, {"name": "access-binary-trees", "lowerIsBetter": true, "alertThreshold": 2.0, "replicates": [3.0, 2.0, 10.0, 2.0, 2.0, 3.0, 3.0, 3.0, 10.0, 2.0, 10.0, 3.0, 3.0, 2.0, 3.0, 3.0, 10.0, 3.0, 2.0, 2.0, 2.0, 2.0, 2.0, 10.0, 2.0, 2.0, 11.0, 3.0, 3.0, 2.0, 10.0, 3.0, 2.0, 10.0, 2.0, 3.0, 3.0, 3.0, 3.0, 3.0, 2.0, 2.0, 2.0, 10.0, 2.0, 15.0, 2.0, 2.0, 15.0, 2.0], "value": 4.32, "unit": "ms"}, {"name": "access-fannkuch", "lowerIsBetter": true, "alertThreshold": 2.0, "replicates": [10.0, 10.0, 9.0, 9.0, 9.0, 10.0, 9.0, 9.0, 10.0, 9.0, 9.0, 10.0, 10.0, 9.0, 9.0, 10.0, 9.0, 9.0, 10.0, 9.0, 9.0, 9.0, 9.0, 8.0, 9.0, 9.0, 9.0, 10.0, 10.0, 9.0, 10.0, 10.0, 10.0, 10.0, 10.0, 10.0, 10.0, 10.0, 10.0, 10.0, 9.0, 9.0, 9.0, 10.0, 9.0, 10.0, 9.0, 9.0, 14.0, 9.0], "value": 9.52, "unit": "ms"}, {"name": "access-nbody", "lowerIsBetter": true, "alertThreshold": 2.0, "replicates": [3.0, 5.0, 3.0, 3.0, 3.0, 6.0, 4.0, 3.0, 3.0, 3.0, 3.0, 6.0, 3.0, 5.0, 3.0, 3.0, 3.0, 4.0, 5.0, 4.0, 5.0, 2.0, 2.0, 3.0, 2.0, 3.0, 3.0, 3.0, 2.0, 2.0, 3.0, 3.0, 3.0, 3.0, 3.0, 3.0, 5.0, 3.0, 3.0, 3.0, 5.0, 3.0, 2.0, 3.0, 3.0, 3.0, 2.0, 2.0, 3.0, 3.0], "value": 3.26, "unit": "ms"}, {"name": "access-nsieve", "lowerIsBetter": true, "alertThreshold": 2.0, "replicates": [5.0, 5.0, 5.0, 5.0, 5.0, 6.0, 5.0, 4.0, 5.0, 5.0, 5.0, 5.0, 5.0, 5.0, 5.0, 5.0, 5.0, 5.0, 5.0, 5.0, 8.0, 4.0, 5.0, 4.0, 4.0, 5.0, 4.0, 5.0, 5.0, 5.0, 5.0, 4.0, 5.0, 6.0, 5.0, 6.0, 5.0, 5.0, 5.0, 5.0, 5.0, 5.0, 7.0, 4.0, 5.0, 5.0, 5.0, 5.0, 4.0, 4.0], "value": 4.98, "unit": "ms"}, {"name": "bitops-3bit-bits-in-byte", "lowerIsBetter": true, "alertThreshold": 2.0, "replicates": [1.0, 1.0, 1.0, 1.0, 1.0, 2.0, 1.0, 1.0, 1.0, 1.0, 2.0, 1.0, 2.0, 2.0, 2.0, 2.0, 1.0, 1.0, 1.0, 1.0, 1.0, 1.0, 1.0, 0.0, 1.0, 1.0, 1.0, 1.0, 0.0, 1.0, 1.0, 1.0, 1.0, 1.0, 1.0, 1.0, 1.0, 1.0, 1.0, 2.0, 1.0, 1.0, 1.0, 1.0, 1.0, 1.0, 1.0, 1.0, 1.0, 1.0], "value": 1.1, "unit": "ms"}, {"name": "bitops-bits-in-byte", "lowerIsBetter": true, "alertThreshold": 2.0, "replicates": [3.0, 2.0, 3.0, 2.0, 3.0, 3.0, 3.0, 2.0, 3.0, 2.0, 2.0, 2.0, 2.0, 2.0, 3.0, 3.0, 3.0, 2.0, 2.0, 2.0, 2.0, 2.0, 2.0, 2.0, 3.0, 2.0, 2.0, 2.0, 3.0, 2.0, 2.0, 2.0, 3.0, 2.0, 2.0, 5.0, 3.0, 2.0, 2.0, 3.0, 2.0, 2.0, 2.0, 2.0, 2.0, 2.0, 2.0, 2.0, 2.0, 2.0], "value": 2.34, "unit": "ms"}, {"name": "bitops-bitwise-and", "lowerIsBetter": true, "alertThreshold": 2.0, "replicates": [3.0, 2.0, 3.0, 2.0, 2.0, 3.0, 2.0, 4.0, 3.0, 3.0, 3.0, 3.0, 2.0, 2.0, 2.0, 3.0, 4.0, 3.0, 2.0, 2.0, 5.0, 2.0, 3.0, 2.0, 3.0, 3.0, 2.0, 14.0, 2.0, 2.0, 3.0, 2.0, 3.0, 2.0, 3.0, 4.0, 2.0, 4.0, 2.0, 5.0, 2.0, 3.0, 2.0, 2.0, 2.0, 4.0, 2.0, 2.0, 3.0, 4.0], "value": 2.94, "unit": "ms"}, {"name": "bitops-nsieve-bits", "lowerIsBetter": true, "alertThreshold": 2.0, "replicates": [5.0, 5.0, 5.0, 5.0, 6.0, 10.0, 5.0, 7.0, 5.0, 6.0, 5.0, 5.0, 6.0, 6.0, 5.0, 5.0, 9.0, 5.0, 5.0, 6.0, 6.0, 5.0, 6.0, 5.0, 6.0, 6.0, 8.0, 7.0, 5.0, 6.0, 6.0, 5.0, 6.0, 5.0, 6.0, 14.0, 5.0, 5.0, 5.0, 9.0, 10.0, 5.0, 5.0, 5.0, 6.0, 5.0, 6.0, 5.0, 5.0, 6.0], "value": 6.0, "unit": "ms"}, {"name": "controlflow-recursive", "lowerIsBetter": true, "alertThreshold": 2.0, "replicates": [2.0, 2.0, 2.0, 3.0, 3.0, 3.0, 3.0, 3.0, 3.0, 2.0, 3.0, 2.0, 3.0, 2.0, 2.0, 3.0, 3.0, 3.0, 2.0, 3.0, 3.0, 2.0, 2.0, 3.0, 3.0, 4.0, 2.0, 2.0, 2.0, 2.0, 2.0, 3.0, 2.0, 3.0, 2.0, 3.0, 3.0, 2.0, 2.0, 5.0, 3.0, 2.0, 2.0, 2.0, 3.0, 2.0, 3.0, 2.0, 2.0, 2.0], "value": 2.54, "unit": "ms"}, {"name": "crypto-aes", "lowerIsBetter": true, "alertThreshold": 2.0, "replicates": [8.0, 8.0, 8.0, 9.0, 23.0, 8.0, 8.0, 13.0, 8.0, 8.0, 7.0, 9.0, 12.0, 7.0, 8.0, 22.0, 8.0, 8.0, 8.0, 8.0, 8.0, 9.0, 15.0, 8.0, 10.0, 18.0, 8.0, 8.0, 8.0, 7.0, 8.0, 8.0, 8.0, 7.0, 8.0, 12.0, 9.0, 8.0, 9.0, 12.0, 8.0, 8.0, 18.0, 8.0, 8.0, 8.0, 7.0, 9.0, 9.0, 8.0], "value": 9.54, "unit": "ms"}, {"name": "crypto-md5", "lowerIsBetter": true, "alertThreshold": 2.0, "replicates": [10.0, 6.0, 6.0, 6.0, 6.0, 7.0, 6.0, 6.0, 7.0, 6.0, 5.0, 7.0, 6.0, 6.0, 6.0, 6.0, 6.0, 10.0, 6.0, 6.0, 6.0, 5.0, 6.0, 6.0, 6.0, 10.0, 6.0, 6.0, 6.0, 9.0, 7.0, 6.0, 7.0, 6.0, 6.0, 10.0, 9.0, 6.0, 7.0, 6.0, 6.0, 5.0, 5.0, 6.0, 7.0, 5.0, 9.0, 6.0, 6.0, 10.0], "value": 6.62, "unit": "ms"}, {"name": "crypto-sha1", "lowerIsBetter": true, "alertThreshold": 2.0, "replicates": [4.0, 5.0, 5.0, 4.0, 4.0, 5.0, 4.0, 4.0, 8.0, 5.0, 4.0, 4.0, 4.0, 5.0, 4.0, 4.0, 4.0, 5.0, 5.0, 4.0, 4.0, 4.0, 4.0, 4.0, 6.0, 5.0, 4.0, 4.0, 5.0, 5.0, 5.0, 4.0, 4.0, 4.0, 4.0, 5.0, 4.0, 5.0, 4.0, 5.0, 7.0, 4.0, 4.0, 4.0, 4.0, 4.0, 7.0, 5.0, 6.0, 5.0], "value": 4.6, "unit": "ms"}, {"name": "date-format-tofte", "lowerIsBetter": true, "alertThreshold": 2.0, "replicates": [12.0, 17.0, 13.0, 14.0, 13.0, 12.0, 12.0, 13.0, 13.0, 12.0, 13.0, 14.0, 13.0, 12.0, 34.0, 12.0, 13.0, 12.0, 13.0, 17.0, 11.0, 12.0, 11.0, 12.0, 12.0, 11.0, 18.0, 13.0, 12.0, 15.0, 13.0, 13.0, 17.0, 12.0, 13.0, 12.0, 17.0, 13.0, 13.0, 16.0, 13.0, 12.0, 13.0, 12.0, 39.0, 12.0, 13.0, 13.0, 13.0, 14.0], "value": 14.08, "unit": "ms"}, {"name": "date-format-xparb", "lowerIsBetter": true, "alertThreshold": 2.0, "replicates": [16.0, 13.0, 15.0, 15.0, 15.0, 14.0, 18.0, 19.0, 14.0, 16.0, 14.0, 14.0, 14.0, 14.0, 14.0, 22.0, 15.0, 14.0, 14.0, 13.0, 14.0, 17.0, 14.0, 14.0, 14.0, 14.0, 14.0, 15.0, 15.0, 13.0, 14.0, 17.0, 14.0, 14.0, 16.0, 16.0, 16.0, 14.0, 14.0, 14.0, 14.0, 16.0, 13.0, 14.0, 14.0, 20.0, 14.0, 15.0, 14.0, 14.0], "value": 14.88, "unit": "ms"}, {"name": "math-cordic", "lowerIsBetter": true, "alertThreshold": 2.0, "replicates": [3.0, 3.0, 3.0, 3.0, 3.0, 3.0, 3.0, 3.0, 3.0, 4.0, 3.0, 3.0, 4.0, 3.0, 3.0, 3.0, 3.0, 4.0, 3.0, 3.0, 3.0, 3.0, 3.0, 2.0, 3.0, 3.0, 3.0, 3.0, 3.0, 3.0, 3.0, 4.0, 3.0, 4.0, 3.0, 3.0, 4.0, 4.0, 3.0, 3.0, 2.0, 3.0, 3.0, 3.0, 3.0, 3.0, 3.0, 3.0, 3.0, 3.0], "value": 3.1, "unit": "ms"}, {"name": "math-partial-sums", "lowerIsBetter": true, "alertThreshold": 2.0, "replicates": [6.0, 7.0, 7.0, 7.0, 7.0, 7.0, 7.0, 8.0, 8.0, 7.0, 7.0, 8.0, 7.0, 7.0, 7.0, 7.0, 7.0, 7.0, 7.0, 7.0, 7.0, 7.0, 6.0, 7.0, 7.0, 7.0, 6.0, 7.0, 7.0, 7.0, 7.0, 7.0, 8.0, 7.0, 7.0, 7.0, 7.0, 8.0, 7.0, 7.0, 7.0, 6.0, 6.0, 6.0, 7.0, 7.0, 7.0, 7.0, 7.0, 7.0], "value": 6.98, "unit": "ms"}, {"name": "math-spectral-norm", "lowerIsBetter": true, "alertThreshold": 2.0, "replicates": [3.0, 2.0, 1.0, 2.0, 3.0, 2.0, 1.0, 2.0, 2.0, 2.0, 2.0, 2.0, 2.0, 2.0, 2.0, 2.0, 1.0, 2.0, 2.0, 2.0, 2.0, 1.0, 2.0, 1.0, 2.0, 1.0, 2.0, 2.0, 2.0, 1.0, 1.0, 1.0, 2.0, 1.0, 2.0, 2.0, 2.0, 2.0, 2.0, 2.0, 1.0, 2.0, 1.0, 3.0, 2.0, 2.0, 1.0, 1.0, 1.0, 1.0], "value": 1.74, "unit": "ms"}, {"name": "regexp-dna", "lowerIsBetter": true, "alertThreshold": 2.0, "replicates": [7.0, 7.0, 8.0, 7.0, 10.0, 8.0, 7.0, 7.0, 8.0, 7.0, 7.0, 7.0, 7.0, 8.0, 8.0, 7.0, 8.0, 7.0, 9.0, 7.0, 8.0, 7.0, 8.0, 8.0, 10.0, 10.0, 8.0, 8.0, 9.0, 8.0, 7.0, 7.0, 8.0, 7.0, 8.0, 9.0, 10.0, 8.0, 9.0, 8.0, 8.0, 10.0, 7.0, 10.0, 8.0, 8.0, 9.0, 7.0, 8.0, 7.0], "value": 7.96, "unit": "ms"}, {"name": "string-base64", "lowerIsBetter": true, "alertThreshold": 2.0, "replicates": [4.0, 4.0, 5.0, 5.0, 5.0, 6.0, 5.0, 7.0, 5.0, 4.0, 5.0, 4.0, 7.0, 8.0, 4.0, 4.0, 6.0, 4.0, 5.0, 4.0, 6.0, 5.0, 4.0, 5.0, 5.0, 4.0, 5.0, 5.0, 5.0, 4.0, 5.0, 5.0, 5.0, 4.0, 15.0, 5.0, 5.0, 4.0, 8.0, 7.0, 5.0, 4.0, 7.0, 4.0, 5.0, 4.0, 5.0, 4.0, 4.0, 4.0], "value": 5.16, "unit": "ms"}, {"name": "string-fasta", "lowerIsBetter": true, "alertThreshold": 2.0, "replicates": [12.0, 12.0, 12.0, 12.0, 12.0, 11.0, 12.0, 11.0, 18.0, 17.0, 12.0, 12.0, 12.0, 17.0, 12.0, 11.0, 12.0, 12.0, 11.0, 11.0, 11.0, 11.0, 11.0, 11.0, 12.0, 11.0, 11.0, 11.0, 11.0, 11.0, 11.0, 12.0, 11.0, 11.0, 11.0, 12.0, 11.0, 17.0, 13.0, 17.0, 11.0, 16.0, 12.0, 17.0, 11.0, 11.0, 17.0, 11.0, 20.0, 11.0], "value": 12.5, "unit": "ms"}, {"name": "string-tagcloud", "lowerIsBetter": true, "alertThreshold": 2.0, "replicates": [12.0, 15.0, 13.0, 13.0, 20.0, 12.0, 13.0, 13.0, 12.0, 12.0, 12.0, 13.0, 14.0, 13.0, 13.0, 14.0, 14.0, 20.0, 13.0, 17.0, 13.0, 13.0, 15.0, 13.0, 14.0, 19.0, 13.0, 20.0, 13.0, 13.0, 14.0, 13.0, 16.0, 13.0, 13.0, 17.0, 13.0, 20.0, 13.0, 12.0, 12.0, 12.0, 14.0, 13.0, 13.0, 13.0, 13.0, 20.0, 15.0, 14.0], "value": 14.14, "unit": "ms"}, {"name": "string-unpack-code", "lowerIsBetter": true, "alertThreshold": 2.0, "replicates": [31.0, 30.0, 32.0, 33.0, 30.0, 26.0, 30.0, 29.0, 28.0, 31.0, 30.0, 33.0, 29.0, 32.0, 44.0, 29.0, 28.0, 29.0, 32.0, 31.0, 27.0, 31.0, 29.0, 31.0, 44.0, 36.0, 31.0, 35.0, 32.0, 31.0, 27.0, 33.0, 30.0, 30.0, 59.0, 33.0, 31.0, 30.0, 33.0, 32.0, 27.0, 36.0, 29.0, 31.0, 43.0, 28.0, 34.0, 37.0, 31.0, 34.0], "value": 32.24, "unit": "ms"}, {"name": "string-validate-input", "lowerIsBetter": true, "alertThreshold": 2.0, "replicates": [8.0, 8.0, 8.0, 9.0, 8.0, 8.0, 9.0, 8.0, 16.0, 8.0, 13.0, 8.0, 8.0, 9.0, 9.0, 9.0, 18.0, 9.0, 8.0, 8.0, 13.0, 7.0, 7.0, 15.0, 7.0, 8.0, 11.0, 8.0, 7.0, 8.0, 15.0, 8.0, 8.0, 8.0, 8.0, 9.0, 8.0, 9.0, 13.0, 9.0, 13.0, 7.0, 8.0, 13.0, 8.0, 7.0, 7.0, 9.0, 12.0, 8.0], "value": 9.34, "unit": "ms"}], "type": "benchmark", "alertThreshold": 2.0, "unit": "ms"}]}
[task 2021-02-25T21:18:27.133Z] 21:18:27 INFO - perftest-output Info: results can also be found locally at: /home/cltbld/tasks/task_161428700791325/build/raptor.json
[task 2021-02-25T21:18:27.134Z] 21:18:27 INFO - perftest-results-handler Info: Validating PERFHERDER_DATA against /home/cltbld/tasks/task_161428700791325/mozharness/external_tools/performance-artifact-schema.json
[task 2021-02-25T21:18:27.142Z] 21:18:27 INFO - raptor-control-server Info: shutting down control server
[task 2021-02-25T21:18:27.384Z] 21:18:27 INFO - raptor-webext Info: finished
[task 2021-02-25T21:18:27.385Z] 21:18:27 ERROR - raptor-main Critical: TEST-UNEXPECTED-FAIL: test 'raptor-sunspider-firefox' timed out loading test page: waiting for pending metrics
[task 2021-02-25T21:18:27.493Z] 21:18:27 ERROR - Return code: 1
[task 2021-02-25T21:18:27.493Z] 21:18:27 WARNING - setting return code to 1```
| Comment hidden (Intermittent Failures Robot) |
|
||
Comment 2•5 years ago
|
||
https://wiki.mozilla.org/Bug_Triage#Intermittent_Test_Failure_Cleanup
For more information, please visit auto_nag documentation.
Status: NEW → RESOLVED
Closed: 5 years ago
Resolution: --- → INCOMPLETE
You need to log in
before you can comment on or make changes to this bug.
Description
•