1607722 - Permanent speedometer KeyError: 'measure'

Status: RESOLVED FIXED

(Testing :: Raptor, defect, P1)

Description

[Treeherder Bug Filer]

Filed by: archaeopteryx [at] coole-files.de
Parsed log: https://treeherder.mozilla.org/logviewer.html#?job_id=283867219&repo=autoland
Full log: https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/KF3Q93CFTfKP6GfFPmxmAg/runs/0/artifacts/public/logs/live_backing.log

---

[task 2020-01-08T10:25:41.992Z] 10:25:41 INFO - [2020-01-08 10:25:41] INFO: [browsertime] Wrote data to blobber_upload_dir/browsertime-results/raptor-speedometer-firefox
[task 2020-01-08T10:25:41.992Z] 10:25:41 INFO - [2020-01-08 10:25:41] DEBUG: [browsertime] Stopping Browsertime
[task 2020-01-08T10:25:41.995Z] 10:25:41 INFO - [2020-01-08 10:25:41] DEBUG: [browsertime] Stopped Browsertime
[task 2020-01-08T10:25:42.063Z] 10:25:42 INFO - perftest-results-handler Info: retrieving browsertime test results
[task 2020-01-08T10:25:42.064Z] 10:25:42 INFO - perftest-results-handler Info: found browsertime results at /home/cltbld/tasks/task_1578478879/build/blobber_upload_dir/browsertime-results/raptor-speedometer-firefox/browsertime.json
[task 2020-01-08T10:25:42.087Z] 10:25:42 ERROR - Traceback (most recent call last):
[task 2020-01-08T10:25:42.087Z] 10:25:42 INFO - File "/home/cltbld/tasks/task_1578478879/build/tests/raptor/raptor/raptor.py", line 1937, in <module>
[task 2020-01-08T10:25:42.087Z] 10:25:42 INFO - main()
[task 2020-01-08T10:25:42.087Z] 10:25:42 INFO - File "/home/cltbld/tasks/task_1578478879/build/tests/raptor/raptor/raptor.py", line 1895, in main
[task 2020-01-08T10:25:42.087Z] 10:25:42 INFO - success = raptor.run_tests(raptor_test_list, raptor_test_names)
[task 2020-01-08T10:25:42.087Z] 10:25:42 INFO - File "/home/cltbld/tasks/task_1578478879/build/tests/raptor/raptor/raptor.py", line 316, in run_tests
[task 2020-01-08T10:25:42.087Z] 10:25:42 INFO - return self.process_results(tests, test_names)
[task 2020-01-08T10:25:42.088Z] 10:25:42 INFO - File "/home/cltbld/tasks/task_1578478879/build/tests/raptor/raptor/raptor.py", line 344, in process_results
[task 2020-01-08T10:25:42.088Z] 10:25:42 INFO - return self.results_handler.summarize_and_output(self.config, tests, test_names)
[task 2020-01-08T10:25:42.088Z] 10:25:42 INFO - File "/home/cltbld/tasks/task_1578478879/build/tests/raptor/raptor/results.py", line 547, in summarize_and_output
[task 2020-01-08T10:25:42.088Z] 10:25:42 INFO - test['measure']):
[task 2020-01-08T10:25:42.088Z] 10:25:42 INFO - KeyError: 'measure'
[task 2020-01-08T10:25:42.143Z] 10:25:42 ERROR - Return code: 1

Comment 1

[Tarek Ziadé (:tarek)]

We don't have any measure value defined here https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/benchmarks/raptor-speedometer.ini

I guess I will just default to "get all measure" in that case. Unless you want to make this field mandtory?

Comment 2

[Tarek Ziadé (:tarek)]

Attachment: Bug 1607722 - Permanent speedometer KeyError: 'measure'

If we don't have any provided 'measure' value, defaults to all.

Comment 3

[Tarek Ziadé (:tarek)]

try run https://treeherder.mozilla.org/#/jobs?repo=try&tier=1%2C2%2C3&revision=f8c8cad111d8235295d2430397213ed0375499ea

Comment 4

[Greg Mierzwinski [:sparky]]

+1 for defaulting to all if it's not provided.

Comment 5

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/autoland/rev/e3f2e22f40fe
Permanent speedometer KeyError: 'measure' r=sparky

Comment 6

[Cristina Coroiu [:ccoroiu]]

https://hg.mozilla.org/mozilla-central/rev/e3f2e22f40fe

Comment 7

[Intermittent Failures Robot]

1 failures in 4472 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 1

Platform breakdown:

• linux64: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1607722&startday=2020-01-06&endday=2020-01-12&tree=all