1464333 - Intermittent talos g4 ValidationError: None is not of type u'number' when Gecko 62 merges to Beta on 2018-06-14

Status: RESOLVED DUPLICATE of bug 1463842

(Testing :: Talos, defect, P5)

Description

[Treeherder Bug Filer]

Filed by: ncsoregi [at] mozilla.com

https://treeherder.mozilla.org/logviewer.html#?job_id=179838834&repo=try

https://queue.taskcluster.net/v1/task/TiZeEzQQR9adNJNiounE8Q/runs/0/artifacts/public/logs/live_backing.log

Central as beta:
https://treeherder.mozilla.org/#/jobs?repo=try&revision=f76e02ac2c5ddbaa682f5a2686209407925f0094&selectedJob=179838834

09:20:06     INFO -  PERFHERDER_DATA: {"framework": {"name": "talos"}, "suites": [{"extraOptions": ["e10s", "stylo"], "name": "basic_compositor_video", "lowerIsBetter": true, "alertThreshold": 2.0, "value": null, "subtests": [{"name": "240p.120fps.mp4_scale_1_startup", "lowerIsBetter": true, "alertThreshold": 2.0, "replicates": [null, null, null, null, null, null, null, null, null, null, null, null], "value": null, "unit": "ms/frame"}, {"name": "240p.120fps.mp4_scale_1_inclip", "lowerIsBetter": true, "alertThreshold": 2.0, "replicates": [null, null, null, null, null, null, null, null, null, null, null, null], "value": null, "unit": "ms/frame"}, {"name": "240p.120fps.mp4_scale_1.1_startup", "lowerIsBetter": true, "alertThreshold": 2.0, "replicates": [null, null, null, null, null, null, null, null, null, null, null, null], "value": null, "unit": "ms/frame"}, {"name": "240p.120fps.mp4_scale_1.1_inclip", "lowerIsBetter": true, "alertThreshold": 2.0, "replicates": [null, null, null, null, null, null, null, null, null, null, null, null], "value": null, "unit": "ms/frame"}, {"name": "240p.120fps.mp4_scale_2_startup", "lowerIsBetter": true, "alertThreshold": 2.0, "replicates": [null, null, null, null, null, null, null, null, null, null, null, null], "value": null, "unit": "ms/frame"}, {"name": "240p.120fps.mp4_scale_2_inclip", "lowerIsBetter": true, "alertThreshold": 2.0, "replicates": [null, null, null, null, null, null, null, null, null, null, null, null], "value": null, "unit": "ms/frame"}, {"name": "480p.60fps.webm_scale_1_startup", "lowerIsBetter": true, "alertThreshold": 2.0, "replicates": [null, null, null, null, null, null, null, null, null, null, null, null], "value": null, "unit": "ms/frame"}, {"name": "480p.60fps.webm_scale_1_inclip", "lowerIsBetter": true, "alertThreshold": 2.0, "replicates": [null, null, null, null, null, null, null, null, null, null, null, null], "value": null, "unit": "ms/frame"}, {"name": "480p.60fps.webm_scale_1.1_startup", "lowerIsBetter": true, "alertThreshold": 2.0, "replicates": [null, null, null, null, null, null, null, null, null, null, null, null], "value": null, "unit": "ms/frame"}, {"name": "480p.60fps.webm_scale_1.1_inclip", "lowerIsBetter": true, "alertThreshold": 2.0, "replicates": [null, null, null, null, null, null, null, null, null, null, null, null], "value": null, "unit": "ms/frame"}, {"name": "480p.60fps.webm_scale_2_startup", "lowerIsBetter": true, "alertThreshold": 2.0, "replicates": [14.779704433497532, 16.21718918918919, 16.575801104972363, 18.752249999999982, 15.22812182741118, 13.514324324324326, 15.959255319148937, 16.130107526881723, 15.87587301587302, 15.790421052631581, 13.453721973094172, 15.15464646464646], "value": 15.87587301587302, "unit": "ms/frame"}, {"name": "480p.60fps.webm_scale_2_inclip", "lowerIsBetter": true, "alertThreshold": 2.0, "replicates": [null, null, null, null, null, null, null, null, null, null, null, null], "value": null, "unit": "ms/frame"}, {"name": "1080p.60fps.mp4_scale_1_startup", "lowerIsBetter": true, "alertThreshold": 2.0, "replicates": [null, null, null, null, null, null, null, null, null, null, null, null], "value": null, "unit": "ms/frame"}, {"name": "1080p.60fps.mp4_scale_1_inclip", "lowerIsBetter": true, "alertThreshold": 2.0, "replicates": [null, null, null, null, null, null, null, null, null, null, null, null], "value": null, "unit": "ms/frame"}, {"name": "1080p.60fps.mp4_scale_1.1_startup", "lowerIsBetter": true, "alertThreshold": 2.0, "replicates": [null, null, null, null, null, null, null, null, null, null, null, null], "value": null, "unit": "ms/frame"}, {"name": "1080p.60fps.mp4_scale_1.1_inclip", "lowerIsBetter": true, "alertThreshold": 2.0, "replicates": [null, null, null, null, null, null, null, null, null, null, null, null], "value": null, "unit": "ms/frame"}, {"name": "1080p.60fps.mp4_scale_2_startup", "lowerIsBetter": true, "alertThreshold": 2.0, "replicates": [null, null, null, null, null, null, null, null, null, null, null, null], "value": null, "unit": "ms/frame"}, {"name": "1080p.60fps.mp4_scale_2_inclip", "lowerIsBetter": true, "alertThreshold": 2.0, "replicates": [null, null, null, null, null, null, null, null, null, null, null, null], "value": null, "unit": "ms/frame"}]}, {"lowerIsBetter": true, "subtests": [{"name": "Mean tick time across 100 ticks: ", "lowerIsBetter": true, "alertThreshold": 2.0, "replicates": [4.476, 4.418, 4.4244, 4.4698, 4.4118], "value": 4.421200000000001, "unit": "ms"}], "extraOptions": ["e10s", "stylo"], "name": "glvideo", "alertThreshold": 2.0}, {"extraOptions": ["e10s", "stylo"], "name": "displaylist_mutate", "lowerIsBetter": true, "alertThreshold": 2.0, "value": 21505.186403693253, "subtests": [{"name": "mutate.html", "lowerIsBetter": true, "alertThreshold": 2.0, "replicates": [21293.079999999998, 20501.84, 21838.940000000002, 22620.7, 20745.78], "value": 21292.36, "unit": "ms"}, {"name": "inactive_mutate.html", "lowerIsBetter": true, "alertThreshold": 2.0, "replicates": [21282.9, 21931.320000000003, 20943.14, 21508.96, 21932.32], "value": 21720.14, "unit": "ms"}]}, {"lowerIsBetter": true, "subtests": [{"name": "", "lowerIsBetter": true, "alertThreshold": 2.0, "replicates": [33194.28, 33700.16, 33269.479999999996, 34222.520000000004, 35028.5, 34932.0, 35349.479999999996, 34367.32, 34553.0, 34908.74], "value": 34553.0, "unit": "ms"}], "extraOptions": ["e10s", "stylo"], "name": "rasterflood_svg", "alertThreshold": 2.0}, {"lowerIsBetter": false, "subtests": [{"name": "", "lowerIsBetter": false, "alertThreshold": 2.0, "replicates": [524.0, 527.0, 528.0, 524.0, 522.0, 521.0, 528.0, 525.0, 521.0, 521.0], "value": 524.0, "unit": "score"}], "extraOptions": ["e10s", "stylo"], "name": "rasterflood_gradient", "alertThreshold": 2.0}]}
09:20:06     INFO - Return code: 0
09:20:06     INFO - Validating PERFHERDER_DATA against /Users/cltbld/tasks/task_1527090851/mozharness/external_tools/performance-artifact-schema.json
09:20:06    ERROR - Error while validating PERFHERDER_DATA
09:20:06    ERROR - Traceback (most recent call last):
09:20:06    ERROR - 
09:20:06    ERROR -   File "/Users/cltbld/tasks/task_1527090851/mozharness/mozharness/mozilla/testing/talos.py", line 624, in _validate_treeherder_data
09:20:06    ERROR -     jsonschema.validate(data, schema)
09:20:06    ERROR - 
09:20:06    ERROR -   File "/Users/cltbld/tasks/task_1527090851/build/venv/lib/python2.7/site-packages/jsonschema/validators.py", line 478, in validate
09:20:06    ERROR -     cls(schema, *args, **kwargs).validate(instance)
09:20:06    ERROR - 
09:20:06    ERROR -   File "/Users/cltbld/tasks/task_1527090851/build/venv/lib/python2.7/site-packages/jsonschema/validators.py", line 123, in validate
09:20:06    ERROR -     raise error
09:20:06    ERROR - 
09:20:06    ERROR - ValidationError: None is not of type u'number'
09:20:06    ERROR - 
09:20:06    ERROR - Failed validating u'type' in schema[u'properties'][u'suites'][u'items'][u'properties'][u'value']:
09:20:06    ERROR -     {u'maximum': 1000000000000.0,
09:20:06    ERROR -      u'minimum': -1000000000000.0,
09:20:06    ERROR -      u'title': u'Suite value',
09:20:06    ERROR -      u'type': u'number'}
09:20:06    ERROR - 
09:20:06    ERROR - On instance[u'suites'][0][u'value']:
09:20:06    ERROR -     None
09:20:06    ERROR - 
09:20:06  WARNING - # TBPL WARNING #

Comment 1

[Sebastian Hengst [:aryx] (needinfo me if it's about an intermittent or backout)]

Only hits opt builds, likely a duplicate of bug 1463842.

Comment 2

[Ryan VanderMeulen [:RyanVM]]

Yeah, I think that's correct. I had the same issue on Beta too when I attempted to uplift bug 1462497 yesterday.

Comment 4

[Intermittent Failures Robot]

12 failures in 632 pushes (0.019 failures/push) were associated with this bug in the last 7 days.    

Repository breakdown:
* try: 12

Platform breakdown:
* osx-10-10: 5
* windows7-32: 4
* windows10-64-qr: 2
* windows10-64: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1464333&startday=2018-05-21&endday=2018-05-27&tree=trunk