1617618 - Invalid perfherder schema in the live_backing.log (lowerIsBetter)

Status: RESOLVED FIXED

(Testing :: Raptor, defect)

Description

[Mike Trinkala [:trink]]

lowerIsBetter is set to an integer instead of a Boolean like all other submissions. The errors seem to be associated with

• provisionerId: releng-hardware
• worker-implementation: generic-worker
• test-type: raptor
• groupSymbol: Btime

Here is a specific task exhibiting the behavior:

• taskId: CI1QLTv7SuCljxX3II8xsg
• summary: SchemaURI: #/properties/suites/items/properties/lowerIsBetter Keyword: type DocumentURI: #/suites/0/lowerIsBetter
• details: {"type":{"expected":["boolean"],"actual":"integer","instanceRef":"#/suites/0/lowerIsBetter","schemaRef":"#/properties/suites/items/properties/lowerIsBetter"}}

Comment 1

[Dustin J. Mitchell [:dustin] (he/him)]

TC doesn't generate the perfherder output. I suspect this is a bug in the raptor tests? I'm not sure who would be responsible for that..

Comment 2

[Mike Trinkala [:trink]]

(In reply to Dustin J. Mitchell [:dustin] (he/him) from comment #1)

TC doesn't generate the perfherder output. I suspect this is a bug in the raptor tests? I'm not sure who would be responsible for that..

Yeah, I didn't know where to file this and was hoping for a needinfo suggestion (as I have some additional related perfherder issues)

Comment 3

[Dustin J. Mitchell [:dustin] (he/him)]

Callek suggests:

Perhaps someone in #cia:mozilla.org given the raptor thought

Comment 4

[Joel Maher ( :jmaher ) (UTC -8)]

test is:
browsertime-ares6-firefox-e10s

I cannot find it on treeherder, so maybe there is someone who can help with that magic.

moving this to testing::raptor, maybe browsertime has or had a bug in reporting

Comment 5

[Greg Mierzwinski [:sparky]]

The patch which caused this issue is being backed out: https://hg.mozilla.org/integration/autoland/rev/82680b76efbe6a01c2e983bd3e78f326c4d3f61c

It's a tier 3 test on autoland.

Comment 6

[Greg Mierzwinski [:sparky]]

This issue is fixed now after the patch was backed out.