1132175 - [raptor] Add support for arbitrary tag names and values as baseline in new raptor tool

Status: RESOLVED DUPLICATE of bug 1129445

(Firefox OS Graveyard :: Gaia::PerformanceTest, defect)

Description

[Inder]

Currently we have only gecko/gaia SHA1s as the baseline for collecting/plotting the performance numbers. It needs to be extended to support arbitrary tag names and values to help collect data for various scenarios. For example, AU names [1] where all the projects are versioned and not just gecko/gaia.

This data can be provided during |make raptor| step.

[1] https://www.codeaurora.org/cgit/quic/lf/b2g/manifest/refs/tags

Comment 1

[Inder]

I am not sure if it's duplicate of Bug 1129445 but definitely related.

Comment 2

[Jean Gong :jgong]

Ravi, as part of 2.2 triage.  We need you look at this and followup,

Comment 3

[Jean Gong :jgong]

Ravi, as part of 2.2 triage.  We need you look at this and followup.

Comment 4

[Ravi Dandu]

This should not block 2.2. This is a requirement on tool used to track performance.

Comment 5

[Mike Lee [:mlee]]

Ravi,

Per my triage with CAF today, a fix for this issue is still needed for them to use Raptor that implies that this issue needs to be 2.2+ blocking-b2g or feature-b2g. Is there a reason why neither flag was set or 2.2? cleared?

Thanks,
Mike

Comment 6

[Mike Lee [:mlee]]

Clarified with :eli on IRC that Raptor delivery is planned for end of Q1 which aligns with the current 2.2 FC date of April 6th at https://wiki.mozilla.org/B2G/Roadmap

This means Raptor isn't scheduled to be delivered for 2.2 FC and not 2.2 FL.

Comment 7

[Mike Lee [:mlee]]

Typo: This means Raptor is scheduled to be delivered for 2.2 FC and not 2.2 FL.

Comment 8

[:Eli Perelman]

This change also needs a revision to the Raptor docker container.