1060641 - [titanic] Switch from TBPL's getBuildRevisions.php to treeherder's API

Status: RESOLVED WONTFIX

(Testing :: General, defect)

Description

[Gautam Akiwate [:gakiwate]]

Titanic (https://github.com/gakiwate/titanic/) is a tool to bisect test failures.

Titanic takes revision under investigation - which can be supplied to it using the APIs or command line and then works by pulling data about the revision and revisions before it from TBPL(https://tbpl.mozilla.org/) to bisect the failure.

One of the main features of TBPL that Titanic uses is the getRevisionBuilds feature. It basically lists out the status of any job given the revision and the branch in a JSON format.

For example, for revision 'd26db5427e8a' in the branch 'mozilla-inbound' we can get all the jobs for all platforms and revisions at 
https://tbpl.mozilla.org/php/getRevisionBuilds.php?branch=mozilla-inbound&rev=d26db5427e8a

It would be great to have something similar for Treeherder to query if something similar doesn't exist already.

Comment 1

[Ed Morley [:emorley]]

The API docs are at:
https://treeherder.mozilla.org/docs/

jeads/mdoglio/camd will be able to answer more specific questions.

Comment 2

[Ed Morley [:emorley]]

For an idea of some of the queries that might work, load https://treeherder.mozilla.org/ with the webconsole open and filter on "/api/".

eg:
* https://treeherder.mozilla.org/api/repository/
* https://treeherder.mozilla.org/api/project/mozilla-central/resultset/?count=10&format=json&full=true&with_jobs=false
* https://treeherder.mozilla.org/api/project/mozilla-central/resultset/1/get_resultset_jobs/?format=json&result_set_ids=461

I think this bug as filed really belongs in Testing::General, since the feature exists in treeherder already, it just needs exploring as part of the ongoing titanic work. Should you need jeads/camd/mdoglio to answer questions/check the queries you're using are the most efficient then just needinfo them. And if the API proves to be inadequate, a separate bug filed in treeherder with the payload required would probably be best :-)

This issue is also orthogonal to adding UI support in treeherder, since when TBPL is EOL'd this bug will be required for titantic to continue to function, even if treeherder isn't integrated with titanic yet.

Comment 3

[Ed Morley [:emorley]]

Making this bug about:
> 1) Shorter term: Switch titanic over to using treeherder's API rather than TBPL's

From bug 1060632 comment 1.

Comment 4

[Ed Morley [:emorley]]

If it helps, here is the diff for another tool switching from getBuildRevisions.php to Treeherder's API:
https://github.com/mstange/analyze-tryserver-profiles/commit/e14dfa4a9a9ca17e0ca6e4d96e0208d37b271e1d

Comment 5

[Gautam Akiwate [:gakiwate]]

Thanks Ed. This actually really helps! This is awesome! :)

Comment 6

[Ed Morley [:emorley]]

Just as a heads up, I'd provisionally like to see if we can switch TBPL off in January (though this is still a big unknown, and there are lots of other pieces that need to be finished before that point). Could someone start looking at this soon? (Or at least say that we needn't block on this bug?) :-)

Comment 7

[Joel Maher ( :jmaher ) (UTC -8)]

I think we can unblock on this- we actually have Q1 work scheduled to expand on Titanic, but some of it will need to be reworked to sort out changing needs, etc.

Comment 8

[Ed Morley [:emorley]]

Great, thank you :-)

Comment 9

[Ed Morley [:emorley]]

Note in the meantime you'll need to adjust the TBPL getRevisionBuilds.php call [1] due to bug 1114742.

[1] https://github.com/gakiwate/titanic/blob/2aa8ebda001a3313700ab8bade44d841cad5600b/titanic.py#L207

Comment 10

[Joel Maher ( :jmaher ) (UTC -8)]

we are using mozilla_ci_tools (https://github.com/armenzg/mozilla_ci_tools) which has taken a lot of titanic pieces and knowledge.