1060576 - [titanic] Use requests-cache to improve performance

Status: RESOLVED WONTFIX

(Testing :: General, defect)

Description

[Gautam Akiwate [:gakiwate]]

Titanic (https://github.com/gakiwate/titanic/) is a tool to bisect test failures.

Titanic takes revision under investigation - which can be supplied to it using the APIs or command line and then works by pulling data about the revision and revisions before it from TBPL(https://tbpl.mozilla.org/) to bisect the failure.

Presently, we do not cache the results that we get from querying TBPL or the releng build system. This means that we spend a lot of time that potentially could be saved if we had cached the results.

We would like to investigate the possibility of using the requests-cache library to achieve caching. 
http://requests-cache.readthedocs.org/en/latest/ 
https://pypi.python.org/pypi/requests-cache

In particular we are interested in improving the performance of the functions
isBuildPending, isBuildRunning, isJobRunning, isJobPending. https://github.com/gakiwate/titanic/blob/master/titanic.py#523

Comment 1

[Gautam Akiwate [:gakiwate]]

Tools that might help in validating improvements!

Line Profiler: https://pythonhosted.org/line_profiler/

Comment 2

[abhi12ravi]

Hi Gautam, 
Can you assign this bug to me?

Comment 3

[Gautam Akiwate [:gakiwate]]

Done. The bug is yours! :)

Comment 4

[Gautam Akiwate [:gakiwate]]

Any progress on this BUG?

Comment 5

[abhi12ravi]

Hi Gautam,

Sorry I haven't been able to work on this bug. Been caught up with academics. Got some time now. Will work on this.

Comment 6

[Gautam Akiwate [:gakiwate]]

Sure. Let me know if you need anything! :)

Comment 7

[Joel Maher ( :jmaher ) (UTC -8)]

we are using mozilla_ci_tools (https://github.com/armenzg/mozilla_ci_tools) which has taken a lot of titanic pieces and knowledge.