1884808 - Frequent UVC / UVCS task time outs due to hgmo slowness

Status: RESOLVED FIXED

(Release Engineering :: General, defect)

Description

[Geoff Brown [:gbrown]]

As seen in #releaseduty, there have been frequent task timeouts in UVC and UVCS tasks over the last couple of weeks. These tasks make many requests to hg.mozilla.org and it has been slow lately -- we assume that's the problem.

https://treeherder.mozilla.org/jobs?repo=mozilla-beta&revision=4460e94868c1046b2812fc3a0940966d4a98a7c5&searchStr=uv
https://treeherder.mozilla.org/jobs?repo=mozilla-release&searchStr=uv&revision=163c38ee7a7a13a344e7fe15b75d86e6c5212ae0

Comment 1

[Geoff Brown [:gbrown]]

Attachment: Bug 1884808 - Increase max-run-time for UVC and UVCS tasks

Comment 2

[Julien Cristau [:jcristau]]

An alternative might be to query hgmo less, and use the fact that we have a clone of the repo.
E.g. instead of https://hg.mozilla.org/releases/mozilla-beta/raw-file/DEVEDITION_95_0b10_RELEASE/browser/locales/shipped-locales we can run hg cat -r DEVEDITION_95_0b10_RELEASE browser/locales/shipped-locales. That might not always work, because unified doesn't track all branches, but it should work often enough?

Comment 3

[Julien Cristau [:jcristau]]

https://phabricator.services.mozilla.com/D204470 is an untested attempt at implementing comment 2

Comment 4

[BugBot [:suhaib / :marco/ :calixte]]

The severity field is not set for this bug.
:jlorenzo, could you have a look please?

For more information, please visit BugBot documentation.

Comment 5

[Heitor Neiva [:hneiva]]

Attachment: Bug 1884808 - Improve UVC performance - async download + hglib r?#releng

Add async downloading from archive
Changes "hg cat" to pull more than one file from a revision

Comment 6

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/autoland/rev/2821d05276b2
Improve UVC performance - async download + hglib r=releng-reviewers,jcristau

Comment 7

[pstanciu]

https://hg.mozilla.org/mozilla-central/rev/2821d05276b2