1391587 - AWFY: Downloads of builds from Treeherder stopped working on Aug. 18th

Status: RESOLVED FIXED

(Testing Graveyard :: AWFY, enhancement)

Description

[Benjamin Bouvier [:bbouvier] (inactive)]

I'll investigate to try to find the root cause, and will comment if I find anything.

Comment 1

[Benjamin Bouvier [:bbouvier] (inactive)]

I think something has changed on treeherder. The download script doesn't find Nightly builds anymore for the following targets (found by running tests/test_url_creator.py):

mozilla-inbound opt - Windows 32bits
mozilla-inbound opt - Windows 64bits
mozilla-inbound opt - Darwin 64bits
mozilla-central opt - Darwin 64bits
mozilla-beta opt - Darwin 64bits

Armen, Bob, can you have a look at it please?

(Also, it might be interesting to investigate having some form of automation running test_url_creator at a regular high frequency with email alerts when there's any failure)

Comment 2

[Armen [:armenzg]]

You mention nightly builds but I actually see some 'opt' downloads fail rather than nightly builds.

I believe we might need to switch opt downloads to use TaskCluster as well.

Can you please file a different bug for adding Travis support? I believe it will be the easiest to set up.


[1] Nightly builds
armenzg@armenzg-mbp slave$ python ../tests/test_url_creator.py
Testing download for (mozilla-central,Windows,64bit,nightly)
Fetching JSON at https://treeherder.mozilla.org/api/project/mozilla-central/resultset/?count=10
Fetching JSON at https://index.taskcluster.net/v1/task/gecko.v2.mozilla-central.nightly.latest.firefox.win64-opt
PASSED

Testing download for (mozilla-central,Windows,32bit,nightly)
Fetching JSON at https://treeherder.mozilla.org/api/project/mozilla-central/resultset/?count=10
Fetching JSON at https://index.taskcluster.net/v1/task/gecko.v2.mozilla-central.nightly.latest.firefox.win32-opt
PASSED

Testing download for (mozilla-central,Darwin,64bit,nightly)
Fetching JSON at https://treeherder.mozilla.org/api/project/mozilla-central/resultset/?count=10
Fetching JSON at https://index.taskcluster.net/v1/task/gecko.v2.mozilla-central.nightly.latest.firefox.macosx64-opt
PASSED

Comment 3

[Benjamin Bouvier [:bbouvier] (inactive)]

(In reply to Armen [:armenzg] from comment #2)
> You mention nightly builds but I actually see some 'opt' downloads fail
> rather than nightly builds.

That's correct, my bad.

> Can you please file a different bug for adding Travis support? I believe it
> will be the easiest to set up.

Sure, that's bug 1391626.

Thanks for looking into it!

Comment 4

[Armen [:armenzg]]

I will be away for the rest of the day.

If you're satisfied with the PR please merge, otherwise, I will check later for any issues, address them and merge it:
https://github.com/mozilla/arewefastyet/pull/160

Comment 5

[Bob Clary [:bc] (inactive)]

Looks fixed to me: https://arewefastyet.com/#machine=35&view=single&suite=speedometer-misc&subtest=score

I'll leave it to armen to resolve. Thank you very much!

Comment 6

[Jan de Mooij [:jandem]]

Maybe unrelated but all browser testing stopped last night? Does anyone know why? The OS X shell builds still seem to work...

Comment 7

[Bob Clary [:bc] (inactive)]

The quantum reference machine had rebooted. I've restarted the task and it should begin testing shortly.

Comment 8

[Bob Clary [:bc] (inactive)]

An additional issue was that I failed to install mozprofile even though jmaher had reminded me. That is fixed and the results appear to be coming in.

This patch was merged in https://github.com/mozilla/arewefastyet/commit/8dc51d4296022addf2bb6ed3439a51c1486bdbd1 -> FIXED.