1367237 - All tests fail on C-C treeherder - Can't download from https://archive.mozilla.org - Caught exception: HTTP Error 404: Not Found

Status: RESOLVED FIXED

(Thunderbird :: Testing Infrastructure, defect)

Description

[Jorg K (CEST = GMT+2)]

https://treeherder.mozilla.org/#/jobs?repo=comm-central&revision=e4103af6a8014354a4d98d30106652f646c7bb17

Log says:

13:46:04     INFO - Can't download from https://archive.mozilla.org/pub/thunderbird/tinderbox-builds/comm-central-macosx64/1495555828/thunderbird-55.0a1.en-US.mac.web-platform.tests.test_packages.json to /builds/slave/test/build/thunderbird-55.0a1.en-US.mac.web-platform.tests.test_packages.json!
13:46:04     INFO - Caught exception: HTTP Error 404: Not Found

Andrei, can you take a look, please. Rail, is this something that will fix itself?

Andrei, I assume you know how the tree herder works, right? Click on a job, so an B, X or Z and below an area opens where you can view the full log (2nd icon from the left).

Comment 1

[Andrei Hajdukewycz [:sancus]]

I don't really know anything about the build system nor do I have access to any of those machines so I'm not sure what help I can be, here. Clearly the json file is not in the place where the build script expects it to be, for some reason :)

Comment 2

[Nick Thomas [:nthomas] (UTC+12)]

I suspect something changed in the files uploaded, which is throwing off the sendchange.

Last green-ish sendchange sent:
    files: ['https://archive.mozilla.org/pub/thunderbird/tinderbox-builds/comm-central-macosx64/1495521623/thunderbird-55.0a1.en-US.mac.dmg', 'https://archive.mozilla.org/pub/thunderbird/tinderbox-builds/comm-central-macosx64/1495521623/thunderbird-55.0a1.en-US.mac.awsy.tests.zip']

First failing sendchange sent:    
    files: ['https://archive.mozilla.org/pub/thunderbird/tinderbox-builds/comm-central-macosx64/1495555828/thunderbird-55.0a1.en-US.mac.web-platform.tests.tar.gz', 'https://archive.mozilla.org/pub/thunderbird/tinderbox-builds/comm-central-macosx64/1495555828/thunderbird-55.0a1.en-US.mac.awsy.tests.zip']

Note that it has missed the .dmg, and found a ...web-platform.tests.tar.gz instead. If you compare 
  https://archive.mozilla.org/pub/thunderbird/tinderbox-builds/comm-central-macosx64/1495521623/
  https://archive.mozilla.org/pub/thunderbird/tinderbox-builds/comm-central-macosx64/1495555828/
you'll see that was ...web-platform.tests.zip previously. So that's bug 1359965.

Probably we need to adjust https://dxr.mozilla.org/build-central/rev/9a669eb05f869eba12fe8e033ddfee600d464a85/buildbotcustom/process/factory.py#194

Comment 3

[Nick Thomas [:nthomas] (UTC+12)]

Since that got backed out you can retrigger some build jobs if you need to.

Comment 4

[Nick Thomas [:nthomas] (UTC+12)]

Attachment: [buildbotcustom] Look for tests.tar.gz too

Comment 5

[Nick Thomas [:nthomas] (UTC+12)]

https://hg.mozilla.org/build/buildbotcustom/rev/6e208a766374f84b7134bb92f7f5109b07c0b79c
https://hg.mozilla.org/build/buildbotcustom/rev/b11e68242e0296f5b35191f2be0addcd1d8b06a2

Should be ready when/if bug 1359965 relands.

Comment 6

[Jorg K (CEST = GMT+2)]

Thanks, I don't know what you've done, but https://treeherder.mozilla.org/#/jobs?repo=comm-central is green again and all tests ran and (almost) all passed.