1281024 - bundles from my user repo are intermittently unavailable

Status: RESOLVED INVALID

(Developer Services :: Mercurial: hg.mozilla.org, defect)

Description

[Kim Moir [:kmoir] ET]

I'm trying to run test builds with this url 

https://api.pub.build.mozilla.org/archiver/hgmo/users/kmoir_mozilla_com/mozilla-beta/595254b25d0c?&preferred_region=us-west-2&suffix=tar.gz&subdir=testing/mozharness

However, it seems that this bundle is only intermittently available and thus most of my test builds fail fetching it.  Is there an issue where it's not on all the nodes that serve these artifacts?

Comment 1

[Hal Wine [:hwine] use NI!]

fwiw, this is the same repo that needed help in initial creation via bug 1279311

Comment 2

[Kim Moir [:kmoir] ET]

I added some more changes to my repo last night and then tried another build this morning but it couldn't clone it.


2016-06-22 05:45:58,768 Setting DEBUG logging.
2016-06-22 05:45:58,768 attempt 1/10
2016-06-22 05:45:58,768 Getting archive location from https://api.pub.build.mozilla.org/archiver/hgmo/users/kmoir_mozilla_com/mozilla-beta/05be4a1e2307?&preferred_region=us-west-2&suffix=tar.gz&subdir=testing/mozharness
2016-06-22 05:45:59,553 attempt 1/10
2016-06-22 05:45:59,735 current task status: no status available at this point. state: SUCCESS
2016-06-22 05:45:59,735 Automation Error: s3 URL could not be determined even though archiver task completed
2016-06-22 05:45:59,735 Check archiver logs for errors. Task status: no status available at this point.

Hal mentioned that user repo bundles are created via a cron job at night.  Could we verify that this cron job is working properly?

Comment 3

[Hal Wine [:hwine] use NI!]

I don't understand this system - tossing to :fubar

Comment 4

[Gregory Szorc [:gps]]

I'm not sure what "bundles from my user repo are intermittently unavailable" means. Do you mean that https://hg.mozilla.org/ is giving 404s or 500s for your user repo? Or is the archiver API not liking things for some reason?

I ask because we don't generate Mercurial bundles for user repos: we only generate them for certain, high-volume repos. The list is at https://hg.cdn.mozilla.net/.

Comment 5

[Gregory Szorc [:gps]]

needinfo per comment #4.

Comment 6

[Kim Moir [:kmoir] ET]

Well, I don't need this anymore since the bug I was using this for I fixed by landing the patches on production trees and testing it that way.  I don't understand how it worked for a few test runs on my master where it appeared to be cloning the user repo but I don't have time to revisit.  I'll keep that in mind next time, that mercurial bundles aren't generated for user repos.