560957 - Talos profiles, plugins, etc. should be fetched via http

Status: RESOLVED FIXED

(Release Engineering :: General, defect, P2)

Description

[Chris AtLee [:catlee]]

Ideally from stage, or some public location.  FileDownload is slow, gets stuck, and smells funny too.

Comment 1

[alice nodelman [:alice] [:anode]]

FileDownload ate my baby!

Comment 2

[Chris AtLee [:catlee]]

More stuck builds because of FileDownload eating babies.

fox2mike sez that it should be easy to set up a pull from cruncher onto stage.  We already have rsyncd set up on cruncher.

1) Alice, can you update your scripts on cruncher to put the files into /var/www/html/talos_profiles.

2) Also, figure out where on stage they should go.

Next, we can file an IT bug to rsync from cruncher::talos_profiles to wherever we'd like on stage.

Comment 3

[alice nodelman [:alice] [:anode]]

Scripts now updated to mv dirty profiles to /var/www/html/talos_profiles after they are updated nightly.

Comment 5

[Chris AtLee [:catlee]]

We need a place on ftp to put these things.  Any suggestions?

Comment 6

[Armen [:armenzg]]

(In reply to comment #5)
> We need a place on ftp to put these things.  Any suggestions?

http://ftp.mozilla.org/pub/mozilla.org/firefox/{others,extra,tools,etc} ?

Are these stuff that we (firefox) only use?

Comment 7

[Chris AtLee [:catlee]]

(In reply to comment #5)
> We need a place on ftp to put these things.  Any suggestions?

We settled on http://build.mozilla.org/talos

Comment 8

[Chris AtLee [:catlee]]

Attachment: Switch most FileDownloads to DownloadFile in TalosFactory

supportUrlBase is something like http://build.mozilla.org/talos

Comment 9

[[e-mail] (:bhearsum)]

Comment on attachment 447926 [details] [diff] [review]
Switch most FileDownloads to DownloadFile in TalosFactory

Looks good to me!

Comment 10

[Chris AtLee [:catlee]]

Attachment: Set support_url_base in buildbot configs to http://build.mozilla.org/talos

Comment 11

[[e-mail] (:bhearsum)]

Comment on attachment 448406 [details] [diff] [review]
Set support_url_base in buildbot configs to http://build.mozilla.org/talos

Seems fine

Comment 12

[Chris AtLee [:catlee]]

Comment on attachment 447926 [details] [diff] [review]
Switch most FileDownloads to DownloadFile in TalosFactory

changeset:   755:8b1380cbf092

Comment 13

[Chris AtLee [:catlee]]

Comment on attachment 448406 [details] [diff] [review]
Set support_url_base in buildbot configs to http://build.mozilla.org/talos

changeset:   2466:dc300ccfeaa1