The default bug view has changed. See this FAQ.

move Talos from cvs into Mercurial

RESOLVED FIXED

Status

Testing
Talos
P5
normal
RESOLVED FIXED
7 years ago
7 years ago

People

(Reporter: jhford, Assigned: alice)

Tracking

Firefox Tracking Flags

(Not tracked)

Details

(Whiteboard: [talos])

Attachments

(1 attachment, 1 obsolete attachment)

I am noticing a lot of N900s failing their testing runs because of CVS being killed midstream or failing to start.

I have imported talos using the mercurial convert extension by doing:

1. enable convert extension by adding this to ~/.hgrc
[extensions]
hgext.convert=

2. created a mapping file for usernames (this is not an exhaustive list)
cat > authors << EOF
anodelman%mozilla.com=Alice Nodelman <alice@mozilla.com>
catlee%mozilla.com=Chris AtLee <catlee@mozilla.com>
lsblakk%mozilla.com=Lukas Blakk <lblakk@mozilla.com>
asasaki%mozilla.com=Aki Sasaki <asasaki@mozilla.com>
EOF

3. check out talos and pageloader
cvs -d :pserver:anonymous@63.245.209.14:/cvsroot co -d talos mozilla/testing/performance/talos
cvs -d :pserver:anonymous@63.245.209.14:/cvsroot co -d pageloader mozilla/layout/tools/pageloader

4. convert CVS -> HG
hg convert --authors=authors talos
hg convert --authors=authors pageloader

5. push to my user repository
hg push ssh://hg.mozilla.org/users/jford_mozilla.com/talos
hg push ssh://hg.mozilla.org/users/jford_mozilla.com/pageloader

6. Copy+modify generate-tpcomponent to work with this format

I have merged the pageloader and talos to form one repository at 
http://hg.mozilla.org/users/jford_mozilla.com/talos-tp-merged

to do this I cloned my talos repository, cloned my pageloader into the talos dir, rm -rf .hg .hgtags in pageloader dir.  I copied the generate-tpcomponent.py script into the talos directory and modified it to work without needing a seperate checkout of pageloader


I don't know if we care about history.  If we don't, instead of doing the hg convert we could do

cd talos
find -name CVS -exec rm -rf {} \;
hg addremove
Priority: -- → P5

Updated

7 years ago
Blocks: 467683
(Assignee)

Comment 1

7 years ago
This is mostly dependent upon having hg installed on all talos slaves.

Comment 2

7 years ago
We probably need Aravind (or somebody) to port the CVS commit hook to an hg hook.
But, yes please :)
OS: Mac OS X → All
Hardware: x86 → All
(In reply to comment #1)
> This is mostly dependent upon having hg installed on all talos slaves.

aiui, installing hg on all the new rev3 talos slaves has been done as part of bug#548768.

Updated

7 years ago
Whiteboard: [talos]
From reading comment#0, it seems like this bug is about taking existing talos and pageloader code checked into cvs, and moving it to hg. Tweaking summary to match.

Moving this bug to Testing:General. Once this is fixed, please file a separate bug in mozilla.org/ReleaseEngineering for us to change our automation to pull from hg instead of cvs.
Component: Release Engineering → General
Product: mozilla.org → Testing
QA Contact: release → general
Summary: Put Talos + Pageloader in Mercurial → Put Talos + Pageloader from cvs into Mercurial
Version: other → unspecified
(Assignee)

Comment 5

7 years ago
Moving to Talos component.
Component: General → Talos
(Assignee)

Updated

7 years ago
Assignee: nobody → anodelman
(Assignee)

Comment 6

7 years ago
Created attachment 473801 [details] [diff] [review]
download talos per run as zip from build server

Just need a zip of the talos code on the build server.

This gets us away from a dependency of having hg installed on all talos slaves.
Attachment #473801 - Flags: review?(catlee)
(Assignee)

Comment 7

7 years ago
Pageloader already in hg repo, updating summary to indicate as such.
Summary: Put Talos + Pageloader from cvs into Mercurial → move Talos from cvs into Mercurial
Comment on attachment 473801 [details] [diff] [review]
download talos per run as zip from build server

easy peasy!  needs testing before landing.
Attachment #473801 - Flags: review?(catlee) → review+
(Assignee)

Updated

7 years ago
Depends on: 595002
(Assignee)

Updated

7 years ago
Depends on: 595007
(In reply to comment #8)
> Comment on attachment 473801 [details] [diff] [review]
> download talos per run as zip from build server
> 
> easy peasy!  needs testing before landing.

also, we can get rid of references to cvsRoot.
(Assignee)

Comment 10

7 years ago
Initial push to http://hg.mozilla.org/build/talos/ complete.

I did convert history and updated all the user names.  Looks okay to me.
(Assignee)

Comment 11

7 years ago
Created attachment 474890 [details] [diff] [review]
[checked in] download talos per run as zip from build server (take 2)
Attachment #473801 - Attachment is obsolete: true
(Assignee)

Comment 12

7 years ago
Staging overnight to ensure that everything works correctly.
(Assignee)

Comment 13

7 years ago
Comment on attachment 474890 [details] [diff] [review]
[checked in] download talos per run as zip from build server (take 2)

Going green in staging.
Attachment #474890 - Flags: review?(catlee)

Updated

7 years ago
Attachment #474890 - Flags: review?(catlee) → review+
(Assignee)

Updated

7 years ago
Blocks: 593081
(Assignee)

Updated

7 years ago
Blocks: 598507
(Assignee)

Updated

7 years ago
Blocks: 596132
I'm seeing jobs pulling Talos from the .zip now. All done here?
Status: NEW → RESOLVED
Last Resolved: 7 years ago
Resolution: --- → FIXED
Comment on attachment 474890 [details] [diff] [review]
[checked in] download talos per run as zip from build server (take 2)

a71cf27a8478
Attachment #474890 - Attachment description: download talos per run as zip from build server (take 2) → [checked in] download talos per run as zip from build server (take 2)
You need to log in before you can comment on or make changes to this bug.