1029773 - end_to_end reconfig script should run its python unbuffered

Status: RESOLVED FIXED

(Release Engineering :: General, defect)

Description

[Justin Wood (:Callek)]

Attachment: [tools] v1

Because the python of manage_masters/manage_foopies is not going directly to a tty, python is running in buffered mode, meaning the log files I try to tail don't give me emmediate feedback, especially annoying for those periodic prints about progress (since I don't get those except as one big blob of text)

This should make this write to the log(s) as data comes in. Definitely worse for IO but better for human sanity.

Comment 1

[Justin Wood (:Callek)]

So I see an error here, so I'm not certain things stuck right, I pinged :jakem and :dustin in IRC incase its expected, I *think* we're good though.

[[e-mail]3 ~]# cd /data/releng/src/talos-remote/www/talos-repo
[[e-mail]3 talos-repo]# hg status
? talos/page_load_test/tp4
[[e-mail]3 talos-repo]# hg id
b4907f0b27d3 tip
[[e-mail]3 talos-repo]# hg pull -r f9136c4bc616
pulling from http://hg.mozilla.org/build/talos
searching for changes
adding changesets
adding manifests
adding file changes
added 18 changesets with 51 changes to 34 files
(run 'hg update' to get a working copy)
[[e-mail]3 talos-repo]# hg up
34 files updated, 0 files merged, 0 files removed, 0 files unresolved
[[e-mail]3 talos-repo]# hg ident
f9136c4bc616 tip
[[e-mail]3 talos-repo]# /data/releng/src/talos-remote/update
Deploying code...
[2014-06-25 13:46:30] Running rsync_project
[2014-06-25 13:46:30] [localhost] running: /usr/bin/rsync -aq --include '.gitkeep' --exclude '.git*' --exclude '.hg*' --exclude '
.svn*' --exclude 'CVS' --exclude '.bzr*' --delete /data/releng/src/talos-remote/ /data/releng/www/talos-remote/
[2014-06-25 13:46:31] [localhost] finished: /usr/bin/rsync -aq --include '.gitkeep' --exclude '.git*' --exclude '.hg*' --exclude
'.svn*' --exclude 'CVS' --exclude '.bzr*' --delete /data/releng/src/talos-remote/ /data/releng/www/talos-remote/ (1.138s)
[2014-06-25 13:46:31] Finished rsync_project (1.139s)
[2014-06-25 13:46:31] Running commit_www
[2014-06-25 13:46:31] [localhost] running: cd /data/releng/www && /usr/bin/git add .; /usr/bin/git commit -a -m 'deploy ['talos-r
emote']'
[2014-06-25 13:46:32] [localhost] finished: cd /data/releng/www && /usr/bin/git add .; /usr/bin/git commit -a -m 'deploy ['talos-
remote']' (1.296s)
[localhost] out: [master c09deff] deploy [talos-remote]
[localhost] out: Committer: root <[e-mail]>
[localhost] out: Your name and email address were configured automatically based
[localhost] out: on your username and hostname. Please check that they are accurate.
[localhost] out: You can suppress this message by setting them explicitly:
[localhost] out:
[localhost] out: git config --global user.name "Your Name"
[localhost] out: git config --global user.email [e-mail]
[localhost] out:
[localhost] out: After doing this, you may fix the identity used for this commit with:
[localhost] out:
[localhost] out: git commit --amend --reset-author
[localhost] out:
[localhost] out: 49 files changed, 1703 insertions(+), 807 deletions(-)
[localhost] out: create mode 100644 talos-remote/www/talos-repo/talos/mainthreadio.py
[localhost] out: create mode 100644 talos-remote/www/talos-repo/talos/mtio-whitelist.json
[localhost] out: create mode 100644 talos-remote/www/talos-repo/talos/page_load_test/tart/addon/content/Profiler.js
[localhost] out: create mode 100644 talos-remote/www/talos-repo/talos/page_load_test/tart/generate-xpi.html
[localhost] out: create mode 100644 talos-remote/www/talos-repo/talos/page_load_test/tart/scripts/jszip.min.js
[localhost] out: create mode 100644 talos-remote/www/talos-repo/talos/page_load_test/tart/scripts/xpigen.js
[localhost] out: create mode 100644 talos-remote/www/talos-repo/talos/pageloader/chrome/Profiler.js
[localhost] out: create mode 100644 talos-remote/www/talos-repo/talos/scripts/Profiler.js
[localhost] out: create mode 100644 talos-remote/www/talos-repo/talos/startup_test/__init__.py
[localhost] out: create mode 100644 talos-remote/www/talos-repo/talos/startup_test/fennecmark/en.wikipedia.org/Wiki.png
[localhost] out: create mode 100644 talos-remote/www/talos-repo/talos/startup_test/media/__init__.py
[localhost] out: rewrite talos-remote/www/talos-repo/talos/startup_test/media/html/input16.wav (93%)
[localhost] out: create mode 100755 talos-remote/www/talos-repo/talos/startup_test/media/tools/MediaUtils
[localhost] out: create mode 100644 talos-remote/www/talos-repo/talos/whitelist.py
[2014-06-25 13:46:32] Finished commit_www (1.297s)
[2014-06-25 13:46:32] Running push_www
[2014-06-25 13:46:32] [web1.releng.webapp.scl3.mozilla.com] running: /data/bin/update-www.sh talos-remote
[2014-06-25 13:46:32] [web2.releng.webapp.scl3.mozilla.com] running: /data/bin/update-www.sh talos-remote
[2014-06-25 13:46:32] [celery1.srv.releng.scl3.mozilla.com] running: /data/bin/update-www.sh talos-remote
[2014-06-25 13:46:32] [celery1.srv.releng.scl3.mozilla.com] failed: /data/bin/update-www.sh talos-remote (0.145s)
[celery1.srv.releng.scl3.mozilla.com] err: Permission denied (publickey,gssapi-keyex,gssapi-with-mic).
[2014-06-25 13:46:37] [web1.releng.webapp.scl3.mozilla.com] finished: /data/bin/update-www.sh talos-remote (5.140s)
[web1.releng.webapp.scl3.mozilla.com] out: Not removing buildapi/buildapi/
[web1.releng.webapp.scl3.mozilla.com] out: Not removing buildapi/virtualenv/lib/python2.6/
[web1.releng.webapp.scl3.mozilla.com] out: httpd (pid  3185) is running...
[2014-06-25 13:46:38] [web2.releng.webapp.scl3.mozilla.com] finished: /data/bin/update-www.sh talos-remote (5.199s)
[web2.releng.webapp.scl3.mozilla.com] out: httpd (pid  19171) is running...
[2014-06-25 13:46:38] Finished push_www (5.202s)
[2014-06-25 13:46:38] Starting new HTTPS connection (1): changelog.paas.allizom.org

Comment 2

[Justin Wood (:Callek)]

...er c#1 was obviously wrong bug