end_to_end reconfig script should run its python unbuffered



Release Engineering
General Automation
3 years ago
3 years ago


(Reporter: Callek, Assigned: Callek)


Firefox Tracking Flags

(Not tracked)



(1 attachment)



3 years ago
Created attachment 8445410 [details] [diff] [review]
[tools] v1

Because the python of manage_masters/manage_foopies is not going directly to a tty, python is running in buffered mode, meaning the log files I try to tail don't give me emmediate feedback, especially annoying for those periodic prints about progress (since I don't get those except as one big blob of text)

This should make this write to the log(s) as data comes in. Definitely worse for IO but better for human sanity.
Attachment #8445410 - Flags: review?(coop)

Comment 1

3 years ago
So I see an error here, so I'm not certain things stuck right, I pinged :jakem and :dustin in IRC incase its expected, I *think* we're good though.

[root@relengwebadm.private.scl3 ~]# cd /data/releng/src/talos-remote/www/talos-repo
[root@relengwebadm.private.scl3 talos-repo]# hg status
? talos/page_load_test/tp4
[root@relengwebadm.private.scl3 talos-repo]# hg id
b4907f0b27d3 tip
[root@relengwebadm.private.scl3 talos-repo]# hg pull -r f9136c4bc616
pulling from http://hg.mozilla.org/build/talos
searching for changes
adding changesets
adding manifests
adding file changes
added 18 changesets with 51 changes to 34 files
(run 'hg update' to get a working copy)
[root@relengwebadm.private.scl3 talos-repo]# hg up
34 files updated, 0 files merged, 0 files removed, 0 files unresolved
[root@relengwebadm.private.scl3 talos-repo]# hg ident
f9136c4bc616 tip
[root@relengwebadm.private.scl3 talos-repo]# /data/releng/src/talos-remote/update
Deploying code...
[2014-06-25 13:46:30] Running rsync_project
[2014-06-25 13:46:30] [localhost] running: /usr/bin/rsync -aq --include '.gitkeep' --exclude '.git*' --exclude '.hg*' --exclude '
.svn*' --exclude 'CVS' --exclude '.bzr*' --delete /data/releng/src/talos-remote/ /data/releng/www/talos-remote/
[2014-06-25 13:46:31] [localhost] finished: /usr/bin/rsync -aq --include '.gitkeep' --exclude '.git*' --exclude '.hg*' --exclude
'.svn*' --exclude 'CVS' --exclude '.bzr*' --delete /data/releng/src/talos-remote/ /data/releng/www/talos-remote/ (1.138s)
[2014-06-25 13:46:31] Finished rsync_project (1.139s)
[2014-06-25 13:46:31] Running commit_www
[2014-06-25 13:46:31] [localhost] running: cd /data/releng/www && /usr/bin/git add .; /usr/bin/git commit -a -m 'deploy ['talos-r
[2014-06-25 13:46:32] [localhost] finished: cd /data/releng/www && /usr/bin/git add .; /usr/bin/git commit -a -m 'deploy ['talos-
remote']' (1.296s)
[localhost] out: [master c09deff] deploy [talos-remote]
[localhost] out: Committer: root <root@relengwebadm.private.scl3.mozilla.com>
[localhost] out: Your name and email address were configured automatically based
[localhost] out: on your username and hostname. Please check that they are accurate.
[localhost] out: You can suppress this message by setting them explicitly:
[localhost] out:
[localhost] out: git config --global user.name "Your Name"
[localhost] out: git config --global user.email you@example.com
[localhost] out:
[localhost] out: After doing this, you may fix the identity used for this commit with:
[localhost] out:
[localhost] out: git commit --amend --reset-author
[localhost] out:
[localhost] out: 49 files changed, 1703 insertions(+), 807 deletions(-)
[localhost] out: create mode 100644 talos-remote/www/talos-repo/talos/mainthreadio.py
[localhost] out: create mode 100644 talos-remote/www/talos-repo/talos/mtio-whitelist.json
[localhost] out: create mode 100644 talos-remote/www/talos-repo/talos/page_load_test/tart/addon/content/Profiler.js
[localhost] out: create mode 100644 talos-remote/www/talos-repo/talos/page_load_test/tart/generate-xpi.html
[localhost] out: create mode 100644 talos-remote/www/talos-repo/talos/page_load_test/tart/scripts/jszip.min.js
[localhost] out: create mode 100644 talos-remote/www/talos-repo/talos/page_load_test/tart/scripts/xpigen.js
[localhost] out: create mode 100644 talos-remote/www/talos-repo/talos/pageloader/chrome/Profiler.js
[localhost] out: create mode 100644 talos-remote/www/talos-repo/talos/scripts/Profiler.js
[localhost] out: create mode 100644 talos-remote/www/talos-repo/talos/startup_test/__init__.py
[localhost] out: create mode 100644 talos-remote/www/talos-repo/talos/startup_test/fennecmark/en.wikipedia.org/Wiki.png
[localhost] out: create mode 100644 talos-remote/www/talos-repo/talos/startup_test/media/__init__.py
[localhost] out: rewrite talos-remote/www/talos-repo/talos/startup_test/media/html/input16.wav (93%)
[localhost] out: create mode 100755 talos-remote/www/talos-repo/talos/startup_test/media/tools/MediaUtils
[localhost] out: create mode 100644 talos-remote/www/talos-repo/talos/whitelist.py
[2014-06-25 13:46:32] Finished commit_www (1.297s)
[2014-06-25 13:46:32] Running push_www
[2014-06-25 13:46:32] [web1.releng.webapp.scl3.mozilla.com] running: /data/bin/update-www.sh talos-remote
[2014-06-25 13:46:32] [web2.releng.webapp.scl3.mozilla.com] running: /data/bin/update-www.sh talos-remote
[2014-06-25 13:46:32] [celery1.srv.releng.scl3.mozilla.com] running: /data/bin/update-www.sh talos-remote
[2014-06-25 13:46:32] [celery1.srv.releng.scl3.mozilla.com] failed: /data/bin/update-www.sh talos-remote (0.145s)
[celery1.srv.releng.scl3.mozilla.com] err: Permission denied (publickey,gssapi-keyex,gssapi-with-mic).
[2014-06-25 13:46:37] [web1.releng.webapp.scl3.mozilla.com] finished: /data/bin/update-www.sh talos-remote (5.140s)
[web1.releng.webapp.scl3.mozilla.com] out: Not removing buildapi/buildapi/
[web1.releng.webapp.scl3.mozilla.com] out: Not removing buildapi/virtualenv/lib/python2.6/
[web1.releng.webapp.scl3.mozilla.com] out: httpd (pid  3185) is running...
[2014-06-25 13:46:38] [web2.releng.webapp.scl3.mozilla.com] finished: /data/bin/update-www.sh talos-remote (5.199s)
[web2.releng.webapp.scl3.mozilla.com] out: httpd (pid  19171) is running...
[2014-06-25 13:46:38] Finished push_www (5.202s)
[2014-06-25 13:46:38] Starting new HTTPS connection (1): changelog.paas.allizom.org

Comment 2

3 years ago
...er c#1 was obviously wrong bug


3 years ago
Attachment #8445410 - Flags: review?(coop) → review+


3 years ago
Last Resolved: 3 years ago
Resolution: --- → FIXED
You need to log in before you can comment on or make changes to this bug.