Closed Bug 846837 Opened 11 years ago Closed 11 years ago

Datazilla Repository Update

Categories

(Infrastructure & Operations Graveyard :: WebOps: Other, task)

x86
macOS
task
Not set
normal

Tracking

(Not tracked)

RESOLVED FIXED

People

(Reporter: jeads, Assigned: cturra)

References

Details

(Whiteboard: [triaged 20130301][push interrupt])

A new datazilla repository is ready to push to stage. This release includes changes addressing the following bugs: Bug 845864, Bug 845364, Bug 844756 and Bug 845936.

Changes include:

1.) Adjusted SQL WHERE clause to include the test name to address the issue described in Bug 845864

2.) Added "7 Days" to the list of time range filters to address Bug 845364

3.) Application names that do not have data available for the selected test and branch are automatically hidden. This addresses Bug 844756

4.) Added a select/unselect all checkbox in the top of the Applications container 

5.) Added a permalink feature that captures the UI state and provides a handful of filter params in the url. The permalink can be accessed by clicking on the "Get Link" button in the top right hand panel of the "Firefox OS Application Performance" graph. All of the param fields in the URL structure can be used in a standalone manner

Example 1:
/b2g?branch=master&range=30&test=cold_load_time&app=contacts&app_list=camera,contacts,gallery,messages,music,phone,settings&gaia_rev=651379a40188da13&gecko_rev=cf5aee3762801a01

Example 2:
/b2g?branch=master&range=30&app=contacts

Example 3:
/b2g?branch=master&range=30&test=cold_load_time

Params:
branch - name of branch
range - Time range to load: 7, 30, 60, 90
test - Test name
app - Application name to use as the series selection
app_list - List of Application names to display
gaia_rev - gaia_revision to select
gecko_rev - gecko_revision to select
update pushed to stage.

[root@datazillaadm.private.scl3 datazilla.allizom.org]# bash -x update 
+ CODE_DIR=/data/datazilla-stage/src/datazilla.allizom.org/datazilla
+ VENDOR_DIR=/data/datazilla-stage/src/datazilla.allizom.org/datazilla/vendor
+ update_code
+ echo -e 'Updating code...'
Updating code...
+ cd /data/datazilla-stage/src/datazilla.allizom.org/datazilla
+ git fetch origin -q
+ checkretval
+ retval=0
+ [[ 0 -gt 0 ]]
+ git checkout -f origin/master -q
+ checkretval
+ retval=0
+ [[ 0 -gt 0 ]]
+ git submodule sync -q
+ checkretval
+ retval=0
+ [[ 0 -gt 0 ]]
+ git submodule update --init --recursive -q
+ checkretval
+ retval=0
+ [[ 0 -gt 0 ]]
+ echo -e 'Cleaning gitignore and pyc files...'
Cleaning gitignore and pyc files...
+ cd /data/datazilla-stage/src/datazilla.allizom.org/datazilla
+ find . -type f -name .gitignore -or -name '*.pyc' -delete
+ checkretval
+ retval=0
+ [[ 0 -gt 0 ]]
+ echo -e 'Storing revision information...'
Storing revision information...
+ cd /data/datazilla-stage/src/datazilla.allizom.org/datazilla
+ git rev-parse HEAD
update: line 40: /data/datazilla-stage/src/datazilla.allizom.org/datazilla/media/revision: No such file or directory
+ generate_revision_info
update: line 43: /data/datazilla-stage/src/datazilla.allizom.org/datazilla/media/revision_info.txt: No such file or directory
+ echo -e 'Deploying code...'
Deploying code...
+ '[' xterm == dumb ']'
+ /data/datazilla-stage/deploy datazilla.allizom.org
[2013-03-01 12:09:46] Running rsync_project
[2013-03-01 12:09:46] [localhost] running: /usr/bin/rsync -aq --include '.gitkeep' --exclude '.git*' --exclude '.hg*' --exclude '.svn*' --exclude 'CVS' --exclude '.bzr*' --delete /data/datazilla-stage/src/datazilla.allizom.org/ /data/datazilla-stage/www/datazilla.allizom.org/
[2013-03-01 12:09:46] [localhost] finished: /usr/bin/rsync -aq --include '.gitkeep' --exclude '.git*' --exclude '.hg*' --exclude '.svn*' --exclude 'CVS' --exclude '.bzr*' --delete /data/datazilla-stage/src/datazilla.allizom.org/ /data/datazilla-stage/www/datazilla.allizom.org/ (0.513s)
[2013-03-01 12:09:46] Finished rsync_project (0.513s)
[2013-03-01 12:09:46] Running commit_www
[2013-03-01 12:09:46] [localhost] running: cd /data/datazilla-stage/www && /usr/bin/git add .; /usr/bin/git commit -a -m 'deploy ['datazilla.allizom.org']'
[2013-03-01 12:09:47] [localhost] finished: cd /data/datazilla-stage/www && /usr/bin/git add .; /usr/bin/git commit -a -m 'deploy ['datazilla.allizom.org']' (0.303s)
[localhost] out: [master 551e853] deploy [datazilla.allizom.org]
[localhost] out: 13 files changed, 428 insertions(+), 63 deletions(-)
[2013-03-01 12:09:47] Finished commit_www (0.303s)
Assignee: server-ops-webops → cturra
Whiteboard: [triaged 20130301][push interrupt]
I fixed a bug and layout issue I found on stage. Updates are now in the repository, please push to stage again.
:jeads - updated.

[root@datazillaadm.private.scl3 datazilla.allizom.org]# bash -x update 
+ CODE_DIR=/data/datazilla-stage/src/datazilla.allizom.org/datazilla
+ VENDOR_DIR=/data/datazilla-stage/src/datazilla.allizom.org/datazilla/vendor
+ update_code
+ echo -e 'Updating code...'
Updating code...
+ cd /data/datazilla-stage/src/datazilla.allizom.org/datazilla
+ git fetch origin -q
+ checkretval
+ retval=0
+ [[ 0 -gt 0 ]]
+ git checkout -f origin/master -q
+ checkretval
+ retval=0
+ [[ 0 -gt 0 ]]
+ git submodule sync -q
+ checkretval
+ retval=0
+ [[ 0 -gt 0 ]]
+ git submodule update --init --recursive -q
+ checkretval
+ retval=0
+ [[ 0 -gt 0 ]]
+ echo -e 'Cleaning gitignore and pyc files...'
Cleaning gitignore and pyc files...
+ cd /data/datazilla-stage/src/datazilla.allizom.org/datazilla
+ find . -type f -name .gitignore -or -name '*.pyc' -delete
+ checkretval
+ retval=0
+ [[ 0 -gt 0 ]]
+ echo -e 'Storing revision information...'
Storing revision information...
+ cd /data/datazilla-stage/src/datazilla.allizom.org/datazilla
+ git rev-parse HEAD
update: line 40: /data/datazilla-stage/src/datazilla.allizom.org/datazilla/media/revision: No such file or directory
+ generate_revision_info
update: line 43: /data/datazilla-stage/src/datazilla.allizom.org/datazilla/media/revision_info.txt: No such file or directory
+ echo -e 'Deploying code...'
Deploying code...
+ '[' xterm == dumb ']'
+ /data/datazilla-stage/deploy datazilla.allizom.org
[2013-03-01 15:23:32] Running rsync_project
[2013-03-01 15:23:32] [localhost] running: /usr/bin/rsync -aq --include '.gitkeep' --exclude '.git*' --exclude '.hg*' --exclude '.svn*' --exclude 'CVS' --exclude '.bzr*' --delete /data/datazilla-stage/src/datazilla.allizom.org/ /data/datazilla-stage/www/datazilla.allizom.org/
[2013-03-01 15:23:32] [localhost] finished: /usr/bin/rsync -aq --include '.gitkeep' --exclude '.git*' --exclude '.hg*' --exclude '.svn*' --exclude 'CVS' --exclude '.bzr*' --delete /data/datazilla-stage/src/datazilla.allizom.org/ /data/datazilla-stage/www/datazilla.allizom.org/ (0.407s)
[2013-03-01 15:23:32] Finished rsync_project (0.408s)
[2013-03-01 15:23:32] Running commit_www
[2013-03-01 15:23:32] [localhost] running: cd /data/datazilla-stage/www && /usr/bin/git add .; /usr/bin/git commit -a -m 'deploy ['datazilla.allizom.org']'
[2013-03-01 15:23:32] [localhost] finished: cd /data/datazilla-stage/www && /usr/bin/git add .; /usr/bin/git commit -a -m 'deploy ['datazilla.allizom.org']' (0.272s)
[localhost] out: [master d2f190a] deploy [datazilla.allizom.org]
[localhost] out: 5 files changed, 14 insertions(+), 6 deletions(-)
[2013-03-01 15:23:32] Finished commit_www (0.273s)
Looks like the bug fix I did worked but there is a javascript error being generated. Likely accessing an undefined variable somewhere. cturra in datazilla/settings/local.py on stage could you set:

DEBUG = True

and restart httpd? That will switch to loading the full js files instead of the minified ones so I can identify the js file/line number associated with the error.
(In reply to Jonathan Eads ( :jeads ) from comment #4)
> cturra in datazilla/settings/local.py on stage could you set:
> 
> DEBUG = True
> 
> and restart httpd?

done. just let me know when you're done debugging so i can disable DEBUG once again.
Thanks! Offending line found and repository updated with the fix. Please disable DEBUG and push the updated repository to stage again.
stage updated.

[root@datazillaadm.private.scl3 datazilla.allizom.org]# bash update 
Updating code...
Cleaning gitignore and pyc files...
Storing revision information...
update: line 40: /data/datazilla-stage/src/datazilla.allizom.org/datazilla/media/revision: No such file or directory
update: line 43: /data/datazilla-stage/src/datazilla.allizom.org/datazilla/media/revision_info.txt: No such file or directory
Deploying code...
[2013-03-01 16:22:16] Running rsync_project
[2013-03-01 16:22:16] [localhost] running: /usr/bin/rsync -aq --include '.gitkeep' --exclude '.git*' --exclude '.hg*' --exclude '.svn*' --exclude 'CVS' --exclude '.bzr*' --delete /data/datazilla-stage/src/datazilla.allizom.org/ /data/datazilla-stage/www/datazilla.allizom.org/
[2013-03-01 16:22:16] [localhost] finished: /usr/bin/rsync -aq --include '.gitkeep' --exclude '.git*' --exclude '.hg*' --exclude '.svn*' --exclude 'CVS' --exclude '.bzr*' --delete /data/datazilla-stage/src/datazilla.allizom.org/ /data/datazilla-stage/www/datazilla.allizom.org/ (0.341s)
[2013-03-01 16:22:16] Finished rsync_project (0.341s)
[2013-03-01 16:22:16] Running commit_www
[2013-03-01 16:22:16] [localhost] running: cd /data/datazilla-stage/www && /usr/bin/git add .; /usr/bin/git commit -a -m 'deploy ['datazilla.allizom.org']'
[2013-03-01 16:22:17] [localhost] finished: cd /data/datazilla-stage/www && /usr/bin/git add .; /usr/bin/git commit -a -m 'deploy ['datazilla.allizom.org']' (0.212s)
[localhost] out: [master a44a0d4] deploy [datazilla.allizom.org]
[localhost] out: 3 files changed, 8 insertions(+), 5 deletions(-)
[2013-03-01 16:22:17] Finished commit_www (0.212s)
[2013-03-01 16:22:17] Running push_www
[2013-03-01 16:22:17] [datazilla1.stage.webapp.scl3.mozilla.com] running: /data/bin/update-www.sh datazilla.allizom.org
[2013-03-01 16:22:17] [datazilla1.stage.webapp.scl3.mozilla.com] finished: /data/bin/update-www.sh datazilla.allizom.org (0.473s)
[2013-03-01 16:22:17] Finished push_www (0.477s)
Victory! Please go ahead and push the updated repository to production.
push to prod complete :)

[root@datazillaadm.private.scl3 datazilla.mozilla.org]# bash -x update 
+ CODE_DIR=/data/datazilla/src/datazilla.mozilla.org/datazilla
+ VENDOR_DIR=/data/datazilla/src/datazilla.mozilla.org/datazilla/vendor
+ update_code
+ echo -e 'Updating code...'
Updating code...
+ cd /data/datazilla/src/datazilla.mozilla.org/datazilla
+ git fetch origin -q
+ checkretval
+ retval=0
+ [[ 0 -gt 0 ]]
+ git checkout -f origin/master -q
+ checkretval
+ retval=0
+ [[ 0 -gt 0 ]]
+ git submodule sync -q
+ checkretval
+ retval=0
+ [[ 0 -gt 0 ]]
+ git submodule update --init --recursive -q
+ checkretval
+ retval=0
+ [[ 0 -gt 0 ]]
+ echo -e 'Cleaning gitignore and pyc files...'
Cleaning gitignore and pyc files...
+ cd /data/datazilla/src/datazilla.mozilla.org/datazilla
+ find . -type f -name .gitignore -or -name '*.pyc' -delete
+ checkretval
+ retval=0
+ [[ 0 -gt 0 ]]
+ echo -e 'Storing revision information...'
Storing revision information...
+ cd /data/datazilla/src/datazilla.mozilla.org/datazilla
+ git rev-parse HEAD
update: line 40: /data/datazilla/src/datazilla.mozilla.org/datazilla/media/revision: No such file or directory
+ generate_revision_info
update: line 43: /data/datazilla/src/datazilla.mozilla.org/datazilla/media/revision_info.txt: No such file or directory
+ echo -e 'Deploying code...'
Deploying code...
+ '[' xterm == dumb ']'
+ /data/datazilla/deploy datazilla.mozilla.org
[2013-03-01 17:05:46] Running rsync_project
[2013-03-01 17:05:46] [localhost] running: /usr/bin/rsync -aq --include '.gitkeep' --exclude '.git*' --exclude '.hg*' --exclude '.svn*' --exclude 'CVS' --exclude '.bzr*' --delete /data/datazilla/src/datazilla.mozilla.org/ /data/datazilla/www/datazilla.mozilla.org/
[2013-03-01 17:05:47] [localhost] finished: /usr/bin/rsync -aq --include '.gitkeep' --exclude '.git*' --exclude '.hg*' --exclude '.svn*' --exclude 'CVS' --exclude '.bzr*' --delete /data/datazilla/src/datazilla.mozilla.org/ /data/datazilla/www/datazilla.mozilla.org/ (0.358s)
[2013-03-01 17:05:47] Finished rsync_project (0.359s)
[2013-03-01 17:05:47] Running commit_www
[2013-03-01 17:05:47] [localhost] running: cd /data/datazilla/www && /usr/bin/git add .; /usr/bin/git commit -a -m 'deploy ['datazilla.mozilla.org']'
[2013-03-01 17:05:47] [localhost] finished: cd /data/datazilla/www && /usr/bin/git add .; /usr/bin/git commit -a -m 'deploy ['datazilla.mozilla.org']' (0.267s)
[localhost] out: [master eac2493] deploy [datazilla.mozilla.org]
[localhost] out: 13 files changed, 441 insertions(+), 65 deletions(-)
[2013-03-01 17:05:47] Finished commit_www (0.268s)
Status: NEW → RESOLVED
Closed: 11 years ago
Resolution: --- → FIXED
Component: Server Operations: Web Operations → WebOps: Other
Product: mozilla.org → Infrastructure & Operations
Product: Infrastructure & Operations → Infrastructure & Operations Graveyard
You need to log in before you can comment on or make changes to this bug.