Closed Bug 1333202 Opened 8 years ago Closed 8 years ago

Bacula and local backup on tableau-gw1.metrics.scl3.mozilla.com

Categories

(Infrastructure & Operations :: MOC: Service Requests, task)

Product:
Infrastructure & Operations
Component:
MOC: Service Requests
Type:
task
Priority:
Not set
Severity:
normal

Tracking

(Not tracked)

Status:
RESOLVED FIXED

People

(Reporter: Shraddha, Assigned: ryanc)

Details

HI, For cut over from current tableau servers(tableau2.metrics.scl3.mozilla.co) to new tableau server(tableau-gw1.metrics.scl3.mozilla.com), can we perform the following activities similar on current production 1. Run daily local tableau backups and send to Bacula ( see for reference Bug 1314771) 2. Tableau daily backup cleanup (see for reference Bug 1315341 ) All the above scripts would be running on tableau-gw1.metrics.scl3.mozilla.com which is the gateway server to tableau6.metrics.scl3.mozilla.com and tableau5.metrics.scl3.mozilla.com Keep the backups on similar folder structure Let me know if you need my help in anything. Thanks !
Taking this to carry out task 2
Assignee: nobody → rchilds
Status: NEW → ASSIGNED
Script landed and setup to run daily at 0200. Tossing to different queue for Bacula.
Assignee: rchilds → infra
Status: ASSIGNED → NEW
Component: MOC: Service Requests → Infrastructure: Backups
QA Contact: lypulong → rtucker
Bacula is installed/configured and took an initial backup of those host. (In reply to Ryan C [:ryanc] from comment #2) > Script landed and setup to run daily at 0200. > > Tossing to different queue for Bacula. :ryanc, Instead of the overhead and complexity of the python script, why not just use a simple powershell?
(In reply to Rob Tucker [:rtucker] from comment #3) > :ryanc, > Instead of the overhead and complexity of the python script, why not just > use a simple powershell? Rob, I was initially inclined to write this in powershell, but python was already installed and was (I thought) much easier to express.
Status: NEW → RESOLVED
Closed: 8 years ago
Resolution: --- → FIXED
(In reply to Ryan C [:ryanc] from comment #4) > (In reply to Rob Tucker [:rtucker] from comment #3) > > :ryanc, > > Instead of the overhead and complexity of the python script, why not just > > use a simple powershell? > > Rob, > > I was initially inclined to write this in powershell, but python was already > installed and was (I thought) much easier to express. Thank you Ryan and Rob, Just to confirm backup is scheduled at 2am and bacula needs schedule too? Can i confirm via testing that both the activities are working as desired?
Bacula runs sometime between 2300PST and 0700PST typically, but can run longer than 0700 depending on the amount of data that is backed up. Bacula is functioning as expected, but I cannot comment on the custom script as written by :ryanc.
(In reply to Rob Tucker [:rtucker] from comment #6) > Bacula runs sometime between 2300PST and 0700PST typically, but can run > longer than 0700 depending on the amount of data that is backed up. Bacula > is functioning as expected, but I cannot comment on the custom script as > written by :ryanc. Shraddha, Looking at the initial backup backup shows directly under C:\, verses where they were backed up before (directory = "C:\TableauBackups\\") PS C:\> hostname tableau-gw1 PS C:\> ls Directory: C:\ Mode LastWriteTime Length Name ---- ------------- ------ ---- d---- 7/26/2012 7:44 AM PerfLogs d-r-- 1/25/2017 1:19 AM Program Files d---- 1/25/2017 1:19 AM Program Files (x86) d---- 1/21/2017 3:01 AM SAML d-r-- 1/23/2017 10:49 PM Users d---- 1/19/2017 6:08 PM Windows -a--- 1/24/2017 12:53 PM 1024 .rnd -a--- 1/20/2017 8:49 AM 1968919297 tableau2-scl3-backup-2017-01-19-23-55-09.tsbak Is this correct? If so I can set it to that directory, but I'd also need to do so for tableau[456].
Assignee: infra → rchilds
Status: RESOLVED → REOPENED
Component: Infrastructure: Backups → MOC: Service Requests
Flags: needinfo?(spatil)
QA Contact: rtucker → lypulong
Resolution: FIXED → ---
Status: REOPENED → ASSIGNED
(In reply to Ryan C [:ryanc] from comment #7) > (In reply to Rob Tucker [:rtucker] from comment #6) > > Bacula runs sometime between 2300PST and 0700PST typically, but can run > > longer than 0700 depending on the amount of data that is backed up. Bacula > > is functioning as expected, but I cannot comment on the custom script as > > written by :ryanc. > > Shraddha, > > Looking at the initial backup backup shows directly under C:\, verses where > they were backed up before (directory = "C:\TableauBackups\\") > > PS C:\> hostname > tableau-gw1 > PS C:\> ls > > Directory: C:\ > > Mode LastWriteTime Length Name > ---- ------------- ------ ---- > d---- 7/26/2012 7:44 AM PerfLogs > d-r-- 1/25/2017 1:19 AM Program Files > d---- 1/25/2017 1:19 AM Program Files (x86) > d---- 1/21/2017 3:01 AM SAML > d-r-- 1/23/2017 10:49 PM Users > d---- 1/19/2017 6:08 PM Windows > -a--- 1/24/2017 12:53 PM 1024 .rnd > -a--- 1/20/2017 8:49 AM 1968919297 > tableau2-scl3-backup-2017-01-19-23-55-09.tsbak > > > Is this correct? If so I can set it to that directory, but I'd also need to > do so for tableau[456]. It should be under "C:\TableauBackups\\" similar to what it is on tableau2 (prod) currently
Flags: needinfo?(spatil)
created ""C:\TableauBackups\\""
Shraddha, When does tableau[456] and tableau-gw1 go prod? Can you let me know so I can check that this script is functioning properly on all hosts?
(In reply to Ryan C [:ryanc] from comment #10) > Shraddha, > > When does tableau[456] and tableau-gw1 go prod? Can you let me know so I can > check that this script is functioning properly on all hosts? HI Ryan, They are slated to be in production on Feb 2nd, 2017. Thanks !
Status: ASSIGNED → RESOLVED
Closed: 8 years ago → 8 years ago
Resolution: --- → FIXED
(In reply to Shraddha Patil [:Shraddha Patil] from comment #11) > (In reply to Ryan C [:ryanc] from comment #10) > > Shraddha, > > > > When does tableau[456] and tableau-gw1 go prod? Can you let me know so I can > > check that this script is functioning properly on all hosts? > > HI Ryan, > > They are slated to be in production on Feb 2nd, 2017. Thanks ! HI Ryan, These servers production date is extended to another week. Ill update the new date soon.Thanks for the support.
HI Ryan, The production date for new tableau VM (tableau-gw1.metrics.scl3.mozilla.com and tableau456.metrics.scl3.mozilla.com) is finalized on 02/17. Wondering if you can spot check that the scripts are functioning properly on the hosts. Let me know,thanks !
(In reply to Shraddha Patil [:Shraddha Patil] from comment #13) > HI Ryan, > > The production date for new tableau VM (tableau-gw1.metrics.scl3.mozilla.com > and tableau456.metrics.scl3.mozilla.com) is finalized on 02/17. > > Wondering if you can spot check that the scripts are functioning properly on > the hosts. Let me know,thanks ! Shraddha, The only system that has C:\TableauBackups is tableau-gw1 -- None of the others do, which is where the script is suppose to do it's thing.
Hi Ryan, Was checking on tableau-gw1, i did not see extract files under C:\TableauBackups. Does Bacula cleans the folder after the script does its work? Can you check and let me know
Flags: needinfo?(rchilds)
(In reply to Shraddha Patil [:Shraddha Patil] from comment #15) > Was checking on tableau-gw1, i did not see extract files under > C:\TableauBackups. Does Bacula cleans the folder after the script does its > work? Can you check and let me know I think there is some confusion here between Tableau's internal backups and Bacula system level backups. Bacula doesn't leave anything in that folder. Tableau does.
Right! Hence checking whether the script that should be leaving extract files in there runs successfully?
If there are no files then the Tableau backups are not putting anything there. The script that ryanc wrote only removes very old files. If there is nothing there then I would say the Tableau backups are not happening and we haven't set any of those up previously.
Ditto what Peter said in comment 18. If "C:\TableauBackups" doesn't exist and there is no backup files ".tsbak" in it from Tableau, the script will not work.
Flags: needinfo?(rchilds)
(In reply to Ryan C [:ryanc] from comment #19) > Ditto what Peter said in comment 18. > > If "C:\TableauBackups" doesn't exist and there is no backup files ".tsbak" > in it from Tableau, the script will not work. Hi Ryan, Tableau backup (".tsbak") got placed in "C:\TableauBackups" from last nights run.
(In reply to Shraddha Patil [:Shraddha Patil] from comment #20) > (In reply to Ryan C [:ryanc] from comment #19) > > Ditto what Peter said in comment 18. > > > > If "C:\TableauBackups" doesn't exist and there is no backup files ".tsbak" > > in it from Tableau, the script will not work. > > Hi Ryan, > > Tableau backup (".tsbak") got placed in "C:\TableauBackups" from last nights > run. Checking in on this and all looks well, PS C:\TableauBackups> ls Directory: C:\TableauBackups Mode LastWriteTime Length Name ---- ------------- ------ ---- d---- 3/8/2017 11:55 PM TableauLogs -a--- 3/9/2017 11:23 AM 345 cleanuplog.txt -a--- 3/5/2017 12:54 AM 1923536359 tableau-gw1-backup-2017-03-04-23-55-01.tsbak -a--- 3/6/2017 12:43 AM 1924577081 tableau-gw1-backup-2017-03-05-23-55-01.tsbak -a--- 3/7/2017 12:45 AM 1931665975 tableau-gw1-backup-2017-03-06-23-55-01.tsbak -a--- 3/8/2017 12:39 AM 1925873919 tableau-gw1-backup-2017-03-07-23-55-02.tsbak -a--- 3/9/2017 12:40 AM 1936659597 tableau-gw1-backup-2017-03-08-23-55-01.tsbak -a--- 3/9/2017 12:40 AM 1936659597 tableau-gw1-backup-latest.tsbak
Awesome thanks Ryan.
You need to log in before you can comment on or make changes to this bug.