1314771 - Backup for all Tableau servers

Status: RESOLVED FIXED

(Infrastructure & Operations :: Infrastructure: Backups, task)

Description

[[:josephine]]

Hi,

I have two requests:

1. Could we put the following tableau servers to bacula:
staging server: tableau1.metrics.scl3.mozilla.com - windows C drive
production server: tableau2.metrics.scl3.mozilla.com - windows C drive
failover server: tableau3.metrics.scl3.mozilla.com - windows C drive

2. Also, is there a location where I can put daily tableau server backup files? This is for the prod server tableau2. Currently there is a daily backup that runs in tableau server and the file is put in C:\TableauBackups.

At the end of the month, the daily files are so large and it's hitting the disk space available in the server. I have a monthly manual routine to remove all daily backup files and leave only one backup file for every month. Please let me know if there is a way to do this better.

Please let me know how I can help on any of the above.

Thanks,
Josephine

Comment 1

[Rob Tucker [:rtucker]]

Josephine,
Would you be the person responsible for installing the bacula windows client and configuring it, if not, can you point me in their direction?

Comment 2

[[:josephine]]

Hi Rob, good question!

I don't know the answer to that right now as this is not in our current process. How do other teams do it? Let me ask around and figure that out.

Comment 3

[Peter Radcliffe [:pir]]

Josephine,

The cleanup of old daily files should be able to be automated if they are still required once bacula backups are happening. Could you open a separate bug for that with the MOC and we can look into it?

Comment 4

[[:josephine]]

Peter, bug 1314771 created.

Comment 5

[Rob Tucker [:rtucker]]

(In reply to Josephine from comment #2)
> Hi Rob, good question!
> 
> I don't know the answer to that right now as this is not in our current
> process. How do other teams do it? Let me ask around and figure that out.

I'm going to see about getting the bacula client configured on tableau2.metrics.scl3.mozilla.com

Comment 6

[Ludovic Hirlimann [:Usul]]

(In reply to Rob Tucker [:rtucker] from comment #5)
> (In reply to Josephine from comment #2)
> > Hi Rob, good question!
> > 
> > I don't know the answer to that right now as this is not in our current
> > process. How do other teams do it? Let me ask around and figure that out.
> 
> I'm going to see about getting the bacula client configured on
> tableau2.metrics.scl3.mozilla.com

rob can you document and I'll do the other tableau servers.

Comment 7

[Rob Tucker [:rtucker]]

I've configured the bacula client on tablea2.metrics.scl3.mozilla.com and add setup a job to backup the windows-c drive nightly.

Just a note, we don't backup the following when we backup the windows-c drive
C:/pagefile.sys
C:/Windows.old
C:/$Recycle.Bin
C:/found.*

Comment 8

[Rob Tucker [:rtucker]]

I've installed bacula on tableau3.metrics.scl3.mozilla.com and configured bacula to backup the entire windows-c drive, except for the excluded directories as outlined in Comment #7.

Comment 9

[Rob Tucker [:rtucker]]

(In reply to Ludovic Hirlimann [:Usul] from comment #6)
> (In reply to Rob Tucker [:rtucker] from comment #5)
> > (In reply to Josephine from comment #2)
> > > Hi Rob, good question!
> > > 
> > > I don't know the answer to that right now as this is not in our current
> > > process. How do other teams do it? Let me ask around and figure that out.
> > 
> > I'm going to see about getting the bacula client configured on
> > tableau2.metrics.scl3.mozilla.com
> 
> rob can you document and I'll do the other tableau servers.

:Usul,
The installation process is essentially just installing the windows executable as provided by bacula, and copying the configuration file and tls cert/key/cacert files.

The passphrase for the bacula private key to sign client certs is currently available to a very small amount of people, so documentation for generating the client key/cert isn't something I can make readily available.

Comment 10

[Rob Tucker [:rtucker]]

Full backup of tableau3 is finished.
Probably a few more hours to go on tableau2.

Comment 11

[[:josephine]]

Many thanks for installing the bacula app and applying backup activity to tableau2 and tableau3. Really appreciate the help here. Please let me know if you need anything from me.

Comment 12

[Rob Tucker [:rtucker]]

(In reply to Josephine from comment #11)
> Many thanks for installing the bacula app and applying backup activity to
> tableau2 and tableau3. Really appreciate the help here. Please let me know
> if you need anything from me.
Josephine,
My pleasure, happy to help!

My recommended next steps would be to setup a nightly job to write to C:\TableauBackups and remove files older than a few days from C:\TableauBackups.

A simple date based naming scheme C:\TableauBackups\Backup-2016-11-10.zip for example. Since we backup every day, there's no reason to keep the files in C:\TableauBackups once they have been backed up by bacula.

Also to note, our file retention inside of bacula is 180 days.

Comment 13

[Rob Tucker [:rtucker]]

I believe everything has been taken care of here.
If not, please feel free to reopen.