Closed Bug 1101779 Opened 11 years ago Closed 11 years ago

Backup System for CA Program Data

Categories

(Infrastructure & Operations :: Infrastructure: Other, task)

task
Not set
normal

Tracking

(Not tracked)

RESOLVED FIXED

People

(Reporter: kathleen.a.wilson, Unassigned)

Details

Now that I'm using SalesForce for the CA Program data, I would like to have the data backed up. SalesForce has a way to schedule a weekly backup. So, we just need a Mozilla system where we can put the backups. I will greatly appreciate it if someone can identify a Mozilla system we can use for these backups, and then work with our SalesForce consultant to set up the weekly backups.
Assignee: server-ops → infra
Component: Server Operations → Infrastructure: Other
Product: mozilla.org → Infrastructure & Operations
QA Contact: shyam → jdow
Do we host the server that's running SftCP, or is that hosted somewhere in the cloud?
(In reply to Richard Soderberg [:atoll] from comment #1) > Do we host the server that's running SftCP, or is that hosted somewhere in > the cloud? For the CA Program, it is hosted in the cloud.
We'll need more technical information to proceed - specifically, what kind of backup targets does SftCP support, and do we need to handle encryption or do they, and so forth? Could you ask the SalesForce consultant to chime in on this bug and offer some guidance (or technical docs, or links to docs) with more information about what is supported with their backups?
Our database will get backed up by an automated process by Salesforce. We will need a place to store the backup file on weekly basis. The backup file will be a compressed file and less than 5MB in size.
What protocols are supported for uploading this backup to a target destination? (For instance: Amazon S3, SSH/SFTP/SCP, FTP, HTTP/DAV, SMB/CIFS, NFS) Is the backup file encrypted or plaintext? (If so, who has the decryption key, and what is the encryption method?)
The backup file is a plain text and has CSV format. So please use any protocol which will not modify the file format to upload. In past I have use NFS. It was the easiest of all options. I could simply drag and drop the file. I would prefer this option.
None of the listed protocols modify the file in transit. Will backups be performed automatically or manually? What client OS will be used to upload the backups?
The backup is done automatically by Salesforce and creates a zip file. I will have to manually download it to designated backup place. Would you like to see the process? I can setup a meeting to show you the process.
What data is contained in this backup? Is it just contact information, or will there be sensitive conversations that must not be made public, or .. ?
The backup file will have information on Companies, contacts and digital certificates. This data should not be made public. I will request Kathleen to comment on the sensitivity of the data.
Since it will be all data associated with the CA Program, there may be sensitive data included.
(In reply to Richard Soderberg [:atoll] from comment #7) > None of the listed protocols modify the file in transit. Will backups be > performed automatically or manually? What client OS will be used to upload > the backups? I will be using Mac OS X 10 and Windows 7 to upload backup file.
Hi Richard, Poonam and I set up the backups so that I will be getting them via https from SalesForce. Basically, the file goes into an area in SalesForce where I can drag/drop from to save elsewhere. So, the question is, where should I put these files? And how? i.e. will I be able to drag/drop the files directly onto a Mozilla system? I use a Mac OS X 10 system. The backup files will contain sensitive data, so we will want to ensure secure transfer and storage of the files. What do you recommend?
Flags: sec-review?(jstevensen)
Hi, Poonam. Two quick questions: 1. What is the purpose of this backup? To do a full restore in a catastrophic failure (like a bad import) or is it for grabbing individually deleted records? As I understand it, there are other options for the latter. 2. Can you let us know if the export file names are predictable (dump.11NOV02015.zip)? FYI - We have an ETL framework going live in late January that can pull data from Salesforce (REST or SOAP) and push it to whatever destination you like. Ideally we'd automate all of this from end-to-end without depending on someone to download the file to an intermediate laptop.
(In reply to David Torre [:dtorre] from comment #14) > 2. Can you let us know if the export file names are predictable > (dump.11NOV02015.zip)? It will contain a 18 digit ID, which is not predictable. In addition, you can only access it with a session cookie obtained with the web login form. > FYI - We have an ETL framework going live in late January that can pull data > from Salesforce (REST or SOAP) and push it to whatever destination you like. > Ideally we'd automate all of this from end-to-end without depending on > someone to download the file to an intermediate laptop. That sounds like a better route if you want to fully automate it.
Here is what I would recommend: -Short term- Since an interactive human must download the export, I'd simply set a schedule in SF to export, then have the developer/administrator save the file to Google Drive. I just exported one of our Saleforce instances and it was only 10MB. -Longer term- We want to automate this. There are a couple options: (a) The aforementioned ETL solution which IT would operate (b) A backup service like Backupify, which the business (Kathleen's team) would own and operate.
(In reply to David Torre [:dtorre] from comment #16) > Here is what I would recommend: > > -Short term- > Since an interactive human must download the export, I'd simply set a > schedule in SF to export, then have the developer/administrator save the > file to Google Drive. I just exported one of our Saleforce instances and it > was only 10MB. > Good idea! I will do this. > -Longer term- > We want to automate this. There are a couple options: > > (a) The aforementioned ETL solution which IT would operate > (b) A backup service like Backupify, which the business (Kathleen's team) > would own and operate. Both of these look like great long-term solutions. But, I think backing up to Google Drive is sufficient for now. I am resolving this bug as fixed, because my request was to identify a Mozilla system we can use for these backups, and you did (via Google Drive). Thanks!
Status: NEW → RESOLVED
Closed: 11 years ago
Resolution: --- → FIXED
Flags: sec-review?(jstevensen)
You need to log in before you can comment on or make changes to this bug.