Closed
Bug 1101779
Opened 11 years ago
Closed 11 years ago
Backup System for CA Program Data
Categories
(Infrastructure & Operations :: Infrastructure: Other, task)
Infrastructure & Operations
Infrastructure: Other
Tracking
(Not tracked)
RESOLVED
FIXED
People
(Reporter: kathleen.a.wilson, Unassigned)
Details
Now that I'm using SalesForce for the CA Program data, I would like to have the data backed up. SalesForce has a way to schedule a weekly backup. So, we just need a Mozilla system where we can put the backups.
I will greatly appreciate it if someone can identify a Mozilla system we can use for these backups, and then work with our SalesForce consultant to set up the weekly backups.
Updated•11 years ago
|
Assignee: server-ops → infra
Component: Server Operations → Infrastructure: Other
Product: mozilla.org → Infrastructure & Operations
QA Contact: shyam → jdow
Do we host the server that's running SftCP, or is that hosted somewhere in the cloud?
| Reporter | ||
Comment 2•11 years ago
|
||
(In reply to Richard Soderberg [:atoll] from comment #1)
> Do we host the server that's running SftCP, or is that hosted somewhere in
> the cloud?
For the CA Program, it is hosted in the cloud.
We'll need more technical information to proceed - specifically, what kind of backup targets does SftCP support, and do we need to handle encryption or do they, and so forth?
Could you ask the SalesForce consultant to chime in on this bug and offer some guidance (or technical docs, or links to docs) with more information about what is supported with their backups?
Comment 4•11 years ago
|
||
Our database will get backed up by an automated process by Salesforce. We will need a place to store the backup file on weekly basis. The backup file will be a compressed file and less than 5MB in size.
What protocols are supported for uploading this backup to a target destination? (For instance: Amazon S3, SSH/SFTP/SCP, FTP, HTTP/DAV, SMB/CIFS, NFS)
Is the backup file encrypted or plaintext? (If so, who has the decryption key, and what is the encryption method?)
Comment 6•11 years ago
|
||
The backup file is a plain text and has CSV format. So please use any protocol which will not modify the file format to upload. In past I have use NFS. It was the easiest of all options. I could simply drag and drop the file. I would prefer this option.
None of the listed protocols modify the file in transit. Will backups be performed automatically or manually? What client OS will be used to upload the backups?
Comment 8•11 years ago
|
||
The backup is done automatically by Salesforce and creates a zip file. I will have to manually download it to designated backup place. Would you like to see the process? I can setup a meeting to show you the process.
What data is contained in this backup? Is it just contact information, or will there be sensitive conversations that must not be made public, or .. ?
Comment 10•11 years ago
|
||
The backup file will have information on Companies, contacts and digital certificates. This data should not be made public. I will request Kathleen to comment on the sensitivity of the data.
| Reporter | ||
Comment 11•11 years ago
|
||
Since it will be all data associated with the CA Program, there may be sensitive data included.
Comment 12•11 years ago
|
||
(In reply to Richard Soderberg [:atoll] from comment #7)
> None of the listed protocols modify the file in transit. Will backups be
> performed automatically or manually? What client OS will be used to upload
> the backups?
I will be using Mac OS X 10 and Windows 7 to upload backup file.
| Reporter | ||
Comment 13•11 years ago
|
||
Hi Richard, Poonam and I set up the backups so that I will be getting them via https from SalesForce. Basically, the file goes into an area in SalesForce where I can drag/drop from to save elsewhere.
So, the question is, where should I put these files?
And how? i.e. will I be able to drag/drop the files directly onto a Mozilla system?
I use a Mac OS X 10 system.
The backup files will contain sensitive data, so we will want to ensure secure transfer and storage of the files.
What do you recommend?
Comment 14•11 years ago
|
||
Hi, Poonam.
Two quick questions:
1. What is the purpose of this backup? To do a full restore in a catastrophic failure (like a bad import) or is it for grabbing individually deleted records? As I understand it, there are other options for the latter.
2. Can you let us know if the export file names are predictable (dump.11NOV02015.zip)?
FYI - We have an ETL framework going live in late January that can pull data from Salesforce (REST or SOAP) and push it to whatever destination you like. Ideally we'd automate all of this from end-to-end without depending on someone to download the file to an intermediate laptop.
Comment 15•11 years ago
|
||
(In reply to David Torre [:dtorre] from comment #14)
> 2. Can you let us know if the export file names are predictable
> (dump.11NOV02015.zip)?
It will contain a 18 digit ID, which is not predictable. In addition, you can only access it with a session cookie obtained with the web login form.
> FYI - We have an ETL framework going live in late January that can pull data
> from Salesforce (REST or SOAP) and push it to whatever destination you like.
> Ideally we'd automate all of this from end-to-end without depending on
> someone to download the file to an intermediate laptop.
That sounds like a better route if you want to fully automate it.
Comment 16•11 years ago
|
||
Here is what I would recommend:
-Short term-
Since an interactive human must download the export, I'd simply set a schedule in SF to export, then have the developer/administrator save the file to Google Drive. I just exported one of our Saleforce instances and it was only 10MB.
-Longer term-
We want to automate this. There are a couple options:
(a) The aforementioned ETL solution which IT would operate
(b) A backup service like Backupify, which the business (Kathleen's team) would own and operate.
| Reporter | ||
Comment 17•11 years ago
|
||
(In reply to David Torre [:dtorre] from comment #16)
> Here is what I would recommend:
>
> -Short term-
> Since an interactive human must download the export, I'd simply set a
> schedule in SF to export, then have the developer/administrator save the
> file to Google Drive. I just exported one of our Saleforce instances and it
> was only 10MB.
>
Good idea! I will do this.
> -Longer term-
> We want to automate this. There are a couple options:
>
> (a) The aforementioned ETL solution which IT would operate
> (b) A backup service like Backupify, which the business (Kathleen's team)
> would own and operate.
Both of these look like great long-term solutions. But, I think backing up to Google Drive is sufficient for now.
I am resolving this bug as fixed, because my request was to identify a Mozilla system we can use for these backups, and you did (via Google Drive).
Thanks!
Status: NEW → RESOLVED
Closed: 11 years ago
Resolution: --- → FIXED
Updated•11 years ago
|
Flags: sec-review?(jstevensen)
You need to log in
before you can comment on or make changes to this bug.
Description
•