1403654 - Clear out all attachments for Firefox OS

Status: RESOLVED FIXED

(bugzilla.mozilla.org :: Infrastructure, enhancement)

Description

[Dylan Hardison [:dylan] (he/him)]

Firefox OS has some pretty large attachments. I'm going to archive and remove (empty, technically) them.

Comment 1

[Dylan Hardison [:dylan] (he/him)]

Is it possible I could have about 60G of free space on something connected to bugzillaadm?

Plan: 

1. backup firefox os attachments > 255 bytes to local filesystem
2. upload to some private S3 bucket (which I also need to ask about)
3. clear out attachments ahead of the "omg the db is filling up" thing we're doing this weekend.

The data appears to be about 45Gibibytes, but it'll be in the form of a mysql query dump (CSV) so ... it might expand a bit.

Comment 2

[Dylan Hardison [:dylan] (he/him)]

Attachment: query matching data to be backed up

Comment 3

[Dylan Hardison [:dylan] (he/him)]

Attachment: DESTRUCTIVE query to set attach data to empty string

Comment 4

[Dylan Hardison [:dylan] (he/him)]

(In reply to Dylan Hardison [:dylan] (he/him) from comment #1)
> Is it possible I could have about 60G of free space on something connected
> to bugzillaadm?
> 
> Plan: 
> 
> 1. backup firefox os attachments > 255 bytes to local filesystem
> 2. upload to some private S3 bucket (which I also need to ask about)
> 3. clear out attachments ahead of the "omg the db is filling up" thing we're
> doing this weekend.
> 
> The data appears to be about 45Gibibytes, but it'll be in the form of a
> mysql query dump (CSV) so ... it might expand a bit.

fubar: disregard, I'll let :mpressman handle this.

Comment 5

[Matt Pressman [:mpressman]]

attach_data has been backed up on backup2.db.scl3.mozilla.com at /data/backups/bugzilla/attach_data-products.name-FirefoxOS.txt.gz

:fubar is there an additional location we should put this backup so that its not in a single location? It's currently 47G on disk, but I'm compressing it now.

Comment 6

[Kendall Libby [:fubar] (he/him)]

We can probably store it in S3 somewhere. Mark, what's the retention policy around this? Do we need to make it publicly available (assuming no)?

Comment 7

[Mark Côté [:mcote]]

So no, public isn't necessary.  I'm not really sure what the retention should be... really I need to tackle bug 1112130 at some point.

I imagine we should announce this somewhere as well.

Comment 8

[Kendall Libby [:fubar] (he/him)]

This can use the bucket we just made for bug 1424003, afaic.

Comment 9

[Dylan Hardison [:dylan] (he/him)]

This was done.