1458452 - S3 bucket for wpt (wpt-api.stage.mozaws.net) is empty; would like to retain 30 days' worth of test-run/results data

Status: RESOLVED FIXED

(Cloud Services :: Operations: Deployment Requests - DEPRECATED, task)

Description

[Stephen Donner [:stephend] Not actively reading bugmail]

In talking with :jbuck today, he discovered that the S3 bucket for wpt is empty, and pointed to these lines:

https://github.com/mozilla-services/webpagetest-settings/blob/master/settings.ini#L47-L54

A colleague, Peter Hedenskog, from Wikimedia (on the Performance team) recommends we keep 7 days worth of data at the very least, and recommends 2 weeks (to allow time for sifting through eventually-correlated commits when there's a performance win/regression, through holidays, PTOs, etc.)

Comment 1

[Stephen Donner [:stephend] Not actively reading bugmail]

Not meant as a prod: https://wikitech.wikimedia.org/wiki/Performance/WebPageTest#WebPageTest_and_AWS should be pretty helpful; I'm familiarizing myself with their setup, now, as much as I can.

Comment 2

[Stephen Donner [:stephend] Not actively reading bugmail]

Attachment: pr 11: Bug 1458452: Keep tests locally for 30 days, before archiving to our S3 bucket

Comment 3

[Stephen Donner [:stephend] Not actively reading bugmail]

Should be fixed; instead of two (2) weeks' worth of perf-test results, we now (thx, :jbuck!) retain 30[0], in -- IIRC -- EBS, now?


[0] https://github.com/mozilla-services/cloudops-deployment/commit/d3bc7f84abcaa9be186a2fcbd7f3237f9b9a5806