Consider expiring wptreport.json sooner
Categories
(Firefox Build System :: Task Configuration, task)
Tracking
(Not tracked)
People
(Reporter: marco, Unassigned)
References
(Blocks 1 open bug)
Details
Attachments
(1 obsolete file)
This is one of the artifacts taking quite a lot of space (5 TB at this time).
James, do you think we could reduce its expiration time? Is this artifact ingested somewhere else?
|
||
Comment 1•2 years ago
|
||
Is that the compressed size? A random example file I tried gzip compressed from 20Mb to 1.2Mb, so if we aren't compressing that suggests there's a factor of ~20 saving in disk space possible from that. If they were 1Mb each and we wre keeping them for a year that would be ~14,000 jobs a day creating them, which seems high. On the other hand ~900 jobs/day at 20Mb seems a bit low? Maybe the currently expiry time isn't a year?
Anyway, we do use them for e.g. wpt sync (and locally) but we don't currently ingest all of them somewhere else (i.e. we can't assume that a small amount of time after the build is complete the information has been duplicated in another system). I think sometimes wpt sync in particular does try to use the files from older tasks (more than a month or two old). We might be able to adjust the behaviour there, however. I don't know if we have enough request logging data to see how the probability of a wptreport.json file being accessed changes with the age of the file?
In any case, at the moment retaining them for at least a couple of months seems necessary. There are other reasons we might want to build a system, at least for some branches, to ingest the actual results data into a different data store. If we did that it might be less necessary to retain the source data.
|
||
Comment 2•1 year ago
|
||
Added font-variant-numeric: tabular-nums to the timestamp display in Picture-in-Picture mode to prevent shifting of the slash between current time and total time as the video progresses.
|
||
Comment 3•1 year ago
|
||
Comment on attachment 9407720 [details]
WIP: Bug 1835005 - Stabilize timestamp position in Picture-in-Picture mode
Revision D213878 was moved to bug 1902633. Setting attachment 9407720 [details] to obsolete.
Description
•