grant additional folks access to balrog log bucket

NEW
Assigned to

Status

Cloud Services
Operations: AWS Account Request
9 months ago
9 months ago

People

(Reporter: bhearsum, Assigned: mostlygeek)

Tracking

Firefox Tracking Flags

(Not tracked)

Details

(Reporter)

Description

9 months ago
We're starting to get asked to do ad-hoc querying of these logs more frequently, so we should grant some additional folks access to them. Specifically:
mtabara@mozilla.com
jlund@mozilla.com
jlorenzo@mozilla.com
rail@mozilla.com
mshal@mozilla.com
jwood@mozilla.com
asasaki@mozilla.com

It would be great if we could turn on Athena for everybody too (all above + me, catlee@mozilla.com, coop@mozilla.com, nthomas@mozilla.com), since that seems like it would be better than mounting an s3 volume.

RelEng folks - https://wiki.mozilla.org/Balrog#ELB_Logs talks a bit about parsing these logs, if you end up doing it.

Comment 1

9 months ago
Hey Benson,

This is blocking release work in bug 1329692. Would you be able to help us with access?

Having everyone Ben listed would be ideal but, if it helps, we could focus on mtabara@mozilla.com, jlund@mozilla.com, and jlorenzo@mozilla.com. These 3 are the folks who are currently managing releases in flight.

thanks!
Blocks: 1329692
Flags: needinfo?(bwong)
(Assignee)

Comment 2

9 months ago
Created the accounts. Will ping jlund to distribute credentials.
Flags: needinfo?(bwong)
(Assignee)

Comment 3

9 months ago
Regarding Athena.

I set up a Athena table and ran a really simple query over 1 day worth of logs. It took a long time and transferred about 1.5TB ($7.50) to do a single day. We're going to be evaluating how to optimize this for both speed and cost.

Comment 4

9 months ago
What's the status here folks? This bug has been idle for a week. We have users stranded on 47 right now we would like to get updated.
Sorry for the delay. We have been a bit busy with the current release and related work...
(Reporter)

Comment 6

9 months ago
(In reply to Jim Mathies [:jimm] from comment #4)
> What's the status here folks? This bug has been idle for a week. We have
> users stranded on 47 right now we would like to get updated.

To be clear: the folks that need it now have access to these logs. This bug has remained open to track enabling Athena for Balrog logs.

It might be worth filing a separate bug about the specific analysis that needs to be done to unblock bug 1329692.

Comment 7

9 months ago
Delay is on me. As rail mentioned, release and migrations have taken priority recently. I will raise this today at release meeting.

I'll also file a separate bug to track the specific analysis

Updated

9 months ago
No longer blocks: 1329692

Comment 8

9 months ago
Thanks!
You need to log in before you can comment on or make changes to this bug.