Closed Bug 1330651 Opened 6 years ago Closed 5 years ago

grant additional folks access to balrog log bucket

Categories

(Cloud Services :: Operations: AWS Account Request, task)

task
Not set
normal

Tracking

(Not tracked)

RESOLVED FIXED

People

(Reporter: bhearsum, Assigned: mostlygeek)

Details

We're starting to get asked to do ad-hoc querying of these logs more frequently, so we should grant some additional folks access to them. Specifically:
mtabara@mozilla.com
jlund@mozilla.com
jlorenzo@mozilla.com
rail@mozilla.com
mshal@mozilla.com
jwood@mozilla.com
asasaki@mozilla.com

It would be great if we could turn on Athena for everybody too (all above + me, catlee@mozilla.com, coop@mozilla.com, nthomas@mozilla.com), since that seems like it would be better than mounting an s3 volume.

RelEng folks - https://wiki.mozilla.org/Balrog#ELB_Logs talks a bit about parsing these logs, if you end up doing it.
Hey Benson,

This is blocking release work in bug 1329692. Would you be able to help us with access?

Having everyone Ben listed would be ideal but, if it helps, we could focus on mtabara@mozilla.com, jlund@mozilla.com, and jlorenzo@mozilla.com. These 3 are the folks who are currently managing releases in flight.

thanks!
Blocks: 1329692
Flags: needinfo?(bwong)
Created the accounts. Will ping jlund to distribute credentials.
Flags: needinfo?(bwong)
Regarding Athena.

I set up a Athena table and ran a really simple query over 1 day worth of logs. It took a long time and transferred about 1.5TB ($7.50) to do a single day. We're going to be evaluating how to optimize this for both speed and cost.
What's the status here folks? This bug has been idle for a week. We have users stranded on 47 right now we would like to get updated.
Sorry for the delay. We have been a bit busy with the current release and related work...
(In reply to Jim Mathies [:jimm] from comment #4)
> What's the status here folks? This bug has been idle for a week. We have
> users stranded on 47 right now we would like to get updated.

To be clear: the folks that need it now have access to these logs. This bug has remained open to track enabling Athena for Balrog logs.

It might be worth filing a separate bug about the specific analysis that needs to be done to unblock bug 1329692.
Delay is on me. As rail mentioned, release and migrations have taken priority recently. I will raise this today at release meeting.

I'll also file a separate bug to track the specific analysis
No longer blocks: 1329692
Thanks!
Status: NEW → RESOLVED
Closed: 5 years ago
Resolution: --- → FIXED
You need to log in before you can comment on or make changes to this bug.