1113316 - replace modulelist cron job with missing_symbols job

Status: RESOLVED FIXED

(Socorro :: Infra, task)

Description

[Robert Helmer [:rhelmer]]

After the next code deploy, we need to replace the modulelist cron job with the new missing_symbols job.

Comment 1

[Robert Helmer [:rhelmer]]

This will go into the dated directories on crash-analysis e.g. https://crash-analysis.mozilla.com/crash_analysis/20141218/ and will be of the form:

debug_file,debug_id
TSysDrv.pdb,532910082
FlashPlayerPlugin.pdb,7092E629A2434F869E5ADF79E057B80F1

Note that it includes non-Windows symbol files potentially, and we'll be adding a "filename" and "version" column when bug 948644 lands (it is safe to trust the header line)

Comment 2

[Robert Helmer [:rhelmer]]

Replaced on stage:

 # Modulelist report for crash-analysis
-00 17 * * * socorro export JAVA_HOME=/usr/lib/jvm/java-1.6.0; export HADOOP_GW="cherry-gw.cherry.metrics.phx1.mozilla.com"; /data/socorro/application/scripts/crons/cron_modulelist.sh
+00 17 * * * socorro /data/socorro/application/scripts/crons/cron_missing_symbols.sh

Sending        socorro
Transmitting file data .
Committed revision 98471.

Comment 3

[Robert Helmer [:rhelmer]]

Replaced on prod:

 # Modulelist report for crash-analysis
-00 17 * * * socorro export JAVA_HOME=/usr/lib/jvm/java-1.6.0; export HADOOP_GW="cherry-gw.cherry.metrics.phx1.mozilla.com"; /data/socorro/application/scripts/crons/cron_modulelist.sh
+00 17 * * * socorro /data/socorro/application/scripts/crons/cron_missing_symbols.sh 


Sending        socorro
Transmitting file data .
Committed revision 98488.

Comment 4

[Robert Helmer [:rhelmer]]

(In reply to Robert Helmer [:rhelmer] from comment #1)
> This will go into the dated directories on crash-analysis e.g.
> https://crash-analysis.mozilla.com/crash_analysis/20141218/ and will be of
> the form:
> 
> debug_file,debug_id
> TSysDrv.pdb,532910082
> FlashPlayerPlugin.pdb,7092E629A2434F869E5ADF79E057B80F1
> 
> Note that it includes non-Windows symbol files potentially, and we'll be
> adding a "filename" and "version" column when bug 948644 lands (it is safe
> to trust the header line)

Ted this needinfo? is just FYI, if this doesn't WFY let me know and I'll fix it up.

Comment 5

[(not currently active) Ted Mielczarek]

I'll need to fixup the fetch-win32-symbols script:
http://hg.mozilla.org/users/tmielczarek_mozilla.com/fetch-win32-symbols/file/3cec31020c0b/symsrv-fetch.py#l120

But it's not a big deal and this should be fine.

Comment 6

[(not currently active) Ted Mielczarek]

(Why is this bug marked moco-confidential?)

Comment 7

[Robert Helmer [:rhelmer]]

(In reply to Ted Mielczarek [:ted.mielczarek] from comment #6)
> (Why is this bug marked moco-confidential?)

Oh, because it's about changing configs and we frequently have diffs that expose things like hostnames and passwords. Comment 3 has a hostname of an internal server that's going away, so it's probably not a big deal.

When I know I am going to be changing configs I usually mark the bug private preemptively, since we can always open it later.

Comment 8

[(not currently active) Ted Mielczarek]

FYI I updated the script and was able to successfully run it against the new missing-symbols data:
http://hg.mozilla.org/users/tmielczarek_mozilla.com/fetch-win32-symbols/rev/2bb14973be37

(Can we open this bug up?)

Comment 9

[Robert Helmer [:rhelmer]]

(In reply to Ted Mielczarek [:ted.mielczarek] from comment #8)
> (Can we open this bug up?)

Done