1124155 - Upgrade Snappy Symbolication Server on symbolapi.mozilla.org

Status: RESOLVED FIXED

(Infrastructure & Operations Graveyard :: WebOps: Other, task)

Description

[(not currently active) Ted Mielczarek]

I've made some changes to the Snappy server in bug 1097210. I have one more PR outstanding but that should be merged soon. We'll want to update the code to the latest master, but we'll also need to tweak some options in the .ini file.

Is the .ini file in a repo somewhere? If not, can you provide the contents of what we're currently using so I could give you a diff of the changes to make?

These changes will also remove the dependency of the Snappy server on the NetApp NFS mount, so as a followup we could remove that (and as a future followup this whole service could move into EC2 if desired, since it'll be fetching symbols from S3 anyway.)

Comment 1

[(not currently active) Ted Mielczarek]

I think this is actually going to get WONTFIXed in favor of bug 1127532 moving this to EC2.

Comment 2

[Shyam Mani [:fox2mike]]

(In reply to Ted Mielczarek [:ted.mielczarek] from comment #1)
> I think this is actually going to get WONTFIXed in favor of bug 1127532
> moving this to EC2.

Ted, if there's no action for us here (like grabbing config files for you) happy to close this out.

Comment 3

[(not currently active) Ted Mielczarek]

rhelmer: we should just WONTFIX this, right?

Comment 4

[Robert Helmer [:rhelmer]]

(In reply to Ted Mielczarek [:ted.mielczarek] from comment #3)
> rhelmer: we should just WONTFIX this, right?

Yes I agree.

Comment 5

[Robert Helmer [:rhelmer]]

Actually, after further discussion let's update the current symbolapi server, so we're not blocked on getting that moved to AWS in order to move forward with symbols-on-S3.

Vladan, do you have access to the current symbolapi server to run upgrades, or do you know who we should ask if not?

Comment 6

[Robert Helmer [:rhelmer]]

Hey shyam, sorry for closing this prematurely - we could still use the .ini for this, per comment 0.

Could you help us push a code change too?

Comment 7

[Vladan Djeric (:vladan)]

(In reply to Robert Helmer [:rhelmer] from comment #5)
> Vladan, do you have access to the current symbolapi server to run upgrades,
> or do you know who we should ask if not?

I don't have access to the current symbolapi server. It's Ops that does this
Can you add me as an admin of https://github.com/mozilla/Snappy-Symbolication-Server

Comment 8

[Robert Helmer [:rhelmer]]

(In reply to Vladan Djeric (:vladan) -- please needinfo! from comment #7)
> (In reply to Robert Helmer [:rhelmer] from comment #5)
> > Vladan, do you have access to the current symbolapi server to run upgrades,
> > or do you know who we should ask if not?
> 
> I don't have access to the current symbolapi server. It's Ops that does this
> Can you add me as an admin of
> https://github.com/mozilla/Snappy-Symbolication-Server

Sure thing, getting this set up now.

Comment 9

[Robert Helmer [:rhelmer]]

(In reply to Robert Helmer [:rhelmer] from comment #8)
> (In reply to Vladan Djeric (:vladan) -- please needinfo! from comment #7)
> > (In reply to Robert Helmer [:rhelmer] from comment #5)
> > > Vladan, do you have access to the current symbolapi server to run upgrades,
> > > or do you know who we should ask if not?
> > 
> > I don't have access to the current symbolapi server. It's Ops that does this
> > Can you add me as an admin of
> > https://github.com/mozilla/Snappy-Symbolication-Server
> 
> Sure thing, getting this set up now.

OK this is done, let me know if you have any trouble.

Comment 10

[Shyam Mani [:fox2mike]]

(In reply to Robert Helmer [:rhelmer] from comment #6)
> Hey shyam, sorry for closing this prematurely - we could still use the .ini
> for this, per comment 0.
> 
> Could you help us push a code change too?

sure. Is this still needed?

Comment 11

[Robert Helmer [:rhelmer]]

(In reply to Shyam Mani [:fox2mike] from comment #10)
> (In reply to Robert Helmer [:rhelmer] from comment #6)
> > Hey shyam, sorry for closing this prematurely - we could still use the .ini
> > for this, per comment 0.
> > 
> > Could you help us push a code change too?
> 
> sure. Is this still needed?

Yep still could use this, sorry for the delay!

Comment 12

[Shyam Mani [:fox2mike]]

So.

Tried to push this out, failed :

[[e-mail]1 Snappy-Symbolication-Server]# git pull
remote: Counting objects: 43, done.
remote: Compressing objects: 100% (7/7), done.
remote: Total 43 (delta 13), reused 10 (delta 10), pack-reused 26
Unpacking objects: 100% (43/43), done.
From https://github.com/vdjeric/Snappy-Symbolication-Server
   8b0f2ad..ea6ada4  master     -> origin/master
Updating 8b0f2ad..ea6ada4
Fast-forward
 README                     |   4 ++--
 sample.ini                 |  16 +++++----------
 symFileManager.py          | 159 +++++++++++++++++++++++++++++++++++++++++++++++++-------------------------------------------------------------------------------------------------
 symbolicationRequest.py    | 118 ++++++++++++++++++++++++++++++++++++++++++++++++++++--------------------------------------------------------
 symbolicationWebService.py |  78 +++++++++++++++++++++++++++++-------------------------------------------
 5 files changed, 148 insertions(+), 227 deletions(-)

And supervisor won't start it back up.

Comment 13

[Robert Helmer [:rhelmer]]

We figured it out, need some backwards-incompatible .ini changes, working through it now.

Comment 14

[Robert Helmer [:rhelmer]]

Seems to be working!

Comment 15

[Shyam Mani [:fox2mike]]

First error was 

Fri Apr 17 14:25:22 2015 MainThread   ERROR Config file should be made up of three sections: 'General', 'SymbolPaths' and 'SymbolURLs'

And then

Fri Apr 17 14:27:15 2015 MainThread   ERROR Unknown config option 'prefetchInterval' in the 'General' section of config file

And then rhelmer pointed me at https://gist.github.com/rhelmer/16b2b1208e7cf67c6bb8 and I fixed up local.ini and it should be back up.

Let me know if you need anything else.