1405073 - Make symbol upload synchronous

Status: RESOLVED FIXED

(Socorro :: Symbols, task)

Description

[Peter Bengtsson [:peterbe]]

In Socorro we used to do all the zip extraction and individual file upload as part of one big request-response. It works there even though it has a bug [0]. 

Tecken, currently, uses (EFS) disk to first write down the file, then trigger a Celery async job to process the file. That's turned out to be slow [1]. Too slow. We tried really hard to make it work by adding longer and longer wsgi timeouts. 

Let's just change back to a synchronous approach. No more Celery to do the .zip extraction and file S3 PUTs. 



[0] When iterating over all files in the .zip it wrongly things each one needs to be replaced so it almost always does a S3 PUT for each symbol file. Tecken has this bug fixed already.
[1] https://bugzilla.mozilla.org/show_bug.cgi?id=1399192

Comment 1

[GitHub Bugzilla PR Linker]

Attachment: Link to GitHub pull-request: https://github.com/mozilla-services/tecken/pull/431

Comment 2

[[github robot]]

Commit pushed to master at https://github.com/mozilla-services/tecken

https://github.com/mozilla-services/tecken/commit/9d81d625a081342429c57cd84073111fd6b9d496
bug 1405073 - Make symbol upload synchronous (#431)