1412286 - Download key invalidation not working

Status: RESOLVED INVALID

(Socorro :: Symbols, task)

Description

[Peter Bengtsson [:peterbe]]

Attachment: peterbe.zip

Steps to reproduce:

1. Go to localhost:8000/peterbe.pdb/deadbeef123/peterbe.sym (Expect 404)
2. Upload the attached zip
3. Go to localhost:8000/peterbe.pdb/deadbeef123/peterbe.sym (Expect 200, Get 404)

Comment 1

[Peter Bengtsson [:peterbe]]

Sadly not possible to reproduce locally :(

Comment 2

[Peter Bengtsson [:peterbe]]

Ah. Able to reproduce if I actually use AWS S3 and not minio on localhost:9000.

There seems to be a delay between S3 PUT and S3 ListObjectsV2. 
I put some print statements and can assert that the S3 PUT command did happen (successfully) BEFORE the S3 ListObjectsV2 happened, yet the ListObjectsV2 concluded that the file does not exist. 

So we need a way to tell the cache to "wait a little longer" before it concludes that the file doesn't exist.

Comment 3

[Peter Bengtsson [:peterbe]]

For the record, I tried switching from ListObjectsV2 to HeadObject (in fact I used both) and HeadObject too says it's not there yet.

Comment 4

[Peter Bengtsson [:peterbe]]

Invalid testing. The reason it manifested itself was because the symboldownloader forces the debugID to be uppercase. But I uploaded a fake .zip whose debugID was all hex chars but it was in lowercase. That triggered a mismatch in the "cache key comparisons".