Too many requests for browserid support document

RESOLVED FIXED

Status

Cloud Services
Server: Token
RESOLVED FIXED
4 years ago
4 years ago

People

(Reporter: rfkelly, Unassigned)

Tracking

Firefox Tracking Flags

(Not tracked)

Details

(Reporter)

Description

4 years ago
As noted in Bug 1097584, the FxA auth server seems to be getting almost 400 requests per second for its .well-known/browserid support document.  This suggests that it's not being cached correctly at some point.

Fetching it by hand, I can see what FxA is sending the following header which AFAICT should allow it to be cached for 10 seconds:

   Cache-Control:"max-age=10, must-revalidate, public"

Benson, can you confirm whether the tokenserver webheads have squid set up to cache this document for the local verifier instances?  I can't see anything about it in the puppet-config but I may be looking in the wrong place.
(Reporter)

Updated

4 years ago
Flags: needinfo?(bwong)
ugh. good find... found it. 

https://github.com/mozilla-services/puppet-config/pull/980

I'll deploy a staging one today to make sure it's good end to end.
Flags: needinfo?(bwong)
Deployed a stage stack and it looks good, squid's logs:


[root@ip-172-31-22-196 squid]# tail -f access.log
1415827691.265    290 127.0.0.1 TCP_MISS/200 1644 GET https://api.accounts.firefox.com/.well-known/browserid - HIER_DIRECT/54.213.130.165 application/json
1415827714.407     65 127.0.0.1 TCP_MISS/200 1643 GET https://api.accounts.firefox.com/.well-known/browserid - HIER_DIRECT/54.213.130.165 application/json
1415827715.751      0 127.0.0.1 TCP_MEM_HIT/200 1650 GET https://api.accounts.firefox.com/.well-known/browserid - HIER_NONE/- application/json
1415827716.758      0 127.0.0.1 TCP_MEM_HIT/200 1650 GET https://api.accounts.firefox.com/.well-known/browserid - HIER_NONE/- application/json
1415827717.764      0 127.0.0.1 TCP_MEM_HIT/200 1650 GET https://api.accounts.firefox.com/.well-known/browserid - HIER_NONE/- application/json
1415827718.772      0 127.0.0.1 TCP_MEM_HIT/200 1650 GET https://api.accounts.firefox.com/.well-known/browserid - HIER_NONE/- application/json
1415827719.779      0 127.0.0.1 TCP_MEM_HIT/200 1650 GET https://api.accounts.firefox.com/.well-known/browserid - HIER_NONE/- application/json
1415827720.786      0 127.0.0.1 TCP_MEM_HIT/200 1650 GET https://api.accounts.firefox.com/.well-known/browserid - HIER_NONE/- application/json
1415827721.793      0 127.0.0.1 TCP_MEM_HIT/200 1650 GET https://api.accounts.firefox.com/.well-known/browserid - HIER_NONE/- application/json
1415827722.801      0 127.0.0.1 TCP_MEM_HIT/200 1650 GET https://api.accounts.firefox.com/.well-known/browserid - HIER_NONE/- application/json
1415827723.808      0 127.0.0.1 TCP_MEM_HIT/200 1650 GET https://api.accounts.firefox.com/.well-known/browserid - HIER_NONE/- application/json
1415827724.888     73 127.0.0.1 TCP_MISS/200 1643 GET https://api.accounts.firefox.com/.well-known/browserid - HIER_DIRECT/54.213.130.165 application/json
1415827725.823      0 127.0.0.1 TCP_MEM_HIT/200 1650 GET https://api.accounts.firefox.com/.well-known/browserid - HIER_NONE/- application/json
1415827726.838      0 127.0.0.1 TCP_MEM_HIT/200 1650 GET https://api.accounts.firefox.com/.well-known/browserid - HIER_NONE/- application/json
1415827727.846      0 127.0.0.1 TCP_MEM_HIT/200 1650 GET https://api.accounts.firefox.com/.well-known/browserid - HIER_NONE/- application/json
1415827728.853      0 127.0.0.1 TCP_MEM_HIT/200 1650 GET https://api.accounts.firefox.com/.well-known/browserid - HIER_NONE/- application/json
1415827729.860      0 127.0.0.1 TCP_MEM_HIT/200 1650 GET https://api.accounts.firefox.com/.well-known/browserid - HIER_NONE/- application/json
1415827730.868      0 127.0.0.1 TCP_MEM_HIT/200 1650 GET https://api.accounts.firefox.com/.well-known/browserid - HIER_NONE/- application/json
1415827731.875      0 127.0.0.1 TCP_MEM_HIT/200 1650 GET https://api.accounts.firefox.com/.well-known/browserid - HIER_NONE/- application/json
1415827732.882      0 127.0.0.1 TCP_MEM_HIT/200 1650 GET https://api.accounts.firefox.com/.well-known/browserid - HIER_NONE/- application/json
1415827733.898      0 127.0.0.1 TCP_MEM_HIT/200 1650 GET https://api.accounts.firefox.com/.well-known/browserid - HIER_NONE/- application/json
Status: NEW → RESOLVED
Last Resolved: 4 years ago
Resolution: --- → FIXED
(Reporter)

Comment 3

4 years ago
Great, thanks!  We can verify it some more as part of loadtesting for Bug 1091313.
Note: deployed the new tokenserver w/ the cache fixes. Looks good. The stackdriver graphs shows a pretty obvious 400r/s drop in traffic.
You need to log in before you can comment on or make changes to this bug.