1815994 - stop proxying symbolication API requests [7/2023]

Status: RESOLVED FIXED

(Tecken :: General, task, P1)

Description

[Will Kahn-Greene [:willkg] ET needinfo? me]

In bug #1739447, we added a proxy for incoming symbolication API requests to symbols.mozilla.org (Tecken webapp) to symbolication.services.mozilla.com (Eliot webapp).

It's been several months. Something out there is still using the symbols.mozilla.org host.

It's time we stop proxying.

Comment 1

[Will Kahn-Greene [:willkg] ET needinfo? me]

Grabbing this to do.

Comment 2

[Will Kahn-Greene [:willkg] ET needinfo? me]

Proxying /symbolicate/ is implemented in nginx configuration, so it's not tying up Gunicorn workers. We should migrate off of this, but it's probably something we can push off for the moment.

Comment 3

[Will Kahn-Greene [:willkg] ET needinfo? me]

Making this block GCP migration because it'd be good to clean up before we migrate.

Comment 4

[Will Kahn-Greene [:willkg] ET needinfo? me]

I sent an email to stability, crash-reporting-wg, and dev-platform asking people who are using symbols.mozilla.org for symbolication to update their code to use symbolication.services.mozilla.com.

The plan is to remove the proxy bits from the nginx configuration in July 2023. I updated the summary accordingly.

Comment 5

[Will Kahn-Greene [:willkg] ET needinfo? me]

I wrote up a PR to remove the symbolication_endpoint configuration and remove the nginx proxy configuration.

https://github.com/mozilla-services/cloudops-deployment/pull/4873

Someone is still using the old host for symbolication, but I've updated as many things as I could find, so at this point we should remove the proxy and let things fail and then people will update their stuff.

Comment 6

[Will Kahn-Greene [:willkg] ET needinfo? me]

This PR landed. I did something to trigger a stage deploy and verified that it no longer proxies /symbolicate/.

This uses Eliot's scripts to put together a symbolication API request. It now kicks up an HTTP 404:

$ python bin/symbolicate.py verify \
    --api-url="https://symbols.stage.mozaws.net/symbolicate/v5" \
    data/stacks/5002f294-9928-4edf-a07a-750730230322.json 

Comment 7

[Will Kahn-Greene [:willkg] ET needinfo? me]

I think this was deployed in bug #1845102. I haven't heard anything from anyone about this change, so everything is probably good here. Marking as FIXED.