1580382 - https://sql.telemetry.mozilla.org returns server error

Status: RESOLVED FIXED

(Data Platform and Tools :: General, defect)

Description

[Andreea Pavel [:apavel]]

Trying to access https://sql.telemetry.mozilla.org returns Cannot connect to server.

Comment 1

[Sebastian Hengst [:aryx] (needinfo me if it's about an intermittent or backout)]

tracert sql.telemetry.mozilla.org
routed to sql-telemetry-m-o.dev.mozaws.net for the SoftVision team yesterday. Now it returns unable to resolve target for them

For me, it connects to prod.stmo.prod.dataops.mozgcp.net and loads.

That migration took place almost 2 months ago: bug 1525461

Comment 2

[Jannis Leidel [:jezdez]]

That's odd indeed, the lookup works for me, but let's ask @jason if there were any changes in the DNS entry?

Comment 3

[Jason Thomas [:jason]]

As far as I can tell no DNS configuration changes have been made recently and querying a common DNS resolver results in the correct address:

dig sql.telemetry.mozilla.org  @8.8.8.8

; <<>> DiG 9.11.6-P1-RedHat-9.11.6-5.P1.fc30 <<>> sql.telemetry.mozilla.org @8.8.8.8
;; global options: +cmd
;; Got answer:
;; ->>HEADER<<- opcode: QUERY, status: NOERROR, id: 7619
;; flags: qr rd ra; QUERY: 1, ANSWER: 3, AUTHORITY: 0, ADDITIONAL: 1

;; OPT PSEUDOSECTION:
; EDNS: version: 0, flags:; udp: 512
;; QUESTION SECTION:
;sql.telemetry.mozilla.org.	IN	A

;; ANSWER SECTION:
sql.telemetry.mozilla.org. 299	IN	CNAME	sql-telemetry-m-o.dev.mozaws.net.
sql-telemetry-m-o.dev.mozaws.net. 59 IN	CNAME	prod.stmo.prod.dataops.mozgcp.net.
prod.stmo.prod.dataops.mozgcp.net. 59 IN A	34.95.121.147

;; Query time: 129 msec
;; SERVER: 8.8.8.8#53(8.8.8.8)
;; WHEN: Wed Sep 11 08:56:04 EDT 2019
;; MSG SIZE  rcvd: 160

One thing I can do is remove the additional hop DNS CNAME record sql-telemetry-m-o.dev.mozaws.net which I believe was originally used as part of a migration. I will file a bug with IT to get this changed over.

Comment 4

[Jason Thomas [:jason]]

DNS entry has been updated:

dig sql.telemetry.mozilla.org @8.8.8.8

; <<>> DiG 9.11.6-P1-RedHat-9.11.6-5.P1.fc30 <<>> sql.telemetry.mozilla.org @8.8.8.8
;; global options: +cmd
;; Got answer:
;; ->>HEADER<<- opcode: QUERY, status: NOERROR, id: 43958
;; flags: qr rd ra; QUERY: 1, ANSWER: 2, AUTHORITY: 0, ADDITIONAL: 1

;; OPT PSEUDOSECTION:
; EDNS: version: 0, flags:; udp: 512
;; QUESTION SECTION:
;sql.telemetry.mozilla.org.	IN	A

;; ANSWER SECTION:
sql.telemetry.mozilla.org. 299	IN	CNAME	prod.stmo.prod.dataops.mozgcp.net.
prod.stmo.prod.dataops.mozgcp.net. 59 IN A	34.95.121.147

;; Query time: 265 msec
;; SERVER: 8.8.8.8#53(8.8.8.8)
;; WHEN: Wed Sep 11 12:19:04 EDT 2019
;; MSG SIZE  rcvd: 117

If this continues to happen if you could provide me with the following details to assist with investigation:

1. The output of dig sql.telemetry.mozilla.org +trace
2. The output of curl -v https://sql.telemetry.mozilla.org

I will keep this bug open for a couple more days. Thanks

Comment 5

[Jason Thomas [:jason]]

Please reopen if you continue to have issues.