1588371 - Intermittent requests.exceptions.HTTPError: 400 Client Error: BAD REQUEST for url: https://aus4-admin.mozilla.org/api/releases/Firefox-mozilla-central-nightly-20191013093601/builds/Darwin_x86_64-gcc3-u-i386-x86_64/ja-JP-mac

Status: RESOLVED DUPLICATE of bug 1591373

(Release Engineering Graveyard :: Applications: Balrog (backend), defect, P5)

Description

[Treeherder Bug Filer]

Filed by: rmaries [at] mozilla.com
Parsed log: https://treeherder.mozilla.org/logviewer.html#?job_id=271063854&repo=mozilla-central
Full log: https://queue.taskcluster.net/v1/task/Xezvjbt9S2CgknX5UhgBFg/runs/0/artifacts/public/logs/live_backing.log

---

File "/app/lib/python3.7/site-packages/requests/models.py", line 940, in raise_for_status
raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 400 Client Error: BAD REQUEST for url: https://aus4-admin.mozilla.org/api/releases/Firefox-mozilla-central-nightly-20191013093601/builds/Darwin_x86_64-gcc3-u-i386-x86_64/ja-JP-mac
2019-10-13 12:01:50,278 - DEBUG - sleeping for 1.65s (attempt 1/10)
2019-10-13 12:01:51,931 - DEBUG - attempt 2/10
2019-10-13 12:01:51,931 - INFO - retry: calling update_dated, attempt #2
2019-10-13 12:01:51,932 - DEBUG - Balrog request to https://aus4-admin.mozilla.org/api/releases/Firefox-mozilla-central-nightly-20191013093601
2019-10-13 12:01:51,932 - DEBUG - Data sent: null
2019-10-13 12:01:51,932 - DEBUG - Using cached token
2019-10-13 12:01:51,934 - DEBUG - Starting new HTTPS connection (1): aus4-admin.mozilla.org:443
2019-10-13 12:01:52,259 - DEBUG - https://aus4-admin.mozilla.org:443 "GET /api/releases/Firefox-mozilla-central-nightly-20191013093601 HTTP/1.1" 200 308791
2019-10-13 12:01:52,287 - DEBUG - REQUEST STATS: {"timestamp": 1570968112.287776, "method": "GET", "url": "https://aus4-admin.mozilla.org/api/releases/Firefox-mozilla-central-nightly-20191013093601", "status_code": 200, "elapsed_secs": 0.3555333614349365}
2019-10-13 12:01:52,290 - DEBUG - Balrog request to https://aus4-admin.mozilla.org/api/releases/Firefox-mozilla-central-nightly-20191013093601/builds/Darwin_x86_64-gcc3-u-i386-x86_64/ja-JP-mac
2019-10-13 12:01:52,290 - DEBUG - Data sent: null
2019-10-13 12:01:52,290 - DEBUG - Using cached token
2019-10-13 12:01:52,455 - DEBUG - https://aus4-admin.mozilla.org:443 "GET /api/releases/Firefox-mozilla-central-nightly-20191013093601/builds/Darwin_x86_64-gcc3-u-i386-x86_64/ja-JP-mac HTTP/1.1" 404 218
2019-10-13 12:01:52,456 - ERROR - Caught HTTPError: b'{\n "detail": "[\"Couldn't find locale identified by: Firefox-mozilla-central-nightly-20191013093601, Darwin_x86_64-gcc3-u-i386-x86_64, ja-JP-mac\"]",\n "status": 404,\n "title": "Not Found",\n "type": "about:blank"\n}\n'
2019-10-13 12:01:52,456 - DEBUG - REQUEST STATS: {"timestamp": 1570968112.456775, "method": "GET", "url": "https://aus4-admin.mozilla.org/api/releases/Firefox-mozilla-central-nightly-20191013093601/builds/Darwin_x86_64-gcc3-u-i386-x86_64/ja-JP-mac", "status_code": 404, "elapsed_secs": 0.16626715660095215}
2019-10-13 12:01:52,458 - DEBUG - Balrog request to https://aus4-admin.mozilla.org/api/releases/Firefox-mozilla-central-nightly-20191013093601
2019-10-13 12:01:52,459 - DEBUG - Data sent: null
2019-10-13 12:01:52,459 - DEBUG - Using cached token
2019-10-13 12:01:52,536 - DEBUG - https://aus4-admin.mozilla.org:443 "HEAD /api/releases/Firefox-mozilla-central-nightly-20191013093601 HTTP/1.1" 200 0
2019-10-13 12:01:52,537 - DEBUG - REQUEST STATS: {"timestamp": 1570968112.53739, "method": "HEAD", "url": "https://aus4-admin.mozilla.org/api/releases/Firefox-mozilla-central-nightly-20191013093601", "status_code": 200, "elapsed_secs": 0.07832145690917969}
2019-10-13 12:01:52,537 - DEBUG - Balrog request to https://aus4-admin.mozilla.org/api/releases/Firefox-mozilla-central-nightly-20191013093601/builds/Darwin_x86_64-gcc3-u-i386-x86_64/ja-JP-mac
2019-10-13 12:01:52,537 - DEBUG - Data sent: {"product": "Firefox", "data": "{"buildID": "20191013093601", "appVersion"<...2411 characters elided ...>
2019-10-13 12:01:52,537 - DEBUG - Using cached token
2019-10-13 12:01:53,833 - DEBUG - https://aus4-admin.mozilla.org:443 "PUT /api/releases/Firefox-mozilla-central-nightly-20191013093601/builds/Darwin_x86_64-gcc3-u-i386-x86_64/ja-JP-mac HTTP/1.1" 201 25
2019-10-13 12:01:53,834 - DEBUG - REQUEST STATS: {"timestamp": 1570968113.8344908, "method": "PUT", "url": "https://aus4-admin.mozilla.org/api/releases/Firefox-mozilla-central-nightly-20191013093601/builds/Darwin_x86_64-gcc3-u-i386-x86_64/ja-JP-mac", "status_code": 201, "elapsed_secs": 1.2967512607574463}
2019-10-13 12:01:53,835 - DEBUG - attempt 1/10
2019-10-13 12:01:53,835 - DEBUG - retry: calling update_latest, attempt #1
2019-10-13 12:01:53,835 - DEBUG - Balrog request to https://aus4-admin.mozilla.org/api/releases/Firefox-mozilla-central-nightly-latest
2019-10-13 12:01:53,835 - DEBUG - Data sent: null
2019-10-13 12:01:53,835 - DEBUG - Using cached token
2019-10-13 12:01:53,837 - DEBUG - Starting new HTTPS connection (1): aus4-admin.mozilla.org:443
2019-10-13 12:01:53,927 - DEBUG - https://aus4-admin.mozilla.org:443 "GET /api/releases/Firefox-mozilla-central-nightly-latest HTTP/1.1" 200 1344265
2019-10-13 12:01:53,945 - DEBUG - REQUEST STATS: {"timestamp": 1570968113.9457564, "method": "GET", "url": "https://aus4-admin.mozilla.org/api/releases/Firefox-mozilla-central-nightly-latest", "status_code": 200, "elapsed_secs": 0.11007809638977051}
2019-10-13 12:01:53,955 - DEBUG - Balrog request to https://aus4-admin.mozilla.org/api/releases/Firefox-mozilla-central-nightly-latest/builds/Darwin_x86_64-gcc3-u-i386-x86_64/ja-JP-mac
2019-10-13 12:01:53,956 - DEBUG - Data sent: null
2019-10-13 12:01:53,956 - DEBUG - Using cached token
2019-10-13 12:01:53,958 - DEBUG - Starting new HTTPS connection (1): aus4-admin.mozilla.org:443
2019-10-13 12:01:54,105 - DEBUG - https://aus4-admin.mozilla.org:443 "GET /api/releases/Firefox-mozilla-central-nightly-latest/builds/Darwin_x86_64-gcc3-u-i386-x86_64/ja-JP-mac HTTP/1.1" 200 2206
2019-10-13 12:01:54,107 - DEBUG - REQUEST STATS: {"timestamp": 1570968114.107354, "method": "GET", "url": "https://aus4-admin.mozilla.org/api/releases/Firefox-mozilla-central-nightly-latest/builds/Darwin_x86_64-gcc3-u-i386-x86_64/ja-JP-mac", "status_code": 200, "elapsed_secs": 0.15119051933288574}
2019-10-13 12:01:54,110 - DEBUG - Balrog request to https://aus4-admin.mozilla.org/api/releases/Firefox-mozilla-central-nightly-20191013093601
2019-10-13 12:01:54,111 - DEBUG - Data sent: null
2019-10-13 12:01:54,111 - DEBUG - Using cached token
2019-10-13 12:01:54,113 - DEBUG - Starting new HTTPS connection (1): aus4-admin.mozilla.org:443
2019-10-13 12:01:54,153 - DEBUG - https://aus4-admin.mozilla.org:443 "GET /api/releases/Firefox-mozilla-central-nightly-20191013093601 HTTP/1.1" 200 313226
2019-10-13 12:01:54,159 - DEBUG - REQUEST STATS: {"timestamp": 1570968114.15968, "method": "GET", "url": "https://aus4-admin.mozilla.org/api/releases/Firefox-mozilla-central-nightly-20191013093601", "status_code": 200, "elapsed_secs": 0.04840230941772461}
2019-10-13 12:01:54,162 - DEBUG - Balrog request to https://aus4-admin.mozilla.org/api/releases/Firefox-mozilla-central-nightly-20191013093601/builds/Darwin_x86_64-gcc3-u-i386-x86_64/ja-JP-mac
2019-10-13 12:01:54,162 - DEBUG - Data sent: null
2019-10-13 12:01:54,162 - DEBUG - Using cached token
2019-10-13 12:01:54,229 - DEBUG - https://aus4-admin.mozilla.org:443 "GET /api/releases/Firefox-mozilla-central-nightly-20191013093601/builds/Darwin_x86_64-gcc3-u-i386-x86_64/ja-JP-mac HTTP/1.1" 200 2206
2019-10-13 12:01:54,230 - DEBUG - REQUEST STATS: {"timestamp": 1570968114.2304752, "method": "GET", "url": "https://aus4-admin.mozilla.org/api/releases/Firefox-mozilla-central-nightly-20191013093601/builds/Darwin_x86_64-gcc3-u-i386-x86_64/ja-JP-mac", "status_code": 200, "elapsed_secs": 0.06821632385253906}
2019-10-13 12:01:54,233 - DEBUG - Submitting latest update with data version 1603092
2019-10-13 12:01:54,234 - DEBUG - Balrog request to https://aus4-admin.mozilla.org/api/releases/Firefox-mozilla-central-nightly-latest
2019-10-13 12:01:54,234 - DEBUG - Data sent: null
2019-10-13 12:01:54,234 - DEBUG - Using cached token
2019-10-13 12:01:54,343 - DEBUG - https://aus4-admin.mozilla.org:443 "HEAD /api/releases/Firefox-mozilla-central-nightly-latest HTTP/1.1" 200 0
2019-10-13 12:01:54,344 - DEBUG - REQUEST STATS: {"timestamp": 1570968114.3440118, "method": "HEAD", "url": "https://aus4-admin.mozilla.org/api/releases/Firefox-mozilla-central-nightly-latest", "status_code": 200, "elapsed_secs": 0.10982036590576172}
2019-10-13 12:01:54,344 - DEBUG - Balrog request to https://aus4-admin.mozilla.org/api/releases/Firefox-mozilla-central-nightly-latest/builds/Darwin_x86_64-gcc3-u-i386-x86_64/ja-JP-mac
2019-10-13 12:01:54,344 - DEBUG - Data sent: {"product": "Firefox", "data": "{"displayVersion": "71.0a1", "completes": <...2415 characters elided ...>
2019-10-13 12:01:54,344 - DEBUG - Using cached token
2019-10-13 12:01:59,749 - DEBUG - https://aus4-admin.mozilla.org:443 "PUT /api/releases/Firefox-mozilla-central-nightly-latest/builds/Darwin_x86_64-gcc3-u-i386-x86_64/ja-JP-mac HTTP/1.1" 400 266
2019-10-13 12:01:59,749 - ERROR - Caught HTTPError: b'{"type": "about:blank", "title": "Bad Request", "detail": "Couldn't update release: Failed to update row, old_data_version doesn't match current data_version", "status": 400, "exception": ["Failed to update row, old_data_version doesn't match current data_version"]}'
2019-10-13 12:01:59,750 - DEBUG - REQUEST STATS: {"timestamp": 1570968119.7501233, "method": "PUT", "url": "https://aus4-admin.mozilla.org/api/releases/Firefox-mozilla-central-nightly-latest/builds/Darwin_x86_64-gcc3-u-i386-x86_64/ja-JP-mac", "status_code": 400, "elapsed_secs": 5.405695915222168}
2019-10-13 12:01:59,750 - DEBUG - retry: Caught exception:

Comment 1

[Intermittent Failures Robot]

1 failures in 3801 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 1

Platform breakdown:

• osx-shippable: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1588371&startday=2019-10-07&endday=2019-10-13&tree=all

Comment 2

[Intermittent Failures Robot]

7 failures in 3964 pushes (0.002 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 7

Platform breakdown:

• osx-shippable: 7

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1588371&startday=2019-10-14&endday=2019-10-20&tree=all

Comment 3

[Intermittent Failures Robot]

6 failures in 4182 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 5
• mozilla-beta: 1

Platform breakdown:

• osx-shippable: 6

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1588371&startday=2019-10-21&endday=2019-10-27&tree=all