Closed Bug 1508049 Opened Last year Closed Last year

Perma Win Nightly partial OSError: Unexpected number of bytes downloaded

Categories

(Release Engineering :: Release Automation: Updates, defect, P5)

defect

Tracking

(firefox-esr60 fixed, firefox65 fixed)

RESOLVED FIXED
Tracking Status
firefox-esr60 --- fixed
firefox65 --- fixed

People

(Reporter: intermittent-bug-filer, Assigned: tomprince)

References

Details

(Keywords: intermittent-failure, Whiteboard: [stockwell disable-recommended])

Attachments

(1 file)

Filed by: apavel [at] mozilla.com

https://treeherder.mozilla.org/logviewer.html#?job_id=212406127&repo=mozilla-central

https://queue.taskcluster.net/v1/task/YQDHHKvoSFOnTnF7HfpGMA/runs/0/artifacts/public/logs/live_backing.log

2018-11-17 13:50:07,735 - INFO - Done.
2018-11-17 13:50:07,735 - INFO - Downloading https://queue.taskcluster.net/v1/task/Non95vHiTrOcldo9hTknEw/artifacts/public/build/target.complete.mar to /tmp/tmpa98439sg/to.mar
2018-11-17 13:50:17,875 - DEBUG - Fetching from url https://s3-us-west-2.amazonaws.com/taskcluster-public-artifacts/Non95vHiTrOcldo9hTknEw/0/public/build/target.complete.mar
2018-11-17 13:50:17,875 - DEBUG - Redirection history: https://queue.taskcluster.net/v1/task/Non95vHiTrOcldo9hTknEw/artifacts/public/build/target.complete.mar
2018-11-17 13:50:17,875 - DEBUG - Redirection history: https://cloud-mirror.taskcluster.net/v1/redirect/s3/us-west-1/https:%2F%2Fs3-us-west-2.amazonaws.com%2Ftaskcluster-public-artifacts%2FNon95vHiTrOcldo9hTknEw%2F0%2Fpublic%2Fbuild%2Ftarget.complete.mar
2018-11-17 13:50:17,875 - DEBUG - Content-Length expected for https://queue.taskcluster.net/v1/task/Non95vHiTrOcldo9hTknEw/artifacts/public/build/target.complete.mar: 48034535
2018-11-17 13:50:18,045 - DEBUG - Bytes downloaded for https://queue.taskcluster.net/v1/task/Non95vHiTrOcldo9hTknEw/artifacts/public/build/target.complete.mar: 4195513
2018-11-17 13:50:18,095 - DEBUG - Bytes downloaded for https://queue.taskcluster.net/v1/task/Non95vHiTrOcldo9hTknEw/artifacts/public/build/target.complete.mar: 8392865
2018-11-17 13:50:18,154 - DEBUG - Bytes downloaded for https://queue.taskcluster.net/v1/task/Non95vHiTrOcldo9hTknEw/artifacts/public/build/target.complete.mar: 12589782
2018-11-17 13:50:18,213 - DEBUG - Bytes downloaded for https://queue.taskcluster.net/v1/task/Non95vHiTrOcldo9hTknEw/artifacts/public/build/target.complete.mar: 16786960
2018-11-17 13:50:18,263 - DEBUG - Bytes downloaded for https://queue.taskcluster.net/v1/task/Non95vHiTrOcldo9hTknEw/artifacts/public/build/target.complete.mar: 20984022
2018-11-17 13:50:18,323 - DEBUG - Bytes downloaded for https://queue.taskcluster.net/v1/task/Non95vHiTrOcldo9hTknEw/artifacts/public/build/target.complete.mar: 25181200
2018-11-17 13:50:18,381 - DEBUG - Bytes downloaded for https://queue.taskcluster.net/v1/task/Non95vHiTrOcldo9hTknEw/artifacts/public/build/target.complete.mar: 29378468
2018-11-17 13:50:18,431 - DEBUG - Bytes downloaded for https://queue.taskcluster.net/v1/task/Non95vHiTrOcldo9hTknEw/artifacts/public/build/target.complete.mar: 33575530
2018-11-17 13:50:18,489 - DEBUG - Bytes downloaded for https://queue.taskcluster.net/v1/task/Non95vHiTrOcldo9hTknEw/artifacts/public/build/target.complete.mar: 37772944
2018-11-17 13:50:18,547 - DEBUG - Bytes downloaded for https://queue.taskcluster.net/v1/task/Non95vHiTrOcldo9hTknEw/artifacts/public/build/target.complete.mar: 41971334
2018-11-17 13:50:18,598 - DEBUG - Bytes downloaded for https://queue.taskcluster.net/v1/task/Non95vHiTrOcldo9hTknEw/artifacts/public/build/target.complete.mar: 46168623
2018-11-17 13:50:18,627 - DEBUG - Downloaded 48029599 bytes
2018-11-17 13:50:18,628 - DEBUG - Content-Length: 48034535 bytes
Traceback (most recent call last):
  File "/home/worker/bin/funsize.py", line 536, in <module>
    main()
  File "/home/worker/bin/funsize.py", line 510, in main
    manifest = loop.run_until_complete(async_main(args, signing_certs))
  File "/usr/lib/python3.6/asyncio/base_events.py", line 468, in run_until_complete
    return future.result()
  File "/home/worker/bin/funsize.py", line 441, in async_main
    manifest = await asyncio.gather(*tasks)
  File "/home/worker/.local/share/virtualenvs/-x-v5uFv0/lib/python3.6/site-packages/scriptworker/utils.py", line 260, in retry_async
    return await func(*args, **kwargs)
  File "/home/worker/bin/funsize.py", line 306, in manage_partial
    await retry_download(f, dest)
  File "/home/worker/bin/funsize.py", line 108, in retry_download
    kwargs=kwargs
  File "/home/worker/.local/share/virtualenvs/-x-v5uFv0/lib/python3.6/site-packages/scriptworker/utils.py", line 260, in retry_async
    return await func(*args, **kwargs)
  File "/home/worker/bin/funsize.py", line 142, in download
    raise IOError('Unexpected number of bytes downloaded')
OSError: Unexpected number of bytes downloaded
[taskcluster 2018-11-17 13:50:19.272Z] === Task Finished ===
[taskcluster 2018-11-17 13:50:19.354Z] Artifact "public/build/target.partial-3.mar" not found at "/home/worker/artifacts/target.partial-3.mar"
[taskcluster 2018-11-17 13:50:19.418Z] Artifact "public/build/target.partial-1.mar" not found at "/home/worker/artifacts/target.partial-1.mar"
[taskcluster 2018-11-17 13:50:19.479Z] Artifact "public/build/target.partial-4.mar" not found at "/home/worker/artifacts/target.partial-4.mar"
[taskcluster 2018-11-17 13:50:19.527Z] Artifact "public/build/target.partial-2.mar" not found at "/home/worker/artifacts/target.partial-2.mar"
[taskcluster 2018-11-17 13:50:19.578Z] Artifact "public/build/manifest.json" not found at "/home/worker/artifacts/manifest.json"
[taskcluster 2018-11-17 13:50:20.225Z] Unsuccessful task run with exit code: 1 completed in 95.86 seconds
Flags: needinfo?(mozilla)
Summary: Intermittent Win Nightly partial OSError: Unexpected number of bytes downloaded → Perma Win Nightly partial OSError: Unexpected number of bytes downloaded
moving to releng since it is related to funsize
Component: General → Release Automation: Updates
Product: Firefox Build System → Release Engineering
QA Contact: mtabara
When Content-Encoding is specified, the decoded length won't match the lenght
in the header. In any case aiohttp has code that verifies the length, so we
don't need to do it as well.
Attachment #9026190 - Attachment description: Bug 1508049: [funsize] Don't verify decoded download length against HTTP header; r?sfraser → Bug 1508049: [funsize] Don't verify decoded download length against HTTP header; r=sfraser
Pushed by mozilla@hocat.ca:
https://hg.mozilla.org/integration/autoland/rev/9201152ee77c
[funsize] Don't verify decoded download length against HTTP header; r=sfraser
https://hg.mozilla.org/mozilla-central/rev/9201152ee77c
Status: NEW → RESOLVED
Closed: Last year
Resolution: --- → FIXED
Flags: needinfo?(mozilla)
You need to log in before you can comment on or make changes to this bug.