1155450 - meta: [jonasfj-Q2-goal] Investigate/reduce error rate from queue and scheduler

Status: RESOLVED FIXED

(Taskcluster :: General, defect)

Description

[Jonas Finnemann Jensen (:jonasfj)]

Right now queue and scheduler are slow... and have many timeout errors.
That's bad I should fix that...

Comment 1

[Jonas Finnemann Jensen (:jonasfj)]

Attachment: Github PR for final changes here

This upgrades queue to use taskcluster-base which has been moved to use
fast-azure-storage for base.Entity.
It also upgrades queue to fast-azure-storage for azure queue storage,
including SAS generation.

This is a bit scary because of the major changes in base.Entity.
But I've tested it all unit tests run, and things held up doing a load-test that while only testing two methods, ensured that at least they work :)

For performance improvements see: http://bit.ly/1IDFvj9

Comment 2

[John Ford [:jhford] CET/CEST Berlin Time]

Comment on attachment 8606039 [details] [review]
Github PR for final changes here

Looks good!

Comment 3

[Jonas Finnemann Jensen (:jonasfj)]

Landed these changes after running locally with production config to ensure that I could load the binary format used by current queue.

Comment 4

[Pete Moore [:pmoore][:pete]]

Resetting Version and Target Milestone that accidentally got changed...