1749897 - Gecko decision task not starting on try

Status: RESOLVED FIXED

(Taskcluster :: Operations and Service Requests, task)

Description

[Andreea Pavel [:apavel]]

Gecko decision task on try didn't start and won't show up in this interval:
https://treeherder.mozilla.org/jobs?repo=try&tochange=6b45e911df48018175dbb4238050e0c529a0aa50&fromchange=8964a8fc7b0651717ff16209a1860d5bcb82b6c0

Newer gecko decision tasks show up on try. Fix for a similar case can be found here https://bugzilla.mozilla.org/show_bug.cgi?id=1578014#c6

Also tried accessing https://firefox-ci-tc.services.mozilla.com/hooks/hg-push/try when this showed up, but got a 502 error for https://firefox-ci-tc.services.mozilla.com/graphql - this error still persists.

:cvalaas and :jbuck are also looking into it.

Comment 1

[Andreea Pavel [:apavel]]

Later update: :cvalaas and :jbuck fixed the 502 issue on https://firefox-ci-tc.services.mozilla.com/hooks/hg-push/try

Only issue remaining is these pushes without gecko decision task: https://treeherder.mozilla.org/jobs?repo=try&tochange=6b45e911df48018175dbb4238050e0c529a0aa50&fromchange=8964a8fc7b0651717ff16209a1860d5bcb82b6c0

Comment 2

[Jon Buckley [:jbuck]]

:cvalaas temporarily increased the load balancer timeout from 30s (default) to 120s and things seem to be working again. :darktrojan noted a very large commit message in the time frame that things broke, which might be something to investigate: https://hg.mozilla.org/try/rev/45859e2849017025a577bc79689052233c340634