1264212 - Treeherder is not suggesting new filed bugs anymore

Status: RESOLVED FIXED

(Tree Management :: Treeherder, defect)

Description

[Carsten Book [:Tomcat]]

As example https://treeherder.mozilla.org/logviewer.html#?job_id=8617078&repo=fx-team

should suggest Bug 1264009 as Wes filed this yesterday, but treeherder suggest only     1173943 Intermittent api_status_idle.html | idle status test - assert_equals: cache.status should equals cache.IDLE expected 1 but got 0


same with Bug 1263878 - its also not suggested by treeherder while it should be

Comment 1

[Carsten Book [:Tomcat]]

Mauro, could you take a look at this or do you know who could take a look ?

Comment 2

[Sebastian Hengst [:aryx] (needinfo me if it's about an intermittent or backout)]

Wasn't it like that at least for the last months? Bugs filed during the last day didn't get suggested and/or suggestions got generated when the job finished.

Comment 3

[Wes Kocher (:KWierso) (Not reading bugmail; email directly if needed)]

I don't remember offhand how often the bugscache gets updated. Thought it was maybe six hours?

Comment 4

[Wes Kocher (:KWierso) (Not reading bugmail; email directly if needed)]

(In reply to Wes Kocher (:KWierso) from comment #3)
> I don't remember offhand how often the bugscache gets updated. Thought it
> was maybe six hours?

https://github.com/mozilla/treeherder/blob/2a9dbefa49d26d8d0ddc7c402c571691b1679770/treeherder/etl/tasks/tasks.py#L9

10x60... minutes, I guess?

Comment 5

[Sebastian Hengst [:aryx] (needinfo me if it's about an intermittent or backout)]

Yes, this should be every 10 minutes. From http://docs.celeryproject.org/en/latest/userguide/tasks.html
> Task.time_limit
>   The hard time limit, in seconds, for this task. If not set then the workers default will be used.
So for some reason the suggestion updates are delayed.

Comment 6

[Carsten Book [:Tomcat]]

seems james is looking into it

Comment 7

[James Graham [:jgraham]]

Could be a regression from bug 1231361, perhaps? I can't obviously see anything wrong with that patch, but it's the only recent change that touches the bug ingestion.

Comment 8

[William Lachance (:wlach)]

Figured this out, the update bugs process is triggering a value error due to timezone configuration on treeherder stage/production:

  File "/data/www/treeherder.mozilla.org/venv/lib/python2.7/site-packages/django/db/backends/mysql/operations.py", line 150, in value_to_db_datetime
    raise ValueError("MySQL backend does not support timezone-aware datetimes when USE_TZ is False.")

I have a fix which I tested manually on production.

Comment 9

[GitHub Autolander Bot]

Attachment: [treeherder] wlach:1264212 > mozilla:master

Comment 10

[Cameron Dawson [:camd]]

Comment on attachment 8741049 [details] [review]
[treeherder] wlach:1264212 > mozilla:master

cool, looks good to me.

Comment 11

[Treeherder GitHub Bugbot]

Commits pushed to master at https://github.com/mozilla/treeherder

https://github.com/mozilla/treeherder/commit/51f540a99ebfbfe2d01f1b87487d07e20bf19050
Bug 1264212 - Ignore timezone when updating bugscache

https://github.com/mozilla/treeherder/commit/1a8a886a389c1f3373aedb76e2a1c606d8703650
Merge pull request #1405 from wlach/1264212

Bug 1264212 - Ignore timezone when updating bugscache