978662 - Stats on AoA are not being updated

Status: RESOLVED FIXED

(support.mozilla.org :: Army of Awesome, task, P1)

Description

[v.kaushik07]

Attachment: Capture2.PNG

User Agent: Mozilla/5.0 (Windows NT 6.1) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/33.0.1750.117 Safari/537.36

Steps to reproduce:

I am the #1 contributor on Army of Awesome and i've been doing 60-70 tweets regularly, but since 15-20 days it's not being updated. It still shows the no. of tweets that were there 15 days back.


Actual results:

No update of tweets on army of awesome since 20 days. It's showing the same no. as it showed 20 days back.


Expected results:

tweets in Army of Awesome used to be update regularly and now it's not. Tweets should have been updated regularly and it should have shown 6009 tweets of mine instead of 5352.

My original tweets on aoa is 6009. My name on aoa is @varunkaushik07 I request you to kindly fix it and update the no. of tweets of the 20 days which were not updated. I mean add the difference back. Like it's showing 5352 on AOA but it's actually 6009 as twitter says. Coz i only tweet for aoa. No tweet other than it. Please kindly fix it and add the difference tweets into all of the contributors list. everyone is being affected with it

Comment 1

[Will Kahn-Greene [:willkg] ET needinfo? me]

Why did you mark this bug marked security-sensitive?

Comment 2

[Ricky Rosario [:rrosario, :r1cky]]

Yeah, the cron job seems to be running out of memory and/or taking to long every night and getting killed off. We'll have to rewrite it. I've been meaning to look into it but... Thanks for filing!

Putting into next sprint. Should be about 2pts.

Comment 3

[Ricky Rosario [:rrosario, :r1cky]]

Sorry, I meant to put this in *next* sprint.

Comment 4

[Ricky Rosario [:rrosario, :r1cky]]

The result for the cron job is always one of:
MemoryError: out of memory

or

/bin/sh: line 1: 15922 Killed                  PYTHONPATH=/usr/local/lib64/python2.6/site-packages /usr/bin/python2.6 -W ignore::DeprecationWarning manage.py cron get_customercare_stats


One thing we do is load up all the reply tweets into memory at once from the db. I'm going to change that so it's chunked and hopefully that fixes the problem.

Comment 5

[Ricky Rosario [:rrosario, :r1cky]]

In a pull request:
https://github.com/mozilla/kitsune/pull/1853

Comment 6

[Ricky Rosario [:rrosario, :r1cky]]

I landed a possible on master:
https://github.com/mozilla/kitsune/commit/552e5d2e7ed51abe1363b0d757be8e8f0acc19a5

By chunking the queryset of replies, the cron job should use less memory and not get killed.

Comment 7

[Ricky Rosario [:rrosario, :r1cky]]

I deployed that fix to prod. If it fails again tonight, I'll reopen this.