582763 - Celery behaving badly, email and thumbnails

Status: VERIFIED FIXED

(support.mozilla.org :: Questions, task, P3)

Description

[Rebecca Billings [:rbillings]]

Clicking the 'Receive updates via email' doesn't send email notifications. Also, signing up for email notifications via clicking the 'me too' button does not send updates.

1) sign up to receive email notifications via 'updates' link or by marking question as 'I have this problem too' [as either signed in or signed out user]
2) sign in as other users> add answers to question

expected: email updates
actual: none

Comment 1

[James Socol [:jsocol, :james]]

I just followed those STR and got:


Answer to question: automation test question 2010-07-28

jsocol0 has posted an answer to the question 
automation test question 2010-07-28.

========

yet-another-reply

========

To view this answer on the site, click the following link, or
paste it into your browser's location bar:

https://support-stage.mozilla.com/questions/88#answer-216

Comment 2

[James Socol [:jsocol, :james]]

I've been seeing reply notifications all night. Is this specific to solution notifications? Anyone else having problems?

Comment 3

[David Tenser [:djst]]

I signed up with a new account (djsttest, [e-mail]) and posted a question, and then I logged in as djst and posted a reply. 

I didn't get an email notification to [e-mail]. In fact, when I posted the question I was already logged in and I didn't even see an option to receive an email when someone responded?

Comment 4

[David Tenser [:djst]]

I tried to do it in the other (much more common order) of asking the question while logged out. I used my third e-mail address for this ([e-mail]) but I couldn't get past an error message when posting:

"An Error Occurred

Oh, no! It looks like an unexpected error occurred. We've already notified the site administrators. Please try again now, or in a few minutes."

:(

Comment 5

[Rebecca Billings [:rbillings]]

I'm finally getting email notifications

Comment 6

[James Socol [:jsocol, :james]]

(In reply to comment #5)
> I'm finally getting email notifications

I just had Shyam recycle celery, maybe the tasks needed a kick start?

(In reply to comment #4)
> I tried to do it in the other (much more common order) of asking the question
> while logged out. I used my third e-mail address for this ([e-mail])
> but I couldn't get past an error message when posting:

See bug 573820 for that.

Comment 7

[James Socol [:jsocol, :james]]

We've definitely tracked this down to a celery issue, as setting CELERY_ALWAYS_EAGER = True seems to have fixed it in general (see bug 583057 for a special case that seems different).

My hope is that when we turn celery back on, all will be fine.

Comment 8

[James Socol [:jsocol, :james]]

Going to dig into this on Monday with some IT help.

Comment 9

[James Socol [:jsocol, :james]]

Worked this out with Jeremy in IRC. There were some stale celeryd processes from over a month ago still running, but without the latest code: they were picking up jobs from the queue and didn't know how to handle them. We've switched to restarting instead of reloading celery and killed the stale processes.

Things should behave much better now.

Comment 10

[Rebecca Billings [:rbillings]]

Verified getting emails correctly, also issue with reporting post on different browsers causing page not found no longer repros.