768536 - change ES timeouts to something reasonable

Status: VERIFIED FIXED

(Participation Infrastructure :: Phonebook, defect)

Description

[Will Kahn-Greene [:willkg] ET needinfo? me]

I looked at the celery logs that I got from bug #768230.

The log starts in February 2012. There are 25,868 indexing tasks of which 455 failed with a TimeoutError since the log started.

If you just look at June 2012, there are 12,506 indexing tasks of which 324 failed with a TimeoutError.

That's not a huge percentage, but it's still not good.

Further, Matt Brandt said he sees periodic timeouts when searching on Mozillians.

For SUMO, we use a 5s timeout for querying the index and a 30s timeout for indexing. Those defaults are much more reasonable. I suggest Mozillians switch to them.

Fixing this in Mozillians is a little hard at the moment with the elasticutils version you're using. I'm hoping to make this easier in a future version of elasticutils.

The gist of it is that you need to use an ES that is set up with the 5s/30s timeout.

Comment 1

[[github robot]]

Commits pushed to master at https://github.com/mozilla/mozillians

https://github.com/mozilla/mozillians/commit/eccd02b0a7ee4a30cfb6645fb72fa34541333c5f
[fix bug 768536] Add ES_TIMEOUT and ES_INDEXING_TIMEOUT.

https://github.com/mozilla/mozillians/commit/4887224212b90b36315bb3022b7379cf4aef93cb
Merge pull request #326 from glogiotatidis/768536

[fix bug 768536] Add ES_TIMEOUT and ES_INDEXING_TIMEOUT.

Comment 2

[Giorgos Logiotatidis [:giorgos]]

With the new ES cluster ES_TIMEOUT (by default set to 5 sec) is enough. We should revert this change.

Comment 3

[[github robot]]

Commits pushed to master at https://github.com/mozilla/mozillians

https://github.com/mozilla/mozillians/commit/9b0f7a17afff417a00763fe3376921bee60a643d
Revert "[fix bug 768536] Add ES_TIMEOUT and ES_INDEXING_TIMEOUT."

This reverts commit eccd02b0a7ee4a30cfb6645fb72fa34541333c5f.

Default ES_TIMEOUT == 5 should be enough, no need for separate
ES_INDEXING_TIMEOUT.

https://github.com/mozilla/mozillians/commit/a233d79f9ff0918298163ac69b7ea45d3d886e7b
Merge pull request #331 from glogiotatidis/estimeout

Revert "[fix bug 768536] Add ES_TIMEOUT and ES_INDEXING_TIMEOUT."

Comment 4

[Rebecca Billings [:rbillings]]

Closed as [qa-]