742411 - Advanced Search returns Connection Reset Error

Status: VERIFIED FIXED

(Socorro :: Webapp, task)

Description

[Alex Lakatos[:AlexLakatos]]

Steps to reproduce:
1.Go to https://crash-stats.allizom.org/
2.Go to Advanced Search
3.Press "Filter Crash Reports"

Expected Results:
3.Reports are filtered

Actual Results: 
3.The connection to the server was reset while the page was loading.

Comment 1

[[DEACTIVATED] Adrian Gaudebert]

The query is executed but seems to time out. Weird, the only thing that changed in search recently was a simple ORDER BY (bug 737421). Here is the SQL that seems to time out:

/* socorro.search.Search search */ 
SELECT 
    r.signature, 
    count(r.id) as total, 
    count(CASE WHEN (r.os_name = E'Windows NT') THEN 1 END) AS is_windows, 
    count(CASE WHEN (r.os_name = E'Mac OS X') THEN 1 END) AS is_mac, 
    count(CASE WHEN (r.os_name = E'Linux') THEN 1 END) AS is_linux, 
    SUM (CASE WHEN r.hangid IS NULL THEN 0  ELSE 1 END) AS numhang, 
    SUM (CASE WHEN r.process_type='plugin' THEN 1ELSE 0 END) as numplugin, 
    SUM (CASE WHEN r.process_type='content' THEN 1ELSE 0 END) as numcontent 
FROM reports r
WHERE r.date_processed BETWEEN '2012-03-28T16:31:42+00:00' AND '2012-04-04T16:31:42+00:00'
    AND (r.product=E'Firefox') 
GROUP BY r.signature
ORDER BY total DESC, signature
LIMIT 100
OFFSET 0

Comment 2

[[:jberkus] Josh Berkus]

so this is what a search session looks like on StageDB.  It looks as if something in the middle is discounnecting as soon as it receives the data, without forwarding it to the client:

2012-04-04 12:19:46.101 PDT,,,6653,"",4f7c9ed2.19fd,1,"",2012-04-04 12:19:46 PDT,,0,LOG,00000,"connection received: host=10.8.70.208 port=64570",,,,,,,,,""
2012-04-04 12:19:46.103 PDT,"breakpad_rw","breakpad",6653,"10.8.70.208:64570",4f7c9ed2.19fd,2,"authentication",2012-04-04 12:19:46 PDT,11/18462,0,LOG,00000,"connection authorized: user=breakpad_rw database=breakpad",,,,,,,,,""
2012-04-04 12:19:46.104 PDT,"breakpad_rw","breakpad",6653,"10.8.70.208:64570",4f7c9ed2.19fd,3,"SET",2012-04-04 12:19:46 PDT,11/0,0,LOG,00000,"duration: 0.094 ms  statement: SET DATESTYLE TO 'ISO'",,,,,,,,,""
2012-04-04 12:19:46.105 PDT,"breakpad_rw","breakpad",6653,"10.8.70.208:64570",4f7c9ed2.19fd,4,"SHOW",2012-04-04 12:19:46 PDT,11/0,0,LOG,00000,"duration: 0.087 ms  statement: SHOW client_encoding",,,,,,,,,""
2012-04-04 12:19:46.106 PDT,"breakpad_rw","breakpad",6653,"10.8.70.208:64570",4f7c9ed2.19fd,5,"SHOW",2012-04-04 12:19:46 PDT,11/0,0,LOG,00000,"duration: 0.036 ms  statement: SHOW default_transaction_isolation",,,,,,,,,""
2012-04-04 12:19:46.108 PDT,"breakpad_rw","breakpad",6653,"10.8.70.208:64570",4f7c9ed2.19fd,6,"SET",2012-04-04 12:19:46 PDT,11/18466,0,LOG,00000,"duration: 0.038 ms  statement: BEGIN; SET TRANSACTION ISOLATION LEVEL READ COMMITTED",,,,,,,,,""
2012-04-04 12:20:56.153 PDT,"breakpad_rw","breakpad",6653,"10.8.70.208:64570",4f7c9ed2.19fd,7,"SELECT",2012-04-04 12:19:46 PDT,11/18466,0,LOG,00000,"duration: 70044.090 ms  statement: /* socorro.external.postgresql.search.Search search.count */ SELECT count(DISTINCT r.signature) FROM reports r 
2012-04-04 12:21:00.026 PDT,"breakpad_rw","breakpad",6653,"10.8.70.208:64570",4f7c9ed2.19fd,8,"SELECT",2012-04-04 12:19:46 PDT,11/18466,0,LOG,00000,"duration: 3872.200 ms  statement: /* socorro.search.Search search */ SELECT r.signature, count(r.id) as total, count(CASE WHEN (r.os_name = E'Windows NT') THEN 1 END) AS is_windows, count(CASE WHEN (r.os_name = E'Mac OS X') THEN 1 END) AS is_mac, count(CASE WHEN (r.os_name = E'Linux') THEN 1 END) AS is_linux, SUM (CASE WHEN r.hangid IS NULL THEN 0  ELSE 1 END) AS numhang, SUM (CASE WHEN r.process_type='plugin' THEN 1ELSE 0 END) as numplugin, SUM (CASE WHEN r.process_type='content' THEN 1ELSE 0 END) as numcontent FROM reports r 
2012-04-04 12:21:00.028 PDT,"breakpad_rw","breakpad",6653,"10.8.70.208:64570",4f7c9ed2.19fd,9,"ROLLBACK",2012-04-04 12:19:46 PDT,11/0,0,LOG,00000,"duration: 0.103 ms  statement: ROLLBACK",,,,,,,,,""
2012-04-04 12:21:00.029 PDT,"breakpad_rw","breakpad",6653,"10.8.70.208:64570",4f7c9ed2.19fd,10,"idle",2012-04-04 12:19:46 PDT,,0,LOG,00000,"disconnection: session time: 0:01:13.928 user=breakpad_rw database=breakpad host=10.8.70.208 port=64570",,,,,,,,,""

Comment 3

[Matt Brandt [:mbrandt]]

Jason bumped the timeout for zeus on stage - bug 724061.

Comment 4

[Matt Brandt [:mbrandt]]

Bumping to qa verified - thanks all -
[13:22:34.601] GET https://crash-stats.allizom.org/query/query?product=Firefox&version=ALL%3AALL&range_value=1&range_unit=weeks&date=04%2F04%2F2012+20%3A22%3A26&query_search=signature&query_type=contains&query=&reason=&build_id=&process_type=any&hang_type=any&do_query=1 [HTTP/1.1 200 OK 73588ms]
--
[13:23:47.851] GET https://crash-stats.allizom.org/css/screen.css?v=1.7.6 [HTTP/1.1 304 Not Modified 75ms]
[13:23:47.867] GET https://crash-stats.allizom.org/js/socorro/nav.js?v=1.7.6.js [HTTP/1.1 304 Not Modified 76ms]
[13:23:48.537] GET https://crash-stats.allizom.org/buginfo/bug?id=633253,633253,722083,610551,711568,722083,610551,711568,549676,549676,633253,694874,633253,694874,740315,671468,740315,671468,728193,720956,716900,595351,707038,728193,720956,716900,595351,707038,572011,572011,729368,716232,655561,655562,654903,729368,716232,655561,655562,654903,574996,597260,574996,597260,682067,676240,682067,676240,598769,598769,723894,705159,640904,723894,705159,640904,722101,702531,722101,702531,500105,569688,500105,569688,633253,676458,678018,669033,664826,633253,676458,678018,669033,664826,633253,688992,647400,567936,540094,633253,688992,647400,567936,540094,633253,672144,574084,566062,633253,672144,574084,566062,726425,726425,603070,603070,706097,706097,561019,561019,630197,630197,730703,717909,700176,730703,717909,700176,730703,705423,730703,705423,693872,693872,716386,716386,561019,561019,633253,659924,565708,633253,659924,565708,610103,590078,608351,655500,672766,585660,556483,516182,522070,531551,569498,548002,501429,610103,590078,608351,655500,672766,585660,556483,516182,522070,531551,569498,548002,501429,673543,631008,673543,631008,677082,677082,695029,622411,531961,437449,695029,622411,531961,437449,675260,711847,675260,711847,677082,677082,709860,709860,599354,599354,699781,699781,706784,706784,724392,724391,712447,631782,724392,724391,712447,631782,524944,524944,547344,547344,418384,558925,585975,418384,558925,585975,691355,633253,622955,564298,691355,633253,622955,564298,665394,634892,618683,665394,634892,618683,639337,591513,639337,591513,656758,656758,668167,668167,700493,740330,700493,740330,700288,700288,740962,740962,601587,601587,741179,741179,710559,709479,710559,709479,714100,714100,707078,655565,655527,654877,707078,655565,655527,654877,726425,726425,716384,716384,626767,626767,614966,614966,701130,701130,720754,720754,693872,693872,725836,725836,709570,585942,709570,585942,734948,595375,734948,595375,719114,719114,727624,727624,728533,639405,568487,728533,639405,568487,633253,633253,597262,597262,720679,720679,735682,633253,718383,626900,735682,633253,718383,626900,724803,724802,724617,724803,724802,724617,663466,663466,681014,677551,681014,677551,633985,618685,633985,618685,716386,617045,716386,617045,717882,657573,717882,657573,677082,677082,682573,682573,606423,606423,706040,706040,664764,664764,597344,548248,597344,548248,659985,659985,555319,520554,526483,555319,520554,526483,652591,652591,723466,723466,591620,591620,654903,654903,627238,547588,530074,627238,547588,530074,622951,622951,561264,561264,637596,637596,&include_fields=summary,status,id,resolution [HTTP/1.1 200 OK 322ms]