599429 - Revert region 8 patch on Socorro collectors

Status: RESOLVED FIXED

(Infrastructure & Operations Graveyard :: WebOps: Other, task)

Description

[Laura Thomson :laura]

We believe the region problem is solved.  

Procedure here is as follows:
1. Check collector and processor logs for absence of errors
2. Revert the patch from bug 599374
3. Check collector and processor logs for continued absence of errors

Comment 1

[Justin Dow [:jabba]]

After reverting the patch, from /tmp/collector.log :
#
2010-09-24 11:47:34,225 INFO - connecting to hbase
#
2010-09-24 11:47:35,037 INFO - mod-python subinterpreter name: crash-reports.mozilla.com
#
2010-09-24 11:47:35,037 INFO - mod-python subinterpreter name: crash-reports.mozilla.com
#
2010-09-24 11:47:35,037 ERROR - MainThread Caught Error: exceptions.IOError
#
2010-09-24 11:47:35,037 ERROR - MainThread Caught Error: exceptions.IOError
#
2010-09-24 11:47:35,037 ERROR - Client read error (Timeout?)
#
2010-09-24 11:47:35,037 ERROR - Client read error (Timeout?)
#
2010-09-24 11:47:35,038 ERROR - trace back follows:
#
  File "/data/www/crash-reports.mozilla.com/application/collector.py", line 40, in handler
#
    theform = util.FieldStorage(req)
#
  File "/usr/lib64/python2.4/site-packages/mod_python/util.py", line 221, in __init__
#
    end_of_stream = self.read_to_boundary(req, boundary, file)
#
  File "/usr/lib64/python2.4/site-packages/mod_python/util.py", line 238, in read_to_boundary
#
    line = req.readline(readBlockSize)
#
 
#
2010-09-24 11:47:35,038 ERROR - trace back follows:
#
  File "/data/www/crash-reports.mozilla.com/application/collector.py", line 40, in handler
#
    theform = util.FieldStorage(req)
#
  File "/usr/lib64/python2.4/site-packages/mod_python/util.py", line 147, in __init__
#
    self.read_to_boundary(req, boundary, None)
#
  File "/usr/lib64/python2.4/site-packages/mod_python/util.py", line 238, in read_to_boundary
#
    line = req.readline(readBlockSize)
#
 
#
2010-09-24 11:47:36,518 INFO - mod-python subinterpreter name: crash-reports.mozilla.com
#
2010-09-24 11:47:36,518 ERROR - MainThread Caught Error: exceptions.IOError
#
2010-09-24 11:47:36,518 ERROR - Client read error (Timeout?)
#
2010-09-24 11:47:36,518 ERROR - trace back follows:
#
  File "/data/www/crash-reports.mozilla.com/application/collector.py", line 40, in handler
#
    theform = util.FieldStorage(req)
#
  File "/usr/lib64/python2.4/site-packages/mod_python/util.py", line 147, in __init__
#
    self.read_to_boundary(req, boundary, None)
#
  File "/usr/lib64/python2.4/site-packages/mod_python/util.py", line 238, in read_to_boundary
#
    line = req.readline(readBlockSize)

Comment 2

[Justin Dow [:jabba]]

2010-09-24 11:51:27,361 INFO - mod-python subinterpreter name: crash-reports.mozilla.com
2010-09-24 11:51:27,362 ERROR - MainThread Caught Error: exceptions.IOError
2010-09-24 11:51:27,362 ERROR - Client read error (Timeout?)
2010-09-24 11:51:27,362 ERROR - trace back follows:
  File "/data/www/crash-reports.mozilla.com/application/collector.py", line 40, in handler
    theform = util.FieldStorage(req)
  File "/usr/lib64/python2.4/site-packages/mod_python/util.py", line 221, in __init__
    end_of_stream = self.read_to_boundary(req, boundary, file)
  File "/usr/lib64/python2.4/site-packages/mod_python/util.py", line 238, in read_to_boundary
    line = req.readline(readBlockSize)

Comment 3

[Justin Dow [:jabba]]

This is done. The same errors were seen before and after the patch, so not related to the patch.