Closed Bug 959743 Opened 10 years ago Closed 10 years ago

unicode errors on bm81

Categories

(Release Engineering :: General, defect)

x86_64
Linux
defect
Not set
critical

Tracking

(Not tracked)

RESOLVED DUPLICATE of bug 929825

People

(Reporter: bhearsum, Unassigned)

References

Details

14:30 <@catlee> bhearsum|buildduty: I think the exceptions in build_scheduler about unicode decode error are important
14:31 < bhearsum|buildduty> that's been happening for weeks
14:31 <@catlee> it means we're missing some sendchanges


The following exceptions (total 3) were detected on buildbot-master81.srv.releng.scl3.mozilla.com bm81-build_scheduler:

Exception in /builds/buildbot/build_scheduler/master/twistd.log:
2014-01-14 10:34:07-0800 [Broker,147469,10.132.54.177] Unhandled Error
        Traceback (most recent call last):
          File "/builds/buildbot/build_scheduler/lib/python2.7/site-packages/twisted/spread/banana.py", line 153, in gotItem
            self.callExpressionReceived(item)
          File "/builds/buildbot/build_scheduler/lib/python2.7/site-packages/twisted/spread/banana.py", line 116, in callExpressionReceived
            self.expressionReceived(obj)
          File "/builds/buildbot/build_scheduler/lib/python2.7/site-packages/twisted/spread/pb.py", line 514, in expressionReceived
            method(*sexp[1:])
          File "/builds/buildbot/build_scheduler/lib/python2.7/site-packages/twisted/spread/pb.py", line 826, in proto_message
            self._recvMessage(self.localObjectForID, requestID, objectID, message, answerRequired, netArgs, netKw)
        --- <exception caught here> ---
          File "/builds/buildbot/build_scheduler/lib/python2.7/site-packages/twisted/spread/pb.py", line 840, in _recvMessage
            netResult = object.remoteMessageReceived(self, message, netArgs, netKw)
          File "/builds/buildbot/build_scheduler/lib/python2.7/site-packages/twisted/spread/pb.py", line 225, in perspectiveMessageReceived
            state = method(*args, **kw)
          File "/builds/buildbot/build_scheduler/lib/python2.7/site-packages/buildbot-0.8.2_hg_439635fc714e_production_0.8-py2.7.egg/buildbot/changes/pb.py", line 43, in perspective_addChange
+           self.changemaster.addChange(change)
          File "/builds/buildbot/build_scheduler/lib/python2.7/site-packages/buildbot-0.8.2_hg_439635fc714e_production_0.8-py2.7.egg/buildbot/changes/manager.py", line 108, in addChange
            change.comments, change.category, change.project))
+       exceptions.UnicodeDecodeError: 'ascii' codec can't decode byte 0xc3 in position 157: ordinal not in range(128)
I'm having trouble associating this with a commit message or username -- Buildbot doesn't dump enough information to match it up to one...I looked over all the mozilla-central (and related) repositories and couldn't find anything. This is probably an l10n change?
More log stuff:
44651 2014-01-14 10:34:07-0800 [-] Starting factory <HTTPClientFactory: http://hg.mozilla.org/releases/l10n/mozilla-aurora/sv-SE/json-pushes?full=1&fromchange=6ddbe3fa327      5e4b1a1047384e9e85507e766c05a>
44652 2014-01-14 10:34:07-0800 [HTTPPageGetter,client] Stopping factory <HTTPClientFactory: http://hg.mozilla.org/releases/l10n/mozilla-aurora/st/json-pushes?full=1&fromc      hange=e46e6939397515d74c80bd489ee1ef2491dc11d7>
44653 2014-01-14 10:34:07-0800 [Broker,147469,10.132.54.177] perspective_addChange called
44654 2014-01-14 10:34:07-0800 [Broker,147469,10.132.54.177] Peer will receive following PB traceback:
44655 2014-01-14 10:34:07-0800 [Broker,147469,10.132.54.177] Unhandled Error
44656     Traceback (most recent call last):
44657       File "/builds/buildbot/build_scheduler/lib/python2.7/site-packages/twisted/spread/banana.py", line 153, in gotItem
44658         self.callExpressionReceived(item)
44659       File "/builds/buildbot/build_scheduler/lib/python2.7/site-packages/twisted/spread/banana.py", line 116, in callExpressionReceived
44660         self.expressionReceived(obj)
44661       File "/builds/buildbot/build_scheduler/lib/python2.7/site-packages/twisted/spread/pb.py", line 514, in expressionReceived
44662         method(*sexp[1:])
44663       File "/builds/buildbot/build_scheduler/lib/python2.7/site-packages/twisted/spread/pb.py", line 826, in proto_message
44664         self._recvMessage(self.localObjectForID, requestID, objectID, message, answerRequired, netArgs, netKw)
44665     --- <exception caught here> ---
44666       File "/builds/buildbot/build_scheduler/lib/python2.7/site-packages/twisted/spread/pb.py", line 840, in _recvMessage
44667         netResult = object.remoteMessageReceived(self, message, netArgs, netKw)
44668       File "/builds/buildbot/build_scheduler/lib/python2.7/site-packages/twisted/spread/pb.py", line 225, in perspectiveMessageReceived
44669         state = method(*args, **kw)
44670       File "/builds/buildbot/build_scheduler/lib/python2.7/site-packages/buildbot-0.8.2_hg_439635fc714e_production_0.8-py2.7.egg/buildbot/changes/pb.py", line 43, i      n perspective_addChange
44671         self.changemaster.addChange(change)
44672       File "/builds/buildbot/build_scheduler/lib/python2.7/site-packages/buildbot-0.8.2_hg_439635fc714e_production_0.8-py2.7.egg/buildbot/changes/manager.py", line       108, in addChange
44673         change.comments, change.category, change.project))
44674     exceptions.UnicodeDecodeError: 'ascii' codec can't decode byte 0xc3 in position 157: ordinal not in range(128)
44675 
44676 2014-01-14 10:34:08-0800 [-] Starting factory <HTTPClientFactory: http://hg.mozilla.org/releases/l10n/mozilla-aurora/sw/json-pushes?full=1&fromchange=c41eacd77c0748      d99cd9dc1aa55598b4a853bab7>
44677 2014-01-14 10:34:08-0800 [HTTPPageGetter,client] Stopping factory <HTTPClientFactory: http://hg.mozilla.org/releases/l10n/mozilla-aurora/sv-SE/json-pushes?full=1&fr      omchange=6ddbe3fa3275e4b1a1047384e9e85507e766c05a>



The fact that this occurs after the sv-SE factory starts but before it ends makes me think it's a change from that repo. But that repo hasn't had any changes since Jan 3.
We've also got some that aren't near polling, which suggests they may not be from l10n:
46635 2014-01-14 10:40:31-0800 [Broker,147516,10.132.54.232] perspective_addChange called
46636 2014-01-14 10:40:31-0800 [Broker,147516,10.132.54.232] Peer will receive following PB traceback:
46637 2014-01-14 10:40:31-0800 [Broker,147516,10.132.54.232] Unhandled Error
46638     Traceback (most recent call last):
46639       File "/builds/buildbot/build_scheduler/lib/python2.7/site-packages/twisted/spread/banana.py", line 153, in gotItem
46640         self.callExpressionReceived(item)
46641       File "/builds/buildbot/build_scheduler/lib/python2.7/site-packages/twisted/spread/banana.py", line 116, in callExpressionReceived
46642         self.expressionReceived(obj)
46643       File "/builds/buildbot/build_scheduler/lib/python2.7/site-packages/twisted/spread/pb.py", line 514, in expressionReceived
46644         method(*sexp[1:])
46645       File "/builds/buildbot/build_scheduler/lib/python2.7/site-packages/twisted/spread/pb.py", line 826, in proto_message
46646         self._recvMessage(self.localObjectForID, requestID, objectID, message, answerRequired, netArgs, netKw)
46647     --- <exception caught here> ---
46648       File "/builds/buildbot/build_scheduler/lib/python2.7/site-packages/twisted/spread/pb.py", line 840, in _recvMessage
46649         netResult = object.remoteMessageReceived(self, message, netArgs, netKw)
46650       File "/builds/buildbot/build_scheduler/lib/python2.7/site-packages/twisted/spread/pb.py", line 225, in perspectiveMessageReceived
46651         state = method(*args, **kw)
46652       File "/builds/buildbot/build_scheduler/lib/python2.7/site-packages/buildbot-0.8.2_hg_439635fc714e_production_0.8-py2.7.egg/buildbot/changes/pb.py", line 43, i      n perspective_addChange
46653         self.changemaster.addChange(change)
46654       File "/builds/buildbot/build_scheduler/lib/python2.7/site-packages/buildbot-0.8.2_hg_439635fc714e_production_0.8-py2.7.egg/buildbot/changes/manager.py", line       108, in addChange
46655         change.comments, change.category, change.project))
46656     exceptions.UnicodeDecodeError: 'ascii' codec can't decode byte 0xc3 in position 157: ordinal not in range(128)
46657 


All of the ones in the logs we have are:
master/twistd.log.1:	exceptions.UnicodeDecodeError: 'ascii' codec can't decode byte 0xef in position 304: ordinal not in range(128)
master/twistd.log.1:	exceptions.UnicodeDecodeError: 'ascii' codec can't decode byte 0xef in position 304: ordinal not in range(128)
master/twistd.log.1:	exceptions.UnicodeDecodeError: 'ascii' codec can't decode byte 0xef in position 304: ordinal not in range(128)
master/twistd.log.1:	exceptions.UnicodeDecodeError: 'ascii' codec can't decode byte 0xc3 in position 157: ordinal not in range(128)
master/twistd.log.1:	exceptions.UnicodeDecodeError: 'ascii' codec can't decode byte 0xc3 in position 157: ordinal not in range(128)
master/twistd.log.1:	exceptions.UnicodeDecodeError: 'ascii' codec can't decode byte 0xc3 in position 157: ordinal not in range(128)
master/twistd.log.1:	exceptions.UnicodeDecodeError: 'ascii' codec can't decode byte 0xc3 in position 157: ordinal not in range(128)
master/twistd.log.10:	exceptions.UnicodeDecodeError: 'ascii' codec can't decode byte 0xc3 in position 149: ordinal not in range(128)
master/twistd.log.10:	exceptions.UnicodeDecodeError: 'ascii' codec can't decode byte 0xc3 in position 149: ordinal not in range(128)
master/twistd.log.2:	exceptions.UnicodeDecodeError: 'ascii' codec can't decode byte 0xef in position 304: ordinal not in range(128)
master/twistd.log.3:	exceptions.UnicodeDecodeError: 'ascii' codec can't decode byte 0xc3 in position 409: ordinal not in range(128)
master/twistd.log.3:	exceptions.UnicodeDecodeError: 'ascii' codec can't decode byte 0xc3 in position 409: ordinal not in range(128)
master/twistd.log.4:	exceptions.UnicodeDecodeError: 'ascii' codec can't decode byte 0xc3 in position 409: ordinal not in range(128)
master/twistd.log.4:	exceptions.UnicodeDecodeError: 'ascii' codec can't decode byte 0xc3 in position 409: ordinal not in range(128)
master/twistd.log.8:	exceptions.UnicodeDecodeError: 'ascii' codec can't decode byte 0xc3 in position 157: ordinal not in range(128)
master/twistd.log.8:	exceptions.UnicodeDecodeError: 'ascii' codec can't decode byte 0xc3 in position 157: ordinal not in range(128)
master/twistd.log.8:	exceptions.UnicodeDecodeError: 'ascii' codec can't decode byte 0xc3 in position 157: ordinal not in range(128)
master/twistd.log.8:	exceptions.UnicodeDecodeError: 'ascii' codec can't decode byte 0xc3 in position 157: ordinal not in range(128)
master/twistd.log.8:	exceptions.UnicodeDecodeError: 'ascii' codec can't decode byte 0xc3 in position 157: ordinal not in range(128)
master/twistd.log.8:	exceptions.UnicodeDecodeError: 'ascii' codec can't decode byte 0xc3 in position 157: ordinal not in range(128)
master/twistd.log.8:	exceptions.UnicodeDecodeError: 'ascii' codec can't decode byte 0xc3 in position 157: ordinal not in range(128)
master/twistd.log.9:	exceptions.UnicodeDecodeError: 'ascii' codec can't decode byte 0xc3 in position 149: ordinal not in range(128)
master/twistd.log.9:	exceptions.UnicodeDecodeError: 'ascii' codec can't decode byte 0xc3 in position 149: ordinal not in range(128)
master/twistd.log.9:	exceptions.UnicodeDecodeError: 'ascii' codec can't decode byte 0xc3 in position 157: ordinal not in range(128)


Note that the positions are very similar - 149, 157, 304, 409. This makes me think there's some usernames with unicode in them or something...
We fixed some causes of this way back in bug 704257. Maybe we need more of that in other parts of buildbot or buildbotcustom code?
Related to bug 929825 ?
Probably a symptom of that bug!
Status: NEW → RESOLVED
Closed: 10 years ago
Resolution: --- → DUPLICATE
Component: General Automation → General
You need to log in before you can comment on or make changes to this bug.