Closed Bug 1343618 Opened 8 years ago Closed 8 years ago

500 errors when trying to push to mozreview

Categories

(MozReview Graveyard :: Integration: Mercurial, defect)

Product:
MozReview Graveyard
Component:
Integration: Mercurial
Type:
defect
Priority:
Not set
Severity:
normal

Tracking

(Not tracked)

Status:
RESOLVED DUPLICATE of bug 1338530

People

(Reporter: bsilverberg, Assigned: glob)

References

Details

Today I experienced a couple of 500 errors when trying to push commits to mozreview. One occurred around 12:20pm Eastern time and the other a couple of hours before that. In both cases the output I saw in the terminal was: pushing to https://reviewboard-hg.mozilla.org/autoreview searching for appropriate review repository redirecting push to https://reviewboard-hg.mozilla.org/gecko searching for changes abort: HTTP Error 500: Internal Server Error
Is there more output if you append --debug to the command line when you push to mozreview? If yes, please provide it.
Flags: needinfo?(bob.silverberg)
See Also: → 1343517
I've only seen the message twice today, but I do recall seeing it on and off over the past few days. I will do my pushed with --debug from now on and if I encounter another one I'll add the details to this bug.
Flags: needinfo?(bob.silverberg)
Assignee: nobody → glob
(In reply to Bob Silverberg [:bsilverberg] from comment #0) > One occurred around 12:20pm Eastern time and the other a couple > of hours before that. note to self: 2017-03-01 17:20:00 UTC
like bug 1343627 there's no errors on reviewboard at that time: 2017-03-01 17:21:49,990 - INFO - - processing batch submission bz://1341277/bsilverberg to gecko with 3 commits 2017-03-01 17:21:49,994 - INFO - - using squashed review request 114940 2017-03-01 17:21:49,994 - INFO - - bz://1341277/bsilverberg: generating squashed diffset for 114940 2017-03-01 17:21:50,125 - INFO - - bz://1341277/bsilverberg: updated squashed diffset for 114940 2017-03-01 17:21:50,127 - INFO - - bz://1341277/bsilverberg: 3 previous commits; 0 discard on publish; 0 unpublished 2017-03-01 17:21:50,127 - INFO - - bz://1341277/bsilverberg: 0/3 commits mapped exactly 2017-03-01 17:21:50,128 - INFO - - bz://1341277/bsilverberg: found precursor to commit f67fe3d6289d5c41311c7e4ee94c9d0e43434ea7; using existing review request 114942 2017-03-01 17:21:51,265 - INFO - - importing Bugzilla users from query "aswan": .. 2017-03-01 17:21:51,955 - INFO - - bz://1341277/bsilverberg: found precursor to commit 69a6833262c9621279794abe52a06077d8c16f92; using existing review request 114944 2017-03-01 17:21:52,087 - INFO - - bz://1341277/bsilverberg: found precursor to commit 8bc91a71580115e2ea240385bfbd005dbe4e8baf; using existing review request 114946 2017-03-01 17:21:52,229 - INFO - - bz://1341277/bsilverberg: 3/3 mapped exactly or to precursors 2017-03-01 17:21:52,229 - INFO - - bz://1341277/bsilverberg: 3/3 mapped after commit ID matching 2017-03-01 17:21:52,229 - INFO - - bz://1341277/bsilverberg: 0 unclaimed review requests 2017-03-01 17:21:52,230 - INFO - - bz://1341277/bsilverberg: 0 unclaimed review requests left over 2017-03-01 17:21:52,278 - INFO - - bz://1341277/bsilverberg: finished processing 114940 i looked around reviewboard-hg for errors, and there's only one around that time: Mar 1 17:20:01 reviewboard-hg2 nslcd[3300]: [068571] <group/member="root"> ldap_result() failed: Can't contact LDAP server i don't think that's related; it doesn't perfect align with the time, i would expect it to have bubbled up in the httpd logs, and that error isn't rare at all. hopefully --debug shines some light on what's going on.
It just happened again at 09:35 Eastern time. Here's the output with --debug: (privacy)mozilla-central$ hg push review --debug automatically setting Bugzilla API Key auth https://reviewboard-hg.mozilla.org pushing to https://reviewboard-hg.mozilla.org/autoreview using https://reviewboard-hg.mozilla.org/autoreview sending capabilities command using auth.autobmoapikey0.* for authentication using /usr/local/Cellar/mercurial/3.8.3/lib/python2.7/site-packages/mercurial/dummycert.pem to enable OS X system CA reviewboard-hg.mozilla.org certificate successfully verified searching for appropriate review repository sending listreviewrepos command using auth.autobmoapikey0.* for authentication redirecting push to https://reviewboard-hg.mozilla.org/gecko sending capabilities command using auth.autobmoapikey0.* for authentication capabilities: streamreqs=generaldelta,revlogv1 changegroupsubset bundle2=HG20%0Achangegroup%3D01%2C02%0Adigests%3Dmd5%2Csha1%2Csha512%0Aerror%3Dabort%2Cunsupportedcontent%2Cpushraced%2Cpushkey%0Ahgtagsfnodes%0Alistkeys%0Apushkey%0Aremote-changegroup%3Dhttp%2Chttps unbundlehash pullreviews batch mozreviewrequires=bzapikeys,commitid,jsonproto,listreviewdata,listreviewrepos,proto1 httpheader=1024 lookup pushlog pushkey known unbundle=HG10GZ,HG10BZ,HG10UN branchmap getbundle mozreview=publish,publishhttp,pullreviews,pushreview,submithttp reviewboard query 1; heads sending batch command using auth.autobmoapikey0.* for authentication searching for changes taking initial sample query 2; still undecided: 1574, sample size is: 200 sending known command using auth.autobmoapikey0.* for authentication sampling from both directions query 3; still undecided: 1, sample size is: 1 sending known command using auth.autobmoapikey0.* for authentication 3 total queries preparing listkeys for "phases" sending listkeys command using auth.autobmoapikey0.* for authentication received listkey for "phases": 1565199 bytes preparing listkeys for "namespaces" sending listkeys command using auth.autobmoapikey0.* for authentication received listkey for "namespaces": 37 bytes checking for updated bookmarks preparing listkeys for "bookmarks" sending listkeys command using auth.autobmoapikey0.* for authentication received listkey for "bookmarks": 4144 bytes 3 changesets found list of changesets: 8549f49de3789c30df623222c5d7b2b8dfefd87b a22beccc19d143c8fc28dc0b7fa6e02e2b1b85c7 4c2911672388a5ae5ab80cde72357b4fe0b32692 bundle2-output-bundle: "HG20", 2 parts total bundle2-output-part: "replycaps" 172 bytes payload bundle2-output-part: "changegroup" (params: 1 mandatory) streamed payload sending unbundle command sending 37108 bytes using auth.autobmoapikey0.* for authentication using auth.autobmoapikey0.* for authentication http auth: user bob.silverberg@gmail.com, password **************************************** using auth.autobmoapikey0.* for authentication reviewboard-hg.mozilla.org certificate successfully verified abort: HTTP Error 500: Internal Server Error
Here's another one that happened at 12:12 Eastern time: (adc63f0)mozilla-central$ hg push review --debug automatically setting Bugzilla API Key auth https://reviewboard-hg.mozilla.org pushing to https://reviewboard-hg.mozilla.org/autoreview using https://reviewboard-hg.mozilla.org/autoreview sending capabilities command using auth.autobmoapikey0.* for authentication using /usr/local/Cellar/mercurial/3.8.3/lib/python2.7/site-packages/mercurial/dummycert.pem to enable OS X system CA reviewboard-hg.mozilla.org certificate successfully verified searching for appropriate review repository sending listreviewrepos command using auth.autobmoapikey0.* for authentication redirecting push to https://reviewboard-hg.mozilla.org/gecko sending capabilities command using auth.autobmoapikey0.* for authentication capabilities: streamreqs=generaldelta,revlogv1 changegroupsubset bundle2=HG20%0Achangegroup%3D01%2C02%0Adigests%3Dmd5%2Csha1%2Csha512%0Aerror%3Dabort%2Cunsupportedcontent%2Cpushraced%2Cpushkey%0Ahgtagsfnodes%0Alistkeys%0Apushkey%0Aremote-changegroup%3Dhttp%2Chttps unbundlehash pullreviews batch mozreviewrequires=bzapikeys,commitid,jsonproto,listreviewdata,listreviewrepos,proto1 httpheader=1024 lookup pushlog pushkey known unbundle=HG10GZ,HG10BZ,HG10UN branchmap getbundle mozreview=publish,publishhttp,pullreviews,pushreview,submithttp reviewboard query 1; heads sending batch command using auth.autobmoapikey0.* for authentication searching for changes taking initial sample query 2; still undecided: 1574, sample size is: 200 sending known command using auth.autobmoapikey0.* for authentication sampling from both directions query 3; still undecided: 1, sample size is: 1 sending known command using auth.autobmoapikey0.* for authentication 3 total queries preparing listkeys for "phases" sending listkeys command using auth.autobmoapikey0.* for authentication received listkey for "phases": 1565844 bytes preparing listkeys for "namespaces" sending listkeys command using auth.autobmoapikey0.* for authentication received listkey for "namespaces": 37 bytes checking for updated bookmarks preparing listkeys for "bookmarks" sending listkeys command using auth.autobmoapikey0.* for authentication received listkey for "bookmarks": 4144 bytes 3 changesets found list of changesets: e01b100a8b584d94848b73c8c5b2145fb40dc471 abb391e6fa06972c50e9788f0896891fb43d9dd7 adc63f0385cc88fa4c482ac84cb9f47ef12216c3 bundle2-output-bundle: "HG20", 2 parts total bundle2-output-part: "replycaps" 172 bytes payload bundle2-output-part: "changegroup" (params: 1 mandatory) streamed payload sending unbundle command sending 37500 bytes using auth.autobmoapikey0.* for authentication using auth.autobmoapikey0.* for authentication http auth: user bob.silverberg@gmail.com, password **************************************** using auth.autobmoapikey0.* for authentication reviewboard-hg.mozilla.org certificate successfully verified abort: HTTP Error 500: Internal Server Error
I just received a 500 error again, at 09:30 Eastern time, but unfortunately I forgot to add --debug this time when I pushed, so I don't have any useful debug output to add for this one. When I pushed immediately afterward it worked fine (i.e., no 500 error).
It just failed again at 09:35: (bookmarks-recent-bug)mozilla-central$ hg push review --debug automatically setting Bugzilla API Key auth https://reviewboard-hg.mozilla.org pushing to https://reviewboard-hg.mozilla.org/autoreview using https://reviewboard-hg.mozilla.org/autoreview sending capabilities command using auth.autobmoapikey0.* for authentication using /usr/local/Cellar/mercurial/3.8.3/lib/python2.7/site-packages/mercurial/dummycert.pem to enable OS X system CA reviewboard-hg.mozilla.org certificate successfully verified searching for appropriate review repository sending listreviewrepos command using auth.autobmoapikey0.* for authentication redirecting push to https://reviewboard-hg.mozilla.org/gecko sending capabilities command using auth.autobmoapikey0.* for authentication capabilities: streamreqs=generaldelta,revlogv1 changegroupsubset bundle2=HG20%0Achangegroup%3D01%2C02%0Adigests%3Dmd5%2Csha1%2Csha512%0Aerror%3Dabort%2Cunsupportedcontent%2Cpushraced%2Cpushkey%0Ahgtagsfnodes%0Alistkeys%0Apushkey%0Aremote-changegroup%3Dhttp%2Chttps unbundlehash pullreviews batch mozreviewrequires=bzapikeys,commitid,jsonproto,listreviewdata,listreviewrepos,proto1 httpheader=1024 lookup pushlog pushkey known unbundle=HG10GZ,HG10BZ,HG10UN branchmap getbundle mozreview=publish,publishhttp,pullreviews,pushreview,submithttp reviewboard query 1; heads sending batch command using auth.autobmoapikey0.* for authentication searching for changes taking initial sample query 2; still undecided: 514, sample size is: 200 sending known command using auth.autobmoapikey0.* for authentication 2 total queries preparing listkeys for "phases" sending listkeys command using auth.autobmoapikey0.* for authentication received listkey for "phases": 1579346 bytes preparing listkeys for "namespaces" sending listkeys command using auth.autobmoapikey0.* for authentication received listkey for "namespaces": 37 bytes checking for updated bookmarks preparing listkeys for "bookmarks" sending listkeys command using auth.autobmoapikey0.* for authentication received listkey for "bookmarks": 4144 bytes 1 changesets found list of changesets: 2f104a903ee100d8382736ec18944466bd6a6337 bundle2-output-bundle: "HG20", 2 parts total bundle2-output-part: "replycaps" 172 bytes payload bundle2-output-part: "changegroup" (params: 1 mandatory) streamed payload sending unbundle command sending 35965 bytes using auth.autobmoapikey0.* for authentication using auth.autobmoapikey0.* for authentication http auth: user bob.silverberg@gmail.com, password **************************************** using auth.autobmoapikey0.* for authentication reviewboard-hg.mozilla.org certificate successfully verified abort: HTTP Error 500: Internal Server Error Note that there was an approximately 8-10 second delay between seeing the "reviewboard-hg.mozilla.org certificate successfully verified" message in the terminal and receiving the 500 error, in case that's relevant.
yup - looks like reviewboard-hg2 is throwing the 500, tracking in bug 1338530.
Status: NEW → RESOLVED
Closed: 8 years ago
Resolution: --- → DUPLICATE
You need to log in before you can comment on or make changes to this bug.