Closed Bug 480122 Opened 17 years ago Closed 17 years ago

LpSolit's feeds ignored

Categories

(Websites :: planet.mozilla.org, defect)

defect
Not set
normal

Tracking

(Not tracked)

RESOLVED FIXED

People

(Reporter: LpSolit, Assigned: asa)

Details

Attachments

(1 file)

I wrote an article yesterday http://lpsolit.wordpress.com/2009/02/24/do-not-use-mysql-5131-or-newer-with-bugzilla-32-322/ but this one is ignored by planet.m.o despite it's listed in the feed when you click my "Bugzilla" feed in the right column of the page. Is it related to bug 477056 comment 5? Wolf said on IRC that my feeds were added back: http://viewvc.svn.mozilla.org/vc/projects/planet/branches/planet/config.ini?r1=22049&r2=22073 but maybe something is still wrong?
I've been seeing the following error in your feeds: ERROR:planet.runner:Error processing http://lpsolit.wordpress.com/category/bugzilla/feed ERROR:planet.runner:UnicodeEncodeError: 'ascii' codec can't encode character u'\xe9' in position 220: ordinal not in range(128) ERROR:planet.runner: File "/data-local/planet/trunk/planet/spider.py", line 312, in httpThread (resp, content) = h.request(idna, 'GET', headers=headers) ERROR:planet.runner: File "/data-local/planet/trunk/planet/vendor/httplib2/__init__.py", line 874, in request (response, content) = self._request(conn, authority, uri, request_uri, method, body, headers, redirections, cachekey) ERROR:planet.runner: File "/data-local/planet/trunk/planet/vendor/httplib2/__init__.py", line 688, in _request (response, content) = self._conn_request(conn, request_uri, method, body, headers) ERROR:planet.runner: File "/data-local/planet/trunk/planet/vendor/httplib2/__init__.py", line 659, in _conn_request conn.request(method, request_uri, body, headers) ERROR:planet.runner: File "/usr/lib64/python2.4/httplib.py", line 810, in request self._send_request(method, url, body, headers) ERROR:planet.runner: File "/usr/lib64/python2.4/httplib.py", line 833, in _send_request self.endheaders() ERROR:planet.runner: File "/usr/lib64/python2.4/httplib.py", line 804, in endheaders self._send_output() ERROR:planet.runner: File "/usr/lib64/python2.4/httplib.py", line 685, in _send_output self.send(msg) ERROR:planet.runner: File "/usr/lib64/python2.4/httplib.py", line 664, in send self.sock.sendall(str) ERROR:planet.runner: File "<string>", line 1, in sendall ERROR:planet.runner:Error 500 while updating feed http://lpsolit.wordpress.com/category/bugzilla/feed Looks like a character in there it doesn't like.
"'ascii' codec" seems an unlikely choice for a feed that has UTF-8 in both the content-type header and the XML decl. Is it maybe getting a case of the stupids while following the redirect from /category/bugzilla/feed to /category/bugzilla/feed/?
(In reply to comment #1) > Looks like a character in there it doesn't like. Is it the "é" from my first name? It seems I'm the only one on planet to have such a character in my name. In that case, you could write "Frederic" if that makes planet happy.
I think it's the feed itself that it doesn't like.
What changed on planet.m.o recently? My blog exists on planet.m.o for more than a year and a half, and it's the first time it doesn't mention an article I wrote.
\xe9 seems to be "é", a character I don't have in my blog's title. This would *really* help me if we could debug this and get the exact string which causes trouble.
(In reply to comment #2) > while following the redirect from /category/bugzilla/feed to > /category/bugzilla/feed/? raccettura, could you try to add the trailing / to the URL of my feed? Or anyone else with enough privs to add it.
Doesn't look like this helped. Same errors.
(In reply to comment #9) > Doesn't look like this helped. Same errors. Would help if you could tell me which string generates the error. This would give me a chance to modify it.
ERROR:planet.runner:Error processing http://lpsolit.wordpress.com/category/bugzilla/feed/ ERROR:planet.runner:UnicodeEncodeError: 'ascii' codec can't encode character u'\xe9' in position 221: ordinal not in range(128) ERROR:planet.runner: File "/data-local/planet/trunk/planet/spider.py", line 312, in httpThread (resp, content) = h.request(idna, 'GET', headers=headers) ERROR:planet.runner: File "/data-local/planet/trunk/planet/vendor/httplib2/__init__.py", line 874, in request (response, content) = self._request(conn, authority, uri, request_uri, method, body, headers, redirections, cachekey) ERROR:planet.runner: File "/data-local/planet/trunk/planet/vendor/httplib2/__init__.py", line 688, in _request (response, content) = self._conn_request(conn, request_uri, method, body, headers) ERROR:planet.runner: File "/data-local/planet/trunk/planet/vendor/httplib2/__init__.py", line 659, in _conn_request conn.request(method, request_uri, body, headers) ERROR:planet.runner: File "/usr/lib64/python2.4/httplib.py", line 810, in request self._send_request(method, url, body, headers) ERROR:planet.runner: File "/usr/lib64/python2.4/httplib.py", line 833, in _send_request self.endheaders() ERROR:planet.runner: File "/usr/lib64/python2.4/httplib.py", line 804, in endheaders self._send_output() ERROR:planet.runner: File "/usr/lib64/python2.4/httplib.py", line 685, in _send_output self.send(msg) ERROR:planet.runner: File "/usr/lib64/python2.4/httplib.py", line 664, in send self.sock.sendall(str) ERROR:planet.runner: File "<string>", line 1, in sendall ERROR:planet.runner:Error 500 while updating feed http://lpsolit.wordpress.com/category/bugzilla/feed/
(In reply to comment #11) > ERROR:planet.runner:UnicodeEncodeError: 'ascii' codec can't encode character > u'\xe9' in position 221: ordinal not in range(128) Yeah, you already posted this in comment 1, but I have no idea what's the string mentionned above.
Attached file content of my feed —
Comment on attachment 366191 [details] content of my feed Let's make it readable by Firefox.
Attachment #366191 - Attachment mime type: application/xml → text/plain
I installed Planet locally, and my feeds are loaded correctly, both bugzilla/ and mozilla/.
Based on the traceback, the error is not in the feed itself, but in httplib. I've tried to reproduce this with httplib, httplib2 (which calls httplib), and with the latest Venus (which calls httplib2 if spider_threads is greater than one). All work just fine for me. I'm running Python 2.5.2. Based on the traceback, you're running 2.4? Either this is fixed in Python 2.5.2, or the server has changed what it sends back since the problem has been reported, or I'm missing something.
(In reply to comment #12) > (In reply to comment #11) > > ERROR:planet.runner:UnicodeEncodeError: 'ascii' codec can't encode character > > u'\xe9' in position 221: ordinal not in range(128) > > Yeah, you already posted this in comment 1, but I have no idea what's the > string mentionned above. The string mentioned above is an "é".
(In reply to comment #17) > The string mentioned above is an "é". Yes, I know that. But it's a single character. I would like to know the string it belongs to. :) Btw, I also have Python 2.5.2 installed, so maybe should planet.m.o upgrade to 2.5.2 and see if this fixes the problem?
(In reply to comment #18) > Btw, I also have Python 2.5.2 installed, so maybe should planet.m.o upgrade to > 2.5.2 and see if this fixes the problem? That's not possible, as we run RHEL5, which ships Python 2.4.3.
Can you try this on RHEL5? (I'm testing on CentOS 5 which provides /usr/bin/python2.4 and /usr/bin/python2.5, but with python2.4 as the default for "python")... $ cd venus/planet/vendor $ python2.4 Python 2.4.3 (#1, May 24 2008, 13:47:28) [GCC 4.1.2 20070626 (Red Hat 4.1.2-14)] on linux2 Type "help", "copyright", "credits" or "license" for more information. >>> import httplib2 >>> h = httplib2.Http(".cache") >>> resp, content = h.request("http://lpsolit.wordpress.com/category/bugzilla/feed", "GET") >>> resp {'status': '200', 'content-location': 'http://lpsolit.wordpress.com/category/bugzilla/feed/', 'x-nananana': 'Batcache', 'transfer-encoding': 'chunked', 'vary': 'Cookie', 'server': 'nginx', 'last-modified': 'Sun, 08 Mar 2009 19:23:54 +0000', 'connection': 'close', 'etag': '"2c6dcef3efb12c4d63ac48d697f24cfe"', 'cache-control': 'max-age=300, must-revalidate', 'date': 'Sun, 08 Mar 2009 19:23:54 GMT', 'x-hacker': "If you're reading this, you should visit automattic.com/jobs and apply to join the fun, mention this header.", 'content-type': 'application/rss+xml; charset=UTF-8', 'x-pingback': 'http://lpsolit.wordpress.com/xmlrpc.php'} >>> len(content) 103039 >>> content[0:72] '<?xml version="1.0" encoding="UTF-8"?>\n<rss version="2.0"\n\txmlns:content'
# python Python 2.4.3 (#1, Sep 17 2008, 16:07:08) [GCC 4.1.2 20071124 (Red Hat 4.1.2-41)] on linux2 Type "help", "copyright", "credits" or "license" for more information. >>> import httplib2 >>> h = httplib2.Http(".cache") >>> resp, content = h.request("http://lpsolit.wordpress.com/category/bugzilla/feed", "GET") >>> resp {'status': '200', 'content-location': 'http://lpsolit.wordpress.com/category/bugzilla/feed/', 'x-nananana': 'Batcache', 'transfer-encoding': 'chunked', 'vary': 'Cookie', 'server': 'nginx', 'last-modified': 'Mon, 09 Mar 2009 03:18:44 +0000', 'connection': 'close', 'etag': '"2c6dcef3efb12c4d63ac48d697f24cfe"', 'cache-control': 'max-age=300, must-revalidate', 'date': 'Mon, 09 Mar 2009 03:18:44 GMT', 'x-hacker': "If you're reading this, you should visit automattic.com/jobs and apply to join the fun, mention this header.", 'content-type': 'application/rss+xml; charset=UTF-8', 'x-pingback': 'http://lpsolit.wordpress.com/xmlrpc.php'} >>> len(content) 103039 >>> content[0:72] '<?xml version="1.0" encoding="UTF-8"?>\n<rss version="2.0"\n\txmlns:content'
Recap: * Works on my machine, and apparently on Frédéric's * Fails in httplib/httplib2 on p.m.o * httplib/httplib2 work just fine on the same machine The traceback indicates that the failure occurs in self.sock.sendall, which suggests that one of the headers being sent (e.g., If-None-Match) is the problem. Suggestion: inside your config.ini for p.m.o, you identify a cache_directory. Inside that directory, httplib2 creates a directory unimaginatively called 'cache'. Inside that directory, you should find a file named lpsolit.wordpress.com,category,bugzilla,feed,,b7bbbdcf95759db450b9eaa05266896a or some such (you might find another without the ',,' if your config.ini references the version of the URI without the trailing slash). Can you: 1) attach the file that you found to this bugzilla report for later analysis? 2) delete that file from your cache. My theory is that this should allow you to fetch the feed without whatever header was causing the problem.
Here are the cached posts I have for LpSolit: -rw-r--r-- 1 root root 4430 May 27 2007 lpsolit.wordpress.com,2007,05,27,custom_status -rw-r--r-- 1 root root 9620 May 28 2007 lpsolit.wordpress.com,2007,05,28,whats-new-in-bugzilla-32 -rw-r--r-- 1 root root 4395 Jun 5 2007 lpsolit.wordpress.com,2007,06,05,comment-faire-pour-avoir-encore-du-temps-libre-en-travaillant-sur-un-projet-open-source -rw-r--r-- 1 root root 7251 Jun 13 2007 lpsolit.wordpress.com,2007,06,13,is-firefox-for-advanced-users-only -rw-r--r-- 1 root root 6419 Jun 26 2007 lpsolit.wordpress.com,2007,06,26,testopia-13-compatible-avec-bugzilla-30-est-sortie -rw-r--r-- 1 root root 4295 Jul 16 2007 lpsolit.wordpress.com,2007,07,16,almost-100000-downlaods-of-bugzilla-30 -rw-r--r-- 1 root root 5092 Jul 25 2007 lpsolit.wordpress.com,2007,07,25,bugzilla-30-en-version-francaise-est-maintenant-disponible -rw-r--r-- 1 root root 4790 Aug 7 2007 lpsolit.wordpress.com,2007,08,07,tinderstatus-024-lets-you-select-which-tinderboxen-to-watch -rw-r--r-- 1 root root 4663 Aug 8 2007 lpsolit.wordpress.com,2007,08,08,new-skin-new-name-but-which-name -rw-r--r-- 1 root root 5324 Aug 23 2007 lpsolit.wordpress.com,2007,08,23,bugzilla-301-and-311-released -rw-r--r-- 1 root root 5139 Aug 24 2007 lpsolit.wordpress.com,2007,08,24,libgtk-x11-acroread-and-firefox -rw-r--r-- 1 root root 7093 Sep 5 2007 lpsolit.wordpress.com,2007,09,05,removal-of-unnecessary-parameters-in-bugzilla-32 -rw-r--r-- 1 root root 4959 Oct 18 2007 lpsolit.wordpress.com,2007,10,19,who-is-fixing-bugzilla-bugs-these-days -rw-r--r-- 1 root root 7936 Nov 20 2007 lpsolit.wordpress.com,2007,11,20,lastest-news-from-the-bugzilla-world-les-dernieres-nouvelles-du-monde-bugzilla -rw-r--r-- 1 root root 5207 Dec 21 2007 lpsolit.wordpress.com,2007,12,21,bugzilla-32-now-supports-oracle-as-db-server -rw-r--r-- 1 root root 4710 Jan 1 2008 lpsolit.wordpress.com,2008,01,01,bugzilla-won-two-awards-from-software-test-performance -rw-r--r-- 1 root root 1430 Sep 8 12:15 lpsolit.wordpress.com,category,bugzilla,feed,d41d8cd98f00b204e9800998ecf8427e -rw-r--r-- 1 root root 5650 Feb 6 2008 lpsolit.wordpress.com,p=22 -rw-r--r-- 1 root root 7169 Mar 20 2008 lpsolit.wordpress.com,p=23 -rw-r--r-- 1 root root 8808 May 5 2008 lpsolit.wordpress.com,p=24 -rw-r--r-- 1 root root 5849 May 15 2008 lpsolit.wordpress.com,p=25 -rw-r--r-- 1 root root 4694 Jun 11 2008 lpsolit.wordpress.com,p=27 -rw-r--r-- 1 root root 7831 Aug 12 2008 lpsolit.wordpress.com,p=28 -rw-r--r-- 1 root root 6137 Aug 21 2008 lpsolit.wordpress.com,p=30 -rw-r--r-- 1 root root 5270 Sep 5 2008 lpsolit.wordpress.com,p=36 -rw-r--r-- 1 root root 4444 Sep 5 2008 lpsolit.wordpress.com,p=38 -rw-r--r-- 1 root root 6173 Sep 8 13:55 lpsolit.wordpress.com,p=40 -rw-r--r-- 1 root root 5246 Sep 22 13:05 lpsolit.wordpress.com,p=42 -rw-r--r-- 1 root root 4451 Sep 23 09:25 lpsolit.wordpress.com,p=47 -rw-r--r-- 1 root root 10028 Oct 29 11:00 lpsolit.wordpress.com,p=50 -rw-r--r-- 1 root root 7912 Nov 8 06:23 lpsolit.wordpress.com,p=54 -rw-r--r-- 1 root root 4787 Dec 13 14:46 lpsolit.wordpress.com,p=56 -rw-r--r-- 1 root root 5113 Jan 6 10:17 lpsolit.wordpress.com,p=62 -rw-r--r-- 1 root root 4465 Jan 31 07:11 lpsolit.wordpress.com,p=67 -rw-r--r-- 1 root root 4650 Feb 2 17:54 lpsolit.wordpress.com,p=69 -rw-r--r-- 1 root root 6311 Feb 3 08:17 lpsolit.wordpress.com,p=75 Do you mean lpsolit.wordpress.com,category,bugzilla,feed,d41d8cd98f00b204e9800998ecf8427e or some other file?
Is this a WONTFIX? Or are there options we can pursue here?
This is now fixed. My last article was correctly reported by planet.m.o.
Status: NEW → RESOLVED
Closed: 17 years ago
Resolution: --- → FIXED
You need to log in before you can comment on or make changes to this bug.

Attachment

General

Created:
Updated:
Size: