413734 - planet.m.o is not updating

Status: RESOLVED FIXED

(Websites :: planet.mozilla.org, defect)

Description

[Reed Loden [:reed]]

For some reason, planet.m.o is not updating...
Last update: January 23, 2008 10:32 AM UTC

I'm supposed to get cron mail for it, but I haven't received anything. Any errors? I know .nl had a stuck rsync that was causing planet in .nl to be old, but this is the main version of planet.

Comment 1

[Dave Miller [:justdave]]

setting this to blocker just to test nagios

Comment 2

[Dave Miller [:justdave]]

after all our debugging turns out we were barking up the wrong tree.  cron apparently didn't get restarted correctly yesterday morning after /data got moved, so none of the cron jobs on mradm02 have been running.  Planet is now running fine on the local build directory, however it still dies with an I/O Error when running it directly on the netapp partition.

Dropping severity since there's a workaround in place to keep the site working, but leaving it open until we figure out the locking issue.  What it's dying with when running it on the netapp partition is:

htmltmpl.TemplateError: Htmltmpl error: IO error in load precompiled template '/data/static/www/planet.mozilla.org/venus/themes/mozilla/index.html.tmplc': (37) No locks available

Comment 3

[Dave Miller [:justdave]]

ok, doing some poking around on Google, what I've found seems to indicate that this error happens when you attempt to acquire a BSD-style lock on an NFS-mounted file.  NFS version 3 only support POSIX-style locks.  Most known linux filesystems also support POSIX-style locks, so any well-behaved cross-platform program should only be using those.

So moving this back to the Planet component since the remaining problem appears to be an application issue.

Comment 4

[Reed Loden [:reed]]

Sam, check comment #2 and comment #3, please. Ideas?

Comment 5

[Sam Ruby]

It looks like htmltmpl doesn't like NFS.  That would imply that the options are to fix htmltmpl, or to stop using either htmltmpl or NFS.

Venus supports multiple template languages: htmltmpl, django, xslt, and genshi:

http://www.intertwingly.net/code/venus/docs/templates.html

Would one of these other languages be suitable?

Comment 6

[Sam Ruby]

I take it that the following is the template in question?

http://viewvc.svn.mozilla.org/vc/projects/planet/branches/venus/venus/themes/mozilla/index.html.tmpl

Comment 7

[Reed Loden [:reed]]

(In reply to comment #6)
> I take it that the following is the template in question?
> 
> http://viewvc.svn.mozilla.org/vc/projects/planet/branches/venus/venus/themes/mozilla/index.html.tmpl

That is correct.

As a side note, is there a way to get the times to be PST/PDT instead of UTC (to coincide with ZST ('Zilla Standard Time)?

Comment 8

[Sam Ruby]

Sometime either tonight or before the weekend is over I'll take a stab at converting that template to xslt.  Based on the results, you can decide if you want to go with that, or if you want to explore other options.

On my planet, I do a little JavaScript magic to convert dates to the localtime of the viewer.  This code is in themes/asf/personalize.js.  It doesn't work for all localizations, nor for all browsers, but it does work for US timezones and Gecko based browsers (natch).

I see you also continue to produce RSS 1.0 and RSS 2.0 using htmltmpl.  I'll probably leave those as an exercise for the student.  If you scan the web, you can find XSLT code that converts iso-8601 formatted dates into rfc 2822.  But as it is 2008, you really should be asking yourselves why you really need to produce three different feed formats for the same data.  If you really are worried about unmaintained clients, consider outsourcing the conversion to feedburner.

Comment 9

[Asa Dotzler [:asa]]

We should absolutely drop the two RSS feed formats. One is plenty. 

Comment 10

[Robert Accettura [:raccettura]]

(In reply to comment #0)

> I'm supposed to get cron mail for it, but I haven't received anything.

Speaking of which, I haven't seen any cron mail in a few weeks now.

Comment 11

[Sam Ruby]

Converted template available here:

http://intertwingly.net/stories/2008/01/25/index.html.xslt

Background: http://intertwingly.net/blog/2008/01/25/Resurrecting-Planet-Mozilla

Interesting question: what mime type should this content be served as?  You can experiment with the http://www.w3.org/TR/xslt#section-HTML-Output-Method, or you can try serving it as application/xhtml+xml and show off features such as SVG.

Comment 12

[Reed Loden [:reed]]

r50834 -- thanks Sam!