702084 - Fix up Jenkins tests for AUSv2

Status: RESOLVED WONTFIX

(Developer Services :: General, task, P1)

Description

[Nick Thomas [:nthomas] (UTC+12)]

Attachment: Local change on jenkins

rhelmer, rail and I were looking at jenkins over the weekend and noticed it wasn't polling CVS for changes. So I configured it to look, and accidentally blew away this local change to tests/Verify.txt. Looks like it's needed to run the fitnesse tests without a timeout.

Should we land this or did you want to change the setup on the new Jenkins to make the settings in CVS valid ?

Comment 1

[Robert Helmer [:rhelmer]]

Comment on attachment 574125 [details] [diff] [review]
Local change on jenkins

Yes this is fallout from the move to the new Jenkins server that I hadn't followed up on yet (I had patched it manually just to test). This looks exactly like what I was thinking of :) Thanks for following up.

Fitnesse can be a real pain to get going, hopefully it will just work when this is checked in.

Comment 2

[Nick Thomas [:nthomas] (UTC+12)]

Woo, I'd fished the diff out of the workspace.

Checking in Verify.txt;
/cvsroot/mozilla/webtools/aus/tests/Verify.txt,v  <--  Verify.txt
new revision: 1.25; previous revision: 1.24
done

Poller picked up the change, which ran green:
  https://hudson.mozilla.org/job/AUSv2/167/

Comment 3

[Nick Thomas [:nthomas] (UTC+12)]

rhelmer noticed the result was
 'AusTests, 316 pages: 0 wrong, 316 ignored or with exceptions'

So that's not really green then is it Jenkins!

Comment 4

[Nick Thomas [:nthomas] (UTC+12)]

It boils down to python traceback ending in
  File "/usr/lib64/python2.6/urllib2.py", line 518, in http_error_default
    raise HTTPError(req.get_full_url(), code, msg, hdrs, fp)
HTTPError: HTTP Error 403: Forbidden

Comment 5

[Robert Helmer [:rhelmer]]

(In reply to Nick Thomas [:nthomas] from comment #4)
> It boils down to python traceback ending in
>   File "/usr/lib64/python2.6/urllib2.py", line 518, in http_error_default
>     raise HTTPError(req.get_full_url(), code, msg, hdrs, fp)
> HTTPError: HTTP Error 403: Forbidden

Hmm I think there is a specific vhost on the server it needs to point to instead of "localhost", I may need to get access to the server to diagnose.

Comment 6

[Nick Thomas [:nthomas] (UTC+12)]

Shyam, can you help us out here ?

Comment 7

[Shyam Mani [:fox2mike]]

I don't see anything special on the older boxes :

[root@sm-hudson01 ~]# httpd -S
VirtualHost configuration:
wildcard NameVirtualHosts and _default_ servers:
*:82                   is a NameVirtualHost
         default server sm-hudson01.mozilla.org (/etc/httpd/conf/httpd.conf:1022)
         port 82 namevhost sm-hudson01.mozilla.org (/etc/httpd/conf/httpd.conf:1022)
*:81                   is a NameVirtualHost
         default server sm-hudson01.mozilla.org (/etc/httpd/conf/httpd.conf:1016)
         port 81 namevhost sm-hudson01.mozilla.org (/etc/httpd/conf/httpd.conf:1016)
         port 81 namevhost jenkins.mozilla.org (/etc/httpd/conf/domains/hudson.mozilla.org.conf:7)
*:80                   is a NameVirtualHost
         default server sm-hudson01.mozilla.org (/etc/httpd/conf/httpd.conf:996)
         port 80 namevhost sm-hudson01.mozilla.org (/etc/httpd/conf/httpd.conf:996)
         port 80 namevhost jenkins.mozilla.org (/etc/httpd/conf/domains/hudson.mozilla.org.conf:1)

[root@dm-hudson01-slave01 ~]# httpd -S
VirtualHost configuration:
wildcard NameVirtualHosts and _default_ servers:
*:82                   is a NameVirtualHost
         default server dm-hudson01-slave01.mozilla.org (/etc/httpd/conf/httpd.conf:994)
         port 82 namevhost dm-hudson01-slave01.mozilla.org (/etc/httpd/conf/httpd.conf:994)

Comment 8

[Shyam Mani [:fox2mike]]

I do see this :

# for AUSv2
<VirtualHost _default_:82>
    ServerAdmin [e-mail]
    DocumentRoot /var/www/html
    <Directory "/var/www/html">
      AllowOverride All
    </Directory>
</VirtualHost>

And I have :

<VirtualHost localhost:80>
    ServerName localhost
    ServerAdmin [e-mail]
    DocumentRoot /var/www/html

    <Directory /var/www/html/>
        AllowOverride All
    </Directory>

</VirtualHost>

Comment 9

[Nick Thomas [:nthomas] (UTC+12)]

The scripts copy the AUS code into /var/www/html/aus/, and Fitnesse is configured to make requests to 'http://localhost/aus/update'. That looks like it should all work, assuming that there is a RewriteRule something like
 RewriteRule ^/aus/update/(.*)$ aus/index.php?path=$1 [QSA]
I'm adapting that from a different setup so that may not be quite right.

If it's all working then a request to http://localhost/aus/update/2/Synthetic/1.0/1000000001/platform/locale/channel/osVersion///update.xml should return

<?xml version="1.0"?>
<updates>
    <update type="minor" version="1.0" extensionVersion="1.0" buildID="2006010101" detailsURL="http://detail.url/content.html ">
        <patch type="complete" URL="http://synthetic.1.0.platform.buildid.locale.channel/complete001" hashFunction="SHA1" hashValue="aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa" size="12345"/>
    </update>
</updates>

Comment 10

[Robert Helmer [:rhelmer]]

Did this ever get fixed? Shyam, did you get a chance to look at comment 9 (I don't think I have access to this box)

Comment 11

[Shyam Mani [:fox2mike]]

(In reply to Robert Helmer [:rhelmer] from comment #10)
> Did this ever get fixed? Shyam, did you get a chance to look at comment 9 (I
> don't think I have access to this box)

Sorry, this fell through the cracks with all the other things happening in December.

This is what I see :

[[e-mail]1 inc]# curl http://localhost/aus/update/2/Synthetic/1.0/1000000001/platform/locale/channel/osVersion///update.xml
<?xml version="1.0"?>
<updates>
</updates>

So something is busted?

Comment 12

[Nick Thomas [:nthomas] (UTC+12)]

We're still seeing results like comment #3 and #4. Any ideas on how to move forward here ? Is this some problem master/slave setup ?

Comment 13

[Nick Thomas [:nthomas] (UTC+12)]

It would be really great if we could fix this once and for all, but I don't know enough about Jenkins in general or our setup to to suggest more than comment #12.

Comment 14

[Robert Helmer [:rhelmer]]

(In reply to Nick Thomas [:nthomas] from comment #13)
> It would be really great if we could fix this once and for all, but I don't
> know enough about Jenkins in general or our setup to to suggest more than
> comment #12.

Sorry fell off my radar; I can take another look at it this week.

Comment 15

[Robert Helmer [:rhelmer]]

I'll likely need some extra IT help since it seems like everything should work (and works for me locally)

Comment 16

[Shyam Mani [:fox2mike]]

Rob, timeout. Reopen when you need a hand :)

Comment 17

[Robert Helmer [:rhelmer]]

Hey now that we have vagrant working on jenkins (bug 703193), we could run it this way instead.. will look into that.

Comment 18

[Robert Helmer [:rhelmer]]

This is still busted, Nick and I tend to run these tests manually. Until AUSv2 is dead I think it's worth getting this going again.

Comment 19

[Nick Thomas [:nthomas] (UTC+12)]

AUS2 has been deprecated for all but release and esr users, and we plan to transition those of the next month or so, so probably not worth fixing this.

Comment 20

[Robert Helmer [:rhelmer]]

(In reply to Nick Thomas [:nthomas] from comment #19)
> AUS2 has been deprecated for all but release and esr users, and we plan to
> transition those of the next month or so, so probably not worth fixing this.

WFM, we can continue to run it manually in the meantime if needed (probably not even that)