911795 - Update all Mozmill-CI Linux templates for broken Proxy settings

Status: RESOLVED FIXED

(mozilla.org Graveyard :: Server Operations, task)

Description

[Henrik Skupin [:whimboo][⌚️UTC+1]]

As it has been turned out with further investigation we have wrongly set proxy settings in nearly all of our VMs. This has been faced now because the upgraded version of mozdownload makes use of Python requests, which showed it.

On Ubuntu 13.04 the HTTPS proxy is wrongly set to 'https://proxy.dmz.scl3.mozilla.com:3128'. Please note the 'https' protocol in the proxy address.

Also the proxies for FTP and HTTPS are wrongly set across all versions of Ubuntu for apt. All have to point to HTTP and not to HTTPS or FTP.

Comment 1

[Henrik Skupin [:whimboo][⌚️UTC+1]]

I have updated the MANA documentation:
https://mana.mozilla.org/wiki/display/websites/QA+Automation+ESX+Service#QAAutomationESXService-ProxySettings

Adrian, shall we also include all proxy settings in capital letters for the /etc/environment file? I would personally do that to be on the safe side.

In the meantime I will check our machines for the broken proxy settings and fix those.

Comment 2

[Henrik Skupin [:whimboo][⌚️UTC+1]]

Arian, somehow the following boxes didn't came correctly back after a restart. I cannot connect via VNC or SSH:

mm-ub-1304-32-2.qa.scl3.mozilla.com

Comment 3

[Henrik Skupin [:whimboo][⌚️UTC+1]]

(In reply to Henrik Skupin (:whimboo) from comment #2)
> Arian, somehow the following boxes didn't came correctly back after a
> restart. I cannot connect via VNC or SSH:
> 
> mm-ub-1304-32-2.qa.scl3.mozilla.com

For that I filed bug 911832 to get it done ASAP.

Comment 4

[Ludovic Hirlimann [:Usul]]

Usul: whimboo: what's the status of 911795 ?
[1:59pm] davida joined the chat room.
[1:59pm] whimboo: Usul: i need someone who converts the templates to vms
[1:59pm] whimboo: then we have to update those vms
[1:59pm] whimboo: i would like to wait for aj if possible
[2:00pm] whimboo: given that he did all the work so far
[2:00pm] Usul: ok sure no problem I'm going to assign this to AJ
[2:00pm] Usul: so it stops pagging me

Comment 5

[Henrik Skupin [:whimboo][⌚️UTC+1]]

Lowering severity given that the critical pieces have been solved by myself yesterday for all existing VMs. Only the templates need an update now.

Comment 6

[Adrian J Fernandez [:Aj]]

The Linux templates have been verified and updated to have the correct proxy settings.

We left the VMs on, in case there's anything else that you wanted to check;
Ubuntu_12.04_x86 10.22.73.242
Ubuntu_12.04_x86-64 10.22.73.243
Ubuntu_12.10_x86 10.22.73.219
Ubuntu_12.10_x86-64 10.22.73.244
Ubuntu_13.04_x86 10.22.73.238
Ubuntu_13.04_x86-64 10.22.73.222

* do keep in mind that they are online on dynamic IPs so if you reboot them, possible that a new IP would be assign.

Comment 7

[Henrik Skupin [:whimboo][⌚️UTC+1]]

Thanks Adrian. I will check those templates in a bit. In the meantime a question. Was there a reason why you put quotes around the environment values? I think that's not valid:

https://mana.mozilla.org/wiki/display/websites/QA+Automation+ESX+Service#QAAutomationESXService-ProxySettings

Comment 8

[Henrik Skupin [:whimboo][⌚️UTC+1]]

(In reply to Adrian Fernandez [:Aj] from comment #6)
> Ubuntu_12.10_x86 10.22.73.219
> Ubuntu_12.10_x86-64 10.22.73.244

I left those out given that those have to be deleted. See bug 910277.

> Ubuntu_12.04_x86 10.22.73.242
> Ubuntu_12.04_x86-64 10.22.73.243
> Ubuntu_13.04_x86 10.22.73.238
> Ubuntu_13.04_x86-64 10.22.73.222

While I was on those machines I also run the software updates to bring the systems up-2-date. Also I removed old linux-headers packages, which haven't been installed yet. All done as of now.


(In reply to Henrik Skupin (:whimboo) from comment #7)
> Thanks Adrian. I will check those templates in a bit. In the meantime a
> question. Was there a reason why you put quotes around the environment
> values? I think that's not valid:
> 
> https://mana.mozilla.org/wiki/display/websites/
> QA+Automation+ESX+Service#QAAutomationESXService-ProxySettings

Looks like it works but IMHO we should be consistent in specifying the values.

Comment 9

[Adrian J Fernandez [:Aj]]

The reason for the quotes, is just a good habit I have of quoting things.
In this example it wouldn't change anything for depending on what's parsing the variables, if one introduces spaces, then the variable place holder will only take the 1st argument which it sees.

Having the quotes will not cause anything to stop working, originally, they did have quotes but among the iterations of changes we did when the proxy was being tested, they came off.

As for the Linux VMs, ok to convert them back to templates?

Comment 10

[Henrik Skupin [:whimboo][⌚️UTC+1]]

Ok, so I have updated the Mana page to be consistent for each entry in /etc/environment.

As said in comment 8 all work on my side has been done and VMs can be converted back to templates. Thanks.

Comment 11

[Adrian J Fernandez [:Aj]]

I rebooted the templates to make sure they come up as expected and converted them back to templates.