1360338 - Install Python 3.5 and add exception rule to Windows 7 iX machines

Status: RESOLVED FIXED

(Infrastructure & Operations Graveyard :: CIDuty, task)

Description

[Armen [:armenzg]]

These are requirements for mitmproxy.

Comment 1

[Amy Rich [:arr] [:arich]]

We would need to add the firewall rule.
Are you installing python 3 with tooltool? That would put the control in your hands and is done with a number of packages that have been put in tree. The reason we install python 2 is because it's needed for the initial hg checkouts.

Comment 2

[Armen [:armenzg]]

That's neat!

Do you know who or where we can define a new Python to be downloaded via tooltool? I can't rememeber much about this.

Comment 3

[Amy Rich [:arr] [:arich]]

What are the firewall exceptions?

Comment 4

[Armen [:armenzg]]

Hi Q,
I believe we have Python exception rules for the iX Windows 7 test machines; could you please let us know if we need to provide you an exact path? or something else?

Thank you!

Comment 5

[Q]

Armen the path would be very helpful.

Q

Comment 6

[Armen [:armenzg]]

(In reply to Q from comment #5)
> Armen the path would be very helpful.
> 
> Q

Hi Q, I am interested on knowing what the current path for Python 2 is on the Win7 machines.
I want to see the path that we currently have.

I just had a memory come back and I believe we create a path to the Python binariy within Mozharness' venv.
If that is true we might not need to add a different rule for Python 3 as the binary name is the same.

We don't have the final prototype integrated into Mozharness and that is why I can't give you a path at this moment.

Comment 7

[Armen [:armenzg]]

We need to install Python at the host level.

Could you please give us an estimate as to when this could be tackled?
The installer we want for these machines is this:
https://www.python.org/ftp/python/3.5.3/python-3.5.3.exe

The only customization to the installer is changing the installation path.

Please install it to:
C:\Python3.5

Q: With regards to the exception, please let me know what the current Python firewall exception is. I believe it might contain "venv" in the path and I will be proposing we add a new rule with the same path except it will be "venv_python3".

Comment 8

[Armen [:armenzg]]

I've received more information from other coworkers and I'm going to give using tooltool one moe try.

The firewall exception rule requirement still applies.

Comment 9

[Armen [:armenzg]]

It seems that tooltool might be a go.
Local testing seems successful. We will test with the automation next week.

Comment 10

[Armen [:armenzg]]

Q: what is the current Python *2.7* firewall exception path? (from comment 6)

If we could deploy the firewall exception for next week we will be able to test the Quantum mitmproxy project.
I expect most of the coding to be completed by then.

Comment 11

[Amy Rich [:arr] [:arich]]

FYI, Q is on PTO till Monday

Comment 12

[Q]

C:\slave\test\build\venv\scripts\python.exe
C:\mozilla-build\buildbotve\scripts\python.exe
C:\talos-slave\test\build\venv\scripts\python.exe

Comment 13

[Joel Maher ( :jmaher ) (UTC -8)]

:rwood, can you verify which rules we need and recommend any firewall rules to include in the image.  This might require python 3.5 to be running with mitmdump properly serving pages before we know fully.

Comment 14

[Robert Wood [:rwood]]

I've never worked with firewall rules before, can you guide me here on how to figure this out? Do I need to turn on a firewall on the win7 loaner somehow, and then try serving pages from mitmproxy and somewhere see what rules are needed? Thanks!

Comment 15

[Joel Maher ( :jmaher ) (UTC -8)]

this I am not sure what needs to be done.  I assume we will get a popup on a windows box asking to allow access for python.exe to access the network.  In this case we need to determine what path it is and ensure that firewall exception is added to the os configuration before running the tests.

Possibly there are no popups asking for this- usually there are a bunch though.

Comment 16

[Robert Wood [:rwood]]

The first time mitmproxy (mitmdump) started up on the Win7 loaner there is a popup asking for permission for Python. Please add a firewall exception for these:

C:\slave\test\build\python3.6\python
C:\slave\test\py3venv
C:\slave\test\py3venv\Scripts

Thanks!

Comment 17

[Joel Maher ( :jmaher ) (UTC -8)]

I think we need python.exe full paths, rwood, can you ensure you have full path to python.exe and is it python.exe or python3.exe, etc.  There shoould be one in c:\slave\test\build and one in the venv somewhere.

Comment 18

[Robert Wood [:rwood]]

Sorry Q, need more time to get the details

Comment 19

[Robert Wood [:rwood]]

C:\slave\test\build\python3.6\python.exe
C:\slave\test\py3venv\Scripts\python.exe

Thanks! :)

Comment 20

[Q]

Added

Comment 21

[Chris AtLee [:catlee]]

Is this done now?

Comment 22

[Robert Wood [:rwood]]

I believe Q added it?

Comment 23

[Robert Wood [:rwood]]

Oh wait saw Q's comment 20, yes this is done thanks