1811337 - Migrate Windows NSS builds from AWS to Azure

Status: RESOLVED FIXED

(Infrastructure & Operations :: Relops: Azure, task)

Comment 1

[Mark Cornmesser [:markco] OOO 2024/04/15]

Changes made for a try push in automation/taskcluster/graph/src/extend.js:

--- a/automation/taskcluster/graph/src/extend.js
+++ b/automation/taskcluster/graph/src/extend.js
@@ -873,24 +873,18 @@ async function scheduleFuzzing32() {
 
   return queue.submit();
 }
 
 /*****************************************************************************/
 
 async function scheduleWindows(name, base, build_script) {
   base = merge(base, {
-    workerType: "win2012r2",
+    workerType: "b-win2012-azure",
     env: {
-      PATH: "c:\\mozilla-build\\bin;c:\\mozilla-build\\python;" +
-           "c:\\mozilla-build\\msys\\local\\bin;c:\\mozilla-build\\7zip;" +
-           "c:\\mozilla-build\\info-zip;c:\\mozilla-build\\python\\Scripts;" +
-           "c:\\mozilla-build\\yasm;c:\\mozilla-build\\msys\\bin;" +
-           "c:\\Windows\\system32;c:\\mozilla-build\\upx391w;" +
-           "c:\\mozilla-build\\moztools-x64\\bin;c:\\mozilla-build\\wget",
       DOMSUF: "localdomain",
       HOST: "localhost",
     },
     features: ["taskclusterProxy"],
     scopes: ["project:releng:services/tooltool/api/download/internal"],
   });
 
   let artifacts_and_kind = {

1. Point to the 2012 Azure pool
2. Remove the $PATH being set and relying on the system $Path. This was done since those directories have changed and can change in the future with mozilla-build package upgrades.

Last try push: https://firefox-ci-tc.services.mozilla.com/tasks/groups/aVN90cEWQMaCLYL1fl1nqw

Each Windows task fails with:

Fetching...
  File "Z:\task_167406812239192\tools\buildfarm\utils\retry.py", line 63
    print "Process stdio:\n%s" % read_file(stdout)
          ^

This maybe related to the newer Python, 3.9.10. However, I am not sure on how to dig deeper into this from here.

Comment 2

[Mark Cornmesser [:markco] OOO 2024/04/15]

Attachment: Bug 1811337 - Add 2012 image including Python 2 for NSS. r=jmoss

Comment 3

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/ci/ci-configuration/rev/285e951fa431
Add 2012 image including Python 2 for NSS. r=jmoss

Comment 4

[Mark Cornmesser [:markco] OOO 2024/04/15]

I was able to get further in the build after reverting to the Mozilla-build package 3.2, which has Python 2.7.

Now these builds are failing on using tooltool while trying to access the tooltool URL.

From https://firefox-ci-tc.services.mozilla.com/tasks/sOMoKhXMQRyMT2d4B477tA/runs/0:

URLError: <urlopen error [Errno 11001] getaddrinfo failed>
INFO - File gyp-2017-05-23.zip not present in local cache folder C:\builds\tooltool_cache
INFO - Attempting to fetch from 'http://taskcluster/tooltool.mozilla-releng.net/'...
INFO - ...failed to fetch 'gyp-2017-05-23.zip' from http://taskcluster/tooltool.mozilla-releng.net/
Traceback (most recent call last):
  File "c:/builds/tooltool.py", line 909, in fetch_file
    with request(url, auth_file) as f, open(temp_path, mode="wb") as out:
  File "c:\mozilla-build\python\lib\contextlib.py", line 17, in __enter__
    return self.gen.next()
  File "c:/builds/tooltool.py", line 888, in request
    with closing(urllib2.urlopen(req)) as f:
  File "c:\mozilla-build\python\lib\urllib2.py", line 154, in urlopen
    return opener.open(url, data, timeout)
  File "c:\mozilla-build\python\lib\urllib2.py", line 429, in open
    response = self._open(req, data)
  File "c:\mozilla-build\python\lib\urllib2.py", line 447, in _open
    '_open', req)
  File "c:\mozilla-build\python\lib\urllib2.py", line 407, in _call_chain
    result = func(*args)
  File "c:\mozilla-build\python\lib\urllib2.py", line 1228, in http_open
    return self.do_open(httplib.HTTPConnection, req)
  File "c:\mozilla-build\python\lib\urllib2.py", line 1198, in do_open
    raise URLError(err)
URLError: <urlopen error [Errno 11001] getaddrinfo failed>
ERROR - The following files failed: 'vs2017_15.4.2.zip', ninja171.zip', gyp-2017-05-23.zip'
retry: Giving up on <function run_with_timeout at 0x0000000002AB0908>
Unable to successfully run ['c:/mozilla-build/python/python.exe', 'c:/builds/tooltool.py', '-c', 'c:/builds/tooltool_cache', '--url', 'http://taskcluster/tooltool.mozilla-releng.net/', '--overwrite', '-m', 'nss/automation/taskcluster/windows/releng.manifest', 'fetch', '-c', 'C:\\builds\\tooltool_cache'] after 10 attempts
[taskcluster 2023-01-25T19:34:32.692Z]    Exit Code: 1

Ahal: Could this be an issue of having incorrect scopes? If not any ideas?

Comment 5

[Mark Cornmesser [:markco] OOO 2024/04/15]

Attachment: Bug 1811337 - Update images used for NSS 2012 VMs. r?#releng-reviewers

Comment 6

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/ci/ci-configuration/rev/4045e4b844a4
Update images used for NSS 2012 VMs. r=releng-reviewers,hneiva

Comment 7

[Mark Cornmesser [:markco] OOO 2024/04/15]

Attachment: Bug 1811337 - migrate Win 2012 tasks to Azure. r?beurdouche

Comment 8

[Benjamin Beurdouche [:beurdouche]]

https://hg.mozilla.org/projects/nss/rev/254a3a72a3a7612c8346fcc3aaeca2f900b67ce7