1904574 - turn off fuzzing builds/tests on beta/release/esr branches

Status: ASSIGNED

(Testing :: General, task)

Description

[Joel Maher ( :jmaher ) (UTC -8)]

we run all of our fuzzing builds on beta/release/esr, I am not sure there is value here (vs asan/tsan) and we should consider removing these.

Comment 1

[Joel Maher ( :jmaher ) (UTC -8)]

to be clear, I am not talking about mozilla-central/autoland/trunk

Comment 2

[Joel Maher ( :jmaher ) (UTC -8)]

Attachment: Bug 1904574 - Run fuzzing builds/tests on trunk, not on beta/release/esr. r=decoder

Comment 3

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/autoland/rev/55b9d28dd3a7
Run fuzzing builds/tests on trunk, not on beta/release/esr. r=decoder

Comment 4

[Iulian Moraru]

Backed out for causing py3 failures on test_mozilla_central.py.

• Push with failures

• Failure log

• Backout link

[task 2024-06-27T02:51:47.837Z] taskcluster/test/test_new_config.py::test_tasks_new_config_true[mochitest-browser-chrome] PASSED
[task 2024-06-27T02:51:47.838Z] 
[task 2024-06-27T02:51:47.839Z] ======================== 2 passed in 494.52s (0:08:14) =========================
[task 2024-06-27T02:51:47.840Z] 
[task 2024-06-27T02:51:47.841Z] 
[task 2024-06-27T03:02:51.615Z] Tests Completed:  83%|████████▎ | 5/6 [16:47<03:11, 191.14s/Test]
[task 2024-06-27T03:02:51.615Z]                                                                  
[task 2024-06-27T03:02:51.615Z] 
[task 2024-06-27T03:02:51.616Z] Tests Completed: 100%|██████████| 6/6 [27:51<00:00, 351.84s/Test]
[task 2024-06-27T03:02:51.616Z]                                                                  
[task 2024-06-27T03:02:51.616Z] /builds/worker/checkouts/gecko/taskcluster/test/test_mozilla_central.py
[task 2024-06-27T03:02:51.616Z] ============================= test session starts ==============================
[task 2024-06-27T03:02:51.616Z] platform linux -- Python 3.8.10, pytest-7.0.1, pluggy-1.5.0 -- /builds/worker/.mozbuild/srcdirs/gecko-8a5b87fe5d69/_virtualenvs/python-test/bin/python
[task 2024-06-27T03:02:51.616Z] rootdir: /builds/worker/checkouts/gecko, configfile: config/mozunit/mozunit/pytest.ini
[task 2024-06-27T03:02:51.616Z] plugins: mock-3.12.0
[task 2024-06-27T03:02:51.616Z] collecting ... collected 3 items
[task 2024-06-27T03:02:51.616Z] 
[task 2024-06-27T03:02:51.616Z] taskcluster/test/test_mozilla_central.py::test_generate_graph PASSED
[task 2024-06-27T03:02:51.616Z] taskcluster/test/test_mozilla_central.py::test_tasks_are_scheduled[tsan builds] TEST-UNEXPECTED-FAIL
[task 2024-06-27T03:02:51.616Z] taskcluster/test/test_mozilla_central.py::test_test_setting PASSED
[task 2024-06-27T03:02:51.616Z] 
[task 2024-06-27T03:02:51.616Z] =================================== FAILURES ===================================
[task 2024-06-27T03:02:51.616Z] ____________________ test_tasks_are_scheduled[tsan builds] _____________________
[task 2024-06-27T03:02:51.616Z] taskcluster/test/test_mozilla_central.py:33: in test_tasks_are_scheduled
[task 2024-06-27T03:02:51.616Z]     assert len(tasks) >= min_expected
[task 2024-06-27T03:02:51.616Z] E   assert 0 >= 1
[task 2024-06-27T03:02:51.616Z] E    +  where 0 = len([])
[task 2024-06-27T03:02:51.616Z] ----------------------------- Captured stdout call -----------------------------
[task 2024-06-27T03:02:51.616Z] []
[task 2024-06-27T03:02:51.616Z] =================== 1 failed, 2 passed in 298.90s (0:04:58) ====================
[task 2024-06-27T03:02:51.616Z] 
[task 2024-06-27T03:02:51.616Z] /builds/worker/checkouts/gecko/taskcluster/test/test_generate_params.py
[task 2024-06-27T03:02:51.616Z] ============================= test session starts ==============================
[task 2024-06-27T03:02:51.616Z] platform linux -- Python 3.8.10, pytest-7.0.1, pluggy-1.5.0 -- /builds/worker/.mozbuild/srcdirs/gecko-8a5b87fe5d69/_virtualenvs/python-test/bin/python
[task 2024-06-27T03:02:51.616Z] rootdir: /builds/worker/checkouts/gecko, configfile: config/mozunit/mozunit/pytest.ini
[task 2024-06-27T03:02:51.616Z] plugins: mock-3.12.0
[task 2024-06-27T03:02:51.616Z] collecting ... collected 34 items
[task 2024-06-27T03:02:51.616Z] 
[task 2024-06-27T03:02:51.616Z] taskcluster/test/test_generate_params.py::test_generate_graphs[mb-push-firefox-partials] PASSED

Comment 5

[Joel Maher ( :jmaher ) (UTC -8)]

odd, I specifically fixed and ran that test on try before submitting:
https://treeherder.mozilla.org/jobs?repo=try&tier=1%2C2%2C3&searchStr=ci&revision=67a540de6f81b999f4bb3cd24afdc46a693b93ec

either way, I will figure this out.

Comment 6

[Joel Maher ( :jmaher ) (UTC -8)]

odd, I cannot reproduce this on try:
https://treeherder.mozilla.org/jobs?repo=try&tier=1%2C2%2C3&revision=91284350ac5191b7985cd5fa616eda23174f2cc0

I rebased onto autoland about an hour ago and push this; clearly this was a perma fail on autoland. I am confused why this failed and before/after I cannot reproduce on try.

Aryx, are you aware of try running these python source-tests differently than they run on autoland?

Comment 7

[Sebastian Hengst [:aryx] (needinfo me if it's about an intermittent or backout)]

3 urls get mocked by conftest. Other requests to hg.mozilla.org and firefox-ci-tc.services.mozilla.com get passed through and talk to the real servers.

When the parameters.yml gets fetched from the latter, this might get one the optimized scheduling with reduced tasks (target_tasks_method: autoland_tasks) - or a similar reuse of the parameters.yml could explain this.