1763314 - Perma py3 tools/tryselect/test/test_scriptworker.py::test_release TEST-UNEXPECTED-FAIL

Status: RESOLVED FIXED

(Developer Infrastructure :: Try, defect, P5)

Description

[Treeherder Bug Filer]

Filed by: imoraru [at] mozilla.com
Parsed log: https://treeherder.mozilla.org/logviewer?job_id=373560663&repo=mozilla-central
Full log: https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/bR_1Z_mPT_S0mbus19bBKg/runs/0/artifacts/public/logs/live_backing.log

---

[task 2022-04-06T04:51:14.315Z] tools/tryselect/test/test_presets.py::test_shared_presets[webrender-perf] XPASS
[task 2022-04-06T04:51:14.315Z] 
[task 2022-04-06T04:51:14.315Z] =============================== warnings summary ===============================
[task 2022-04-06T04:51:14.315Z] tools/tryselect/test/test_presets.py::test_shared_presets[builds]
[task 2022-04-06T04:51:14.315Z]   /builds/worker/checkouts/gecko/third_party/python/taskcluster_taskgraph/taskgraph/config.py:76: DeprecationWarning: The usage of `cmp` is deprecated and will be removed on or after 2021-06-01.  Please use `eq` and `order` instead.
[task 2022-04-06T04:51:14.315Z]     @attr.s(frozen=True, cmp=False)
[task 2022-04-06T04:51:14.315Z] 
[task 2022-04-06T04:51:14.315Z] tools/tryselect/test/test_presets.py::test_shared_presets[builds]
[task 2022-04-06T04:51:14.315Z]   /builds/worker/checkouts/gecko/python/mach/mach/main.py:13: DeprecationWarning: the imp module is deprecated in favour of importlib; see the module's documentation for alternative uses
[task 2022-04-06T04:51:14.315Z]     import imp
[task 2022-04-06T04:51:14.315Z] 
[task 2022-04-06T04:51:14.315Z] tools/tryselect/test/test_presets.py::test_shared_presets[builds]
[task 2022-04-06T04:51:14.315Z]   /builds/worker/checkouts/gecko/third_party/python/mozilla_version/mozilla_version/version.py:17: DeprecationWarning: The usage of `cmp` is deprecated and will be removed on or after 2021-06-01.  Please use `eq` and `order` instead.
[task 2022-04-06T04:51:14.315Z]     @attr.s(frozen=True, cmp=False, hash=True)
[task 2022-04-06T04:51:14.315Z] 
[task 2022-04-06T04:51:14.315Z] tools/tryselect/test/test_presets.py::test_shared_presets[builds]
[task 2022-04-06T04:51:14.315Z]   /builds/worker/checkouts/gecko/third_party/python/mozilla_version/mozilla_version/gecko.py:91: DeprecationWarning: The usage of `cmp` is deprecated and will be removed on or after 2021-06-01.  Please use `eq` and `order` instead.
[task 2022-04-06T04:51:14.315Z]     @attr.s(frozen=True, cmp=False, hash=True)
[task 2022-04-06T04:51:14.315Z] 
[task 2022-04-06T04:51:14.315Z] -- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
[task 2022-04-06T04:51:14.315Z] ======================= 16 xpassed, 4 warnings in 5.44s ========================
[task 2022-04-06T04:51:14.315Z] 
[task 2022-04-06T04:51:14.315Z] 
[task 2022-04-06T04:51:14.315Z] Tests Completed: 100%|██████████| 10/10 [01:28<00:00, 18.12s/Test]
[task 2022-04-06T04:51:14.316Z]                                                                   
[task 2022-04-06T04:51:14.316Z] /builds/worker/checkouts/gecko/tools/tryselect/test/test_scriptworker.py
[task 2022-04-06T04:51:14.316Z] ============================= test session starts ==============================
[task 2022-04-06T04:51:14.316Z] platform linux -- Python 3.6.9, pytest-7.0.1, pluggy-1.0.0 -- /builds/worker/checkouts/gecko/obj-x86_64-pc-linux-gnu/_virtualenvs/python-test/bin/python
[task 2022-04-06T04:51:14.316Z] rootdir: /builds/worker/checkouts/gecko, configfile: config/mozunit/mozunit/pytest.ini
[task 2022-04-06T04:51:14.316Z] collecting ... collected 1 item
[task 2022-04-06T04:51:14.316Z] 
[task 2022-04-06T04:51:14.316Z] tools/tryselect/test/test_scriptworker.py::test_release TEST-UNEXPECTED-FAIL
[task 2022-04-06T04:51:14.316Z] 
[task 2022-04-06T04:51:14.316Z] =================================== FAILURES ===================================
[task 2022-04-06T04:51:14.316Z] _________________________________ test_release _________________________________
[task 2022-04-06T04:51:14.316Z] tools/tryselect/test/test_scriptworker.py:35: in test_release
[task 2022-04-06T04:51:14.316Z]     assert expected.search(output)
[task 2022-04-06T04:51:14.316Z] E   assert None
[task 2022-04-06T04:51:14.321Z] E    +  where None = <built-in method search of _sre.SRE_Pattern object at 0x2907690>('Commit message:\nscriptworker tests: tree\n\nPushed via `mach try scriptworker`\nCalculated try_task_config.json:\n{\n    "parameters": {\n        "app_version": "100.0",\n        "build_number": 2,\n        "existing_tasks": {\n            "balrog-ach-linux-shippable/opt": "JZ_Jq9_CRBqRItNbF4dTLQ",\n            "balrog-ach-linux64-shippable/opt": "BEaz3uT2T5aPLQI-4gt--A",\n
<...>

Comment 1

[Iulian Moraru]

Hi Joel! Can you please take a look at this? Could this be caused by your recent changes in Bug 1751492?
Thank you!

Comment 2

[Julien Cristau [:jcristau]]

Not actually regressed by yesterday's change as far as I can tell, but mach try scriptworker looks up the latest shipped beta build to use its parameters, and ever since it was added, the test hardcodes the build number as 1. We had a 100.0build2 yesterday, so the test now fails.

Comment 3

[Julien Cristau [:jcristau]]

Attachment: Bug 1763314 - don't hardcode the build_number in `mach try scriptworker` test. r?ahal

Comment 4

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/autoland/rev/c75511f04c60
don't hardcode the build_number in `mach try scriptworker` test. r=releng-reviewers,gbrown

Comment 5

[Norisz Fay [:noriszfay]]

https://hg.mozilla.org/mozilla-central/rev/c75511f04c60

Comment 6

[Ryan VanderMeulen [:RyanVM]]

https://hg.mozilla.org/releases/mozilla-beta/rev/cdda8034b88c

Comment 7

[Intermittent Failures Robot]

10 failures in 2922 pushes (0.003 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 7
• autoland: 3

Platform and build breakdown:

• linux1804-64: 7
  • opt: 7
• windows10-64: 2
  • opt: 2
• macosx1015-64-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1763314&startday=2022-04-04&endday=2022-04-10&tree=all