Closed Bug 1655577 Opened 4 years ago Closed 4 years ago

Intermittent 1:13.10 tools/tryselect/test/test_fuzzy.py::test_query_paths TEST-UNEXPECTED-FAIL

Categories

(Developer Infrastructure :: Try, defect, P5)

defect

Tracking

(firefox81 fixed)

RESOLVED FIXED
81 Branch
Tracking Status
firefox81 --- fixed

People

(Reporter: intermittent-bug-filer, Assigned: ahal)

References

Details

(Keywords: intermittent-failure)

Attachments

(1 file)

Filed by: nbeleuzu [at] mozilla.com
Parsed log: https://treeherder.mozilla.org/logviewer.html#?job_id=311176464&repo=autoland
Full log: https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/LkIaFAZ5Rg-JD24JOfIZEQ/runs/0/artifacts/public/logs/live_backing.log


[task 2020-07-27T20:16:06.797Z] 1:13.10 platform linux -- Python 3.6.9, pytest-3.6.2, py-1.5.4, pluggy-0.6.0 -- /builds/worker/checkouts/gecko/obj-x86_64-pc-linux-gnu/_virtualenvs/gecko-QUm8IANb-3/bin/python
[task 2020-07-27T20:16:06.797Z] 1:13.10 rootdir: /builds/worker/checkouts/gecko, inifile: /builds/worker/checkouts/gecko/config/mozunit/mozunit/pytest.ini
[task 2020-07-27T20:16:06.798Z] 1:13.10 collecting ... collected 2 items
[task 2020-07-27T20:16:06.798Z] 1:13.10
[task 2020-07-27T20:16:06.798Z] 1:13.10 tools/tryselect/test/test_fuzzy.py::test_query_paths TEST-UNEXPECTED-FAIL
[task 2020-07-27T20:16:06.798Z] 1:13.10 tools/tryselect/test/test_fuzzy.py::test_query PASSED
[task 2020-07-27T20:16:06.798Z] 1:13.10
[task 2020-07-27T20:16:06.798Z] 1:13.10 =================================== FAILURES ===================================
[task 2020-07-27T20:16:06.798Z] 1:13.10 _______________________________ test_query_paths _______________________________
[task 2020-07-27T20:16:06.798Z] 1:13.10
[task 2020-07-27T20:16:06.798Z] 1:13.10 run_mach = <function run_mach.<locals>.inner at 0x7f68ebc9e7b8>
[task 2020-07-27T20:16:06.798Z] 1:13.10 capfd = <_pytest.capture.CaptureFixture object at 0x7f68eb81bb00>
[task 2020-07-27T20:16:06.798Z] 1:13.10
[task 2020-07-27T20:16:06.798Z] 1:13.10 @pytest.mark.skipif(os.name == 'nt', reason="fzf not installed on host")
[task 2020-07-27T20:16:06.798Z] 1:13.10 def test_query_paths(run_mach, capfd):
[task 2020-07-27T20:16:06.798Z] 1:13.10 cmd = ['try', 'fuzzy', '--no-push',
[task 2020-07-27T20:16:06.798Z] 1:13.10 '-q', "'test-linux1804-64/opt-xpcshell", 'caps/tests/unit/test_origin.js']
[task 2020-07-27T20:16:06.798Z] 1:13.10 assert run_mach(cmd) == 0
[task 2020-07-27T20:16:06.798Z] 1:13.10
[task 2020-07-27T20:16:06.798Z] 1:13.10 output = capfd.readouterr().out
[task 2020-07-27T20:16:06.798Z] 1:13.10 print(output)
[task 2020-07-27T20:16:06.798Z] 1:13.10
[task 2020-07-27T20:16:06.798Z] 1:13.10 # If there are more than one tasks here, it means that something went wrong
[task 2020-07-27T20:16:06.799Z] 1:13.10 # with the path filtering.
[task 2020-07-27T20:16:06.799Z] 1:13.10 expected = """
[task 2020-07-27T20:16:06.799Z] 1:13.10 "tasks": [
[task 2020-07-27T20:16:06.799Z] 1:13.10 "test-linux1804-64/opt-xpcshell-e10s-1"
[task 2020-07-27T20:16:06.799Z] 1:13.10 ]""".lstrip()
[task 2020-07-27T20:16:06.799Z] 1:13.10
[task 2020-07-27T20:16:06.799Z] 1:13.10 > assert expected in output
[task 2020-07-27T20:16:06.799Z] 1:13.10 E assert '"tasks": [\n "test-linux1804-64/opt-xpcshell-e10s-1"\n ]' in 'Task configuration changed, generating target task set\nno tasks selected\n'
[task 2020-07-27T20:16:06.799Z] 1:13.10
[task 2020-07-27T20:16:06.799Z] 1:13.10 tools/tryselect/test/test_fuzzy.py:29: AssertionError

I think this was regressed by some of the shippable work Ben was doing. Not his fault, the test is brittle and likely didn't run on his push.

Assignee: nobody → ahal
Status: NEW → ASSIGNED

This test is pretty brittle. This change should make it slightly less
brittle, but still far from great.

Pushed by ahalberstadt@mozilla.com:
https://hg.mozilla.org/integration/autoland/rev/95fe0595c61c
[tryselect] Fix test_fuzzy.py after removal of opt builds from central, r=bhearsum
Status: ASSIGNED → RESOLVED
Closed: 4 years ago
Resolution: --- → FIXED
Target Milestone: --- → 81 Branch
Product: Firefox Build System → Developer Infrastructure
You need to log in before you can comment on or make changes to this bug.

Attachment

General

Created:
Updated:
Size: