1507835 - Intermittent ..\python\mach\mach\test\test_telemetry.py::test_simple TEST-UNEXPECTED-FAIL

Status: RESOLVED FIXED

(Firefox Build System :: Mach Core, enhancement, P5)

Description

[Treeherder Bug Filer]

Filed by: rgurzau [at] mozilla.com

https://treeherder.mozilla.org/logviewer.html#?job_id=212227366&repo=autoland

https://queue.taskcluster.net/v1/task/GKAbhW9PScqM09K4R5QIsA/runs/0/artifacts/public/logs/live_backing.log

15:23:45     INFO - ========================== 12 passed in 0.05 seconds ==========================
15:23:47     INFO - z:\build\build\src\python\mach\mach\test\test_telemetry.py
15:23:47     INFO - ============================= test session starts =============================
15:23:47     INFO - platform win32 -- Python 2.7.15, pytest-3.6.2, py-1.5.4, pluggy-0.6.0 -- z:\build\build\src\obj-firefox\_virtualenvs\obj-firefox-sNC2NmI7-2.7\Scripts\python.exe
15:23:47     INFO - rootdir: z:\build\build\src, inifile: z:\build\build\src\config\mozunit\mozunit\pytest.ini
15:23:47     INFO - collecting ... collected 6 items
15:23:47  WARNING - ..\python\mach\mach\test\test_telemetry.py::test_simple TEST-UNEXPECTED-FAIL
15:23:47     INFO - ..\python\mach\mach\test\test_telemetry.py::test_path_filtering PASSED
15:23:47     INFO - ..\python\mach\mach\test\test_telemetry.py::test_path_filtering_in_objdir PASSED
15:23:47     INFO - ..\python\mach\mach\test\test_telemetry.py::test_path_filtering_other_cwd PASSED
15:23:47     INFO - ..\python\mach\mach\test\test_telemetry.py::test_mach_invoke_recursive PASSED
15:23:47     INFO - ..\python\mach\mach\test\test_telemetry.py::test_registrar_dispatch PASSED
15:23:47     INFO - ================================== FAILURES ===================================
15:23:47     INFO - _________________________________ test_simple _________________________________
15:23:47     INFO - run_mach = <function run at 0x00000000048C56D8>
15:23:47     INFO - tmpdir = local('c:\\users\\task_1542376328\\appdata\\local\\temp\\pytest-of-task_1542376328\\pytest-1\\test_simple0')
15:23:47     INFO -     def test_simple(run_mach, tmpdir):
15:23:47     INFO - >       data = run_mach('python', '-c', 'pass')
15:23:47     INFO - ..\python\mach\mach\test\test_telemetry.py:46:
15:23:47     INFO - _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _
15:23:47     INFO - args = ('python', '-c', 'pass'), kwargs = {}
15:23:47     INFO - path = 'c:\users\task_1542376328\appdata\local\temp\pytest-of-task_1542376328\pytest-1\test_simple0\telemetry\outgoing'
15:23:47     INFO -     def run(*args, **kwargs):
15:23:47     INFO -         # Run mach with the provided arguments
15:23:47     INFO -         subprocess.check_output([sys.executable, mach] + list(args),
15:23:47     INFO -                                 stderr=subprocess.STDOUT,
15:23:47     INFO -                                 env=env,
15:23:47     INFO -                                 **kwargs)
15:23:47     INFO -         # Load any telemetry data that was written
15:23:47     INFO -         path = unicode(tmpdir.join('telemetry', 'outgoing'))
15:23:47     INFO - >       return [json.load(open(os.path.join(path, f), 'rb')) for f in os.listdir(path)]
15:23:47     INFO - E       WindowsError: [Error 3] The system cannot find the path specified: u'c:\\users\\task_1542376328\\appdata\\local\\temp\\pytest-of-task_1542376328\\pytest-1\\test_simple0\\telemetry\\outgoing\\*.*'
15:23:47     INFO - ..\python\mach\mach\test\test_telemetry.py:41: WindowsError

Comment 1

[(not currently active) Ted Mielczarek]

OK this is what bug 1506759 looks like after the patch there. Seems like the `os.listdir` call is failing.

Comment 2

[(not currently active) Ted Mielczarek]

I think maybe we should re-add the try/except, but put some additional logging in the except--we could check every directory upwards to see what exists. My guess is that either something is failing to create the outgoing directory or that something in the test harness is removing the temp directory before we're done with it.

Comment 3

[Intermittent Failures Robot]

2 failures in 2917 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:
* autoland: 2

Platform breakdown:
* windows2012-64: 1
* windows2012-32: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1507835&startday=2018-11-12&endday=2018-11-18&tree=all

Comment 4

[Intermittent Failures Robot]

7 failures in 2387 pushes (0.003 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:
* mozilla-inbound: 2
* autoland: 4
* mozilla-central: 1

Platform breakdown:
* windows2012-32: 2
* windows2012-64: 3
* windows2012-64-noopt: 2

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1507835&startday=2018-11-19&endday=2018-11-25&tree=all

Comment 5

[Intermittent Failures Robot]

7 failures in 2808 pushes (0.002 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:
* mozilla-inbound: 3
* autoland: 3
* mozilla-central: 1

Platform breakdown:
* windows2012-64: 6
* windows2012-32-noopt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1507835&startday=2018-11-26&endday=2018-12-02&tree=all

Comment 6

[Intermittent Failures Robot]

7 failures in 1862 pushes (0.004 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:
* mozilla-inbound: 2
* mozilla-central: 1
* autoland: 4

Platform breakdown:
* windows2012-64: 6
* windows2012-32: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1507835&startday=2018-12-03&endday=2018-12-09&tree=all

Comment 7

[Intermittent Failures Robot]

5 failures in 2485 pushes (0.002 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:
* try: 1
* autoland: 3
* mozilla-inbound: 1

Platform breakdown:
* windows2012-32: 3
* windows2012-64: 2

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1507835&startday=2018-12-10&endday=2018-12-16&tree=all

Comment 8

[Intermittent Failures Robot]

12 failures in 2648 pushes (0.005 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:
* mozilla-central: 3
* try: 1
* mozilla-inbound: 1
* autoland: 7

Platform breakdown:
* linux64: 1
* windows2012-64: 6
* win64-asan-reporter: 1
* windows2012-32: 4

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1507835&startday=2018-12-17&endday=2018-12-23&tree=all

Comment 9

[Intermittent Failures Robot]

4 failures in 1008 pushes (0.004 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:
* mozilla-inbound: 2
* autoland: 1
* mozilla-central: 1

Platform breakdown:
* windows2012-32-noopt: 1
* windows2012-32: 3

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1507835&startday=2018-12-24&endday=2018-12-30&tree=all

Comment 10

[Intermittent Failures Robot]

6 failures in 1668 pushes (0.004 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:
* mozilla-inbound: 4
* autoland: 2

Platform breakdown:
* windows2012-64: 1
* windows2012-32: 4
* windows2012-32-noopt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1507835&startday=2018-12-31&endday=2019-01-06&tree=all

Comment 11

[(not currently active) Ted Mielczarek]

Looking at the logs shows that the underlying cause was bug 1517909.

Comment 12

[Intermittent Failures Robot]

3 failures in 2627 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 2
• mozilla-inbound: 1

Platform breakdown:

• windows2012-32: 1
• windows2012-64: 2

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1507835&startday=2019-01-07&endday=2019-01-13&tree=all