1651845 - Intermittent 1:40.77 testing/raptor/test/test_cpu.py::test_usage_with_invalid_data_returns_zero TEST-UNEXPECTED-FAIL

Status: RESOLVED INCOMPLETE

(Testing :: Raptor, defect, P5)

Description

[Treeherder Bug Filer]

Filed by: abutkovits [at] mozilla.com
Parsed log: https://treeherder.mozilla.org/logviewer.html#?job_id=309206454&repo=mozilla-central
Full log: https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/OwfSAAITRMCT5IWXNiJYlg/runs/0/artifacts/public/logs/live_backing.log

---

[task 2020-07-09T22:05:13.589Z] 1:40.77 testing/raptor/test/test_cpu.py::test_no_device PASSED
[task 2020-07-09T22:05:13.589Z] 1:40.77 testing/raptor/test/test_cpu.py::test_usage_with_invalid_data_returns_zero TEST-UNEXPECTED-FAIL
[task 2020-07-09T22:05:13.589Z] 1:40.77 testing/raptor/test/test_cpu.py::test_usage_with_output PASSED
[task 2020-07-09T22:05:13.589Z] 1:40.77 testing/raptor/test/test_cpu.py::test_usage_with_fallback PASSED
[task 2020-07-09T22:05:13.589Z] 1:40.77
[task 2020-07-09T22:05:13.589Z] 1:40.77 ================================== FAILURES ===================================
[task 2020-07-09T22:05:13.589Z] 1:40.77 __________________ test_usage_with_invalid_data_returns_zero __________________
[task 2020-07-09T22:05:13.590Z] 1:40.77
[task 2020-07-09T22:05:13.590Z] 1:40.77 def test_usage_with_invalid_data_returns_zero():
[task 2020-07-09T22:05:13.590Z] 1:40.77 with mock.patch("mozdevice.adb.ADBDevice") as device:
[task 2020-07-09T22:05:13.590Z] 1:40.77 with mock.patch("control_server.RaptorControlServer") as control_server:
[task 2020-07-09T22:05:13.590Z] 1:40.77 # Create a device that returns invalid data
[task 2020-07-09T22:05:13.590Z] 1:40.77 device.shell_output.side_effect = ["8.0.0", "geckoview"]
[task 2020-07-09T22:05:13.590Z] 1:40.77 device._verbose = True
[task 2020-07-09T22:05:13.590Z] 1:40.77
[task 2020-07-09T22:05:13.590Z] 1:40.77 # Create a control server
[task 2020-07-09T22:05:13.590Z] 1:40.77 control_server.cpu_test = True
[task 2020-07-09T22:05:13.590Z] 1:40.77 control_server.device = device
[task 2020-07-09T22:05:13.590Z] 1:40.77 > raptor = WebExtensionAndroid("geckoview", "org.mozilla.geckoview_example")
[task 2020-07-09T22:05:13.590Z] 1:40.77
[task 2020-07-09T22:05:13.590Z] 1:40.77 ....\test\test_cpu.py:43:
[task 2020-07-09T22:05:13.590Z] 1:40.77 _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _
[task 2020-07-09T22:05:13.590Z] 1:40.77 ..\webextension\android.py:37: in init
[task 2020-07-09T22:05:13.590Z] 1:40.77 app, binary, profile_class="firefox", **kwargs
[task 2020-07-09T22:05:13.590Z] 1:40.77 ..\webextension\base.py:37: in init
[task 2020-07-09T22:05:13.590Z] 1:40.77 super(WebExtension, self).init(*args, **kwargs)
[task 2020-07-09T22:05:13.590Z] 1:40.77 ..\perftest.py:208: in init
[task 2020-07-09T22:05:13.590Z] 1:40.77 self.build_browser_profile()
[task 2020-07-09T22:05:13.590Z] 1:40.77 ..\perftest.py:633: in build_browser_profile
[task 2020-07-09T22:05:13.590Z] 1:40.77 super(PerftestAndroid, self).build_browser_profile()
[task 2020-07-09T22:05:13.590Z] 1:40.77 ..\webextension\base.py:175: in build_browser_profile
[task 2020-07-09T22:05:13.590Z] 1:40.77 super(WebExtension, self).build_browser_profile()
[task 2020-07-09T22:05:13.590Z] 1:40.77 ..\perftest.py:320: in build_browser_profile
[task 2020-07-09T22:05:13.590Z] 1:40.77 self.profile_class, profile=self.get_conditioned_profile()
[task 2020-07-09T22:05:13.590Z] 1:40.77 ..\perftest.py:276: in get_conditioned_profile
[task 2020-07-09T22:05:13.591Z] 1:40.77 repo=repo
[task 2020-07-09T22:05:13.591Z] 1:40.77 ......\condprofile\condprof\client.py:163: in get_profile
[task 2020-07-09T22:05:13.591Z] 1:40.77 os.makedirs(download_dir)
[task 2020-07-09T22:05:13.591Z] 1:40.77 _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _
[task 2020-07-09T22:05:13.591Z] 1:40.77
[task 2020-07-09T22:05:13.591Z] 1:40.77 name = 'C:\Users\task_1594330394/.condprof-cache', mode = 511
[task 2020-07-09T22:05:13.591Z] 1:40.77
[task 2020-07-09T22:05:13.591Z] 1:40.77 def makedirs(name, mode=0777):
[task 2020-07-09T22:05:13.591Z] 1:40.77 """makedirs(path [, mode=0777])
[task 2020-07-09T22:05:13.591Z] 1:40.77
[task 2020-07-09T22:05:13.591Z] 1:40.77 Super-mkdir; create a leaf directory and all intermediate ones.
[task 2020-07-09T22:05:13.591Z] 1:40.77 Works like mkdir, except that any intermediate path segment (not
[task 2020-07-09T22:05:13.591Z] 1:40.77 just the rightmost) will be created if it does not exist. This is
[task 2020-07-09T22:05:13.591Z] 1:40.77 recursive.
[task 2020-07-09T22:05:13.591Z] 1:40.77
[task 2020-07-09T22:05:13.591Z] 1:40.77 """
[task 2020-07-09T22:05:13.591Z] 1:40.77 head, tail = path.split(name)
[task 2020-07-09T22:05:13.591Z] 1:40.77 if not tail:
[task 2020-07-09T22:05:13.591Z] 1:40.77 head, tail = path.split(head)
[task 2020-07-09T22:05:13.591Z] 1:40.77 if head and tail and not path.exists(head):
[task 2020-07-09T22:05:13.591Z] 1:40.77 try:
[task 2020-07-09T22:05:13.591Z] 1:40.77 makedirs(head, mode)
[task 2020-07-09T22:05:13.591Z] 1:40.77 except OSError, e:
[task 2020-07-09T22:05:13.591Z] 1:40.77 # be happy if someone already created the path
[task 2020-07-09T22:05:13.591Z] 1:40.77 if e.errno != errno.EEXIST:
[task 2020-07-09T22:05:13.591Z] 1:40.77 raise
[task 2020-07-09T22:05:13.591Z] 1:40.77 if tail == curdir: # xxx/newdir/. exists if xxx/newdir exists
[task 2020-07-09T22:05:13.591Z] 1:40.77 return
[task 2020-07-09T22:05:13.592Z] 1:40.77 > mkdir(name, mode)
[task 2020-07-09T22:05:13.592Z] 1:40.77 E WindowsError: [Error 183] Cannot create a file when that file already exists: 'C:\Users\task_1594330394/.condprof-cache'
[task 2020-07-09T22:05:13.592Z] 1:40.77
[task 2020-07-09T22:05:13.592Z] 1:40.77 ........\obj-x86_64-pc-mingw32_virtualenvs\src-81_vI----2\lib\os.py:157: WindowsError
[task 2020-07-09T22:05:13.592Z] 1:40.77 ---------------------------- Captured stderr call -----------------------------
[task 2020-07-09T22:05:13.592Z] 1:40.77 condprof INFO | Getting conditioned profile with arguments: {'repo': 'mozilla-central', 'platform': u'g5-geckoview_example', 'task_id': None, 'customization': 'default', 'scenario': 'settled'}
[task 2020-07-09T22:05:13.592Z] 1:40.77 condprof INFO | Getting headers at https://firefox-ci-tc.services.mozilla.com
[task 2020-07-09T22:05:13.592Z] 1:40.77 condprof INFO | Response code is 200
[task 2020-07-09T22:05:13.592Z] 1:40.77 condprof INFO | preparing download dir
[task 2020-07-09T22:05:13.592Z] 1:40.77 Traceback (most recent call last):
[task 2020-07-09T22:05:13.592Z] 1:40.77 File "Z:\task_1594330394\build\src\testing\raptor\raptor\perftest.py", line 276, in get_conditioned_profile
[task 2020-07-09T22:05:13.592Z] 1:40.77 repo=repo
[task 2020-07-09T22:05:13.592Z] 1:40.77 File "Z:\task_1594330394\build\src\testing\condprofile\condprof\client.py", line 163, in get_profile
[task 2020-07-09T22:05:13.592Z] 1:40.77 os.makedirs(download_dir)
[task 2020-07-09T22:05:13.592Z] 1:40.77 File "Z:\task_1594330394\build\src\obj-x86_64-pc-mingw32_virtualenvs\src-81_vI----2\lib\os.py", line 157, in makedirs
[task 2020-07-09T22:05:13.592Z] 1:40.77 mkdir(name, mode)
[task 2020-07-09T22:05:13.592Z] 1:40.77 WindowsError: [Error 183] Cannot create a file when that file already exists: 'C:\Users\task_1594330394/.condprof-cache'
[task 2020-07-09T22:05:13.592Z] 1:40.77 ===================== 1 failed, 3 passed in 48.20 seconds =====================
[task 2020-07-09T22:05:13.592Z] 1:40.77 Setting retcode to 1 from Z:\task_1594330394\build\src\testing\raptor\test\test_cpu.py
[task 2020-07-09T22:05:13.593Z] 1:40.77 Return code from mach python-test: 1
[taskcluster 2020-07-09T22:05:13.718Z] Exit Code: 1
[taskcluster 2020-07-09T22:05:13.718Z] User Time: 0s
[taskcluster 2020-07-09T22:05:13.718Z] Kernel Time: 0s
[taskcluster 2020-07-09T22:05:13.718Z] Wall Time: 9m53.6953448s
[taskcluster 2020-07-09T22:05:13.718Z] Result: FAILED
[taskcluster 2020-07-09T22:05:13.718Z] === Task Finished ===
[taskcluster 2020-07-09T22:05:13.718Z] Task Duration: 9m53.6963241s
[taskcluster 2020-07-09T22:05:13.718Z] [mounts] Preserving cache: Moving "Z:\task_1594330394\build" to "Z:\caches\EDOh6ymKSourty54-2ACuw"
[taskcluster 2020-07-09T22:05:13.911Z] [mounts] Denying task_1594330394 access to 'Z:\caches\EDOh6ymKSourty54-2ACuw'
[taskcluster 2020-07-09T22:05:30.947Z] Uploading redirect artifact public/logs/live.log to URL https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/OwfSAAITRMCT5IWXNiJYlg/runs/0/artifacts/public/logs/live_backing.log with mime type "text/plain; charset=utf-8" and expiry 2021-07-09T21:52:06.964Z

Comment 1

[Intermittent Failures Robot]

1 failures in 5265 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 1

Platform breakdown:

• windows10-64: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1651845&startday=2020-07-06&endday=2020-07-12&tree=all

Comment 2

[BugBot [:suhaib / :marco/ :calixte]]

https://wiki.mozilla.org/Bug_Triage#Intermittent_Test_Failure_Cleanup
For more information, please visit auto_nag documentation.

Comment 3

[Alexandru Michis [:malexandru]]

Recent failure log: https://treeherder.mozilla.org/logviewer.html#/jobs?job_id=312352127&repo=autoland&lineNumber=819

Comment 4

[Intermittent Failures Robot]

1 failures in 4618 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 1

Platform breakdown:

• windows10-64: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1651845&startday=2020-08-03&endday=2020-08-09&tree=all

Comment 5

[Intermittent Failures Robot]

1 failures in 3601 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 1

Platform breakdown:

• macosx1014-64: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1651845&startday=2020-08-10&endday=2020-08-16&tree=all

Comment 6

[Intermittent Failures Robot]

3 failures in 4100 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 3

Platform breakdown:

• macosx1014-64: 2
• windows10-64: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1651845&startday=2020-08-17&endday=2020-08-23&tree=all

Comment 7

[BugBot [:suhaib / :marco/ :calixte]]

https://wiki.mozilla.org/Bug_Triage#Intermittent_Test_Failure_Cleanup
For more information, please visit auto_nag documentation.

Comment 8

[Natalia Csoregi [:nataliaCs]]

https://treeherder.mozilla.org/logviewer?job_id=321471641&repo=mozilla-central&lineNumber=783

Comment 9

[Intermittent Failures Robot]

1 failures in 4040 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 1

Platform breakdown:

• windows10-64: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1651845&startday=2020-11-09&endday=2020-11-15&tree=all

Comment 10

[Intermittent Failures Robot]

2 failures in 1479 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 2

Platform breakdown:

• windows10-64: 1
• macosx1014-64: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1651845&startday=2020-11-23&endday=2020-11-29&tree=all

Comment 11

[Intermittent Failures Robot]

1 failures in 3712 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 1

Platform breakdown:

• windows10-64: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1651845&startday=2020-11-30&endday=2020-12-06&tree=all

Comment 12

[Intermittent Failures Robot]

2 failures in 3421 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 2

Platform breakdown:

• windows10-64: 2

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1651845&startday=2020-12-14&endday=2020-12-20&tree=all

Comment 13

[BugBot [:suhaib / :marco/ :calixte]]

https://wiki.mozilla.org/Bug_Triage#Intermittent_Test_Failure_Cleanup
For more information, please visit auto_nag documentation.

Comment 14

[Atila Butkovits]

New occurrence: https://treeherder.mozilla.org/logviewer?job_id=326797887&repo=autoland&lineNumber=759

Comment 15

[Intermittent Failures Robot]

1 failures in 3810 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 1

Platform breakdown:

• windows10-64: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1651845&startday=2021-01-11&endday=2021-01-17&tree=all

Comment 16

[Intermittent Failures Robot]

1 failures in 3488 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 1

Platform and build breakdown:

• windows10-64: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1651845&startday=2021-01-18&endday=2021-01-24&tree=all

Comment 17

[Intermittent Failures Robot]

1 failures in 3891 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 1

Platform and build breakdown:

• windows10-64: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1651845&startday=2021-01-25&endday=2021-01-31&tree=all

Comment 18

[Intermittent Failures Robot]

1 failures in 4322 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 1

Platform and build breakdown:

• windows10-64: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1651845&startday=2021-02-08&endday=2021-02-14&tree=all

Comment 19

[Intermittent Failures Robot]

2 failures in 4327 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 1
• mozilla-central: 1

Platform and build breakdown:

• windows10-64: 2
  • opt: 2

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1651845&startday=2021-02-22&endday=2021-02-28&tree=all

Comment 20

[BugBot [:suhaib / :marco/ :calixte]]

https://wiki.mozilla.org/Bug_Triage#Intermittent_Test_Failure_Cleanup
For more information, please visit auto_nag documentation.

Comment 21

[Intermittent Failures Robot]

1 failures in 3967 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 1

Platform and build breakdown:

• windows10-64: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1651845&startday=2021-03-22&endday=2021-03-28&tree=all