1401124 - Intermittent test_cli_arguments.py TestCommandLineArguments.test_start_in_safe_mode | AssertionError: Safe Mode has not been enabled followed by more failures

Status: RESOLVED INCOMPLETE

(Testing :: Marionette Client and Harness, defect, P5)

Description

[Treeherder Bug Filer]

Filed by: archaeopteryx [at] coole-files.de

https://treeherder.mozilla.org/logviewer.html#?job_id=131903526&repo=mozilla-inbound

https://queue.taskcluster.net/v1/task/dXRjnv9FRCOiNDcp1thqxg/runs/0/artifacts/public/logs/live_backing.log

This hit both MnH and Mn for win10 x64 debug on that push. Unfortunately, there is no screenshot in the log.

05:18:51     INFO -  TEST-START | test_cli_arguments.py TestCommandLineArguments.test_start_in_safe_mode
05:18:51     INFO -  Application command: Z:\task_1505795350\build\application\firefox\firefox.exe -no-remote -marionette -safe-mode -profile c:\users\genericworker\appdata\local\temp\tmpkwvwgt.mozrunner
05:18:51    ERROR -  TEST-UNEXPECTED-FAIL | test_cli_arguments.py TestCommandLineArguments.test_start_in_safe_mode | AssertionError: Safe Mode has not been enabled
05:18:51     INFO -  Traceback (most recent call last):
05:18:51     INFO -    File "Z:\task_1505795350\build\venv\lib\site-packages\marionette_harness\marionette_test\testcases.py", line 156, in run
05:18:51     INFO -      testMethod()
05:18:51     INFO -    File "Z:\task_1505795350\build\tests\marionette\tests\testing\marionette\harness\marionette_harness\tests\unit\test_cli_arguments.py", line 36, in test_start_in_safe_mode
05:18:51     INFO -      self.assertTrue(safe_mode, "Safe Mode has not been enabled")
05:18:51     INFO -  TEST-INFO took 175ms
05:18:51     INFO -  Application command: Z:\task_1505795350\build\application\firefox\firefox.exe -no-remote -marionette -profile c:\users\genericworker\appdata\local\temp\tmpg8plqy.mozrunner

Comment 1

[Henrik Skupin [:whimboo][⌚️UTC+2]]

Sadly for those tests the complete DEBUG/TRACE log output is missing. I filed bug 1401157 to investigate it.

Comment 2

[Intermittent Failures Robot]

2 failures in 943 pushes (0.002 failures/push) were associated with this bug in the last 7 days.    

Repository breakdown:
* mozilla-inbound: 2

Platform breakdown:
* windows10-64: 2

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1401124&startday=2017-09-18&endday=2017-09-24&tree=all

Comment 3

[Emma Humphries ☕️🎸🧞‍♀️✨ (she/they) [:emceeaich] (Pacific Time) use needinfo]

https://wiki.mozilla.org/Bugmasters#Intermittent_Test_Failure_Cleanup

Comment 4

[Intermittent Failures Robot]

1 failures in 864 pushes (0.001 failures/push) were associated with this bug in the last 7 days.    

Repository breakdown:
* autoland: 1

Platform breakdown:
* windows10-64: 1

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1401124&startday=2017-10-16&endday=2017-10-22&tree=all

Comment 5

[Intermittent Failures Robot]

2 failures in 912 pushes (0.002 failures/push) were associated with this bug in the last 7 days.    

Repository breakdown:
* mozilla-inbound: 1
* mozilla-central: 1

Platform breakdown:
* windows10-64: 2

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1401124&startday=2017-10-23&endday=2017-10-29&tree=all

Comment 6

[Intermittent Failures Robot]

7 failures in 857 pushes (0.008 failures/push) were associated with this bug in the last 7 days.    

Repository breakdown:
* mozilla-inbound: 4
* autoland: 2
* mozilla-central: 1

Platform breakdown:
* windows10-64: 6
* windows10-64-nightly: 1

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1401124&startday=2017-10-30&endday=2017-11-05&tree=all

Comment 7

[Intermittent Failures Robot]

1 failures in 849 pushes (0.001 failures/push) were associated with this bug in the last 7 days.    

Repository breakdown:
* mozilla-inbound: 1

Platform breakdown:
* windows10-64: 1

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1401124&startday=2017-11-06&endday=2017-11-12&tree=all

Comment 8

[Firefox Bug Husbandry Bot]

https://wiki.mozilla.org/Bug_Triage#Intermittent_Test_Failure_Cleanup

Comment 9

[BMO Automation]

Moving bug to Testing::Marionette Client and Harness component per bug 1815831.