1312204 - Taskcluster tests do not retry on failure due to DMError, etc

Status: RESOLVED FIXED

(Taskcluster :: General, defect)

Description

[Sebastian Hengst [:aryx] (needinfo me if it's about an intermittent or backout)]

+++ This bug was initially created as a clone of Bug #1280570 +++

https://treeherder.mozilla.org/logviewer.html#?job_id=38072502&repo=mozilla-inbound

[task 2016-10-22T00:26:35.939256Z] 00:26:35     INFO -  25 INFO TEST-START | dom/html/test/test_bug430351.html
[task 2016-10-22T00:27:18.778817Z] 00:27:18     INFO -  INFO | automation.py | Application ran for: 0:05:06.221552
[task 2016-10-22T00:27:18.779062Z] 00:27:18     INFO -  INFO | zombiecheck | Reading PID log: /tmp/tmpvATqlxpidlog
[task 2016-10-22T00:27:18.789901Z] 00:27:18     INFO -  /data/anr/traces.txt not found
[task 2016-10-22T00:27:18.816207Z] 00:27:18     INFO -  Traceback (most recent call last):
[task 2016-10-22T00:27:18.816530Z] 00:27:18     INFO -    File "/home/worker/workspace/build/tests/mochitest/runtests.py", line 2393, in doTests
[task 2016-10-22T00:27:18.820884Z] 00:27:18     INFO -      marionette_args=marionette_args,
[task 2016-10-22T00:27:18.820943Z] 00:27:18     INFO -    File "/home/worker/workspace/build/tests/mochitest/runtestsremote.py", line 292, in runApp
[task 2016-10-22T00:27:18.820991Z] 00:27:18     INFO -      return self._automation.runApp(*args, **kwargs)
[task 2016-10-22T00:27:18.821041Z] 00:27:18     INFO -    File "/home/worker/workspace/build/tests/mochitest/automation.py", line 577, in runApp
[task 2016-10-22T00:27:18.821101Z] 00:27:18     INFO -      crashed = self.checkForCrashes(os.path.join(profileDir, "minidumps"), symbolsPath)
[task 2016-10-22T00:27:18.821157Z] 00:27:18     INFO -    File "/home/worker/workspace/build/tests/mochitest/remoteautomation.py", line 212, in checkForCrashes
[task 2016-10-22T00:27:18.821199Z] 00:27:18     INFO -      logcat = self._devicemanager.getLogcat(filterOutRegexps=fennecLogcatFilters)
[task 2016-10-22T00:27:18.821249Z] 00:27:18     INFO -    File "/home/worker/workspace/build/venv/local/lib/python2.7/site-packages/mozdevice/devicemanager.py", line 173, in getLogcat
[task 2016-10-22T00:27:18.821273Z] 00:27:18     INFO -      timeout=self.short_timeout)
[task 2016-10-22T00:27:18.821326Z] 00:27:18     INFO -    File "/home/worker/workspace/build/venv/local/lib/python2.7/site-packages/mozdevice/devicemanager.py", line 414, in shellCheckOutput
[task 2016-10-22T00:27:18.821360Z] 00:27:18     INFO -      "(output: '%s', retval: '%s')" % (cmd, output, retval))
[task 2016-10-22T00:27:18.821440Z] 00:27:18 CRITICAL -  DMError: Non-zero return code for command: ['/system/bin/logcat', '-v', 'time', '-d', 'dalvikvm:I', 'ConnectivityService:S', 'WifiMonitor:S', 'WifiStateTracker:S', 'wpa_supplicant:S', 'NetworkStateTracker:S'] (output: '', retval: 'None')
[task 2016-10-22T00:27:18.821483Z] 00:27:18     INFO -  26 ERROR Automation Error: Received unexpected exception while running application

Comment 1

[Greg Arndt [:garndt]]

This should be fixed when new workers are rolled out.  The desktop-test* worker types accidentally were reverted to an older AMI that did not have this retry fix.