Closed Bug 686091 Opened 14 years ago Closed 14 years ago

Intermittent Tegra mochitest and browser-chrome and jsreftest failure with "INFO | automation.py | Application ran for: 0:00:15.nnnnnn"

Categories

(Release Engineering :: General, defect, P3)

ARM
Android
defect

Tracking

(Not tracked)

RESOLVED FIXED

People

(Reporter: philor, Unassigned)

References

Details

(Keywords: intermittent-failure, Whiteboard: [android_tier_1])

Nothing else apparent or in common, just that the test run starts, the app runs for 15 seconds and change, and then closes. https://tbpl.mozilla.org/php/getParsedLog.php?id=6358586 Android Tegra 250 mozilla-inbound opt test browser-chrome on 2011-09-09 19:30:40 PDT for push 068a0c2a28b2 python mochitest/runtestsremote.py --deviceIP 10.250.49.27 --xre-path ../hostutils/xre --utility-path ../hostutils/bin --certificate-path certs --app org.mozilla.fennec --console-level INFO --http-port 30040 --ssl-port 31040 --pidfile /builds/tegra-040/test/../runtestsremote.pid --browser-chrome --test-path mobile in dir /builds/tegra-040/test/build/tests (timeout 2400 secs) watching logfiles {} argv: ['python', 'mochitest/runtestsremote.py', '--deviceIP', '10.250.49.27', '--xre-path', '../hostutils/xre', '--utility-path', '../hostutils/bin', '--certificate-path', 'certs', '--app', 'org.mozilla.fennec', '--console-level', 'INFO', '--http-port', '30040', '--ssl-port', '31040', '--pidfile', '/builds/tegra-040/test/../runtestsremote.pid', '--browser-chrome', '--test-path', 'mobile'] environment: PATH=/opt/local/bin:/opt/local/sbin:/opt/local/Library/Frameworks/Python.framework/Versions/2.6/bin:/usr/bin:/bin:/usr/sbin:/sbin:/usr/local/bin:/usr/X11/bin PWD=/builds/tegra-040/test/build/tests SUT_IP=10.250.49.27 SUT_NAME=tegra-040 __CF_USER_TEXT_ENCODING=0x1F6:0:0 closing stdin using PTY: False unable to execute ADB: ensure Android SDK is installed and adb is in your $PATH restarting as root failed reconnecting socket INFO | runtests.py | Installing extension at /builds/tegra-040/test/build/tests/mochitest/specialpowers to /tmp/tmpSrM57n. INFO | runtests.py | Done installing extension. pushing directory: /tmp/tmpSrM57n to /mnt/sdcard/tests/profile args: ['/builds/tegra-040/test/build/hostutils/bin/xpcshell', '-g', '/builds/tegra-040/test/build/hostutils/xre', '-v', '170', '-f', './httpd.js', '-e', "const _PROFILE_PATH = '/tmp/tmpNgNQ40';const _SERVER_PORT = '30040'; const _SERVER_ADDR ='10.250.48.202';", '-f', './server.js'] INFO | runtests.py | Server pid: 57385 pushing directory: /tmp/tmpSrM57n to /mnt/sdcard/tests/profile INFO | runtests.py | Running tests: start. FIRE PROC: '"MOZ_CRASHREPORTER=1,XPCOM_DEBUG_BREAK=stack,MOZ_CRASHREPORTER_NO_REPORT=1,NO_EM_RESTART=1,MOZ_PROCESS_LOG=/tmp/tmp_iOEZapidlog,XPCOM_MEM_BLOAT_LOG=/tmp/tmpSrM57n/runtests_leaks.log" org.mozilla.fennec -no-remote -profile /mnt/sdcard/tests/profile/ about:blank' INFO | automation.py | Application pid: 0 DeviceManager: error pulling file: No such file or directory INFO | automation.py | Application ran for: 0:00:15.295203 INFO | automation.py | Reading PID log: /tmp/tmp_iOEZapidlog WARNING | automationutils.processLeakLog() | refcount logging is off, so leaks can't be detected! INFO | runtests.py | Running tests: end. DeviceManager: error pulling file: No such file or directory removing file: /mnt/sdcard/tests/logs/mochitest.log program finished with exit code 0 elapsedTime=27.460717 TinderboxPrint: mochitest-browser-chrome<br/> https://tbpl.mozilla.org/php/getParsedLog.php?id=6358052 Android Tegra 250 mozilla-inbound opt test mochitest-5 on 2011-09-09 18:49:25 PDT for push d09ca67df777 unable to execute ADB: ensure Android SDK is installed and adb is in your $PATH restarting as root failed reconnecting socket INFO | runtests.py | Installing extension at /builds/tegra-062/test/build/tests/mochitest/specialpowers to /tmp/tmp_ci7Re. INFO | runtests.py | Done installing extension. pushing directory: /tmp/tmp_ci7Re to /mnt/sdcard/tests/profile args: ['/builds/tegra-062/test/build/hostutils/bin/xpcshell', '-g', '/builds/tegra-062/test/build/hostutils/xre', '-v', '170', '-f', './httpd.js', '-e', "const _PROFILE_PATH = '/tmp/tmpABSJEB';const _SERVER_PORT = '30062'; const _SERVER_ADDR ='10.250.48.201';", '-f', './server.js'] INFO | runtests.py | Server pid: 71493 pushing directory: /tmp/tmp_ci7Re to /mnt/sdcard/tests/profile INFO | runtests.py | Running tests: start. FIRE PROC: '"MOZ_CRASHREPORTER=1,XPCOM_DEBUG_BREAK=stack,MOZ_CRASHREPORTER_NO_REPORT=1,NO_EM_RESTART=1,MOZ_PROCESS_LOG=/tmp/tmpwqAHXOpidlog,XPCOM_MEM_BLOAT_LOG=/tmp/tmp_ci7Re/runtests_leaks.log" org.mozilla.fennec -no-remote -profile /mnt/sdcard/tests/profile/ http://mochi.test:8888/tests/dom/tests/mochitest/ajax/mochikit?autorun=1&closeWhenDone=1&logFile=%2Fmnt%2Fsdcard%2Ftests%2Flogs%2Fmochitest.log&fileLevel=INFO&consoleLevel=INFO' INFO | automation.py | Application pid: 0 DeviceManager: error pulling file: No such file or directory INFO | automation.py | Application ran for: 0:00:15.234946 INFO | automation.py | Reading PID log: /tmp/tmpwqAHXOpidlog WARNING | automationutils.processLeakLog() | refcount logging is off, so leaks can't be detected! INFO | runtests.py | Running tests: end. DeviceManager: error pulling file: No such file or directory removing file: /mnt/sdcard/tests/logs/mochitest.log program finished with exit code 0 elapsedTime=25.076699 TinderboxPrint: mochitest-plain<br/><em class="testfail">T-FAIL</em>
Summary: Intermittent Tegra mochitest and browser-chrome failure with "INFO | automation.py | Application ran for: 0:00:15.nnnnnn" → Intermittent Tegra mochitest and browser-chrome and jsreftest failure with "INFO | automation.py | Application ran for: 0:00:15.nnnnnn"
Not entirely sure whether https://tbpl.mozilla.org/php/getParsedLog.php?id=6383530&tree=Mozilla-Inbound is really a Crashtest version of this, or something different, what with a lot more noise during the brief run, and the run lasting 18 seconds instead of the steady 15.
In the end, I backed out the patch for bug 686405 for the comment 17 thing and several more 18 or 19 second ones, but that's making me think this is also Fennec's problem, a startup crash.
:philor, you couldn't be more accurate here. Fennec is crashing upon startup and we need to debug this.
Priority: -- → P3
Priority: -- → P3
Sneaky, exception-catching added 3 seconds onto the startup crash runtime, I almost thought this had gone away. https://tbpl.mozilla.org/php/getParsedLog.php?id=6573047&tree=Mozilla-Inbound https://tbpl.mozilla.org/php/getParsedLog.php?id=6571506&tree=Firefox
Summary: Intermittent Tegra mochitest and browser-chrome and jsreftest failure with "INFO | automation.py | Application ran for: 0:00:15.nnnnnn" → Intermittent Tegra mochitest and browser-chrome and jsreftest failure with "INFO | automation.py | Application ran for: 0:00:18.nnnnnn" after repeated "DeviceManager: error pulling file: No such file or directory"
actually this is 0:18:xx.xxxxxx, so from 15 seconds to 18 minutes, and the elapsed time is 1100+ seconds. This indicates that the test had some type of error while trying to run the tests, either a bad profile or something wrong with the build or tests. We would see other errors if the tegra was unreachable or offline.
Math is hard.
Summary: Intermittent Tegra mochitest and browser-chrome and jsreftest failure with "INFO | automation.py | Application ran for: 0:00:18.nnnnnn" after repeated "DeviceManager: error pulling file: No such file or directory" → Intermittent Tegra mochitest and browser-chrome and jsreftest failure with "INFO | automation.py | Application ran for: 0:00:15.nnnnnn"
Blocks: 689839
And indeed, I was completely wrong and the 15 second thing does still exist. https://tbpl.mozilla.org/php/getParsedLog.php?id=6599749&tree=Mozilla-Inbound
Well, sort of, since that was actually from a bad patch that made the browser crash on startup 100%, but at least that does show that with a startup crash, we would still do this.
https://tbpl.mozilla.org/php/getParsedLog.php?id=6611138&tree=Mozilla-Inbound is 53 seconds, but the smell is otherwise quite similar
Status: NEW → RESOLVED
Closed: 14 years ago
Resolution: --- → FIXED
Whiteboard: [orange][android_tier_1] → [android_tier_1]
Product: mozilla.org → Release Engineering
You need to log in before you can comment on or make changes to this bug.