938969 - Intermittent in testAboutHomeVisibility: got http://mochi.test:8888/tests/robocop/robocop_blank_01.html, expected Browser Blank Page 01

Status: RESOLVED DUPLICATE of bug 946656

(Firefox for Android Graveyard :: Testing, defect)

Description

[Michael Comella (:mcomella) [NI reported issues only: ex-Mozilla]]

bug 910859 introduces the testAboutHomeVisibility test which has failed for me intermittently. However, I'm not sure if my device was using an old (or WIP) fennec build at the time. This bug is here to followup and track any possible intermittent failures.

Comment 1

[Michael Comella (:mcomella) [NI reported issues only: ex-Mozilla]]

This may have been solved in the original bug; see bug 910859 comment 69.

Comment 2

[Michael Comella (:mcomella) [NI reported issues only: ex-Mozilla]]

via bug 910859 comment 86:

> Intermittent in try from bug 910859 comment 82 - I'm holding landing until I can figure this out.

> It occurred on 2.2 armv6 so it's possible our timeout is too short (though the hasTimedOut
> message is not in the output, so perhaps not.

> Here's a try push with a longer timeout (2000->5000):
> https://tbpl.mozilla.org/?tree=Try&rev=7c9f65e32fa0

Comment 3

[Michael Comella (:mcomella) [NI reported issues only: ex-Mozilla]]

This could also be a network error: later in the file (granted, after a minute and the start of another test) we get:

11-27 03:07:33.042 I/GeckoSuggestClient( 8314): Not connected to network
...
11-27 03:07:36.372 E/LoadFaviconTask( 8314): java.net.UnknownHostException: mochi.test

This is after a page has loaded, meaning the connection could just have been spotty.

Comment 4

[Michael Comella (:mcomella) [NI reported issues only: ex-Mozilla]]

Precedent exists for this issue in BaseTest - see bug 915350 and bug 943310.

Comment 5

[Michael Comella (:mcomella) [NI reported issues only: ex-Mozilla]]

Attachment: local repro - stderr

I was able to repro locally with some more useful debug output.

The event to change the title is "DOMTitleChanged" which notably fires *after* the toolbar title has been asserted.

Comment 6

[Michael Comella (:mcomella) [NI reported issues only: ex-Mozilla]]

try run waiting for both DOMContentLoaded and DOMTitleChanged in WaitHelper.waitForPageLoad:

https://tbpl.mozilla.org/?tree=Try&rev=06c1913c0ddb

Comment 7

[Michael Comella (:mcomella) [NI reported issues only: ex-Mozilla]]

The try run passed so I added a patch (#2) to bug 910859 fixing the issue by waiting on both the "DOMContentLoaded" and "DOMTitleChanged" events, as per comment 6.

I will mark this as a dupe once bug 910859 lands.

Comment 8

[Michael Comella (:mcomella) [NI reported issues only: ex-Mozilla]]

Solved in bug 910859 though potentially the same issue as bug 946656.

Comment 9

[Legacy TBPL/Treeherder Robot]

KWierso
https://tbpl.mozilla.org/php/getParsedLog.php?id=33418381&tree=Mozilla-Inbound
Android 2.2 Tegra mozilla-inbound opt test robocop-2 on 2014-01-22 13:48:00
revision: a1877d97194d
slave: tegra-254

Mochi-Remote ERROR   | Automation Error: Missing end of test marker (process crashed?)
20 INFO TEST-UNEXPECTED-FAIL | testAboutHomeVisibility | The Toolbar title is Browser Blank Page 01 - got http://mochi.test:8888/tests/robocop/robocop_blank_01.html, expected Browser Blank Page 01
01-22 14:21:09.038 I/Robocop ( 7565): 20 INFO TEST-UNEXPECTED-FAIL | testAboutHomeVisibility | The Toolbar title is Browser Blank Page 01 - got http://mochi.test:8888/tests/robocop/robocop_blank_01.html, expected Browser Blank Page 01
01-22 14:21:10.208 I/TestRunner( 7565): junit.framework.AssertionFailedError: 20 INFO TEST-UNEXPECTED-FAIL | testAboutHomeVisibility | The Toolbar title is Browser Blank Page 01 - got http://mochi.test:8888/tests/robocop/robocop_blank_01.html, expected Browser Blank Page 01

Comment 10

[Michael Comella (:mcomella) [NI reported issues only: ex-Mozilla]]

Forward duping to the most relevant bug on this issue.

Comment 11

[Legacy TBPL/Treeherder Robot]

philor
https://tbpl.mozilla.org/php/getParsedLog.php?id=35023250&tree=Mozilla-Inbound
Android 4.0 Panda mozilla-inbound opt test robocop-5 on 2014-02-20 21:16:21
revision: a917689cc392
slave: panda-0270

38 INFO TEST-UNEXPECTED-FAIL | testAboutHomeVisibility | The Toolbar title is Browser Blank Page 02 - got http://mochi.test:8888/tests/robocop/robocop_blank_02.html - Google Search, expected Browser Blank Page 02
02-20 21:39:45.390 I/Robocop ( 3159): 38 INFO TEST-UNEXPECTED-FAIL | testAboutHomeVisibility | The Toolbar title is Browser Blank Page 02 - got http://mochi.test:8888/tests/robocop/robocop_blank_02.html - Google Search, expected Browser Blank Page 02
02-20 21:39:46.585 I/TestRunner( 3159): junit.framework.AssertionFailedError: 38 INFO TEST-UNEXPECTED-FAIL | testAboutHomeVisibility | The Toolbar title is Browser Blank Page 02 - got http://mochi.test:8888/tests/robocop/robocop_blank_02.html - Google Search, expected Browser Blank Page 02
Return code: 1