various xpcshell tests in toolkit/mozapps/... fail or hang on Android

NEW
Unassigned

Status

()

7 years ago
3 years ago

People

(Reporter: gbrown, Unassigned)

Tracking

Firefox Tracking Flags

(Not tracked)

Details

(Whiteboard: [mobile-testing][xpcshell])

Attachments

(7 attachments, 1 obsolete attachment)

(Reporter)

Description

7 years ago
With patches for bug 668349 and 668351, xpcshell tests can be run on an Android device, and the majority of tests pass. 

However, some tests in toolkit/mozapps/... fail or hang when run on Android.

The failures are in:
toolkit/mozapps/extensions/test/xpcshell/test_bug563256.js
toolkit/mozapps/extensions/test/xpcshell/test_bug616841.js
toolkit/mozapps/extensions/test/xpcshell/test_dss.js
toolkit/mozapps/extensions/test/xpcshell/test_plugins.js
toolkit/mozapps/extensions/test/xpcshell/test_startup.js
toolkit/mozapps/extensions/test/xpcshell/test_theme.js
toolkit/mozapps/update/test_timermanager/unit/test_0010_timermanager.js

The hangs are in:
toolkit/mozapps/extensions/test/xpcshell/<various>
(Reporter)

Updated

7 years ago
Whiteboard: [mobile-testing][xpcshell]
Can we get logs of these so we can try to figure out why they are failing?
(Reporter)

Comment 2

7 years ago
I should be able to provide some logs in a few days. If anyone would like to run the tests themselves, there are instructions at: https://wiki.mozilla.org/Mobile/Fennec/Android#Testing
(Reporter)

Comment 3

7 years ago
Created attachment 570130 [details]
log for test_bug563256.js
(Reporter)

Comment 4

7 years ago
Created attachment 570131 [details]
log for test_bug616841.js
(Reporter)

Comment 5

7 years ago
Created attachment 570133 [details]
log for test_dss.js
(Reporter)

Comment 6

7 years ago
Created attachment 570135 [details]
log for test_plugins.js
(Reporter)

Comment 7

7 years ago
Created attachment 570136 [details]
log for test_startup.js
(Reporter)

Comment 8

7 years ago
Created attachment 570137 [details]
log for test_theme.js
(Reporter)

Comment 9

7 years ago
Created attachment 570138 [details]
log for test_0010_timermanager.js
(Reporter)

Comment 10

7 years ago
Created attachment 570141 [details]
log for test_AddonRepository.js

This test was hanging when this bug was opened. It no longer hangs -- but it still fails.
(In reply to Geoff Brown [:gbrown] from comment #3)
> Created attachment 570130 [details]
> log for test_bug563256.js

Fennec is missing a preference this test depends on, files bug 698108
(In reply to Geoff Brown [:gbrown] from comment #4)
> Created attachment 570131 [details]
> log for test_bug616841.js

This is due to a bug in Fennec. Filed bug 698128
(In reply to Geoff Brown [:gbrown] from comment #5)
> Created attachment 570133 [details]
> log for test_dss.js

This log says the test is actually passing, which matches what I see
(In reply to Geoff Brown [:gbrown] from comment #6)
> Created attachment 570135 [details]
> log for test_plugins.js

This test depends on the test plugin being in an expected location relative to the xpcshell binary, we either need to copy it to the right place on the device with the xpcshell test setup or just leave this test disabled.
(In reply to Geoff Brown [:gbrown] from comment #7)
> Created attachment 570136 [details]
> log for test_startup.js

This log claims the test is passing which matches what I see
(In reply to Geoff Brown [:gbrown] from comment #8)
> Created attachment 570137 [details]
> log for test_theme.js

This log says the test is passing which matches what I'm seeing
(In reply to Geoff Brown [:gbrown] from comment #10)
> Created attachment 570141 [details]
> log for test_AddonRepository.js
> 
> This test was hanging when this bug was opened. It no longer hangs -- but it
> still fails.

Another one that depends on some preferences being set. Since those preferences are used by features that Fennec doesn't use we may just want to leave it disabled.
Filed bug 698147 for test_bug449027.js, test_bug455906.js and test_bug514327_3.js.

The other 20 or 30 tests in toolkit/mozapps/extensions that are marked as hanging seem to be passing just fine for me.

We should fix xpcshell.ini to point to actual bugs for issues.
Comment on attachment 570138 [details]
log for test_0010_timermanager.js

test_timermanager no longer fails and is enabled
Attachment #570138 - Attachment is obsolete: true
You need to log in before you can comment on or make changes to this bug.