676992 - various xpcshell tests in toolkit/mozapps/extensions... fail or hang on Android

Status: RESOLVED WONTFIX

(Toolkit :: Add-ons Manager, defect, P3)

Description

[Geoff Brown [:gbrown]]

With patches for bug 668349 and 668351, xpcshell tests can be run on an Android device, and the majority of tests pass. 

However, some tests in toolkit/mozapps/... fail or hang when run on Android.

The failures are in:
toolkit/mozapps/extensions/test/xpcshell/test_bug563256.js
toolkit/mozapps/extensions/test/xpcshell/test_bug616841.js
toolkit/mozapps/extensions/test/xpcshell/test_dss.js
toolkit/mozapps/extensions/test/xpcshell/test_plugins.js
toolkit/mozapps/extensions/test/xpcshell/test_startup.js
toolkit/mozapps/extensions/test/xpcshell/test_theme.js
toolkit/mozapps/update/test_timermanager/unit/test_0010_timermanager.js

The hangs are in:
toolkit/mozapps/extensions/test/xpcshell/<various>

Comment 1

[Dave Townsend [:mossop]]

Can we get logs of these so we can try to figure out why they are failing?

Comment 2

[Geoff Brown [:gbrown]]

I should be able to provide some logs in a few days. If anyone would like to run the tests themselves, there are instructions at: https://wiki.mozilla.org/Mobile/Fennec/Android#Testing

Comment 3

[Geoff Brown [:gbrown]]

Attachment: log for test_bug563256.js

Comment 4

[Geoff Brown [:gbrown]]

Attachment: log for test_bug616841.js

Comment 5

[Geoff Brown [:gbrown]]

Attachment: log for test_dss.js

Comment 6

[Geoff Brown [:gbrown]]

Attachment: log for test_plugins.js

Comment 7

[Geoff Brown [:gbrown]]

Attachment: log for test_startup.js

Comment 8

[Geoff Brown [:gbrown]]

Attachment: log for test_theme.js

Comment 9

[Geoff Brown [:gbrown]]

Attachment: log for test_0010_timermanager.js

Comment 10

[Geoff Brown [:gbrown]]

Attachment: log for test_AddonRepository.js

This test was hanging when this bug was opened. It no longer hangs -- but it still fails.

Comment 11

[Dave Townsend [:mossop]]

(In reply to Geoff Brown [:gbrown] from comment #3)
> Created attachment 570130 [details]
> log for test_bug563256.js

Fennec is missing a preference this test depends on, files bug 698108

Comment 12

[Dave Townsend [:mossop]]

(In reply to Geoff Brown [:gbrown] from comment #4)
> Created attachment 570131 [details]
> log for test_bug616841.js

This is due to a bug in Fennec. Filed bug 698128

Comment 13

[Dave Townsend [:mossop]]

(In reply to Geoff Brown [:gbrown] from comment #5)
> Created attachment 570133 [details]
> log for test_dss.js

This log says the test is actually passing, which matches what I see

Comment 14

[Dave Townsend [:mossop]]

(In reply to Geoff Brown [:gbrown] from comment #6)
> Created attachment 570135 [details]
> log for test_plugins.js

This test depends on the test plugin being in an expected location relative to the xpcshell binary, we either need to copy it to the right place on the device with the xpcshell test setup or just leave this test disabled.

Comment 15

[Dave Townsend [:mossop]]

(In reply to Geoff Brown [:gbrown] from comment #7)
> Created attachment 570136 [details]
> log for test_startup.js

This log claims the test is passing which matches what I see

Comment 16

[Dave Townsend [:mossop]]

(In reply to Geoff Brown [:gbrown] from comment #8)
> Created attachment 570137 [details]
> log for test_theme.js

This log says the test is passing which matches what I'm seeing

Comment 17

[Dave Townsend [:mossop]]

(In reply to Geoff Brown [:gbrown] from comment #10)
> Created attachment 570141 [details]
> log for test_AddonRepository.js
> 
> This test was hanging when this bug was opened. It no longer hangs -- but it
> still fails.

Another one that depends on some preferences being set. Since those preferences are used by features that Fennec doesn't use we may just want to leave it disabled.

Comment 18

[Dave Townsend [:mossop]]

Filed bug 698147 for test_bug449027.js, test_bug455906.js and test_bug514327_3.js.

The other 20 or 30 tests in toolkit/mozapps/extensions that are marked as hanging seem to be passing just fine for me.

We should fix xpcshell.ini to point to actual bugs for issues.

Comment 19

[Robert Strong (they/them - no direct email)]

Comment on attachment 570138 [details]
log for test_0010_timermanager.js

test_timermanager no longer fails and is enabled

Comment 20

[Mark Banner (:standard8)]

It looks like any remaining references to this bug are in toolkit/mozapps/extensions, so moving across to that component.