1223871 - [GIJ_FAILS_ON_DEVICE] First Time Use > FTU Click Thru

Status: RESOLVED WONTFIX

(Firefox OS Graveyard :: Gaia::First Time Experience, defect)

Description

[John Dorlus [:Silne30]]

This whole test suite fails on device but works on desktop.

Error: Timeout exception

Comment 1

[John Dorlus [:Silne30]]

I apologize. Scratch the first sentence of the previous comment.

This test fails with a timeout exception.

Comment 2

[Sam Foster [:sfoster] (he/him)]

> This test fails with a timeout exception.

Thanks, I'll take a look. Is this a new regression or just the first time recently we've run the test on device? Can you attach logs and details of which device and gecko & gaia versions?

Comment 3

[John Dorlus [:Silne30]]

(In reply to Sam Foster [:sfoster] from comment #2)
> > This test fails with a timeout exception.
> 
> Thanks, I'll take a look. Is this a new regression or just the first time
> recently we've run the test on device? Can you attach logs and details of
> which device and gecko & gaia versions?

We only recently have gotten tests able to run on device. This fails on both flame and Aries. I will get you gecko and gaia versions in a bit.

Comment 4

[John Dorlus [:Silne30]]

Build# 20151030113931
Commit # 32ec5405
Aries Device

Comment 5

[Sam Foster [:sfoster] (he/him)]

I've just run this a couple of times on a Flame with nightly/moz-central build and gaia master and it passes each time for me - with 1024MB and also 319MB memory configured. As the tests are running on device, I'm not sure if there's anything to tweak on my end to match the environment that produced this bug. Can we re-test?

Comment 6

[Johan Lorenzo [:jlorenzo]]

I ran the suite with that command line, against an aries[1].
> BUILDAPP=device TEST_FILES=apps/ftu/test/marionette/ftu_test.js NODE_DEBUG=* make test-integration

Every single test passed from my side:
> TEST-START | apps/ftu/test/marionette/ftu_test.js | First Time Use > FTU comes up on profile generation
> TEST-PASS | apps/ftu/test/marionette/ftu_test.js | First Time Use > FTU comes up on profile generation
> TEST-END | apps/ftu/test/marionette/ftu_test.js | First Time Use > FTU comes up on profile generation took 6452 ms
> TEST-START | apps/ftu/test/marionette/ftu_test.js | First Time Use > FTU click thru
> TEST-PASS | apps/ftu/test/marionette/ftu_test.js | First Time Use > FTU click thru
> TEST-END | apps/ftu/test/marionette/ftu_test.js | First Time Use > FTU click thru took 21450 ms
> TEST-START | apps/ftu/test/marionette/ftu_test.js | First Time Use > FTU user timing
> TEST-PASS | apps/ftu/test/marionette/ftu_test.js | First Time Use > FTU user timing
> TEST-END | apps/ftu/test/marionette/ftu_test.js | First Time Use > FTU user timing took 14910 ms
> *~*~* Results *~*~*
> passed: 3
> failed: 0
> todo: 0

John, if that issues still occurs on your side, could you provide a stacktrace? 

[1] Build ID               20151219131630
Gaia Revision          bc1ffac8950caf728c0e3ec5cec9a1b224f2e024
Gaia Date              2015-12-18 17:06:56
Gecko Revision         https://hg.mozilla.org/mozilla-central/rev/388bdc46ba51ee31da8b8abe977e0ca38d117434
Gecko Version          46.0a1
Device Name            aries
Firmware(Release)      4.4.2
Firmware(Incremental)  eng.worker.20151219.123525
Firmware Date          Sat Dec 19 12:35:33 UTC 2015
Bootloader             s1

Comment 7

[John Dorlus [:Silne30]]

No longer relevant.