1123672 - Investigate failure in test_IMAP_email_notification.py

Status: RESOLVED FIXED

(Firefox OS Graveyard :: Gaia::UI Tests, defect)

Description

[Viorela Ioia [:viorela]]

Test test_IMAP_email_notification.py has failed in latest mozilla-central build: http://jenkins1.qa.scl3.mozilla.com/job/flame-kk-319.mozilla-central.ui.functional.smoke/274/HTML_Report/
The test is failing while asserting that the senders email is the expected one. 
A potential fix here would be to wait for senders email to equal the expected email.

I wasn't able to replicate the failure locally manually or by running the automated test in a loop. 

Traceback (most recent call last):
File "/var/jenkins/1/workspace/flame-kk-319.mozilla-central.ui.functional.smoke/.env/local/lib/python2.7/site-packages/marionette_client-0.8.6-py2.7.egg/marionette/marionette_test.py", line 268, in run
testMethod()
File "/var/jenkins/1/workspace/flame-kk-319.mozilla-central.ui.functional.smoke/tests/python/gaia-ui-tests/gaiatest/tests/functional/email/test_IMAP_email_notification.py", line 72, in test_IMAP_email_notification
email.senders_email))
AssertionError: Senders's email on the inbox screen is incorrect. Expected email is [e-mail]. Actual email is [e-mail].

Device firmware (base) 	L1TC10011880
Device firmware (date) 	20 Jan 2015 01:38:43
Device firmware (incremental) 	eng.cltbld.20150120.043832
Device firmware (release) 	4.4.2
Device identifier 	flame
Gaia date 	19 Jan 2015 13:39:27
Gaia revision 	a5c5ac093814
Gecko build 	20150120010227
Gecko revision 	c1c6840d9255
Gecko version 	38.0a1

Comment 1

[Viorela Ioia [:viorela]]

I stored email.senders_email in a variable and replace it in the assert and assert message, and I started an adhoc run: http://jenkins1.qa.scl3.mozilla.com/job/flame-kk.ui.adhoc/608/console
The test has failed constanlty with 'Expected email is [e-mail]. Actual email is .
', what means that the actual email was an empty string.
I will open a PR to wait for the senders email to be different from an empty string. 
Another way to fix this issue would be to replace the assert in the test with a wait.

Comment 2

[Viorela Ioia [:viorela]]

Attachment: Github PR: https://github.com/mozilla-b2g/gaia/pull/27527

I started an adhoc with this patch: http://jenkins1.qa.scl3.mozilla.com/view/UI/job/flame-kk.ui.adhoc/616/HTML_Report/
There are 2 failures, unrelated to the one described in this bug.

Comment 3

[Viorela Ioia [:viorela]]

(In reply to Viorela Ioia [:viorela] from comment #2)
> Created attachment 8552432 [details] [review]
> Github PR: https://github.com/mozilla-b2g/gaia/pull/27527
> 
> I started an adhoc with this patch:
> http://jenkins1.qa.scl3.mozilla.com/view/UI/job/flame-kk.ui.adhoc/616/
> HTML_Report/
> There are 2 failures, unrelated to the one described in this bug.

The first test failure is caused by the fact that tapping on the email notification redirects us to emails list, and not to the received email, as expected. But that issue is not what we are investigating in this bug. I will open another bug for that.

Comment 4

[Florin Strugariu [:Bebe]]

https://github.com/mozilla-b2g/gaia/commit/8748598a70770366a9b8e504b69544888d1f582c