Closed Bug 1101227 Opened 10 years ago Closed 10 years ago

Intermittent test_system_notification_bar.py TestNotificationBar.test_notification_bar | AssertionError: 'TestNotificationBar_BODY' != u'

Categories

(Firefox OS Graveyard :: Gaia::UI Tests, defect)

Product:
Firefox OS Graveyard
Component:
Gaia::UI Tests
Type:
defect
Priority:
Not set
Severity:
normal

Tracking

(Not tracked)

Status:
RESOLVED FIXED

People

(Reporter: KWierso, Assigned: Bebe)

References

Details

(Keywords: intermittent-failure)

Attachments

(1 file)

github pr
46 bytes, text/x-github-pull-request
Details | Review 
11:28:13 INFO - TEST-START | test_settings_wallpaper.py TestWallpaper.test_change_wallpaper
11:28:41 INFO - TEST-PASS | test_settings_wallpaper.py TestWallpaper.test_change_wallpaper | took 27833ms
11:28:41 INFO - TEST-START | test_system_notification_bar.py TestNotificationBar.test_notification_bar
11:29:08 ERROR - TEST-UNEXPECTED-FAIL | test_system_notification_bar.py TestNotificationBar.test_notification_bar | AssertionError: 'TestNotificationBar_BODY' != u''
11:29:08 INFO - Traceback (most recent call last):
11:29:08 INFO - File "/builds/slave/test/build/venv/local/lib/python2.7/site-packages/marionette/marionette_test.py", line 267, in run
11:29:08 INFO - testMethod()
11:29:08 INFO - File "/builds/slave/test/gaia/tests/python/gaia-ui-tests/gaiatest/tests/functional/system/test_system_notification_bar.py", line 37, in test_notification_bar
11:29:08 INFO - self.assertEqual(self._notification_body, notifications[0].content)
11:29:08 INFO - TEST-INFO took 27677ms
11:29:08 INFO - TEST-START | test_system_message_pending.py TestSystemMessage.test_pending_system_message
11:29:26 INFO - TEST-PASS | test_system_message_pending.py TestSystemMessage.test_pending_system_message | took 18149ms
11:29:26 INFO - TEST-START | test_privileged_app_contacts_prompt.py TestPrivilegedAppContactsPrompt.test_contact_prompt
11:29:48 INFO - TEST-PASS | test_privileged_app_contacts_prompt.py TestPrivilegedAppContactsPrompt.test_contact_prompt | took 21768ms
11:29:48 INFO - TEST-START | test_privileged_app_device_sdcard_prompt.py TestPrivilegedAppDeviceSDcardPrompt.test_get_sdcard_prompt
11:30:09 INFO - TEST-PASS | test_privileged_app_device_sdcard_prompt.py TestPrivilegedAppDeviceSDcardPrompt.test_get_sdcard_prompt | took 21212ms
11:30:09 INFO - TEST-START | test_video_empty.py TestVideoEmpty.test_empty_video
11:30:29 INFO - TEST-PASS | test_video_empty.py TestVideoEmpty.test_empty_video | took 19147ms
11:30:29 INFO - TEST-START | test_play_ogg_video.py TestPlayOGGVideo.test_play_ogg_video
11:30:53 INFO - TEST-PASS | test_play_ogg_video.py TestPlayOGGVideo.test_play_ogg_video | took 23922ms
This (and another f2 failure I'm about to file) seemed to have started up on my backout of bug 1044736. Was there something else we needed to back out to get everything working?
Flags: needinfo?(kchen)
(In reply to Wes Kocher (:KWierso) from comment #1)
> This (and another f2 failure I'm about to file) seemed to have started up on
> my backout of bug 1044736. Was there something else we needed to back out to
> get everything working?

I don't think there are any more patches need back out. I'll take a look when investigating the earlier failures.
Flags: needinfo?(kchen)
Component: Gaia::System → Gaia::UI Tests
QA Whiteboard: [fxosqa-auto-backlog+]
QA Whiteboard: [fxosqa-auto-backlog+] → [fxosqa-auto-s4+]
Assignee: nobody → florin.strugariu
The Utility try opens and then immediately closes after that

We need to update the wait_for_notification_container_displayed and investigate why the Utility try closes
This was caused by:
https://bugzilla.mozilla.org/show_bug.cgi?id=1098118

which was backed out, but then the changed was landed again in:
https://bugzilla.mozilla.org/show_bug.cgi?id=1099137
Depends on: 1098118, 1099137
(In reply to Zac C (:zac) from comment #95)
> This was caused by:
> https://bugzilla.mozilla.org/show_bug.cgi?id=1098118
> 
> which was backed out, but then the changed was landed again in:
> https://bugzilla.mozilla.org/show_bug.cgi?id=1099137

I doubt that this was caused by 1098118. The failure continues even 1098118 was backed out.
(In reply to Kan-Ru Chen [:kanru] from comment #96)
> (In reply to Zac C (:zac) from comment #95)
> > This was caused by:
> > https://bugzilla.mozilla.org/show_bug.cgi?id=1098118
> > 
> > which was backed out, but then the changed was landed again in:
> > https://bugzilla.mozilla.org/show_bug.cgi?id=1099137
> 
> I doubt that this was caused by 1098118. The failure continues even 1098118
> was backed out.

You're right, it was probably https://bugzilla.mozilla.org/show_bug.cgi?id=1044736
Attached file github pr — 
Gecko or something is cancelling the flick events before the status bar can lock into place.

Occasionally the utility bar stays open for just long enough for the test to pass and that is the cause of the intermittent.

This patch to the test uses move_by_offset which is not susceptible, for whatever reason.
Attachment #8526822 - Flags: review?(gmealer)
(In reply to Zac C (:zac) from comment #97)
> (In reply to Kan-Ru Chen [:kanru] from comment #96)
> > (In reply to Zac C (:zac) from comment #95)
> > > This was caused by:
> > > https://bugzilla.mozilla.org/show_bug.cgi?id=1098118
> > > 
> > > which was backed out, but then the changed was landed again in:
> > > https://bugzilla.mozilla.org/show_bug.cgi?id=1099137
> > 
> > I doubt that this was caused by 1098118. The failure continues even 1098118
> > was backed out.
> 
> You're right, it was probably
> https://bugzilla.mozilla.org/show_bug.cgi?id=1044736

Nope. The test fails when 1044736 was backed out too.
(In reply to Kan-Ru Chen [:kanru] from comment #99)
> (In reply to Zac C (:zac) from comment #97)
> > (In reply to Kan-Ru Chen [:kanru] from comment #96)
> > > (In reply to Zac C (:zac) from comment #95)
> > > > This was caused by:
> > > > https://bugzilla.mozilla.org/show_bug.cgi?id=1098118
> > > > 
> > > > which was backed out, but then the changed was landed again in:
> > > > https://bugzilla.mozilla.org/show_bug.cgi?id=1099137
> > > 
> > > I doubt that this was caused by 1098118. The failure continues even 1098118
> > > was backed out.
> > 
> > You're right, it was probably
> > https://bugzilla.mozilla.org/show_bug.cgi?id=1044736
> 
> Nope. The test fails when 1044736 was backed out too.

The very earliest instance I can find of it failing on b2g-i is:
https://hg.mozilla.org/integration/b2g-inbound/rev/5f740aacca6d
In any case, I think these patches have just exposed some downstream bugs. For example this only seems to occur on linux, not mac, which could point to some kind of different Gecko path.
Attachment #8526822 - Flags: review?(gmealer)
Merged on master
Status: NEW → RESOLVED
Closed: 10 years ago
Resolution: --- → FIXED
You need to log in before you can comment on or make changes to this bug.

Attachment

General

Creator:
Created:
Updated:
Size: