Investigate failure in test_settings_do_not_track.py

RESOLVED FIXED

Status

defect
RESOLVED FIXED
4 years ago
4 years ago

People

(Reporter: viorela, Assigned: viorela)

Tracking

Firefox Tracking Flags

(Not tracked)

Details

Attachments

(3 attachments)

Assignee

Description

4 years ago
Test test_settings_do_not_track.py is failing on latest m-c: http://jenkins1.qa.scl3.mozilla.com/job/flame-kk-319.mozilla-central.ui.functional.non-smoke.1/172/HTML_Report/
I've been able to reproduce the failure locally, the test is failing intermittently; repro rate: 4/5
Probably we should add a better wait, before checking if the pref is True/False.  

Traceback (most recent call last):
File "/var/jenkins/1/workspace/flame-kk-319.mozilla-central.ui.functional.non-smoke.1/.env/local/lib/python2.7/site-packages/marionette_client-0.8.7-py2.7.egg/marionette/marionette_test.py", line 283, in run
testMethod()
File "/var/jenkins/1/workspace/flame-kk-319.mozilla-central.ui.functional.non-smoke.1/tests/python/gaia-ui-tests/gaiatest/tests/functional/settings/test_settings_do_not_track.py", line 33, in test_enable_do_not_track_via_settings_app
self.assertEqual(self.data_layer.get_bool_pref('privacy.donottrackheader.enabled'), True)
AssertionError: False != True

Device firmware (base) 	L1TC100118D0
Device firmware (date) 	03 Feb 2015 06:16:28
Device firmware (incremental) 	eng.cltbld.20150203.091617
Device firmware (release) 	4.4.2
Device identifier 	flame
Gaia date 	02 Feb 2015 11:50:21
Gaia revision 	ae5a1580da94
Gecko build 	20150203052826
Gecko revision 	b28f97ae095a
Gecko version 	38.0a1
Before https://github.com/mozilla-b2g/gaia/commit/a0529167d625c8a99d58ff249b12b98bd2aff973 the app object waited for both prefs. I modified it to wait for the UI cues but this didn't appear to be enough for the int pref, and apparently is sometimes not enough for the boolean also. We could just change the assert to a wait in the test.
Assignee

Updated

4 years ago
Assignee: nobody → viorela.ioia
QA Whiteboard: [fxosqa-auto-s9]
Assignee

Updated

4 years ago
Attachment #8559044 - Flags: review?(florin.strugariu)
Attachment #8559044 - Flags: review?(dave.hunt)
Attachment #8559044 - Flags: review?(florin.strugariu)
Attachment #8559044 - Flags: review?(dave.hunt)
Attachment #8559044 - Flags: review+
You need to log in before you can comment on or make changes to this bug.