Closed Bug 1236908 Opened 6 years ago Closed 6 years ago

Intermittent: test_dialer_dsds_receive_call_on_both_sims.py fails because SIM cards are swapped

Categories

(Firefox OS Graveyard :: Bitbar, defect)

ARM
Gonk (Firefox OS)
defect
Not set
normal

Tracking

(Not tracked)

RESOLVED FIXED

People

(Reporter: u504868, Assigned: u504868)

References

Details

(Keywords: intermittent-failure)

Attachments

(1 file)

46 bytes, text/x-github-pull-request
njpark
: review+
martijn.martijn
: review+
Details | Review
Found in Jenkins[1] and Taskcluster[2]

> 07:42:51  3:16.78 TEST_START: MainThread test_dialer_dsds_receive_call_on_both_sims.py TestDsdsReceiveCallOnBothSims.test_dsds_receive_call_on_both_sims_1
> 07:44:13  4:38.79 TEST_END: MainThread FAIL, expected PASS
> 07:44:13 Traceback (most recent call last):
> 07:44:13   File "/var/lib/jenkins/jobs/flame-kk-512.mozilla-central.tinderbox.ui.functional.dsds.bitbar/workspace/.env/lib/python2.7/site-packages/marionette_client-2.0.0-py2.7.egg/marionette/marionette_test.py", line 344, in run
> 07:44:13     testMethod()
> 07:44:13   File "/var/lib/jenkins/jobs/flame-kk-512.mozilla-central.tinderbox.ui.functional.dsds.bitbar/workspace/.env/lib/python2.7/site-packages/marionette_client-2.0.0-py2.7.egg/marionette/marionette_test.py", line 222, in wrapper
> 07:44:13     return func(self, *args, **kwargs)
> 07:44:13   File "/var/lib/jenkins/jobs/flame-kk-512.mozilla-central.tinderbox.ui.functional.dsds.bitbar/workspace/tests/python/gaia-ui-tests/gaiatest/tests/functional/dialer/test_dialer_dsds_receive_call_on_both_sims.py", line 42, in test_dsds_receive_call_on_both_sims
> 07:44:13     self.assertTrue(sim_name in call_screen.incoming_via_sim)
> 07:44:13 AssertionError: False is not true

[1] http://jenkins1.qa.scl3.mozilla.com/view/UI/job/flame-kk-512.mozilla-central.tinderbox.ui.functional.dsds.bitbar/1099/console
[2] https://tools.taskcluster.net/task-inspector/#RGhZsT-bTOm-o9l_jVeiJQ/0
Comment on attachment 8704158 [details] [review]
PR: Make the assertion more verbose

This won't solve the issue, but the error message will be more explicit:. For example:
> TEST-UNEXPECTED-FAIL | test_dialer_dsds_receive_call_on_both_sims.py TestDsdsReceiveCallOnBothSims.test_dsds_receive_call_on_both_sims_1 | AssertionError: 'expected string' not found in u'{"n":1}'
Attachment #8704158 - Attachment description: [gaia] JohanLorenzo:bug-1236908 > mozilla-b2g:master → PR: Make the assertion more verbose
Attachment #8704158 - Flags: review?(npark)
Attachment #8704158 - Flags: review?(martijn.martijn)
Comment on attachment 8704158 [details] [review]
PR: Make the assertion more verbose

lgtm
Attachment #8704158 - Flags: review?(npark) → review+
Assignee: nobody → jlorenzo
Attachment #8704158 - Flags: review?(martijn.martijn) → review+
After seeing a couple of logs[1], it seems like SIM cards are simply swapped. A change in the testvars.json file should fix that. We just need to detect which devices are impacted.

[1] https://tools.taskcluster.net/task-inspector/#c6Oi8RdKRsq8LiOLV2DzQQ/0 https://tools.taskcluster.net/task-inspector/#Fu82jR47TIKHtxjIqveB-Q/0
We have 4 devices under the 2-sim-group. I looked into the jobs that succeeded and I found 3 different devices.

I took 5 of the failed jobs, and each time they were running on 356cd0b6. Would it be possible to swap the 2 sims in 356cd0b6, Sakari? Thanks!
Component: Gaia::UI Tests → Bitbar
Flags: needinfo?(sakari.rautiainen)
See Also: → 1237625
Blocks: 1225457
Summary: Intermittent: AssertionError: False is not true in test_dialer_dsds_receive_call_on_both_sims.py → Intermittent: test_dialer_dsds_receive_call_on_both_sims.py fails because SIM cards are swapped
Swapped simcards, slot1 -> slot2 and slot2->slot1
Flags: needinfo?(sakari.rautiainen)
Fixed by comment 7.
Status: NEW → RESOLVED
Closed: 6 years ago
Resolution: --- → FIXED
You need to log in before you can comment on or make changes to this bug.