1236908 - Intermittent: test_dialer_dsds_receive_call_on_both_sims.py fails because SIM cards are swapped

Status: RESOLVED FIXED

(Firefox OS Graveyard :: Bitbar, defect)

Description

[Johan Lorenzo [:jlorenzo]]

Found in Jenkins[1] and Taskcluster[2]

> 07:42:51  3:16.78 TEST_START: MainThread test_dialer_dsds_receive_call_on_both_sims.py TestDsdsReceiveCallOnBothSims.test_dsds_receive_call_on_both_sims_1
> 07:44:13  4:38.79 TEST_END: MainThread FAIL, expected PASS
> 07:44:13 Traceback (most recent call last):
> 07:44:13   File "/var/lib/jenkins/jobs/flame-kk-512.mozilla-central.tinderbox.ui.functional.dsds.bitbar/workspace/.env/lib/python2.7/site-packages/marionette_client-2.0.0-py2.7.egg/marionette/marionette_test.py", line 344, in run
> 07:44:13     testMethod()
> 07:44:13   File "/var/lib/jenkins/jobs/flame-kk-512.mozilla-central.tinderbox.ui.functional.dsds.bitbar/workspace/.env/lib/python2.7/site-packages/marionette_client-2.0.0-py2.7.egg/marionette/marionette_test.py", line 222, in wrapper
> 07:44:13     return func(self, *args, **kwargs)
> 07:44:13   File "/var/lib/jenkins/jobs/flame-kk-512.mozilla-central.tinderbox.ui.functional.dsds.bitbar/workspace/tests/python/gaia-ui-tests/gaiatest/tests/functional/dialer/test_dialer_dsds_receive_call_on_both_sims.py", line 42, in test_dsds_receive_call_on_both_sims
> 07:44:13     self.assertTrue(sim_name in call_screen.incoming_via_sim)
> 07:44:13 AssertionError: False is not true

[1] http://jenkins1.qa.scl3.mozilla.com/view/UI/job/flame-kk-512.mozilla-central.tinderbox.ui.functional.dsds.bitbar/1099/console
[2] https://tools.taskcluster.net/task-inspector/#RGhZsT-bTOm-o9l_jVeiJQ/0

Comment 1

[GitHub Autolander Bot]

Attachment: PR: Make the assertion more verbose

Comment 2

[Johan Lorenzo [:jlorenzo]]

Comment on attachment 8704158 [details] [review]
PR: Make the assertion more verbose

This won't solve the issue, but the error message will be more explicit:. For example:
> TEST-UNEXPECTED-FAIL | test_dialer_dsds_receive_call_on_both_sims.py TestDsdsReceiveCallOnBothSims.test_dsds_receive_call_on_both_sims_1 | AssertionError: 'expected string' not found in u'{"n":1}'

Comment 3

[No-Jun Park [:njpark]]

Comment on attachment 8704158 [details] [review]
PR: Make the assertion more verbose

lgtm

Comment 4

[Johan Lorenzo [:jlorenzo]]

Verbose patch landed in master at: https://github.com/mozilla-b2g/gaia/commit/16ebbfb6ce62c14573982b0aa87537ef8f857047

Comment 5

[Johan Lorenzo [:jlorenzo]]

After seeing a couple of logs[1], it seems like SIM cards are simply swapped. A change in the testvars.json file should fix that. We just need to detect which devices are impacted.

[1] https://tools.taskcluster.net/task-inspector/#c6Oi8RdKRsq8LiOLV2DzQQ/0 https://tools.taskcluster.net/task-inspector/#Fu82jR47TIKHtxjIqveB-Q/0

Comment 6

[Johan Lorenzo [:jlorenzo]]

We have 4 devices under the 2-sim-group. I looked into the jobs that succeeded and I found 3 different devices.

I took 5 of the failed jobs, and each time they were running on 356cd0b6. Would it be possible to swap the 2 sims in 356cd0b6, Sakari? Thanks!

Comment 7

[Sakari Rautiainen]

Swapped simcards, slot1 -> slot2 and slot2->slot1

Comment 8

[Johan Lorenzo [:jlorenzo]]

Fixed by comment 7.