1039215 - [MTCS][fxos-certsuite-1.3.0.9] SMS Incoming/outgoing and Telephony Incoming/outing keep failing

Status: RESOLVED FIXED

(Firefox OS Graveyard :: Certification Suite, defect)

Description

[Vance Chen [:vchen][skype:vance.lucida][[e-mail]]]

Attachment: firefox-os-certification_20140716151353.zip

Running the MCTS v1.3.0.9 with Mac OS and python 2.7.6. In the Conformance Test part, the SMS Incoming/Outgoing part is always fail even if the tester follow the instruction on the screen.

As to the telephony incoming/outing test, it just fail...we don't see any incoming/outgoing call activities at all

Attached please find the logs

Comment 1

[Jonathan Griffin (:jgriffin)]

Rob, can you take a look and see if you can reproduce this?

Comment 2

[Robert Wood [:rwood]]

I ran the semi-auto webapi tests on hamachi with the latest 1.3 build.

The webapi SMS tests all passed.

The webapi telephony tests fail on 1.3, because disabling the default dialer agent is broken in 1.3 (known issue).

Unfortunately the webapi_structured.log file is missing from the attached results.zip (looks like there was a mozlog error for some reason), therefore no logs for the semiauto webapi tests were provided. Therefore I am unable to verify that the telephony tests failed for the same reason (dialer agent), and there is no insight into the SMS failures.

Please try running the tests again and see if you can get a webapi_structured.log file; if not if you could take a screenshot of the browser test runner itself while the SMS and Telephony webapi test results/failures are displayed, that would be really helpful. Thanks!

Comment 3

[Jonathan Griffin (:jgriffin)]

Note that MCTS 1.3.0.10 has been released and may provide better logging in case of failure.

Comment 4

[Jonathan Griffin (:jgriffin)]

(In reply to Robert Wood [:rwood] from comment #2)
> I ran the semi-auto webapi tests on hamachi with the latest 1.3 build.
> 
> The webapi SMS tests all passed.
> 
> The webapi telephony tests fail on 1.3, because disabling the default dialer
> agent is broken in 1.3 (known issue).
> 
Should we disable telephony tests on 1.3 then?

Comment 5

[Robert Wood [:rwood]]

They run fine on 1.3T on tarako though (I'm guessing they back-ported the new callscreen there but not to 1.3).

Comment 6

[Jonathan Griffin (:jgriffin)]

We've added code to disable the Telephony tests on devices where we can't disable the dialer agent (a necessary pre-requisite to running the tests).  The SMS tests seem to work fine with the latest release, so closing this; please re-open if needed.