919262 - [Bluetooth][PTS][Meta] Bluetooth PTS monthly test (Sep. 2013)

Status: RESOLVED FIXED

(Firefox OS Graveyard :: Bluetooth, defect)

Description

[Hubert Lu[:hlu] <[e-mail]>]

Please RD provides PICS configuration file, then QA will start to perform the PTS test. Final test result report also will be uploaded here for tracking.

Comment 1

[Walter Chen[:ypwalter][:wachen]]

Thanks for Hubert's opening of this bug. I think Ben would give me the file for testing tomorrow (9/25).

CCing Naoki and Tony

Comment 2

[Ben Tian (inactive)]

Attachment: HFP pics

Update HFP pics for v1.2
+ HFP 1.6
+ Individual Indicator Activtion (mandatory for HFP 1.6)
+ CHLD=0

Comment 3

[Ben Tian (inactive)]

Attachment: HSP pics

Identical HSP pics as in bug 905079.

Comment 4

[Ben Tian (inactive)]

Attachment: OPP pics

Identical OPP pics as in bug 905079.

Comment 5

[Ben Tian (inactive)]

Attachment: IOPT pics

Identical IOPT pics as in bug 905079.

Comment 6

[Ben Tian (inactive)]

Attachment: A2DP pics

Comment 7

[Ben Tian (inactive)]

Attachment: AVRCP pics

Comment 8

[Ben Tian (inactive)]

All pics are here, including new A2DP and AVRCP ones. Please use 0929 unagi aurora build [1] to test. Let me know for any testing problem.

[1] https://pvtbuilds.mozilla.org/pub/mozilla.org/b2g/nightly/mozilla-aurora-unagi-eng/2013/09/2013-09-29-00-40-04/

Redirect to QA Walter.

Comment 9

[Walter Chen[:ypwalter][:wachen]]

Hi, all,

I started to test on PTS. I will continuing on opening bugs and communicate on other stuffs with devs soon. After the test, I will be sending out the v1.2 full report for test cases, bugs, and other related stuffs.

Also, please forgive me if there is any delay (Mozilla Summit is coming), I will try to finish it as soon as possible.

PS. Naoki and Tony added in cc list for observing the process

Thanks,
Walter

Comment 10

[Walter Chen[:ypwalter][:wachen]]

OPP done and no bug filed

Comment 11

[Walter Chen[:ypwalter][:wachen]]

IOPT bugs filed
HSP skipped as for now (will do later)

Comment 12

[Ben Tian (inactive)]

Attachment: IOPT pics v2

Update IPOT pics for newly-added A2DP and AVRCP.

Comment 13

[Walter Chen[:ypwalter][:wachen]]

A2DP done and no bug filed.

However, TC_SRC_SET_BV_05_J and TC_SRC_SET_BV_06_J will be skipped this time due to a music app bug.
The music app will only start to play after about a minute.
It's all good before guard timed out.

Comment 14

[Walter Chen[:ypwalter][:wachen]]

HSP: 
Test case : TC_AG_OAC_BV_01_I started
	- SDP Service record for PTS: 'Headset HS' successfully registered
	- Using SDP to determine IUT RFCOMM server channel number.
	- ProtocolDescriptorList: IUT reports that its RFCOMM server channel number is 11
	- ProfileDescriptorList: Headset Profile version retrieved successfully
	- FATAL ERROR (AT): Error in SPP connect response
	- MTC received unexpected EXIT message from AT component
	- MTC: Test case ended
Final Verdict : Inconclusive

Comment 15

[Ben Tian (inactive)]

Walter, please try running HSP TC_AG_IAC_BV_01_I (under AG_IAC) first and then re-run TC_AG_OAC_BV_01_I.

We think this inconclusion results from PTS tool. Let me know if you meet further problem.

Comment 16

[Walter Chen[:ypwalter][:wachen]]

Test case : TC_TG_CEC_BV_02_I 
Test case : TC_TG_MDI_BV_02_C 
Can't run for some reason

Test case : TC_TG_CEC_BV_02_I started
 - MTC: SDP Service record was successfully registered.
 - A2DP SNK SDP Service record successfully registered
 - A2DP SNKsuccessfully registered
 - User canceled the current operation MMI.
 - AVCTP: Exiting AVCTP1 PTC
 - AVDTP: Exiting AVDTP1 PTC
 - CM_PTC_EXIT
 - MMI CM_EXIT
 - MTC: Test case ended
Final Verdict : Inconclusive

Test case : TC_TG_MDI_BV_02_C started
 - MTC: SDP Service record was successfully registered.
 - A2DP SNK SDP Service record successfully registered
 - A2DP SNKsuccessfully registered
 - MTC: IUT successfully responded to AVDTP CONNECT.
 - MTC: IUT successfully accepted AVCTP channel connection.

Comment 17

[Walter Chen[:ypwalter][:wachen]]

AVRCP done with 2 incinclusive and failure.
IOPT done and passed

Comment 18

[Walter Chen[:ypwalter][:wachen]]

HSP still can't be executed.

Comment 19

[Walter Chen[:ypwalter][:wachen]]

All the tests has been finished. I will try to come up with a report of all tests and some summary of v1.2.

Comment 20

[Walter Chen[:ypwalter][:wachen]]

All the bug are now solved.

Comment 21

[Jamin Liu [:jaliu][:Jamin]]

Hi Walter,
All pics are here, Please use 11/21 hamachi build [1] to test. Please feel free to let me know if you have any testing problem.
Thank you very much.

[1] https://pvtbuilds.mozilla.org/pvt/mozilla.org/b2g_ril/hamachi-eng-mozilla-b2g26_v1_2-20131121004002-ril01.02.00.019.102.zip

These PTS test cases are hard to perform.
I think SQA found skip them until we find better way to do these test.
HFP AG_ACS - Requires to close SCO but keep Service level connection.
HFP AG_TCA - Requires to close SCO but keep Service level connection.
HFP AG_OOR - Requires to close Bluetooth, and enable cellular
HFP AG_TRS - Requires to close cellular but enable Bluetooth
HFP AG_PSI - Requires battery change

SQA don't have to pass this test case IOPT TC_COD_BV_02_I, since it has been implemented under HFP15 in PTS.

I'll put more information for PTS test and update Bug 924800 later.

Comment 22

[Jamin Liu [:jaliu][:Jamin]]

Hi all,
I'm sorry, please ignore my last comment.
That comment should be added to Bug 939706.