[MCTS] Change omni.ja test with a proper presentation in report

RESOLVED FIXED

Status

Firefox OS
Certification Suite
RESOLVED FIXED
3 years ago
3 years ago

People

(Reporter: atsai, Assigned: askeing)

Tracking

Firefox Tracking Flags

(Not tracked)

Details

User Story

Currently, our testing just simply compare the contents after unzip the omni.ja. However, omni.ja sometimes are changed by partners and should not be blocked. We'll need to change the display to show the difference but won't be blocked if there's any difference. To judge the modifications by partners will be done manually by Mozilla.

Attachments

(1 attachment)

54 bytes, text/x-github-pull-request
oo[oouyang]
: review+
Details | Review | Splinter Review
Comment hidden (empty)
(Reporter)

Comment 1

3 years ago
Per offline discuss, Askeing will take care of this bug.
QA Contact: fyen
(Reporter)

Updated

3 years ago
Assignee: nobody → fyen
QA Contact: fyen
(Assignee)

Comment 2

3 years ago
Created attachment 8582301 [details] [review]
PR 248

test end support: [PASS | FAIL | OK | ERROR | TIMEOUT | CRASH | ASSERT | SKIP]
test status support: [PASS | FAIL | TIMEOUT | NOTRUN]

1. There is no difference.
*  Test End "OK"
*  Status "PASS" with "The omni.ja on device is the same as reference file omni.ja".
2. There are difference between device and ref omni.ja file.
*  Test End "OK"
*  Status "Fail" with "Diff Result".
3. Run diff faile.
*  Test End "Fail"
*  Status "Fail" with "error running diff..." message.
Attachment #8582301 - Flags: review?(oouyang)
(Assignee)

Comment 3

3 years ago
(In reply to Askeing Yen[:askeing] from comment #2)
> Created attachment 8582301 [details] [review]
> PR 248
> 
> test end support: [PASS | FAIL | OK | ERROR | TIMEOUT | CRASH | ASSERT |
> SKIP]
> test status support: [PASS | FAIL | TIMEOUT | NOTRUN]
> 
> 1. There is no difference.
> *  Test End "OK"
> *  Status "PASS" with "The omni.ja on device is the same as reference file
> omni.ja".
> 2. There are difference between device and ref omni.ja file.
> *  Test End "OK"
> *  Status "Fail" with "Diff Result".
> 3. Run diff faile.
> *  Test End "Fail"
> *  Status "Fail" with "error running diff..." message.

ref: http://lxr.mozilla.org/mozilla-central/source/testing/mozbase/mozlog/mozlog/structured/structuredlog.py#25

Comment 4

3 years ago
Comment on attachment 8582301 [details] [review]
PR 248

LGTM
Attachment #8582301 - Flags: review?(oouyang) → review+
(Assignee)

Comment 5

3 years ago
https://github.com/mozilla-b2g/fxos-certsuite/commit/a6cc263c6341316c1bcf65863031d70b1a6ba7c3
Status: NEW → RESOLVED
Last Resolved: 3 years ago
Resolution: --- → FIXED
(Assignee)

Updated

3 years ago
Blocks: 1153728
You need to log in before you can comment on or make changes to this bug.