Closed Bug 1144536 Opened 9 years ago Closed 9 years ago

[MCTS] Change omni.ja test with a proper presentation in report

Categories

(Firefox OS Graveyard :: Certification Suite, defect)

x86
macOS
defect
Not set
normal

Tracking

(Not tracked)

RESOLVED FIXED

People

(Reporter: atsai, Assigned: askeing)

References

Details

User Story

Currently, our testing just simply compare the contents after unzip the omni.ja. However, omni.ja sometimes are changed by partners and should not be blocked. We'll need to change the display to show the difference but won't be blocked if there's any difference. To judge the modifications by partners will be done manually by Mozilla.

Attachments

(1 file)

54 bytes, text/x-github-pull-request
oouyang
: review+
Details | Review
      No description provided.
Per offline discuss, Askeing will take care of this bug.
QA Contact: fyen
Assignee: nobody → fyen
QA Contact: fyen
Attached file PR 248
test end support: [PASS | FAIL | OK | ERROR | TIMEOUT | CRASH | ASSERT | SKIP]
test status support: [PASS | FAIL | TIMEOUT | NOTRUN]

1. There is no difference.
*  Test End "OK"
*  Status "PASS" with "The omni.ja on device is the same as reference file omni.ja".
2. There are difference between device and ref omni.ja file.
*  Test End "OK"
*  Status "Fail" with "Diff Result".
3. Run diff faile.
*  Test End "Fail"
*  Status "Fail" with "error running diff..." message.
Attachment #8582301 - Flags: review?(oouyang)
(In reply to Askeing Yen[:askeing] from comment #2)
> Created attachment 8582301 [details] [review]
> PR 248
> 
> test end support: [PASS | FAIL | OK | ERROR | TIMEOUT | CRASH | ASSERT |
> SKIP]
> test status support: [PASS | FAIL | TIMEOUT | NOTRUN]
> 
> 1. There is no difference.
> *  Test End "OK"
> *  Status "PASS" with "The omni.ja on device is the same as reference file
> omni.ja".
> 2. There are difference between device and ref omni.ja file.
> *  Test End "OK"
> *  Status "Fail" with "Diff Result".
> 3. Run diff faile.
> *  Test End "Fail"
> *  Status "Fail" with "error running diff..." message.

ref: http://lxr.mozilla.org/mozilla-central/source/testing/mozbase/mozlog/mozlog/structured/structuredlog.py#25
Comment on attachment 8582301 [details] [review]
PR 248

LGTM
Attachment #8582301 - Flags: review?(oouyang) → review+
https://github.com/mozilla-b2g/fxos-certsuite/commit/a6cc263c6341316c1bcf65863031d70b1a6ba7c3
Status: NEW → RESOLVED
Closed: 9 years ago
Resolution: --- → FIXED
Blocks: 1153728
You need to log in before you can comment on or make changes to this bug.

Attachment

General

Created:
Updated:
Size: