Open Bug 1030228 Opened 9 years ago Updated 6 months ago

[mozlog] Result.html doesn't contain the 'message' string for web-platform-test failures

Categories

(Testing :: Mozbase, defect)

Product:
Testing
Component:
Mozbase
Type:
defect

Tracking

(Not tracked)

People

(Reporter: jgriffin, Unassigned)

References

Details

Result.html contains results for wpt tests, but it only shows the status; it should also show the 'reason' string, e.g.,

{"status": "ERROR", "thread": "Thread-TestrunnerManager-1", "pid": 27396, "source": "web-platform-tests", "test": "/IndexedDB/interfaces.html", "time": 1403671217266, "action": "test_end", "message": "ReferenceError: WebIDL2 is not defined", "expected": "OK"}

should show as "ReferenceError: WebIDL2 is not defined".
This is the top-level results.html, or the subsuite-specific html?
(In reply to Ted Mielczarek [:ted.mielczarek] from comment #1)
> This is the top-level results.html, or the subsuite-specific html?

Sorry, this is in the web-platform-tests_structured.html sub-suite html.
Okay, then this is a mozlog bug.
Component: Certification Suite → Mozbase
Product: Firefox OS → Testing
QA Contact: hskupin
Summary: Result.html doesn't contain the 'reason' string for web-platform-test failures → [mozlog.structured] Result.html doesn't contain the 'reason' string for web-platform-test failures
Summary: [mozlog.structured] Result.html doesn't contain the 'reason' string for web-platform-test failures → [mozlog.structured] Result.html doesn't contain the 'message' string for web-platform-test failures
For fxos-certsuite I think we want a different report format anyway, so that we don't report tests where the result is better than expected.
Summary: [mozlog.structured] Result.html doesn't contain the 'message' string for web-platform-test failures → [mozlog] Result.html doesn't contain the 'message' string for web-platform-test failures
Severity: normal → S3
You need to log in before you can comment on or make changes to this bug.