Closed Bug 1843285 Opened 2 years ago Closed 2 years ago

Perma TEST-UNEXPECTED-NOTRUN | /webcodecs/videoDecoder-codec-specific.https.any.worker.html?h265_hevc | Test isConfigSupported() - expected PRECONDITION_FAILED when Gecko 117 merges to Beta on 2023-07-31

Categories

(Core :: Audio/Video: Web Codecs, defect)

Product:
Core
Component:
Audio/Video: Web Codecs
Type:
defect

Tracking

()

Status:
VERIFIED FIXED
Milestone:
117 Branch
Tracking Flags:
Tracking Status
firefox-esr102 --- unaffected
firefox-esr115 --- unaffected
firefox115 --- unaffected
firefox116 --- unaffected
firefox117 + verified

People

(Reporter: smolnar, Assigned: chunmin)

References

(Regression)

Details

(Keywords: regression)

Attachments

(1 obsolete file)

Central as beta simulation

How to run these simulations

Failure log

TEST-UNEXPECTED-NOTRUN | /webcodecs/videoDecoder-codec-specific.https.any.worker.html?h265_hevc | Test isConfigSupported() - expected PRECONDITION_FAILED
[task 2023-07-13T11:44:12.602Z] 11:44:12     INFO - TEST-INFO | expected PRECONDITION_FAILED
[task 2023-07-13T11:44:12.618Z] 11:44:12     INFO - 
[task 2023-07-13T11:44:12.618Z] 11:44:12     INFO - TEST-UNEXPECTED-NOTRUN | /webcodecs/videoDecoder-codec-specific.https.any.worker.html?h265_hevc | Test isConfigSupported() with 1080p crop - expected PRECONDITION_FAILED
[task 2023-07-13T11:44:12.618Z] 11:44:12     INFO - TEST-INFO | expected PRECONDITION_FAILED
[task 2023-07-13T11:44:12.619Z] 11:44:12     INFO - 
[task 2023-07-13T11:44:12.619Z] 11:44:12     INFO - TEST-UNEXPECTED-NOTRUN | /webcodecs/videoDecoder-codec-specific.https.any.worker.html?h265_hevc | Test that isConfigSupported() returns a parsed configuration - expected PRECONDITION_FAILED
[task 2023-07-13T11:44:12.619Z] 11:44:12     INFO - TEST-INFO | expected PRECONDITION_FAILED
[task 2023-07-13T11:44:12.619Z] 11:44:12     INFO - 
[task 2023-07-13T11:44:12.619Z] 11:44:12     INFO - TEST-UNEXPECTED-NOTRUN | /webcodecs/videoDecoder-codec-specific.https.any.worker.html?h265_hevc | Test invalid configs - expected PRECONDITION_FAILED
[task 2023-07-13T11:44:12.619Z] 11:44:12     INFO - TEST-INFO | expected PRECONDITION_FAILED
[task 2023-07-13T11:44:12.620Z] 11:44:12     INFO - 
[task 2023-07-13T11:44:12.620Z] 11:44:12     INFO - TEST-UNEXPECTED-NOTRUN | /webcodecs/videoDecoder-codec-specific.https.any.worker.html?h265_hevc | Test configure() - expected PRECONDITION_FAILED
[task 2023-07-13T11:44:12.620Z] 11:44:12     INFO - TEST-INFO | expected PRECONDITION_FAILED
[task 2023-07-13T11:44:12.620Z] 11:44:12     INFO - 
[task 2023-07-13T11:44:12.620Z] 11:44:12     INFO - TEST-UNEXPECTED-NOTRUN | /webcodecs/videoDecoder-codec-specific.https.any.worker.html?h265_hevc | Decode a key frame - expected PRECONDITION_FAILED
[task 2023-07-13T11:44:12.620Z] 11:44:12     INFO - TEST-INFO | expected PRECONDITION_FAILED
[task 2023-07-13T11:44:12.621Z] 11:44:12     INFO - 
[task 2023-07-13T11:44:12.621Z] 11:44:12     INFO - TEST-UNEXPECTED-NOTRUN | /webcodecs/videoDecoder-codec-specific.https.any.worker.html?h265_hevc | Decode a non key frame first fails - expected PRECONDITION_FAILED
[task 2023-07-13T11:44:12.621Z] 11:44:12     INFO - TEST-INFO | expected PRECONDITION_FAILED
[task 2023-07-13T11:44:12.622Z] 11:44:12     INFO - 
[task 2023-07-13T11:44:12.622Z] 11:44:12     INFO - TEST-UNEXPECTED-NOTRUN | /webcodecs/videoDecoder-codec-specific.https.any.worker.html?h265_hevc | Verify reset() suppresses outputs - expected PRECONDITION_FAILED
[task 2023-07-13T11:44:12.622Z] 11:44:12     INFO - TEST-INFO | expected PRECONDITION_FAILED
[task 2023-07-13T11:44:12.623Z] 11:44:12     INFO - 
[task 2023-07-13T11:44:12.623Z] 11:44:12     INFO - TEST-UNEXPECTED-NOTRUN | /webcodecs/videoDecoder-codec-specific.https.any.worker.html?h265_hevc | Test unconfigured VideoDecoder operations - expected PRECONDITION_FAILED
[task 2023-07-13T11:44:12.623Z] 11:44:12     INFO - TEST-INFO | expected PRECONDITION_FAILED
[task 2023-07-13T11:44:12.623Z] 11:44:12     INFO - 
[task 2023-07-13T11:44:12.623Z] 11:44:12     INFO - TEST-UNEXPECTED-NOTRUN | /webcodecs/videoDecoder-codec-specific.https.any.worker.html?h265_hevc | Test closed VideoDecoder operations - expected PRECONDITION_FAILED
[task 2023-07-13T11:44:12.623Z] 11:44:12     INFO - TEST-INFO | expected PRECONDITION_FAILED
[task 2023-07-13T11:44:12.624Z] 11:44:12     INFO - 
[task 2023-07-13T11:44:12.624Z] 11:44:12     INFO - TEST-UNEXPECTED-NOTRUN | /webcodecs/videoDecoder-codec-specific.https.any.worker.html?h265_hevc | Decode empty frame - expected PRECONDITION_FAILED
[task 2023-07-13T11:44:12.624Z] 11:44:12     INFO - TEST-INFO | expected PRECONDITION_FAILED
[task 2023-07-13T11:44:12.624Z] 11:44:12     INFO - 
[task 2023-07-13T11:44:12.624Z] 11:44:12     INFO - TEST-UNEXPECTED-NOTRUN | /webcodecs/videoDecoder-codec-specific.https.any.worker.html?h265_hevc | Decode corrupt frame - expected PRECONDITION_FAILED
[task 2023-07-13T11:44:12.625Z] 11:44:12     INFO - TEST-INFO | expected PRECONDITION_FAILED
TEST-UNEXPECTED-NOTRUN | /webcodecs/videoDecoder-codec-specific.https.any.worker.html?h265_hevc | Close while decoding corrupt frame - expected PRECONDITION_FAILED
[task 2023-07-13T11:44:12.625Z] 11:44:12     INFO - TEST-INFO | expected PRECONDITION_FAILED
[task 2023-07-13T11:44:12.625Z] 11:44:12     INFO - 
[task 2023-07-13T11:44:12.626Z] 11:44:12     INFO - TEST-UNEXPECTED-NOTRUN | /webcodecs/videoDecoder-codec-specific.https.any.worker.html?h265_hevc | Test decoding after flush - expected PRECONDITION_FAILED
[task 2023-07-13T11:44:12.626Z] 11:44:12     INFO - TEST-INFO | expected PRECONDITION_FAILED
[task 2023-07-13T11:44:12.626Z] 11:44:12     INFO - 
[task 2023-07-13T11:44:12.626Z] 11:44:12     INFO - TEST-UNEXPECTED-NOTRUN | /webcodecs/videoDecoder-codec-specific.https.any.worker.html?h265_hevc | Test decoding a with negative timestamp - expected PRECONDITION_FAILED
[task 2023-07-13T11:44:12.626Z] 11:44:12     INFO - TEST-INFO | expected PRECONDITION_FAILED
[task 2023-07-13T11:44:12.627Z] 11:44:12     INFO - 
[task 2023-07-13T11:44:12.627Z] 11:44:12     INFO - TEST-UNEXPECTED-NOTRUN | /webcodecs/videoDecoder-codec-specific.https.any.worker.html?h265_hevc | Test reset during flush - expected PRECONDITION_FAILED
[task 2023-07-13T11:44:12.627Z] 11:44:12     INFO - TEST-INFO | expected PRECONDITION_FAILED
[task 2023-07-13T11:44:12.627Z] 11:44:12     INFO - 
[task 2023-07-13T11:44:12.627Z] 11:44:12     INFO - TEST-UNEXPECTED-NOTRUN | /webcodecs/videoDecoder-codec-specific.https.any.worker.html?h265_hevc | Test low-latency decoding - expected PRECONDITION_FAILED
[task 2023-07-13T11:44:12.627Z] 11:44:12     INFO - TEST-INFO | expected PRECONDITION_FAILED
[task 2023-07-13T11:44:12.628Z] 11:44:12     INFO - 
[task 2023-07-13T11:44:12.628Z] 11:44:12     INFO - TEST-UNEXPECTED-NOTRUN | /webcodecs/videoDecoder-codec-specific.https.any.worker.html?h265_hevc | VideoDecoder decodeQueueSize test - expected PRECONDITION_FAILED
[task 2023-07-13T11:44:12.628Z] 11:44:12     INFO - TEST-INFO | expected PRECONDITION_FAILED
[task 2023-07-13T11:44:12.628Z] 11:44:12     INFO - TEST-UNEXPECTED-ERROR | /webcodecs/videoDecoder-codec-specific.https.any.worker.html?h265_hevc | ReferenceError: EncodedVideoChunk is not defined
[task 2023-07-13T11:44:12.628Z] 11:44:12     INFO - CHUNKS<@https://web-platform.test:8443/webcodecs/videoDecoder-codec-specific.https.any.js:217:20
[task 2023-07-13T11:44:12.628Z] 11:44:12     INFO - @https://web-platform.test:8443/webcodecs/videoDecoder-codec-specific.https.any.js:216:23
Flags: needinfo?(james)

Paul, could you have a look over these wpts that would fail on beta on merge day? These were triggered by changes in latest wpt-sync here https://bugzilla.mozilla.org/show_bug.cgi?id=1840364#c2 .
The failing tests across all platforms look something like this.

Component: web-platform-tests → Audio/Video: Web Codecs
Flags: needinfo?(james) → needinfo?(padenot)
Product: Testing → Core
Summary: Perma TEST-UNEXPECTED-NOTRUN | /webcodecs/videoDecoder-codec-specific.https.any.worker.html?h265_hevc | Test isConfigSupported() - expected PRECONDITION_FAILED when Gecko 117 merges to Beta → Perma TEST-UNEXPECTED-NOTRUN | /webcodecs/videoDecoder-codec-specific.https.any.worker.html?h265_hevc | Test isConfigSupported() - expected PRECONDITION_FAILED when Gecko 117 merges to Beta on 2023-07-31
Version: Default → unspecified
Flags: needinfo?(padenot) → needinfo?(cchang)

I'll take a look tomorrow. Keep the NI for now

The only reason for no-return I can think of now is that there is no response from isConfigSupported in checkImplements().

However, I cannot reproduce this on my end and I don't see the reason why there is no response. For h265 codec string, isConfigSupported should be rejected here since it's unsupported codec.

I am going to allow no-return in the expected results for now and investigate this later. I've open bug 1844206 to add more error logs to see what we can find.

Flags: needinfo?(cchang)
Attached file Bug 1843285 - Allow NOTRUN for h265 (obsolete) —
Assignee: nobody → cchang
Status: NEW → ASSIGNED

Aha, I should make IsValid accept h265 string but make IsConfigSupported return unsupported for h265

Let's see if patches in Bug 1844206 can suppress the unexpected results here.

Flags: needinfo?(cchang)

The unexpected results, as per Comment 7, are still appearing and that can be seen in today's beta sim.

Flags: needinfo?(cchang)

(In reply to Serban Stanca [:SerbanS] from comment #9)

The unexpected results, as per Comment 7, are still appearing and that can be seen in today's beta sim.

The error in comment #7 is reference-error, not the NOTURN error as the bug title says. The patches in bug 1844818 will address the reference-error in comment #7. I've push a try: https://treeherder.mozilla.org/jobs?repo=try&revision=381a7a0b2ba6894ef758e5670c57eafbf426aafe

The patch here in this bug is for NOTURN error only.

Flags: needinfo?(cchang)

The patch seems to be working in today's beta-simulation. https://treeherder.mozilla.org/jobs?repo=try&group_state=expanded&revision=2a1acc6cb5f5f3f77d9ed9091b71b4b4f5cc3b3d&test_paths=webcodecs&searchStr=wpt

Status: ASSIGNED → RESOLVED
Closed: 2 years ago
status-firefox117: affected → verified
Resolution: --- → FIXED
Target Milestone: --- → 117 Branch
Status: RESOLVED → VERIFIED
Attachment #9344519 - Attachment is obsolete: true
You need to log in before you can comment on or make changes to this bug.

Attachment

General

Creator:
Created:
Updated:
Size: