1249189 - Fix YCbCr convert problem when using TexImage2D

Status: RESOLVED FIXED

(Core :: Graphics: CanvasWebGL, defect)

Description

[Ethan Lin[:ethlin]]

The related conformance test is:
video/tex-image-and-sub-image-2d-with-video-rgb8-rgb-unsigned_byte,
video/tex-image-and-sub-image-2d-with-video-srgb8-rgb-unsigned_byte, etc.

error messages:
testing: video/webm; codecs="vp8, vorbis"
Testing texImage2D with flipY=true bindingTarget=TEXTURE_2D
Checking lower left corner
FAIL at (4, 4) expected: 0,255,0 was 255,125,255
Checking upper left corner
FAIL at (4, 24) expected: 255,0,0 was 255,125,255
Testing texImage2D with flipY=false bindingTarget=TEXTURE_2D
Checking lower left corner
FAIL at (4, 4) expected: 255,0,0 was 255,125,255
Checking upper left corner
FAIL at (4, 24) expected: 0,255,0 was 255,125,255
Testing texSubImage2D with flipY=true bindingTarget=TEXTURE_2D
Checking lower left corner
FAIL at (4, 4) expected: 0,255,0 was 255,125,255
Checking upper left corner
FAIL at (4, 24) expected: 255,0,0 was 255,125,255
Testing texSubImage2D with flipY=false bindingTarget=TEXTURE_2D
Checking lower left corner
FAIL at (4, 4) expected: 255,0,0 was 255,125,255
Checking upper left corner
FAIL at (4, 24) expected: 0,255,0 was 255,125,255
...

Comment 1

[Ethan Lin[:ethlin]]

Attachment: Fix YCbCr conversion. r=jgilbert

The ALPHA, LUMINANCE, LUMINANCE_ALPHA in ES3.0.4 and OpenGL4.0 are legacy pixel formats. So I use GL_RED to do the conversion.

Comment 2

[Kelsey Gilbert [:jgilbert]]

Comment on attachment 8721884 [details] [diff] [review]
Fix YCbCr conversion. r=jgilbert

Review of attachment 8721884 [details] [diff] [review]:
-----------------------------------------------------------------

RED textures aren't valid in GLES2, and ALPHA textures are not valid in desktop GL Core Profiles (relevant for OSX). However, R8 textures aren't valid in desktop GL until 3.0

Good news though: LUMINANCE/LUMINANCE/UNSIGNED_BYTE is valid. If we switch to Lum8 textures, we can unconditionally have our shaders use `.r` instead of `.a`.

Specifically, we should be using R8 textures on GL3.0+ and GLES3.0+, but LUMINANCE/LUMINANCE/UNSIGNED_BYTE otherwise.

There is the small outside chance of a bad driver implementing Luminance8 textures as RGB8 textures with duplicated values, and thus tripling our memory usage for Luminance8 textures, but we should cross that bridge only if we come to it.

::: gfx/gl/GLBlitHelper.cpp
@@ +614,3 @@
>      if (!tex) {
>          MOZ_ASSERT(needsAllocation);
> +        tex = CreateTexture(mGL, LOCAL_GL_RED, LOCAL_GL_RED, LOCAL_GL_UNSIGNED_BYTE,

This is not valid GLES3:
GLES 3.0.4 p112 tells us that if we use RED/UNSIGNED_BYTE for format/type, our internalFormat must be R8.

We should prefer R8 where available, which is GLES3+ and GL3.0+.

Comment 3

[Ethan Lin[:ethlin]]

Attachment: Fix YCbCr conversion. r=jgilbert

I use different format by GL/EGL version and the shader is using r channel. But there is a small bug in the "IsAtLeast", so I also fixed it.

Comment 4

[Ethan Lin[:ethlin]]

try server:
https://treeherder.mozilla.org/#/jobs?repo=try&revision=847c670d49f4

Comment 5

[Pulsebot]

https://hg.mozilla.org/integration/mozilla-inbound/rev/33a9e4482bcc

Comment 6

[Wes Kocher (:KWierso) (Not reading bugmail; email directly if needed)]

https://hg.mozilla.org/mozilla-central/rev/33a9e4482bcc