Closed Bug 820457 Opened 12 years ago Closed 11 years ago

Intermittent REFTEST TEST-UNEXPECTED-PASS | webgl-clear-test.html?readback&__&_____&________ | image comparison (==) (followed by many more)

Categories

(Core :: Graphics: CanvasWebGL, defect)

Product:
Core
Component:
Graphics: CanvasWebGL
Platform:
ARM
Android
Type:
defect
Priority:
Not set
Severity:
normal

Tracking

()

Status:
RESOLVED WORKSFORME

People

(Reporter: emorley, Unassigned)

References

Details

(Keywords: intermittent-failure) 

Android Armv6 Tegra 250 mozilla-inbound opt test reftest-2 on 2012-12-07 11:39:56 PST for push 6ae3ca2f2438

slave: tegra-031

https://tbpl.mozilla.org/php/getParsedLog.php?id=17720523&tree=Mozilla-Inbound

{
REFTEST TEST-UNEXPECTED-PASS | http://10.250.48.208:30031/tests/content/canvas/test/reftest/webgl-clear-test.html?readback&__&_____&________ | image comparison (==)
REFTEST TEST-UNEXPECTED-PASS | http://10.250.48.208:30031/tests/content/canvas/test/reftest/webgl-clear-test.html?readback&aa&_____&________ | image comparison (==)
REFTEST TEST-UNEXPECTED-PASS | http://10.250.48.208:30031/tests/content/canvas/test/reftest/webgl-clear-test.html?readback&__&_____&preserve | image comparison (==)
REFTEST TEST-UNEXPECTED-PASS | http://10.250.48.208:30031/tests/content/canvas/test/reftest/webgl-clear-test.html?readback&aa&_____&preserve | image comparison (==)
REFTEST TEST-UNEXPECTED-PASS | http://10.250.48.208:30031/tests/content/canvas/test/reftest/webgl-orientation-test.html?readback&__&_____&________ | image comparison (==)
REFTEST TEST-UNEXPECTED-PASS | http://10.250.48.208:30031/tests/content/canvas/test/reftest/webgl-orientation-test.html?readback&aa&_____&________ | image comparison (==)
REFTEST TEST-UNEXPECTED-PASS | http://10.250.48.208:30031/tests/content/canvas/test/reftest/webgl-orientation-test.html?readback&__&_____&preserve | image comparison (==)
REFTEST TEST-UNEXPECTED-PASS | http://10.250.48.208:30031/tests/content/canvas/test/reftest/webgl-orientation-test.html?readback&aa&_____&preserve | image comparison (==)
REFTEST TEST-UNEXPECTED-PASS | http://10.250.48.208:30031/tests/content/canvas/test/reftest/webgl-color-test.html?readback&__&_____&________ | image comparison (==)
REFTEST TEST-UNEXPECTED-PASS | http://10.250.48.208:30031/tests/content/canvas/test/reftest/webgl-color-test.html?readback&aa&_____&________ | image comparison (==)
REFTEST TEST-UNEXPECTED-PASS | http://10.250.48.208:30031/tests/content/canvas/test/reftest/webgl-color-test.html?readback&__&_____&preserve | image comparison (==)
REFTEST TEST-UNEXPECTED-PASS | http://10.250.48.208:30031/tests/content/canvas/test/reftest/webgl-color-test.html?readback&aa&_____&preserve | image comparison (==)
REFTEST TEST-UNEXPECTED-PASS | http://10.250.48.208:30031/tests/content/canvas/test/reftest/webgl-hanging-fb-test.html?readback | image comparison (==)
REFTEST TEST-UNEXPECTED-PASS | http://10.250.48.208:30031/tests/content/canvas/test/reftest/webgl-hanging-fb-test.html?readback&aa | image comparison (==)
REFTEST TEST-UNEXPECTED-PASS | http://10.250.48.208:30031/tests/content/canvas/test/reftest/webgl-hanging-scissor-test.html?readback | image comparison (==)
REFTEST TEST-UNEXPECTED-PASS | http://10.250.48.208:30031/tests/content/canvas/test/reftest/webgl-hanging-scissor-test.html?readback&aa | image comparison (==)
REFTEST TEST-UNEXPECTED-PASS | http://10.250.48.208:30031/tests/content/canvas/test/reftest/webgl-color-test.html?16bpp&readback | image comparison (==)
REFTEST TEST-UNEXPECTED-PASS | http://10.250.48.208:30031/tests/layout/reftests/image-element/canvas-outside-document.html | image comparison (==)
REFTEST TEST-UNEXPECTED-FAIL | http://10.250.48.208:30031/tests/layout/reftests/mathml/mirror-op-1.html | image comparison (==), max difference: 207, number of differing pixels: 217
}
The final unexpected-fail is almost certainly unrelated.
It is strange that these should start passing all of the sudden. Perhaps it's new slave hardware?
We could make these skip-if instead of fails-if. I prefer keeping things consistent, but it would bandaid this.

I have a hunch that the reftests have timing-dependent characteristics, so that changing the hardware (presumedly upgrading it) would cause us to see unexpected-passes is not unlikely.
Depends on: 826546
So 826546 didn't fix this. However, I do notice that all of these seem to be "slave: tegra-031". Is there anything different about this slave compared to the others?
(In reply to Jeff Gilbert [:jgilbert] from comment #21)
> So 826546 didn't fix this. However, I do notice that all of these seem to be
> "slave: tegra-031". Is there anything different about this slave compared to
> the others?

Oh good spot! :-)
This tegra is likely broken in some way, I've requested that it be taken out of production in bug 817990.
Depends on: tegra-031
Resolving WFM keyword:intermittent-failure bugs last modified >3 months ago, whose whiteboard contains none of:
{random,disabled,marked,fuzzy,todo,fails,failing,annotated,time-bomb,leave open}

There will inevitably be some false positives; for that (and the bugspam) I apologise. Filter on orangewfm.
Status: NEW → RESOLVED
Closed: 11 years ago
Resolution: --- → WORKSFORME
You need to log in before you can comment on or make changes to this bug.