1400994 - Intermittent dom/canvas/test/webgl-mochitest/test_capture.html | Error: Shader program linking failed:

Status: RESOLVED INCOMPLETE

(Core :: Graphics: CanvasWebGL, defect, P3)

Description

[Treeherder Bug Filer]

Filed by: philringnalda [at] gmail.com

https://treeherder.mozilla.org/logviewer.html#?job_id=131791225&repo=autoland

https://queue.taskcluster.net/v1/task/K3hiKEfNSPuCrTBMU6ANqA/runs/0/artifacts/public/logs/live_backing.log

Comment 1

[Intermittent Failures Robot]

3 failures in 943 pushes (0.003 failures/push) were associated with this bug in the last 7 days.    

Repository breakdown:
* autoland: 2
* mozilla-central: 1

Platform breakdown:
* windows7-32: 3

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1400994&startday=2017-09-18&endday=2017-09-24&tree=all

Comment 2

[Intermittent Failures Robot]

5 failures in 885 pushes (0.006 failures/push) were associated with this bug in the last 7 days.    

Repository breakdown:
* mozilla-central: 2
* autoland: 2
* mozilla-beta: 1

Platform breakdown:
* windows7-32: 4
* windows7-32-stylo-disabled: 1

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1400994&startday=2017-09-25&endday=2017-10-01&tree=all

Comment 3

[Intermittent Failures Robot]

14 failures in 824 pushes (0.017 failures/push) were associated with this bug in the last 7 days.    

Repository breakdown:
* autoland: 8
* mozilla-inbound: 4
* try: 1
* mozilla-beta: 1

Platform breakdown:
* windows7-32: 14

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1400994&startday=2017-10-02&endday=2017-10-08&tree=all

Comment 4

[Intermittent Failures Robot]

23 failures in 947 pushes (0.024 failures/push) were associated with this bug in the last 7 days.    

Repository breakdown:
* autoland: 13
* mozilla-inbound: 8
* mozilla-central: 2

Platform breakdown:
* windows7-32: 23

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1400994&startday=2017-10-09&endday=2017-10-15&tree=all

Comment 5

[Joel Maher ( :jmaher ) (UTC -8)]

this has been consistently failing on windows7-debug mochitest-webgl-8, we are now at 31 failures in the last 7 days.

here is a recent log:
https://treeherder.mozilla.org/logviewer.html#?repo=mozilla-inbound&job_id=138487432

sadly the screenshots have errors in them, so I cannot show one, but here is a link:
https://public-artifacts.taskcluster.net/NvFAkwtbR7e1hZ95X7-nJg/0/public/test_info/mozilla-test-fail-screenshot_r8qp7p.png

here is related data from the above log file:
13:50:43     INFO -  670 INFO None671 INFO TEST-START | dom/canvas/test/webgl-mochitest/test_capture.html
13:50:43     INFO -  GECKO(5028) | ++DOMWINDOW == 64 (139BC000) [pid = 5028] [serial = 64] [outer = 26CB5400]
13:50:43     INFO -  GECKO(5028) | [5028, Main Thread] WARNING: NS_ENSURE_TRUE(ParseTypeAttribute(type, &version)) failed: file z:/build/build/src/dom/script/ScriptLoader.cpp, line 1281
13:50:43     INFO -  GECKO(5028) | [5028, Main Thread] WARNING: NS_ENSURE_TRUE(ParseTypeAttribute(type, &version)) failed: file z:/build/build/src/dom/script/ScriptLoader.cpp, line 1281
13:50:43     INFO -  GECKO(5028) | JavaScript warning: http://mochi.test:8888/tests/dom/canvas/test/webgl-mochitest/webgl-util.js, line 44: Error: WebGL warning: Exceeded 16 live WebGL contexts for this principal, losing the least recently used one.
13:50:43     INFO -  GECKO(5028) | WebGL(15248800)::ForceLoseContext
13:50:43     INFO -  GECKO(5028) | Destroying context 0D980000 surface 171D89D0 on display 26330F10
13:50:43     INFO -  GECKO(5028) | Initializing context 0D980000 surface 171D89D0 on display 26330F10
13:50:43     INFO -  GECKO(5028) | JavaScript warning: http://mochi.test:8888/tests/dom/canvas/test/webgl-mochitest/webgl-util.js, line 147: Error: WebGL warning: linkProgram: Failed to link, leaving the following log:
13:50:43     INFO -  GECKO(5028) | error X8000: D3D11 Internal Compiler Error: Invalid Bytecode: Failed to parse shader using reference shader parser: 0x8007000e
13:50:43     INFO -  GECKO(5028) | Warning: D3D shader compilation failed with default flags. (ps_5_0)
13:50:43     INFO -  GECKO(5028) |  Retrying with skip validation
13:50:43     INFO -  GECKO(5028) | error X8000: D3D11 Internal Compiler Error: Invalid Bytecode: Failed to parse shader using reference shader parser: 0x8007000e
13:50:43     INFO -  GECKO(5028) | Warning: D3D shader compilation failed with skip validation flags. (ps_5_0)
13:50:43     INFO -  GECKO(5028) |  Retrying with skip optimization
13:50:43     INFO -  GECKO(5028) | error X8000: D3D11 Internal Compiler Error: Invalid Bytecode: Failed to parse shader using reference shader parser: 0x8007000e
13:50:43     INFO -  GECKO(5028) | Warning: D3D shader compilation failed with skip optimization flags. (ps_5_0)
13:50:43     INFO -  GECKO(5028) | Failed to create D3D shaders.
13:50:43     INFO -  TEST-INFO | started process screenshot
13:50:43     INFO -  TEST-INFO | screenshot: exit 1
13:50:43    ERROR -  672 INFO TEST-UNEXPECTED-FAIL | dom/canvas/test/webgl-mochitest/test_capture.html | Error: Shader program linking failed:
13:50:43     INFO -  Shader program info log:
13:50:43     INFO -  error X8000: D3D11 Internal Compiler Error: Invalid Bytecode: Failed to parse shader using reference shader parser: 0x8007000e
13:50:43     INFO -  Warning: D3D shader compilation failed with default flags. (ps_5_0)
13:50:43     INFO -   Retrying with skip validation
13:50:43     INFO -  error X8000: D3D11 Internal Compiler Error: Invalid Bytecode: Failed to parse shader using reference shader parser: 0x8007000e
13:50:43     INFO -  Warning: D3D shader compilation failed with skip validation flags. (ps_5_0)
13:50:43     INFO -   Retrying with skip optimization
13:50:43     INFO -  error X8000: D3D11 Internal Compiler Error: Invalid Bytecode: Failed to parse shader using reference shader parser: 0x8007000e
13:50:43     INFO -  Warning: D3D shader compilation failed with skip optimization flags. (ps_5_0)
13:50:43     INFO -  Failed to create D3D shaders.
13:50:43     INFO -  Vert shader log:
13:50:43     INFO -  Frag shader log:
13:50:43     INFO -      errorFunc@dom/canvas/test/webgl-mochitest/test_capture.html:165:5
13:50:43     INFO -      warning@dom/canvas/test/webgl-mochitest/webgl-util.js:31:5
13:50:43     INFO -      createProgramByIds@dom/canvas/test/webgl-mochitest/webgl-util.js:154:7
13:50:43     INFO -      beginTest@dom/canvas/test/webgl-mochitest/test_capture.html:172:10
13:50:43     INFO -      @dom/canvas/test/webgl-mochitest/test_capture.html:217:1
13:50:43     INFO -  Not taking screenshot here: see the one that was previously logged
13:50:43    ERROR -  673 INFO TEST-UNEXPECTED-FAIL | dom/canvas/test/webgl-mochitest/test_capture.html | Program linking should succeed.
13:50:43     INFO -      beginTest@dom/canvas/test/webgl-mochitest/test_capture.html:174:5
13:50:43     INFO -      @dom/canvas/test/webgl-mochitest/test_capture.html:217:1


:milan, can you help prioritize this bug as you see fit?

Comment 6

[Intermittent Failures Robot]

26 failures in 864 pushes (0.03 failures/push) were associated with this bug in the last 7 days.    

Repository breakdown:
* autoland: 12
* mozilla-inbound: 11
* mozilla-central: 3

Platform breakdown:
* windows7-32: 26

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1400994&startday=2017-10-16&endday=2017-10-22&tree=all

Comment 7

[Geoff Brown [:gbrown]]

With retries, the earliest failure I could find is https://treeherder.mozilla.org/#/jobs?repo=autoland&revision=203c1f909ae096450cc1b1d1f4d5d72aefb9c9ab&filter-searchStr=windows+debug+webgl, or perhaps the previous revision (different failure for this test), neither of which appears to be a likely cause.

Comment 8

[Geoff Brown [:gbrown]]

There is possibly related work happening in bug 1395805.

Comment 9

[Intermittent Failures Robot]

28 failures in 912 pushes (0.031 failures/push) were associated with this bug in the last 7 days.    

Repository breakdown:
* autoland: 18
* mozilla-inbound: 7
* mozilla-central: 2
* try: 1

Platform breakdown:
* windows7-32: 28

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1400994&startday=2017-10-23&endday=2017-10-29&tree=all

Comment 10

[Milan Sreckovic [:milan] (needinfo for best results)]

Yes, lets see what happens once we resolve bug 1395805

Comment 11

[Michael Leu[:Lenzak](UTC+8)]

I cannot reproduce the crash in bug 1395805 anymore, but this fail still persist.

The error message:
error X8000: D3D11 Internal Compiler Error: Invalid Bytecode: Failed to parse shader using reference shader parser: 0x8007000e

0x8007000e means OOM in Windows

https://msdn.microsoft.com/zh-tw/library/windows/desktop/aa378137(v=vs.85).aspx

So it seems that D3D11 internal compiler cannot reside in swap memory so enabling pagefile in windows 7 doesn't fix this issue.

Comment 12

[Intermittent Failures Robot]

38 failures in 857 pushes (0.044 failures/push) were associated with this bug in the last 7 days. 

This is the #45 most frequent failure this week.  

** This failure happened more than 30 times this week! Resolving this bug is a high priority. **

** Try to resolve this bug as soon as possible. If unresolved for 2 weeks, the affected test(s) may be disabled. **  

Repository breakdown:
* autoland: 21
* mozilla-inbound: 13
* try: 3
* mozilla-central: 1

Platform breakdown:
* windows7-32: 38

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1400994&startday=2017-10-30&endday=2017-11-05&tree=all

Comment 13

[Intermittent Failures Robot]

5 failures in 849 pushes (0.006 failures/push) were associated with this bug in the last 7 days.    

Repository breakdown:
* autoland: 4
* mozilla-inbound: 1

Platform breakdown:
* windows7-32: 5

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1400994&startday=2017-11-06&endday=2017-11-12&tree=all

Comment 14

[Firefox Bug Husbandry Bot]

https://wiki.mozilla.org/Bug_Triage#Intermittent_Test_Failure_Cleanup

Comment 15

[Intermittent Failures Robot]

1 failures in 462 pushes (0.002 failures/push) were associated with this bug in the last 7 days.    

Repository breakdown:
* try: 1

Platform breakdown:
* windows7-32: 1

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1400994&startday=2018-01-01&endday=2018-01-07&tree=all