1207160 - Please investigate t-w732-ix-001 and t-w732-ix-117

Status: RESOLVED FIXED

(Infrastructure & Operations :: RelOps: General, task)

Description

[Alin Selagea [:aselagea]]

These slaves seem to be experiencing graphics issues.

Noticed that the Nvidia drivers are installed and working, also the resolution is the correct one. For some of jobs that ended with warnings we've found in the logs some error messages related to WebGL:

t-w732-ix-001 -> Error: WebGL: WebGL creation is disabled, and so disallowed here.

t-w732-ix-117 -> Error: WebGL: compressedTexImage2D: Invalid format COMPRESSED_RGB_S3TC_DXT1_EXT: Requires that WEBGL_compressed_texture_s3tc is enabled

Comment 1

[Vinh Hua [:vinh]]

Video cards replaced, host reimaging.

Comment 2

[Vinh Hua [:vinh]]

reimage completed, host back online

vhua$ ssh t-w732-ix-001.wintest.releng.scl3.mozilla.com
The authenticity of host 't-w732-ix-001.wintest.releng.scl3.mozilla.com (10.26.40.151)' can't be established.
RSA key fingerprint is 59:52:b1:d1:2f:21:5a:db:61:e9:7a:6c:7c:ff:53:22.
Are you sure you want to continue connecting (yes/no)?

vhua$ ssh t-w732-ix-117.wintest.releng.scl3.mozilla.com
The authenticity of host 't-w732-ix-117.wintest.releng.scl3.mozilla.com (10.26.41.167)' can't be established.
RSA key fingerprint is 12:27:49:87:f8:8b:a9:0b:5d:bc:d2:a9:02:ac:21:c1.
Are you sure you want to continue connecting (yes/no)?

Comment 3

[Phil Ringnalda (:philor)]

t-w732-ix-117 hasn't run the affected test suite yet, but t-w732-ix-001 has and still times out (I've left it enabled for now, because I'm curious like that).

I asked a couple of developers what the failure could possibly mean, and they are curious about whether we've wound up with a different version of msmpeg2vdec.dll on these slaves than on all the rest.

Comment 4

[Phil Ringnalda (:philor)]

t-w732-ix-117 remains affected as well.

Comment 5

[Phil Ringnalda (:philor)]

New failure, "dom/media/webaudio/test/test_bug1056032.html | We should be able to decode an mp3 using decodeAudioData but couldn't" on t-w732-ix-001 in https://treeherder.mozilla.org/logviewer.html#?job_id=4823548&repo=fx-team, which could be a red herring or could be an clue, dunno which.

Comment 6

[Armen [:armenzg]]

What is the warning sign at the bottom right [1][2] of t-w732-ix-117?

What are the graphic card version for a working machine vs one of the bad ones?
Can we please attach the dxdiag of each type?

[1]
http://mozilla-releng-blobs.s3.amazonaws.com/blobs/try/sha512/6b77086559a34df0078a21a9a9c199d62a85996605fe120193c7e37f81e8a4824f2b2325f88b8afed527f4d7653058ce04fc93641deab050e32768b52b7ec76a

[2] http://buildbot-master119.bb.releng.scl3.mozilla.com:8201/builders/Windows%207%2032-bit%20try%20debug%20test%20mochitest-devtools-chrome-4/builds/1692/steps/run_script/logs/stdio

Comment 7

[Vlad Ciobancai [:vladC] [:vciobancai]]

Attachment: t-w732-ix-117-dxdiag-disaplay.png

Attached the screenshot from dxdiag display for t-w732-ix-117

Comment 8

[Alin Selagea [:aselagea]]

Attachment: t-w732-ix-068-dxdiag.PNG

Also attached a screenshot showing the display configuration of a working machine. No differences spotted between the two.

Comment 9

[Phil Ringnalda (:philor)]

Redisabled t-w732-ix-117 yet again.

Comment 10

[Amy Rich [:arr] [:arich]]

:philor: Can you please indicate the reason for disabling it this time?

Comment 11

[Phil Ringnalda (:philor)]

I actually tried to do that after I got home from work, but I couldn't find which bug in the tangle I had commented in. https://treeherder.mozilla.org/logviewer.html#?job_id=15000705&repo=mozilla-inbound - video/mp4 being an unsupported mimetype.

Comment 12

[Q]

That is the media pack issue. Lucky not a graphics issue as assumed before

Comment 13

[Amy Rich [:arr] [:arich]]

Q rebooted 117 and verified that the media pack was installed correctly. I've re-enabled the slave.

Comment 14

[Q]

Both of these machines seem to be functional for some time. Closing bug