843100 - install OpenGL on AWS test instances - needed for b2g emulator tests

Status: RESOLVED INVALID

(Infrastructure & Operations Graveyard :: CIDuty, task)

Description

[Vladimir Vukicevic [:vlad] [:vladv] (needinfo me, slow to respond)]

The B2G emulator is using whatever the native platform GL driver is, since it does passhtrough.  We should use a known-good software Mesa implementation for that to ensure that we can get consistent test results (and can scale since everything will be pure software).

Comment 1

[John O'Duinn [:joduinn] (please use "needinfo?" flag)]

found in triage

Comment 2

[Rail Aliiev [:rail]]

Any suggestions what can be used for this?

Comment 3

[Andrew Halberstadt [:ahal]]

I think Jeff was going to look into this in bug 843080

Comment 4

[Justin Wood (:Callek)]

(In reply to Rail Aliiev [:rail] from comment #2)
> Any suggestions what can be used for this?

fwiw we install OpenGL in mock on Linux PGO builders with package mesa-libGL-devel so this should be doable with mesa or similar.

Comment 5

[Rail Aliiev [:rail]]

Vlad, any suggestion what should be installed?

Comment 6

[Vladimir Vukicevic [:vlad] [:vladv] (needinfo me, slow to respond)]

Not offhand; jeff was going to look into it in 843080, but I don't think he's had time yet.

Comment 7

[Armen [:armenzg]]

Jeff doesn't seem to be looking into it on bug 843080.
Is there anyone that could look into it?

Comment 8

[Vladimir Vukicevic [:vlad] [:vladv] (needinfo me, slow to respond)]

Let me talk to Jeff today.

Comment 9

[Vladimir Vukicevic [:vlad] [:vladv] (needinfo me, slow to respond)]

Yep, Jeff's going to look into it.

Comment 10

[Armen [:armenzg]]

(In reply to Vladimir Vukicevic [:vlad] [:vladv] from comment #9)
> Yep, Jeff's going to look into it.

Awesome!
Jeff, what would you need?

Comment 11

[Chris Cooper [:coop] (he/him)]

Jeff: ping? 

Is this still needed, or just back-burnered for a bit?

Comment 12

[Graydon Hoare :graydon]

Bug 910092 is (probably) blocked on the absence of libgl1-mesa-dev from certain AWS test instances (those serving Ash; I don't know whether it's the same pool that'll service other branches). I discussed with :rail on IRC and he suggested making a note here and assigning this bug to him.

Comment 13

[Rail Aliiev [:rail]]

FTR, this package install the following packages as well: 

Inst libgl1-mesa-glx [8.0.2-0ubuntu3] (8.0.4-0ubuntu0.2 Ubuntu:12.04/precise-security [i386]) []
Inst libglapi-mesa [8.0.2-0ubuntu3] (8.0.4-0ubuntu0.2 Ubuntu:12.04/precise-security [i386])
Inst libkms1 (2.4.32-1ubuntu1 Ubuntu:12.04/precise [i386])
Inst libdrm-dev (2.4.32-1ubuntu1 Ubuntu:12.04/precise [i386])
Inst libpthread-stubs0 (0.3-3 Ubuntu:12.04/precise [i386])
Inst libpthread-stubs0-dev (0.3-3 Ubuntu:12.04/precise [i386])
Inst xorg-sgml-doctools (1:1.10-1 Ubuntu:12.04/precise [all])
Inst x11proto-core-dev (7.0.22-1 Ubuntu:12.04/precise [all])
Inst libxau-dev (1:1.0.6-4 Ubuntu:12.04/precise [i386])
Inst libxdmcp-dev (1:1.1.0-4 Ubuntu:12.04/precise [i386])
Inst x11proto-input-dev (2.1.99.6-1 Ubuntu:12.04/precise [all])
Inst x11proto-kb-dev (1.0.5-2 Ubuntu:12.04/precise [all])
Inst xtrans-dev (1.2.6-2 Ubuntu:12.04/precise [all])
Inst libxcb1-dev (1.8.1-1 Ubuntu:12.04/precise [i386])
Inst libx11-dev (2:1.4.99.1-0ubuntu2 Ubuntu:12.04/precise [i386])
Inst libx11-doc (2:1.4.99.1-0ubuntu2 Ubuntu:12.04/precise [all])
Inst x11proto-xext-dev (7.2.0-3 Ubuntu:12.04/precise [all])
Inst libxext-dev (2:1.3.0-3build1 Ubuntu:12.04/precise [i386])
Inst mesa-common-dev (8.0.4-0ubuntu0.2 Ubuntu:12.04/precise-security [i386])
Inst libgl1-mesa-dev (8.0.4-0ubuntu0.2 Ubuntu:12.04/precise-security [i386])
Conf libglapi-mesa (8.0.4-0ubuntu0.2 Ubuntu:12.04/precise-security [i386])
Conf libgl1-mesa-glx (8.0.4-0ubuntu0.2 Ubuntu:12.04/precise-security [i386])
Conf libkms1 (2.4.32-1ubuntu1 Ubuntu:12.04/precise [i386])
Conf libdrm-dev (2.4.32-1ubuntu1 Ubuntu:12.04/precise [i386])
Conf libpthread-stubs0 (0.3-3 Ubuntu:12.04/precise [i386])
Conf libpthread-stubs0-dev (0.3-3 Ubuntu:12.04/precise [i386])
Conf xorg-sgml-doctools (1:1.10-1 Ubuntu:12.04/precise [all])
Conf x11proto-core-dev (7.0.22-1 Ubuntu:12.04/precise [all])
Conf libxau-dev (1:1.0.6-4 Ubuntu:12.04/precise [i386])
Conf libxdmcp-dev (1:1.1.0-4 Ubuntu:12.04/precise [i386])
Conf x11proto-input-dev (2.1.99.6-1 Ubuntu:12.04/precise [all])
Conf x11proto-kb-dev (1.0.5-2 Ubuntu:12.04/precise [all])
Conf xtrans-dev (1.2.6-2 Ubuntu:12.04/precise [all])
Conf libxcb1-dev (1.8.1-1 Ubuntu:12.04/precise [i386])
Conf libx11-dev (2:1.4.99.1-0ubuntu2 Ubuntu:12.04/precise [i386])
Conf libx11-doc (2:1.4.99.1-0ubuntu2 Ubuntu:12.04/precise [all])
Conf x11proto-xext-dev (7.2.0-3 Ubuntu:12.04/precise [all])
Conf libxext-dev (2:1.3.0-3build1 Ubuntu:12.04/precise [i386])
Conf mesa-common-dev (8.0.4-0ubuntu0.2 Ubuntu:12.04/precise-security [i386])
Conf libgl1-mesa-dev (8.0.4-0ubuntu0.2 Ubuntu:12.04/precise-security [i386])

Comment 14

[Graydon Hoare :graydon]

Oh gosh, that seems like quite a major change, more likely to destabilize something; let's see if I can hack around it via a different approach. Thanks for checking.

Comment 15

[Rail Aliiev [:rail]]

We talked on IRC about this. libgl1-mesa-dev contains a symlink from libGL.so.1 to libGL.so which resolves some issues. It's not worth to install so many packages just to have a symlink in place.

We can work around this by creating the following symlinks:

ln -s libGL.so.1 /usr/lib/x86_64-linux-gnu/mesa/libGL.so
ln -s libGL.so.1 /usr/lib/i386-linux-gnu/mesa/libGL.so

(both on 64-bit machines).

This can be easily done with puppet.

:graydon, can you ping me whenever you have some results from you ash hacks?

Comment 16

[Graydon Hoare :graydon]

Worked around using a local symlink, no need. Thanks though. Removed blocking status.

Comment 17

[Rail Aliiev [:rail]]

Back to the pool until we figure out which packages we need.

Comment 18

[Armen [:armenzg]]

The requirements on this bug seem vague.
Please request loaning a machine to figure out what is specifically needed in here and we will looking into deploying it.

Not sure if at all related but I will mention it in here.
We will be pushing fixing b2g reftests on AWS on bug 818968:
https://tbpl.mozilla.org/?tree=Cedar&showall=1&jobname=b2g_emulator_vm.*reftest

I'm removing the dependencies until I know how it blocks any of the removed blocked bugs.