1323047 - Apply HP firmware updates to hg servers

Status: NEW

(Developer Services :: Mercurial: hg.mozilla.org, defect)

Description

[Gregory Szorc [:gps]]

The servers behind hg.mozilla.org are advertising 3 HP storage firmware updates. We should probably upgrade the machines.

dividehex: are you OK with me upgrading and rebooting hgweb11 today? I would upgrade the remaining machines if the servers behaves well for the next ~48 hours.

Comment 1

[Jake Watkins [:dividehex]]

(In reply to Gregory Szorc [:gps] from comment #0)
> The servers behind hg.mozilla.org are advertising 3 HP storage firmware
> updates. We should probably upgrade the machines.
> 
> dividehex: are you OK with me upgrading and rebooting hgweb11 today? I would
> upgrade the remaining machines if the servers behaves well for the next ~48
> hours.

I'm fine with this. Go ahead and exec the update.  Also, let moc know you are doing a firmware update.

Comment 2

[Gregory Szorc [:gps]]

hgweb11 rebooting. For posterity, here is the command output. It seems kinda weird that the smartarray firmware update is listed twice?


Please run /usr/local/sbin/install_hp_firmware.sh before rebooting this
machine to install:
   hp-firmware-system-i36 hp-firmware-smartarray-ea3138d8e8 hp-firmware-smartarray-ea3138d8e8-4.52
[[e-mail]3 ~]$ sudo /usr/local/sbin/install_hp_firmware.sh

DO NOT answer yes to any of the reboot questions individual updates
ask you. You can end up rebooting during the next update and bricking
the machine. Install all the updates and then reboot manually.
Press return to continue.

=== Running :/usr/lib/i386-linux-gnu/hp-firmware-system-i36-2.30_2016_09_12-1.1/./hpsetup
Flash Engine Version: Linux-1.5.8.1-1

Name: Online ROM Flash Component for Linux - HPE ProLiant BL460c Gen9/WS460c Gen9 (I36) Servers
New Version: 2.30 (09/12/2016)

Current Version: 2.20 (05/05/2016)

The software is installed but is not up to date.

Do you want to upgrade the software to a newer version (y/n) ?y

Flash in progress do not interrupt or your system may become unusable.
Working.............................................................................................................
The installation procedure completed successfully.

A reboot is required to finish the installation completely.
Do you want to reboot your system now? no
=== Running :/usr/lib/x86_64-linux-gnu/hp-firmware-smartarray-ea3138d8e8-4.52-1.1/./hpsetup
Supplemental Update / Online ROM Flash Component for Linux (x64) - Smart Array H240ar, H240nr, H240, H241, H244br, P240nr, P244br, P246br, P440ar, P440, P441, P542D, P741m, P840, P840ar, and  P841 (4.52), searching...
1) Smart Array P244br Smart Array P244br in Slot 0 (3.56)
Select which devices to flash [#,#-#,(A)ll,(N)one]> a
Flashing Smart Array P244br in Slot 0 [ 3.56 -> 4.52 ]
Deferred flashes will be performed on next system reboot
============ Summary ============
Smart Component Finished

Summary Messages
================
Reboot needed to activate 1 new FW image

Exit Status: 1
Deferred flashes will be performed on next system reboot
A reboot is required to complete update.
=== Running :/usr/lib/x86_64-linux-gnu/hp-firmware-smartarray-ea3138d8e8-4.52-1.1/./hpsetup
Supplemental Update / Online ROM Flash Component for Linux (x64) - Smart Array H240ar, H240nr, H240, H241, H244br, P240nr, P244br, P246br, P440ar, P440, P441, P542D, P741m, P840, P840ar, and  P841 (4.52), searching...
1) Smart Array P244br Smart Array P244br in Slot 0 (3.56)
Select which devices to flash [#,#-#,(A)ll,(N)one]> a
Flashing Smart Array P244br in Slot 0 [ 3.56 -> 4.52 ]
Deferred flashes will be performed on next system reboot
============ Summary ============
Smart Component Finished

Summary Messages
================
Reboot needed to activate 1 new FW image

Exit Status: 1
Deferred flashes will be performed on next system reboot
A reboot is required to complete update.

REMINDER. The login warning will remain until puppet has run after a reboot.

[[e-mail]3 ~]$ sudo reboot
PolicyKit daemon disconnected from the bus.
We are no longer a registered authentication agent.
Connection to hgweb11.dmz.scl3.mozilla.com closed by remote host.
Connection to hgweb11.dmz.scl3.mozilla.com closed.

Comment 3

[Gregory Szorc [:gps]]

Machine came back from reboot just fine and is back in service in the zlb. Now we wait to see if anything weird happens.