Decommission all HP G1 servers that are in production

RESOLVED FIXED

Status

Infrastructure & Operations
MOC: Projects
--
enhancement
RESOLVED FIXED
6 years ago
5 months ago

People

(Reporter: dumitru, Assigned: vinh)

Tracking

({spring-cleaning})

Details

(Whiteboard: :dcops [2013Q4])

(Reporter)

Description

6 years ago
This is a tracker bug for decommissioning all G1 HP servers that are still in production.
Individual bugs will be filed against this one for better tracking.

We have renewed the warranty for the G1 servers that are still in production for one year only. Thus, this bug has to be fixed by the end of the year.

Updated

6 years ago
Whiteboard: [end of 2013] → [2013Q4]
(Reporter)

Updated

6 years ago
Depends on: 833470
(Reporter)

Updated

6 years ago
Depends on: 833472
(Reporter)

Updated

6 years ago
Depends on: 833476
(Reporter)

Updated

6 years ago
Depends on: 833483
(Reporter)

Updated

6 years ago
Depends on: 833484
(Reporter)

Updated

6 years ago
Depends on: 833485
(Reporter)

Updated

6 years ago
Depends on: 833488
(Reporter)

Updated

6 years ago
Depends on: 833491

Updated

5 years ago
Depends on: 852412
(Reporter)

Updated

5 years ago
Depends on: 842826
dekiwiki{1,2}.webapp.scl3 were also G1 servers not mentioned here, decommissioned in bug 864826

Updated

5 years ago
Assignee: server-ops → dgherman
(Reporter)

Updated

5 years ago
Assignee: dgherman → server-ops
Keywords: spring-cleaning

Updated

4 years ago
Whiteboard: [2013Q4] → :dcops [2013Q4]

Updated

4 years ago
Group: infra
Component: Server Operations → MOC: Service Requests
Product: mozilla.org → Infrastructure & Operations
QA Contact: shyam → lypulong

Updated

3 years ago
Assignee: server-ops → nobody

Comment 2

3 years ago
unblocking bug 833470 since app1.metrics was p2v'ed off hardware in bug 1072976

For finding rogues later:
invtool search -q 'sys.system_status__status=production AND (sys.server_model__vendor=HP AND sys.server_model__model~G1)'
No longer depends on: 833470

Comment 3

3 years ago
Currently;

[root@centos01 inv-tool]# invtool search -q 'sys.system_status__status=production AND (sys.server_model__vendor=HP AND sys.server_model__model~G1)'
316   cnadm01.cn.mozilla.com                   10.6.11.101 INV SYS  00666 2UX739031L
318   pc-vmware01.cn.mozilla.com               None INV SYS  00668 2UX74102SJ
320   syslog1.private.pek1.mozilla.com         10.24.1.20 INV SYS  00670 2UX74102T2
323   backup1.mail.pek1.mozilla.com            10.24.1.20 INV SYS  00673 2UX743058H
388   vertica2.stage.metrics.scl3.mozilla.com  10.22.1.196 INV SYS  1327 2UX802015Y
389   vertica3.stage.metrics.scl3.mozilla.com  10.22.1.196 INV SYS  1328 2UX8020160
393   vertica1.stage.metrics.scl3.mozilla.com  10.22.1.196 INV SYS  1332 2UX750022W
679   admin1a.private.pek1.mozilla.com         10.24.1.20 INV SYS  1386 2UX81802EP
680   admin1b.private.pek1.mozilla.com         10.24.1.20 INV SYS  1387 2UX81909BP
847   packager1.private.scl3.mozilla.com       10.22.1.240 INV SYS  1488 2UX839058C
1100  lm-app-generic02.labs.mozilla.org        10.22.1.192 INV SYS  2554 2UX91501E9
1105  zlb1.phy.labs.scl3.mozilla.com           10.22.1.192 INV SYS  2559 2UX91501DZ
1227  nladm02.nl.mozilla.com                   10.4.10.21 INV SYS  None 2UX92702EU
1228  ns2-glb.mozilla.net                      10.4.10.21 INV SYS  None 2UX92702F1
Some of those are long dead, like nladm02.nl.mozilla.com (datacenter in NL got turned down a while back) and haven't been cleaned up properly.

pek1 machines will be out of service soon when that datacenter is turned down.

The rest need to be checked they're still really there.
Probably better to get this list out of foreman, since that data is current (Inventory is often stale)

Updated

3 years ago
Assignee: nobody → rchilds

Updated

3 years ago
Status: NEW → ASSIGNED

Updated

3 years ago
Depends on: 1196603

Comment 6

3 years ago
Here we go.

admin1a.private.pek1.mozilla.com 	productname 	ProLiant BL460c G1
admin1b.private.pek1.mozilla.com 	productname 	ProLiant BL460c G1
packager1.private.scl3.mozilla.com 	productname 	ProLiant BL460c G1
vertica1.stage.metrics.scl3.mozilla.com 	productname 	ProLiant BL460c G1
vertica2.stage.metrics.scl3.mozilla.com 	productname 	ProLiant BL460c G1
vertica3.stage.metrics.scl3.mozilla.com 	productname 	ProLiant BL460c G1

Updated

3 years ago
Depends on: 1196607

Updated

3 years ago
Assignee: rchilds → nobody
Status: ASSIGNED → NEW
(Assignee)

Updated

2 years ago
Assignee: nobody → vhua
(Assignee)

Updated

2 years ago
Depends on: 1252314
(Assignee)

Updated

2 years ago
Depends on: 1252315
(Assignee)

Updated

2 years ago
Depends on: 1252320
(Assignee)

Updated

2 years ago
Status: NEW → ASSIGNED
Component: MOC: Service Requests → MOC: Projects

Updated

2 years ago
See Also: → bug 1288510

Comment 7

2 years ago
$ invtool search -q 'sys.system_status__status=production AND (sys.server_model__vendor=HP AND sys.server_model__model~G1)'
316   cnadm01.cn.mozilla.com                   10.6.11.101 INV SYS  00666 2UX739031L
318   pc-vmware01.cn.mozilla.com               None INV SYS  00668 2UX74102SJ
388   vertica2.stage.metrics.scl3.mozilla.com  10.22.4.200 INV SYS  1327 2UX802015Y
389   vertica3.stage.metrics.scl3.mozilla.com  10.22.4.200 INV SYS  1328 2UX8020160
679   admin1a.private.pek1.mozilla.com         10.24.1.20 INV SYS  1386 2UX81802EP
680   admin1b.private.pek1.mozilla.com         10.24.1.20 INV SYS  1387 2UX81909BP
1227  nladm02.nl.mozilla.com                   10.4.10.21 INV SYS  None 2UX92702EU
1228  ns2-glb.mozilla.net                      10.4.10.21 INV SYS  None 2UX92702F1

Waiting on PEK and Vertica
(In reply to Ryan C [:ryanc] from comment #7)
> $ invtool search -q 'sys.system_status__status=production AND
> (sys.server_model__vendor=HP AND sys.server_model__model~G1)'
> 1227  nladm02.nl.mozilla.com                   10.4.10.21 INV SYS  None
> 2UX92702EU
> 1228  ns2-glb.mozilla.net                      10.4.10.21 INV SYS  None
> 2UX92702F1

the nl should probably have been decom ages ago and is probably not in production anymore. the ns2-glb is probably the same. i'll update inventory if :digi approves my saying.
Flags: needinfo?(bhourigan)
(In reply to Ludovic Hirlimann [:Usul] from comment #8)
> (In reply to Ryan C [:ryanc] from comment #7)
> > $ invtool search -q 'sys.system_status__status=production AND
> > (sys.server_model__vendor=HP AND sys.server_model__model~G1)'
> > 1227  nladm02.nl.mozilla.com                   10.4.10.21 INV SYS  None
> > 2UX92702EU
> > 1228  ns2-glb.mozilla.net                      10.4.10.21 INV SYS  None
> > 2UX92702F1
> 
> the nl should probably have been decom ages ago and is probably not in
> production anymore. the ns2-glb is probably the same. i'll update inventory
> if :digi approves my saying.

r+, you're absolutely right. dmoore shut down our NL DC ages ago
Flags: needinfo?(bhourigan)
How are we doing on current G1 servers, what's left?
(Assignee)

Comment 11

a year ago
Pending the 2 admin servers in pek1 and vertica[123].stage.metrics.scl3
(Assignee)

Comment 12

a year ago
:per discussion in our MOC triage, we're down to just the last 5 G1 hosts that's waiting for the owning team to make progress.  Ashish is already working on replacing the admin servers in pek1 and :w0ts0n is working on P2V the vertica[123].stage.metrics.  Got the OK to close this bug .
Status: ASSIGNED → RESOLVED
Last Resolved: a year ago
Resolution: --- → WORKSFORME
(Assignee)

Updated

a year ago
Status: RESOLVED → REOPENED
Resolution: WORKSFORME → ---

Updated

a year ago
Status: REOPENED → ASSIGNED

Updated

8 months ago
Severity: minor → enhancement
QA Contact: lypulong → kferrando

Updated

6 months ago
Depends on: 1421160
Changing default QA contact per https://bugzilla.mozilla.org/show_bug.cgi?id=1431393
QA Contact: kferrando → mcristofi

Updated

5 months ago
Status: ASSIGNED → RESOLVED
Last Resolved: a year ago5 months ago
Resolution: --- → FIXED
You need to log in before you can comment on or make changes to this bug.