rename and re-kick new bugzilla DB servers in scl3

RESOLVED FIXED

Status

RESOLVED FIXED
6 years ago
4 years ago

People

(Reporter: scabral, Assigned: rbryce)

Tracking

Details

Attachments

(1 attachment)

(Reporter)

Description

6 years ago
Please rename:
addons3.db.scl3.mozilla.com
addons4.db.scl3.mozilla.com
addons5.db.scl3.mozilla.com
addons6.db.scl3.mozilla.com

to:

bugzilla1.db.scl3.mozilla.com
bugzilla2.db.scl3.mozilla.com
bugzilla3.db.scl3.mozilla.com
bugzilla4.db.scl3.mozilla.com

As their names suggest, they should be in the 10.22.70 subnet.

Please also re-kickstart them. I'll add the right MySQL configs when that's done. Thanx!
(Reporter)

Comment 1

6 years ago
these servers are in nagios so please do make sure to take them out first.
Assignee: server-ops → mburns
Created attachment 650471 [details]
x86_64 cobbler rhel 6.2 install

This is the error screenshot on the failed cobbler install
Kickstarted and puppetized.

bugzilla1.db.scl3.mozilla.com has address 10.22.70.33
bugzilla2.db.scl3.mozilla.com has address 10.22.70.34
bugzilla3.db.scl3.mozilla.com has address 10.22.70.35
bugzilla4.db.scl3.mozilla.com has address 10.22.70.36
Status: NEW → RESOLVED
Last Resolved: 6 years ago
Resolution: --- → FIXED
(Reporter)

Updated

6 years ago
Blocks: 726710
Burns,

Seems like none of these servers have been puppetized. Can we please fix that?
Status: RESOLVED → REOPENED
Resolution: FIXED → ---
[root@bugzilla1.db.scl3 ~]# ls /home/ | wc -l
65
[root@bugzilla2.db.scl3 ~]# ls /home/ | wc -l
65
[root@bugzilla3.db.scl3 ~]# ls /home/ | wc -l
65
[root@bugzilla4.db.scl3 ~]# ls /etc/cron.d
0hourly  hp-health  puppetcheck  raid-check  sysstat

My mistake. These look to be *actualy for realz no joke* puppetized now.
(Reporter)

Comment 7

6 years ago
Fixed!
Status: REOPENED → RESOLVED
Last Resolved: 6 years ago6 years ago
Resolution: --- → FIXED
(Reporter)

Comment 8

6 years ago
Verified! Thanx for jumping on this so quickly.
Status: RESOLVED → VERIFIED
Sheeri, just to make sure : these have the 3.x fusionIO stuff on them? Thanks!

Updated

6 years ago
Blocks: 775457

Updated

6 years ago
Summary: rename and re-kick for new bugzilla servers in scl3 → rename and re-kick new bugzilla DB servers in scl3
(Reporter)

Comment 10

6 years ago
Just to recap this AM's discusion on IRC:

These machines don't have a separate partition so I don't believe they have fusionIO stuff on them at all.

You're going to order SSD's, but that's another ticket.
Sorry Burnsie, I'm going to have to reopen, since we'll have to rekick these once the SSDs are in them.
Status: VERIFIED → REOPENED
Depends on: 785882
Resolution: FIXED → ---
No problem. I'll get these kicked when the SSDs get installed.
(In reply to Michael Burns [:mburns] from comment #12)
> No problem. I'll get these kicked when the SSDs get installed.

Thanks dude. Van is replacing the drives now, feel free to re-kick when that's done.
(Reporter)

Comment 14

6 years ago
Looks like Van is done, so mburns whenever the pager stops ringing, feel free to have at it!
(Reporter)

Updated

6 years ago
Blocks: 781809
(Assignee)

Comment 15

6 years ago
burnsie is traveling to MozCamp.  I'm taking these over for him, but I won't get started until later this afternoon.
(Reporter)

Comment 16

6 years ago
Thanx!
(Assignee)

Updated

6 years ago
Depends on: 777797
(Assignee)

Updated

6 years ago
No longer depends on: 777797
(Assignee)

Comment 17

6 years ago
these have been rekicked and puppetized.  Each server had this error after the puppetze run. 

---

notice: /Stage[main]/Mysql2::Server/Service[mysql]: Dependency Package[Percona-Server-server-51] has failures: true
notice: /Stage[main]/Mysql2::Server/Service[mysql]: Dependency File[/etc/my.cnf] has failures: true
warning: /Stage[main]/Mysql2::Server/Service[mysql]: Skipping because of failed dependencies
notice: /Stage[main]/Mysql2::Server/Mysql2::Variable[slow_query_log_file]/Exec[mysql2::variable::slow_query_log_file]: Dependency Package[Percona-Server-server-51] has failures: true
notice: /Stage[main]/Mysql2::Server/Mysql2::Variable[slow_query_log_file]/Exec[mysql2::variable::slow_query_log_file]: Dependency File[/etc/my.cnf] has failures: true
warning: /Stage[main]/Mysql2::Server/Mysql2::Variable[slow_query_log_file]/Exec[mysql2::variable::slow_query_log_file]: Skipping because of failed dependencies
notice: /Stage[main]/Mysql2::Server/Mysql2::Variable[slow_query_log]/Exec[mysql2::variable::slow_query_log]: Dependency Package[Percona-Server-server-51] has failures: true
notice: /Stage[main]/Mysql2::Server/Mysql2::Variable[slow_query_log]/Exec[mysql2::variable::slow_query_log]: Dependency File[/etc/my.cnf] has failures: true
warning: /Stage[main]/Mysql2::Server/Mysql2::Variable[slow_query_log]/Exec[mysql2::variable::slow_query_log]: Skipping because of failed dependencies
notice: /Stage[main]/Mysql2::Server/Mysql2::Variable[log_output]/Exec[mysql2::variable::log_output]: Dependency Package[Percona-Server-server-51] has failures: true
notice: /Stage[main]/Mysql2::Server/Mysql2::Variable[log_output]/Exec[mysql2::variable::log_output]: Dependency File[/etc/my.cnf] has failures: true
warning: /Stage[main]/Mysql2::Server/Mysql2::Variable[log_output]/Exec[mysql2::variable::log_output]: Skipping because of failed dependencies
err: /Stage[main]/Mysql2::Server/File[/var/log/mysql]: Could not evaluate: Could not find user mysql
Assignee: mburns → rbryce.bugs
Status: REOPENED → RESOLVED
Last Resolved: 6 years ago6 years ago
Resolution: --- → FIXED
(Reporter)

Comment 18

6 years ago
Thanx! I fixed the problems and here's the latest run:

[root@bugzilla1.db.scl3 ~]# /usr/local/sbin/puppetctl run
info: Retrieving plugin
info: Loading facts in /var/lib/puppet/lib/facter/customFacts.rb
info: Loading facts in /var/lib/puppet/lib/facter/root_home.rb
info: Loading facts in /var/lib/puppet/lib/facter/puppetmaster.rb
info: Loading facts in /var/lib/puppet/lib/facter/hp_array_utils.rb
info: Loading facts in /var/lib/puppet/lib/facter/vmware_version.rb
info: Loading facts in /var/lib/puppet/lib/facter/concat_basedir.rb
info: Loading facts in /var/lib/puppet/lib/facter/puppet_vardir.rb
info: Loading facts in /var/lib/puppet/lib/facter/partitions.rb
info: Loading facts in /var/lib/puppet/lib/facter/datacenter.rb
info: Loading facts in /var/lib/puppet/lib/facter/available_package_updates.rb
info: Loading facts in /var/lib/puppet/lib/facter/iptables.rb
info: Loading facts in /var/lib/puppet/lib/facter/raidcontroller.rb
info: Caching catalog for bugzilla1.db.scl3.mozilla.com
info: Applying configuration version '46820'
notice: Finished catalog run in 25.58 seconds
[root@bugzilla1.db.scl3 ~]#
Product: mozilla.org → mozilla.org Graveyard
You need to log in before you can comment on or make changes to this bug.