537786 - most n810s can't resolve production-mobile-master.mv.mozilla.com

Status: RESOLVED FIXED

(Release Engineering :: General, defect)

Description

[Aki Sasaki (not active)]

I'm doing routine maintenance on the n810s, and noticed one couldn't connect to production-mobile-master.mv.mozilla.com (after 600? tries?)

I sshed in and it can't resolve the name. I did a for loop and most of the n810s can't resolve production-mobile-master.mv.mozilla.com.

Are there any known DNS/wireless issues? These are on the Mozilla-Build wireless network. /etc/resolv.conf only shows 127.0.0.1 for both broken and working n810s.

The pool's pretty much dead in the water. I can switch to a hardcoded IP if that's the most expedient solution.

Comment 1

[Aki Sasaki (not active)]

Ok.

From maemo-flashing (desktop computer on MV 2nd floor),

  nslookup production-mobile-master

gives me production-mobile-master.mv.mozilla.com, 10.250.48.135 from 10.250.0.21.

From production-mobile-master itself, that same nslookup gives me production-mobile-master.build.mozilla.org, 10.250.48.135 from 10.250.74.125.

Guessing I should switch everything to use build.m.o now ? (aware we're going to do this, just verifying I should do this now)

Comment 2

[Aki Sasaki (not active)]

Just ran

  all_maemo_ssh.sh "sed -i -e 's/mv.mozilla.com/build.mozilla.org/' /builds/buildbot/host.py; grep host /builds/buildbot/host.py"

Guess we'll see if that fixes things.

Comment 3

[Aki Sasaki (not active)]

Reassigning to myself to catch the other mv.mozilla.com hardcodes.

Comment 4

[Aki Sasaki (not active)]

Attachment: mv.mozilla.com -> build.mozilla.org for p-m-m and s-m-m references

Comment 5

[Aki Sasaki (not active)]

I may also have to update .ssh/known_hosts; not sure which ones. Updated cltbld@s-m-m.

Comment 6

[Shyam Mani [:fox2mike]]

Aki, FWIW..I think dmoore finally made the DNS changes for mv yesterday (or that's what I saw on IRC IIRC) and so I think that's why you ran into this. CC'ing him for confirmation.

Comment 7

[Aki Sasaki (not active)]

Comment on attachment 420021 [details] [diff] [review]
mv.mozilla.com -> build.mozilla.org for p-m-m and s-m-m references

http://hg.mozilla.org/build/buildbot-configs/rev/68826f6f2a9f