GNAX Network Issues

[Matt]

The official word from GNAX is:

At approsximately 5:00 am for some reason our external fans that draw air through the dry cooler room both shut down. they did not lose power that we know of - but they just stopped. they are on automatic to run at a certain temperature. well this caused the dry cooler water loop to slowly heat up to the point that we started losing ac units on high head pressure.

once that happened - our power room had several main breakers trip due to heating.

we have turned the fans on manual - so they are on with no electronics intervention - sothey will just run 24x7 at this point.

some of the aggregation switches were on the breakers that went out so part of the dc was out. that is why some of your servers were out and others were not.

we are going to leave the fans on at this point rather than risk going to auto again since we are so close to opening the new dc anyway

[monkette]

I pinged and pinged away for Glowhost and my Fran for about 40 minutes until I went to bed. I ran network-tools tests that said that the GNAX router was timed out...not Glowhost, but I thought maybe somebody bombed Atlanta or something...glad to see it's back up...