GNAX Down

[Matt]

There is some packet loss affecting some servers at GNAX DC1 in Atlanta. we are looking into this now.

[Matt]

More servers are back online, the last update we received is that they are still working on the problem. We don't have much information other than that but we do see more servers coming back online every minute. Please standby for updates.

We will post them as soon as we get any more information.

[Matt]

Twitter also available for updates if you prefer

Twitter

[Matt]

So as the preliminary reports advise, a nearby lightning strike was to blame. This was enough to knock most everything offline. The servers that are still down are most likely undergoing automatic fsck.

We are going to check them each to make sure that they are truly waiting for fsck to complete or if there is any electrical damage which would prevent the remaining machines from coming back online automatically when fsck completes.

[rlhanson]

Hey Matt -
Do you have any additional info regarding anticipated online status for Missy?

[Matt]

Nothing as of yet, I just put in another ticket a few minutes regarding the remaining servers and it looks like they are plugging a crash cart into the ones you see remaining on netstatus.

[rlhanson]

Okay thanks! Just trying to keep my clients updated as they are all concerned.

[Matt]

We are sorry for the delays for the handful of you that are still waiting are experiencing. We definitely are making our point with GNAX about the issues and they assure us they are scrambling to get information to us and those of you who are still down, back and running.

[Matt]

The list of servers with problems is getting smaller, we will keep at this until they are all back up.

[charlesh]

Given that this is a somewhat recently recurring problem, are things becoming slack there at the DC?