Outage - 1AM Central

[VOIPoTim]

When it rains, it pours. As much as I hate to say it, we had another outage right now.

The datacenter which we have some of our core equipment in (along with many thousands of HostGator servers) had a network switch that went down for scheduled maintenance tonight. Our DNS servers are both in that zone so some users undoubtedly ran into issues connecting.

Their scheduled maintenance was communicated to HostGator and HostGator communicated it to affected customers, but there was a major major breakdown in communication in that it wasn't communicated to us since we're not really a HostGator customer. We're increasing the communication between the two companies so this never happens again.

Once we realized it was down and found out about this maintenance, we were able to get things back online very quickly.

It looks like nearly all PAP2 users reconnected immediately and nearly all Grandstream HT502 users directly connected to a modem reconnected almost immediately. Unfortunately, in terms of Grandstream users behind a router/NAT, it seems like about 90% of them reconnected at this point and 10% did not. If you are one of those users (a few hundred) you may need to reboot.

We'll be sending out a system-wide e-mail shortly so everyone is aware of the situation. We apologize for any inconvenience has caused and we're confident that these outages will become less frequent.

[VOIPoTim]

Since network blips, etc will always occur with a service that uses the public internet, it's critical that we get the remaining Grandstream adapters used behind a NAT to ALL be re-registering consistently.

Again, we're now shipping PAP2s out by default and only sending the HT502s out by request so in the future this would not come up.

We're evaluating options for dealing with the 10% of so of our HT502s that are still not re-registering. We've considered possible replacing them all with PAP2s but are working with Grandstream to try to exhaust other options before doing this. They've asked us to give them a week and they're going through logs. We're going to let them work on it and will continue to evaluate all options for dealing with them.

Again virtual all PAP2 users and Grandstream HT502 users NOT behind a router will automatically re-register and these outages will be self-correcting.

It's the Grandstream HT502s behind a router that still have about 10% not doing it.

[burris]

Yep..

Just got up and found both my PAP2s online as you described, with no problems.

[Xponder1]

Thank you for the heads up. I am one of the few it seems.
"You do not currently have any devices registered to our servers! "

Thanks Tim,

[NY Tel Guy]

.......Again virtual all PAP2 users and Grandstream HT502 users NOT behind a router will automatically re-register and these outages will be self-correcting.

It's the Grandstream HT502s behind a router that still have about 10% not doing it.

I am also a member of the great "502 unwashed" whose adpater is not registering in a NAT environment.
I am not home now so I cannot re-boot it but I guess if I am not home, I can't miss the calls that I would not have been home for.....

[dcshobby]

We are also behind a NAT with the 502 and we lost registration again. This is really getting sickening and if the only way to fix it is to move to a PAP2, count us in because we are sick of restarting the 502 all the time. If new firmware can fix the 502 though, we would gladly hold onto it.

[GTOJim]

I have missed all of the fun.

My GS-502 hasn't missed a beat, have not had any registration issues that I'm aware of.

I have one of the first GS-502's still using the original firmware it shipped with. My 502 is behind a router, static IP setup for it with port forwarding. Everything has been working beautifully with one exception. It didn't update to a newer firmware which might be a good thing.

[VOIPoTim]

I have missed all of the fun.

My GS-502 hasn't missed a beat, have not had any registration issues that I'm aware of.

I have one of the first GS-502's still using the original firmware it shipped with. My 502 is behind a router, static IP setup for it with port forwarding. Everything has been working beautifully with one exception. It didn't update to a newer firmware which might be a good thing.

The other big thing too is that you only have 1 line configured, so the HT502 has nothing to get confused with.

[sr98user]

I lost registration overnight. It did not reconnect. I had to reboot.

Is it a problem with the GS firmware? Why is it stopping the retrys?

[usa2k]

You guys who lost registration are behind NAT?
(Mine did great behind the Cable Modem.)