Friday, June 21, 2019
Friday, 21 June 2019, 15:19 - We're aware of Dallas connectivity issues and are investigating now.
Friday, 21 June 2019, 15:41 - This is a networking issue. Our engineers is working on it at the moment.
Friday, 21 June 2019, 15:50 - All the data is safe. We are working on getting our spare router up and working.
Friday, 21 June 2019, 15:59 - Our network is back online. Our engineers is doing their checks before confirming this is stable now.
RFO:
We have experienced a BGP flap on Thursday, 20 June 2019, 08:59 and our engineers have investigated the situation and found out that our main router has rebooted itself for an unknown reason.
We have been monitoring our router since and we haven't seen any irregularities until Friday, 21 June 2019, 15:19.
On Friday, 21 June 2019, 15:19, our router became inaccessable again.
We have dispatched datacenter engineers to physically connect to the router and unfortunately they weren't able to.
We have then immediately attempted to put our spare core router online to replace the faulty one.
Finally on Friday, 21 June 2019, 15:59, the spare router was in place and up and running and our BGP session was reestablished.
For this not to happen again in the future, we are moving forward with our our core redundancy setup plans to have full network redundancy in advance of our scheduled date to complete this.
We sincerely apologize for the inconvenience this situation has caused you and we appreciate your understanding very much.