Service Status

Resolved

Issue with two servers in UK

Tuesday, 09 July 2019, 08:49 - We're investigating an issue with our ukhighram1 and ukvz7highram1 host nodes. All other UK services are currently online. We'll provide updates here as we have them. 

Tuesday, 09 July 2019, 10:01 - This issue is still under investigation. An ETA is not available beyond as soon as possible. 

Tuesday, 09 July 2019, 11:00 - Our datacenter hasn't provided us with enough information about the source of the outage. They are still working on to get them back online.

Tuesday, 09 July 2019, 11:29 - Our datacenter has notified us that the power distribution unit in the rack which is connected to these servers is having issues and that they are working on to replace it.

Tuesday, 09 July 2019, 12:25 - The PDU has been replaced and all servers are back online now. If you're still seeing a connectivity issue please don't hesitate to ticket in to inquire and we'll investigate. Thank you. 

Resolved

Storage server connectivity with IP range 63.142.248.xxx

Friday, 28 June 2019, 12:15 - we're aware of a connectivity issues for storage servers in IP range 63.142.248.xxx and are working this issue now. 

Friday, 28 June 2019, 12:39 - this is fixed. If you're still seeing an issue with 63.142.248.xxx please do tricket in. 

Resolved

Dalhighram16 - connectivity issues

Wednesday, 26 June 2019, 02:37 - We are experiencing connectivity issues and are currently investigating the problem on dalhighram16. Updates to follow.
Wednesday, 26 June 2019, 02:53 - We have identified the problem and applied a fix. Connectivity is restored in full.

Resolved

Network Downtime in Dallas

Friday, 21 June 2019, 15:19 - We're aware of Dallas connectivity issues and are investigating now. 

Friday, 21 June 2019, 15:41 - This is a networking issue. Our engineers is working on it at the moment.

Friday, 21 June 2019, 15:50 - All the data is safe. We are working on getting our spare router up and working.

Friday, 21 June 2019, 15:59 - Our network is back online. Our engineers is doing their checks before confirming this is stable now.

RFO:

We have experienced a BGP flap on Thursday, 20 June 2019, 08:59 and our engineers have investigated the situation and found out that our main router has rebooted itself for an unknown reason.

We have been monitoring our router since and we haven't seen any irregularities until Friday, 21 June 2019, 15:19.

On Friday, 21 June 2019, 15:19, our router became inaccessable again.

We have dispatched datacenter engineers to physically connect to the router and unfortunately they weren't able to.

We have then immediately attempted to put our spare core router online to replace the faulty one.

Finally on Friday, 21 June 2019, 15:59, the spare router was in place and up and running and our BGP session was reestablished.

For this not to happen again in the future, we are moving forward with our our core redundancy setup plans to have full network redundancy in advance of our scheduled date to complete this.

We sincerely apologize for the inconvenience this situation has caused you and we appreciate your understanding very much.

Resolved

Connectivity issues in Dallas Location

 Thursday, 20 June 2019, 08:59 - we're aware of Dallas connectivity issues and are investigating now. 

Thursday, 20 June 2019, 09:09 - issue resolved and everything back online. Please do open a ticket if you're still seeing connectivity issues. Thank you. 

Resolved

Varied Dallas network connectivity issues

Friday, 31 May 2019, 07:45 - Some customers are reporting connectivity issues to our Dallas location. If this is affecting you, please run a traceroute from yourself to one of your Dallas services and provide it in a ticket. Thank you.

Friday, 31 May 2019, 08:11 - Issue is solved, waiting for confirmation of stability from datacenter.

Friday, 31 May 2019, 09:40 - Issue confirmed solved, RCA from datacenter: We received this from he.net. One of the routers in Ashburn unexpectedly reloaded, resulting in some routing irregularities while paths converged.

Resolved

dalpremium12 emergency reboot

We are rebooting dalpremium12 node to fix unstability issues. It should come back up in the next 5 minutes.

Update 08:14. All VPS's are booted back up.

Resolved

Dallas packet loss

Saturday, 20 April 2019, 08:39 - we're aware of the packet loss in Dallas and are investigating now. 

 Saturday, 20 April 2019, 09:23 - issue has been resolved and network should be stable now. Please do ticket in if you're still seeing packet loss. 

Resolved

ukhighram3 is offline

Sunday, 24 March 2019, 17:49 - We're aware that this server is currently offline. We've reached out to the datacenter and are currently assessing the situation. Further updates will be tagged to this announcement as they become available. Thank you for your patience.
Sunday, 24 March 2019, 21:50 - The node is back online, we're awaiting an RFO from the DC. Your VMs should now all be coming back online.

Resolved

Connectivity issues impacting some Dallas Storage VPS services

Tuesday, 12 March 2019, 01:04 - We are aware on the connectivity issues affecting some of our Storage VPS Dallas customers. This is related to  an emergency maintenance of our upstream provider. Pending further updates.

Tuesday, 12 March 2019, 04:01- Connectivity issues are resolved.

Resolved

Dallas Network downtime

Saturday, 16 February 2019, 14:11 - we are aware of the Dallas connectivity issues and are investigating now. 

Saturday, 16 February 2019, 14:19 - connectivity is back, awaiting confirmation from the datacenter for stability. 

Resolved

UK location emergency PDU maintenance

Due to a potential PDU issue in our UK cabinet, our DC is going to perform a PDU swap. During this time ukhighram1, ukhighram2, ukhighram3 and ukhighram4 is going to be offline for a period.

The maintenance is going to take place at Thursday February 7th, 2019 @ 5:00PM CST.

The maintenance window is for a few hours but we are expecting that the VPS's are going to come online within 30-40 minutes.

This maintenance is to fix the problem the DC had with their power distribution last week. They have assured us that after this maintenance, they are not expecting any downtimes in the future.

We are sorry for the inconvenience caused due to this.

Update Thursday February 7th, 2019 @ 5:00PM CST: We have shut down all the VPS's which are going to be affected by the power maintenance.

Update Thursday February 7th, 2019 @ 5:21PM CST: The DC has let us know that the maintenance has been started.

Resolved

Connectivity issues affecting UK

Friday, 01 February 2019, 20:04: We've detected connectivity issues affecting our UK nodes, we're currently investigating. Will keep you posted.
Friday, 01 February 2019, 23:46: Services seem to be back online. We'll continue observing the situation and monitoring the nodes.

Resolved

lastorage1 connectivity issues

Monday, 14 January 2019, 09:24 - we are investigating an issue with our lastorage1 host node. We will update this announcement as we have more information. 

 

Monday, 14 January 2019, 10:22 - This issue is now resolved, root cause was a PDU issue which has been replaced. 

Resolved

dalhighcpu2 emergency reboot

Sunday, 13 January 2019, 20:17 - We discovered that this node had kernel panicked, subsequently, an emergency reboot had to be issued. VMs are now booting and should become available over the next 10 minutes. A root-cause analysis will be performed once stability resumes.

Resolved

Dallas Network problem

Thursday, 10 January 2019, 14:33 - we're investigating a Dallas connectivity issue now. We will update this announcement as we have more information. 

Thursday, 10 January 2019, 14:42 - looking like a power issue affecting specific servers. Investigation continues, will update this announcement as we have more information. 

Thursday, 10 January 2019, 14:48 - servers should be back online. We're still investigating to ensure they stay online. 

Resolved

dalpremium8 Emergency Reboot

Due to an unstability issue with dalpremium8, we have to do an emergency reboot.

All VPS's should come back online in less than 5 minutes.

Update: 01/08/2019 02:38: All VPS's are back online.

Resolved

Intermittent connectivity affecting some Dallas nodes

Friday, 21 December 2018, 02:07 - We're aware of the issue, and are attempting to follow up with our connectivity provider. Further updates will be posted to this issue as we receive them.

Friday, 21 December 2018, 07:12 - Connectivity should be restored now. Please let us know if you're still seeing accessibility issues and we will engage. Thank you. 

Resolved

Dallas Network Issue

Wednesday, 28 November 2018, 03:31 - We're aware of the issue in Dallas, and are attempting to follow up with our connectivity provider. Further updates will be posted to this issue as we receive them.
Wednesday, 28 November 2018, 04:21 - Everything should be operating normally already, please get in touch with us in case you're not able to access your service.

Resolved

Network wide port blocks

Due to recent reflection exploits involving ports 111 (portmap/NFS), 161 (snmpd), and 389 (ldap), we've implemented a network-wide filter at our network edge to avoid your services running on these ports from being exploited and used to attack other computers on the internet.

We understand that this may be disruptive to your usage, and we can provide guidance on how to adjust these services to use different ports so that you may continue to enjoy uninterrupted connectivity.

These services are not installed on our VPS by default, so if you do not recognize any of the above services or ports, you're likely not affected by this action and this message is informational only.