At 2PM CDT (GMT-5) a power outage occurred at our upstream provider, leaving all services offline while the issue was remedied. Following power restoration, we still saw several servers offline and had to investigate the cause of this problem. One of our power distribution units (PDUs) had failed. We had a spare on site for exactly this type of occurrence, and it was installed as quickly as possible to bring all still-offline services back online at approximately 5PM CDT (GMT-5).

Although this issue was out of our control, we are pleased our emergency response went well with a full PDU failure being resolved in such a short period of time given the extreme situation. It is impossible to avoid hardware failure completely, but we are continually working to ensure we are prepared for such problems when they do arise as they did today.

We would like to thank everyone for their patience and understanding as we worked through the outage today. If you are still seeing any service problems, please let us know and we will check into any remaining issues right away.

We are currently investigating an issue affecting the OnApp control panel and two hypervisors hosting VPS customers. We have techs on site investigating the cause and working to get this issue resolved as soon as possible. Updates will be posted here as soon as we have more information.

[ posted at 8:16PM CDT 4/8/2017 ]

The issue has been identified as a partial PDU failure in the rack servicing our Chicago-based VPS services. This took down two hypervisors and the OnApp control panel server for roughly 60 minutes today (4/8/2017). We have identified the failing PDU ports and will have a replacement installed shortly; service is already restored and VPS services should be back to normal operation at this time.

[ update posted at 9:02PM CDT 4/8/2017 ]

To finalize a software update to the OnApp platform we will be rebooting individual VPSs throughout the day on Sunday, December 11 starting at 8AM. Downtime is expected to be minimal for each VPS, but each VPS may require up to two reboots lasting 5-10 minutes each. We do not have an estimated timeframe for the maintenance completion, however we do not expect any individual VPS to require more than two reboots before the maintenance is finished.

These software updates will allow us to provide faster, more stable VPS hosting services to all customers. If you have any questions or concerns, please contact us at [email protected] or through our Help Desk directly at https://www.geekstorage.com/my/ under the Support tab.

This message was posted on Dec 9 at 11:20AM CDT.

We are aware of an issue with our OnApp cloud that is affecting some of our VPS users. We are investigating the root cause of this issue and hope to have the issue resolved very soon. Thank you for your patience while we work to restore service.

Update at 12:00PM CDT: The issues on our OnApp platform for users on the chi01 node group are now resolved. All VMs should be coming back online at this time. If you still see any issues, please contact our support team for assistance.

As of approximately 3:30 PM CST, the Chi-2 data center's internet connectivity was interrupted by a cut to the data center's fiber line. Engineers are on-site troubleshooting and working to resolve the issue as quickly as possible. 

Chi-2 hosts some of our dedicated server customers and off-site backups for shared and reseller hosting customers. No shared, reseller, or VPS customers are located in Chi-2.

We will continue to post further updates to our service announcements blog and Twitter as soon as they are available. At the current time there is no known ETA for resolution, but please know that the problem is being addressed and a resolution will follow as quickly as is possible.

Update: 01/02/2016 @ 11:20 PM CST

Chi-2 internet connectivity has been restored at this time. When additional information is available, we will post it here.