 |
 |
Hello, my name is Bil MacLeslie and I'm the CEO of ipHouse. I want to personally apologize for todays outage. I'm sincerely sorry this happened and affected so many of our customers. I also want to thank all of our customers for their patience while we restored power and got things back to normal. Thank you! This morning at approximately 8:51am a 480v circuit breaker tripped, shutting down power to an integrated 480v/208v transformer & PDU (power distribution unit). This caused a power outage for some of our colocation customers who are fed power from this PDU. At 9:32am, power was restored to the PDU and by 9:56am all circuits were back on. I personally staggered powering circuits back on to watch for an overload condition. The NEC (National Electric Code) requires that the maximum circuit load be 80% of the rated capacity of the circuit breaker, e.g. 16A maximum on a 20A breaker. We regularly take power readings from each circuit and maintain power utilization within the requirements of the NEC. When reading power utilization today, we found nothing that would cause the 480v circuit to be overloaded. All indicators show that the circuit is not overloaded, nor is the PDU overloaded. The true cause for the breaker being tripped will likely never be known, but does not appear to be from overloading. Because of this outage, some customers have had equipment failures that are indicative of a voltage surge on the system. The UPS and PDU system is protected by a transient voltage surge suppressor (TVSS) and we are investigating the aspect of a surge further. We are also currently investigating to see if the UPS contains data that may shed some light on the situation. As we get more data, we will provide it to you. One last note. Moments like these are trials that test the mettle of the people who make this operation run. My thanks goes out to my staff, who answered the calls, took the heat and made things work under stressful conditions. Thank you. If you have any questions for me, please send them to [log in to unmask] Support can be reached Monday thru Friday from 8:00am until 8:00pm, Saturdays from 11:00am until 4:00pm via phone at 612-337-6340, or via email at [log in to unmask] -- Bil K. MacLeslie - TGWGTD - ipHouse http://www.ipHouse.com/