http://www.iphouse.com/news/ Outages and updates at ipHouse. en-us Copyright 2004-2005 ipHouse. webmaster@iphouse.com Sat, 03 May 2008 07:35:53 GMT http://www.iphouse.com/news/outages/2008/2008-05-03.01.txt As was announced, we replaced a 3 phase breaker for pur PDU (power distribution unit) that had failed on us a few weeks ago. The replacement of the breaker went very smooth. Power had been restored at approximately 12:30am. Thank you to everyone who worked with us during this scheduled outage. webmaster@iphouse.com Sat, 03 May 2008 07:35:53 GMT http://www.iphouse.com/news/outages/2008/2008-04-16.01.txt This announcement is final follow up to the power outage from March 28, 2008. The UPS manufacturer was here on April 10th and did some analysis of the UPS to see if there was any information to be learned. The results show that the UPS is functioning properly and is not overloaded and hasn't given us any indication as to why the breaker tripped. That leaves the breaker as the only possible source of this outage. webmaster@iphouse.com Wed, 16 Apr 2008 19:51:18 GMT http://www.iphouse.com/news/outages/2008/2008-04-08.01.txt As was told to me last night, and physically verified late last night, the MUX is only powered by the 'A' side of the 48v D/C power plant. Electrictions tonight are supposed to extend the B side power into the system, as the A side is looking good, no outage is expected. I do not have a time for this work yet, though. Estimations were for ~11:00pm tonight. I'll try to find something more concrete. webmaster@iphouse.com Tue, 08 Apr 2008 14:36:19 GMT http://www.iphouse.com/news/outages/2008/2008-04-07.03.txt There might be a problem with the D/C power feed into the OC48 fiber MUX as I just got a call from the building that the MUX may have been wired incorrectly when it was installed by Qwest for the power feed. I am heading to the datacenter now to physically look at the situation. webmaster@iphouse.com Tue, 08 Apr 2008 03:47:20 GMT http://www.iphouse.com/news/outages/2008/2008-04-07.02.txt The B leg has been restored and the OC48 MUX is back online. I am receiving the recovery pages now from our monitoring systems and logging into all of the routers shows connectivity has been restored. I am waiting for a final report from our building maintenance people as to what happened. webmaster@iphouse.com Tue, 08 Apr 2008 02:29:19 GMT http://www.iphouse.com/news/outages/2008/2008-04-07.01.txt The building has scheduled maintenance later tonight on the A leg of power from the D/C power plant. A customer in the building, do not know who, or where, allegedly blew the power on both the A and B legs of the D/C (direct current) power plant that services the fiber MUX gear handling: webmaster@iphouse.com Tue, 08 Apr 2008 02:11:42 GMT http://www.iphouse.com/news/outages/2008/2008-03-28.04.txt Hello, my name is Bil MacLeslie and I'm the CEO of ipHouse. I want to personally apologize for todays outage. I'm sincerely sorry this happened and affected so many of our customers. I also want to thank all of our customers for their patience while we restored power and got things back to normal. Thank you! webmaster@iphouse.com Fri, 28 Mar 2008 22:54:19 GMT http://www.iphouse.com/news/outages/2008/2008-03-28.03.txt Breaker has now been reset and servers are coming back online. I will send another annoucement if I receive any other information. webmaster@iphouse.com Fri, 28 Mar 2008 14:56:50 GMT http://www.iphouse.com/news/outages/2008/2008-03-28.02.txt As a followup - the breaker has not been reset as of 5 minutes ago, waiting on building maintenance. I'll post another announcement as soon as I have more information. At this time I do not have an ETA. One the breaker has been reset, ipHouse personnel will be walking through the datacenter and powering up servers in the racks that were affected. webmaster@iphouse.com Fri, 28 Mar 2008 14:38:37 GMT http://www.iphouse.com/news/outages/2008/2008-03-28.01.txt This morning a breaker on one of the PDUs in the datacenter tripped causing an outage of part of the data center. There are 3 separate PDUs in the data center and this is the one that powers many of the 1/2 and full racks in the data center. The breaker has been reset and we will be taking power readings later today (which we do monthly anyway) to check on load distribution. webmaster@iphouse.com Fri, 28 Mar 2008 14:18:40 GMT