Today, at 5:02 PM and 5:12 PM on 3/21/2011, m20-1.mpls.iphouse.net one
of our core routers handling our Level3 upstream bandwidth rebooted
unexpectedly while a redundant hardware part was being replaced. It
should not have been affected by this change, and the way it failed,
should have been covered by other redundancies on the hardware itself.

This affected any connections made through our Level3 upstream back
to the Net, while the remote sites recomputed the destination to reach
our network through our remaining two upstream bandwidth providers,
and some people may have noticed some packet loss or reachability
while the routing was being recomputed external to us.

We will have to schedule up a maintenance window to finish the 
part swap that was going on this evening at some future time.
Not having this part installed won't affect any current services. 
This replacement again should not have had any impact, with the
redundancies this hardware has, but the gremlins come out now and then.

If you have any problems or questions please let us know at
[log in to unmask], or call us up at 612-337-6340.

Thank you.



-- 
Doug McIntyre                            <[log in to unmask]>
          -- ipHouse/Goldengate/Bitstream/ProNS -- 
       Network Engineer/Provisioning/Jack of all Trades