Final recap:
At 1:19PM, our OC12c to qwest.net went down.
A ticket is open with qwest.net already, they are saying they
aren't receiving any light from us.
...lots of time goes by...
As of 5:17PM, the Oc12c to qwest.net is back online.
Reason for outage from Qwest:
Qwest connectivity in the MUX was originally installed
incorrectly by Qwest in July, 2004.
We were plugged into the backup OC12c card on the MUX, not the
primary card as it should have been.
Something changed in the MUX taking down the backup card.
Qwest dispatched and was working on the MUX and noticed the
problem with the incorrect connectivity and moved our fibers
over to the working card (primary).
The primary card was never provisioned completely, so when the
fibers were installed, nothing happened as far as our
connection to the qwest.net backbone.
Qwest tech had to work with the CO techs to move fibers around
and get the other MUXes in between reconfigured correctly.
Connectivity returned once the fiber paths were reconfigured.
It is hard to believe that it took 4 hours to rectify this problem and
I'll be working with our local Qwest reps to see what can be done to
protect us further from this kind of issue. I am also hoping for a
more descriptive answer for the reason for outage.
The OC48 MUX itself was working as it should have, only the cards and
the SONET configuration were screwed up causing the issues today.
I wish to thank everyone who called and emailed today for your
patience and understanding while we worked this out.
Another announcement is on the way.
Support can be reached Monday thru Friday from 8:00am until 8:00pm,
Saturdays from 11:00am until 4:00pm via phone at 612-337-6340, or via
email at [log in to unmask]
--
Mike Horwath [log in to unmask]
ipHouse - Welcome home!
