Print

Print


11:30 am: OSP reported that splicing is complete. Please verify that your Services have restored.

 

Frank

 

From: MICE Discuss <[log in to unmask]> On Behalf Of Frank Bulk
Sent: Tuesday, June 11, 2019 10:44 AM
To: [log in to unmask]
Subject: Re: [MICE-DISCUSS] lost MICE

 

10:33 am: OSP has reported that splicing on the north case is complete. Splicers working on South case. You should start to see service restore as splicing continues. A rough ETR is 1 hour. More updates to follow.

 

Frank

 

From: MICE Discuss <[log in to unmask]> On Behalf Of Frank Bulk
Sent: Tuesday, June 11, 2019 10:05 AM
To: [log in to unmask]
Subject: Re: [MICE-DISCUSS] lost MICE

 

My own link alarm cleared at 9:52 am, so just a hair under 26.5 hours.

 

From what I heard from our field staff, the issue wasn’t that bad – looking through the update, it just took Zayo’s staff and/or contractors a long time to get on site and perform the work.  It seems like they had just one fiber splicing crew, so they didn’t prep and splice on both sides at the same time. We’ve had similar cuts many times before and we would likely have this resolved in 6 to 8 hours.

 

Frank

 

From: MICE Discuss <[log in to unmask]> On Behalf Of James Urwiller
Sent: Tuesday, June 11, 2019 9:43 AM
To: [log in to unmask]
Subject: Re: [MICE-DISCUSS] lost MICE

 

I would like to Thank Frank for reporting all this info.  He is keeping up with the Zayo ticket responses very well!

You mentioned this was cut near your area.. was it really that bad to warrant 24+ hrs?  seems like they are pretty slow with these repairs?

 

James Urwiller

Network Architect

Stealth Broadband

[log in to unmask]

[log in to unmask]" alt="stealth300">

 

From: MICE Discuss <[log in to unmask]> On Behalf Of Frank Bulk
Sent: Tuesday, June 11, 2019 07:58
To: [log in to unmask]
Subject: Re: [MICE-DISCUSS] lost MICE

 

11:04 pm: Excavation is currently underway at this time. Techs are trenching out the 200 feet of cable required to make repairs.

12:58 am: Underground crews have completed the trench on one side of the break. OSP splicers have the cable exposed on that side and are prepping the old cable and the new for repairs. The Underground crew is working to excavate on the opposite end at this time. No ETTR at this time.

2:22 am: OSP crews are still continuing to work at this time. Excavation crews are continuing to work to expose the remaining fiber to prep for splicing. No ETTR at this time.

3:20 am: At this time the underground crew has completed excavation and the cable is fully exposed for repairs. Prep work is still ongoing on both sides. Splicers expect to be splicing on one end of the cable in about 1 hour. The other side will be spliced once prep work is complete. No ETR at this time.

5:04 am: OSP splicers are continuing the splice at this time. Techs are prioritizing the active fibers to speed up restoration. No ETTR at this time.

5:57 am: OSP splicers are continue to finish up the splicing on the North side of the cut. Once complete crews will move to the South side to complete prep work and begin splicing. We have a tentative ETTR of 10 CST today.

7:07 am: OSP splicers onsite advised they have been a bit delayed on the splicing at the North side of the cut. Splicers are nearly complete on the North side, and will be moving to the South to complete prep work and repairs. Crews have revised the tentative ETTR for 12 CST.

 

Frank

 

From: MICE Discuss <[log in to unmask]> On Behalf Of Frank Bulk
Sent: Monday, June 10, 2019 10:47 PM
To: [log in to unmask]
Subject: Re: [MICE-DISCUSS] lost MICE

 

9:26 pm: Emergency locates are nearly complete so the underground construction crew will be able to start major excavations soon. The crew will need to trench along 200 feet of the cable path to add in a new section of fiber. No ETTR at this time.

 

Frank

 

From: Frank Bulk
Sent: Monday, June 10, 2019 9:09 PM
To: 'MICE Discuss' <[log in to unmask]>
Subject: RE: [MICE-DISCUSS] lost MICE

 

8:19 pm: OSP has reported that Underground crew has arrived on site. They will begin excavation within the next few minutes. There is no ETTR at this time. More updates to follow.

 

Frank

 

From: Frank Bulk
Sent: Monday, June 10, 2019 7:15 PM
To: 'MICE Discuss' <[log in to unmask]>
Subject: RE: [MICE-DISCUSS] lost MICE

 

6:58 pm: No Change in Update. OSP has located the damage between 130th and 140th along highway 60 in Sibley IA. Looks like land owner or contractor trenched through the cable. Cable is completely severed. Underground crew is in route and are trying to get around flooded roads. ETA is 30 mins. More updates to follow as we receive them.

 

Frank

 

From: Frank Bulk
Sent: Monday, June 10, 2019 6:00 PM
To: 'MICE Discuss' <[log in to unmask]>
Subject: RE: [MICE-DISCUSS] lost MICE

 

4:47 pm: No Change in Update. OSP has located the damage between 130th and 140th along highway 60 in Sibley IA. Looks like land owner or contractor trenched through the cable. Cable is completely severed. Underground crew is in route with ETA of 2 - 2.5 hours. More updates to follow as we receive them.

 

5:51 pm: No Change in Update. OSP has located the damage between 130th and 140th along highway 60 in Sibley IA. Looks like land owner or contractor trenched through the cable. Cable is completely severed. Underground crew is in route with ETA of 30-45 mins. More updates to follow as we receive them.

 

Frank

 

From: Frank Bulk
Sent: Monday, June 10, 2019 2:56 PM
To: MICE Discuss <[log in to unmask]>
Subject: RE: [MICE-DISCUSS] lost MICE

 

2:42 pm: OSP has reported that splicer is in route and has a ETA of 30 mins. More updates to follow.

 

Note that the location listed in the ticket is incorrect – I’ve communicated the correct address (130th and Hwy 60) to Zayo’s NCC and they’ve acknowledged receipt of that.

 

If they do get onsite by 3:15 pm it will have been about 10 hours since the initial cut.

 

Frank

 

From: MICE Discuss <[log in to unmask]> On Behalf Of Frank Bulk
Sent: Monday, June 10, 2019 1:24 PM
To: [log in to unmask]
Subject: Re: [MICE-DISCUSS] lost MICE

 

12:35 pm: OSP reported they are trying to get resources to the damage location. Damage appears to be right off of I60 and 170th in Sibley IA. ETA or 2.5 hours at 10:58 AM CDT, so splicers should be on-site shortly. More updates to follow.

12:43 pm: OSP reported Splicer is in route to the damage location right off of I60 and 170th in Sibley IA. ETA is approximately 1.5 hrs. More updates to follow.

 

Frank

 

From: MICE Discuss <[log in to unmask]> On Behalf Of Frank Bulk
Sent: Monday, June 10, 2019 10:35 AM
To: [log in to unmask]
Subject: Re: [MICE-DISCUSS] lost MICE

 

Another update from Zayo:

 

10:30 OSP reported they are trying to get resources to the damage location. Damage appears to be right off of I60 and 170th in Sibley IA. Currently there is no ETA for techs. More updates to follow.

 

Frank

 

From: MICE Discuss <[log in to unmask]> On Behalf Of Frank Bulk
Sent: Monday, June 10, 2019 10:27 AM
To: [log in to unmask]
Subject: Re: [MICE-DISCUSS] lost MICE

 

First two updates from Zayo:

 

9:48 am: Your case has been associated with a higher level outage ticket, your ticket number will remain the same. The latest update is as follows: Zayo is experiencing a network event between SIOUX CITY, IA and MANKATO MN affecting multiple customers. The appropriate resources have been engaged for repairs. At this time, OSP is en route to the suspected trouble location to begin investigating. No ETA available as of yet.

 

10:21 am: Our OSP crews are en route to begin investigations. More updates to follow.

 

Frank

 

From: MICE Discuss <[log in to unmask]> On Behalf Of Frank Bulk
Sent: Monday, June 10, 2019 8:53 AM
To: [log in to unmask]
Subject: Re: [MICE-DISCUSS] lost MICE

 

Turns out that the fiber got hit by a tiler in our area, by 130th and Hwy 60 (https://www.google.com/maps?q=hwy+60+and+130th,+sibley&rlz=1C1GCEU_enUS814US815&um=1&ie=UTF-8&sa=X&ved=0ahUKEwjcyZ_sht_iAhVRCKwKHZE6DGsQ_AUIECgB) in Sibley, Iowa.  The tiler called one of our techs and the farmer called another one of our techs, inquiring if it was our fiber or not (it’s not).  The tiler reported hitting a line below the tape.

 

I opened a ticket with Zayo’s NCC email address about 35 minutes ago, and haven’t yet received an acknowledgement, but once I do I will inform them of the location.

 

Frank

 

From: MICE Discuss <[log in to unmask]> On Behalf Of Frank Bulk
Sent: Monday, June 10, 2019 8:06 AM
To: [log in to unmask]
Subject: Re: [MICE-DISCUSS] lost MICE

 

Yes, same thing, between 7:25 and 7:26 am our 10G link went down.  I assume it’s an issue between Sioux City and Belle Plaine.

 

Frank

 

From: MICE Discuss <[log in to unmask]> On Behalf Of James Urwiller
Sent: Monday, June 10, 2019 7:58 AM
To: [log in to unmask]
Subject: [MICE-DISCUSS] lost MICE

 

I lost MICE again over ZAYO about 30 minutes ago.. anyone else?

 

James Urwiller

Network Architect

Stealth Broadband

[log in to unmask]

[log in to unmask]" alt="stealth300">

 

 


To unsubscribe from the MICE-DISCUSS list, click the following link:
http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1

 


To unsubscribe from the MICE-DISCUSS list, click the following link:
http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1

 


To unsubscribe from the MICE-DISCUSS list, click the following link:
http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1

 


To unsubscribe from the MICE-DISCUSS list, click the following link:
http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1

 


To unsubscribe from the MICE-DISCUSS list, click the following link:
http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1

 


To unsubscribe from the MICE-DISCUSS list, click the following link:
http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1

 


To unsubscribe from the MICE-DISCUSS list, click the following link:
http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1

 


To unsubscribe from the MICE-DISCUSS list, click the following link:
http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1

 


To unsubscribe from the MICE-DISCUSS list, click the following link:
http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1

 


To unsubscribe from the MICE-DISCUSS list, click the following link:
http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1

 


To unsubscribe from the MICE-DISCUSS list, click the following link:
http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1



To unsubscribe from the MICE-DISCUSS list, click the following link:
http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1