Does anyone else find it disappointing that it took Google/Lumen a full 6 days to find and fix a rolled jumper?

Confirmed @ AcenTek as well.  Ours recovered around the same time CST.

 

Jesse

 

From: MICE Discuss <[log in to unmask]> On Behalf Of Frank Bulk
Sent: Monday, October 25, 2021 3:23 PM
To: [log in to unmask]
Subject: Re: [MICE-DISCUSS] bgp with google

 

EXTERNAL: This email originated from a sender outside AcenTek. Do not click links or open attachments unless you recognize the sender and know the content is safe.

 

Update from Google:

For an update, the circuit is restored now.  

Lumen found the fault on their side. Their technician went to the demarc and saw bidirectional light but the fibers were flipped, he was able to correct it.

Link is currently up and stable for an hour with live traffic. BGP sessions are also established. We'll now proceed on closing this case.

 

I saw my two sessions (IPv4 and IPv6) come up between 2:09 and 2:10 pm.

 

Frank

 

From: MICE Discuss <[log in to unmask]>
Sent: Friday, October 22, 2021 7:30 PM
To: [log in to unmask]
Subject: [External GPC] Re: [MICE-DISCUSS] bgp with google

 

I just got this back from Google about two hours ago:

                currently link is still down and we're engaging our vendor to fix the issue.

 

Frank

 

From: MICE Discuss <[log in to unmask]> On Behalf Of Jesse Reed
Sent: Wednesday, October 20, 2021 1:48 PM
To: [log in to unmask]
Subject: Re: [MICE-DISCUSS] bgp with google

 

Same @ AcenTek

 

From: MICE Discuss <[log in to unmask]> On Behalf Of Frank Bulk
Sent: Wednesday, October 20, 2021 1:11 PM
To: [log in to unmask]
Subject: Re: [MICE-DISCUSS] bgp with google

 

EXTERNAL: This email originated from a sender outside AcenTek. Do not click links or open attachments unless you recognize the sender and know the content is safe.

 

FYI, still down for me.

 

Frank

 

From: MICE Discuss <[log in to unmask]> On Behalf Of Andrew Hoyos
Sent: Tuesday, October 19, 2021 11:57 PM
To: [log in to unmask]
Subject: Re: [MICE-DISCUSS] bgp with google

 

AFAIK, they backhaul to Chicago.

 

On Oct 20, 2021, at 1:19 AM, Gary Glissendorf <[log in to unmask]> wrote:



Does google have equipment in 511 or do they backhaul to Chicago.  A fiber cut took down our leases wave from 511 to Chicago this afternoon. 

 

 

Gary Glissendorf | Network Architect

[log in to unmask]" target="_blank">[log in to unmask]

 

From: MICE Discuss <[log in to unmask]> On Behalf Of Jesse Reed
Sent: Tuesday, October 19, 2021 4:09 PM
To: [log in to unmask]
Subject: Re: [MICE-DISCUSS] bgp with google

 

CAUTION: This email originated from outside of SDN Communications. Exercise caution when opening attachments or clicking links, especially from unknown senders.

 

AcenTek also noticed this outage for AS 15169 starting @ 13:12 CST today.  It remains OOS at the moment.

 

Jesse

 

From: MICE Discuss <[log in to unmask]> On Behalf Of Andrew Hoyos
Sent: Tuesday, October 19, 2021 3:57 PM
To: [log in to unmask]
Subject: Re: [MICE-DISCUSS] bgp with google

 

EXTERNAL: This email originated from a sender outside AcenTek. Do not click links or open attachments unless you recognize the sender and know the content is safe.

 

This went down at the same time as some planned Level3 fiber maint between ORD and MSP. 

We had some things on that same path down overnight but now recovered. 

Sent from my iPhone

 

On Oct 19, 2021, at 11:35 PM, Jeremy Lumby <[log in to unmask]> wrote:



Yes, mine is as well.  Looks like their link is down.

 

From: MICE Discuss [mailto:[log in to unmask]] On Behalf Of Jeff Wilde
Sent: Tuesday, October 19, 2021 3:27 PM
To: [log in to unmask]
Subject: [MICE-DISCUSS] bgp with google

 

Anyone elses session idle?

 

206.108.255.141

 

Description: --- Google ---

Remote router ID 0.0.0.0

  BGP state = Active

  NSR State: None

 

Jeff Wilde · Network Engineer · Park Region Office 218.826.6161 · Direct 218.826.8330 · Fax 218.826.6298

 

 

 

---

To unsubscribe from the MICE-DISCUSS list, click the following link:
http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1

 

---

To unsubscribe from the MICE-DISCUSS list, click the following link:
http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1

 

---

To unsubscribe from the MICE-DISCUSS list, click the following link:
http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1

 

---

To unsubscribe from the MICE-DISCUSS list, click the following link:
http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1

***This message and any attachments are solely for the intended recipient. If you are not the intended recipient, disclosure, copying, use or distribution of the information included in this message is prohibited -- Please immediately and permanently delete.***

---

To unsubscribe from the MICE-DISCUSS list, click the following link:
http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1

 

---

To unsubscribe from the MICE-DISCUSS list, click the following link:
http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1

 

---

To unsubscribe from the MICE-DISCUSS list, click the following link:
http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1

 

---

To unsubscribe from the MICE-DISCUSS list, click the following link:
http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1

 

---

To unsubscribe from the MICE-DISCUSS list, click the following link:
http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1

 

---

To unsubscribe from the MICE-DISCUSS list, click the following link:
http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1

 

---

To unsubscribe from the MICE-DISCUSS list, click the following link:
http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1