Print

Print


Traffic started ramping up at 7:45. Thanks to all who worked on this.

Frank

-----Original Message-----
From: MICE Discuss [mailto:[log in to unmask]] On Behalf Of Andrew Hoyos
Sent: Tuesday, September 27, 2016 11:00 PM
To: [log in to unmask]
Subject: Re: [MICE-DISCUSS] What's happening with MICE bandwidth this evening?

That’s what we’re seeing too:

er1.511.msp rpd[1461]: bgp_read_v4_message:10672: NOTIFICATION received from 206.108.255.37 (External AS 36040): code 6 (Cease) subcode 6 (Other Configuration Change)

(which on JunOS, actually flaps the session)

--
Andrew Hoyos
[log in to unmask]



> On Sep 27, 2016, at 10:56 PM, [log in to unmask] <[log in to unmask]> wrote:
> 
> Looks the same as yesterday on both servers:
> 206.108.255.37 BGP      master   up     22:38:09    Established
> 2001:504:27:0:0:8cc8::1 BGP      master   start  22:42:34    Idle          Received: Maximum number of prefixes reached
> 
> But I see we've started getting these BIRD log messages:
> 016-09-26 17:28:45  NASN_36040: Received: Other configuration change
> 
> Additionally my ping generated a "We're actively troubleshooting this issue" reply, so it all seems to fit together.
> 
> Cheers,
> anthony
> 
> 
> Anthony Anderberg
> Sr. Systems Analyst
> 320-234-5239
> [log in to unmask]
> www.nutelecom.net
> 
> 
> -----Original Message-----
> From: MICE Discuss [mailto:[log in to unmask]] On Behalf Of Andrew Hoyos
> Sent: Tuesday, September 27, 2016 10:40 PM
> To: [log in to unmask]
> Subject: Re: [MICE-DISCUSS] What's happening with MICE bandwidth this evening?
> 
> We have bilateral sessions to them, not sure on the route reflectors. Can someone check logs/BGP uptime there?
> 
> --
> Andrew Hoyos
> [log in to unmask]
> 
> 
> 
>> On Sep 27, 2016, at 10:25 PM, Frank Bulk <[log in to unmask]> wrote:
>> 
>> Thanks for reaching out to your Google contacts.
>> 
>> Are you saying that MICE's route reflectors have been seeing their BGP sessions to Google's cache boxes flapping over the last few days? 
>> 
>> Frank
>> 
>> -----Original Message-----
>> From: MICE Discuss [mailto:[log in to unmask]] On Behalf Of Andrew Hoyos
>> Sent: Tuesday, September 27, 2016 10:16 PM
>> To: [log in to unmask]
>> Subject: Re: [MICE-DISCUSS] What's happening with MICE bandwidth this evening?
>> 
>> We’ve had some issues with our sessions to the Google cache boxes flapping over the last few days.
>> Checking with a few internal folks to Google, seemed like maybe there were a few other open tickets related to these cache boxes too.
>> 
>> --
>> Andrew Hoyos
>> [log in to unmask]
>> 
>> 
>> 
>>> On Sep 27, 2016, at 10:09 PM, Frank Bulk <[log in to unmask]> wrote:
>>> 
>>> Looks like it’s the Google LAG:
>>> 
>>> 
>>> 
>>> From: MICE Discuss [mailto:[log in to unmask]] On Behalf Of Frank Bulk
>>> Sent: Tuesday, September 27, 2016 10:07 PM
>>> To: [log in to unmask]
>>> Subject: [MICE-DISCUSS] What's happening with MICE bandwidth this evening?
>>> 
>>> Saw our own MICE-facing traffic drop down, and I see MICE’s own aggregate is the same.
>>> 
>>> To unsubscribe from the MICE-DISCUSS list, click the following link:
>>> http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1
>>> 
>>