Traffic started ramping up at 7:45. Thanks to all who worked on this. Frank -----Original Message----- From: MICE Discuss [mailto:[log in to unmask]] On Behalf Of Andrew Hoyos Sent: Tuesday, September 27, 2016 11:00 PM To: [log in to unmask] Subject: Re: [MICE-DISCUSS] What's happening with MICE bandwidth this evening? That’s what we’re seeing too: er1.511.msp rpd[1461]: bgp_read_v4_message:10672: NOTIFICATION received from 206.108.255.37 (External AS 36040): code 6 (Cease) subcode 6 (Other Configuration Change) (which on JunOS, actually flaps the session) -- Andrew Hoyos [log in to unmask] > On Sep 27, 2016, at 10:56 PM, [log in to unmask] <[log in to unmask]> wrote: > > Looks the same as yesterday on both servers: > 206.108.255.37 BGP master up 22:38:09 Established > 2001:504:27:0:0:8cc8::1 BGP master start 22:42:34 Idle Received: Maximum number of prefixes reached > > But I see we've started getting these BIRD log messages: > 016-09-26 17:28:45NASN_36040: Received: Other configuration change > > Additionally my ping generated a "We're actively troubleshooting this issue" reply, so it all seems to fit together. > > Cheers, > anthony > > > Anthony Anderberg > Sr. Systems Analyst > 320-234-5239 > [log in to unmask] > www.nutelecom.net > > > -----Original Message----- > From: MICE Discuss [mailto:[log in to unmask]] On Behalf Of Andrew Hoyos > Sent: Tuesday, September 27, 2016 10:40 PM > To: [log in to unmask] > Subject: Re: [MICE-DISCUSS] What's happening with MICE bandwidth this evening? > > We have bilateral sessions to them, not sure on the route reflectors. Can someone check logs/BGP uptime there? > > -- > Andrew Hoyos > [log in to unmask] > > > >> On Sep 27, 2016, at 10:25 PM, Frank Bulk <[log in to unmask]> wrote: >> >> Thanks for reaching out to your Google contacts. >> >> Are you saying that MICE's route reflectors have been seeing their BGP sessions to Google's cache boxes flapping over the last few days? >> >> Frank >> >> -----Original Message----- >> From: MICE Discuss [mailto:[log in to unmask]] On Behalf Of Andrew Hoyos >> Sent: Tuesday, September 27, 2016 10:16 PM >> To: [log in to unmask] >> Subject: Re: [MICE-DISCUSS] What's happening with MICE bandwidth this evening? >> >> We’ve had some issues with our sessions to the Google cache boxes flapping over the last few days. >> Checking with a few internal folks to Google, seemed like maybe there were a few other open tickets related to these cache boxes too. >> >> -- >> Andrew Hoyos >> [log in to unmask] >> >> >> >>> On Sep 27, 2016, at 10:09 PM, Frank Bulk <[log in to unmask]> wrote: >>> >>> Looks like it’s the Google LAG: >>> >>> >>> >>> From: MICE Discuss [mailto:[log in to unmask]] On Behalf Of Frank Bulk >>> Sent: Tuesday, September 27, 2016 10:07 PM >>> To: [log in to unmask] >>> Subject: [MICE-DISCUSS] What's happening with MICE bandwidth this evening? >>> >>> Saw our own MICE-facing traffic drop down, and I see MICE’s own aggregate is the same. >>> >>> To unsubscribe from the MICE-DISCUSS list, click the following link: >>> http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 >>> >>