I do agree that filtering BGP prior to the move is a great thing to do. I know we attempted it in the past, and we had some issues getting it to work properly. Now that we are on the Arista, I have tested it and it seems to work well. I plan on utilizing it on all future maintenance on the Arista switch.
From: MICE Discuss [mailto:[log in to unmask]] On Behalf Of Andrew Hoyos
Sent: Wednesday, April 26, 2017 8:08 AM
To: [log in to unmask]
Subject: Re: [MICE-DISCUSS] Arista Round 3 Moves
On Apr 26, 2017, at 6:52 AM, John Unger <[log in to unmask]> wrote:
> Jeremy, why are we doing these moves during the day? This does not make sense to me? Having been in this industry for over 35 years this is just crazy? Nobody does maintenance during the day?
If you are worried about impact, shut down *your* MICE peering sessions to affected parties before the maintenance starts.
I would suggest that perhaps we look into filtering BGP (tcp/179) with an ACL prior to maintenance start on those specific ports being moved. Many other IXs are doing this for maintenance as a way to gracefully take things down, and let bilateral and RS sessions time out without killing active traffic. As we've noticed, not all members being moved are bothering to shut down sessions prior, which causes impact to/from those members. (i.e.: https://ripe67.ripe.net/presentations/374-WH-IXPMaintReduce.pdf)
A small minority of members are also doing BFD which can lessen impact here. If your gear supports it, I'd suggest looking into as a way to minimize impact of things like this.
> Yesterday's maintenance caused our switch to have problems and we were not even part of the move??
You're on the Mankato remote switch. That was listed in the maintenance notification as being affected.
> Is MICE issuing credits for outages??
Surely, you're joking, right?
As an aside, thanks Jeremy for doing all this move work, it's not a small effort and definitely appreciated.
> -----Original Message-----
> From: MICE Discuss [mailto:[log in to unmask]] On Behalf Of Jeremy Lumby
> Sent: Tuesday, April 25, 2017 1:20 PM
> To: [log in to unmask]
> Subject: Re: [MICE-DISCUSS] Arista Round 3 Moves
> The maintenance is now starting
> -----Original Message-----
> From: Jeremy Lumby [mailto:[log in to unmask]]
> Sent: Saturday, April 15, 2017 6:03 PM
> To: MICE Discuss
> Subject: Arista Round 3 Moves
> I am planning on doing round 3 of moves to the Arista switch on the afternoon of 4/25/17 beginning at 1PM. The following connections to the main switch will be moved:
> Netflix (Will simultaneously upgrade to 2x100G) Google Hurricane Electric CNS (remote switch feed) Neutral Path (remote switch feed) Vast Broadband DCN Charter Broadband Visions Jaguar Yahoo SDN TDS CloudFlare Fastly Mankato Networks (remote switch feed) MN VoIP (remote switch feed)
> I suggest that all members listed above, as well as the members connected to the remote switches above shutdown BGP by 12:00PM CST to avoid dropped packets while being moved. Please leave the interface up so that we can test link, as well as the ability to ping the interface IP. Additional notice will be sent immediately before and after the maintenance.
> Jeremy Lumby
> Minnesota VoIP
> 9217 17th Ave S
> Suite 216
> Bloomington, MN 55425
> Main: 612-355-7740 x211
> Direct: 612-392-6814
> EFax: 952-873-7425
> [log in to unmask]
[log in to unmask]