EVPN Solutions/Applications for DC& SP Segments
Ali Sajassi
Distinguished Engineer, Cisco System
MPLS Japan 2015, Nov 92006

-2008

Started the project OPEN atCisco
OPEN = Optimum Ethernet
Network

BRKMPL-2333-Introduced to IETF as
Routed-VPLS
Merged with Juniper’s
MAC-VPN and wasintroduced an EVPN

© 2014 Cisco and/or its affiliates. All rights reserved.

2010

Following drafts wereintroduced:- EVPN- IPBB-EVPN- EVPN-VPWS- EVPN-Overlay- EVPN-ETREE

Cisco Public

2012

2014/2015

Following drafts were introduced- EVPN IRB- EVPN DCIEnhancements- Virtual ES- Optimized ingress replication- IGMP aggregation betweenPODs- mcast tunnels between DCs- Inter-AS for IRB- L3VPN multi-homingChallenges with Legacy VPN (VPLS)• Next generation VPN solution need to have
– Extensive multi-homing capabilities– Per-flow load-balancing in the core and accesswith DF election and loop prevention– Fast convergence upon failure

M1

CE1

PE1

PE3

PE2

PE4

PE1

PE3

PE2

PE4

CE2

M2

Echo !

• Existing VPLS solutions do not offer an AllActive per-flow redundancy

M1

CE1

CE2 Duplicate !

• Looping of Traffic Flooded from PE• Duplicate Frames from Floods from the Core
• MAC Flip-Flopping over Pseudowire

M1– E.g. Port-Channel Load-Balancing does notproduce a consistent hash-value for a frame withthe same source MAC (e.g. non MAC basedHash-Schemes)
BRKMPL-2333© 2014 Cisco and/or its affiliates. All rights reserved.

Cisco Public

3

CE1

PE1

PE2

MAC
Flip-FlopPE3

PE4

CE2M2

What is EVPN ?
EVPN is next generation all-in-one VPN solution
E-LAN

E-LINE

E-TREE(MP2MP
L2VPN)(P2P
L2VPN)(P2MPL2VPN)

VPLS

PW

VPLSETREE

4364

EVPN
VPWS

EVPN
ETREE

EVPNL3VPN

L3VPN

DC Fabric

IRB

DCI

(IntraDCOverlay)(L2/L3Overlay)(InterDC)

EVPNOverlay

EVPNIRB

EVPNDCIEVPNPBBEVPN

4BRKMPL-2333© 2014 Cisco and/or its affiliates. All rights reserved.

Cisco Public

Not only a single technology/solution does the job of many existing solutions
but it does it better!

PBBEVPN
EVPN
VPWS

Service

Additional Capabilities

E-LAN•••

Provides All-Active multi-homing
Prevents loop for both all-active & single-active even in transient stateAbility to do per-flow LB & DF

E-Line•••Both single-segment & multi-segment support
Discovery & signaling via single protocol – BGP
All-active & single-active redundancy support

E-TREE•

Ingress filtering for traffic destined to egress leaf sites

EVPNETREEBRKMPL-2333© 2014 Cisco and/or its affiliates. All rights reserved.

Cisco PublicNew Applications & Solutions

EVPNOverlay
EVPNIRB
EVPNDCI
BRKMPL-2333

ServiceFeatures

DC-Fabric(IntraDC Overlay)

••
•
••

Geo-redundancy & VM mobility support
ARP suppression & ARP proxy
Support for different encaps such as VxLAN, NVGRE, MPLS, MPLSoUDP
Extensive multi-homing support
Extensive load-balancing capabilities

IRB••
•

both L2 & L3 (on a per flow) for a given VLAN/tenant
L3 only mode when needed
Inherent support for anycast GW

DCI(InterDC)•

Support for any kind of access technology such as EVPN Overlay (VxLAN),
Native Ethernet, TRILL, 802.1Qbp, MPLS
Seamless interop with IP-VPN (RFC4364)•© 2014 Cisco and/or its affiliates. All rights reserved.

Cisco PublicServiceIETF draftsE-LAN••••••••

RFC7209 – draft-ietf-l2vpn-evpn-req
RFC 7432 - draft-ietf-l2vpn-evpn
RFC 7623 - draft-ietf-l2vpn-pbb-evpn
draft-ietf-bess-evpn-vpls-seamless-integ
draft-rbadan-bess-evpn-optimized-ir
drft-mohanty-bess-evpn-df-election
draft-sajassi-bess-evpn-igmp-mld-proxy
Draft-sajassi-bess-pbb-evpn-anycast-ip-tunnel

EVPNVPWS

E-Line••draft-ietf-bess-evpn-vpws
draft-boutros-bess-evpn-service-edge-gw

EVPNETREE

E-TREE• draft-bess-l2vpn-evpn-etree

EVPN/
PBBEVPNBRKMPL-2333© 2014 Cisco and/or its affiliates. All rights reserved.

Cisco PublicEVPNOverlay

ServiceIETF drafts

DC-Fabric(IntraDC Overlay)•

draft-ietf-bess-evpn-overlay

IRB

•
•

draft-bess-l2vpn-evpn-inter-subnet-forwarding
draft-bess-l2vpn-evpn-prefix-advertisement

DCI(InterDC)

•
•
•
•

draft-sajassi-l2vpn-evpn-ipvpn-interop
draft-ietf-l2vpn-trill-evpn
Draft-ietf-l2vpn-spb-evpn
draft-boutros-l2vpn-vxlan-evpn

L3VPN

•

draft-sajassi-evpn-l3vpn-multihoming

EVPNIRB
EVPNDCIEVPNL3VPN
BRKMPL-2333© 2014 Cisco and/or its affiliates. All rights reserved.

Cisco Public

E-LANE-LINE

E-TREE(MP2MP
L2VPN)(P2P
L2VPN)(P2MP
L2VPN)VPLS

PW

VPLSETREE

4364

EVPN
VPWS

EVPNETREEEVPNL3VPN

SP Applications

L3VPN

EVPN

PBBEVPN

9EVPN - Highlights• Next generation solution for Ethernet multipoint (E-LAN)
services• PEs run Multi-Protocol BGP to advertise & learn
Customer MAC addresses (C-MACs) over Core

Data-plane address
learning from Access– Same operational principles of L3VPN

Control-plane addressadvertisement / learningover CorePE1• Learning on PE Access Circuits via data-planetransparent learning

PE3

VID 100
SMAC: M1
DMAC: F.F.F

CE1• No pseudowire full-mesh required– Unicast: use MP2P tunnels– Multicast: use ingress replication over MP2P tunnels or use LSM

CE3

MPLS
C-MAC:M2

C-MAC:
M1• Provides– Extensive multi-homing capabilities– Per-flow load-balancing in the core and access with DF
election and loop prevention– Fast convergence upon failure© 2014Solution
Cisco and/or its affiliates.
All rights reserved.
• BRKMPL-2333
Multi-vendor– RFC7432

Cisco Public

10PE2PE4
BGP MAC adv. Route
EVPN NLRI
MAC M1 via PE1

PBB-EVPN PE

PBB -EVPNPBB

Backbone
Edge BridgeHighlights• Next generation solution for Ethernet multipoint(E-LAN) services by combining Provider
Backbone Bridging (PBB - IEEE 802.1ah) and
Ethernet VPN

Control-plane address
advertisement /learning over Core (BMAC)

Data-plane address
learning from Core
• Remote C-MAC to remote
B-MAC binding• Data-plane learning of local C-MACs and remote
C-MAC to B-MAC binding

Data-plane addresslearning from Access• Local C-MAC to local BMAC binding• PEs run Multi-Protocol BGP to advertise local
Backbone MAC addresses (B-MACs) & learn
remote B-MACs

EVPN

PE3

PE1
B-MAC:
B-M1

B-M2

CE3

CE1

MPLS

– Takes advantage of PBB encapsulation to simplify BGP
control plane operation – faster convergence– Lowers BGP resource usage (CPU, memory) on
deployed infrastructure (PEs and RRs)
– Scales for very large number of MACs

C-MAC:
MB

C-MAC:MA
B-MAC:
B-M1

B-M2

PE4PE2• Multi-vendor solution – RFC 7623

BGP MAC adv.
Route
EVPN NLRI
MAC B-M1 via PE2
BRKMPL-2333© 2014 Cisco and/or its affiliates. All rights reserved.

Cisco Public

11When to use PBB-EVPN?
• For SP & DCI applications where E2E L2services needed

PBBEVPN• Lower control-plane overhead than
EVPN alone– PBB-EVPN uses only a sub-set of EVPN routes– Simpler and Faster failure convergence for allactive multi-homing scenarios– Faster MAC move convergence handled indata-plane• Lower control-plane scale requirements
than EVPN alone– BGP MAC advertisements for smaller
Backbone MAC (B-MAC) address space– Requires less resources (CPU, memory) on
deployed infrastructure (PEs / RRs)
BRKMPL-2333© 2014 Cisco and/or its affiliates. All rights reserved.

Cisco Public

12Comparison of L2VPN Solutions
VPLS

PBB-VPLSEVPN

PBB-EVPN

Service Based Load-balancing CE-to-PE

✔

✔

✔

✔

Flow Based Load-balancing CE-to-PE!"

!

✔

✔

Flow Based Load-balancing PE-to-PE!"

!

✔

✔

Flow Based Multi-Pathing in the Core✔

✔

✔

✔

Core Auto-Discovery✔

✔

✔

✔

Access Auto-Sensing!"

!

✔

✔

Redundancy Group Auto-Discovery!"

!

✔

✔

Automatic Designated Forwarder election and Service Carving!"

!

✔

✔

Port-Based / VLAN-based / VLAN Bundling✔

✔

✔

✔

VLAN-aware Bundling!"

!

✔

✔

Ingress Replication

✔

✔

✔

✔

LSM with P2MP Tree✔

✔

✔

✔

!"

!

✔

✔

Requirement
Multi-Homing with All-Active Forwarding

Provisioning Simplicity

Service Interfaces

Multi-Destination Traffic Forwarding

LSM withMP2MP
Tree
BRKMPL-2333© 2014
Cisco and/or
its affiliates. All rights reserved.

Cisco Public13

Comparison of L2VPN Solutions (cont.)
VPLS

PBB-VPLSEVPN

PBB-EVPNCE-PE Link Failures / PE Node Failures

✔

✔

✔

✔

MAC Mobility

✔

✔

✔

✔

CE-PE Link Failures with Local Repair!"

!

✔

✔

Scale to Millions of C-MAC Addresses

!

✔

!

✔

Confinement of C-MAC entries to PE with active flows

✔

✔

!

✔

MAC Summarization

!

!

✔

✔

MAC Summarization co-existence with C-MAC Mobility

!

!

!

✔

Per C-MAC Forwarding Control Policies

!

!

✔

!

Per-Segment Forwarding Control Policies

!

!

✔

✔

Requirement
Fast Convergence

MAC Scalability

Flexible VPN Policies

BRKMPL-2333© 2014 Cisco and/or its affiliates. All rights reserved.

Cisco Public

14

EVPN VPWS: All-Active Operation
RD – RD unique per adv. PEper EVI

PE 1 Eth A-D Route

ESI – 10 bytes ESI as specifyby EVPN Ethernet segment
IETF draft

RD = RD-1a
ESI = ES1
Eth.Tag ID = VPWS-ID A

Eth.Tag ID – 4-bytes local
AC-ID

Label (e.g. X)
RT ext. community

3•

Both single-segment & multisegment support
Discovery & signaling via single
protocol – BGP
All-active & single-active redundancy
support••

RT – RT associated with agiven EVI

RT-aMPLS Label – (downstream
assigned) used by remotePEs to reach segment

PE1VPWS Service Config:
EVI = 100Local AC ID = AC1
VPWS ID = A

CE11MAC

RT-a
BRKMPL-2333

ES1-ESI-Eth.TAG

26PE3 RIB

RD = RD-2aPE2

ESI = ES2PE34

AC2Cisco Public

Path List

VPN

MAC

ESI

Eth.TAG

Label (e.g. Y)

RT-a-

ES1

A

PE1

RT ext. community

RT-a-

ES1

A

PE2

RT-a

RT-a-

ES1

A

PE1,PE2

NH

Eth.Tag ID = VPWS-ID ANH© 2014 Cisco and/or its affiliates. All rights reserved.

ES2ES2 – Since CE2 is single
homed to PE2, ES2 = 0PE 3 Eth A-D RoutePath List

PE1 & PE2 RIB
VPNPE3MPLS

VPWS Service Config:
EVI = 100
Local AC ID = AC1
VPWS ID = A

5ES1

VPWS Service Config:
EVI = 100
Local AC ID = AC2
VPWS ID = A
CE215

EVPN-VPWS: Service Edge GW
A-PE

CE

IP/MPLS
Access

1S-PE
IP/MPLS
Core

2543

EVPN VPWS
1.
2.
3.
4.
5.

EVPN or IP-VPN

Discovery among S-PEs per EVPN/IP-VPN service needing VPWS
Origination of single-side signaling by an A-PE for a given VPWS service (identified by the 24-bit
Ethernet tag)
DF election by S-PEs for Active/Backup
Active & Backup S-PEs responding to the single-sided signaling of step (2)Binding of two halves of the EVC (or IPVC) by the A-PE upon receiving the response in step (3) &setting up backup EVC

BRKMPL-2333© 2014 Cisco and/or its affiliates. All rights reserved.

Cisco PublicEVPN-ETREE
PE-1
(R)
(L)
(L)

PE-3
(L)
(L)
(L)

EVI
MPLS/IP Core

(R)
(R)
(L)

(L)
(L)
PE-2

PE-4

EVPN-ETREE provides ingress filtering for traffic destined toegress leaf sites !!
BRKMPL-2333© 2014 Cisco and/or its affiliates. All rights reserved.

Cisco Public

PEr
IP-VRF foo

RR• Req: Single-BGP session from CPE with fast switchover and min. traffic
disruption during failure• Solution has three components:
1. PIC functionality for fast switchover at PEr devices
2. Synch up of ARP cache and VRF tables on all PEs in the
redundancy group
3. BGP GR with non-stop forwarding between CPE and PEs in the
redundancy group

PEr
IP-VRF foo

MPLS/IP Core
PE1PE2PE3PE4

IP-VRF foo

IP-VRF foo

IP-VRF fooIP-VRF foo

A-PE

BRKMPL-2333

Interface Ether25
mode Single-Active
Interface Ether25.1
vrf forwarding vrf-foo
ipv4 address 10.0.0.11
255.255.255.0
mac-address aaa.bbb.ccc© 2014 CiscoCPE
and/or its affiliates. All rights reserved.

Cisco Public

DC Fabric

IRB

DCI

(IntraDCOverlay)(L2/L3
Overlay)(InterDC)

EVPNIRB

EVPNDCIDC Applications
EVPN

EVPNOverlay

Data Center East :BGP AS #100
BGP
RR

Two DCs are directly connected at theAgg. eVPN Routes exchanged via eBGP

Data Center West:
BGP AS #200

BGP
RR

N7K
eBGP…

Aggregation…

VXLAN Packet:

VTEPVTEPAccess

N9K

H2H1••••IP-H1
VNI 100

Layer-2 multi-tenacy
Geo-redundancy & seamless VM mobility support
ARP suppression & ARP proxy
Support large scale VMs & policy control
BRKMPL-2333© 2014 Cisco and/or its affiliates. All rights reserved.

Cisco Public

IP-H2VNI 100•••

Support for different encaps such as VxLAN, NVGRE,
MPLS, MPLSoUDP
Extensive multi-homing support
Extensive load-balancing capabilities

EVPN-IRB•••••

WAN-EdgePE

Multi-tenancy for L2 & L3LB (on a per flow) for a given VLAN/
tenantInherent support for anycast GW
ARP suppression
L3 only mode when needed

DC CoreDistributed Anycast Gateway

ToRToR
TOR	  NX	  2K	  NX	  2K	  #1BRKMPL-2333

NX	  2K	  #2© 2014 Cisco and/or its affiliates. All rights reserved.

Cisco Public

NX	  2K	  NX	  2K	  # 40

EVPN-DCI
WAN

DC1
Aggrega.on	  Layer	  Leaf/
AccessLeaf/
AccessLeaf/
AccessASR9K/N7K	  MPLSL3VPN
MPLSEVPN

Leaf/
Access•Seamless interop with IP-VPN (RFC4364)•Support for any kind of access technology such as EVPN
Overlay (VxLAN), Native Ethernet, TRILL, 802.1Qbp, MPLSBRKMPL-2333© 2014 Cisco and/or its affiliates. All rights reserved.

Cisco Public

22Client

DCI/WAN	  DC2

IGMP/MLD Proxy
POD-A

Spine

POD-B

Spine

G1

Spine

G2

Spine

G3
Leaf A1

Leaf A2

Leaf A3

BorderLeaf

Border
Leaf

Leaf B3

Leaf B2

Leaf B1

G3
IGMP Report

G1, G2, G3

G3Multicast Router

BGP EVPN selective multicast Route:
G1, G2, G3

BRKMPL-2333© 2014 Cisco and/or its affiliates. All rights reserved.

Cisco PublicG1

G1

G2

G3

IGMP Reports