OpenFlow and beyond on theCisco Catalyst 9000
Atri Indiresan
atri@cisco.com
Cisco Systems
FAUCETCon 2019
October 23, 2019

© 2019 Cisco and/or its affiliates. All rights reserved. Cisco PublicAgendaØ Catalyst 9K OpenFlow
Ø OpenFlow pipeline abstraction
Ø TFM and flexible pipelines
Ø Beyond OpenFlow: hybrid behavior
Ø LLDP and PoE
Ø MacSec and MKA© 2019 Cisco and/or its affiliates. All rights reserved. Cisco PublicCatalyst 9K OpenFlow© 2019 Cisco and/or its affiliates. All rights reserved. Cisco Public

Cisco Catalyst 9000 enables Faucet OpenFlow
Built for
Programmability

Programmability

OpenConfig, GNMI, GNOI

© 2019 Cisco and/or its affiliates. All rights reserved. Cisco PublicCatalyst 9K OpenFlow in the wild
• General availability since IOS-XE 16.9.1 (August 2018)•Major release 3 times a year

• 4000+ fixed and modular switches deployed in enterprise at 40+ locations

worldwide•

Faucet and proprietary controllers• Hybrid features like LLDP for PoE utilized in production• Active feature development in coordination with customers© 2019 Cisco and/or its affiliates. All rights reserved. Cisco Public

Cisco Switching Portfolio
Cisco Catalyst
9600 Series
Cisco Catalyst
9400 Series
Cisco Catalyst
9200 Series

Cisco Catalyst
2960-X/XR

Cisco Catalyst
9300 Series

Cisco Catalyst
3650/3850

Cisco Catalyst
4500E Series

Access switching© 2019 Cisco and/or its affiliates. All rights reserved.

Catalyst
9000
Switching
Platform

Cisco Catalyst
9500 Series

Cisco Catalyst
3850-XS/4500-X

Cisco Catalyst
6840-X/6880-X

Cisco Catalyst
6500-E/6807-XL

Core switching
Cisco Confidential

Catalyst 9K OpenFlow Summary• Powered by UADP

Programmable pipeline• Flexible match and actions•UADP 3.0

• Faucet and TFM compatible• Software enhancements for features andscale

Platform

Type

Number ofTables

Number ofPriority
LevelsNumber ofFlows

9300

Fixed access,copper

16128

9K

9400

Modularaccess, copper

16128

27K

9500

Fixed agg/core,optical

16128

27K

9500H

Fixed agg/core,optical, highperformance

16128

27K

~20B transistors
16-nm technology© 2019 Cisco and/or its affiliates. All rights reserved. Cisco Public

Cisco Catalyst 9300 Series
New generation of fixed accessMultigigabit + 2.5G

2.5G at theprice of 1G

Highest2.5G, 5G,Multigigabit
density inthe industry

40G at theprice of 10G

NEWCisco Catalyst 9000 leadership
UADP 2.0

12 ports Multigigabit+ 36 ports 2.5G

Cisco IOS® XE Software
SD-Accessx86 CPU and containers

1G data

Encrypted Traffic Analytics (ETA)*

24 ports 1G

AES-256/MACsec-256
Trustworthy systems

1G Cisco UPOE/PoE+

Onlystackable
switch with
8x 10Gand 2x 25G
uplinks

Cisco StackWise® Virtual
IEEE1588 and AVB

48 ports 1G

Multigigabit Cisco UPOE

NBAR2Perpetual/Fast PoE
Model-driven programmability

48 ports
Multigigabit

Patching/GIR
Streaming telemetry

Modularfans

Higher-efficiency AC andDC power supplies

Modular uplinks
NEWNEW

8x 10G

2x 40G

4x Multigigabit

C97-738949-02 © 2018 Cisco and/or its affiliates. All rights reserved.

4x 1G

2x 25GNEW

NEWNEW

315W AC

715W AC/DC*

1100W AC

Cisco Confidential* Roadmap

Cisco Catalyst 9400 Series
New generation of modular access

9 Tbpssystembandwidth

Cisco® Catalyst®
9000 leadership
UADP 2.0
Open Cisco IOS® XE

Redundancy
is nowtable stakes

SD-Accessx86 CPU and containers

Industry’s
highest PoE
scaleEncrypted Traffic Analytics*
256-bit MACsec*
Trustworthy systems
Cisco StackWise® Virtual*
IEEE1588 and AVB*

4-Slot*Supervisor• Sup-1: 80G per slot access
optimized• Sup-1XL*: 120G per slot core
optimized

7-SlotAccess line cards

Core line cards• 24x Multigigabit +24x Cisco UPOE®
• 48x Cisco UPOE
• 48x PoE+, 48x data

C97-738949-02 © 2018 Cisco and/or its affiliates. All rights reserved.

10-Slot

Cisco Confidential• 24x 10G SFP+
• 48x 1G SFP• 24x 1G SFP

Power supply• 3200W AC• 3200W DC*• 2100W AC

NBAR2Model-driven programmability
Patching and GIR
Streaming telemetry* Roadmap

Cisco Catalyst 9500 Series

New generation of purpose-built fixed core/aggregation
UADP 2.0

UADP 3.0• 40G at the price of 10G• Industry’s first 40G enterprise switch• 1TB SSD storage• Industry’s first 100G enterprise switch• Optimized 10G switch for midsize backbone• 8x buffering vs. the competition

Cisco Catalyst
9500-16X
Cisco Catalyst
9500-40X

Cisco Catalyst
9500-24Y4C
Cisco Catalyst
9500-48Y4C
Cisco Catalyst
9500-32QC
Cisco Catalyst
9500-32C

Cisco Catalyst
9500-24Q
Cisco Catalyst
9500-12Q

Extending Cisco®
Catalyst® 4000 and6000 Series
leadership in
fixed core
13x throughput (3.2 Tbps)
6x performance (1 Bpps)
No oversubscription
8x 40G density
Pluggable SSD storage
USB 3.0
4x memory and flash
2x CPU cores
Customizable templates

Modular fans

Modular uplinks

C97-738949-02 © 2018 Cisco and/or its affiliates. All rights reserved.

Cisco Confidential

Modularpower supplies

Storage forapplication hosting

Cisco StackWise® Virtual

OpenFlow Table Feature Message
and flexible pipelines© 2019 Cisco and/or its affiliates. All rights reserved. Cisco PublicMatch Table

Match Table…

Stage NQueues
Rewrite/resolution

Stage 2Action

Stage 1

MatchAction
StageAction

MatchAction
Stage

ActionMatchAction
Stage
Match Table

In

Programmable Parser

Match-Action Table Pipeline

OutData© 2019 Cisco and/or its affiliates. All rights reserved. Cisco PublicWhat’s in your pipeline?
• Fixed vs Flexible• Number of pipeline stages• Operations associated with pipeline stages

With a sufficient number ofrecirculations, a fixed pipeline
could emulate a flexible pipeline© 2019 Cisco and/or its affiliates. All rights reserved. Cisco PublicBroadcom Trident 3 pipeline© 2019 Cisco and/or its affiliates. All rights reserved. Cisco PublicBroadcom abstract switch for OF-DPA© 2019 Cisco and/or its affiliates. All rights reserved. Cisco PublicExample of Faucet with OF-DPA
Chris Lorier: https://wand.net.nz/~cml16/poster.pdf© 2019 Cisco and/or its affiliates. All rights reserved. Cisco Public

OpenFlow Table Feature Message• Basic parameters

Number of tables• Table size•• Table parameters•

Match fields••Exact, wildcard, maskable

Actions
Apply actions• Forwarding – output, drop, punt
• GoTo table•© 2019 Cisco and/or its affiliates. All rights reserved. Cisco Public

Outline of TFM algorithms• Assign OpenFlow table to pipeline stage•

Get next pipeline stage that matches the table’s capabilities•

Size, type of memory, matches and actions

If last pipeline stage, next pipeline stage is after recirculation• Some apply actions may force a recirculation•• Flow programming (add, delete, update)Get pipeline stage associated with table• Program matches and actions•© 2019 Cisco and/or its affiliates. All rights reserved. Cisco PublicBeyond OpenFlow: Hybrid behavior
LLDP and PoE
MacSec and MKA© 2019 Cisco and/or its affiliates. All rights reserved. Cisco PublicNative vs Hybrid behavior
Native behavior is fully specified by the OpenFlow
pipeline and data plane
Hybrid behavior requires switch capabilities beyond
what is specified by OpenFlow
OpenFlow can redirect packets to the switch CPU
with “action=output:LOCAL”© 2019 Cisco and/or its affiliates. All rights reserved. Cisco Public

LLDP MED and Power over Ethernet
Media Endpoint Discovery extension of LLDP•

Auto-discovery of LAN policies•

Device location discovery•

Inventory management•

Extended and automated power management of Powerover Ethernet (PoE) end points••

How does the controller manage power levels of end-points?
Is it better for the switch to do this?

© 2019 Cisco and/or its affiliates. All rights reserved. Cisco Public

MacSec Key Agreement (MKA) – 802.1AE•

Key negotiationRekeying•

EAPOL BPDUs•© 2019 Cisco and/or its affiliates. All rights reserved. Cisco PublicWhat’s next?

© 2019 Cisco and/or its affiliates. All rights reserved. Cisco Public

Future directions – devices and controllers
New features and capabilities must be driven by deployment
needs and Faucet requirements• Network architecture and solutions• Multipath - L2 and L3• Segmentation• Identity• Policy© 2019 Cisco and/or its affiliates. All rights reserved. Cisco PublicCatalyst 9K OpenFlow teamAtri Indiresan
Christophe Rene
Imran Mohamed
Manas Pati
Mel TsaiMohanraj K
Nilesh Ashok Inamdar
Nirupa Gnanasekaran
Orkhan Hasanli
Stephen Wang
Suneetha Maddineni© 2019 Cisco and/or its affiliates. All rights reserved. Cisco Public

Q&A© 2019 Cisco and/or its affiliates. All rights reserved. Cisco Public© 2019 Cisco and/or its affiliates. All rights reserved. Cisco Public