High Availability in EtherNet/IP Systems using
Frame Replication and Elimination for Reliability (FRER)As defined in the TSN Standard IEEE 802.1CB-2017
George A. Ditzel III
Schneider Electric
October 10, 2018

Availability = MTTF / (MTTF+MTTR)
Mean-Time-To-Fail (MTTF)
Mean-Time-To-Repair (MTTR)High Availability

High
Availability

Technical Track© 2018 ODVA, Inc.

2018 Industry Conference & 19th Annual Meeting
All rights reserved.

www.odva.org

2

High
Availability
Impossible to create networks that never failKey to High Availability is reduced recovery time
Availability is increased by introducing Redundancy

Technical Track© 2018 ODVA, Inc.

2018 Industry Conference & 19th Annual Meeting
All rights reserved.

www.odva.org

3

Dynamic Network Redundancy

Dev = Device
SW = Ethernet
SwitchNormalOperation
Technical Track© 2018 ODVA, Inc.

Failure2018 Industry Conference & 19th Annual Meeting
All rights reserved.

Recoverywww.odva.org

4

Dynamic Network Redundancy

Technical Track© 2018 ODVA, Inc.

2018 Industry Conference & 19th Annual Meeting
All rights reserved.

www.odva.org

5

Static Network Redundancy
Input

Input

Dev

Dev

StbySW

Actv
SW

StbySW

Dev

Dev

OutputOutputNormalOperation
Technical Track© 2018 ODVA, Inc.

Actv
SW

2018 Industry Conference & 19th Annual Meeting
All rights reserved.

Failurewww.odva.org

Dev = Device
SW = Ethernet
Switch6

Static Network Redundancy
Input

Input

Dev

Dev

StbySW

Actv
SW

Stby
SW

Dev

Dev

OutputOutputNormalOperation
Technical Track© 2018 ODVA, Inc.

Actv
SW

2018 Industry Conference & 19th Annual Meeting
All rights reserved.

Failurewww.odva.org

Dev = Device
SW = Ethernet
Switch7

Example EtherNet/IP System
MonitorSngl-Port
Controller

Ethernet
SwitchMulti-Port
SensorMulti-Port
SensorTechnical Track© 2018 ODVA, Inc.

CameraRecorderMulti-Port
IO DeviceMulti-Port
IO Device

Multi-Port
IO Device

Multi-Port
IO Device

Multi-Port
IO Device

Ethernet
SwitchEthernet
SwitchEthernet
SwitchSngl-Port
Drive

Sngl-Port
Drive

Ethernet
SwitchEthernet
Switch2018 Industry Conference & 19th Annual Meeting
All rights reserved.

www.odva.org

IP
Camera8FRER Components: End Systems (ES)Monitor(ES)

Sngl-Port
Controller(ES)

Ethernet
SwitchMulti-Port
SensorMulti-Port
Sensor(ES)

Technical Track© 2018 ODVA, Inc.

CameraRecorder(ES)
Multi-Port
IO Device

Multi-Port
IO Device

Multi-Port
IO Device

Multi-Port
IO Device

Multi-Port
IO Device

Ethernet
SwitchEthernet
SwitchEthernet
SwitchSngl-Port
Drive(ES)Sngl-Port
Drive(ES)Ethernet
SwitchEthernet
Switch2018 Industry Conference & 19th Annual Meeting
All rights reserved.

www.odva.org

IP
Camera(ES)

9FRER Components: Relay Systems (RS)Monitor(ES)

Sngl-Port
Controller(ES)

Ethernet
Switch(RS)

Multi-Port
SensorMulti-Port
Sensor(ES)

Technical Track© 2018 ODVA, Inc.

CameraRecorder(ES)

Multi-Port
IO Device

Multi-Port
IO Device

Multi-Port
IO Device

Multi-Port
IO Device

Multi-Port
IO Device

Ethernet
Switch(RS)

Ethernet
Switch(RS)

Ethernet
Switch(RS)

Sngl-Port
Drive(ES)Sngl-Port
Drive(ES)Ethernet
Switch(RS)

Ethernet
Switch(RS)

2018 Industry Conference & 19th Annual Meeting
All rights reserved.

www.odva.org

IP
Camera(ES)

10Relay-End Systems (RES)
Monitor(ES)

Sngl-Port
Controller(ES)

Ethernet
Switch(RS)

Multi-Port
Sensor(RES)

Multi-Port
Sensor(ES)

Technical Track© 2018 ODVA, Inc.

CameraRecorder(ES)

Multi-Port
IO Device(RES)

Multi-Port
IO Device(RES)

Multi-Port
IO Device(RES)

Multi-Port
IO Device(RES)

Multi-Port
IO Device(RES)

Ethernet
Switch(RS)

Ethernet
Switch(RS)

Ethernet
Switch(RS)

Sngl-Port
Drive(ES)Sngl-Port
Drive(ES)Ethernet
Switch(RS)

Ethernet
Switch(RS)

2018 Industry Conference & 19th Annual Meeting
All rights reserved.

www.odva.org

IPCamera(ES)

11

FRER Components and Network Interconnect
Monitor(ES)

Sngl-Port
Controller(ES)

Ethernet
Switch(RS)

Multi-Port
Sensor(RES)

Multi-Port
Sensor(ES)

Technical Track© 2018 ODVA, Inc.

CameraRecorder(ES)

Multi-Port
IO Device(RES)

Multi-Port
IO Device(RES)

Multi-Port
IO Device(RES)

Multi-Port
IO Device(RES)

Multi-Port
IO Device(RES)

Ethernet
Switch(RS)

Ethernet
Switch(RS)

Ethernet
Switch(RS)

Sngl-Port
Drive(ES)Sngl-Port
Drive(ES)Ethernet
Switch(RS)

Ethernet
Switch(RS)2018 Industry Conference & 19th Annual Meeting
All rights reserved.

www.odva.org

IPCamera(ES)

12FRER and Ring Network – Single Talkers/Listeners
Monitor(ES)

Sngl-Port
Controller(ES)

Ethernet
Switch(RS)

Multi-Port
Sensor(RES)

Multi-Port
Sensor(ES)

Technical Track© 2018 ODVA, Inc.

CameraRecorder(ES)

Multi-Port
IO Device(RES)

Multi-Port
IO Device(RES)

Multi-Port
IO Device(RES)

Multi-Port
IO Device(RES)

Multi-Port
IO Device(RES)

Ethernet
Switch(RS)Ethernet
Switch(RS)Ethernet
Switch(RS)

Sngl-Port
Drive(ES)Sngl-Port
Drive(ES)Ethernet
Switch(RS)Ethernet
Switch(RS)2018 Industry Conference & 19th Annual Meeting
All rights reserved.

www.odva.org

IP
Camera(ES)

13

FRER and Mesh Network
Monitor(ES)

Sngl-Port
Controller(ES)

Ethernet
Switch(RS)

Multi-Port
Sensor(RES)

Multi-Port
Sensor(ES)

Technical Track© 2018 ODVA, Inc.

CameraRecorder(ES)

Multi-Port
IO Device(RES)

Multi-Port
IO Device(RES)

Multi-Port
IO Device(RES)

Multi-Port
IO Device(RES)

Multi-Port
IO Device(RES)

Ethernet
Switch(RS)Ethernet
Switch(RS)

Ethernet
Switch(RS)

Sngl-Port
Drive(ES)Sngl-Port
Drive(ES)Ethernet
Switch(RS)

Ethernet
Switch(RS)2018 Industry Conference & 19th Annual Meeting
All rights reserved.

www.odva.org

IPCamera(ES)

14

FRER and Mesh Network – Multiple Listeners
Monitor(ES)

Sngl-Port
Controller(ES)

Ethernet
Switch(RS)

Multi-Port
Sensor(RES)

Multi-Port
Sensor(ES)

Technical Track© 2018 ODVA, Inc.

CameraRecorder(ES)

Multi-Port
IO Device(RES)

Multi-Port
IO Device(RES)

Multi-Port
IO Device(RES)

Multi-Port
IO Device(RES)

Multi-Port
IO Device(RES)

Ethernet
Switch(RS)Ethernet
Switch(RS)

Ethernet
Switch(RS)

Sngl-Port
Drive(ES)Sngl-Port
Drive(ES)Ethernet
Switch(RS)Ethernet
Switch(RS)

2018 Industry Conference & 19th Annual Meeting
All rights reserved.

www.odva.org

IP
Camera(ES)

15

FRER and Mesh Network Single Talkers/Listeners
Monitor(ES)

Sngl-Port
Controller(ES)

Ethernet
Switch(RS)

Multi-Port
Sensor(RES)

Multi-Port
Sensor(ES)

Technical Track© 2018 ODVA, Inc.

CameraRecorder(ES)
Multi-Port
IO Device(RES)

Multi-Port
IO Device(RES)

Multi-Port
IO Device(RES)

Multi-Port
IO Device(RES)

Multi-Port
IO Device(RES)

Ethernet
Switch(RS)

Ethernet
Switch(RS)

Ethernet
Switch(RS)

Sngl-Port
Drive
(ES)

Sngl-Port
Drive
(ES)

Ethernet
Switch(RS)

Ethernet
Switch(RS)

2018 Industry Conference & 19th Annual Meeting
All rights reserved.

www.odva.org

IP
Camera(ES)

16

FRER and PRP/HSR Networks
Monitor(ES)

CameraRecorder(ES)
HSR
Redbox(RS)

Sngl-Port
Controller
(ES)

PRP
Redbox(RS)

Ethernet
Ethernet
SwitchSwitch(RS)(RS)

Multi-Port
Sensor(ES)

Technical Track© 2018 ODVA, Inc.

Ethernet
Ethernet
SwitchSwitch(RS)(RS)

Multi-Port
IO Device(RES)

Multi-Port
IO Device(RES)

HSR Network
HSR
Redbox(RS)

Multi-Port
Sensor(RES)

Multi-Port
IO Device(RES)

Multi-Port
IO Device(RES)

Multi-Port
IO Device(RES)

Ethernet
SwitchEthernet(RS)
Switch(RS)

PRP
Redbox(RS)

Sngl-Port
Drive
(ES)

Sngl-Port
Drive(ES)2018 Industry Conference & 19th Annual Meeting
All rights reserved.

www.odva.org

HSR
Redbox(RS)

IP
Camera(ES)

17FRER and PRP/HSR Networks
Monitor(ES)

CameraRecorder(ES)
HSR
Redbox(RS)

Sngl-Port
Controller
(ES)

PRP
Redbox(RS)

Ethernet
Ethernet
SwitchSwitch(RS)(RS)

Multi-Port
Sensor(ES)Technical Track© 2018 ODVA, Inc.

Ethernet
Ethernet
SwitchSwitch(RS)(RS)

Multi-Port
IO Device(RES)

Multi-Port
IO Device(RES)

HSR Network
HSR
Redbox(RS)

Multi-Port
Sensor(RES)

Multi-Port
IO Device(RES)

Multi-Port
IO Device(RES)

Multi-Port
IO Device(RES)

Ethernet
SwitchEthernet(RS)
Switch(RS)

PRP
Redbox(RS)

Sngl-Port
Drive(ES)Sngl-Port
Drive(ES)2018 Industry Conference & 19th Annual Meeting
All rights reserved.

www.odva.org

HSR
Redbox(RS)

IPCamera(ES)

18THANK YOU