Device Conformance Testing
Hamza Choudhry
ODVA
October 10, 2018

CIP Network Conformance Testing
Today’s Topics:•Conformance Testing process•Changes and additions to Conformance Testing•

How to be ready for a Conformance Test•

QuestionsTechnical Track© 2018 ODVA, Inc.

2018 Industry Conference & 19th Annual Meeting
All rights reserved.

www.odva.org

2

Conformance Testing Process3Conformance Testing Process
Conformance Testing Purpose•Because You Have To (TOU)•Better Products at Release•Benefits Your Customers and Ultimately You

Technical Track© 2018 ODVA, Inc.

2018 Industry Conference & 19th Annual Meeting
All rights reserved.

www.odva.org

4Technical Track© 2018 ODVA, Inc.

2018 Industry Conference & 19th Annual Meeting
All rights reserved.

www.odva.org

5Changes and additions toConformance Testing6New Tests in DeviceNet™ CT29/CT30•

New Common Service Test:•••••••••

Get_Member Service Test for Basic and Extended Format
Get_Attribute_List / Set_Attribute_List Test
Set_Attributes_All for some CIP objects

Port Object Test update (Associated Communication Objects attribute)
Time Sync Object test update
File Object Test update
Circuit Breaker Profile and Circuit Breaker objects testIdentity Object Test (new attributes)
Support Parameter Group Object revision 2

Technical Track© 2018 ODVA, Inc.

2018 Industry Conference & 19th Annual Meeting
All rights reserved.

www.odva.org

7

New Tests in DeviceNet™ CT29/CT30• DUP Mac Test on Network Power cycle

Expectation: A device needs to execute
Duplicate MAC ID detection process after
a reset of the device or after a power
cycle of the network power.

Technical Track© 2018 ODVA, Inc.

2018 Industry Conference & 19th Annual Meeting
All rights reserved.

www.odva.org

8

New Tests in EtherNet/IP™ CT15
Automated Test Enhancements••

New Common Service Test
Connection Manager Object test
enhancements– Updated Class 3 Duplicate 16-bit
Sequence Count Test
– Production Inhibit Time Network
Segment in Milliseconds /Microseconds– I/O RPI configurable via stc interface– Speed up I/O tests when DUT
supports multiple Priority levels

Technical Track© 2018 ODVA, Inc.

2018 Industry Conference & 19th Annual Meeting
All rights reserved.

www.odva.org

9New Tests in EtherNet/IP™ CT15
Automated Test Enhancements•••••

CIP Modbus Device and CIP
Modbus Translator Device Profiles
Test
CIP Motion Test for Motion
Controllers and Motion Devices
SNMP Object Test
File Object Test update
Port Object Test update for
Associated Communication
Objects attributeTechnical Track© 2018 ODVA, Inc.

2018 Industry Conference & 19th Annual Meeting
All rights reserved.

www.odva.org

10New Tests in EtherNet/IP™ CT15
• Broadcast ListIdenty MaxResponseDelay Test
“The receiver’s delay shall be a random value, in milliseconds, between 0 and theMaxResponseDelay specified in the ListIdentity request” [Vol2, Chapter 2, Section 2-4.2.3]

Technical Track© 2018 ODVA, Inc.

2018 Industry Conference & 19th Annual Meeting
All rights reserved.

www.odva.org

11

New Tests in EtherNet/IP™ CT16
Enhancements in CT16
• CT can be run from GUI or Command Line• Circuit Breaker Profile and Circuit Breakerobjects test
• Identity Object Test (new attributes)• Support Parameter Group Object revision 2• MDAO and Motion I/O test for new SEs

Technical Track© 2018 ODVA, Inc.

2018 Industry Conference & 19th Annual Meeting
All rights reserved.

www.odva.org

12

Manual Test additions - EtherNet/IP™ CT15/CT16
PRP Behavior Test
“Parallel Redundancy Protocol (PRP) is a
network protocol standard for Ethernet thatprovides seamless failover against failure of any
network component. This redundancy isinvisible to the application.
“The PRP/HSR Protocol Object provides theCIP application-level interface to these protocols(PRP/HSR).”

Technical Track© 2018 ODVA, Inc.

2018 Industry Conference & 19th Annual Meeting
All rights reserved.

www.odva.org

13

Manual Test additions - EtherNet/IP™ CT15/CT16
Off-Link Routing Test
“If the destination is on a connected network, the datagram is sent directly to the destination host;otherwise, it has to be routed to a gateway on a connected network” [RFC 1122, Section 3.3.1]

Technical Track© 2018 ODVA, Inc.

2018 Industry Conference & 19th Annual Meeting
All rights reserved.

www.odva.org

14

Manual Test additions EtherNet/IP™ CT15/CT16
Multicast I/O Forward Open Request

Default TTL Value of DUT = 1
Default Gateway Assigned to DUT
Technical Track© 2018 ODVA, Inc.

2018 Industry Conference & 19th Annual Meeting
All rights reserved.

Unicast I/O Forward Open Request

www.odva.org

15

New Tests in EtherNet/IP™ CT16
CIP Security Test: (in a separate app for CT16)•••••

Technical Track© 2018 ODVA, Inc.

I/O Test via DTLS session
CIP security objects test via TLS session
Configure and use PSK test
Use default and non-default certificates test
NULL ciphers and non-NULL ciphers test

2018 Industry Conference & 19th Annual Meeting
All rights reserved.

www.odva.org

16

Conformance Test ToolKit – Content Highlights
ODVA Test Framework••

To be released as part of CT-16 (but a separate installation package)
Tools to aid in conformance testing:••••Connections ToolDHCP Server
CIP Motion I/O Validator

Scripts to provide some automation for manual test processes••

ACDTTL/MCast17

Conformance Test ToolKit – DHCP Server Tool•

Roundtable© 2018 ODVA, Inc.

2018 Industry Conference & 19th Annual Meeting
All rights reserved.

www.odva.org

Fully functional DHCP Server.

18

Conformance Test ToolKit – Connections ToolRoundtable© 2018 ODVA, Inc.

2018 Industry Conference & 19th Annual Meeting
All rights reserved.

•Encapsulation commands•

Explicit messaging• Connected• UCMM•

I/O Connections• Multiple connections

www.odva.org

19

Conformance Test ToolKit – Motion I/O Validator•

Roundtable© 2018 ODVA, Inc.

2018 Industry Conference & 19th Annual Meeting
All rights reserved.

Utility to validate CIP
Motion I/O messages

www.odva.org

20

Conformance Test ToolKit – Script Sequencer

Scripting Engine front end provides:••••

Roundtable© 2018 ODVA, Inc.

2018 Industry Conference & 19th Annual Meeting
All rights reserved.

Selection of installed scripts to be run
Selection of DUT information (.STC)
Visual feedback during test execution
Automatic archiving of result data

www.odva.org

21

Conformance Test ToolKit – Results Viewer•••

Roundtable© 2018 ODVA, Inc.

2018 Industry Conference & 19th Annual Meeting
All rights reserved.

www.odva.org

Report shows result of eachscript step, as well as final
result of test.
Test data is stored as XMLformat.
Report is generated asHTML for viewing

22

Getting ready for aConformance Test

23

Getting ready for a Conformance Test•••••

Start early – submit your conformance test
well in advance
Read the ODVA Test Guidelines in theConformance Test Details Form
Review and run the manual tests
First timers – encouraged to attend the test
Ask Questions! – conformance@odva.org

Technical Track© 2018 ODVA, Inc.

2018 Industry Conference & 19th Annual Meeting
All rights reserved.

www.odva.org

24Technical Track© 2018 ODVA, Inc.

2018 Industry Conference & 19th Annual Meeting
All rights reserved.

www.odva.org

25

THANK YOU