CIP Network Conformance Testing
ODVA Conformance Authority
February 22, 2017

Presenters– Lance Smith, ODVA

lsmith@odva.org– Hamza Choudhry, ODVA

hchoudhry@odva.org

Marketing & Training Track 2017 Industry Conference & 18th Annual Meeting© 2017 ODVA, Inc.
All rights reserved.

www.odva.org

2

CIP Network Conformance Testing
Today’s Topics:Ø Conformance Testing ProcessØ New Conformance Test ChangesØ Common Conformance Testing ErrorsØ Questions

Marketing & Training Track 2017 Industry Conference & 18th Annual Meeting© 2017 ODVA, Inc.
All rights reserved.

www.odva.org

3

Conformance Testing ProcessConformance Testing PurposeØ Because You Have To (TOU)Ø Better Products at ReleaseØ Benefits Your Customers and Ultimately You

Marketing & Training Track 2017 Industry Conference & 18th Annual Meeting© 2017 ODVA, Inc.
All rights reserved.

www.odva.org

4Marketing & Training Track 2017 Industry Conference & 18th Annual Meeting© 2017 ODVA, Inc.
All rights reserved.

www.odva.org

5

Conformance Testing Process
Updates to ODVA Test GuidelinesØ Read the ODVA Test Guidelines in the Conformance Test Details Form§ Updates to the DUT firmware testing will require repeating all tests§ Order extra hours in advance§ Send in the required documents on time

Marketing & Training Track 2017 Industry Conference & 18th Annual Meeting© 2017 ODVA, Inc.
All rights reserved.

www.odva.org

6

New Tests in EtherNet/IP™ CT14

Marketing & Training Track 2017 Industry Conference & 18th Annual Meeting© 2017 ODVA, Inc.
All rights reserved.

www.odva.org

7

New Tests in EtherNet/IP™ CT14
Ø MS/NS LED Behavior§ Vendor specific LED behavior must be documented.
§ MS/NS LEDs not required forIndustrial Performance Level§ But if implemented must conform to requirements§ or documented§ Special LED behavior before DHCP / BOOTP server
configuration.
§ MS = flashing green, NS = darkMarketing & Training Track 2017 Industry Conference & 18th Annual Meeting© 2017 ODVA, Inc.
All rights reserved.

www.odva.org

8

New Tests in EtherNet/IP™ CT14Ø TCP/IP Interface Object Test§ Multiple Instances Test!
§§

§

CT tool probes all instances of TCP/IP Object!
Need as many STC files as instances!
§ unless some or all instances configured same!

IANA Port Admin attribute test!
§At minimum, all EtherNet/IP-related ports supported by theDUT shall be exposed.!

Marketing & Training Track 2017 Industry Conference & 18th Annual Meeting© 2017 ODVA, Inc.
All rights reserved.

www.odva.org

9New Tests in EtherNet/IP™ CT14
Ø Point-to-Point I/O on non-default port§ Point-to-Point consumer can specify alternate port number§ Default UDP port is 2222. Sockaddr Info item specifies other UDP port.
§ Forward_Open Request - T->O Item – Originator as Consumer, determines the port
§ Forward_Open Reply - O->T Item – Target as Consumer, determines the port

Marketing & Training Track 2017 Industry Conference & 18th Annual Meeting© 2017 ODVA, Inc.
All rights reserved.

www.odva.org

10New Tests in EtherNet/IP™ CT14Ø T->O multicast matching rules test (return error code)
Test for the rule “For multicast, if an established T->O producer exists on
the same port*, the T->O parameters listed in the Table 3-6.4 below shallmatch. If not, the device shall return the indicated error.”*	  Same	  port	  means	  same	  UDP	  port	  2222	  and	  same	  	  T-­‐>O	  path	  Marketing & Training Track 2017 Industry Conference & 18th Annual Meeting© 2017 ODVA, Inc.
All rights reserved.

www.odva.org

11

New Tests in EtherNet/IP™ CT14Ø T->O multicast matching rules, test cases in CT tool software§§§§§§§§Transport Class mismatch!
T->O Production Trigger mismatch!
T->O Production Inhibit Time mismatch!
T->O Network Connection Parameters Size mismatch!
T->O Network Connection Parameters Fixed/Variable mismatch!
T->O Network Connection Parameters Priority mismatch!
T->O parameters totally match!
See also CIP PCTS PUB 166 for details of these tests!

Marketing & Training Track 2017 Industry Conference & 18th Annual Meeting© 2017 ODVA, Inc.
All rights reserved.

www.odva.org

12

New Tests in EtherNet/IP™ CT14
Ø Run CT§ for each supported Configuration Method:
Hardware, DHCP, Static IP Mode…
§ again for Large_Forward_Open ifsupported. Set Connection Size to > 511
For Class 3 Connection (Explicit Messages)

Marketing & Training Track 2017 Industry Conference & 18th Annual Meeting© 2017 ODVA, Inc.
All rights reserved.

www.odva.org

13

New Tests in EtherNet/IP™ CT14Ø Large_Forward_Open (LFO)§ Class 1 Connection§ Tested by Connection
Manager Size Max§ Either T->O or O->T
now generates LFO when
Max Size > 511

Marketing & Training Track 2017 Industry Conference & 18th Annual Meeting© 2017 ODVA, Inc.
All rights reserved.

www.odva.org

14

New Tests in EtherNet/IP™ CT141Ø ACD Behavior Test of WaitLinkIntegrity
1. DUT Initialization

OngoingDetection

3!

4!

!

2. DUT LinkDown (only port)!

3. Transition to ProbeIpv4Address (LinkUp)
2

4. Reference Node creates Conflict•DUT shall not defend

Marketing & Training Track 2017 Industry Conference & 18th Annual Meeting© 2017 ODVA, Inc.
All rights reserved.

www.odva.org

15

New Tests in EtherNet/IP™ CT14
Ø DLR§ AutoMDIX in Auto-Negotiation and Forced Mode.
§ Use appropriate PHY§ Neighbor_Status on Ring Fault (notifies Supervisor)
§
§
§
§

0x01 Port 1 Active (bit 0)0x02 Port 2 Active (bit 1)
0x80 Neighbor Status (bit 7)
Indicates Unresponsive Neighbor

Marketing & Training Track 2017 Industry Conference & 18th Annual Meeting© 2017 ODVA, Inc.
All rights reserved.

www.odva.org

16New Tests in EtherNet/IP™ CT14
Ø DLR§ Multiple Instances (DLR Switch)
§
§
§
§

Manual verification, each instance operates independently
CT tool probes each instance
Ring Port 1 and 2 Ethernet Link Object Instance Attributes§ Allow Ethernet Link Object Instances to be mapped to DLR instanceDLR Enable§ Allows the DLR instance to be disabled

Marketing & Training Track 2017 Industry Conference & 18th Annual Meeting© 2017 ODVA, Inc.
All rights reserved.

www.odva.org

17

Common Conformance Testing Errors

Marketing & Training Track 2017 Industry Conference & 18th Annual Meeting© 2017 ODVA, Inc.
All rights reserved.

www.odva.org

18

Common Conformance Testing Errors
Ø TCP/IP Interface Object Test
– Report correct status or value duringmode switch for following attributes:§ Attribute 1(Status) accurately reports
Configuration Status§ Attribute 2 (Configuration Capability)reflects correct DUT capabilities

Marketing & Training Track 2017 Industry Conference & 18th Annual Meeting© 2017 ODVA, Inc.
All rights reserved.

www.odva.org

19Common Conformance Testing Errors
Ø TCP/IP Interface Object Test – Cont’d§ Attribute 3 (Configuration Control) showscurrent mode of DUT§ Attribute 5 (Interface Configuration)
maintains proper values§ In DHCP mode, attributes 5 & 6 should
get the Domain Name and Host Namefrom the DHCP server if they are in the
DHCPOFFER*.
Marketing & Training Track 2017 Industry Conference & 18th Annual Meeting© 2017 ODVA, Inc.
All rights reserved.

www.odva.org

20Marketing & Training Track 2017 Industry Conference & 18th Annual Meeting© 2017 ODVA, Inc.
All rights reserved.

www.odva.org

21

Common Conformance Testing Errors
Ø Ethernet Link Object Test§ Attribute 2 (Interface Flags) shall reportcorrect status and configuration about thephysical interface.
§ Attribute 9 (Admin State) should not allow
you to disable the last port*.

Marketing & Training Track 2017 Industry Conference & 18th Annual Meeting© 2017 ODVA, Inc.
All rights reserved.

www.odva.org

22Common Conformance Testing Errors
Ø Ethernet Link Object Test§

Attribute 11 (Interface Capability) shall indicate the exact capabilities of that instance.
§Ensure this matches the capabilities reported in other Ethernet link object attributes (attribute 2)

Marketing & Training Track 2017 Industry Conference & 18th Annual Meeting© 2017 ODVA, Inc.
All rights reserved.

www.odva.org

23

Common Conformance Testing Errors
Ø DLR Object Test§

Sign_On Frame is received and transmitted upon power up. Test with all Configurations(BOOTP,DHCP, Static)§

Be sure to check for consistent
results on LinkDown (Ring Fault) atleast three times, for all DLR Frames.

Marketing & Training Track 2017 Industry Conference & 18th Annual Meeting© 2017 ODVA, Inc.
All rights reserved.

www.odva.org

24Common Conformance Testing Errors
Ø NV (Non-Volatile) Attributes Behavior§ NV attribute values shall be persistentafter a power cycle or a Type 0 Reset.
§ NV attribute values shall be restored tofactory default values after a Type 1Reset.

Marketing & Training Track 2017 Industry Conference & 18th Annual Meeting© 2017 ODVA, Inc.
All rights reserved.

www.odva.org

25

Common Conformance Testing Errors
Ø NV (Non-Volatile) Attributes Behavior§

Take effect immediately. e.g. PTPEnable in Time Sync Object!

§Take effect after power cycle or a Type 0 Reset.
e.g. QoS Object attributes. ACD Enable§

Take effect immediately or after a reset. Tend tohave a pending reset bit. e.g. Interface Configuration, TTL/Mcast attributes!

Marketing & Training Track 2017 Industry Conference & 18th Annual Meeting© 2017 ODVA, Inc.
All rights reserved.

www.odva.org

26

Common Conformance Testing ErrorsØ Honorable Mentions§ DUT unable to acquire Interface Configuration after
ACD conflict, upon link up.
§ DUT only able to pass CT with a single TCP/IPconfiguration.
§ DUT having Memory leak/buffer issues.

Marketing & Training Track 2017 Industry Conference & 18th Annual Meeting© 2017 ODVA, Inc.
All rights reserved.

www.odva.org

27

Marketing & Training Track 2017 Industry Conference & 18th Annual Meeting© 2017 ODVA, Inc.
All rights reserved.

www.odva.org

28

THANK YOU