ATCA, HPI, AIS – open
specifications for HA
applications
Artem Kazakov
SOKENDAI/KEK
kazakov@gmail.com
TIPP09

2Outline New CS and ATCA as platform of choice Service Availability Forum (SAF) Hardware Platform Interface (HPI) Application Interface Specification (AIS)March 15 2009

Technology and Instrumentation in Particle Physics, Tsukuba

3ILC Control System requirements
 Overall Control system availability goals of 99% -99.9%
 For a system of a ~1200 “shelves” it translates to 99.999%
availability for each “shelf”
 Serviceability and manageability 30 km long underground tunnel Standardization
 For simplified development and Quality Assurance
 Modularity – Both Hardware and Software And many other including redundancy, high speed serial
links…
March 15 2009

Technology and Instrumentation in Particle Physics, Tsukuba

ATCA as a platform for ILC controlsystem
 Advanced Telecom Computing Architecture (ATCA)
embodies most of the required features
 Designed to provide 99.999% availability
 Modularity
 separate back-pane and front HOT SWAP Redundancy – Power supply, cooling, serial back-pane Extensive manageability And more
March 15 2009

Technology and Instrumentation in Particle Physics, Tsukuba

45Service Availability Forum Objectives:
 Develop and publish high service availability andmanagement software interface specifications
 Promote and facilitate their adoption by the industry

 Members – Leading telecom industry companies
 Primary specifications: HPI - Hardware Platform Interface – for hardware resource
monitoring and management, similar to IPMI
 AIS - Application Interface Specification – for software
monitoring and management
March 15 2009

Technology and Instrumentation in Particle Physics, Tsukuba

6SAF Specifications
 Represent current “best-practices” of Telecom Industry
in building HA applications
 And this may be applicable for accelerator control systems
as well C and Java API
 Provide a framework and guidelines for development ofHA applications

March 15 2009

Technology and Instrumentation in Particle Physics, Tsukuba

7

Basic architecture

March 15 2009

Technology and Instrumentation in Particle Physics, Tsukuba

8Basic Architecture
HardwareBoard1

General Purpose/RTOS|||HPI

Board2AISServices

March 15 2009AIS
AIS services

Applications

Technology and Instrumentation in Particle Physics, Tsukuba

HPI – Hardware Platform
Interface Inventory & configuration – what components are in thesystem HW, serial numbers, location
 Control – Hot Swap, Power up/down, reset, firmware
upgrade, watchdogs…
 Monitoring – temperature, voltage, fan speed, LED…
 Portable – Abstract, support various factors/architectures

March 15 2009

Technology and Instrumentation in Particle Physics, Tsukuba

910

HPI – Reasons to use Hides platform specific or proprietary features fromapplication
 Eliminates proprietary application interface – allows fast
porting to other platforms
 Remote control via HPI-SNMP

March 15 2009

Technology and Instrumentation in Particle Physics, Tsukuba

HPI usage example – Redundant
EPICS IOC ATCA shelf with two CPUblades

ATCA shelf Running two Redundant
EPICS IOCCPU board

CPU Board HPI is used to monitor thehealth of each blade

IOC1IOC2

 This information is used tomake decision on failover

HPIHPI

Shelf
Manager

Shelf
ManagerMarch 15 2009

Technology and Instrumentation in Particle Physics, Tsukuba

11

HPI usage example – Redundant
EPICS IOC
 HPI is Platform
independent Instead of ATCA we can use“conventional” server PC
 OpenHPI has /dev/sysfs
mappings on LinuxMarch 15 2009

Server 1

Server2

IOC1

IOC2

HPIHPI/dev/sysfs/dev/sysfs

Technology and Instrumentation in Particle Physics, Tsukuba

12

AIS – Application Interface
Specification

13AMF

 AIS is a set of open standard interface
specifications

CLM

 AIS defines an API for middleware between theapplications and the operating system

LOG
EVT

 It is divided into the areas:








Availability Management Framework
Cluster Membership ServiceLog Service
Event Service
Lock Service
Checkpoint Service
Message Service
Information management Model

March 15 2009LCK
CPTMSG
IMM

Technology and Instrumentation in Particle Physics, Tsukuba

14Further topics
 AIS benefits and reasons to use
 AIS implementations ?
 OpenSAF, OpenAIS, OpenClovis

 Examples of AIS usage
 “cold” standby redundant IOC – Claude Sanders APS
 EPICS caGW – proposal – Claude Sanders APS
 My experience ?

March 15 2009

Technology and Instrumentation in Particle Physics, Tsukuba

15Conclusion
 ATCA is being actively adopted by accelerator people,
new boards being developed, Physics ATCA initiative As for the software HPI & AIS offer extensive base for
hardware and software management. And a frameworkand guidelines for development of HA applications
 HPI & AIS Possible areas of usage in accelerator controls
 IOCs Nameservers
 Gateways
 Embedded CPUs (FPGA)March 15 2009

Technology and Instrumentation in Particle Physics, Tsukuba

16Open questions

March 15 2009

Technology and Instrumentation in Particle Physics, Tsukuba