Control System
Mar. 5, 2013
Tatsuro NAKAMURA

Outline• Overview• Central Server Computers• Network• IOC (Input/Output Controller)• Field Buses• Bucket Selection System• Beam Abort System• Other Issues
2Overview of KEKB Control System(Software)• EPICS based --- Distributed System– EPICS (Experimental Physics and Industrial Control System) is atoolkit to construct control systems– 2 layer model• OPI (Operation Interface) --- operation programs on central servers• IOC (I/O Controller) --- equipment controls on frontend computers– CA (Channel Access)• Communication protocol over network• Key technology of EPICS• Operation Programs in Scripting Languages• Quick and Flexible Development• With EPICS-CA, GUI (tk)

– SAD Script (developed at KEK)
– Python3

Overview of KEKB Control System(Hardware)
Central Servers

ConsolesHigh Speed Network（10G/1G Ethernet）

Frontend Computers
IOC (I/O Controller)

Field Buses
4

Central Server Computers•

Control Servers --- Managed by Control Group– Dedicated for KEKB Control / Operation– Currently consists of• Rack Mount Servers– 2 HP-UX– 1 Linux• Blade Servers– 14 Linux•SAD Computers (SAD Cluster) --- Managed by SAD Group– Originally for SAD Simulations– Later intensively used for KEKB Operation– Not only for KEKB but also for other Projects (Many user accounts !)– Currently consists of• 1 Alpha/Tru64• 5 Macintosh• 5 Free BSD
5

NetworkStar Conﬁgura1on between
Central Control Building
and26 Local Control Rooms• Upgrade in Progress– 10G/1G bps Ethernet– Additional Optical Fibers
Central Control– Central core switch• Catalyst 6509E

Building– Redundant Configuration– VLAN6

Op#cal ﬁber cabling for SuperKEKB is on going.

7

Network --- Current Configuration
KEK Laboratory
Network

KEK Firewall

WAN

Many computers have connections
both to the Lab. Network andControl Network.

FirewallControl Servers
SAD Computers
ConsolesFile Server (NAS)All Users (not only KEKB user)
can access Control System.

KEKB Control Network
EPICS IOC

8Network --- New Configuration Plan
SAD Computers(Oﬄine Purpose)

Userʼs PC PCPCPC

All Users can login.

KEK Laboratory Network

NAS(/users, /data, DB,etc)

Firewall

NAS can be accessed directly
through both Networks.

KEKB Control Network

EPICS IOCIOCIOCIOC

Control Servers
SAD Computers(Opera1on Purpose)

ConsolesOnly KEKB Users can login.

All of SAD Computers and Control Servers share same home directory.

9

Network --- Wireless LAN• Partially installed in KEKB
• Widely Deployed in SuperKEKB– Required to be available in the construction phase(before T=0)
– In the Accelerator Tunnel• LCX cable (Leaky Coaxial cable) for Arc Sections• Collinear antenna for Straight Sections– In the Local Control Rooms and Power Stations• Collinear antenna– Both Linac and KEKB Wireless Networks aremanaged in a unified manner.
10Wireless LAN using LCX cable

Prototype Test of LCX cablecable supports

LCX cable (200m)

11

Wireless LAN• Installation in progress right now !
The 16 LCX cable drums havedelivered to KEK the last month.

12

They were unpacked the last week,and …

13

Just installed tothe KEKB beam‐line yesterday.

14

Now under construc#on.

15

IOC (Input/Output Controller)• VME/VxWorks IOC– Widely used in KEKB
– Continue to use also in
SuperKEKB– CPU upgradeＣＰＵ• Force PPC750 → MVME5500• PLC/Linux IOC– Yokogawa FAM3 series PLC– Embedded EPICS
CPU Module
F3RP61I/O Modules 16

F3RP61 (e-RT3 2.0)
Linux 2.6.24
PPC 533MHz
128Mbyte RAM
100BaseTx x 2USBIEEE1394
SerialKEKB Beam mask controller
PCI
I/O Bus for FAM3 Module Interface
can access to mature FAM3 I/O Modules
Can be combined with conventional ladder CPU
Software development environment (ELDK)

17

F3RP61 in SuperKEKB
construction in progress …
• Vacuum Control• LLRF (used with MicroTCA system)• Interface to the Personnel Protection System• Embedded in Large Magnet Power Supply– Digital feed back control for high current stability• Beam Mask Control• Pulsed Q-Magnet Control
and more …
• RF Power Supply Control• Tilting Support (SX Magnet) Control
18

Field Buses• CAMAC --- Too old (>25 years old)
– Replacement in progress PLC (Embedded EPICS) or other Embedded EPICS Systems• Serial (Asynchronous)• GP-IB– Widely used

• Ethernet– Widely used

• VXI/MXI– For BPM

• ARCNET– For Magnet Power Supply
19

ARCNET and Magnet Power Supply
synchronous start signal

ARCNET Interface board（4 ch. / boards）
PSICMCPUmagnetpower
supplyIOC(VME)

max. 20 nodes
twisted pair cable
local control
room

power supplyroom

ARCNET（1 pair）
synchronous start signal（1 pair）

20

Version up of the interface for
Magnet Power Supply• PSICM (Power Supply Interface ControllerModule)– Interface/Controller card plugged in power supply• Microprocessor is embedded• ARCNET controller and driver• Timing signal input to start synchronous ramping– New version of PSICM• Support high speed communication (10/5/2.5Mbps)• Support high resolution Power Supply (24/20/18/16bits DAC)
• Fully compatible to the current version for the Magnet PS• Redundant timing signals• More reliable connectors
21

New Version of PSICM
Old VersionConnector Protection against
dust is available. (option)

New Version (Prototype)22

Bucket Selection System• Complicated Task for positron injection– Damping Ring

• Start Designing– Expansion of delay time, 500µs ⇒ 2ms– Phase shift for RF at 2nd half of LinacDiscussion with related groups is important.
Linac Control Group / RF Group / Operation Group• Test and Evaluation of modules– Reflective Memory Module: VMIVME-5655– Event System Module: EVG, EVR
23

Beam Abort System

T. Naito, A. Akiyama

For the machine protection, the beam abort systemhave to fire the abort kicker as soon as possible.
The input signals over 130 points are directlyconverted to the abort kicker trigger signal throughthe star connected optical fibers without any delay
except for the cable delay. The response time ofsystem is less than 20us from the input to the beamabort.
24

System conﬁgura3on of the beam abort

200m(1us)max.

2km(10us)max.

Opticalfiber
The most of the response 1me is limited by the cable signaltransfer 1me.

25

Improvement from the KEKB abort system
1. Response time from the input to the beam abort
100us -> 20us. Previous system used low pass filters for the noise
reduction, which increased the response time.

2. Optical fiber connection
Three kinds of signals(TTL, RS422, Relay contact) convert to opticalsignals to avoid the electrical noise. Control group maintains thesignal transfer quality.

3. Time stamp
In the most of the case, the beam abort are not only one input signal
but also many dependent signals. To find out the source of thebeam abort, the time stamp function is added to the VME-AM, which
can store the time of the abort signal with 0.1us resolution.

4. System check
To increase the reliability of this system, the system check function is26
installed to the VME-AM.

VME‐AbortModule(VME‐AM)

27

Other Issues• Operation Consoles– Start designing• Choice of the console terminals• Layout of the Central Control Room

• EPICS Standard Tools– CSS (Control System Studio)• Evaluation, Customize, Deployment• Operation Log– “Zlog” : Zope based web application• EPICS Training– Training Course– Training Materials
28

Man Power••

There are still many things to do.
Toward T=0, more and more software developments increase.
– More Outsourcing (?)•KEKB Control Members• T. T. Nakamura– Magnet Control, Database, Python, Archiver, …

• M. Iwasaki– Network, Server Computers, Interface to Belle II, …

• H. Kaji– Timing, Bucket Selection, Wire Scanner Control, …

• A. Akiyama– VME, PSICM/ARCNET, Embedded Controller, …

• J-I. Odagiri– PLC/F3RP61, Vacuum Control, RF Control, …

• T. Naito (Not full time)– Beam Abort System• We need new young people !
29

Thank you !

31backup32

ネットワーク速度測定結果
3) 既設AP(A社)とB社製APとの比較 （制御netに接続せず、localで測定）
LCX実効伝送速度(平均速度 Mbps)
25

B社
20

A社 up

15

A社 down
B社 up
10

B社 down

A社

5A社 (フジクラ測定）

A社（フジクラによる測定）

00m

50m

100m

125m

150m

200m

Localの測定だと、A社製APとB社製 APの差は少ない
33

ネットワーク速度測定結果
4) 既設AP(A社)とB社製APとの比較 （制御netに接続したとき）
LCX実効伝送速度(平均速度 Mbps)
25

20

B社
A社 up
A社 down

15

B社 up
B社 down

10

A社 (KEK測定 加速器運転なし)

A社
加速器運転なし（KEKによる測定）

5

00m

50m

A社
AR運転中
（フジクラによる測定）

100m

125m

150m

200m

制御ネットに接続するとAPの性能がネットワーク速度に影響する
34