Accelerator Controls< kazuro.furukawa @ kek.jp >Controls
Accelerator Control Systems,
Design and Operation

Kazuro Furukawa
High Energy Accelerator Research Organization (KEK)
KEKB and Linac Control Groups< kazuro.furukawa @ kek.jp ><http://www-linac.kek.jp/linac/><http://www-linac.kek.jp/cont/>

School for Accelerator Technology and Application, IIT-Bombay

Kazuro Furukawa, KEK, Feb.2012.

1

Accelerator Controls

ContentsuOverviewuAccelerator ControlsuAvailable TechnologiesuReliabilityuExamplevPast KEKBvSuperKEKBvOperationuConclusion
School for Accelerator Technology and Application, IIT-Bombay

Kazuro Furukawa, KEK, Feb.2012.

2

Accelerator Controls

Overview

School for Accelerator Technology and Application, IIT-Bombay

Kazuro Furukawa, KEK, Feb.2012.

3

Accelerator Controls

Large Experimental Physics and ControlsuExperimental Apparatus run by tens to thousands ofresearchersvHigh energy physics, Optical and radio observatory, Plasma
fusion, Gravitational wave interferometer, etc.
vTend to be designed, constructed, and run internationallyvCERN/LHC at Geneva, ITER at Cadarache, ALMA at Chile,
SuperKEKB at Tsukuba, ILC developments all over theworld, etc.

LHC/CERN

School for Accelerator Technology and Application, IIT-Bombay

ITER/JAEA

Kazuro Furukawa, KEK, Feb.2012.

4

Accelerator Controls

ConferencesuExchange collaboration ideas internationally³Collaboration is important because we don't want toreinvent the wheel³Asia, Europe and North America regionsvICALEPCS, International conference on acceleratorsand large experimental physics control systemsvPCaPAC, International workshop on personal
computers and particle accelerator controlsvWAO, International workshop on accelerator
operationvIBIC, International beam instrumentation conferencevIPAC, International particle accelerator conference
School for Accelerator Technology and Application, IIT-Bombay

Kazuro Furukawa, KEK, Feb.2012.

5

Accelerator Controls

Performance achievement
If the system is small single controller or single person cancover it. However, … We need global optimization insteadof local optimization
Controls

12

12

10

10
Performance

Performance

Computers

8
6
4

8
6
4
2

2

0
0

0
0

1

2 3 4 5 6
Number of CPUs

7

School for Accelerator Technology and Application, IIT-Bombay

1 2 3 4 5 6 7
Number of controllers oreven staffs
Kazuro Furukawa, KEK, Feb.2012.

6

Accelerator Controls

ChallengesuNumber of componentsuNumber of kinds of componentsuCollection of user requirementsvwith some knowledge of acceleratorvcollaboration with equipment and physics groupsuEfficient use of industrial solutionsvExtreme is commercial acceleratoruMany interactions with all groupsvWe can enjoy controls
School for Accelerator Technology and Application, IIT-Bombay

Kazuro Furukawa, KEK, Feb.2012.

7

Accelerator Controls

Challenges (2)uOnline simulation capabilitiesvRapid prototyping and rapid turnaround are important nowvAcceptance of changing requirementuDaily maintenancevRoutine automated proceduresuPerformance analysisvAnalysis of data history archives³Correlations, trends, sudden changes, etc.

vMonitoring from officesuProtection systems, personnel, machine, etc.
uAbove procedures have to be carried at both equipment
and operation layers
School for Accelerator Technology and Application, IIT-Bombay

Kazuro Furukawa, KEK, Feb.2012.

8

Accelerator Controls

Accelerators at KEK
Mt. Tsukuba"
J-PARC"(at Tokai Site)"(Super)KEKB"
PF-AR" ATF"

STF"
cERL"

PF"
Linac"

School for Accelerator Technology and Application, IIT-Bombay

Kazuro Furukawa, KEK, Feb.2012.

9

Accelerator Controls

KEKB and Linac Accelerator

KEKB and Linacu KEKB B-factory: Electron/Positron
Asymmetric Collider for CP-violationStudyv ~3km Dual-rings: Electron(8GeV - 1.4A) /Positron(3.5GeV - 1.8A)³ Stable and Robust Operation³ Many Active Operation Parameters³ Importance of Controlsu Linac:v ~600m, 50Hz
³ 8GeV 2nC Electron, 3.5GeV 1.2nC Positron³ Beam switchings, KEKB, PF, PF-AR ringsu Achieved world luminosity record
Increase of Luminosity with Crab Cavities
School for Accelerator Technology and Application, IIT-Bombay

Kazuro Furukawa, KEK, Feb.2012.

Accelerator Controls

Control Systems at KEK (1)uSharing resources as much as possibleuSuperKEKB (B-factory for flavor physics study)vWill inherit resources from KEKB (and TRISTAN)³Upgrade 2011-2014 is on-goinguLinac (electron/positron)vInject beams to 4 rings, (Super)KEKB, PF, PF-AR³Pulse-to-pulse (50Hz) beam modulation (2.5GeV ~ 8GeV, e–/e+)uPF (Photon Factory)vMoved to EPICS environment, serve large number of users³Mainly with Linux-VME

uPF-AR (Photon Factory Advanced Ring)vMostly the same environment as KEKB
³Many CAMAC installations
School for Accelerator Technology and Application, IIT-Bombay

Kazuro Furukawa, KEK, Feb.2012.

11

Accelerator Controls

Control Systems at KEK (2)uJ-PARC (Proton Accelerator Research Center)vInherit success at KEKB and linac³Many network-based EPICS devicesuATF (Accelerator Test Facility)³Vista Controls environment with CAMAC³Linux and socket environment with some EPICS devicesuSTF (Superconducting RF Test Facility)vTest facility for ILC³EPICS with Linux, ATCA test, PLC, …

ucERL (Compact ERL)vBeing built for ERL development³May share the resources with other accelerators
School for Accelerator Technology and Application, IIT-Bombay

Kazuro Furukawa, KEK, Feb.2012.

12

Accelerator Controls

KEKB Operation Improvement (base of SuperKEKB)
Injection at every other hour

Controls provide
basis of robust operation environment
and flexible evolution for daily advances

Belle/KEK

every hour

every 5-minuteMay.2000

every 20ms

Apr.2003
Dual Bunch e+
Feb.2005
Continuous
Injections
Dec.2008
Crab Cavities andSimultaneous Injection
School for Accelerator Technology and Application, IIT-Bombay

Important to follow
changing demands
flexibly
Kazuro Furukawa, KEK, Feb.2012.

13

KEKB

Accelerator Controls

Size of Middle/Large Accelerator (KEKB)u Composite of many devices
vThousands of magnetsvTens of microwave sourcesvThousands of vacuum componentsvThousands of beam instrumentationsvHundreds of researchers/engineers³Accelerator and detector share the tasks³Accelerator itself is a physics research field³Collaboration with other fields like large scale superconducting system andvacuum systemu ControlsvThousands of small form-factor embedded controllersvHundreds of middle-layer computersvTens of server computersvIP-based networku 10-100 times larger at the next generation machine like ILC
School for Accelerator Technology and Application, IIT-Bombay

Kazuro Furukawa, KEK, Feb.2012.

14

Accelerator Controls

KEKB and Controls

Simple example (KEKB)
Researchers
Firewall

Office Network

Internet(Collaboration)
FirewallOffline computers

ServerComputers

Detector
Network

Control Network
FirewallMiddle-layer
Computers
Device Network
安全系
安全系
Protection
Systems

No connection�

School for Accelerator Technology and Application, IIT-Bombay

EmbeddedControllers
Kazuro Furukawa, KEK, Feb.2012.

15

Accelerator Controls

Accelerator Controls

School for Accelerator Technology and Application, IIT-Bombay

Kazuro Furukawa, KEK, Feb.2012.

16

Accelerator Controls

Accelerator Controls

Accelerator ControlsuObjectivesvControl requirements are decided only after
requirements of equipment are decided³Final objective is physics experiment achievementvRequirements often change during the operation³Flexibility as well as robustness is required³Realization of bright new idea is important, while many ofthem are thrown away later. Speed!

vUnfortunately, no general purpose control systemyet³We should design something to meet our accelerator needswAt the same time we have many components that can be sharedwEffective sharing can be achieved via collaboration
School for Accelerator Technology and Application, IIT-Bombay

Kazuro Furukawa, KEK, Feb.2012.

17

Accelerator Controls

Accelerator Controls

Some Historyu Discussion on accelerator controlsv Conference of ICALEPCS started in 1987
³ Industrial standards like X-Window and VME, success of NODAL interpreter at SPS/CERNwBefore, it was said that there were no sharable components between institutes³ More sharable, reusable control components (Eco!)v NODAL deployment at TRISTAN/KEKv Industrial Micro-Computer and VAX/VMS at SLC/SLACv Standard model (of accelerator controls)³ Field-network + VME + Unix + X11v Hope for sharable control system³ Defining class object to express whole accelerator (?)
wPractically impossible, then stackedv General purpose control API from specific institutes³ ncRPC/LEP/CERN, TACL/CEBAF/TJNAF, ACNET/FNAL/Tevatron, etc³ EPICS was employed at SSC, then EPICS spreads APS, CEBAF, BESSY, …

v Many absorb industrial advances³ More computer aided development possible³ CICERO (CORBA)/CERN, TANGO (CORBA), JCOP (CORBA+Java)/CERN, …
³ Windows (COM)/Microsoft, …
School for Accelerator Technology and Application, IIT-Bombay

Kazuro Furukawa, KEK, Feb.2012.

18

Accelerator Controls

Accelerator Controls

No Complete Sharable Control SystemvThe sense of balance required to select and adopt
available technologiesuObject-oriented vs. Channel-orientedvObject-oriented technology³More support benefits from software engineering³Extendable, clearer definitions³Different people have different ideas on control objectsvChannel-oriented technology³Flat (one-layer structure), simple, scalable³Not much support from software engineering³Easy to make gateways
wEPICS is basically channel-oriented
School for Accelerator Technology and Application, IIT-Bombay

Kazuro Furukawa, KEK, Feb.2012.

19

Accelerator Controls

Accelerator ControlsMore balancesuCompiled language vs. interpretive languagevTwo level languages³Interpretive language for rapid prototyping³Compiled language for established algorithms
vAfter too much success of NODAL³Many un-manageable programsvCompiled languages programmed by expert³Documentation, maintenance, policy-driven³Manageable, then reliablevInterpretive/scripting languages³Rapid developmentwRealization of novel ideas in hours³Everyone attends the construction of operation environment³Another level of management/maintenance required
School for Accelerator Technology and Application, IIT-Bombay

Kazuro Furukawa, KEK, Feb.2012.

20

Accelerator Controls

Accelerator ControlsMore balances for technology choiceuBest & aggressive vs. moderate & conservativevNew technology is attractive³But can be a “fad”³Can we justify the choice?

vFor longer life-span, which is better?
³Life of accelerator is often very long compared withwUser facilitieswCommercially available software/communication technologies³Operational performance continuously advancesvAccumulation of operation knowledge base³Stored mainly as software and database in the control systemwBeam stabilization algorithms, hardware startup procedures, etc

vIt is valuable treasure³There should be mechanism to keep such resourceswWith longer life-span
School for Accelerator Technology and Application, IIT-Bombay

Kazuro Furukawa, KEK, Feb.2012.

21

Accelerator Controls

Accelerator Controls

ʻStandardʼ balancesuInternational vs. de-facto standardsvInternational organizations pursue ideal solutions³Sometimes they donʼt become de-facto standards³Selection of one of many standards is difficultvWatching the market³TCP/IP network, Unix/Windows OSes, VME, MicroTCA, etcvAdvantages of de-facto standards³Economical advantage to select products out of markets³Save man-power avoiding proprietary development³Other institutes may choose the same standard³Solutions will be provided for the old standard in the next
generation³As a whole, it is good for long life-span
School for Accelerator Technology and Application, IIT-Bombay

Kazuro Furukawa, KEK, Feb.2012.

22

Accelerator Controls

Available Technologies

School for Accelerator Technology and Application, IIT-Bombay

Kazuro Furukawa, KEK, Feb.2012.

23

Accelerator Controls

Available Technologies

PLCu Programmable Logic Controllers (PLC)vRule-based algorithms can be well-adopted for simple controlsvIP network for the both controls and management were preferable³Especially at KEK/Linac which has a policy of IP only field networkv~150 PLCs at Linac since 1993, and also many at J-PARC
vIsolated/separated development becomes easy
³Outsourcing orientedvEquipment developer oriented³Many maintenance capabilities were implementedvIEC61131-3 Standards³5 languages, with emphasis on naming³Effort to make common development environment³Should be paid more attention

vRedundancy sometimes possiblevEmbedded Linux/EPICS possible³Efficient reuse of resources, cheap, quick, etc.
School for Accelerator Technology and Application, IIT-Bombay

Kazuro Furukawa, KEK, Feb.2012.

24

Accelerator Controls

Available Technologies

Network with only IP/Ethernetu The policy chosen when we upgrade Linac in 1993vMake network management simpler³Faster switches, routing, network-booting, etc.

vAvoid Hardware failure and analysis effort with old field network³Home-grown field networks need much dedicated man-powervCost for optical Ethernet went down at around 1995
³Linac has high-power modulator stations, noise sourcevNowadays many facilities have this policy with GbE³J-PARC controls basically followed thisvMore and more intelligent network devices³ex. Oscilloscopes with Windows/3GHz-Pentium built-in³Even EPICS IOC, MATLAB, or others can be embeddedvNetwork components can be replaced one-by-onevSecurity consideration will be more and more important
School for Accelerator Technology and Application, IIT-Bombay

Kazuro Furukawa, KEK, Feb.2012.

25

Accelerator Controls

Available Technologies

FPGAuAnother “everywhere” after IP networkvDigital circuit and software can be embedded into
one chip³Even CPU core, Linux, and EPICS are embedded³Flexible and robust, wonderful platform for local controlswSometime terrible source of bugsvNano-second level timingvMore and more gates, memory, pins, etcvMore software support neededvOpen hardware initiative may enhance the benefits

School for Accelerator Technology and Application, IIT-Bombay

Kazuro Furukawa, KEK, Feb.2012.

26

Accelerator Controls

Available Technologies

ATCA and µTCAu Advanced telecommunications computing architecturevAccommodate many 100ohm serial busesvGbE or PCI-express, 10GbE, etcvTypically 14slots in 19” width and 12-unit heightvShelf manager manages healthiness of the system³through Intelligent Platform Management Interface (IPMI)vMany reliability improving facilities, redundancy, hot-swap, etc.

u MicroTCA
vMore recently defined in 2006, based on AdvancedMC Mezzanine Carddefined in ATCAvBegin to acquire many facilities from ATCAu Future acceleratorsvDevelopment started for ILC, XFEL/DESY, and detectors

School for Accelerator Technology and Application, IIT-Bombay

Kazuro Furukawa, KEK, Feb.2012.

27

Accelerator Controls

Available Technologies

EPICSu EPICS was chosen at many institutes, as they expected sharable software toolsv As sharable circumstances increase, sharable software expandsu Started at LANL, one of two general purpose control software packagesv EPICS was chosen at ANL/APS among others, and it was extendedv Chosen at CEBAF/Jlab, DESY, etc, then chosen at SSCv Spread to light sources, HEP including KEKB, Fusion experiments, Observatory, etcv Contains all or most of basic facilities which are required in controlsv Technique not to loose performance even with flexibility and expandabilityu Open Sourcev Freeware for research institutes before 2003v Then after 2003 Open Source, open even to companiesu Development collaborationv Core group and coderathonv Collaboration Meeting at least twice a yearv Mailing Listv Web at APS <http://www.aps.anl.gov/epics/>u Recentlyv ILC and ITER also utilize EPICS as interim basev Even commercial products which supports EPICS
School for Accelerator Technology and Application, IIT-Bombay

Kazuro Furukawa, KEK, Feb.2012.

28

Available Technologies

Accelerator Controls

EPICS software componentsu 'Base' normally provided by manager, but can be tested by you easilyv Retrieve EPICS Base (ex. baseR3.14.12.tar.gz)v Expand itv set EPICS_BASE=`pwd`
v setenv EPICS_HOST_ARCH `startup/EpicsHostArch.pl`v make (Basic software including libraries are built)v $EPICS_BASE/bin/$EPICS_HOST_ARCH/makeBaseApp.pl -t example myappv $EPICS_BASE/bin/$EPICS_HOST_ARCH/makeBaseApp.pl -I -t example
myappv make (Example application programs are built)v bin/$EPICS_HOST_ARCH/myapp st.cmd³ For examplew<http://www-linac.kek.jp/cont/epics/linux/>u Extensions or clients are developed at world wide institutesv Feedbacks from mailing list or collaboration meetings refine the softwarev Each institute chooses some of the available software and integrate
School for Accelerator Technology and Application, IIT-Bombay

Kazuro Furukawa, KEK, Feb.2012.

29

Accelerator Controls

Channel Access Commands“connection
request” or“search request”

Channel Access Client

Who has a PV named“S1A:H1:CurrentAO”?

“get”
or
“caget”
What is its
value?

“put” or“caput”“set a monitor”

Change its
value to 30.5

Notify me when the valuechanges

CA Client
CA Server
Channel Access Server

I do.

25.5
AMPS

Process Variables:

OK, it is now
30.5

It is now
20.5
AMPS

It is
now

10.5
AMPS

It is now
0.0023AMPS“put complete”

S1A:H1:CurrentAO

S1:P1:x
S1:P1:yS1:G1:vacuum

School for Accelerator Technology and Application, IIT-Bombay

oror

30.5 is too high. It is
now set to the
maximum value of
27.5.

“post an event”
or“post a monitor”

You are notauthorized to change
this value

Kazuro Furukawa, KEK, Feb.2012.

Accelerator Controls

Available Technologies

EPICSu Now is a kind standard, but …
u Object-oriented design support is limited nowvNaming scheme, and/or design of new recordvMore software-engineering support favored³Several different efforts to provide better environmentwJava IOC (M. Kraimer), Control system studio (M. Clausen), Data access (R. Lange)u Security mechanismsvUser, Host-based protection availablevMore security³Dynamic controls of security³Access logging/auditing, authentication, transaction mechanismu Dynamic configuration of databasevDynamic creation / loading of recordsvDynamic removal of records³Maybe some part of the codes can be shared with redundant-IOC project
School for Accelerator Technology and Application, IIT-Bombay

Kazuro Furukawa, KEK, Feb.2012.

32

Accelerator Controls

Available Technologies

Magnet ControlsuIt is typical controls and still many things to douMany magnets and many power supplies³No one-to-one correspondence. One-to-many, several-to-onevWhich hardware interface to use?

uProceduresvInterlock status, on/off, analog with some precision, etcvEnergy, kick - field - current conversions³How to represent those conversion curvesvTiming synchronous operation³for tune change, orbit correction, etc.

vStandardization

School for Accelerator Technology and Application, IIT-Bombay

Kazuro Furukawa, KEK, Feb.2012.

33

Accelerator Controls

Available Technologies

Event Systemu Old Timing System at Linac
vProvides ~3pico-second Timings to ~150
DevicesvSlow (0.1~100 sec) global controlsvVME(x6) and CAMAC(x10)u MRF Event System (EVG/EVR)vSingle Fiber can Transfer Clock, DelayedTimings, Events (256), Data Buffers (2k-bytes)u Event system at LinacvFast and Synchronized global controlsvVME-basedvVxWorks/RTEMSvEVG/EVRvEPICS Driver/Device Support from community

School for Accelerator Technology and Application, IIT-Bombay

Kazuro Furukawa, KEK, Feb.2012.

34

Accelerator Controls

Linac Event SystemuBasic parametersvEvent rate : 114.24MHzvFiducial rate : 50HzvBit rate : 2284.8Mbps
vTiming jitter (Short term) : ~8psvNo. of defined events : ~50vNo. of receiver stations : 18vNo. of Fast parameters : ~150vData rate : 2kbyte / ~36µsec

CCPPUU  EEVVGG  EEVVRR  
OOpptt..  FFaannoouutt  

School for Accelerator Technology and Application, IIT-Bombay

Kazuro Furukawa, KEK, Feb.2012.

35

Accelerator Controls

BPMu DPO7104 can acquire data in 50Hz .
u Beam modes are recognized by events through network.
u Clients can monitor data of an interested beam mode.
u 100 BPMs are synchronized.
u For SuperKEKB we re-design completely for higher precision

School for Accelerator Technology and Application, IIT-Bombay

Kazuro Furukawa, KEK, Feb.2012.

36

Accelerator Controls

LLRFu Timing and analog signals are essential for absolute energy,
energy spread, and dual-bunch energy equalization.
u Signals can be switched pulse-by-pulse.
u Driver klystrons (SB), energy tuner klystron (KL), andsub-harmonic bunchers (SH) are managed
by the event system.

School for Accelerator Technology and Application, IIT-Bombay

Kazuro Furukawa, KEK, Feb.2012.

37

New LLRF Controller

Accelerator Controls

RF Group

MicroTCA based LLRF ControllervSingle-width full-height modulevWithout physics experiment extension (MTCA.4)³We started earlier³Front-panel connectors only (rather busy)vDigital part and Analog part are on isolated cards³ADC 16bit, 130Msps, x4³DAC 16bit, 500Msps, x4³Virtex5 with PPC440³RAM 640MB, Flash 64MB
³Also monitor card employing the same digital partwADC 14bit, 400Msps, 1.4GHz, x2vFabrication was carried at Mitsubishi Electric Tokki System<http://www-linac.kek.jp/cont/epics/mtca/>

School for Accelerator Technology and Application, IIT-Bombay

Kazuro Furukawa, KEK, Feb.2012.

38

New LLRF Controller

Accelerator Controls

RF Group
Mitsubishi Tokki

School for Accelerator Technology and Application, IIT-Bombay

Kazuro Furukawa, KEK, Feb.2012.

39

Accelerator Controls

Reliability

School for Accelerator Technology and Application, IIT-Bombay

Kazuro Furukawa, KEK, Feb.2012.

40

Accelerator Controls

Reliability

ReliabilityuThe end user expect rigid reliable operationsuInner layers need flexibilities³Because of daily improvementvCompromise between³Practical or ideal solutions³Aggressive and conservative³Under restrictions ofwTime, safety, budget, man-powervHere we think about
adaptive reliability
for 99.999% availability
School for Accelerator Technology and Application, IIT-Bombay

hardwarehardware Interface
equipment controls
beam controls
linac
ring
accelerator physics
beam delivery
detector
data acquisition
computingphysics, chemistry,
medical treatment
Kazuro Furukawa, KEK, Feb.2012.

41

Reliability

Accelerator Controls

Reliability Increase without much Costu There should be “right way”
vWe hope to have it some day, but for now we need interimsu Surveillance for everythingvWell-arranged system does not need this, but…

u Testing frameworkvHardware/Middleware tests just before BeamvSoftware tests when installedu RedundancyvIn Many Hardware/Software componentsvOf course some of them are Expensive, but…

School for Accelerator Technology and Application, IIT-Bombay

Kazuro Furukawa, KEK, Feb.2012.

42

Accelerator Controls

Possible Right ways for the ReliabilityuWell-defined classes for accelerator controlsvIt surely reduces the coding errors³But one may insist on a complete class of acceleratorwwhich we can never achieveuWell-arranged naming conventionsvIt surely reduces human-operation errorsvAnd enables more computer-aided tools³But real world was not so simpleuWell-specified deployment proceduresvEnables more computer-aided toolsvEven scripting languages were said to be bad³But we are lazy

School for Accelerator Technology and Application, IIT-Bombay

Kazuro Furukawa, KEK, Feb.2012.

43

Accelerator Controls

Reliability

Surveillance for everythinguWe have written too many pieces of softwarevwhich assume certain circumstances unfortunately³which will fail some dayvin scripting languages too rapidly and too easily³without documentationsuWe manage too many computersvIf only one, Iʼm almost sure I can make it stable³But in reality even hostname can be mis-labeleduWe installed too many network componentsvwithout good network database etc³which sometimes has bad routing information, etcuWe need surveillance
School for Accelerator Technology and Application, IIT-Bombay

Kazuro Furukawa, KEK, Feb.2012.

44

Accelerator Controls

Reliability

Surveillance for everythinguIf certain installation of (software/hardware) was
not idealvFind out³What is the most important feature of the installation?
³What is the easiest test for its healthiness?
vRoutine test is carried automatically³by cron or continuous scripts³If an anomaly found,wAlarm, e-Mail to the author, make error log
wRestart related software, if not criticalwReport to the human operator, if criticalvNot ideal, but effective under limited human resources
School for Accelerator Technology and Application, IIT-Bombay

Kazuro Furukawa, KEK, Feb.2012.

45

Accelerator Controls

Reliability

Software TestinguMoving operating environmentvFor better resource performance³We tend to do it because of the pressure from budget
restrictionsvMay lead to malfunctions³We knew they may happenuAutomatic software (hardware) tests preferablevUnder new environment (machine, compiler, network, etc)
³Many kinds of important free software does them
³Language systems, Linux Test ProjectuWe do some testsvBut sometimes not enoughvMore thoroughly prepared tests needed
School for Accelerator Technology and Application, IIT-Bombay

Kazuro Furukawa, KEK, Feb.2012.

46

Accelerator Controls

Reliability

Testing Frameworku When we introduce new environmentvUnit test³ We donʼt do it much yet³ EPICS began to have it, “make runtests”
wCollecting existent test caseswUser can provide tests in Perl/Test framework³ Hope to have for SAD and SADscriptsvRegression tests³ We have something, but not thorough, not exhaustive³ Difficult to collect casesvStress tests³ We do it during operation (?)³ We know computers rarely fail, but network/network-devices dowFind solutionwDevelopment of surveillanceswInstallation of failure-recovery or failover procedures

School for Accelerator Technology and Application, IIT-Bombay

Kazuro Furukawa, KEK, Feb.2012.

47

Accelerator Controls

Reliability

Testing Frameworku When we start new runvNew software/hardware³We test unit by unit
³But not through operational tools preparedvMaintenance works³We often forget to restore/initialize cables, switches, variables³Power-stop may bring another annoyanceu We need routine procedures which include³Hardware tests³Name/ID matching³Database tests³Software component tests³Software/Hardware simulation testsvBefore beam operationvWe do it mostly by operator observations based on written proceduresvThere were efforts to automate in the past
School for Accelerator Technology and Application, IIT-Bombay

Kazuro Furukawa, KEK, Feb.2012.

48

Accelerator Controls

Reliability

RedundancyuDo we need redundancy?
³Redundancy may be the last-resort measure³It may costvCentralized facilities are easier to manage³If I have only one server, my life is much easiervBut they become complicated monsters³Nobody understand everythinguEspecially useful for maintenancevNot only for failure-recovery³Redundant systems of complicated system; (complicated)2uAnyway we may have to prepare backups
vThen automatic failover is just around the corner³And …
School for Accelerator Technology and Application, IIT-Bombay

Kazuro Furukawa, KEK, Feb.2012.

49

Accelerator Controls

Reliability

Redundant EPICS IOCuRedundant controllers are favorablewas in PLCsvThe project was started at DESY (M. Clausen)³Redundancy monitor task (RMT)wMonitors healthiness of controllers
wManages primary redundancy resource (PRR)³Continuous control executive (CCE)wSynchronizes internal states³Modifications for several others PRRʼswScan tasks, Channel access server tasks, Sequencer, Drivers
wPossibly user tasksvKEK joined in for wider applications³Linux (OSI) port
³Gateway applicationsvATCA implementation possible³For ILC (?), microTCA (?)
School for Accelerator Technology and Application, IIT-Bombay

Kazuro Furukawa, KEK, Feb.2012.

53

Accelerator Controls

Reliability

Software redundancyuEPICS IOC redundancy is slightly complicatedvSince it has name resolution facilityvMore advanceduLinac/KEK controls is simpler
vNormally we run several middle-layer control servers³on separate machinesvFor EPICS gateway³We need redundant IOC technologyuOther existent serversvRecently more careful in redundancy³Like dchpd³Redundancy and replications
School for Accelerator Technology and Application, IIT-Bombay

Kazuro Furukawa, KEK, Feb.2012.

54

Accelerator Controls

Past KEKB

School for Accelerator Technology and Application, IIT-Bombay

Kazuro Furukawa, KEK, Feb.2012.

55

Accelerator Controls

KEKB / Linac Controls

KEKB and Linac Control Systemsu LinacvControls Upgrade (1990~)1993³De-facto (and International) Standards, IP-only NetworksvNo long Shutdown for KEKB upgrade³3.5-times Energy increase, 10-times current increasevDivision changed at the end of UpgradevThree indirect User Facilities (KEKB, PF, PF-AR)vFewer resourcesu KEKBv5-year Shutdown after TRISTAN 1994-1998³Precision requirements were much different for KEKBvComplete transition of Controls³from Nodal at TRISTAN to EPICS+SAD at KEKBvBasically Single-user (Belle)

School for Accelerator Technology and Application, IIT-Bombay

Kazuro Furukawa, KEK, Feb.2012.

Accelerator Controls

Linac Controller

Equipment Controllers at Linacu 1982~(1997) (1st generation)v300 microprocessor-based controllers³Linked together with home-grown fiber-optic networku 1993~now (upgrade of controls)v150 PLCs (programmable logic controller)³Linked via only Fiber-optic Ethernet/IPwControl communication with servers and program developmentu 1995~now (upgrade for KEKB)v30 VXI for rf measurementv5 VME / 10 CAMAC for Timingv20 VME for Beam monitorsu 2006~ (upgrade of BPM readout)v24 Oscilloscopes with WindowsXP IOC for 100 BPMs
³10Gs/s, 50Hz acquisition, local processing with 20 calibration parameter/BPM
School for Accelerator Technology and Application, IIT-Bombay

Kazuro Furukawa, KEK, Feb.2012.

KEKB Controller

Accelerator Controls

Equipment Controllers at KEKBuTRISTANvMostly CAMAC³Equipment group responsibility: CAMAC module and outsideuKEKBv100 VME/IOC without Analog processingv200 VXI/MXI mainframes for 900 BPMsv50 CAMAC crates are kept for rf and vacuumvARCNet boards for Magnet ps. settings, and othersvGPIB for Magnet ps. readback, and othersvPLCs for Magnet interlocks, and others

School for Accelerator Technology and Application, IIT-Bombay

Kazuro Furukawa, KEK, Feb.2012.

Accelerator Controls

EPICS at Linac

EPICS Transition at LinacuHome-grown RPC at Linac (1990~)vBad timing but no choice because of end of old mini-computer
supportuLynxOS Transition was developed (1994~1996)vTo cover both RPC and EPICS with pthread, posix³Mostly working, Failed to get funding for Hardware/Software
upgradeuGateways to EPICS in several waysvSoftware-only IOC and Gateway (Clients to both RPC/CA)vPortable Channel Access Server of EPICS-3.12 (1995~)vSoft-IOC with device support to Linac RPC (2002~)

uReal IOCs are increasingvPLC(rf,vacuum,magnet) and Linux, Oscilloscope(bpm) with
Windows, VME(llrf and timing)vRPC servers read EPICS IOCs, EPICS gateways read RPC servers
School for Accelerator Technology and Application, IIT-Bombay

Kazuro Furukawa, KEK, Feb.2012.

Accelerator Controls

EPICS at KEKBEPICS Transition at KEKBuSome candidates discussed after Nodal at
TRISTANvRPC/CORBA based control designvReflective memory (hardware shared memory) designuNo other choice than EPICS for KEKBvNo man-power for control system softwarevThe choice at SSCvInternational collaboration was attractive

School for Accelerator Technology and Application, IIT-Bombay

Kazuro Furukawa, KEK, Feb.2012.

Accelerator Controls

ArchiverArchiver/LoggeruLinacvSeveral archivers with different filters and stored in asciivReplaced with two EPICS archivers (2002)³Channel archiver, with Java viewer, and Web-based viewer³Transition to CSS-based channel archiver³KEKBlog, SADscript-based viewerwBoth ~400MB/day, Dynamic ADEL changesuKEKBvKEKBlog, since 1998
³Once there was a plan to replace it with Channel ArchiverwData conversion, no much performance difference³Only ADEL-based filterw4GB/day³SADscript-based viewer is one of the most used applicationswWith Data analysis capability, easy manipulations
School for Accelerator Technology and Application, IIT-Bombay

Kazuro Furukawa, KEK, Feb.2012.

Accelerator Controls

Scripting Language

Scripting Languages
uHeavy use because of rapid prototypinguLinacv(1992~) Tcl/Tk as Test tools on Unixv(1997~) Tcl/Tk as Main Operator Programming Toolv(Now) Mixture of SADscript/Tk, Python/Tk, Tcl/Tk³SADscript has most accelerator design capabilitywCovers many features like MATLAB, Mathematica, XAL, MADuKEKB³(Nodal interpreter and Fortran covered everything at TRISTAN)vPython covers many areas which is not covered by medmvSADscript is used by operators and physicists everyday³Realization of novel ideas in hours
wOnly some ideas are effective, so rapid prototyping is important

School for Accelerator Technology and Application, IIT-Bombay

Kazuro Furukawa, KEK, Feb.2012.

Accelerator Controls

Towards SuperKEKB

School for Accelerator Technology and Application, IIT-Bombay

Kazuro Furukawa, KEK, Feb.2012.

66

SuperKEKB

Accelerator Controls

SuperKEKBuElectron-positron asymmetriccollidervBased on a decade of successful operation at KEKBuAims at 40-times higher luminosityv8 x 1035cm-2s-1 for further flavor physics studiesv7GeV / 2.6A electron, 4GeV / 3.6A positronvβy* ~ 0.3mm, εx /εy ~ 4nm/9pm, σy ~ 50nm, σz ~ 6mmvAnte chamber, longer bend, damping ring, rf gun,etc
School for Accelerator Technology and Application, IIT-Bombay

Kazuro Furukawa, KEK, Feb.2012.

67

KEKB

Accelerator Controls

KEKB Controls 1998 - 2010uEPICS as Main control Software ToolkitvBecame one of de-facto standard at 1995vSeveral fieldbuses were incorporated³VME, VXI, CAMAC, ArcNet, GPIB, etcvReduced software design efforts muchuScripting Languages for Operational SoftwarevSADscript/Tk, Python/Tk, Tcl/Tk used much
³Especially, SADscript as a bridge btw. Accelerator simulation,
Numeric manipulation, Graphic interface and EPICS controlsvBright new idea in the morning meeting could make theoperation much advanced in the evening³Great tool to optimize the operation
School for Accelerator Technology and Application, IIT-Bombay

Kazuro Furukawa, KEK, Feb.2012.

68

SuperKEKB

Accelerator Controls

SuperKEKB ControlsuInherit Good part of KEKB ControlsvEPICSvScripting languagesvWith simple rejuvenation of software/hardwareuTwo Additional Concepts

School for Accelerator Technology and Application, IIT-Bombay

Kazuro Furukawa, KEK, Feb.2012.

69

SuperKEKB

Accelerator Controls

1st: CA EverywhereuEPICS Channel Access (CA) Everywhere³Or EPICS anywherevEmbed EPICS control software (IOC) everywhere
possiblevReduce efforts on protocol design, testing, etc

School for Accelerator Technology and Application, IIT-Bombay

Kazuro Furukawa, KEK, Feb.2012.

70

CA Everywhere

Accelerator Controls

Transition of Architecture
Mini
Computer

Mini
ComputerDevices

1990~

1993~

2005~

Unix

Unix

OPI

TCP/
RPC/CA

ChannelAccessChannelAccessVME

VME/IOCIOC

Field
Networks

TCP/IP

ChannelAccessDeviceController

DeviceController

DeviceIOC

School for Accelerator Technology and Application, IIT-Bombay

Kazuro Furukawa, KEK, Feb.2012.

71

CA Everywhere

Accelerator Controls

Overview of controls at KEKuVME + Unix (1990~)vStandard model (later EPICS) configuration³With several fieldbusesuEvery controller on IP network (1993~)v2-layer physical, 3-layer in logical (Linac, J-PARC)uEvery controller with EPICS IOC (2005~)vChannel Access everywhere (CA Everywhere)³Good for rapid development and smooth maintenance³May need some consideration on network management
School for Accelerator Technology and Application, IIT-Bombay

Kazuro Furukawa, KEK, Feb.2012.

72

CA Everywhere

Accelerator Controls

Embedded EPICS IOCs at (Super)KEKBuNot only information server, but also the same
software framework on every controller³Rapid development and smooth maintenancevµTCA LLRF module: Linux/FPGA (Odagiri…)vYokogawa PLC: Linux CPU (Odagiri…)vOscillo. 50Hz measurement: Windows (Satoh…)
OPIvMPS management :Linux/FPGA (Akiyama…)
CAvTiming TDC: Linux/Arm (Kusano…)vPower modulator: Linux/FPGA (Kusano…)
IOCvLibera BPM at 50Hz: Linux/FPGA (Satoh…)
CA
vNI cRIO : CAS/FPGA (Odagiri…)
DeviceIOCvMany more…
School for Accelerator Technology and Application, IIT-Bombay

Kazuro Furukawa, KEK, Feb.2012.

73

CA Everywhere

Accelerator Controls

Simpler PLC Usage under EPICS
Conventional PLC usage
OPI
CA Clientswith asynchronous access

IOC(Logics)OPI
CA Clients

LadderCPU(Logics)

FAM3 PLC
I/O Modules

F3RP61
IOC

FAM3 PLC
I/O Modules

If necessary, we can combine
OPI
CA Clients

F3RP61IOC

LadderCPU

FAM3 PLC
I/O Modules

Logics are confined in PLC, and management is easier
School for Accelerator Technology and Application, IIT-Bombay

Kazuro Furukawa, KEK, Feb.2012.

74

SuperKEKB

Accelerator Controls

2nd: Dual-layer ControlsuAnother layer in addition to EPICS/CAvEvent system helps EPICS with another channelvAdditional functionality, synchronization and speed

School for Accelerator Technology and Application, IIT-Bombay

Kazuro Furukawa, KEK, Feb.2012.

75

Dual-layer Controls

Accelerator Controls

Dual-layer ControlsuIOC controls via Conventional EPICS CA³Above 1ms, ordered controlsuFast FPGA controls via SFP/Fiber³10ps ~ 100ms, 114MHz synchronous controls
OPI
Channel Access
IOC

IOC

IOC

IOC

EVG

EVR

EVR

EVR

FPGA/SFP
School for Accelerator Technology and Application, IIT-Bombay

Kazuro Furukawa, KEK, Feb.2012.

76

Dual-layer Controls

Accelerator Controls

Fast Global Synchronous Controlsu MRF’s series-230 Event Generator / Receiversu114.24MHz event rate,u VME64x and VxWorks v5.5.1
50Hz fiducialsu EPICS R3.14.9 with DevSup v2.4.1
uMore than hundredu 17 event receivers up to now
50Hz-analog/timing param.
Central"Event Generator"uMulti/single-mode fiberuTiming precision is < 10ps.
SH_A1"
KL_B5/B6"

SB_B"

Injection"

SB_A"

e− GunARC!

v < 1ps with external
module.
96ns

e– BT (PF: 2.5GeV, 0.1nC)>100nsCont-ABC"
KL_51/52"
SB_C"

SB_1"

SB_2"

SB_3"

SB_4"

SB_5"

e+ BT (KEKB: 3.5GeV, 2nC)

>100nse+ Target
Cont-1"

Cont-2"96ns
Cont-3"Cont-4"Cont-5"

Event Receivers"
School for Accelerator Technology and Application, IIT-Bombaye– BT (KEKB: 8GeV, 2nC,
PFAR: 3.0GeV, 0.1nC)

Kazuro Furukawa, KEK, Feb.2012.

77

Dual-layer Controls

Accelerator Controls

Event Manipulation
Human Operator

Injection Programs

Flexible with script
and reliable/fastwith FPGA.

Arbitrate and Generate Beam Mode Pattern (in PythonTk)
considering priorities of the ring accelerators
equalizing pulsed power supply intervalin arrays of length 2 (40ms) to 500 (10s)each element corresponds to a 20-ms time slot and a beam mode �Generate Events for the Next 20-ms Time Slot (in Event Generator)
reading two consecutive elements from the beam mode patterngenerate several events for the next pulse
generate preparation events for the next after next�

Generate Signals based on Received Events (in Event Receiver)generate pulsed signals as prepared in the previous time slot
program the signals (analog value, delays, etc) for the next
start to generate analog signals for the next�School for Accelerator Technology and Application, IIT-Bombay

Kazuro Furukawa, KEK, Feb.2012.

78

Dual-layer Controls

Accelerator Controls

One Machine, Multiple Virtual Accelerators (VAs)u Control/Monitor are carried dependent on a VAv Mostly independent between VAsu Independent parameter set for each VA, one of the VAs is controlled at atimev VAs for Injections (HER (e-), LER (e+), PF, PF-AR) and Linac-only in SuperKEKB projecte− Gun!

e– BT (PF: 2.5GeV, 0.1nC)!

PF Injection�

ARC!

e+ Target"

Event-based
Control Systeme− Gun!
ARC!

KEKB-LER Injection�

Primary e– (4GeV, 10nC)

e+ BT (KEKB: 3.5GeV, 0.6nC)!

e+ Target"e− Gun!
ARC!

KEKB-HER Injection�
e+ Target"e– BT (KEKB: 8GeV, 1.2nC)!

School for Accelerator Technology and Application, IIT-Bombay

Kazuro Furukawa, KEK, Feb.2012.

79

Dual-layer Controls

Accelerator Controls

Multiple Closed Loop Controls Overlappedu Closed loops can be installed on each VA independentlyvTested at KEKB

e− Gun!

e– BT (PF: 2.5GeV, 0.1nC)!

PF Injection�

ARC!

e+ Target"e− Gun!

Event-based
Control System

ARC!

KEKB-LER Injection�

Primary e– (4GeV, 10nC)

e+ BT (KEKB: 3.5GeV, 0.6nC)!

e+ Target"e− Gun!
ARC!

KEKB-HER Injection�
e+ Target"e– BT (KEKB: 8GeV, 1.2nC)!

School for Accelerator Technology and Application, IIT-Bombay

Kazuro Furukawa, KEK, Feb.2012.

80

Accelerator Controls

Event-based Timing and Fast Global
Synchronous ControlsuSeveral Stable RF Frequencies (RF group)v114, 509, 571, 1298, 2856 MHz, Rubidium-baseduIndependent Circumference Correction andBucket SelectionvKEKB: ~4x10-7, PF, PF-AR: 4~20x10-6

uSuperKEKB Injection Timing < 30psvPF, PF-AR Injection with accidental sync. ~300ps

u4-ring Simultaneous InjectionvExchange energy, charge, sync. every 20ms
vWith damping ring ( 20ms) further complexityuLLRF control and monitor are important
School for Accelerator Technology and Application, IIT-Bombay

Kazuro Furukawa, KEK, Feb.2012.

81

Accelerator Controls

Towards SuperKEKB
uUpgrade of controllers for each type of devicevDiscussions with device groups, for aging controllersuBase software components, OS, EPICS, CSS,
(Scripting) LanguagesvEspecially EPICS Collaboration-based softwareuOperational softwarevArchiver, Archive viewer, Alarm, e-Log, etcuInformation sharing to officesvMore Web based application softwareuSeminar and traininguIP Networking, Wireless LAN, Console Desk, etc
School for Accelerator Technology and Application, IIT-Bombay

Kazuro Furukawa, KEK, Feb.2012.

82

Accelerator Controls

SuperKEKB Plan (1)uFor nano-beam scheme with 40-times higher luminosityvMany new facilities should be requireduWill start based on the existent environmentvWith additional concept of CA everywhereuHelp device groups to have better global controlsvReplacement of old installations such as CAMAC
vSolutions not only VME but also other types of controllers,
embedded EPICS if possibleuFaster networks for the groups who can build controllers
by themselvesuBetter connection to operational environmentsvKeeping SAD environment, etc
vMonitoring at offices
School for Accelerator Technology and Application, IIT-Bombay

Kazuro Furukawa, KEK, Feb.2012.

83

Accelerator Controls

SuperKEKB Plan (2)uArchiving scheme and viewervMaybe existing KEKBlog and channel archivers³New viewer should be developeduAlarm handlervCSS or Python (to simulate KEKBalarm)³EvaluatinguOperational LogvIn house, two versions with different origins³Postgres + (Python/Zope and Flash/Flex)uScriptsvSADscript/Tk, Python/Tk, (decreasing Tcl/Tk)

uDisplaysvCSS and MEDM/EDM
School for Accelerator Technology and Application, IIT-Bombay

Kazuro Furukawa, KEK, Feb.2012.

84

Accelerator Controls

SuperKEKB Plan (3)uInterviews to each device groupsvPlanning to have meetings and trainings³To collect user requirements, etcvPartially successful for old hardware replacements³Not yet effective for new functionalitieswWhether both sides do not have experiencesuAdditional controlsvex. Global orbit feedback³May provide EPICS interface, middle-speed feedback, etc

School for Accelerator Technology and Application, IIT-Bombay

Kazuro Furukawa, KEK, Feb.2012.

85

Accelerator Controls

Operation

School for Accelerator Technology and Application, IIT-Bombay

Kazuro Furukawa, KEK, Feb.2012.

90

Accelerator Controls

KEKB and Linac Operation

KEKB Commissioning Groupsu Formation of Commissioning Group (KCG)vLinac Commissioning (LCG)³7 from Linac³~10 from RingvKEKB Ring Commissioning Group (KCG)³All LCG
³~20 from Ring
³Several from Detector (BCG)vCommissioning softwarebase was formed during
Linac Commissioning(1997~)
Tcl/Tk , Python/Tk, SADscript/Tk

KEKB
CommissioningLinac
Group CommissioningGroup

KEKB Ring
School for Accelerator Technology and Application, IIT-Bombay

Linac

Kazuro Furukawa, KEK, Feb.2012.

91

Accelerator Controls

Scripting Language

Scripting Languages
uHeavy use because of rapid prototypinguLinacv(1992~) Tcl/Tk as Test tools on Unixv(1997~) Tcl/Tk as Main Operator Programming Toolv(Now) Mixture of Tcl/Tk, SADscript/Tk, Python/Tk³SADscript has most accelerator design capabilitywCovers many features like MATLAB, Mathematica, XAL, MADuKEKB³(Nodal interpreter and Fortran covered everything at TRISTAN)vPython covers many areas which is not covered by medmvSADscript is used by operators and physicists everyday³Realization of novel ideas in hours
wOnly some ideas are effective, so rapid prototyping is important

School for Accelerator Technology and Application, IIT-Bombay

Kazuro Furukawa, KEK, Feb.2012.

92

Accelerator Controls

KEKB and Linac Operation

SADScriptu Mathematica-like LanguagevNot Real Symbolic Manipulation (Fast)vEPICS CA (Synchronous and Asynchronous)
CaRead/CaWrite[ ], CaMonitor[ ], etc.

v(Oracle Database)vTk WidgetvCanvas Draw and PlotvKBFrame on top of TkvData Processing (Fit, FFT, …)vInter-Process Communication (Exec, Pipe, etc)
System[ ], OpenRead/Write[ ], BidirectionalPipe[ ], etc.

vGreek LettervFull Accelerator Modeling CapabilityvAlso Used for non-Accelerator ApplicationsvComparable to XAL, but very different architecture

School for Accelerator Technology and Application, IIT-Bombay

Kazuro Furukawa, KEK, Feb.2012.

93

Accelerator Controls

KEKB and Linac Operation

SADScriptu Example

FFS;
w=KBMainFrame["w1",fm,Title->"t1"];$DisplayFunction=CanvasDrawer;
W1=Frame[fm];c1=Canvas[w1,Width->600,Height->400,
Side->"top"];
Canvas$Widget=c1;
data = {{0,0}, {1,1}, {2,5}, {3,8}, {4,10}, {5,7}, {6,4}, {7,2}, {8,0}, {9,2}}
fit = FitPlot[data,a Sin[x b + c] + d, x, {a,5},{b,1},{c,1},{d,5}, FrameLabel->{"X","Y"}];phase = StringJoin["Phase : ", (c/.fit[[1]]) 180/Pi, " Deg."];f1=KBFComponentFrame[w1,Add->{KBFText[Text->phase]}];TkWait[];Exit[];

School for Accelerator Technology and Application, IIT-Bombay

Kazuro Furukawa, KEK, Feb.2012.

94

Accelerator Controls

KEKB and Linac Operation

KEKB Alarm Panelu KEKB Alarm Main Panel covers Linac Alarms as well.
~10,000 Records are Monitored in One Panel. Detailed
alarm information/history is available in a separate panel
Linac

Ring

School for Accelerator Technology and Application, IIT-Bombay

Kazuro Furukawa, KEK, Feb.2012.

95

KEKB and Linac Operation

Accelerator Controls

Beam Optics Panels in SAD
u Beam Optics Matching and Optimization Panels
in SADscriptuSome Parameters goesthru EPICS Gateways,
others directly to Linac
School for Accelerator Technology and Application, IIT-Bombay

Kazuro Furukawa, KEK, Feb.2012.

96KEKB and Linac Operation

Accelerator Controls

KEKB Operation Panel ExamplesuTune Measurement
and Tune Changer

School for Accelerator Technology and Application, IIT-Bombay

Kazuro Furukawa, KEK, Feb.2012.

97

KEKB and Linac Operation

Accelerator Controls

Virtual Accelerator in KEKBuTune/Optics ServervMaintain a Model of Real AcceleratorvCan Change Tune, Chromaticity, etc, on Request
by Other PanelsvAct as a Virtual
Accelerator

School for Accelerator Technology and Application, IIT-Bombay

Kazuro Furukawa, KEK, Feb.2012.

98

Accelerator Controls

Virtual Accelerator in KEKBu For Example in KEKB
vmost Beam Optics Condition is
maintained in the Optics PanelvOther Panels Manipulate Parameters
Communicating with the Optics Panel(Oide, Koiso, Ohnishi et al)===>	Tune Measurement/Changer
School for Accelerator Technology and Application, IIT-Bombay

Optics Panel
Kazuro Furukawa, KEK, Feb.2012.

99

Accelerator Controls

KEKB and Linac Operation

Example Virtual AcceleratoruVirtual Accelerator may Provide
the Both Fake Steerings and Fake BPMs
Maybe with Simulated Errors/NoisesuOrbit Correction Application may WorkOn Those Fake Information
Operation Panel
Orbit Correction
Real Acc.

Virtual Acc.

OpticsSteerings
BPMs
Noises

OpticsSteerings
BPMs
ErrorsSchool for Accelerator Technology and Application, IIT-Bombay

Kazuro Furukawa, KEK, Feb.2012. 100

KEKB and Linac Operation

Accelerator Controls

Virtual Accelerator with EPICSu Fake Accelerator Implementation³With EPICS Channel Access

Operation Panel� SimulatorvIn A Single SAD Application³Built-in Simulator in Operation Panel³Only SAD ApplicationsvSeparate Simulator (Virtual Accelerator)³Needs Some Switching MechanismvSeparate Simulator (Virtual Accelerator)³In EPICS Semantics (EPICS Simulation Server)³Any Operation Panel (not only SAD)
³SAD Simulation Server should Act as
EPICS Channel Access Server

School for Accelerator Technology and Application, IIT-Bombay

Real Accelerator

Operation Panel�
SwitchReal Acc.

Virtual Acc.

Operation Panel(Any EPICS Client)
SwitchReal Acc.

Virtual Acc.

Kazuro Furukawa, KEK, Feb.2012. 101

KEKB and Linac Operation

Accelerator Controls

EPICS Simulation ModeuEPICS Database - Simulation ModeA set of fields to support simulation are supplied on all hardware input
records.
SIMM = YES makes this record a simulation record.
A link to a database value to put the record into simulation mode is specified
in the SIML. A non-zero number puts the record into simulation mode.
SVAL is the engineering units value used when the record is in simulation
mode.
SIOL is a database location from which to fetch SVAL when the record is in
simulation mode.
SIMS is the alarm severity of the record if it is in simulation mode.

vThat is, EPICS Records may have Proxy Records

School for Accelerator Technology and Application, IIT-Bombay

Kazuro Furukawa, KEK, Feb.2012. 102

KEKB and Linac Operation

Accelerator Controls

EPICS Simulation Mode
³SIMM - Simulation Mode
»This field has either the value YES or NO. By setting this field to YES, the record can beswitched into simulation mode of operation. While in simulation mode, input will beobtained from SIOL instead of INP.

³SIML - Simulation Mode Location»This field can be a constant, a database link, or a channel access link. If SIML is adatabase or channel access link, then SIMM is read from SIML. If SIML is a constant linkthen SIMM is initialized with the constant value but can be changed via dbPuts.

³SVAL - Simulation Value»This is the record's input value, in engineering units, when the record is switched into
simulation mode, i.e. when SIMM is set to YES.

³SIOL - Simulation Value Location»This field can be a constant, a database link, or a channel access link. If SIOL is adatabase or channel access link, then SVAL is read from SIOL. If SIOL is a constant linkthen SVAL is initialized with the constant value but can be changed via dbPuts.

³SIMS - Simulation Mode Alarm Severity»When this record is in simulation mode, it will be put into alarm with this severity and astatus of SIMM.

School for Accelerator Technology and Application, IIT-Bombay

Kazuro Furukawa, KEK, Feb.2012. 103

Accelerator Controls

KEKB and Linac Operation

Simulation ModeuEPICS Simulation Mode Simple ExamplevTests Logic without Hardware
AI Record
.INP
.SIML

A/D D/A Card.SIOL

AO Record

Programmable
Power Supply

.VAL
.SIML

.OUT

.VAL
(Simulation
Mode
Switch)School for Accelerator Technology and Application, IIT-Bombay

Kazuro Furukawa, KEK, Feb.2012. 104

KEKB and Linac Operation

Accelerator Controls

SAD as EPICS Simulatoru Implementing a Virtual Acceleratoru SAD Simulator in Channel Access ServervServes Channel Values Requested by Channels (Records)
in Simulation Mode (SIOL),
Acting as a Channel Access ServervSlightly more Difficult to Implement (at the First Stage)u SAD Simulator in Channel Access ClientvProvides Channel Values Needed by Channels (Records)
in Simulation Mode (SVAL)vEasier to Implement (?)³Needs Some Studies

School for Accelerator Technology and Application, IIT-Bombay

Kazuro Furukawa, KEK, Feb.2012. 105

Accelerator Controls

Beam Optics Databaseu Repository of Inputs to Simulation Codes?
u XSIF Extended Standard Input Formatv Many Simulation Codes utilize itv SAD does notv Currently a Conversion Tool is Used to for These Input Formatsv XSIF (LIBXSIF) inclusion in SAD?

u Yet another Generalized Input Format?
v Separation between Beamline Geometry (relatively static) and Beam Optics(more varying)v Could be structured into XMLu Relational information to each Hardware Componentsv We do not prefer complicated relations

by OideSchool for Accelerator Technology and Application, IIT-Bombay

Kazuro Furukawa, KEK, Feb.2012. 106

Accelerator Controls

Summary

School for Accelerator Technology and Application, IIT-Bombay

Kazuro Furukawa, KEK, Feb.2012. 107

Accelerator Controls

Accelerator ControlsuIt’s a fan to interact with all the componentsof the accelerator through control hardware
and softwareuIt’s a fan to interact with all the staff
members of the project in order to design andimprove controlsuWe can contribute to the machine
performance and the results even without
realizing it
School for Accelerator Technology and Application, IIT-Bombay

Kazuro Furukawa, KEK, Feb.2012. 108

Accelerator Controls

ConferencesuExchange collaboration ideas internationally³Collaboration is important because we don't want toreinvent the wheel³Asia, Europe and North America regionsvICALEPCS, San Francisco/NIF, Oct.2013vPCaPAC, Kolkata/VECC, Dec.2012vEPICS collab. meeting, Daejeon/KSTAR, Oct.2012vWAO, San Francisco/SLAC, Aug.2012vIBIC, Tsukuba, Oct.2012vIPAC, New Orleans, May.2012
School for Accelerator Technology and Application, IIT-Bombay

Kazuro Furukawa, KEK, Feb.2012. 109

Accelerator Controls

Performance achievement
If the system is small single controller or single person cancover it. However, … We need global optimization insteadof local optimization
Controls

12

12

10

10
Performance

Performance

Computers

8
6
4

8
6
4
2

2

0
0

0
0

1

2 3 4 5 6
Number of CPUs

7

School for Accelerator Technology and Application, IIT-Bombay

1 2 3 4 5 6 7
Number of controllers oreven staffs
Kazuro Furukawa, KEK, Feb.2012.

110

Accelerator Controls

ConclusionuTwo kinds of virtual accelerators appeared inthis slides. That may mean something.
uControl efforts have contacts with allactivities in the particle accelerator. Controls
are at the privileged position to enjoy it.
uWe should provide maximum performanceout of each component and achieve ultimate
goal.
uWith some Phronesis (Greek: practical
wisdom, ability to understand the universal
truth), we believe we can achieve the target.
School for Accelerator Technology and Application, IIT-Bombay

Kazuro Furukawa, KEK, Feb.2012.

111

Accelerator Controls

Mt. Tsukuba

Thank you
SuperKEKB
dual rings
PF-AR
PF
Linac

School for Accelerator Technology and Application, IIT-Bombay

Kazuro Furukawa, KEK, Feb.2012. 112

Accelerator Controls

Thank you

School for Accelerator Technology and Application, IIT-Bombay

Kazuro Furukawa, KEK, Feb.2012. 113

Accelerator Controls

Phronesisuアリストテレスの知恵の考え方vSophia とは逆に普遍的な真実を理解しようとする能力(らしい)、全体的な解決方法を探す能力

u加速器制御v実現する方法はたくさんあるが、各装置の能力を引き出し、性能向上のための新しいアイデアを実現し、物理実
験の成果を最大限に高める方法はそれほど多くないv同じ基盤の上で各グループがアイデアを交換できることが重要なのではないか
School for Accelerator Technology and Application, IIT-Bombay

Kazuro Furukawa, KEK, Feb.2012.

114

Accelerator Controls

Thank you

School for Accelerator Technology and Application, IIT-Bombay

Kazuro Furukawa, KEK, Feb.2012.

115