Embedded LLRF Controller< kazuro.furukawa @ kek.jp >Embedded LLRF Controller
with Channel Accesson MicroTCA Backplane Interconnect
K. Furukawa, K. Akai, A. Akiyama, T. Kobayashi, S. Michizono,
T. Miura, K. Nakanishi, J. Odagiri (KEK)
H. Deguchi, K. Hayashi, M. Ryoshi (Mitsubishi Elec. Tokki)
October 2011.

Kazuro Furukawa, KEK, Oct.2011.

1

Embedded LLRF Controller

LLRF controllers at KEK, MicroTCA
EPICS at KEK, Channel Access EverywhereNew LLRF controllerRF control configuration

Kazuro Furukawa, KEK, Oct.2011.

2

Embedded LLRF Controller

LLRF at KEK

Digital LLRF Controllers at KEKRF GroupJ-PARC CompactPCI-based DSP/FPGA system
 Since ~2003

ILC and STF development
 Started with CompactPCI-based controller Based on J-PARC experiences Ten 16bit ADC, two 14bit DAC, Virtex2pro

 ATCA-based controller
 For ILC “baseline” design large card was required at that time Large card (14bit ADC x “32”, 16bit DAC x4, FPGA, etc)
 Reliability for large number of components

Choice of bus for the next generation was difficult VME was old No good standard was available for cPCI with PCIe

Kazuro Furukawa, KEK, Oct.2011.

3

Embedded LLRF Controller

LLRF at KEK

MicroTCA (μTCA)
ATCA (2003)
 New computing standard for telecommunication and industry
 After CompactPCI (1993)

 Many serial interconnects on backplane 2.5Gbps each (10Gbps in the future) IPMI surveillance/remote-management for reliability

AMC (Advanced Mezzanine Card for ATCA)
 Serial interconnects, IPMI, good part of ATCA

MicroTCA (2008)
 AMC card itself is powerful
 Direct slot-in AMC cards in a Box

MicroTCA for LLRF should be a good choice
Kazuro Furukawa, KEK, Oct.2011.

4LLRF at KEK

Embedded LLRF Controller

New LLRF Controller at KEKRF GroupcERL (Compact Energy Recovery Linac (Test Facility)) CW, under construction, for future ERL AMC or MicroTCA-based LLRF Controller Future stability of 0.01% in amplitude, 0.01degree in phase For now, 0.1% in amplitude, 0.1degree in phase, 1μs loop delay

SuperKEKB
 CW, under designing, starting part of construction
 For higher luminosity, higher stability and feedback capability is required Synergy between projects - MicroTCA

STF/ILC for S1 global
 ATCA control
 For Clustered RF scheme New RF system configuration , “DRFS” (Distributed RF Scheme)
 For single tunnel scheme MicroTCA can be adequate

Kazuro Furukawa, KEK, Oct.2011.

5

Embedded LLRF Controller

EPICS at KEK

Control Progress at KEKVME + Unix (1990~)

Every controller on IP network (1993~)

Every controller with EPICS IOC (2005~)
Channel Access everywhere (CA Everywhere)
Good for rapid development and smooth maintenanceKazuro Furukawa, KEK, Oct.2011.

6

EPICS at KEK

Embedded LLRF Controller“Channel Access Everywhere”
The same software framework on every controller Rapid development and smooth maintenanceEmbedded EPICS IOCs at (Super)KEKB
Yokogawa PLC: Linux CPU
Oscilloscope 50Hz measurement: Windows
MPS management :Linux/FPGATiming TDC: Linux/Arm
Power modulator: Linux/FPGALibera singlepass BPM at 50Hz: Linux/FPGANI cRIO : CAS/FPGAMany more…

OPICAIOCCADeviceIOC

Kazuro Furukawa, KEK, Oct.2011.

7

Embedded LLRF Controller

EPICS at KEKStandard EPICS
EPICS Channel Access (CA) as “Software bus”

CA on Ethernet

IOCIOCIOC

IOC

Kazuro Furukawa, KEK, Oct.2011.

8

Embedded LLRF Controller

EPICS at KEK

Channel Access on MicroTCA Backplane
CA on Hardware “bus”

CAGbEther
IOCIOCIOC

IOC

MicroTCA box
Picture by J.Odagiri
Kazuro Furukawa, KEK, Oct.2011.

9

EPICS at KEK

Embedded LLRF Controller

It was natural to think in the following way
Let’s employ Channel Access on μTCA
Backplane !
Let’s embed EPICS IOC on to Each μTCA/
AMC Card !

Miura and Furukawa
Kazuro Furukawa, KEK, Oct.2011.

10

Embedded LLRF Controller

New LLRF Controller

IOC on MicroTCA
Natural to put IOC on μTCA LLRF Controller
Shared among STF, cERL, and SuperKEKB

Chose GbEthernet as a main media on thebackplane interconnect
Link to global control is straightforwardChose PowerPC core on Virtex5
ML507 of Xilinx as a good referenceLinux on PowerPCNo realtime processing is necessary for now

Kazuro Furukawa, KEK, Oct.2011.

11

New LLRF Controller

Embedded LLRF Controller

EPICS IOC on MicroTCA LLRF Controller
Linux 2.6.9 on PPC/Virtex5 Boot from Flash (or over network) EPICS and application software from NFS server disk
 Relatively straight forward

EPICS 3.14.9
 Driver to FPGA (with mmap())
 Channel access on backplane interconnect
 Directly connected to outside at firstCollaboration between RF group, Mitsubishi Elec. Tokki
System Co. Ltd., and Control group
Kazuro Furukawa, KEK, Oct.2011.

12

New LLRF Controller

Embedded LLRF Controller

RF Group

MicroTCA based LLRF Controller
 Single-width full-height module Without physics experiment extension (MTCA.4)
 We started earlier Front-panel connectors only (rather busy)

 Digital part and Analog part are on isolated cards
 ADC 16bit, 130Msps, x4
 DAC 16bit, 500Msps, x4
 Virtex5 with PPC440
 RAM 640MB, Flash 64MB
 Also monitor card employing the same digital part ADC 14bit, 400Msps, 1.4GHz, x2

 Fabrication was carried at Mitsubishi Electric Tokki System<http://www-linac.kek.jp/cont/epics/mtca/>

Kazuro Furukawa, KEK, Oct.2011.

13

New LLRF Controller

Embedded LLRF Controller

RF Group
Mitsubishi Tokki

Kazuro Furukawa, KEK, Oct.2011.

14

Embedded LLRF Controller

RF Control Configuration

RF Controls

CAMAC and NIM modules
graduallyMicroTCA and PLC

Kazuro Furukawa, KEK, Oct.2011.

15

RF Control Configuration

Embedded LLRF Controller

Slow control with PLC
Embedded IOC

MPS with FPGA/PPC
(For cERL and STF)
Embedded IOC

Kazuro Furukawa, KEK, Oct.2011.

RF Control Configuration

Embedded LLRF Controller

Embedded EPICSMPS/Suzaku/atmark-techno
FPGA Virtex-4
PPC Linux-2.6
64MB, Ethernet
EPICS 3.14

PLC/F3RP61/Yokogawa
PowerPC 533MHz
Linux-2.6 PREEMPT_RT
128MB ram, Ethernet x2
PCI, USB, IEEE1394, Serial
EPICS 3.14
Kazuro Furukawa, KEK, Oct.2011.

17

Embedded LLRF Controller

RF Control Configuration

Control Architecture – EPICS Channel Access Everywhere
OPIGlobal Control
Network

Each system(SuperKEKB,cERL, STF)
has slightly
different
configuration

ChannelAccess (CA)MTCA
Vacuum etc
IOC / PLC

MPS
IOC / FPGA

CA on Backplane

AMC
LLRF
IOC / PPCAMC
LLRF
IOC / PPC

AMC
RF monitor
IOC / PPCFPGAFPGAFPGA
Kazuro Furukawa, KEK, Oct.2011.

18

Embedded LLRF Controller

RF Control Configuration

MicroTCA Management Capability
At the beginning, we will not depend on the shelf
management facility much
We will not depend on a CPU module !

Separately, redundant power supply, MCH, CPU,are evaluated, and redundant EPICS IOC will becombined

Kazuro Furukawa, KEK, Oct.2011.

19

Embedded LLRF Controller

RF Control Configuration

Control Architecture – future possibility
OPI

ChannelAccess (CA)

Vacuum etc
IOC / PLC

Redundant
IOC

MTCA
CPUCPUMPS
IOC / FPGA

CA on Backplane

AMC
LLRF
IOC / PPCAMC
LLRF
IOC / PPC

AMC
RF monitor
IOC / PPCFPGAFPGAFPGA
Kazuro Furukawa, KEK, Oct.2011.

20

Embedded LLRF Controller

Present Status and Further Development
Base hardware/software were evaluatedAnother PCB fabrication to remove patches

FPGA and EPICS (mostly SNL sequencer)
application programs are being evaluatedOperator interfaces via standard EPICS tools
EDM at first, moving towards CSSCommissioning in 2011-2012 for STF & cERL
Commissioning in 2014 for SuperKEKB
Kazuro Furukawa, KEK, Oct.2011.

21

Embedded LLRF Controller

Under Evaluation

RF Group

Preliminary I/Q control stability results
Much better than the specification
~0.022% in amplitude, ~0.016degree in phase

Kazuro Furukawa, KEK, Oct.2011.

22

Embedded LLRF Controller

Further Development
Application to beam instrumentation is planned
Monitor AMC (400Ms/s, 14bit, x2)

MicroTCA Physics Extension (MTCA.4)
Possible upgrade candidate

Comparison to ATCA at STF
Opensource Linux
Microblaze on FPGARedundant System
…
Kazuro Furukawa, KEK, Oct.2011.

23

Embedded LLRF Controller

Conclusion
As a natural consequence of several
developments at KEK,LLRF controller for MicroTCA
with Channel Access on the backplane

was developed
All components embed EPICS/IOC
μTCA FPGA controller, PLC controller, MPS controller

Performance is excellent
It is being applied for SuperKEKB, cERL, andSTF at KEK
Kazuro Furukawa, KEK, Oct.2011.

24

Embedded LLRF Controller

Mt. Tsukuba

Thank you
SuperKEKB
dual rings

STF
cERL
Linac

Kazuro Furukawa, KEK, Oct.2011.

25

Embedded LLRF Controller

Thank you

Kazuro Furukawa, KEK, Oct.2011.

26