The 7th International Workshop on Accelerator Operation, April 12-16 2010, Daejeon, KOREA

2009
2008

2007
2006
2005
2004
2003
2002

Mikyung Park
KSTAR Research Center

1998

KSTAR

Korea Superconducting Tokamak Advanced Research

The 7th International Workshop on Accelerator Operation, April 12-16 2010, Daejeon, KOREA

Outlines
 Introduction of KSTAR Project Implementation of KSTAR Control

System Operational Result and Issues
 Summary2The 7th International Workshop on Accelerator Operation, April 12-16 2010, Daejeon, KOREA

1 KSTAR Project3

The 7th International Workshop on Accelerator Operation, April 12-16 2010, Daejeon, KOREA

4KSTAR Project ?
 KSTAR - Korea Superconducting Tokamak Advanced Research Missions -Development of a steady-state-capable advanced superconducting
tokamak to establish the scientific and technological base for an attractive
fusion reactor as a future energy source.
 History1995 : Project launched1998 : Construction started
2007 : Completion of Assembly2008 : Achievement of the 1st plasma
Major radius, R0 / Minor radius, aElongation,  / Triangularity, Plasma volume
Plasma surface area / cross section
Plasma shape
Plasma current, IP
Toroidal field, B0
Pulse length
N
Plasma fuelSuperconductor
Auxiliary heating /CD
Cryogenic

1.8 m / 0.5 m
2.0 / 0.8
17.8 m3
56 m2 / 1.6 m2
DN, SN
2.0 MA
3.5 T
300 s
~5.0
H, D-D
Nb3Sn, NbTi
~ 28 MW9 kW @4.5K

SEOUL

POHANGDAEJEONThe 7th International Workshop on Accelerator Operation, April 12-16 2010, Daejeon, KOREA

Fusion ?
 Fusion has the potential of providing an essentially inexhaustible

source of energy for the future.
 Via nuclear fusion, the low atomic number elements react to convert
mass to energy.
 Principal Fusion Reaction
1)
2)
3)
4)

D + D = 3He + n + 3.2MeV
D + D = T + p + 4MeV
D + T = 4He + n + 17.6MeV
D + 3He = 4He + p + 18.3MeV• D can be obtained from sea-water and T from 7Li and 6Li (quite abundant in nature).
• 3He can be found on the moon.
• D, Li and 4He are stable nuclei.

“The fusion of 1g of T(together with 2/3g of D) produces 1.6x105kW-hr of
thermal energy.”

5

The 7th International Workshop on Accelerator Operation, April 12-16 2010, Daejeon, KOREA

Tokamak & Ancillary Systems

6

The 7th International Workshop on Accelerator Operation, April 12-16 2010, Daejeon, KOREA

Long-term Plan of KSTAR
Last update : 2009.12.3

7

The 7th International Workshop on Accelerator Operation, April 12-16 2010, Daejeon, KOREAKSTAR Control System

8

The 7th International Workshop on Accelerator Operation, April 12-16 2010, Daejeon, KOREA

FeaturesMissions• Integrating all Plant System I&Cs for Tokamak Operation• Establishing the environment for Real-time F/B Control on plasma• Implementing Machine Interlock & Protection• Achievement of Synchronized Operation• Development of Schema for Sequential operationCommunication standard and software framework
EPICS (Experimental Physics and Industrial Control System)Using every possible Open-source Tools for development

Integration of Heterogeneous controllers: VME, VXI, cPCI, PXI, PCI, PLC, and cFP

About 15,000 I/Os and 45,000 PVs (integrated in EPICS)
About 800 experimental signal channels (managed by MDSplus)Using Five Different Optical Networks



Adopting Two Databases : EPICS Channel Archiver, MDSplus



Additional Databases for web_portal, signal DB and RDB (MSsql, Mysql)

The our control system is still growing and evolving !!

9The 7th International Workshop on Accelerator Operation, April 12-16 2010, Daejeon, KOREA

Features
2 Tier•Control --- Interlock+Safety

2 Layer•Central --- Local

Structure
Middleware

EPICS

OperatingsystemLinux•Plant monitoring & control

VxWorks•Feedback control

H/W
Platform

Slow control•PLC, cFP

Fast control•VME, PXI, cPCI, PCI, VXI, (ATCA)

MachineInterface(Networks)

OPI

EPICS CA

•Plant monitoring & control•Operational data transfer

Experimental Data MDSip•Shot-based data storing

Real-time

Shared-memory•Real-time feedback control

Interlock(ControlNet)•Machine interlock & protection

TimingHome-made protocol•Timing & synchronized operation

Qt (open source)

EPICS Channel Archiver
DataManagements
MDSplus•Home made•Low rate continuous operational data
•High rate shot-based experimental data

10

The 7th International Workshop on Accelerator Operation, April 12-16 2010, Daejeon, KOREA

11

Control System Architecture
Data Display

Client tools

PCS
Control/Display

Machine Controls

OPIs(Epics CA)

CA Viewer(Epics CA)

Supervisory/
Discharge Control

Supervisory
Interlock

AccessControl

OPIs(Epics CA)
Control Network(xxx.xx.100.xxx)

GPFS

Data Analysis
server(mdsip)

RDB
ServerStandbyserverSAN

CA Gateway

ChannelArchiver

MDSPlusServer•Main Storage System•Backup System•Permanent Backup(xxx.xx.101.xxx) M(xxx.xx.102.xxx) E

R
I
T

TMS/
GCDS

VMS/CLS/
HDS/GDC

HRS

Plant Systems / EPICS IOCs

PCS_DAQ

Heatings

Fueling

MPS

Synchronized Op.

Diagnostics

GEP/CWF

Sub-Interlock

The 7th International Workshop on Accelerator Operation, April 12-16 2010, Daejeon, KOREA

Plant Control System
ICRH System

He Distribution System

Main Control Room

12

The 7th International Workshop on Accelerator Operation, April 12-16 2010, Daejeon, KOREA

13

Plasma Diagnostic DAQ System
 50 types of Diagnostics / 21 diagnostics installed until 2009 (channels are increasing) MDSip / Experimental network : data stored to the MDSplus server/Central storage EPICS CA / Machine network : configuration, system status reporting, receiving of operation information
 Operated in synchronized manner using LTU (Local Timing Unit)
SystemChannels(Final)

Rogowski Coil3
Flux/Voltage Loop
45
Magnetic Field Probe
244 (512)
Diamagnetic Loop9
Saddle Loop
40
Vessel Current Monitor
3
Halo Current Monitor
15 (273)
Mirnov Coil
8 (72)
Fast Reciprocating Probe
5 (25)
Fixed Edge probe
6 (120)MMW Interferometer
8
ECE Radiometer
40
Edge Reflectometer
4
Resistive Bolometer
12
X-ray Crystal Spectrometer 1
Visible Survey Spectrometer
Visible Filterscope
H_alpha Monitor
30
Soft X-ray Array
2
Hard X-ray Array
80 (240)
Visible/H_alpha TV
3

DAQ
cPCI, max 200KHz
cPCI, max 200KHz
cPCI, max 200KHz
cPCI, max 200KHz
cPCI, max 200KHz
cPCI, max 200KHz
cPCI, max 200KHz
VXI, 1 ~ 10MHz
cPCI, max 200KHz
cPCI, max 200KHz
VME, max 200KHz
VME, max 200KHz
PXI, max 200MHzPXI, max 500KHz
PCI, max 10KHz, Window
PCI, max 100KHz, Window
PCI, max 100KHz, Window
VME, max 200KHz
PXI, max 250KHz
PCI, 10MHz, Window
PCI, Window

Passive diagnostics Active diagnostics
Charged particles
Neutral particles

Microwaves++ +Photon beams(Laser)NeutralParticle beams
Charged+ particle
beams

Photons(IR, Visible,
VUV, X-ray, etc)

ProbesMicrowaves

Physics Parameters• Plasma current• Loop voltage• Plasma shape & position• Temperature, density• Stored energy, impurities• Stability• confinement• Real-time measuring for feedback control

The 7th International Workshop on Accelerator Operation, April 12-16 2010, Daejeon, KOREA

Machine Interlock
 Structure• 1 Supervisory Interlock (Fully redundant system)• 10 sub-interlock systems for 28 Local controllers• About 300 I/O points (in the initial stage)
 Communication (ControlNet/duplicate)• Media: Optical Fiber/ coaxial• Method: star + daisy chain Assistant or Redundant Interlock• Plasma Current Fault protection• Direct Quench signal for Magnet Power Supply• SMS (Short Message Service)

Local
InterlockLevel Four Interlock levels• Level 1 : Fast discharge of TF current• Level 2 : Slow discharge of TF current• Level 3 : Experiment stop
fast discharge of PF current• Level 4 : Next shot inhibit• Warning

14

The 7th International Workshop on Accelerator Operation, April 12-16 2010, Daejeon, KOREA

15

Access Control System During Plasma Shot
• Red zone : no access• Green zone : controlled access Layout on the 2nd Floor

282

Controlled Door

280

Emergency Exit

: Warning Lights & Siren

In the Main Control RoomThe 7th International Workshop on Accelerator Operation, April 12-16 2010, Daejeon, KOREA

16

Radiation Monitoring System
GroupsMeasurements

Detectors

Gamma

Ionization Chamber

neutron

He-3

ARM1

Gamma

Ionization Chamber

ARM3

Gamma

Ionization Chamber

Gamma

Siliconneutron

He-3

Gamma

Siliconneutron

He-3

STA1(exhaust)

Particle(α,β)

Ionization Chamber

Gas(α,β)Double Silicon

STA2(exhaust)

Particle(α,β)

Ionization Chamber

Gas(α,β)Double Silicon

Gamma

Siliconneutron

He-3

Gamma

Siliconneutron

He-3

Gamma

Siliconneutron

He-3

Room
ARM2

STA1

ARM4

ARM3

ARM4
ARM5

ARM1
ARM5
(B2)

ARM2

Environmental
STA2
(B1)

ERM1
(200m)
ERM2(100m)
ERM3(300m)

The 7th International Workshop on Accelerator Operation, April 12-16 2010, Daejeon, KOREA

17

Infrastructure Main Control Room
• Operator’s area : 24 operator’s seats, Display wall containing 12 DLP cubes, 5 aux. displays
E-stop buttons, access key-box, portable H.323, web-cam for web service, audio, ..
• Equipment room : mainframes of OPI servers, CCS, Central timing, SIS, PSI, RMS, a node of PCS, ..
• Meeting room : H.323, audio, project, etc….
• Plan : enlargement of MCR, construction of remote OP room for KSTAR and ITER

 Storage system• Main storage : IBM DS 8100, 14TB
• Disc Backup Storage : EMC, 6.5TB, temporary backup• Tape Backup Library : IBM TS3500, 110TB, permanent backup
 Shared file system : GPFS v.3.2.1 (IBM) Network : 2 backbones, 11 workgroup SW, multi-mode fiber-optic, star-topology
 Servers : Gateway, Data archiving, Data analysis, Computing, Relational DB, Web_portal, Standby, etc

The 7th International Workshop on Accelerator Operation, April 12-16 2010, Daejeon, KOREA

Data Visualization
 Operator Interface•Developed panels : 154 first the 1st campaign•Development tool : Qt 4.3.1 Open source tool
 Data Visualization•Run-time Data Display : SinglePlot, MultiPlot•Experimental data display : jScope, Rtscope, Reviewplus,
IDL/Matlab applications

18

The 7th International Workshop on Accelerator Operation, April 12-16 2010, Daejeon, KOREA

19

Experiments Information Services
Web_portal

Proposal Application
Frame data

EFIT movie

e-Logbook

Shot Summary

Plasma movie

The 7th International Workshop on Accelerator Operation, April 12-16 2010, Daejeon, KOREA

Operational Results and Issues

20

The 7th International Workshop on Accelerator Operation, April 12-16 2010, Daejeon, KOREA

Operation Mode and Access Control
 6 Long-term Operation Stages
Vacuum pumping – Cool down – Magnet test – Plasma Experiment– Warm up – Maintenance Daily Operation
Search – Readiness check – TF on – Reference shot – Plasma shot –TF Off21

The 7th International Workshop on Accelerator Operation, April 12-16 2010, Daejeon, KOREA

22

Experiment(Shot) Sequence
Prepare for Next
Shot

Create Next Shot #T0Readiness
check?

Sequential Operation
Controlled by PCSTiming & parameter
set
PF On
Parameter
set DONE?

PF Off

PFPS
current=0?

Timing generation

Data transfer@T0 – 2min.
Lock

Create MDStree

Start of shot

@T0

End of shot

•Lockout•PF PS Standby -> Run•PCS Standby

Start of sequence@T0 – 1min.

Calculation

Post activity

End of sequence•Data auto-display•Shot-result upload•Shot summary create ..

The 7th International Workshop on Accelerator Operation, April 12-16 2010, Daejeon, KOREA

nd

Operation of the 223

Campaign in 2009

 Operation Period : 08/10 2009 ~ 12/28 2009 [~ 5 months]
Magnet test
(20days)
10/8

Baking & C.
(15days)

Plasma Exp.
(36days)
10/28

Cooled-Down (93days)
9/1

12/3

Warm-Up(15days)

Vacuum Operation (141days)
8/10

12/28

 Plant Control and Diagnostic DAQ systems• 2008 : 27 systems with 17911 Processing Variables (PVs)• 2009 : 37 systems with 45375 PVs

 Total Experimental Shots including vacuum shot and plasma shot• 2008 : 1 - 1283 shot (1283 shots)• 2009 : 1284 - 2342 shot (1059 shots) Plasma Experimental Data (MDSplus data)• 2008 : 211.904GB• 2009 : 479GB (due to the expansion of diagnostic channels)

 Plant Operational Data (EPICS data)• 2008 : 1143GB /8365 PVs (13 Archive engines)• 2009 : 389GB /4886 PVs (11 Archive engines)(optimization in # of signals & archiving rate)

The 7th International Workshop on Accelerator Operation, April 12-16 2010, Daejeon, KOREA

Experimental Results

24

The 7th International Workshop on Accelerator Operation, April 12-16 2010, Daejeon, KOREA

Operational Results in 2009
 Analysis of Faults
CausesOccurrence

Consequences

Operator’s errors

46

Plant Control Faults

18

Servers Faults

7

Stop the plasma shots
Fain in operation monitoring
Fail in synchronized operation
Fail in data monitoring & archiving

Diagnostic DAQ Faults

5

Fail in Data acquisition

Diagnostic DAQ Fault (7%)
Servers Fault (9%)
Plant Control Fault (24%)• CCS RT violation fault• CLS_HCS communication error• TMS IOC down
• Fuel_DAQ fault• ECH sequence error• ECH synchronization fail

• CA gateway down
• MDSplus server down
• Archiver server down

Operator’s errors(61%)

 Results
1. Upgrades and modifications conducted to enhance the performance andstabilities by solving the problems occurred during the 1st operation
2. NOT serious faults to effect on the plasma experiments
3. Major faults caused by operator’s errors in violating the operationalsequences and making mistakes in system configurations

25

The 7th International Workshop on Accelerator Operation, April 12-16 2010, Daejeon, KOREA

Summary

26

The 7th International Workshop on Accelerator Operation, April 12-16 2010, Daejeon, KOREA

Summary
 KSTAR is the first tokamak to adopt EPICS fully for thecontrol system.
 KSTAR integrated control system has performed its
missions successfully during the last two campaigns.
 Therefore, KSTAR control system is becoming a new
standard in tokamak control because ITER decided to use
EPICS after verifying its performance in KSTAR.
 Next consideration in the operation is to increase theavailability of machine.
• Human error became the major source of machineinterrupt.
• Besides the training of operators or practical
documentation, the robustness & automation must be
achieved in the control systems.

27

The 7th International Workshop on Accelerator Operation, April 12-16 2010, Daejeon, KOREA

Near-term Plan to Support Operation
 Expanding the control system to cope with newly installed plant &diagnostic systems
 Enhancing stability and availability of control system: Non-interrupt Operation of KSTAR• Redundancy : Hardware, EPICS IOC, Applications• Self-Protection logics implemented into each control system against
unintended actions such as sequence violation, operator’s errors, etc• Document the procedures for operation practically and intimately
 Improving the management of control systems• Update the guideline for control system development• Improve the environment for run-time monitoring & configuration ofcontrol system
 Establishing the environment for remote participating in KSTAR
experiments and operations outside KSTAR• Enhance the security of access to KSTAR• Development a tool for remote operation
 Setting to R&D work for longer pulse operation in the future

28

The 7th International Workshop on Accelerator Operation, April 12-16 2010, Daejeon, KOREA

29

On the date of the first plasma target achievement (Jun. 13, 2008)