II-9. Instrumentation

RIKEN Accel. Prog. Rep. 54 (2021)

RIKEN Accel. Prog. Rep. 54 (2021)

Computer server and network for HiCARI experiments
H. Baba,∗1 F. Browne,∗1 P. Doornenbal,∗1 B. Mauss,∗1 B. Moon,∗1 D. Suzuki,∗1 N. Aoi,∗2 S. Iwazaki,∗2A. Kohda,∗2 Y. Yamamoto,∗2 T. Koiwai,∗3,∗1 R. Taniuchi,∗4,∗1 and K. Wimmer∗5,∗1 for the HiCARI
Collaboration
The HiCARI project1) has been launched at the
RIKEN RIBF. To process signals from Ge detectors,
the GRETINA data acquisition system (DAQ)2) isadopted. 100 MHz digitizers acquire information on
the energy, timing, and pulse shapes of detectors andsend data to data processing nodes. For trackingtype Ge detectors, data processing nodes perform pulse
shape analysis (PSA) to obtain position information.
Finally, processed data are merged by the event builder
node and stored into a RAID storage system. For thisDAQ system, computer servers and network equipment
were newly installed. In addition, HOKUSAI SS3) isused as a near-online analysis environment. In this report, we describe the computer server and network for
the HiCARI experiment.
Table 1 lists the computer nodes. Five nodes of HP
ProLiant DL360 G10 (16 CPU cores) were newly installed. One node is for the event builder; three nodes(48 CPU cores in total) are for the PSA of a triple segmented tracking detector from LBNL Berkeley (LBNLP3), which has 111 signals in total; and the last one
is for the data process (DP) of Miniball and clover
detectors (152 signals in total). Since PSA is not applied for Miniball and clover detectors, the demand forCPU resources is small. However, owing to the limitation of the GRETINA DAQ software, the numberof processes per OS is limited. To optimize the allocation of CPU resources, four virtual machines (VM)
are launched using KVM.4) Three CPU cores are allocated to each VM, and four CPU cores are reserved
for the KVM host process. In addition, ten HP ProLiant DL380 G6 (8 CPU cores) were transported fromRCNP Osaka. Eight nodes (64 CPU cores in total) areused for the PSA of the RCNP quad-type segmented
tracking detector (RCNP Quad). One of them is used
for the DAQ controller, and the last one is reserved asTable 1. List of computer nodes.
FunctionDAQ Controller
Event Builder
PSA for LBNL P3
DP for Miniball/Clover
PSA for RCNP QuadSpare∗1∗2∗3∗4∗5ModelDL380 G6
DL360 G10
DL360 G10DL360 G10DL380 G6
DL380 G6Unit
113181RIKEN Nishina Center
RCNP, Osaka University
Department of Physics, University of Tokyo
Department of Physics, University of YorkIEM-CSIC

Core81648
16648L2 Switch
B2F
B3F
toRIBFDAQ
Network

L2 Switch

IOC
IOC
IOC
IOC
IOC
IOCIOCIOC ×16
DAQ Controller
PSA
PSA forfor LBNL
LBNL P3P3 ×3
DP for Miniball/Cloverto HOKUSAI SS
10 Gbps Ethernet
1 Gbps Ethernet
8 Gbps FC

Event Builder

PSAforPSA
for RCNP
RCNP QuadQuadPSA
PSA forfor RCNP
RCNP Quad
Quad ×8

FC-SAN Switch
RAIDFig. 1. Network diagram for HiCARI experiments.

a spare node.
A data analysis environment has been prepared in
HOKUSAI SS for RIBF experiments. HOKUSAI SS
is a private cloud system based on OpenStack.5) Asof January 2021, a total of 80 cores and a disk spaceof 100 TB has been secured, and it can be expanded
upon request. These resources are allocated not only
to the HiCARI project, but also to other experimentalprojects. In 2020, 64 cores out of 80 cores were tentatively allocated to the VM of HiCARI experiments.
From 2021, the resource allocation will be optimized
according to the usage.
The network diagram for the HiCARI experiment isshown in Fig. 1. Sixty digitizers are installed on theB2F, and sixteen CPU boards (called IOC) send data
to the PSA nodes. Processed data are merged by theevent builder and stored in the RAID system via an
8-Gbps fibre channel-storage area network (FC-SAN).
For now, a total of 160 TB of space has been preparedfor the HiCARI project, and 36 TB of data were acquired in 2020. These data were also transferred to theHOKUSAI SS through a 10-Gbps Ethernet connection
for near-online analysis.
In summary, the computer server and network equipment were set up for the HiCARI project. They worked
stably and successfully acquired data of seven experimental proposals. The equipment reported in this paper will be used for upcoming HiCARI experiments in2021.
References

1) K. Wimmer et al., in this report.
2) J. T. Anderson et al., IEEE NSS Conference Record 56,1751 (2007).
3) HOKUSAI SS, https://i.riken.jp/data-sci/ .
4) Kernel Virtual Machine (KVM), https://www.linux-kvm.
org/ .
5) OpenStack, https://www.openstack.org/ .

- 102 -1