JobManagement Slurm Light-weight Grid Computing for Small Group Use Cases Aiqiang Zhang, Qimin Zhou, Xu Deng, Benda Xu Department of Engineering Physics, Tsinghua University zhangaq19@mails.tsinghua.edu.cn CHEP, 4-8 November 2019 1. Introduction In modern physics experiments, data analysis need considerable computing capacity. While several largescale grid solutions exist, for example DiRAC (Distributed Infrastructure with Remote Agent Control) [1], there are few schemes devoted to solve the problem at small-scale. For the cases when light-weight grid computing is more desirable, our project provides a simple solution in connecting and managing the distributive computing resources of a small group. The components are all freely available as official Debian packages. [1] Fifield, Tom, et al. "Integration of cloud, grid and local cluster resources with DIRAC." Journal of Physics: Conference Series. Vol. 331. No. 6. IOP Publishing, 2011. [2] Juliusz Chroboczek. The Babel Routing Protocol. RFC 6126. Apr. 2011. doi: 10.17487/RFC6126. url: https://rfc-editor.org/rfc/rfc6126.txt. [3] ”Slurm Workload Manager”. 2019. Web. Oct 2019. https://slurm.schedmd.com/overview.html. [4] Ming Chen, Dean Hildebrand, Geoff Kuenning, Soujanya Shankaranarayana, Bharat Singh, and Erez Zadok. 2015. Newer Is Sometimes Better: An Evaluation of NFSv4.1. SIGMETRICS Perform. Eval. Rev. 43, 1 (June 2015), 165-176. DOI=http://dx.doi.org/10.1145/2796314.274584 2. Overview 2.1 Network: Overlay 2.2 Storage: NFS 2.3 JobManager: Slurm 3. Performance 4 Conclusions References Acknowledgements 5 Upcoming Research tinc and babel are installed in every nodes. network is fault-tolerated and has low latency. hosts in private network could be connected. NFS (Network File System) was developed to allow machines to mount a disk partition on a remote machine as if it were a local disk.[4] run NFS server on the storage sharing host run NFS client on the hosts which can mount the shared filesystem Slurm is an open source, fault-tolerant, and highly scalable cluster management and job scheduling system for large and small Linux clusters.[3] slurmd daemon runs on each computing node slurmctld daemon runs on management node Requirement: 1.distribute filesystem 2. job management 3. maintainable without support team limitation: 1. several hosts, number range 2~4 2. different hosts in private isolated network Network: Overlay Storage: NFS HOST1 HOST3 SLURMCTLD SLURMD HOST2 NFS client NFS server VFS(virtual File System) network 3.1 Network Performance 3.2 System Performance slurmctld slurmd slurmd ENVIRONMENT: • The system is setup with 2 hosts in different private network. • The NFS server and Slurm controller run on the same node. • Server CPU: 32 cores, Intel Xeon E5-2630 • Client CPU: 16 cores, Intel Xeon E5-620 Figure 6 shows a time cost comparison between local file copy and remote file copy. The different size of files cost different time to copy. Copying file use NFS need network transport, which leads to more time delay. Figure 7 shows an experiment to measure the data processing time using single core without Slurm, single core with Slurm, five cores with Slurm. In the experiment, the job is to process many waveform files (the waveform generated from PMT voltage readout). The NFS cost a lot of time in the whole system. It is faster to use Slurm on more cores than single core. A unified interface is achievable with a few available packages from popular GNU/Linux distributions. Compare NFS with other distribute filesystem. Find the best strategy to allocate jobs to reduce the delay from network. Compare performance with other grid solutions, such as DIRAC. This work is support by SRT (Student Research Training) of Tsinghua University. The whole project is mentored by Professor Benda Xu. Qimin Zhou and Xu Deng did the main part of this project with me. Figure 1: small scale group Figure 2: Concepts maps of our solution Figure 3: The overlay network Figure 7: Time d