AI Bridging Cloud Infrastructure “ABCI”
Tutorial (Preparation)
Digital Architecture Promotion Center
Department of Information Technology and Human Factors
National Institute of Advanced Industrial Science and Technology

CONTENTS⚫ Setup Client PC Environment•Windows: Using Windows Subsystem for Linux⚫ ABCI System Usage Procedure(Assuming you have already applied for and obtained an account)•

Access to the User Portal•••

Initial Login
Declaration for the Applicability of the Specific Categories
Features⚫ Generate public and private key pairs•••

Key generation with commands from TerminalKey generation with PuTTYgen
To convert keys generated by another tools for PuTTY⚫ Register a public key⚫ Log in to the ABCI system••

Log in from TerminalUsing PuTTY⚫ Reference Links SummarySetup Client PC Environment
Compute Node (V)・・・

Compute Node (V) × 1,088

・・・

NVIDIA V100 × 4,352

ABCI system

ABCI Cloud Storage

Compute Node (A)Access from the client PC
to ABCI system

・・・

Compute Node (A) × 120

・・・

・・・

NVIDIA V100 × 960

File System Estimated 47PB

The ABCI system consists of the following hardware and software.
• 1,088 nodes of Compute Nodes (V) with a total of 4,352 NVIDIA V100 GPU accelerators• 120 nodes of Compute Nodes (A) with a total of 960 NVIDIA A100 GPU accelerators• Approximately 47 PB of shared file system and ABCI cloud storage
Linux-based operating systems are used for these Compute nodes.
To run jobs on the Compute Nodes of the ABCI system, users access them via an access server.
Reference: ABCI 2.0 User Guide – ABCI System Overview

Setup Client PC Environment- In case of Windows PC Using Windows Subsystem for Linux (WSL)
to build an environment that runs Linux on Windows
WSL is a mechanism to run a Linux environment on Windows, allowing Linux commands and applications torun on Windows. However, since the installation procedure differs depending on the Windows version,please update your Windows to the latest version before installing WSL.
Please refer to the "Reference Links" below for detailed procedures. The main procedure is as follows.
(Tip: Some BIOS settings may be required depending on your PC to use the virtual machine functionality.)
1. Enable Windows subsystem for Linux.
2. Enable the "Virtual Machine Platform (Hyper-V)" optional feature.
3. Download and install Linux kernel package.
4. Download and install Ubuntu.
Reference Links:⚫ https://qiita.com/boss_ape/items/6f1e1f731b5385f4b31a⚫ https://qiita.com/fumikomatsu/items/01e5cfa09347176f4d1a⚫ https://chigusa-web.com/blog/wsl2-win11/

ABCI System Usage Procedure- Access to the User Portal Access to the “ABCI User Portal”, which manages various information in using
the ABCI system, to register, manage, and check necessary information.
The “ABCI User Portal" is a site that manages information required to use the ABCI System.
Before using the ABCI system, access the “ABCI User Portal" to register and confirm necessary information.
After accessing the “ABCI User Portal" and completing the necessary procedures, you will receive an e-mailwith a login URL.
① Access the “ABCI User Portal” with a browser.
② Enter your account name and pass the image authentication.

Image authentication screen(https://portal.abci.ai/user/?lang=en)③ The login URL will be sent to the registered e-mail address.

ABCI system④
User

Access the login URL in the e-mail sent to you.

⑤ Enter your ABCI system account name and password to log in.

ABCIUser Portal
User Portal login screen

ABCI System Usage Procedure- Initial login to the User Portal When you log in to the User Portal for the first time,agree to the Terms of Use and change from a temporary password.
－ Initial login to the User Portal －When you register to use the ABCI system, you will receive an e-mail containing your initial login URL,
temporary password, and account. Please access the "User Portal" from the URL for initial login, agree tothe Terms of Use, and change the temporary password.

① Access URL for initial login② Agree to the Terms of Use③ Change fromtemporary password
Reference: ABCI Portal Guide - 2. User Portal

ABCI System Usage Procedure- Declaration for the Applicability of the Specific Categories When you log in to the User Portal for the first time in each fiscal year, please
complete the “Declaration for the Applicability of Specific Categories”.
－ When logging in to the “User Portal” for the first time in each fiscal year －You will receive two E-mails containing a special password and the URL of the website for “Declaration for
the Applicability of Specific Category”.
Please access to the “User Portal” from the URL for declaration, log in with the temporary password sent toyou, and answer the questions displayed.

➢① Access to the URL for
declaration② Declaration for the Applicability ofSpecific Categories

Read the description of the “Applicability for
the Specific Categories” and confirm whether
you fall under the category or not.

Reference: ABCI Portal Guide – 2.1.1
Declaration for the Applicability ofSpecific Categories

ABCI System Usage Procedure- User Portal: When the URL for login has expired When the URL for login in the User Portal expires
please access "User Portal" again.
The login URL sent to you by e-mail has an expiration time.
If the URL has expired, please access the "User Portal" (https://portal.abci.ai/user/?lang=en) again,
Pass the image authentication and receive another e-mail with the login URL.
Enter your account name and temporary password on the User Portal login screen.
Dear ABCI user,
This mail was automatically sent by the ABCI system.
To login the ABCI system as Kataoka Satoshi, please visit the following URL:

https://portal.abci.ai/user/login.php?action=input_passwd&logon_url=xxxxxxxxxxxxxxxxxxxxxxxx
xxxxxxxxx....
Note: Please be aware that the validity period of this URL will expire on yyyy/mm/dd hh:MM.

Example: E-mail sent from “User Portal”

ABCI System Usage Procedure- User Portal: Features The "ABCI User Portal" allows you to manage users of the ABCI system,
add points, check history of additional/usage point,
and register public keys to connect to the ABCI system.
Upon logging in to the ABCI User Portal, you can view and manage information necessary for using the ABCI system.
For details on each function, please refer to "ABCI Portal Guide: 2. User Portal, 3. User Administrator Authority".
[Users]• Change / Reissue password• Register / Browse / Delete public key• List of Node reservation / cancellation• Usage History for ABCI Point• Cloud Storage Management[Requires Supervisory User or User Administrator
privileges]• Node reservation / cancellation• Details of Usage History for ABCI Point• Additional history for ABCI point additions• Group Management• Cloud Storage Management

See the groups andgroup members thatyou belong to ormanage.

(*Screens vary depending on the authority of the person who logged in)Reference: ABCI Portal Guide - 2. User Portal
3. User Administrator Authority

Necessary steps to connect to the ABCI system• Public and private key generation required for SSH public key authentication• Create tunneling and login by SSH port forwarding
Generation and registration of the "key" necessary for authentication and connection using SSH port
forwarding are required to connect to the ABCI system, since the SSH public key authentication method isused.
We will introduce the below two types of these procedures starting on the next page.
• Using a terminal• Using SSH client software (PuTTY is covered in this content)
It is not necessary to perform both types of procedures.
There are also other methods not introduced here.
Please use them according to your environment.

Generate public and private key pair

- Key generation with commands from Terminal Generate a public/private key pair using the "ssh-keygen" command in theterminal for SSH encrypted communication with the ABCI system.
To connect to the ABCI system, you will need an SSH client and a secure public/private key pair.
Available key pairs for ABCI are RSA keys (2048bit or higher), ECDSA keys (256bit, 384bit, or 521bit), and Ed25519 keys.
Example: Generate a public/private key pair with a terminal (Create a 4096-bit RSA key, add a comment with your e-mail address,and create the key in the /.ssh directory)
Substitute where "satoshi.kataoka@hanazono.com" with your own e-mail address.
Make a directory to put key and set permission
yourpc$ install -m 0700 -d ~/.ssh
yourpc$ cd ~/.ssh
Generate key with "ssh-keygen" command
yourpc$ ssh-keygen -t rsa -b 4096 -C ”satoshi.kataoka@hanazono.com" -f ~/.ssh/id_rsa
Generating public/private rsa key pair. Enter passphrase (empty for no passphrase):
Enter your passphrase (strongly recommended)
Enter same passphrase again:
Your identification has been saved in id_rsa.
Enter the passphrase again (strongly recommended)Your public key has been saved in id_rsa.pub.
yourpc$ ls ~/.ssh
Check that public/private keys have been generated
id_rsaid_rsa.pub
Reference: ABCI 2.0 User Guide – Getting Started ABCI Prerequisites

Generate public and private key pairs- Key generation with PuTTYgen Generate public/private keys with "PuTTYgen", a key generation tool for PuTTY
After installing PuTTY, start "PuTTYgen" from the Windows Start menu, and the "PuTTY Key Generator"
dialog box will appear. Generate keys from this dialog box. (The version of PuTTY is assumed to be “0.81”.)
Select the key type and press "Generate".

Save the key
Right-click to copy
the public key

Any comment canbe included
Any Passphrase
can be brought① For "Parameters", select "RSA", enter"4096" for "Number of bits ...", press"Generate".
(In this example, the key format is thesame as in the previous section.)② Move the mouse until the key
generation starts and thegreen progress bar fills up.

③ Enter a comment and passphrase, and press "SavePrivate Key" to save the private key.
Copy the public key by right-clicking with the mouse.
(This step is necessary for the public key registration on thenext step.)

Generate public and private key pairs- To convert keys generated by another tools for PuTTY If you have a public/private key generated by another tool and you want to continue to use thepublic key already registered with the host, you need to convert the private key for PuTTY.
Select the key type and press "Generate".

Save the key
Right-click to copy
the public key
Any comment canbe included

Note that the “Type”
field says just “File”.

Any Passphrase
can be brought① Launch “PuTTYgen” and go to“Conversions” → “Import key”
from the menu bar.

② Find the key pair you
created with another tooland select the private key.

③ Enter a comment and passphrase, and press "SavePrivate Key" to save the private key.
④ Copy the public key by right-clicking with the mouse.
(This step is necessary for the public key registration on thenext step.)➢Private keys created with standard Windows command tools are usually locatedin the “.ssh” folder directly under the “C:\Users\{username}” folder. “id_rsa” “file”.

➢If your public key is already registered, this step is
not necessary.

Register a public key
Register a public key generated in previous section to the “User Portal”
Copy a public key generated in previous section. Login to the “ABCI User Portal”, open “Register public key”
page, select “Direct Input”, paste into the rectangle space, and press [Register].
(If your public key is already registered, this step is not necessary.)
Generated by terminal: Show the generated key by cat command and copy.
yourpc$ cat ~/.ssh/id_rsa.pub
ssh-rsaabcdefghijklmnopqrstuvwxz1234567890ABCDEFGHI…………………
………………………………………………………………………………………………………………………………………
……………EhTBbCel satoshi.kataoka@hanazono.com
yourpc$Generated by “PuTTYgen”: After generate key, copy the public key from thedialog box.

Login to the “ABCI User Portal” and paste key in “Register public key”

①Open “Register public key”
② Select “Direct input”③ Paste the public key here

④ Press [Register]

Drag the public key, rightclick in selected area, andchoose “Copy”.

Log in to the ABCI system
To connect to an interactive node, which is the front end of ABCI, follow the steps below.
① Login to the access server using SSH public key and create a tunnel between the client PC and the interactive node.
② Login to the interactive node ( es or es-a ) through the SSH tunnel using SSH public key authentication.

ABCI system
Node (V)② Login to the interactive node
Log in to the interactive node of thenode type (V or A) you wish to use
through the tunnel・・・Interactive Node (V)es

SSH connection

・・・

Access Serveras.abci.ai

localhost① Login to the access server

Create a tunnel by SSH port forwarding*・・・

Interactive Node (A)es-a・・・

Compute Node (V)1,088 nodes
NVIDIA V100
4,352 unit

Compute Node (A)120 nodes
NVIDIA A100
960 units

Node (A)ABCI has two types of nodes, (V) and (A). Compute Node (V) and Compute Node (A) for Computenodes, es and es-a for Interactive nodes as well, each of these nodes are dedicated.

Log in to the ABCI system- Login from Terminal (1/2) Login to the access server via SSH and establish a route for port forwarding access from the client PC side to the interactive node.
例：アクセスサーバにアカウント”aaa12345xx”がSSHでログイン。
(*The
access to the interactive node uses port:22, but the client PC side uses a vacancy number such as port:10022).
クライアントPCのポート：10022へのアクセスをインタラクティブノードのポート：22へポートフォワーディングする経路を確立する
Client PC(port:10022 for localhost side)

Access Serveras.abci.ai

Route via portforwarding

Fire wall

Interactive Node es or es-a
(port:22 for remote host side)

SSH connection

Command ssh -L 10022:es:22 -l aaa12345xx as.abci.ai
syntax-L {port number to receive on Client PC}:{interactive node name to connect to}:{port number of interactive node} -l {ABCI account name} {access server name}Create a tunnel between the client PC andthe Access Server and port forwarding to
Example yourpc$ ssh -L 10022:es:22 -l aaa12345xx as.abci.ai
the Interactive Node.
The authenticity of host 'as.abci.ai (0.0.0.1)' can't be established.
RSA key fingerprint is XX:XX:XX:XX:XX:XX:XX:XX:XX:XX:XX:XX:XX:XX:XX:XX.
This message is shown only at first login.
Are you sure you want to continue connecting (yes/no)? yesType “yes” and [Enter].
Warning: Permanently added ‘XX.XX.XX.XX' (RSA) to the list of known hosts.
Enter passphrase for key '/home/username/.ssh/id_rsa':
Welcome to ABCI access server.
Please press any key if you disconnect this session.

Enter the "passphrase" you set.
After successful login, the message"Welcome to ABCI ..." is appeared.

Reference: ABCI 2.0 User Guide – Getting Started ABCI Login using an SSH ClientLog in to the ABCI system- Login from Terminal (2/2) Example: After establishing an SSH connection to the access server (as.abci.ai) and a port forwarding route,
open another terminal and login to the interactive node (es) from the configured localhost port:10022.
Client PC(port:10022 for localhost side)

Access Serveras.abci.ai

Route via portforwarding

Fire wall

Interactive Node es or es-a
(port:22 for remote host side)

SSH connection

Command ssh -p 10022 -l aaa12345xx localhostsyntax-p {port number to receive on client PC} -l {ABCI account name to login} {host name}ExampleLogin to Interactive Node es:22, port

yourpc$ ssh -p 10022 -l aaa12345xx localhost
forwarded from localhost:10022
The authenticity of host 'localhost (127.0.0.1)' can't be established. RSA key fingerprint isThis message is shown only at first login.
XX:XX:XX:XX:XX:XX:XX:XX:XX:XX:XX:XX:XX:XX:XX:XX.
Are you sure you want to continue connecting (yes/no)? yesType “yes” and [Enter].
Warning: Permanently added 'localhost' (RSA) to the list of known hosts.
Enter the "passphrase" you set.
Enter passphrase for key '/home/username/.ssh/id_rsa':
After successful login, the prompt is[username@es1 ~]$appeared.
Reference: ABCI 2.0 User Guide – Getting Started ABCI Login using an SSH ClientLog in to the ABCI system- Using PuTTY (1/6) ① Open PuTTY and set SSH tunnel parameters.

The set value will be appeared here.

① In the Category menu on the left side of the dialog box,
select “Connection” => “SSH” => “Tunnels”, then fill in the following values in the “SSH port forwarding” field on the right.
✓ Source port: 10022 (Specify a vacancy port number in your system)✓ Destination: es:22 or es-a:22✓ Choose “◉ Local”
After entering the setting values, press the [Add] button to reflect the setting values.
Reference： ABCI 2.0 User Guide ー Tips PuTTY

Log in to the ABCI system- Using PuTTY (2/6) ② Enter the SSH authentication information.

② - 1. In the Category menu on the left side of the dialog box,
select “Connection” => “SSH” => “Auth” => “Credentials”,
then specify the path to the private key in the “Public-keyauthentication” field.
✓ Private key file for authentication: Enter the path tothe private key.
✓ You can also select a file by pressing the [Browse]
button.

② - 2. Page “Session” in the Category menu on the left side andenter login parameters.
✓ Host Name (or IP address): as.abci.ai✓ Port: 22

Log in to the ABCI system- Using PuTTY (3/6) ③ Save and load the set parameters.

③ - 1. Name and save the settings entered so far.
Enter "as-es" in the "Saved Sessions" field and press the [Save] button to place it on the saved list.
2.

When you want to reuse the saved settings, select them from the save list and press the [Load] button to recall them.

Log in to the ABCI system- Using PuTTY (4/6) ④ Log in to the access server (as.abci.ai) and create an SSH tunnel.
Enter ABCI account name.
Enter the passphraseof the set private key.

After filling or loading the values,click [Open].

Note:
You must keep this login session while working
with ABCI.
Do not press any key on this screen, as it willclose the session.

④ - 1. After all values are entered or loaded, press the [Open] button.
2.
3.

When logging in for the first time, you will see the message in the center above and press the [Accept] button.
The access server login screen will be displayed, enter the following…

✓ "ABCI Account Name“✓ "Passphrase" of the private key
If the login is successful, “Welcome to ABCI Access Server” will be displayed.

Log in to the ABCI system- Using PuTTY (5/6) ⑤ Launch PuTTY in another window and configure the connection settings

Enter the same
SSH authentication
information as theaccess server⑤ - 1. In the Configuration dialog box of PuTTY launched inanother window, select “Connection” => “SSH” =>“Auth” => “Credentials” from the Category menu on
the left, then specify the path to the private key in the"Public-key authentication" field, in the same way as
for the access server.

⑤ - 2. Select "Session" from the Category menu on the left, enter
the login information for the Interactive Node.
✓ Host Name (or IP address): localhost✓ Port: 10022
Specify the port number set in the SSH Tunnel Information.
Enter the same SSH authentication information as theAccess server.
After entering the configuration parameters, save themagain as a name, e.g., "es-terminal".

Log in to the ABCI system- Using PuTTY (6/6) ⑥ Log in to the Interactive Node (es or es-a).
Enter ABCI account name.
Enter the passphraseof the set private key.
After successful login, operation
schedule, manuals, and QA contact
information are displayed.

After filling the values, click "Open".

⑥ - 1. After all values are entered or loaded, press the [Open] button.
2.
3.

When logging in for the first time, you will see the message in the center
above and press the [Accept] button.
The Interactive Node login screen will be displayed, enter the following…
✓ "ABCI Account Name“✓ "Passphrase" of the private key
If the login is successful, “Welcome to ABCI System” will be displayed.

Reference Links Summary• ABCI Official Website (https://abci.ai/)• ABCI 2.0 User Guide (https://docs.abci.ai/en/)
This guide explains the technical details of ABCI 2.0 and how to use it.
This content mainly introduces the "Connecting to Interactive Node" section in the "Getting Started ABCI" chapter of the User Guide.

• ABCI Portal Guide (https://docs.abci.ai/portal/en/)
A portal site for managing ABCI 2.0 users and other necessary information.

• Windows Subsystem for Linux (WSL)
Reference information on the environment settings required to use ABCI2.0 from Windows terminals.
Please refer to the latest information as it is updated from time to time on external sites.
•••

https://learn.microsoft.com/en-us/windows/wsl/install#manual-installation-steps
https://qiita.com/fumikomatsu/items/01e5cfa09347176f4d1a (Japanese)
https://chigusa-web.com/blog/wsl2-win11/ (Japanese)• About SSH client software PuTTY••

WinSCP (included PuTTYgen, https://winscp.net)
PuTTY (https://www.chiark.greenend.org.uk/~sgtatham/putty/latest.html)

https://abci.ai/