New activities/challenges of fundamental research in Bay Area.

August. 2023
NTT Research, Inc.
https://ntt-research.com

NTT Research, Inc. at glance
Established: Apr. 2019
Shareholder: 100% subsidiary of NTT Holdings Company
Our mission:
・Focus on Basic Research related Quantum Computing, Cryptography,
Block chain & Medical Informatics
・Grow NTT brands by original technologies in Worldwide

President & CEO
Kazuhiro Gomi

Research Partners

Number of Members: Jul. 2023:
・Researchers 48
44 has Ph.D. degree 2 has M.D.
Footprints:・Headquarters: Sunnyvale, CA, U.S.A・ Branch:
Munich, Germany
Research Partners:・Universities: 11 US, 1 Canada , 1 Germany,
1 Australia, 1 Japan・2 National Research Center (US, Japan)

Footprints

1Position of NTT Research, Inc.
President & CEO
Kazu h iro G o m i
持株会社
N T T 研究所

NTT東日本NTT西日本Distinguished Scientist:
Prof. Robert L. Byer
Applied Physics,
Stanford University

PHI Labs(Physics & informatics)

Director: Yoshihisa Yamamoto

Quantum Comp.

Researcher 23 (incl. Director) 23 Ph.D. • 4 Professors

CIS Labs(Cryptography &Information Security)
Director: Brent Waters

Cryptography,
Block Chain

Researcher 17(incl. Director)

MEI Labs (Medical &Healthcare informatics)
Director: Joe Alexander,NTT DATA
Inc. (Global)

NTT DATAJapan

17 Ph.D. • 8 Professors

Distinguished Scientist:
Dr. Jon Peterson
Ph.D.: BiomedicalEngineering, Johns Hopkins
UniversityBio Digital Twin Researcher 7 (incl. Director) 3 Ph.D. • 2 MD • 1 Professor
COO/CTO
Hideaki Ozawa

Staff

VP Strategy
Takashi Goto

VP Marketing
Chris Shaw

MEI Lab – Bio Digital Twin
§ A bio digital twin is ultimately a virtual representation (an electronic replica) of an individual3

Towards closed loop therapeutic system
Cardiovascular Drug Delivery System
Cardiac Medications withDifferent Effects

Prediction
CV BioDT
DrivenTreatment

Operation
Cardiac
Patient

Bio Digital Twin
High Performance
Computing like as
Quantum Computing

Autonomous
Drug Drug
Computer-Controlled
delivery Delivery
actuatorDevice

Analytics

Securitytechnologies

Vital Sensing

Monitoring Patient Response
To Drug Therapy

Input Desired Target Patient Response To Drug Therapy(e.g., Blood Pressure, Cardiac Output)

Omics,Genome

Behavior log(Lifestyle etc.)
4 4Otto: Cardiovascular Bio Digital Twin (CV BDT)• The prototype of CV BDT was developed based on hemodynamic model (Otto) which models blood circulation and simulation
scenario of the response of the system to treatment such as medication.
• In Otto, the mechanism of the circulator is represented by an electrical circuit model. In terms of the relationship between bloodvessels and the heart, the heart is a pump or a battery that pushes out electrical current in electrical circuitry, and blood vessels
are electrical wires in electrical circuitry. In addition, factors such as whether a blood vessel is hardened due to arteriosclerosis orwhether there is a narrow place in the blood vessel due to plaque accumulation are represented by the resistance value. So far, wehave built computer simulated model based on the Bayesian Network that can simulate parameters representing individual
circulatory differences and changes in conditions that occur during treatment such as medication for acute heart failure or
myocardial infarction.
• In the future, we will add simulation functions for organs related to circulatory organs, such as the autonomic nerve, which plays
an important role in keeping blood pressure constant, and the kidney (which regulates blood flow), and then verify theeffectiveness of the bio-digital twin by animal experiments.
Left atrium and left ventricle

Otto's circuit model
aortaorgans

vena cava
Status of blood pressure

Status of blood flow

pulmonaryvein

Figure 1. Relationship between circulator andelectric circuit representation

state of heart
movementlungpulmonary right atrium and rightventricle
arteryFigure 2. Simulation Results

A method for optimizing the infusion of drugs for acute heart failure• This study aims to automate drug treatment for acute heart failure by using simulation methods to select the most appropriate
combination of drugs and to develop a method that can deliver the most appropriate dose of medication to conventional
physicians based on their experience and guidelines.
• The goal of treatment is to normalize the overall circulation of blood by simultaneously achieving multiple goals, such as whether
the patient's blood pressure is within a certain level and whether the heart is pushing blood below the lower limit.
• It is now possible to construct a model called the Drug Library, which expresses how the effects of drugs contribute to theresistance and capacitor values of the Bio Digital Twin, and simulate the medication situation with the CV Bio Digital Twin.
• The combination and dosage of drugs were optimized for 5600 patients including 3 patient conditions (Figure 1-II, III, IVConditions). The combination of drugs selected met the treatment guidelines, and the dosage of each drug could be determined
in detail (Fig. 2). The system also supports the physician's decision to switch to a different treatment plan early to pre-identify patients
who cannot be treated with drugs by simulation. Based on this result, we will conduct animal experiments to verify whether the proposed
method is effective for treatment.
III Patients with
II Patients with

infusionHigh (warm)

diuretic

IV Patients withcold and wet
conditions

cold and dry
conditions

warm and humid
conditions

vasodilator
MI: mortality < 3% 1III

MI: Mortality rate 9% 1

2.2

Low (cold)

blood pressure
vasopressor

Warm dryCardiac output [L/min/m2]𝐶𝐼

contraction
enhancer

Warm and Wet

Cold DryIII

MI: Mortality 23% 1iV

cold Wet

MI: Mortality 51% 1
18Normal lung (dry)Pulmonary edema (wet)Left atrial pressure (mmHg)𝑃!"

Figure 2. Drug treatment strategies recommended byclinical guidelines

II and III
Concomitant
use of drugs
Mechanicalsupportonen

han

cing

drugsrs sis o to r
ct
e s ila
rt ar
p dn
so so
Co
Va Va

s f ictan
Tr iounresu dicont

r

ac

ti

on

hangc indrses
pr rosov a ila toordsvaen

It has been automatically determinedthat these two drugs should not beadministered.

ugfin

usiodineurt icncotract ioen-nhvava

ansogc ine
prdso

drssilatug

ororfinus

ionu
diret ic

A treatment consistent withthe guidelines was selected.

Figure 3. Results of the calculation of themedication to minimize the total dose6

Towards closed loop therapeutic system
Cardiovascular Drug Delivery System
Cardiac Medications withDifferent Effects

Prediction
CV BioDT
DrivenTreatment

Operation
Cardiac
Patient

Bio Digital Twin
High Performance
Computing like as
Quantum Computing

AutonomousDrug Drug
Computer-Controlled
delivery Delivery
actuatorDevice

AnalyticsSecuritytechnologies

Vital Sensing

Monitoring Patient Response
To Drug Therapy

Input Desired Target Patient Response To Drug Therapy(e.g., Blood Pressure, Cardiac Output)

Omics,Genome

Behavior log(Lifestyle etc.)
7 7

Overview of Quantum Computing Research
MaxSAT, Drug discovery, Sparce Coding(Combinatorial Optimization Problem)

Brain or Artificial Intelligence research(Machine Learning)

Target applications
Algorithm/Computing methods for Isingmachine etc.

Analog Computing mechanism

Algorithm/mechanism
Optical computing platform

Device Research

MVM by optical computing etc.

TFLN based silicon photonics

Theory of Coherent Ising Machine
8Quantum Computing
・PHI Labs. tackle to develop Annealing based quantum computer using Quantum behavior of photon.
・Annealing of Quantum behavior can be simulated on current digital computing technology. We tackle todevelop implementation of CIM on FPGA/GPU as CyberCIM
Annealing- Coherent Ising Machine Approach

Quantum inspired digital
implementation

Applications

Organization

Quantum behavior

Combinatorial optimization

CyberCIMTOSHIBA

Quantum Gate
Quantum gate
General purpose

CIM

Merit

Reliability by stablehardware

Robust against noise and gate error

Transparent physics and establishedtheoretical limit

DemeritResource hanging

Complicated physics; theoretical limit
unknown

Sensitive to noise and gate errors

Time toCommercial

Shortly in a few years

Shorter than Quantum Gate
implementation

Still very long9

Combinatorial Optimization and Machine Learning
https://ja.storyblocks.com/stockimage/smart-city-and-wirelesscommunication-network-abstract-imagevisual-internet-of-things-mono-blue-tone-roiwpowejgj044z2ev

Structure Based Virtual Screening (SBVS) for discovery ofn Lead optimization(drug discovery)n Peptide drugn Biocatalyst

Resource optimization inn Wireless communicationn Logistics
n Schedulingn Portfolio management

https://iartificial.net/redesneuronales-desde-cero-iintroduccion/
https://ja.wikipedia.org/wiki

Sparse estimate in compressed sensing forn Astronomyn Magnetic Resonance Imaging (MRI)n Computed Tomography (CT)

Learning and synaptic pruning in deep neural network forn Voice and image recognitionn Self-driving carsn Healthcare, Finance10Research area and team・Research of QAOA(Quantum Approximate Optimization Algorithm) is added as new topic. QAOA is an algorithm for
combinatorial optimization to use Gate typed Quantum Computer. This is a theoretical research.
One of collaborator is Prof. Peter Shor at MIT who is well known as the Shor Algorithm for integer factorization
・Notre Dame University and Tokyo Tech joined to the collaboration team for CIM

Prof. Peter Shor

Notre Dame
Waterloo

COLLABORATIONS
for QAOA

University of Chicago

NTT Basic ResearchLaboratories (NTT-BRL)
NTT Software Innovation
Laboratories (NTT-SIC)
NTT Communication
Science Laboratories(NTT-CSL)NTT Research, Inc (NTT-RI)
PHI Labs

HarvardCOLLABORATIONS
for CIM

FUND, $10M(For 5 years）

Tokyo Tech

MEI Labs11

CIM Research direction
1. Theoretical research : Understanding performance limitation of Coherent Ising
Machine2. Hardware improvements: More spins, stable machine.
3. Explore practical applications:
CIM simulator(FPGA/GPU implementation)

Optical based vector
matrix multiplier

All OpticalArchitecture

Closed loop CIM
TFLN based optical memory
or processing unit

Original CIM
2021

2025-2030
12

Artificial Intelligence Research in NTT Research••

In the course of research aimed at realizing CIM, technologies applicable to artificial intelligence are emerging.
1)Increase the reliability of current AI that is too complex to explain its behavior (make AI Trusted)
2)Achieve drastic energy savings for digital circuit-based DNNs (Dep Neural Networks) that consume enormous amounts of electricity
Each research topic has been published in the world's top journals such as Nature/Science.

DNN Modelvv

Development of new
calculation principle bycomparing between biologicalbrain and DNN

In the biological brain, it is known that roles are divided by parts, and that there are certain
rules in the learning process. By applying these characteristics of the biological brain tolearning by AI, we are developing a research field called "the physics of knowledge" thatguides the rules of learning.
While modern AI greatly improves performance by learning with a huge amount of data, itcannot be ruled out that a behavior different from the original intention may occur. Inaddition, when such a wrong behavior occurs, there is no means to efficiently repair thewrong behavior. Therefore, the aim is to realize a safe and secure AI by understanding
which stage and method of learning can suppress or repair the unintended behavior byutilizing knowledge of psychology.

GPUCPU, etcØØ

Photonic LSItechnologies using TFLN

It is estimated that ChatGPT requires more than 10 MW of power to run 20 (1GWh in
One time when learning). DNN (Physical Neural Network), which is based on analog
technology, is a way to keep performance as an artificial intelligence and bring energy
requirements closer to the human brain. The PHI Institute has confirmed its basic
operation and is studying a scaling strategy.
By replacing the product sum operation, which accounts for most of the AI power
consumption, with an optical circuit, a drastic reduction in power consumption can berealized. Advancing this direction, we are conducting research aimed at replacing
GPUs with optical LSI-based systems. Specifically, we aim to realize optical LSI
manufacturing technology using TFLN(Thin Film Lithium Niobate) as a material.

Cornell
Research on Computational
Principles

Computation using analog
optical circuit

Research on System Architecture

Research on Optical LSI Platforms
13

PHI Labs Researchers
Myoung-Gyun Suh

Satoshi Kako

Senior Scientist

Deputy Director ofPHI Lab.

Ph.D. : Caltech

Ph.D. : Univ of Tokyo

Ryan Hamerly
Group HeadPh.D. : Stanford Univ.
Timothee Leleu
Group HeadPh.D. : Univ. of Tokyo
Faculty : Assoc. Prof. of U-Tokyo
Edwin Ng
Research Scientist
Ph.D. : Stanford Univ.
Gautam Reddy
NallamalaResearch Scientist
Ph.D. : UC San Diego
Yoshitaka Inui

Faculty: Assist Prof of U-Tokyo
Logan WrightResearch Scientist
Ph.D. : Cornell Univ.
Hideanori Tanaka
Group HeadRobert Byer
Distinguished Scientist.
Ph.D. : Stanford Univ.
Faculty: Prof. of Stanford Univ.
Yoshihisa Yamamoto
Director of PHI Lab.
Ph.D. : Univ of Tokyo
Faculty: Prof. of Stanford Univ.

Michael D. Fraser
Group Head
Ph.D. : The Australian
National University(AU)Adil Gangat
Senior Scientist
Ph.D. : Univ. ofQueensland(AU)Tatsuhiro Onodera
Research Scientist

Ph.D. : Harvard Univ.

Thibault Chervy

Marc Jankowski

Ph.D. : Univ. ofStrasbourg(FR)Tim McKenna

Jess Riedel

Ph.D. : Stanford Univ.

Research Scientist
Ph.D. : Stanford Univ.
Etienne Lorchat
Post-Doctoral Fellow
Ph.D. : Univ. ofStrasbourg(FR)Research Scientist

Ryotatsu Yanagimoto
Post-Doctoral Fellow

Ph.D. : Kyoto Univ.

Ph.D. : Stanford Univ.

Group HeadGroup Head
Ph.D. : UC Santa Barbara

Ph.D. : Stanford Univ.

Principal Scientist

Sho Sugiura
Senior Scientist
Ph.D. : Univ. of Tokyo

Sina Zeytinoglu
Post-Doctoral Fellow
Ph.D. : ETH

Maya Okawa
Research Scientist
Ph.D.: Kyoto Univ.

14

CIS Lab: Research Direction•CIS Labs. tackle to develop algorthm of advanced cryptography for below 3 criteria
1. Conventional encryption can provide one cipher key and one decipher key. CIS Labs tackle todevelop more flexible theory of Cryptography. Such as, multiple type of decipher key for
purpose of using encrypted data, or statical functions without decipher operation
2. Decentralized key management or Distributed encryption data storage
3. Post Quantum cryptography. It is not only measures for conventional cryptography in Quantum
computing era. We tackle brand-new theory of cryptography using Quantum information like as
Quantum money too

Quantum cryptography

Post Quantum

Multi Authority
Attribute-based Encryption

Distributed

Keymanagement

Post Quantum
Post Quantum Multi party Computation
Attribute-based Encryption
Block Chain
Multi party Computation

Secretsharing

Attribute-based Encryption

obfuscation
Functional Encryption

Homomorphic
Conventional encryptions; Encryption
I.e. RSA, AES

Centralized

Added Functionality or
Flexibility15

Attribute-based Encryption (ABE): Business development
What is ABE: Invented by Brent Waters several years ago. This technology realizes “Access control at Data Layer”, which iscommonly required in IOT implementations. NTT Research Inc. recognizes this technology as byproduct ofour R&D, which is ready for market implementation.
IP ownership: NTT Research Inc. now owns key 5 patents, and related software libraries. NTT OpCo can use all of them.
Current status:• Demo system created (with the help from NTT Data Italy) to start business based discussions.
• To be first implemented at the smart-university project in NSW (Australia) led by NTT Ltd. in Australia.
Base Data (Encrypted)

Decryption Key (for Clinical Team)

Decryption Key (for Finance team)

Date

Name

Age

GenderClinical Data

Paid

Apr 1

John

45

M

340

Yes

Apr 2

Mary22F450

No

Date

Name

Age

GenderClinical Data

Paid

Date

Name

Age

GenderClinical Data

Paid

Jun 3

Bob50

M

1000

NoApr 1

John45M

340

Yes

Apr 1

John

45

M

340

Yes

Jul 5

Alice16F400

No

Apr 2

Mary22F450

No

Apr 2

Mary22F450

NoAug 6Paolo30

M300

Yes

Jun 3Bob50

M1000

NoJun 3

Bob50

M1000NoJul 5Alice16F400

NoJul 5Alice16F400

No

Aug 6Paolo

30

M300

Yes

Aug 6Paolo

30

M300

Yes

ABE
Attribute Based
Encryption

Encryption

Access Controlat Data Layer

Clinical Analysis

Financial Analysis

16CIS Lab: = World leading crypto teamBrent Waters§Simons Investigators Award 2019 from Simon
Foundation§

IACR Test-of-Time Award 2020 from IACR§

Best Paper Award on Crypto 2020 from IACR§

Best Paper Award on Crypto 2022 from IACR

§IACR Test-of-Time Award 2023 from IACR

Mark Zhandry§

Best Paper Award on EuroCrypt 2019 from IACR§

Best Paper Award on AsiaCrypt 2022 from IACR

Daniel Wichs§

Number of publications at the top international crypto conferences
Organization

Crypto2023

EuroCrypt2023

Crypto2022

EuroCrypt
2022

NTT CIS Lab(NTT Total)

14(15)

14 (17)17(22)

9(12)10365454442
923441324
3
1

3
1
6
3
0
4
3

Berkeley
Cornell
UCLACNRS
MicrosoftIBM
GoogleBest Paper Award on STOC 2023 from ACM

17

CIS Lab researchers
Brent Waters

Daniel Wichs

Vipul Goyal

Go Yamamoto

DIRECTOR
Ph.D.: Princeton Univ.
Faculty: Professor at
University of Texas at Austin

SENIOR SCIENTISTPh.D.: New York Univ.
Faculty: Assoc. Prof. at
Northeastern Univ.

SENIOR SCIENTISTPh.D.: UCLA
Faculty: Assoc. Prof. atCarnegie Melon Univ.

SENIOR SCIENTIST
Ph.D.: Univ. of Tokyo

Hoeteck WeeSanjam Garg

Elette Boyle

Arka Choudhuri

SENIOR SCIENTISTPh.D.: UC Berkeley
CNRS Senior Researcher at
ENS, ParisSENIOR SCIENTISTPh.D.: UCLA
Faculty: Assoc. Prof. at
UC Berkeley

SENIOR SCIENTIST
Ph.D.: MIT
Faculty: Assoc. Prof. at
Reichman Univ., Israel

Post-Doctoral Fellow

Mark Zhandry

Ilan Komargodski

Justin HolmgrenAarushi Goel

SENIOR SCIENTISTPh.D.: Stanford Univ.
Faculty: Assist. Prof. atPrinceton University

SCIENTIST
Ph.D.: The Weizmann
Institute of Science

SCIENTIST
Ph.D.: MITPOSTDOCTORAL FELLOW

Pratish Datta

Susumu Kiyoshima

Sri AravindaKrishnan

Chen-Da Liu Zhang

SCIENTIST
Ph.D.: IIT Kharagpur

SCIENTIST
Ph.D.: Kyoto Univ.

Thyagarajan

POSTDOCTORAL FELLOWPOSTDOCTORAL FELLOW

Ph.D.: ETH

Ph.D.: Johns Hopkins
Univ.

Ph.D.: Johns Hopkins
Univ.

Ph.D.: FAU Erlangen-Nürnberg(Germany)

18Summer Internship program• NTT Research, Inc. conducts internships mainly for doctoral students.
• More than 30 students from PHI and CIS laboratories participated in the summer internship program in 2023. (Mainlystudents from graduate schools in the United States)• We welcome interns who can participate for five or six months, not only during the summer vacation.
• We are planning to hold interns in 2024, so we look forward to receiving applications from talented students.
• We will open the site of intership program for FY2024 at end of Jan. 2024.
• Recruitment Overview: Practical training at PHI Laboratory (quantum computer: Coherent Ising Machine research)• Eligibility: Graduate student in Physics, Computer Science, Applied Mathematics, Electrical Engineering, or related
technical field.
• Location: In principle, Sunnyvale. Depending on the theme of the training, the training may be conducted at a joint
research center in the U.S.
• Treatment: ・Salary provided for the duration of the internship period in accordance besed on our company policy
・Reimbursement provided for round-trip economy class tickets from Japan to US・Housing allowance will be subsidized base on our company policy・Application: Please access to the site below on Feb.

https://careers.ntt-research.com/phi19

Areas of internship program at the PHI Lab.
Examples of themes

Research overview

Location

Research on brain scienceand artificial brain(AI)Research that uses the superior properties ofbiological brains for artificial intelligence such as
DNNs

Sunnyvale, Boston(Harvard)

Applications for Isingmachines

Exploring applications suitable for CIM, developing
algorithms for quantum computers

Sunnyvale

Quantum Inspired Machine(Simulator)

Simulator for solving combinatorial optimization
problems at high speed on a digital computer

Sunnyvale

CIM hardware technology(Optical Technology)Research on optical technologies to improve CIM /Research on optical circuit technology using TFLN

Sunnyvale,Los Angels(Caltech),Ithaca(Cornell), Boston(MIT)

Quantum theory in CIM

Research on the theory inherent in NTT's quantum
computer CIM

Sunnyvale

Theoretical research ofQuantum Computer

Theoretical Study of Gate Quantum Computer andAnnealing Quantum Computer

Sunnyvale, Boston(MIT)2020

NTT One Vision Center• NTT Group global R&D Campus: NTT Research, Docomo Innovations• NTT Group West Cost campus ：NTT DATA, NTT Docomo, NTT Ltd., NTT-AT

San Francisco
International Airport

NTT One VisionCenterSan Jose Airport21

https://www.ntt-research.com

https://www.linkedin.com/company/ntt-research