Building Computers
for AI with RISC-V

June 2023

Tenstorrent builds computers for AI. Our mission is to address theopen-source compute demands for software 2.0 through industryleading AI/ML accelerators, high-performing RISC V-CPUs, andinfinitely-configurable ML and CPU Chiplets.

Confidential2

Tenstorrent• Founded in 2016
• $230M raised from Fidelity, Eclipse, Jim Keller and others• 280 employees in 5 offices: Toronto, Santa Clara, Austin, Belgrade, Bangalore• Team background: AMD, ARM, nVidia, Apple, Altera• Two ML chips - Grayskull and Wormhole - ready for production, working on third• Mid-way through the design of a high performance RISCV core

Confidential3Tenstorrent CEO Jim Keller
Jim Keller is the CEO of Tenstorrent and a veteranhardware engineer.
Prior to joining Tenstorrent, he served two years as Senior Vice
President of Intel's Silicon Engineering Group. He has held roles as
Tesla's Vice President of Autopilot and Low Voltage Hardware,
Corporate Vice President and Chief Cores Architect at AMD, andVice President of Engineering and Chief Architect at P.A. Semi, which
was acquired by Apple.
Jim has led multiple successful silicon designs over the decades,from the DEC Alpha processors, to AMD K7/K8/K12, HyperTransport
and the AMD Zen family, the Apple A4/A5 processors, and Telsa's
self-driving car chip.

Confidential

Tenstorrent Executive TeamJim Keller

David Bennett

Keith Witek

CEO: Digital Alpha
processor, Apple A
series, AMD Zen,
Tesla Autonomous
Driving system

Chief CPU Architect:
Apple, PA Semi, AMD

Chief Operating
Officer:
Google, Tesla, AMD

Matt Matina

Wei-han Lien

Jim Montanaro

VP Machine:
Learning
ARM

Chief CPU Architect:
Apple, PA Semi, AMDPD Fellow:
Apple, AMDDan Bailey

Srikanth Arekapudi

Yasuo Ishii

Senior Fellow:
Tesla, AMD,DEC

RTL/DV Fellow:
Cerebras, AMD

Architecture
Fellow: Arm, NECConfidential

5About Tenstorrent• Based in North America, with of4ces in Tokyo, Toronto,
Santa Clara, Austin, Belgrade, and Bengaluru.
• Tenstorrent builds the most innovative AI products:• Inference and Training, CNNs, LLMs, and NLPs
• Powerful software stacks for models & bare metal
programming• Tenstorrent created the highest performing RISC-V CPU
technology in the world• Led by industry veteran hardware engineer andCPU architect, CEO Jim Keller.

Confidential

6

Hardware Roadmap

HeterogenousChiplet

2021

2022

2023

Grayskull

Wormhole

Black Hole

QuasarGrendel

ML Processor

Networked MLProcessor

Standalone MLComputer

Low Power, Low
Cost ML Chiplet

Highly Configurable andPerformant ML Chiplet• 12nm, 276 TFLOP (FP8)• 12nm, 328 TFLOP (FP8)• 6nm• 200 GB/S Scale-out Ethernet• SiFive RISC-V X-280• Heterogenous compute2024• ML Chiplet• CPU + ML chiplets

Confidential

1

AI Solutions PortfolioCards
Available Now
e75 + e150 (Grayskull)➔ 75W-150W TDP➔ Up to120 x 1GHz Tensix cores➔ 8GB LPDDR4 RAM, 120MBSRAM➔ 246-295 TOPS
➔ Embedded,Workstations, Servers

Shipping Q3 2023
n150 + n300 (Wormhole)➔ 150W -300W TDP➔ 1.6 TB onboard Ethernet➔ Embedded,Workstations, Servers

Systems

GalaxyCloud

Shipping Q4 2023

Shipping Q4 2023

Available Now

Galaxy 4U➔ 32x Wormhole modules➔ 7 PetaOPS at BFP8
➔ 41.6 Tbps internal connectivity➔ 384GB of globally accessible
GDDR6 memory➔ 4GB SRAM
➔ 7kW per server➔ Configurable + Scalable
implementation

Cloud Compute in Colo
➔ Customers currently
utilizing self-serve cloudwith ability to deploy
API’s➔ Expanding model
support and scope in
mid-August➔ 20+ Galaxy systems inbuild to support broadcustomer base

T1000
➔ 1- 300W Card
➔ Up to 2TB RAM➔ Expansion slot for add-on cards➔ Edge Deployment Device

Shipping Q4 2023
T3000
➔ 2- 300W cards (configurable to 4)➔ Up to 4TB RAM➔ DT form factor, rackmount capable➔ Entry Data Center Technology witheasy installation

Confidential

Tenstorrent Software – Two Distinct Approaches

Buda: Run any
model right away
• Great for production
customers whowant to get models
up and running withease

BudaM: Open Accessto Tenstorrent
Hardware & Software•Low level hardware
access, more like
CUDA or Assembly•

Useful for HPC, C++environments andlow level Modeldevelopment•

Open SW stack for
3rd party compilers
and tools• Program in Pytorch,
Tensorflow, …
• Automaticcompilation andoptimization

Confidential

10Tenstorrent RISC-V O-o-O Processor Family
Performance

Higher Performance

Open & Free

8-Wide Decode
AscalonServer, Laptop, and HPC

6-Wide Decode
Client and Edge

4-Wide Decode
3-Wide Decode
4-Wide Decode
Sonic Boom with Vector

2-Wide Decode

Confidential

11Scalar Competition Landscape (SPEC2K17INT)
Frequency (GHz)

SPEC2K17INT Rate 1
Amazon Graviton 1

Amazo n Gra viton 1
Amazo n Gra viton 2
Amazo n Gra viton 3 (p roje cte d)
AMD Na ple s
AMD Ro me
AMD Mil an
AMD Geno a/Berga mo
AMD Zen5 (Pro jecte d)Intel Xen on
Inte Sapp hire R ap id 84 80

2.06

Amazon Graviton 2

3.70

Amazon Graviton 3…

4.63

AMD Naples

4.30

AMD Rome

4.56

AMD Milan

1.9 SPECINT20 17 /GHz
2.2 SPECINT20 17 /GHz

5.91

AMD Genoa/Bergamo

6.80

0

AMD Zen5 (Projected)

1234525 030 0

8.84

NVIDIA Grace (Projected )Power Usage (TDP)

7.44

Intel Xenon

5.73

Sapphire Rapids 84 80…

Amazo n Gra viton 1
Amazo n Gra viton 2
Amazo n Gra viton 3 (p roje cte d)
AMD Na ple s
AMD Ro me
AMD Mil an
AMD Geno a/Berga mo
AMD Zen5 (Pro jecte d)Intel Xen on

7.45

1.9 SPECINT2 017/GHz

7.03

2.2 SPECINT2 017/GHz

8.14

0.00

Confidential

2.00

4.00

6.00

8.00

10.00

1.9 SPECINT20 17 /GHz
2.2 SPECINT20 17 /GHz050

10 015 020 012

Tenstorrent: Open Business Model• Tenstorrent works with partners to design,create, modify, optimize heterogenous designs• Key technology providers for wide spectrum ofproducts for our strategy partners• AI• CPUCPU

ChipletConfidential

IPWhitebox

13

Tenstorrent’s Offerings
ProductIP

ChipletChip

CardSystems

CloudRISC-V

AI AccConfidential

14

Why Tenstorrent is all in on RISC-V: Open and Customizable

Fully customizable / fullownership (you canbrand it how you want)

Add datatypes, combined
chiplets, or change the ISA(things x86 and ARM can’t)

Confidential

Optimize performancefor your specificworkloads

No crazy license
restrictions15

AI IP Partnership | Licensing Agreement: AI Accelerator

IP / Chiplet collaboration to power AI in LG’s
full product line

Global Attention

Chosun Media

Confidential

This collaboration is just a beginning.
Tenstorrent’s market leading AI andRISC-V CPU technologies will strengthen
SoC competitiveness of LG’s future
products while our long-time proven
video codec technology will help
Tenstorrent take control of data center
high-performance processor markets.
LG Corp CTO Byoung-hoon Kim

Thursday, July 6, 2023

17