Safe Harbor Statement
The following is intended to outline our general product direction at this time. Thereis no obligation to update this presentation and the Company’s products anddirection are always subject to change. This presentation is intended for information
purposes only and may not be relied upon for any purchasing, partnership, or otherdecisions.

©2020 SambaNova Systems2

SambaNova
Systems IntroPC Cluster Consortium
Jan 20, 2022
Toshinori Kujiraoka
Country Sales Director

1/12/223

Brief BackgroundYesterday’s Goldilocks Zone is Constraining Progress

HW Performance

Existing architecture bottlenecks are hard to overcome

Transformer(Distilled)

Transformer

GPT, Zero,MoE

ResNet-50

True-res CVModels(Standard)

EfficientNet
VisualModels
Text Models

GPUBigger Models

Highly Detailed©2022 SambaNova Systems5

About SambaNova Systems
2017

Establishedthe company

ML/AI

Palo Alto

500+

Software-Defined
HardwareAustinLondon

HW/SW
AI Engineers

Rodrigo Liang
CEOKunle Olukotun
Professor EE/CS
Stanford University

Chris Ré

Professor CS
Stanford University©2022 SambaNova Systems Confidential | Do Not DistributeSambaNova Systems is the Best Funded AI Start-up

Over $1 Billion
Raised ThroughSeries D©2022 SambaNova Systems Confidential | Do Not Distribute7

Industry Awards and Recognition

2021©2022 SambaNova Systems Confidential | Do Not Distribute8

Why AI/ML, Why Now?

The Biggest Transformation in Business and Tech is Here

Scale-out
ComputingEmbedded Devices

Dataflow
Computing

Web
1998

Mobile
2008

AI
Now

Developer Driven

Consumer Driven

Machine & Data Driven©2022 SambaNova Systems Confidential | Do Not Distribute10

AI is a Software Problem - Models Are The New Code

Traditional (Software 1.0)

AI is all about DataFlow (Software 2.0)

• Written in code (C++, …)• Data -not code- trains the models• Written in the weights of a Neural Network• Fewer lines of code, greater productivity,
improved accuracy• Requires domain expertise• Decompose the problem• Design algorithms• Compose into a system

Andrej Karpathy. Scaled ML 2018 talk©2022 SambaNova Systems Confidential | Do Not Distribute11Three Computing Trends for ML

Multi-coreprocessing utility
is at end of life

Convergenceof training andinference

Generalapplicability ofnext-gen computebeyond ML©2022 SambaNova Systems Confidential | Do Not Distribute

Hierarchical parallel pattern Dataflow
Natural ML execution modelNextGeneration
Compute Must
Support…

Terabyte sized models
Large embeddings

Sparsity

Graph based neural networks

Flexible mapping

Model and data parallelism

Data processing

SQL in inner loop of ML training©2021 SambaNova Systems Confidential | Do Not Distribute13

The SambaNova Systems Advantage:
Vertically Integrated Approach

Global Dataflow
Memory Optimization
High Efficiency Mapping

Compiler
Architecture

Hierarchical Compute
Configurable Memory
Dataflow Optimized Communication

VLSI

TSMC 7nm
High Performance Implementation©2022 SambaNova Systems Confidential | Do Not Distribute

Optimization Within & Between Layers

Algorithms

Low Precision
SparsityCompression

14

Four Classes of Models Covering Broad Industries

True Resolution
Computer Vision

Natural Language
Processing

Recommendation

AI for Science

Every imaging
deviceSpeech and text
is ubiquitous

80% of online retail
AI investment

Exascale dataprocessing©2022 SambaNova Systems Confidential | Do Not Distribute15

True Resolution Vision©2022 SambaNova Systems

Limited Possibilities with Conventional Solutions
Today’s computer vision capabilities are falling behind Imaging technology

ROIGPU60k x 40k

(Special-purpose imaging technologies)
Cloud
Low-resolution Service(Internet)

1k images(Dated IoT devices)
4k images(Modern IoT devices)

Image Resolution©2022 SambaNova Systems Confidential | Do Not Distribute17

Case Study: True Resolution Computer Vision
Break through the accuracy limit from conventional solutions
Conventional Solution

MANDATED WORKAROUNDS TO TRAIN

Train model at true resolution of theoriginal high-res images

1. Down Sampling

2. Patching• Large field of view with blurrylarge features• Small field of view

• Loss of details• Loss of information at boundaries• Lowered resolution

TRAIN IN NATURAL FORM AS-IS• Loss of large features in each tile
• Requires more compute resources• Large field of view and high-resolution
details in the same pipeline• No compromise on accuracy
State-of-the-art Accuracy
Missing screw

Failed to identify the defect©2022 SambaNova Systems Confidential | Do Not Distribute18

Dataflow-as-a-Service Efficiently Trains with Your Images
Eliminate the costly workarounds from conventional solutions
1160

Whole Slide Image
20k x 20k

512 x 512 pixel patches
20k x 20k original

True resolution
computer vision

Labeling costr r or s
Human Eoi s eLabel N

Reproduc

ibility

AccuracyNatural Language©2022 SambaNova Systems Confidential | Do Not DistributeDataFlow-as-a-ServiceTM GPT: for OTP Bank
Deployment of next generation language as-a-service capabilities
What is being announced?
• Multiple versions of GPT pre-trained with English • Multi-year subscriptionlanguage• Multi-rack installation• Domain specific pre-training for finance• Service Delivery on/before Feb 2022
Why is it significant?
• Training and Inference• OTP has leapfrogged regional competitors withsignificantly more advanced language
capabilities at a fraction of the time and cost“This is a unique collaboration between OTP Group, ITM, and SambaNova
Systems to provide an incredible resource to the country and the Central andEastern European region. We are pleased to announce that this groundbreaking
supercomputer will represent a unique AI capability to build GPT-3 level
language models for languages across CEE.”
Péter Csányi, Deputy CEO, Head of Digital Divison, OTP Group21• OTP’s language as-a Service deployment will
enable a next generation of model driven
application products and services toaccelerate digital customer acquisition

DataFlow-as-a-ServiceTM GPT: for OTP Bank
European AI supercomputing for large language models on SambaNova
Initial Use Cases

Natural Language
Understanding

Decision Engine

Textual Data

ChannelIntegration

RuleEngine(Speech-to-Text and Textto-Speech Conversion)

ParsedOutputVoice andText Data•••••

Natural Language
Generation

Voice ActivatedDevices

Mobile/ Web
App Chatbot

22

Complex linguistics
Sentiment Analysis
Document Classification
Named-Entity Recognition
Text/Document Generation
Line of Business Applications

•••
•
•
•
•

CRM (contact center)
Customer Engagement
Omni Channel Marketing
Loan Origination & Servicing
Conduct Surveillance
Digital Voice Innovations
Risk & ComplianceRun State of the Art Accuracy Transformers in Seconds
Instantly run thousands of Hugging Face models with zero code change
SambaNova DataScale

DGX A100DOWNLOAD MODELCoLA SST-2 MNLI MRPC MRPC STS-B(MCC) (Acc) (Acc) (Acc) (F1)
(Prs)

Downloadable
ModelsResults inSeconds

STS-B(Spr)

STS-B QQP(Cor) (Acc)

QQP
(F1)

QNLI
RTE
WNLI(Acc) (Acc) (Acc)

Same Accuracy
as on GPU23

Recommendation©2022 SambaNova Systems Confidential | Do Not DistributeWorld Record Recommender Training and Inference
Highest throughput DIN recommender results

5x Faster

Training Than GPU8x Faster

Inference Than GPU25

AI For Science
HPC + AI©2022 SambaNova Systems Confidential | Do Not DistributeMachine Learning and AI Intersects and Helps with HPC* Artificial Intelligence and Machine Learning to Accelerate Translational Research: Proceedings of a Workshop—inBrief (2018)©2022 SambaNova Systems Confidential | Do Not DistributeHybrid HPC Pipeline with SambaNova Systems
HPC computation
task
ML computationtask
HPC computationtask

HPC computation
task
Existing supercomputerfor HPC

ML computationtask
HPC computation
task©2022 SambaNova Systems Confidential | Do Not Distribute

AI acceleration systemlike Sambanova SN-10
with Reconfigurable
Dataflow Units (RDUs)

Strategic Partnership and a National Imperative“This strategic partnership agreement with SambaNova
Systems will highlight extraordinary efforts that will contribute to
the continuous advancing of AI and machine learning
initiatives within DOE and the NNSA”-David Etim, a federal program manager for the NNSA Office of Advanced Simulation and Computing and leader of theAdvanced Machine Learning Initiative©2022 SambaNova Systems Confidential | Do Not Distribute

Solutions©2021 SambaNova Systems Confidential | Do Not DistributeDeployed at Select Revenue Customers Since H1 CY2020
Real customers, real workloads, real results

Software:No lock-in, CUDA-free computing
Hardware:SW-defined, Dataflow optimized
System:Ease of use and integration
Results:
New capabilities, performance

Software, Hardware,
Services, Support
Multi-System
Deployments
100% Remote
Installations in 45 Mins
Customer Models
Running on Day 1©2022 SambaNova Systems Confidential | Do Not Distribute31

AI Computing is Multi-Faceted and Complex
It’s not just about performance

Performance

Accuracy

Scale©2022 SambaNova Systems Confidential | Do Not Distribute

Ease of Use32

One Platform With All the Right Interfaces You Need
Choose DataScale or Dataflow-as-a-Service , on-premises or in the cloudDataflow-as-a-Service
Dataflow-as-a-Service

Dataflow-as-a-Service API

DataScale
The Platform for Innovation• Model-centric computing• Common open interfaces• PyTorch, TensorFlow• SambaFlowTM• ML engineers and data
scientists

DataScale

ML Models and Tasks

Extensible Platform Services• Data-centric computing• Low Code Interfaces• API/SDK
• GUI
• CLI
• Application developers

SambaFlowTM

On-Premises, Hybrid, Public Cloud©2022 SambaNova Systems Confidential | Do Not Distribute33

World’s First Dataflow-as-a-Service Offerings
Three Dataflow-as-a-Service subscriptions: From zero to AI, fast and simple
Recommendation

Extensible AI Services Platform••••••Language

AI cloud services @ customer site
Scale on-demandState of the art accuracy
Ease of use at scale
Managed by SambaNova
Cloud consumption OPEX model

Vision©2022 SambaNova Systems Confidential | Do Not Distribute34

SambaFlow Open Software
SambaFlow: No lock-in, ease of use, developer productivity

Custom kernel

Completesystem solutions
require an openand easy to use
software stack©2022 SambaNova Systems Confidential | Do Not Distribute35

40Btransistors

100s ofutilizedTFLOPS

100s MBon chip

50Directinterfaces toTBs off chipkilometersof wire

SambaNova Systems Cardinal SN10 RDU
World’s First Reconfigurable Dataflow Unit

©2022 SambaNova Systems Confidential | Do Not Distribute36

Existing Solutions Are Built For Software 1.0

t1 = conv(in)t2 = pool(t1)t3 = conv(t2)t4 = norm(t3)t5 = sum(t4)Sequence of instructions executed in time

The old way: Kernel-by-kernel

Bottlenecked by memory bandwidthand host overhead©2022 SambaNova Systems Confidential | Do Not Distribute37Software 2.0 is Dataflow
ConvolutionGraph

The Dataflow way: Spatial programming

Eliminates memory traffic and overhead, increases parallelism©2022 SambaNova Systems Confidential | Do Not DistributeSoftware-Defined Hardware Architecture
Software-Driven Architecture

Programmable Compute and Communication

Tiled architecture with reconfigurable SIMD pipelines, distributed scratchpads, and programmed switches
AGS

S

Coalescing
Unit

map

PMUS

PCU

S

PMU

filterAGSS

PMUPCU

AG

groupBy

reduceSS

Coalescing
Unit

Key1 Key2 Key3…
CoalescingUnitSCoalescingUnit©2022 SambaNova SystemsSSAGAddress
GenerationUnit

SPCU

PCU

PMUAGSSPMUSSSwitchS

PMU

PatternMemory
Unit

PCU

PatternCompute
Unit

39

SambaNova Systems Flexibility to Support Key Scenarios
4 RDU deployment examples
1) High Performance
Mixed Workloads
Training

PreProcessing

SQL3) SecureMulti-Tenancy

2) Efficient
Concurrent Applications
App 1

App 3

App 2

App 4

VM 1

VM 2

VM 3

VM 4

VM 5

VM 6

VM 7

VM 8

4) Compiler Driven Application Scale-Up

ML-Training/Inference or HPC Application
RDU0

RDU1

RDU2

RDU3

RDU4©2022 SambaNova Systems

RDU5

RDU6RDU740

Delivering Cloud-Native Features From Inception
Enterprise, service provider, supercomputing

Securemulti-tenancy

Built-invirtualization

ResourcepoolingManagementand provisioning

Autoscalemodel anddata parallel

Built for Cloud in
Gen 1, not Gen n41

Open Standards, Disruptive Technology, Easy to Deploy
AI infrastructure deployed and running customer workloads in 45 minutes
Open Source Frameworks

Open standard rack,
Open standard form factor,
Open standard power,
Open standard cooling,
Open standard operations

The New Standard

Open Source Orchestration

Open Source Containers
SingularityOpen Source OS
Open Standards Connectivity
Ethernet©2022 SambaNova Systems Confidential | Do Not Distribute42

Dataflow-as-a-Service Unlocks New Capabilities
From zero to AI with one subscription
SambaNova Advantages:• Intelligent software stack• Dataflow-driven• High compute efficiency• Big memory architectureHigh-Resolution andLarge Parameter
Models©2022 SambaNova Systems Confidential | Do Not Distribute43

Flexibility and Choice
For Deployment and Consumption

44