PRODUCT SHEETSambaNova DataScale SN40L
The Hardware System for Model Training and Inference
Unlock the fastest system for AI model training and inference with the capability to run
multiple models, including the latest and largest open source models with the highest
performance.
Powered by the SambaNova Cerulean SN40L™ reconfigurable dataflow unit™ (RDU), the SambaNova DataScale®
SN40L delivers unprecedented performance across all model sizes to enable government agencies, researchorganizations, and enterprises to train and deploy the most demanding generative and agentic AI workloads andachieve world record performance with the largest and most challenging models.

The fastest platform for inference

Designed for scale

Delivering the highest accuracy

Delivering world record performanceand accuracy, across the latest large
and small models

With TBs of addressable memory, run
all your models and switch between
them in microseconds.

Quickly, easily, and securely fine tune
models using private data for thehighest accuracy

The DataScale system takes advantage of the unique SambaNova Cerulean SN40L Reconfigurable Dataflow Unit(RDU) to deliver exceptional performance in a small footprint. The SN40L is able to deliver this extreme performance
thanks to its revolutionary dataflow architecture and large memory footprint.

Dataflow architecture
The SN40L is purpose-built for AI. Breaking free fromthe limitations of legacy technologies, the SN40L uses
a dataflow architecture and revolutionary software
stack that maps AI algorithms to the processor anddynamically reconfigures the processor for optimalperformance. This eliminates the redundancy inherent
to GPU architectures.

Three tiered memory architecture
Purpose-built to power the largest AI models, the SN40L
has a three tiered memory architecture that includes verylarge memory, high bandwidth memory, and very fastmemory. The result is that a single system node can support
up to 5 trillion parameters consisting of up to hundreds ofseparate models. With terabytes of addressable memory,the SN40L is ideal for custom and chained models, and canswitch between models in microseconds which is orders ofmagnitude faster than legacy GPUs.

Model Specifications: DataScale SN40L Configurations
Components
Rack system

DataScale SN40L-8• Up to 2 DataScale SN40L-8 nodes

ComputeDataScale SN40L-8 nodes, each with 8 x Cerulean SN40LTM Reconfigurable
Dataflow UnitTM (RDU) chips, 512 GB -1 TB of high-bandwidth total memory,and 6 TB -12 TB DRAM total memory

Networking• High performance 400/200 GbE data switch• General purpose 1 GbE access and management switch, 48-port• Serial console manager server

Software• Red Hat Enterprise Linux OS• Ubuntu Linux OS• SambaFlow™ software

Environmental Specifications

1-node2-nodeSystem Dimensions

Height: 78.5” (1994 mm) | Width: 24.0” (610 mm) | Depth: 50” (1270 mm)

Operating Temperature

59° F to 86° F (15 C to 30° C)

Operating Humidity

20% to 80% (non-condensing)Operating Altitude

Up to 9842ft (3000m); derated by @ 1.8F (1C) per 984ft (300m)
above 2952ft (900m)

System Weight738 lbs ( 335 kg) 			

1056 lbs (480 kg)(without packaging)

SambaNova DataScale®
To learn more about how SambaNova Systems canaccelerate and transform your organization withgenerative AI, schedule a meeting.

Learn more at SambaNova.AI
linkedin.com/company/sambanova@SambaNovaAI
info@sambanova.ai

Customers turn to SambaNova to quickly deploy state-of-the-art AI capabilities to meet the demands of the AI-enabled world. Our purpose-built enterprise-scale
AI platform is the technology backbone for the next generation of AI computing. We enable customers to unlock the valuable business insights trapped in theirdata. Our flagship offering, SambaNova Suite, overcomes the limitations of legacy technology to power the large complex foundation models that enable
customers to discover new services and revenue streams, and boost operational efficiency. Headquartered in Palo Alto, California, SambaNova Systems wasfounded in 2017 by industry luminaries, and hardware and software design experts from Sun/Oracle and Stanford University. Investors include SoftBank Vision Fund2, funds and accounts managed by BlackRock, Intel Capital, GV, Walden International, Temasek, GIC, Redline Capital, Atlantic Bridge Ventures, Celesta, andseveral others.

Copyright © 2024 SambaNova Systems, Inc. All rights reserved. | (650) 263-1153