PRODUCT SHEETSamba-1
Samba-1: 1 Trillion Parameters, One Model, One Platform - All Your Apps

Features:• 1.3 Trillion parameter Composition of Experts.
• Made up of best in class base models
including Llama, Mistral, Falcon, DeepSeek,Llava• 92 state of the art experts in a wide range oftasks, domains and modalities.

• Sophisticated routing techniques enable
users to automatically route to the best expert
and developers to create their own routing
strategies.

What is Samba-1
Samba-1 is a pioneering 1 trillion parameter model
designed to revolutionize enterprise AI. A highperforming Composition of Experts that combines thecomprehensive power of trillion-parameter models withthe precision and efficiency of specialized models. This
unique model offers a single API endpoint, enabling
the orchestration of domain-specific experts acrossvarious fields such as finance, legal, and engineering,along with task-specific experts for operations likesummarization, extraction, and content editing acrossmultiple modalities including text, code, and images.
Samba-1 facilitates a seamless integration of thesediverse models, providing configurable access andpermissions that reflect an organization’s structure, thus
ensuring data segregation and security.

Features of Samba-1
Benefits:• Secure. Your own dedicated Samba-1
instance that can be fine tuned on your own
private data.

• Affordable at enterprise scale. 10X costand power reduction for production scaleinference versus similar solutions.

• Accurate for business tasks. Complex businesstasks require systems that understand detailed
and diverse content and queries.

• Broadly applicable. Able to handle the range
and diversity of business tasks.

• Manageable. A full stack solution, and over atrillion parameters deployed as one endpoint.

• Open standards. Own and control yourmodel, providing governance and avoid
vendor lock in.

Leverage diverse models from one endpoint: Utilize
the single API endpoint to create knowledge-richapplications with a wide range of domain and task
experts across different configurations and modalities,
including text, code, and images. Easily integrate theseexperiments into your applications for real-world use.
Customize and fine-tune models for specific tasks:
Tailor Samba-1’s Composition of Experts model withyour own data for fine-tuning, ensuring the model aligns
perfectly with your specific business requirements andenhances performance on targeted tasks.
Develop applications with advanced reasoning
capabilities: Harness the power of Samba-1’s
automated routing to build applications that can makecomplex decisions, perform tasks, and provide solutions
tailored to customer needs by combining expert
models with API calls and data queries.
Configurable Access and Permissions: Samba-1
enables flexible access controls, allowing precise
management of model permissions to align withorganizational roles, enhancing security and ensuring
compliance.
Total AI Stack Control: With options for on-premise
and air-gapped deployments, Samba-1 ensurescomplete data privacy and security, enabling the useof sensitive data for model training without externalexposure.
Optimize application performance and efficiency:
Benefit from the efficiency and lower operational costsof running Samba-1 in SambaStudio on the SN40L
system. Enjoy 10x reduction in inference cost and power
consumption over alternative solutions.

Llama 2
Swallow-7b-instruct-v0.1
Swallow-13b-instruct-v0.1
Swallow-70b-instruct-v0.1
Swallow-7b-NVE-instruct-hf
Swallow-70b-NVE-instruct-hf
ELYZA-japanese-llama-2-7b
Nous-Hermes-llama-2-7b
Nous-Hermes-Llama2-13b
CodeLlama-70b-Python-hf
CodeLlama-70b-Instruct-hf
Magicoder-S-DS-6.7B
Magicoder-S-DS-6.7B-16k
sqlcoder-7b-2
sqlcoder-70b-alphallama-2-7b-chat-hf
law-chatfinance-chat
Explore-LM-7B-Rewriting
llama-2-7b-hf
LlamaGuard-7b

Llama 3
Meta-Llama-3-8B
Meta-Llama-3-8B-Instruct
Meta-Llama-Guard-2-8B
Meta-Llama-3-70B
Meta-Llama-3-70B-Instruct
Meta-Llama-3-70B-Instruct

MistralSambaLingo-70b-Hungarian-Chat
SambaLingo-70b-Arabic-Chat
SambaLingo-70b-Thai-Chat
SambaLingo-Bulgarian-Chat
SambaLingo-Japanese-Chat
SambaLingo-Thai-Chat
SambaLingo-Arabic-Chat
SambaLingo-Hungarian-Chat
SambaLingo-Russian-Chat
SambaLingo-Slovenian-Chat
SambaLingo-Turkish-Chat
SambaLingo-Serbian-Chatmedicine-chatXwin-Math-7B-V1.0
TableLlama
lumos_web_agent_ground_iterative
lumos_web_agent_plan_iterative
SambaCoder-nsql-llama-2-70b

FalconFalcon-40b-instruct

NexusRaven-V2-13B
llama-2-13b-chat-hf
Xwin-Math-13B-V1.0
llama-2-13b-hf
Xwin-Math-70B-V1.0
deepseek-llm-7b-chatdeepseek-llm-67b-chattulu-2-7b
tulu-2-dpo-7b
GOAT-70B-Storytelling
llama-2-70b-chat-hf
llama-2-70b-hf
tulu-2-dpo-13b
autoj-13b
tulu-2-13b
tulu-2-dpo-70b
tulu-2-70b
UniNER-7B-all
nsql-llama-2-7b

DeepSeek
deepseek-coder-1.3b-instructdeepseek-coder-6.7b-instructdeepseek-coder-33b-instruct
Deepseek-llm-7b-chatDeepseek-llm-67b-chatsqlcoder-7b
BioMistral-7B
BioMistral-7B-DARE
BioMistral-7B-TIES
BioMistral-7B-SLERP
Saul-Instruct-v1WestLake-7B-v2-laser-truthy-dpo
EmertonMonarch-7B
typhoon-7b
Genstruct-7B
Mistral-7B-OpenOrca
OpenHermes-2p5-Mistral-7B
Nous-Hermes-2-Mistral-7B-DPO
Starling-LM-7B-beta
Mistral-7B-Instruct-v0.2
zephyr-7b-beta
Mistral-T5-7B-v1
Lil-c3po
v1olet_merged_dpo_7B
Rabbit-7B-DPO-Chat
DonutLM-v1
Snorkel-Mistral-PairRM-DPO

BLOOMChat

Gemma

BLOOMChatv2-8k
BLOOMChatv2-2k

codegemma-7b
codegemma-7b-it
gemma-7b
gemma-7b-it

Inference Performance
Samba-1 can be deployed on a single SN40L node, while other systems would need many nodes to run a model of this size.
*Consult your SambaNova point of contact for assistance on sizing.

SambaNova Suite & Samba-1
To learn more about how SambaNova Systems canaccelerate and transform your organization withgenerative AI, schedule a meeting.

Learn more at SambaNova.AI
linkedin.com/company/sambanova@SambaNovaAI
info@sambanova.ai

Customers turn to SambaNova to quickly deploy state-of-the-art AI capabilities to meet the demands of the AI-enabled world. Our purpose-built enterprise-scale
AI platform is the technology backbone for the next generation of AI computing. We enable customers to unlock the valuable business insights trapped in theirdata. Our flagship offering, SambaNova Suite, overcomes the limitations of legacy technology to power the large complex foundation models that enable
customers to discover new services and revenue streams, and boost operational efficiency. Headquartered in Palo Alto, California, SambaNova Systems wasfounded in 2017 by industry luminaries, and hardware and software design experts from Sun/Oracle and Stanford University. Investors include SoftBank Vision Fund2, funds and accounts managed by BlackRock, Intel Capital, GV, Walden International, Temasek, GIC, Redline Capital, Atlantic Bridge Ventures, Celesta, andseveral others.

Copyright © 2024 SambaNova Systems, Inc. All rights reserved. | (650) 263-1153