Hailo-10H M.2 Key M ET
Generative AI Acceleration Module
Immersive generative AI experienceon the edge

Key Features & Benefits
High performance processing ofgenerative AI models including LLMs
with minimal CPU / GPU load

Highest cost-efficiency(TOPS/$) compared withexisting solutions

Scalable, enabling
simultaneous processing ofmulti-models

Powered by Hailo-10H AI
accelerators with 40 Tera-Operations
Per Second (TOPS)

Best-in-class power
efficiency. Consumes lessthan 3.5W (typical)

Robust software suite
supports state-of-the-art
deep learning models &generative AI applications

Enables real-time, low latency, andhigh-efficiency AI inferencing onPCs, smart cars and other edge
devices

Fast time to market using
a standard M.2 form factor
moduleTechnical Specifications
Form factor
M.2 Key M 2242 / 2280

Interface
PCIe Gen-3.0, 4-lanes (x4)

Supported
Microsoft Windows

ON-Module DDR
8GB LPDDR4Supported host architectures
X86 or ARM aarch-64 based

Supported AI frameworks
TensorFlow, TensorFlow Lite,Keras, PyTorch & ONNX

Hailo-10H M.2 Generative AI Acceleration Module
With M.2 form factor, the Hailo-10H based modules can be plugged into existing PCs and edge
devices with an M.2 socket to execute deep neural network inferencing in real-time utilizing
low power for a broad range of applications and market segments.

Featuring the Hailo-10H AI Processor
The Hailo-10H AI processor, delivering up to 40 tera-operations per second (TOPS), significantly outperforms
all other edge AI processors. Its area and power efficiency are far superior to other leading solutions by anorder of magnitude.
The Hailo-10H unique, powerful and scalable structure-driven dataflow architecture takes advantageof the core properties of neural networks. It enables edge devices to run deep learning applications atfull scale more efficiently and effectively than traditional solutions, while significantly lowering costs.

Hailo-10H M.2 Key M AI Acceleration Module

Comprehensive Software Suite
AI software suite which seamlessly integrates with existing deep learning development frameworks
to allow smooth and easy integration in existing development ecosystems. The Hailo AI software
suite includes:

Model Build Environment

Runtime Environment

Model Build Computer

Host ProcessorAIApplications

Machine LearningFrameworks

Model Zoo
A variety of common &state-of-the-art pre-trainedand retrainable models inTensorFlow & ONNX

Hailo TAPPASTAPPAS

Application examples
Applications Pipeline
Elements

User
ModelsHailo Dataflow
CompilerA software toolset foroptimization & translationof trained models toHailo-8 format

HailoModels
Zoo

OS IP
Stack

HailoRT

HailoRT
Production-grade,precompiled, runtime
software for the hostprocessor

PCIe
Hailo Dataflow
Compiler

High-performancepre-trained AI application& task templates withproduction-grade pipeline
elements

Hailo-10H Device
Hailo SW component

Hailo-10H Firmware

Other SW component

Hailo EcosystemHailo collaborates with partners globally to offer products for edge solutions — from small andfanless devices, to ruggedized appliances, ,embedded computing platforms and more.
To select your Hailo-based AI platform click here

System Usage
M.2 module connected to the various
types of host processors via PCIe.

www.hailo.ai

Hostprocessor

PCIe

Hailo-10H
M.2

Click here for more information & product inquiry© Copyright Hailo Technologies Ltd, all rights reserved. 4/24.