MLSteam
MLOps System Platform
Eric Chen 陳明江 PhD
eric@myelintek.com
0920-603351

You focus on your AI mission.
We handle the AI environment for you.

MyelinTek Inc. 邁爾凌科技
AI System Software Company
spun-off from ITRI since 2020

Products: MLSteam• AI/ML Training System• AI/ML Inferencing System• AI/ML Lifecycle Management System (MLOps)
Service• Large-scale System Design and Implementation
Rm. 202, Bldg. 1, No. 321, Sec. 2, Guangfu Rd., Hsinchu, Taiwan
contact@myelintek.com
https://www.myelintek.com/2

AI/ML Workflow
TrainedModelInferencing

51

ModelDesign6284Training

Servers

Performance
Monitoring

7

Model
Training

Data
Correction

3GPUModel
Evaluation

ModelOperation

Data
Model
Preparation Deployment
Servers & IPC
Research & Development

Operation & Application

3

MLSteam (AI/ML System)
AI/ML Training System

AI/ML Inferencing System
Model
Evaluation

84

3

Inferencing

NVIDIA
Train, Adapt, andOptimize (TAO)

5

1

MLOps

62

Training
Model
DesignPerformance
Monitoring

7

Model
Training

Data
Correction

ModelOperation

Data
Model
Preparation Deployment

AI/ML Lifecycle Management System

Research & Development

Operation & Application

4

MLSteam (AI/ML System)
AI/ML Developers/Operators
Project Management
Data ManagementModel Management
Training Job Management
Inference Request Management
Model Pipeline Management

Application
SoftwareAI Dev/Ops
Management Tools

CVNLP

Speech&Voice

Time-series

Data, AI Models

Orchestration Management
SystemSoftware

DNN Frameworks
DNN Libraries

IT/MIS
Container Management
Resource Allocation
Cluster Management
Resource Monitoring
Hardware Recommendation

OS, GPU Driver

InfrastructureManagement Tools
Hardware

NVIDIA GPU, AMD GPU,
Other AI Accelerators

Storage,Networking

X86 Machines5MLSteam (AI/ML System)
Customers: Any AI Enablers

Application
Software

CCV

NLP

Speech&Voice

Time-series

Data, AI Models

Orchestration Management•A AI/ML System Software
Software•B AI/ML Appliance
Software + Hardware• AI/ML Solution
C
Software + Hardware + Trained Models
B• AI/ML Cloud Service
D
Software + Hardware + Cloud Service

A

SystemSoftware

DNN Frameworks
DNN Libraries
OS, GPU Driver

Hardware

NVIDIA GPU, AMD GPU,
Other AI Accelerators

Storage,Networking

X86 Machines
6

References
Customer:• Defense Department
Products/Service:• Large-scale System Design and Implementation• AI/ML Appliance• AI/ML System Software• over GPU servers, GPU workstations,
NVIDIA DGX-1, DGX Station,NAS, Pure Storage Server, andNetApp Server• NVIDIA GPU and AMD GPU
AI Usage:• Smart Manufacturing• AI/ML Training

7

References
Customer:• Medical Center (Hospitals)
Products/Service:• Large-scale System Design and Implementation• AI/ML ApplianceCentralized Manage• Model Version Control• NVIDIA A100 SXM4
• Data Version Control• NVIDIA Multi-Instance GPU (MIG)• Inference Requests
AI Usage:• Inference Results• Smart Healthcare• AI/ML Inferencing for multiple clinics within a hospital8

Support NVIDIA MIG
Easily Enable NVIDIA Multi-Instance GPU (MIG)

NVIDIA A100 GPU & MIG

9Support AMD GPU for AI/MLIMAGES/SEC

FP32

FP166221111

MI100 x1

MI100 x8

FP324638

IMAGES/SECMI100 x1

8040

RESNET-50, IMAGENET2012(1,281,167 IMAGES)TENSORFLOW; 30 EPOCHS; 72% ACCURACY

FP166221111

MI100 x84638

8040

RESNET-50, IMAGENET2012(1,281,167 IMAGES)TENSORFLOW; 30 EPOCHS; 72% ACCURACY

10MyelinTek Inc.
AI/ML Training System

AI/ML Inferencing System
Model
Evaluation

84

3

Inferencing

NVIDIA
Train, Adapt, andOptimize (TAO)

5

1

MLOps

62

Training
Model
DesignPerformance
Monitoring

7

Model
Training

Data
Correction

Model
Operation

Data
Model
Preparation Deployment

AI/ML Lifecycle Management System

Research & Development

Operation & Application

11Thank YouEric Ming-Chiang Chen 陳明江 PhD
eric@myelintek.com
886-920-603-351
12