DATASHEETAI in Retail – Unlock Growth Opportunities
AI Fuelling Sector’s Transformation••

As of 2024, 42 percent of retailers are actively utilizing AI, with an additional 34 percent1 in the stages ofassessment or pilot testing.
Generative AI solutions, leveraging Large Language Models (LLMs) for advanced natural language
processing, can generate an astounding $660 billion2 in value for the retail sector.

Common Pain Points of Adopting AI for The Retail Industry•••

Insufficient or low data quality impact AIinsights.
Integrating AI with outdated legacy systemsoften leads to compatibility issues, andscalability concerns.
High latency and low responsiveness canimpact a customer’s shopping experience.

•••

Brick and mortar store environmental
conditions such as noise, lighting, etc. can
impact AI processes like interpreting images
from computer vision.
Scarcity of tech talent, high employee turnover
and adoption resistance by frontline workers.
If not handled properly, cybersecurity andphysical security of edge devices can bevulnerable to attacks.

Supermicro with NVIDIA Empowering Your AI JourneySupermicro and NVIDIA® deliver best-in-class outcomes for predictive and generative AI implementationsin the retail sector. This collaborative approach provides a comprehensive framework that integrates CPUs,GPUs, and optimized memory, all orchestrated within the resilient infrastructure of Supermicro’s platforms.
These AI solutions serve applications across multiple use cases in retail. Some of the common use cases you
can adopt today are:

Key Use Cases of AI in Retail
Relevant Supermicro Systems
Personal Shopping Advisor: AI-enabled shopping advisors bringa new experience to shoppers, improve customer ratings, removes
friction for sales and boosts revenue for retailers.

Edge – Kiosk Operation Server: Supermicro SYS-110P-20CFRAN8TP with NVIDIA L40 GPU | Back-office- LLM Host
Server: Supermicro Hyper-E SYS-221HE-TNR(D) with dual
NVIDIA RTX A6000 ADA.

Retail Loss Prevention: Computer vision and AI for security can help
retailers identify and prevent retail loss and product shrinkage, while
also integrating with inventory management.

Edge - Al Computer Vision: Supermicro E300 Embedded
System with NVIDIA L4 GPU, Deep stream SDK | Datacenter– Al Evaluator with similarity search: Supermicro ARS111GL-NHR with NVIDIA Grace Hopper Superchip.

Store Analytics: AI-driven store analytics can help by predicting
and preventing stockouts, optimize merchandising through precise
assessment of planogram performance, and streamline store
operations via real-time data insights.

Edge-Al Computer Vision: Supermicro E403-13E-FRN2T
with NVIDIA L40S GPU | Datacenter - Al vector searchbackend: Supermicro HGX Systems with NVIDIA H100/
H200 GPUs.

Intelligent Supply Chain: AI and simulation solutions enhance
supply chain efficiency and intelligence, helping retailers aligninventory with projected demand.

Datacenter – Digital Twins warehouse simulation server:
Supermicro 5U PCle GPU system SYS-521GE-TNRT withNVIDIA RTX 6000 ADA GPUs.

AI-powered Employee Assistance: AI can modernize the workplaceby simplifying tasks, improving information access, and providing
dynamic guidance for a more efficient work environment.

Datacenter-Retrieval-Augmented Generation withcustom LLM: Supermicro HGX Systems with NVIDIA H100/
H200 GPUs, NVIDIA AI Enterprise.

State of AI in Retail and CPG | NVIDIA | 2Game On, Retailers: Elevate your customer Experience with Gen AI1© 2024 Copyright Super Micro Computer, Inc. All rights reserved

July 2024

AI in RetailSupermicro Solutions for Powering Retail AI
SmallMedium

Large

Extra Large

SYS-E300-13AD

SYS-110D-20C-FRAN8TP*

SYS-E403-13E-FRN2T

SYS-221HE-TNR(D)

Dimensions (mm)HW
D
43.0 x 264.8 x 225.8

HW
D
43.0 x 437.0 x 399.0

HWD
117.3 x 266.7 x 406.4

HW
D
88.9 x 436.9 x 574.0

Single NVIDIA A2, L4
or RTX A1000

Single NVIDIA L4 or
RTX 4000 Ada

Single NVIDIA L40S, L40,
or RTX 6000 Ada

Multiple H100PCIe,L40S, or RTX 6000 Ada

Key Features for Predictive AI
AI computer vision for up to8 streams1

AI computer vision for up to16 streams1

AI computer vision for up to32 streams1

AI computer vision for up to48 streams per GPU1

Up to ~2,000 automatic
speech recognition (ASR)
samples per second2

Up to ~6,000 automatic
speech recognition (ASR)
samples per second2

Up to ~22,000 automatic
speech recognition (ASR)
samples per second2

Up to ~32,000 automatic
speech recognition (ASR)
samples per secondper GPU2

Key Features for Generative AI
LLM up to 8 billion
parameters

LLM up to 24 billion
parameters

LLM up to 48 billion
parameters

LLM up to 80 billion
parameters

Image and video
generation with Stable
Diffusion at ~1 image
every 4-5 seconds.

Image and video
generation with Stable
Diffusion at ~1 image
every 2 seconds.

Image and video
generation with Stable
Diffusion at ~1-2 images
per second.

Image and video
generation with Stable
Diffusion at ~3 images
per second.

*Additional models include SYS-110D-4C-FRAN8TP, SYS-110D-8C-FRAN8TP, SYS-110D-14C-FRAN8TP, and SYS-110D-16C-FRAN8TP
1
Based on using an image classification model similar to EfficientNet-B4, dependent on video stream compression and other workloads on the system
2
Based on using an ASR model like QuartzNet

Supermicro Systems
Accelerating Your AI journey

Selecting The Optimal Supermicro
Systems for Your AI Applications

Supermicro’s cutting-edge AI-ready infrastructure
solutions enable large-scale training to intelligent
edge inferencing allowing retailers to streamline
and accelerate AI deployment. Their
AI-infrastructure empower workloads with optimal
performance and scalability while optimizing costs
and minimizing environmental impact.

Supermicro and NVIDIA excel in guiding organizations to selectthe right system for their specific AI applications. This support
involves considering factors like the size of AI models, systemcompatibility, and specific use case requirements. Whether
it’s handling large-scale video analytics of a smart store orprocessing LLMs in building chatbots, Supermicro’s portfolioof edge platforms are available across a wide range of formfactors, including a compact box, 1U and 2U, wall mount,rack mount, and even fanless models. When combined withNVIDIA’s powerful AI and computing platforms, they provide arange of solutions to meet these diverse needs effectively.

Supermicro’s flexible range of solutions ensuresthat retailers implementing AI solutions can scale
up their implementation as much as needed.
Whatever the requirements, solutions are available
to expand memory, processing power, and storage
to meet any situation.

For more information, visit:https://www.supermicro.com/en/solutions/ai-deep-learning© 2024 Copyright Super Micro Computer, Inc. Specifications subject to change without notice. All other brands and names are the property of
their respective owners. All logos, brand names, campaign statements and product images contained herein are copyrighted and may not be
reprinted and/or reproduced, in whole or in part, without express written permission by Supermicro Corporate Marketing.