Morgan Funtowicz's picture

4 4

Morgan Funtowicz

mfuntowicz

·

https://github.com/mfuntowicz

AI & ML interests

Model inference low-level optimization, hardware affinity and large-scale distributed training.

Articles

CPU Optimized Embeddings with 🤗 Optimum Intel and fastRAG

Accelerating SD Turbo and SDXL Turbo Inference with ONNX Runtime and Olive

Optimum-NVIDIA - Unlock blazingly fast LLM inference in just 1 line of code

AMD + 🤗: Large Language Models Out-of-the-Box Acceleration with AMD GPU

Accelerating over 130,000 Hugging Face models with ONNX Runtime

Case Study: Millisecond Latency using Hugging Face Infinity and modern CPUs

Scaling up BERT-like model Inference on modern CPU - Part 2

Introducing Optimum: The Optimization Toolkit for Transformers at Scale

Scaling-up BERT Inference on CPU (Part 1)

Organizations

mfuntowicz's activity

New activity in FacebookAI/roberta-large 3 months ago

Adding ONNX file of this model

#3 opened about 1 year ago by

New activity in distilbert/distilbert-base-multilingual-cased about 1 year ago

Adding ONNX file of this model

#4 opened about 1 year ago by

D3v

New activity in philschmid/distilbert-onnx-banking77 almost 2 years ago

Added Infinity endpoint

#1 opened almost 2 years ago by