Pavlo Molchanov's picture

Pavlo Molchanov PRO

pmolchanov

·

https://www.pmolchanov.com

AI & ML interests

Efficiency in Multi-Modal LLMs

Recent Activity

updated a model about 1 month ago

nvidia/Minitron-8B-Base

updated a model about 1 month ago

nvidia/Minitron-4B-Base

updated a model about 1 month ago

nvidia/Nemotron-Mini-4B-Instruct

View all activity

Organizations

pmolchanov's activity

upvoted 2 articles about 1 month ago

Article

Bamba: Inference-Efficient Hybrid Mamba2 Model

Dec 18, 2024

• 45

Article

Finally, a Replacement for BERT: Introducing ModernBERT

Dec 19, 2024

• 572

upvoted a paper about 2 months ago

SANA 1.5: Efficient Scaling of Training-Time and Inference-Time Compute in Linear Diffusion Transformer

Paper • 2501.18427 • Published Jan 30 • 17

upvoted a collection 2 months ago

Cosmos

The collection of Cosmos models • 31 items • Updated about 8 hours ago • 269

upvoted 2 papers 3 months ago

NVILA: Efficient Frontier Visual Language Models

Paper • 2412.04468 • Published Dec 5, 2024 • 58

Cautious Optimizers: Improving Training with One Line of Code

Paper • 2411.16085 • Published Nov 25, 2024 • 20

upvoted a collection 4 months ago

Hymba

A series of Hybrid Small Language Models. • 2 items • Updated about 8 hours ago • 28

upvoted 2 papers 4 months ago

Star Attention: Efficient LLM Inference over Long Sequences

Paper • 2411.17116 • Published Nov 26, 2024 • 52

Hymba: A Hybrid-head Architecture for Small Language Models

Paper • 2411.13676 • Published Nov 20, 2024 • 42

upvoted 2 papers 5 months ago

ShadowKV: KV Cache in Shadows for High-Throughput Long-Context LLM Inference

Paper • 2410.21465 • Published Oct 28, 2024 • 11

COAT: Compressing Optimizer states and Activation for Memory-Efficient FP8 Training

Paper • 2410.19313 • Published Oct 25, 2024 • 19

upvoted 4 papers 6 months ago

PHI-S: Distribution Balancing for Label-Free Multi-Teacher Distillation

Paper • 2410.01680 • Published Oct 2, 2024 • 34

Lotus: Diffusion-based Visual Foundation Model for High-quality Dense Prediction

Paper • 2409.18124 • Published Sep 26, 2024 • 32

MaskLLM: Learnable Semi-Structured Sparsity for Large Language Models

Paper • 2409.17481 • Published Sep 26, 2024 • 47

Discovering the Gems in Early Layers: Accelerating Long-Context LLMs with 1000x Input Token Reduction

Paper • 2409.17422 • Published Sep 25, 2024 • 25

upvoted 3 collections 6 months ago

Llama 3.2

This collection hosts the transformers and original repos of the Llama 3.2 and Llama Guard 3 • 15 items • Updated Dec 6, 2024 • 578

MagpieLM

Aligning LMs with Fully Open Recipe + Synthetic Data Generated from Open-Source LMs. • 9 items • Updated Jan 13 • 16

RADIO

A collection of Foundation Vision Models that combine multiple models (CLIP, DINOv2, SAM, etc.). • 6 items • Updated about 8 hours ago • 5

upvoted 2 collections 7 months ago

Qwen2-VL

Vision-language model series based on Qwen2 • 16 items • Updated Dec 6, 2024 • 208

VILA: On Pre-training for Visual Language Models

10 items • Updated Oct 31, 2024 • 52