Hymba: A Hybrid-head Architecture for Small Language Models
Paper
•
2411.13676
•
Published
•
42
•
3
Pavlo Molchanov PRO
pmolchanov
AI & ML interests
Efficiency in Multi-Modal LLMs
Recent Activity
updated
a model
about 1 month ago
nvidia/Minitron-8B-Base
updated
a model
about 1 month ago
nvidia/Minitron-4B-Base
updated
a model
about 1 month ago
nvidia/Nemotron-Mini-4B-Instruct
Organizations
pmolchanov's activity
Update LMFlow support
#6 opened 3 months ago
by
shizhediao2
Update LMFlow support
#10 opened 3 months ago
by
shizhediao2
Add Hymba-1.5B to the leaderboard
3
#1030 opened 3 months ago
by
pmolchanov
when will the Hymba-125M-Instruct be released? thanks
1
#6 opened 4 months ago
by
nemonameless
How good would this be for RAG?
2
#2 opened 4 months ago
by
Unomagan
How well this model can inference on cpu only devices?
2
#5 opened 4 months ago
by
mhdaw
A collection of observations in the code
2
#1 opened 4 months ago
by
AntonV
Add base model metadata
#7 opened 4 months ago
by
davanstrien
Add link to paper, update tags
#3 opened 4 months ago
by
nielsr
Update README.md
1
#4 opened 4 months ago
by
mishig
commented
a
paper
4 months ago
commented
a
paper
5 months ago
License?
1
#2 opened 7 months ago
by
pmolchanov
Mistral-NeMo-Minitron-8B-Chat
5
#5 opened 7 months ago
by
rasyosef
Awesome model, instruct version as well possibly?
3
#2 opened 7 months ago
by
OPPEYRADY
Context Length
1
#4 opened 7 months ago
by
Sao10K
commented
a
paper
7 months ago
Where is Minitron-4B-Instruct?
1
#2 opened 8 months ago
by
mgoin
Import error
5
#1 opened 11 months ago
by
halidziya1