54 2 1

Olivier Dehaene

olivierdehaene

olivierdehaene

AI & ML interests

None yet

Recent Activity

new activity 4 months ago

mistral-community/Pixtral-Large-Instruct-2411:🚩 Report: Legal issue(s)

new activity 7 months ago

Alibaba-NLP/gte-Qwen2-1.5B-instruct:"Bidirectional attention"

new activity 7 months ago

sanchit-gandhi/whisper-jax:Fix Dockerfile

View all activity

Organizations

olivierdehaene's activity

New activity in mistral-community/Pixtral-Large-Instruct-2411 4 months ago

🚩 Report: Legal issue(s)

#1 opened 4 months ago by

patrickvonplaten

New activity in Alibaba-NLP/gte-Qwen2-1.5B-instruct 7 months ago

"Bidirectional attention"

#1 opened 9 months ago by

olivierdehaene

New activity in sanchit-gandhi/whisper-jax 7 months ago

Fix Dockerfile

#127 opened 7 months ago by

olivierdehaene

New activity in mistralai/Mistral-Nemo-Instruct-2407 8 months ago

model is not working

#74 opened 8 months ago by

lowpex

liked a model 10 months ago

raidium/MQG

Text Generation • Updated Jul 10, 2024 • 10 • 3

replied to mayank-mishra's post about 1 year ago

Nice blog!
@osanseviero we have been doing this in TGI and TEI for a while ;)
Padding free implementations also make dynamic batching easier to implement and more predictable in memory.

authored a paper about 1 year ago

StarCoder 2 and The Stack v2: The Next Generation

Paper • 2402.19173 • Published Feb 29, 2024 • 142

reacted to loubnabnl's post with ❤️🤯🤗 about 1 year ago

Post

⭐ Today we’re releasing The Stack v2 & StarCoder2: a series of 3B, 7B & 15B code generation models trained on 3.3 to 4.5 trillion tokens of code:

- StarCoder2-15B matches or outperforms CodeLlama 34B, and approaches DeepSeek-33B on multiple benchmarks.
- StarCoder2-3B outperforms StarCoderBase-15B and similar sized models.
- The Stack v2 a 4x larger dataset than the Stack v1, resulting in 900B unique code tokens 🚀
As always, we released everything from models and datasets to curation code. Enjoy!

🔗 StarCoder2 collection: bigcode/starcoder2-65de6da6e87db3383572be1a
🔗 Paper: https://drive.google.com/file/d/17iGn3c-sYNiLyRSY-A85QOzgzGnGiVI3/view
🔗 BlogPost: https://huggingface.co/blog/starcoder2
🔗 Code Leaderboard: bigcode/bigcode-models-leaderboard