Hugging Face's logo
Elie Bakouch's picture
2 10 21

Elie Bakouch

eliebak
loubnabnl's profile picture lunarflu's profile picture medmekk's profile picture
·

AI & ML interests

Training LLM's @ 🤗

Articles

Organizations

Hugging Face's profile picture Hugging Face H4's profile picture HuggingFaceBR4's profile picture Hugging Face TB Research's profile picture huggingPartyParis's profile picture MLX Community's profile picture HuggingFaceFW's profile picture Nanotron Research's profile picture Hugging Face SMOL's profile picture LLHF's profile picture llmc's profile picture SLLHF's profile picture

Posts 1

view post
Post
732
Wow, impressive 340B model by nvidia with a nice permissive license! 🚀 The technical report is full of insights and seems to use a different learning rate schedule than cosine, probably a variant of WSD. Hope to get more info on that! 👀

nvidia/nemotron-4-340b-666b7ebaf1b3867caf2f1911

Collections 1

Papers 1