Join the conversation

Join the community of Machine Learners and AI enthusiasts.

Sign Up
fblgit 
posted an update 27 days ago
Post
599
Cybertron is back:

We released today a newest version of Cybertron: V4 based on Qwen2.5 7B and trained on MagPie. Scoring #1 LLM on 7B & 8B class.

The model hasn't go thru DPO, so the weights are in good shape to welcome further training sessions and optimizations.
Enjoy it in the hub as usual:
fblgit/cybertron-v4-qw7B-MGS

hello Could you share your training methods and paper?

In this post