Post
2004
Releasing H2O-Danube2-1.8b - a new and improved language model being the current top model on the Open LLM Leaderboard.
The model is trained on additional 2T tokens (total of 3T tokens) with various data mix stages as a result of extensive experimentation. Focus is on natural language tasks.
Base weights: h2oai/h2o-danube2-1.8b-base
SFT weights: h2oai/h2o-danube2-1.8b-sft
Chat weights: h2oai/h2o-danube2-1.8b-chat
The model is trained on additional 2T tokens (total of 3T tokens) with various data mix stages as a result of extensive experimentation. Focus is on natural language tasks.
Base weights: h2oai/h2o-danube2-1.8b-base
SFT weights: h2oai/h2o-danube2-1.8b-sft
Chat weights: h2oai/h2o-danube2-1.8b-chat
