Edit model card

Join our Discord! https://discord.gg/Nbv9pQ88Xb

Works on Kobold 1.74!

(Layla (iOS / Android) support is in progress)


BeaverAI proudly presents...

Hubble 4B v1

Equipped with his five senses, man explores the universe around him and calls the adventure 'Science'.

image/png

Description

This is a finetune of Nvidia's Llama 3.1 4B Minitron - a shrunk down model of Llama 3.1 8B 128K.

Usage

  • ChatML or Text Completion
  • Add <|im_end|> as a stop token

Links

Technical Note

Hubble was trained on ChatML with <|end_of_text|> as the EOS token. If you encounter any issues with the model, please let me know!

Downloads last month
241
GGUF
Model size
4.51B params
Architecture
llama

2-bit

3-bit

4-bit

5-bit

6-bit

16-bit

Inference API
Unable to determine this model's library. Check the docs .