Is this model trained from scratch (randomly init) or layers or weights of other models used during the training?

by Sunny111 - opened Feb 21, 2024

Feb 21, 2024

Very cool model. I am curious is this model trained from scratch or weight of existing huggingface LLMs are used?

Hugging Face Smol Models Research org Feb 21, 2024

yes it's trained from scratch

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

Your need to confirm your account before you can post a new comment.

· Sign up or log in to comment