Is this model trained from scratch (randomly init) or layers or weights of other models used during the training?

by Sunny111 - opened Feb 21

Feb 21

Very cool model. I am curious is this model trained from scratch or weight of existing huggingface LLMs are used?

Hugging Face TB Research org Feb 21

yes it's trained from scratch

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment