Edit model card

Instruct_Llama3_8B

Fine-tuned from Llama-3-8B, using a wide variety of sources for the dataset. 84.9% for training, 15% validation, 0.1% test. Trained for 2 epochs using QDora. Trained with 4096 context window.

Model Details

  • Trained by: trained by Brillibits. See YouTube as well.
  • Model type: Instruct_Llama3_8B is an auto-regressive language model based on the Llama 3 transformer architecture.
  • Language(s): English
  • License for Instruct_Llama3_8B: llama3 license

Prompting

<s>[SYS] {system prompt or blank space} [/SYS] [INST] {instruction} [/INST] {response}</s>

Professional Assistance

This model and other models like it are great, but where LLMs hold the most promise is when they are applied on custom data to automate a wide variety of tasks

If you have a dataset and want to see if you might be able to apply that data to automate some tasks, and you are looking for professional assistance, contact me here

Downloads last month
1,452
Safetensors
Model size
8.03B params
Tensor type
BF16
·