llama3-8b-cqia / README.md
HenryJJ's picture
Update README.md
22ed900 verified
metadata
license: apache-2.0
datasets:
  - m-a-p/COIG-CQIA

llama3-8b-cqia

Built with Axolotl

SFT with m-a-p/COIG-CQIA. 2 epoch qlora. Code under https://huggingface.co/HenryJJ/llama3-8b-lima/blob/main/config/llama3-cqia.yml.

Model Details

  • Trained by: trained by HenryJJ.
  • Model type: llama3 is an auto-regressive language model based on the Llama 3 transformer architecture.
  • Language(s): English
  • License for llama3-8B-lima: apache-2.0 license

Prompting

Prompt format chatml: This model uses ChatML prompt format.

<|im_start|>system
You are a helpful AI assistant.<|im_end|>
<|im_start|>user
{prompt}<|im_end|>
<|im_start|>assistant

Example:

<|im_start|>system
You are a helpful assistant.
<|im_start|>user
who is the president of us
<|im_start|>assistant