File size: 648 Bytes
03cc30d c2955a4 03cc30d c2955a4 03cc30d c2955a4 03cc30d c2955a4 03cc30d c2955a4 |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 |
---
base_model: daryl149/llama-2-7b-chat-hf
datasets:
- Hypersniper/philosophy_dialogue
---
# Overview
Fine-tuned [Llama-2 7B](https://huggingface.co/daryl149/llama-2-7b-chat-hf) with a philosopher conversation dataset (originally from [Hypersniper/philosophy_dialogue](https://huggingface.co/datasets/Hypersniper/philosophy_dialogue)).
Used QLoRA for fine-tuning. Trained for one epoch on a 40GB GPU (NVIDIA A100) instance.
The version here is the fp16 HuggingFace model.
# Prompt style
The model was trained with the following prompt style:
```
<s>[INST] <<SYS>>
{{ system_prompt }}
<</SYS>>
{{ user_message }} [/INST]
{{ response }} </s>
``` |