Update README.md
Browse files
README.md
CHANGED
@@ -2,6 +2,7 @@
|
|
2 |
datasets:
|
3 |
- Yukang/LongAlpaca-16k-length
|
4 |
---
|
|
|
5 |
|
6 |
This is an extended (16K) context version of LLaMA 3. Trained for five hours on 8x A6000 GPUs, using the `Yukang/LongAlpaca-16k-length` dataset.
|
7 |
|
|
|
2 |
datasets:
|
3 |
- Yukang/LongAlpaca-16k-length
|
4 |
---
|
5 |
+
This repo is a clone of [mattshumer/Llama-3-8B-16K](https://huggingface.co/mattshumer/Llama-3-8B-16K)
|
6 |
|
7 |
This is an extended (16K) context version of LLaMA 3. Trained for five hours on 8x A6000 GPUs, using the `Yukang/LongAlpaca-16k-length` dataset.
|
8 |
|