Commit
•
004b286
1
Parent(s):
d3722c0
Update README.md
Browse files
README.md
CHANGED
|
@@ -2,7 +2,14 @@
|
|
| 2 |
license: other
|
| 3 |
license_name: yi-license
|
| 4 |
license_link: LICENSE
|
|
|
|
|
|
|
| 5 |
---
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 6 |
<div align="center">
|
| 7 |
|
| 8 |
<h1>
|
|
@@ -47,4 +54,4 @@ Although we use data compliance checking algorithms during the training process
|
|
| 47 |
## License
|
| 48 |
|
| 49 |
The Yi series model must be adhere to the [Model License Agreement](https://huggingface.co/01-ai/Yi-34B/blob/main/LICENSE).
|
| 50 |
-
For any questions related to licensing and copyright, please contact us ([yi@01.ai](mailto:yi@01.ai)).
|
|
|
|
| 2 |
license: other
|
| 3 |
license_name: yi-license
|
| 4 |
license_link: LICENSE
|
| 5 |
+
datasets:
|
| 6 |
+
- unalignment/spicy-3.1
|
| 7 |
---
|
| 8 |
+
|
| 9 |
+
# Fine-tune of Y-34B with Spicyboros-3.1
|
| 10 |
+
One epoch of fine tuning with @jondurbin's SpicyBoros-3.1 dataset. 4.65bpw should fit on a single 3090/4090, 5.0bpw, 6.0bpw, and 8.0bpw will require more than one GPU 24 GB VRAM GPU.
|
| 11 |
+
|
| 12 |
+
# Original Yi-34B Model Card Below
|
| 13 |
<div align="center">
|
| 14 |
|
| 15 |
<h1>
|
|
|
|
| 54 |
## License
|
| 55 |
|
| 56 |
The Yi series model must be adhere to the [Model License Agreement](https://huggingface.co/01-ai/Yi-34B/blob/main/LICENSE).
|
| 57 |
+
For any questions related to licensing and copyright, please contact us ([yi@01.ai](mailto:yi@01.ai)).
|