checkpoint 4800
Browse files- README.md +0 -6
- pytorch_model.bin +1 -1
README.md
CHANGED
|
@@ -4,12 +4,6 @@ datasets:
|
|
| 4 |
- togethercomputer/RedPajama-Data-1T
|
| 5 |
---
|
| 6 |
|
| 7 |
-
[<img src="https://raw.githubusercontent.com/OpenAccess-AI-Collective/axolotl/main/image/axolotl-badge-web.png" alt="Built with Axolotl" width="200" height="32"/>](https://github.com/OpenAccess-AI-Collective/axolotl)
|
| 8 |
-
Questions, comments, feedback, looking to donate, or want to help? Reach out on our [Discord](https://discord.gg/PugNNHAF5r) or email [wing@openaccessaicollective.org](mailto:wing@openaccessaicollective.org)
|
| 9 |
-
|
| 10 |
-
OpenLLaMA extended to 4k context using X-Pos RoPE with the RedPajama Sample dataset. (this is still a preview from about 35% training)
|
| 11 |
-
|
| 12 |
-
|
| 13 |
# OpenLLaMA: An Open Reproduction of LLaMA
|
| 14 |
|
| 15 |
|
|
|
|
| 4 |
- togethercomputer/RedPajama-Data-1T
|
| 5 |
---
|
| 6 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 7 |
# OpenLLaMA: An Open Reproduction of LLaMA
|
| 8 |
|
| 9 |
|
pytorch_model.bin
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
size 13611219061
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:c4149b2d1f95cc4de9281b36dce2d2b926cd18649827a19f7f6ea8ab5c340737
|
| 3 |
size 13611219061
|