winglian commited on
Commit
7a717f9
1 Parent(s): db1b099

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +6 -0
README.md CHANGED
@@ -4,6 +4,12 @@ datasets:
4
  - togethercomputer/RedPajama-Data-1T
5
  ---
6
 
 
 
 
 
 
 
7
  # OpenLLaMA: An Open Reproduction of LLaMA
8
 
9
 
 
4
  - togethercomputer/RedPajama-Data-1T
5
  ---
6
 
7
+ [<img src="https://raw.githubusercontent.com/OpenAccess-AI-Collective/axolotl/main/image/axolotl-badge-web.png" alt="Built with Axolotl" width="200" height="32"/>](https://github.com/OpenAccess-AI-Collective/axolotl)
8
+ Questions, comments, feedback, looking to donate, or want to help? Reach out on our [Discord](https://discord.gg/PugNNHAF5r) or email [wing@openaccessaicollective.org](mailto:wing@openaccessaicollective.org)
9
+
10
+ OpenLLaMA extended to 4k context using X-Pos RoPE with the RedPajama Sample dataset. (this is still a preview from about 35% training)
11
+
12
+
13
  # OpenLLaMA: An Open Reproduction of LLaMA
14
 
15