juewang commited on
Commit
78f7e48
1 Parent(s): f5e6c75

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +17 -0
README.md CHANGED
@@ -191,6 +191,23 @@ Please refer to [togethercomputer/RedPajama-Data-1T](https://huggingface.co/data
191
 
192
  Please refer to our [blog post](https://together.xyz) for benchmark results.
193
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
194
  ## Community
195
 
196
  Join us on [Together Discord](https://discord.gg/6ZVDU8tTD4)
 
191
 
192
  Please refer to our [blog post](https://together.xyz) for benchmark results.
193
 
194
+ ## Intermediate Checkpoints
195
+
196
+ We provide 11 intermediate checkpoints that have been released for study.
197
+ The checkpoints are organized based on the number of tokens they contain, ranging from 240 billion tokens to 1 trillion tokens.
198
+
199
+ - [240b_tokens](https://huggingface.co/togethercomputer/RedPajama-INCITE-7B-Base/tree/240b_tokens)
200
+ - [280b_tokens](https://huggingface.co/togethercomputer/RedPajama-INCITE-7B-Base/tree/280b_tokens)
201
+ - [400b_tokens](https://huggingface.co/togethercomputer/RedPajama-INCITE-7B-Base/tree/400b_tokens)
202
+ - [440b_tokens](https://huggingface.co/togethercomputer/RedPajama-INCITE-7B-Base/tree/440b_tokens)
203
+ - [500b_tokens](https://huggingface.co/togethercomputer/RedPajama-INCITE-7B-Base/tree/500b_tokens)
204
+ - [600b_tokens](https://huggingface.co/togethercomputer/RedPajama-INCITE-7B-Base/tree/600b_tokens)
205
+ - [700b_tokens](https://huggingface.co/togethercomputer/RedPajama-INCITE-7B-Base/tree/700b_tokens)
206
+ - [720b_tokens](https://huggingface.co/togethercomputer/RedPajama-INCITE-7B-Base/tree/720b_tokens)
207
+ - [960b_tokens](https://huggingface.co/togethercomputer/RedPajama-INCITE-7B-Base/tree/960b_tokens)
208
+ - [1t_tokens](https://huggingface.co/togethercomputer/RedPajama-INCITE-7B-Base/tree/1t_tokens)
209
+ - [latest](https://huggingface.co/togethercomputer/RedPajama-INCITE-7B-Base/tree/main)
210
+
211
  ## Community
212
 
213
  Join us on [Together Discord](https://discord.gg/6ZVDU8tTD4)