juewang commited on
Commit
d2362a6
1 Parent(s): 7e384d9

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +5 -0
README.md CHANGED
@@ -2,11 +2,16 @@
2
  license: apache-2.0
3
  language:
4
  - en
 
 
 
 
5
  ---
6
 
7
  # RedPajama-INCITE-Instruct-3B-v1
8
 
9
  RedPajama-INCITE-Instruct-3B-v1, is a large transformer-based language model developed by Together Computer and trained on the RedPajama-Data-1T dataset.
 
10
 
11
  ## Model Details
12
  - **Developed by**: Together Computer.
 
2
  license: apache-2.0
3
  language:
4
  - en
5
+ datasets:
6
+ - togethercomputer/RedPajama-Data-1T
7
+ - Muennighoff/P3
8
+ - Muennighoff/natural-instructions
9
  ---
10
 
11
  # RedPajama-INCITE-Instruct-3B-v1
12
 
13
  RedPajama-INCITE-Instruct-3B-v1, is a large transformer-based language model developed by Together Computer and trained on the RedPajama-Data-1T dataset.
14
+ The model was further fine-tuned on the data of [GPT-JT](https://huggingface.co/togethercomputer/GPT-JT-6B-v1), with exclusion of tasks that overlap with the HELM core scenarios.
15
 
16
  ## Model Details
17
  - **Developed by**: Together Computer.