Text Generation
Transformers
PyTorch
English
gpt_neox
text-generation-inference
Inference Endpoints
zhangce commited on
Commit
d7637b0
1 Parent(s): 0d401b5

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +4 -2
README.md CHANGED
@@ -10,8 +10,10 @@ datasets:
10
 
11
  # RedPajama-INCITE-Chat-3B-v1
12
 
13
- RedPajama-INCITE-Chat-3B-v1, is a large transformer-based language model developed by Together Computer and trained on the RedPajama-Data-1T dataset.
14
- It is further fine-tuned on OASST1 and Dolly2 to enhance chatting ability.
 
 
15
 
16
  ## Model Details
17
  - **Developed by**: Together Computer.
 
10
 
11
  # RedPajama-INCITE-Chat-3B-v1
12
 
13
+ RedPajama-INCITE-Chat-3B-v1 was developed by Together and leaders from the open-source AI community including Ontocord.ai, ETH DS3Lab, AAI CERC, Université de Montréal, MILA - Québec AI Institute, Stanford Center for Research on Foundation Models (CRFM), Stanford Hazy Research research group and LAION.
14
+ The training was done on 3,072 V100 GPUs provided as part of the INCITE 2023 project on Scalable Foundation Models for Transferrable Generalist AI, awarded to MILA, LAION, and EleutherAI in fall 2022, with support from the Oak Ridge Leadership Computing Facility (OLCF) and INCITE program.
15
+
16
+ It is fine-tuned on OASST1 and Dolly2 to enhance chatting ability.
17
 
18
  ## Model Details
19
  - **Developed by**: Together Computer.