togethercomputer
/

Pythia-Chat-Base-7B

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

juewang commited on Mar 24, 2023

Commit

fa62984

•

1 Parent(s): 2ebb61e

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -11,7 +11,7 @@ language:
 > TLDR: As part of OpenChatKit (codebase available [here](https://github.com/togethercomputer/OpenChaT)),
 > Pythia-Chat-Base-7B-v0.16 is a 7B parameter language model, fine-tuned from EleutherAI’s Pythia 7B with over 40 million instructions on 100% carbon negative compute.
-Pythia-Chat-Base-7B-v0.16 is based on ElutherAI’s GPT-NeoX model, and is fine-tuned with data focusing on dialog-style interactions.
 We focused the tuning on several tasks such as question answering, classification, extraction, and summarization.
 We’ve fine-tuned the model with a collection of 43 million high-quality instructions.
 Together partnered with LAION and Ontocord.ai, who both helped curate the dataset the model is based on.

 > TLDR: As part of OpenChatKit (codebase available [here](https://github.com/togethercomputer/OpenChaT)),
 > Pythia-Chat-Base-7B-v0.16 is a 7B parameter language model, fine-tuned from EleutherAI’s Pythia 7B with over 40 million instructions on 100% carbon negative compute.
+Pythia-Chat-Base-7B-v0.16 is based on ElutherAI’s Pythia-7B model, and is fine-tuned with data focusing on dialog-style interactions.
 We focused the tuning on several tasks such as question answering, classification, extraction, and summarization.
 We’ve fine-tuned the model with a collection of 43 million high-quality instructions.
 Together partnered with LAION and Ontocord.ai, who both helped curate the dataset the model is based on.