zhangirazerbayev commited on
Commit
0971c99
1 Parent(s): 3bcdc4e

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +1 -1
README.md CHANGED
@@ -14,7 +14,7 @@ datasets:
14
  # ProofGPT-v0.1
15
 
16
  # Model Description
17
- ProofGPT-v0.1 is a 1.3B parameter language model based on the GPT-NeoX architecture and trained on the [proof-pile](https://huggingface.co/datasets/hoskinson-center/proof-pile).
18
  The model is initialized with [pythia-1.3b](https://huggingface.co/EleutherAI/pythia-1.3b) weights. ProofGPT-v0.1's Weights & Biases training log is viewable [here](https://wandb.ai/zhangir-azerbayev/math-lm/groups/1.3B%20preliminary_227qly9c/workspace?workspace=user-zhangir-azerbayev).
19
 
20
  Detailed evaluations coming soon :)
 
14
  # ProofGPT-v0.1
15
 
16
  # Model Description
17
+ ProofGPT-v0.1 is a 1.3B parameter language model based on the GPT-NeoX architecture and trained on the [proof-pile](https://huggingface.co/datasets/hoskinson-center/proof-pile) (v1.1).
18
  The model is initialized with [pythia-1.3b](https://huggingface.co/EleutherAI/pythia-1.3b) weights. ProofGPT-v0.1's Weights & Biases training log is viewable [here](https://wandb.ai/zhangir-azerbayev/math-lm/groups/1.3B%20preliminary_227qly9c/workspace?workspace=user-zhangir-azerbayev).
19
 
20
  Detailed evaluations coming soon :)