Hugging Face's logo

ikala
/
redpajama-3b-chat

Text Generation
Transformers
PyTorch
Safetensors
English
Chinese
Japanese
gpt_neox
sft
text-generation-inference
Inference Endpoints
Model card Files Community
1
ikala-ray commited on
Commit
b64a560
•
1 Parent(s): 7f33463

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +2 -0
README.md CHANGED
@@ -66,6 +66,8 @@ start generating the assistant reply.
66
 
67
  - base model: [togethercomputer/RedPajama-INCITE-Base-3B-v1](https://huggingface.co/togethercomputer/RedPajama-INCITE-Base-3B-v1)
68
  - checkpoint: 1 epoch (6000 steps)
 
 
69
 
70
  command: `deepspeed trainer_sft.py --configs defaults redpajama-3b datasets --num_train_epochs 2 --deepspeed`
71
 
 
66
 
67
  - base model: [togethercomputer/RedPajama-INCITE-Base-3B-v1](https://huggingface.co/togethercomputer/RedPajama-INCITE-Base-3B-v1)
68
  - checkpoint: 1 epoch (6000 steps)
69
+ - hardware: NVIDIA RTX A6000 x 4
70
+
71
 
72
  command: `deepspeed trainer_sft.py --configs defaults redpajama-3b datasets --num_train_epochs 2 --deepspeed`
73