ikala
/

redpajama-3b-chat

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

ikala-ray commited on May 25, 2023

Commit

23a1d76

•

1 Parent(s): d11fc53

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -66,7 +66,7 @@ start generating the assistant reply.
 - base model: [togethercomputer/RedPajama-INCITE-Base-3B-v1](https://huggingface.co/togethercomputer/RedPajama-INCITE-Base-3B-v1)
 - checkpoint: 1 epoch (6000 steps)
-command: `deepspeed trainer_sft.py --configs defaults stablelm-7b oasst-mix --cache_dir /home/ubuntu/data_cache --output_dir .saved/stable-lm-7b-1 --num_train_epochs 4 --deepspeed`
 data:
 ```

 - base model: [togethercomputer/RedPajama-INCITE-Base-3B-v1](https://huggingface.co/togethercomputer/RedPajama-INCITE-Base-3B-v1)
 - checkpoint: 1 epoch (6000 steps)
+command: `deepspeed trainer_sft.py --configs defaults redpajama-3b datasets --num_train_epochs 2 --deepspeed`
 data:
 ```