khoicrtp
/

cog-llama-test

Model card Files Files and versions Community

khoicrtp commited on May 22, 2023

Commit

45bb876

•

1 Parent(s): 7382135

Update train_model.sh

Files changed (1) hide show

train_model.sh +0 -1

train_model.sh CHANGED Viewed

@@ -19,4 +19,3 @@ torchrun --nproc_per_node=1 --master_port=9292 train.py \
     --logging_steps 1 \
     --fsdp "full_shard auto_wrap" \
     --fsdp_transformer_layer_cls_to_wrap 'LLaMADecoderLayer' \
-    --tf32 True \

     --logging_steps 1 \
     --fsdp "full_shard auto_wrap" \
     --fsdp_transformer_layer_cls_to_wrap 'LLaMADecoderLayer' \