The conversion script to 8 shards and 8 tensor parrallels
#1
by
RobertKe
- opened
May I ask how do you convert the model to 8 shards and 8 tps? Thank you very much~
May I ask how do you convert the model to 8 shards and 8 tps? Thank you very much~