lucadiliello
/

opt-30b-deepspeed-inference-fp16-shard-8

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

opt-30b-deepspeed-inference-fp16-shard-8

Commit History

Update ds_inference_config.json

4fc9560

lucadiliello commited on Mar 22, 2023

added tp sharded ckpts

0e3cd21

lucadiliello commited on Mar 21, 2023

Create README.md

ff546ce

lucadiliello commited on Mar 21, 2023

Upload LICENSE.md

e502dd6

lucadiliello commited on Mar 21, 2023

initial commit

abb5bc6

Luca Di Liello commited on Mar 21, 2023