lucadiliello's picture
Create README.md
992f316
|
raw
history blame
730 Bytes

This is a copy of the original OPT weights that is more efficient to use with the DeepSpeed-MII and DeepSpeed-Inference. In this repo the original tensors are split into 2 shards to target 2 GPUs, this allows the user to run the model with DeepSpeed-inference Tensor Parallelism.

For specific details about the OPT model itself, please see the original OPT model card.

For examples on using this repo please see the following: