Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
lucadiliello
/
opt-30b-deepspeed-inference-fp16-shard-2
like
0
Text Generation
Transformers
opt
Inference Endpoints
text-generation-inference
Model card
Files
Files and versions
Community
Train
Deploy
Use this model
main
opt-30b-deepspeed-inference-fp16-shard-2
2 contributors
History:
7 commits
lucadiliello
Update ds_inference_config.json
7891f1a
about 1 year ago
.gitattributes
1.48 kB
initial commit
about 1 year ago
LICENSE.md
11.1 kB
Upload LICENSE.md
about 1 year ago
README.md
730 Bytes
Create README.md
about 1 year ago
config.json
749 Bytes
added tp sharded ckpts
about 1 year ago
ds_inference_config.json
487 Bytes
Update ds_inference_config.json
about 1 year ago
merges.txt
456 kB
added tp sharded ckpts
about 1 year ago
non-tp.pt
429 Bytes
LFS
added tp sharded ckpts
about 1 year ago
special_tokens_map.json
548 Bytes
added tp sharded ckpts
about 1 year ago
tokenizer_config.json
891 Bytes
added tp sharded ckpts
about 1 year ago
tp_00_00.pt
4.04 GB
LFS
added tp sharded ckpts
about 1 year ago
tp_00_01.pt
pickle
Detected Pickle imports (5)
"torch._utils._rebuild_tensor_v2"
,
"torch.FloatStorage"
,
"torch._utils._rebuild_parameter"
,
"torch.HalfStorage"
,
"collections.OrderedDict"
How to fix it?
3.7 GB
LFS
added tp sharded ckpts
about 1 year ago
tp_00_02.pt
pickle
Detected Pickle imports (5)
"torch._utils._rebuild_tensor_v2"
,
"collections.OrderedDict"
,
"torch._utils._rebuild_parameter"
,
"torch.FloatStorage"
,
"torch.HalfStorage"
How to fix it?
3.91 GB
LFS
added tp sharded ckpts
about 1 year ago
tp_00_03.pt
pickle
Detected Pickle imports (5)
"torch._utils._rebuild_tensor_v2"
,
"torch.FloatStorage"
,
"torch._utils._rebuild_parameter"
,
"torch.HalfStorage"
,
"collections.OrderedDict"
How to fix it?
3.7 GB
LFS
added tp sharded ckpts
about 1 year ago
tp_00_04.pt
pickle
Detected Pickle imports (5)
"torch._utils._rebuild_tensor_v2"
,
"torch._utils._rebuild_parameter"
,
"torch.FloatStorage"
,
"collections.OrderedDict"
,
"torch.HalfStorage"
How to fix it?
3.91 GB
LFS
added tp sharded ckpts
about 1 year ago
tp_00_05.pt
pickle
Detected Pickle imports (5)
"torch._utils._rebuild_tensor_v2"
,
"torch.FloatStorage"
,
"torch._utils._rebuild_parameter"
,
"torch.HalfStorage"
,
"collections.OrderedDict"
How to fix it?
3.7 GB
LFS
added tp sharded ckpts
about 1 year ago
tp_00_06.pt
pickle
Detected Pickle imports (5)
"torch._utils._rebuild_tensor_v2"
,
"torch.FloatStorage"
,
"torch._utils._rebuild_parameter"
,
"torch.HalfStorage"
,
"collections.OrderedDict"
How to fix it?
3.7 GB
LFS
added tp sharded ckpts
about 1 year ago
tp_00_07.pt
pickle
Detected Pickle imports (5)
"torch._utils._rebuild_tensor_v2"
,
"collections.OrderedDict"
,
"torch._utils._rebuild_parameter"
,
"torch.FloatStorage"
,
"torch.HalfStorage"
How to fix it?
4.42 GB
LFS
added tp sharded ckpts
about 1 year ago
tp_01_00.pt
pickle
Detected Pickle imports (5)
"torch.HalfStorage"
,
"collections.OrderedDict"
,
"torch._utils._rebuild_tensor_v2"
,
"torch.FloatStorage"
,
"torch._utils._rebuild_parameter"
How to fix it?
4.04 GB
LFS
added tp sharded ckpts
about 1 year ago
tp_01_01.pt
pickle
Detected Pickle imports (5)
"torch._utils._rebuild_tensor_v2"
,
"torch.HalfStorage"
,
"torch.FloatStorage"
,
"collections.OrderedDict"
,
"torch._utils._rebuild_parameter"
How to fix it?
3.7 GB
LFS
added tp sharded ckpts
about 1 year ago
tp_01_02.pt
pickle
Detected Pickle imports (5)
"torch.HalfStorage"
,
"torch._utils._rebuild_tensor_v2"
,
"collections.OrderedDict"
,
"torch._utils._rebuild_parameter"
,
"torch.FloatStorage"
How to fix it?
3.91 GB
LFS
added tp sharded ckpts
about 1 year ago
tp_01_03.pt
pickle
Detected Pickle imports (5)
"torch._utils._rebuild_tensor_v2"
,
"collections.OrderedDict"
,
"torch.HalfStorage"
,
"torch.FloatStorage"
,
"torch._utils._rebuild_parameter"
How to fix it?
3.7 GB
LFS
added tp sharded ckpts
about 1 year ago
tp_01_04.pt
pickle
Detected Pickle imports (5)
"torch._utils._rebuild_tensor_v2"
,
"torch.HalfStorage"
,
"collections.OrderedDict"
,
"torch.FloatStorage"
,
"torch._utils._rebuild_parameter"
How to fix it?
3.91 GB
LFS
added tp sharded ckpts
about 1 year ago
tp_01_05.pt
pickle
Detected Pickle imports (5)
"collections.OrderedDict"
,
"torch.FloatStorage"
,
"torch._utils._rebuild_parameter"
,
"torch.HalfStorage"
,
"torch._utils._rebuild_tensor_v2"
How to fix it?
3.7 GB
LFS
added tp sharded ckpts
about 1 year ago
tp_01_06.pt
pickle
Detected Pickle imports (5)
"torch._utils._rebuild_parameter"
,
"collections.OrderedDict"
,
"torch.HalfStorage"
,
"torch.FloatStorage"
,
"torch._utils._rebuild_tensor_v2"
How to fix it?
3.7 GB
LFS
added tp sharded ckpts
about 1 year ago
tp_01_07.pt
pickle
Detected Pickle imports (5)
"torch.HalfStorage"
,
"torch._utils._rebuild_parameter"
,
"collections.OrderedDict"
,
"torch.FloatStorage"
,
"torch._utils._rebuild_tensor_v2"
How to fix it?
4.42 GB
LFS
added tp sharded ckpts
about 1 year ago
vocab.json
999 kB
added tp sharded ckpts
about 1 year ago
