aashush
/

quantized-local-llm-int8

Model card Files Files and versions Community

quantized-local-llm-int8

1 contributor

History: 2 commits

aashush's picture

commit files to HF hub

59a7396 4 months ago

.gitattributes

1.57 kB

commit files to HF hub 4 months ago
config.json

713 Bytes

commit files to HF hub 4 months ago
generation_config.json

132 Bytes

commit files to HF hub 4 months ago
model-00001-of-00003.safetensors

4.91 GB
LFS

commit files to HF hub 4 months ago
model-00002-of-00003.safetensors

4.98 GB
LFS

commit files to HF hub 4 months ago
model-00003-of-00003.safetensors

134 MB
LFS

commit files to HF hub 4 months ago
model.safetensors.index.json

13.5 kB

commit files to HF hub 4 months ago
pytorch_model.bin
Detected Pickle imports (8)
- "torch.QInt8Storage",
- "collections.OrderedDict",
- "torch.FloatStorage",
- "torch._utils._rebuild_tensor_v2",
- "torch._utils._rebuild_qtensor",
- "torch.per_tensor_affine",
- "torch.qint8",
- "torch.LongStorage"
How to fix it?
4.6 GB
LFS

commit files to HF hub 4 months ago
special_tokens_map.json

636 Bytes

commit files to HF hub 4 months ago
tokenizer.json

17.5 MB
LFS

commit files to HF hub 4 months ago
tokenizer_config.json

2.16 kB

commit files to HF hub 4 months ago