kittn
/

Meta-Llama-3-70B-quant

Text Generation

Inference Endpoints

text-generation-inference

Model card Files Files and versions Community

Meta-Llama-3-70B-quant

1 contributor

History: 4 commits

kittn's picture

Upload HQQplus-2bit-gs32.pt with huggingface_hub

0a3462a verified about 1 month ago

.gitattributes

1.52 kB

initial commit about 1 month ago
HQQplus-2bit-gs32.pt
Detected Pickle imports (8)
- "collections.OrderedDict",
- "torch._utils._rebuild_tensor_v2",
- "torch.float16",
- "torch.HalfStorage",
- "torch._utils._rebuild_parameter",
- "torch.ByteStorage",
- "torch.uint8",
- "torch.Size"
How to fix it?
27.7 GB
LFS

Upload HQQplus-2bit-gs32.pt with huggingface_hub about 1 month ago
HQQplus-3bit-gs64.pt
Detected Pickle imports (10)
- "collections.OrderedDict",
- "torch._utils._rebuild_tensor_v2",
- "torch.float16",
- "torch.HalfStorage",
- "torch.int32",
- "torch._utils._rebuild_parameter",
- "torch.Size",
- "torch.IntStorage",
- "torch.uint8",
- "torch.ByteStorage"
How to fix it?
37.4 GB
LFS

Upload HQQplus-3bit-gs64.pt with huggingface_hub about 1 month ago
config.json

698 Bytes

Upload config.json with huggingface_hub about 1 month ago