PrunaAI
/

microsoft-Phi-3-mini-128k-instruct-HQQ-4bit-smashed

Text Generation

Inference Endpoints

Model card Files Files and versions Community

microsoft-Phi-3-mini-128k-instruct-HQQ-4bit-smashed

1 contributor

History: 3 commits

sharpenb's picture

93310b6c3d65d01e853760265bc91e016c3386c2d3fa64ce6c12983addc13f41

ff0b71d verified 2 months ago

.gitattributes

1.52 kB

initial commit 2 months ago
README.md

5.56 kB

93310b6c3d65d01e853760265bc91e016c3386c2d3fa64ce6c12983addc13f41 2 months ago
added_tokens.json

293 Bytes

93310b6c3d65d01e853760265bc91e016c3386c2d3fa64ce6c12983addc13f41 2 months ago
config.json

3.44 kB

93310b6c3d65d01e853760265bc91e016c3386c2d3fa64ce6c12983addc13f41 2 months ago
plots.png

385 kB

93310b6c3d65d01e853760265bc91e016c3386c2d3fa64ce6c12983addc13f41 2 months ago
qmodel.pt
Detected Pickle imports (8)
- "torch.uint8",
- "torch.ByteStorage",
- "torch.Size",
- "torch._utils._rebuild_tensor_v2",
- "collections.OrderedDict",
- "torch.float16",
- "torch._utils._rebuild_parameter",
- "torch.HalfStorage"
How to fix it?
2.29 GB
LFS

75c1677fabe22baca8067198f4ea7c90d71d372daa8c292f8b29cf1b0e583dac 2 months ago
results.json

1.61 kB

93310b6c3d65d01e853760265bc91e016c3386c2d3fa64ce6c12983addc13f41 2 months ago
smash_config.json

1.02 kB

93310b6c3d65d01e853760265bc91e016c3386c2d3fa64ce6c12983addc13f41 2 months ago
special_tokens_map.json

569 Bytes

93310b6c3d65d01e853760265bc91e016c3386c2d3fa64ce6c12983addc13f41 2 months ago
tokenizer.json

1.84 MB

93310b6c3d65d01e853760265bc91e016c3386c2d3fa64ce6c12983addc13f41 2 months ago
tokenizer.model

500 kB
LFS

93310b6c3d65d01e853760265bc91e016c3386c2d3fa64ce6c12983addc13f41 2 months ago
tokenizer_config.json

3.19 kB

93310b6c3d65d01e853760265bc91e016c3386c2d3fa64ce6c12983addc13f41 2 months ago