mobiuslabsgmbh
/

Mixtral-8x7B-Instruct-v0.1-hf-attn-4bit-moe-2bitgs8-metaoffload-HQQ

Text Generation

Mixture of Experts

Model card Files Files and versions Community

Mixtral-8x7B-Instruct-v0.1-hf-attn-4bit-moe-2bitgs8-metaoffload-HQQ

1 contributor

History: 5 commits

mobicham's picture

Update README.md

5f4deec verified about 12 hours ago

.gitattributes

1.52 kB

upload model 11 months ago
README.md

4.65 kB

Update README.md about 12 hours ago
config.json

773 Bytes

upload model 11 months ago
qmodel.pt
Detected Pickle imports (7)
- "torch._utils._rebuild_parameter",
- "torch._utils._rebuild_tensor_v2",
- "collections.OrderedDict",
- "torch.ByteStorage",
- "torch.HalfStorage",
- "torch.Size",
- "torch.float16"
How to fix it?
24.1 GB
LFS

upload model 11 months ago
special_tokens_map.json

414 Bytes

upload model 11 months ago
tokenizer.json

1.8 MB

upload model 11 months ago
tokenizer.model

493 kB
LFS

upload model 11 months ago
tokenizer_config.json

1.46 kB

upload model 11 months ago