mobiuslabsgmbh
/

Mixtral-8x7B-Instruct-v0.1-hf-attn-4bit-moe-2bit-metaoffload-HQQ

Text Generation

Mixture of Experts

Model card Files Files and versions Community

Mixtral-8x7B-Instruct-v0.1-hf-attn-4bit-moe-2bit-metaoffload-HQQ

2 contributors

History: 3 commits

mobicham's picture

upload model

6d3c872 10 months ago

.gitattributes

1.52 kB

initial commit 10 months ago
README.md

2.76 kB

Update README.md 10 months ago
config.json

773 Bytes

upload model 10 months ago
qmodel.pt
Detected Pickle imports (7)
- "torch.ByteStorage",
- "torch._utils._rebuild_parameter",
- "torch.Size",
- "torch._utils._rebuild_tensor_v2",
- "torch.HalfStorage",
- "collections.OrderedDict",
- "torch.float16"
How to fix it?
18.3 GB
LFS

upload model 10 months ago
special_tokens_map.json

414 Bytes

upload model 10 months ago
tokenizer.json

1.8 MB

upload model 10 months ago
tokenizer.model

493 kB
LFS

upload model 10 months ago
tokenizer_config.json

1.46 kB

upload model 10 months ago