Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
mobiuslabsgmbh
/
Mixtral-8x7B-Instruct-v0.1-hf-attn-4bit-moe-2bit-metaoffload-HQQ
like
14
Text Generation
Transformers
mixtral
Mixture of Experts
conversational
text-generation-inference
License:
apache-2.0
Model card
Files
Files and versions
Community
3
Train
Deploy
Use this model
main
Mixtral-8x7B-Instruct-v0.1-hf-attn-4bit-moe-2bit-metaoffload-HQQ
Commit History
Update README.md
78ace90
verified
mobicham
commited on
Feb 29
update qmodel with gs=128
cbbc082
mobicham
commited on
Feb 29
Update README.md
c4deccd
verified
mobicham
commited on
Feb 26
Update README.md
d8057bb
verified
mobicham
commited on
Feb 23
screencast
649cf7c
verified
appoose
commited on
Feb 23
adding streaming in the example provided
9ed79d7
verified
appoose
commited on
Feb 23
adding vram usage
48d4273
verified
appoose
commited on
Feb 23
adding initial metrics
956a729
verified
appoose
commited on
Feb 23
Update README.md
49119b7
verified
appoose
commited on
Feb 23
Update README.md
3d7f303
verified
mobicham
commited on
Feb 23
upload model
6d3c872
mobicham
commited on
Feb 23
Update README.md
8c0da45
verified
mobicham
commited on
Feb 23
initial commit
a671496
verified
mobicham
commited on
Feb 23
appoose
commited on
