ISTA-DASLab
/

Mixtral-8x7B-Instruct-v0_1-AQLM-2Bit-1x16-hf

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

Mixtral-8x7B-Instruct-v0_1-AQLM-2Bit-1x16-hf

Commit History

removed obsolete code

deec8ed

BlackSamorez commited on Feb 27, 2024

correct dtype + new dispatch + tokenizer

5133b63

BlackSamorez commited on Feb 27, 2024

Update README.md

ea1c68f
verified

BlackSamorez commited on Feb 19, 2024

Update README.md (#1)

9c3cec7
verified

SpiridonSunRotator commited on Feb 17, 2024

Upload MixtralForCausalLM

6bfb114
verified

BlackSamorez commited on Feb 17, 2024

initial commit

f273afb
verified

BlackSamorez commited on Feb 17, 2024