ISTA-DASLab/Llama-2-7b-AQLM-2Bit-8x8-hf
Text Generation • 2B • Updated • 12
AI & ML interests
None defined yet.
Recent Activity
Papers
MatryoshkaLoRA: Learning Accurate Hierarchical Low-Rank Representations for LLM Fine-Tuning
GSQ: Highly-Accurate Low-Precision Scalar Quantization for LLMs via Gumbel-Softmax Sampling
ISTA-DASLab/Llama-2-7b-AQLM-2Bit-2x8-hf
Text Generation • 2B • Updated • 69 • 2
ISTA-DASLab/Llama-2-7b-AQLM-2Bit-1x16-hf
Text Generation • 1B • Updated • 264 • 5
ISTA-DASLab/Mixtral-8x7b-AQLM-2Bit-1x16-hf
Text Generation • 7B • Updated • 37 • 23
ISTA-DASLab/gemma-2b-AQLM-2Bit-2x8-hf
Text Generation • 1B • Updated • 12 • 4
ISTA-DASLab/gemma-2b-AQLM-2Bit-1x16-hf
Text Generation • 0.8B • Updated • 165 • 6
ISTA-DASLab/Mixtral-8x7B-Instruct-v0_1-AQLM-2Bit-1x16-hf
Text Generation • 7B • Updated • 11 • 19
ISTA-DASLab/Llama-2-13b-AQLM-4Bit-2x16-hf
Text Generation • Updated • 8
ISTA-DASLab/Llama-2-70b-AQLM-4Bit-2x16-hf
Text Generation • 18B • Updated • 9
ISTA-DASLab/switch-c-2048_qmoe
Updated • 5 • 4
ISTA-DASLab/switch-large-128_qmoe
Updated • 4
ISTA-DASLab/switch-base-128_qmoe
Updated • 4 • 1