Matt's picture

6 9

Matt

mo137

·

AI & ML interests

None yet

Organizations

None yet

mo137's activity

New activity in NyxKrage/LLM-Model-VRAM-Calculator 3 months ago

lazy bandaid to fix Mistral's gated config.json being inaccessible

#4 opened 3 months ago by

broken

#3 opened 3 months ago by

New activity in pyp1/VoiceCraft 4 months ago

Safetensors?

#3 opened 4 months ago by

New activity in NyxKrage/LLM-Model-VRAM-Calculator 4 months ago

Add support for EXL2 4 bit KV cache; switch from metric gigabytes (1e9 bytes) to JEDEC gigabytes (2^30 bytes)

#2 opened 4 months ago by

New activity in LoneStriker/Mixtral_34Bx2_MoE_60B-3.0bpw-h6-exl2 7 months ago

Can you make a 2.4bpw quantization?

#1 opened 7 months ago by

New activity in fblgit/una-cybertron-7b-v2-bf16 7 months ago

Context length

#5 opened 8 months ago by