Hugging Face's logo
Iwan Kawrakow's picture
12

Iwan Kawrakow

ikawrakow
phi0112358's profile picture jackliv3r's profile picture ddh0's profile picture
·

AI & ML interests

None yet

Organizations

None yet

ikawrakow's activity

New activity in ikawrakow/various-2bit-sota-gguf 2 months ago

What 2bit quantization approach are you using?

1
#13 opened 2 months ago by ingridstevens
New activity in ikawrakow/mixtral-instruct-8x7b-quantized-gguf 3 months ago

Dataset for importance matrix?

4
#3 opened 3 months ago by RamoreRemora
New activity in ikawrakow/mixtral-8x7b-quantized-gguf 3 months ago

Broken M quants

1
#2 opened 3 months ago by Artefact2
New activity in ikawrakow/various-2bit-sota-gguf 4 months ago

What -ctx and -chunks parameters did you use to make the iMatrix of the Lllama 2 70b?

1
#9 opened 4 months ago by Nexesenex

Would love a deepseekcode 2bit quant. I bet others would love it too :)

2
#6 opened 4 months ago by subiculumforge

[Model request] Saily 100b, Saily 220b

1
#5 opened 4 months ago by Perpetuity7

Could We combine AWQ and Importance Matrix calculation together to further improve perplexity.

3
#4 opened 4 months ago by shing3232
New activity in ikawrakow/mixtral-instruct-8x7b-quantized-gguf 4 months ago

mixtral-instruct-8x7b-q3k-medium.gguf

4
#2 opened 4 months ago by cmh
New activity in ikawrakow/open-hermes-2.5-mistral-7b-quantized-gguf 4 months ago

SOTA 2-Quant of Nous-Heremes-Solar-10.7B and Nous-Hermes-2-Yi-34B, Please 🙏

4
#1 opened 4 months ago by Joseph717171
New activity in ikawrakow/various-2bit-sota-gguf 4 months ago

Please 3b model rocket 2bit?

17
#1 opened 4 months ago by Shqmil
New activity in ikawrakow/mixtral-instruct-8x7b-quantized-gguf 4 months ago

Q5_1 & Q5_K_M quant

3
#1 opened 4 months ago by muzika38
New activity in ikawrakow/mixtral-8x7b-quantized-gguf 4 months ago

Mixtral Instruct quant

3
#1 opened 4 months ago by cmh