Hugging Face's logo
Michael Radermacher's picture
256 6

Michael Radermacher

mradermacher
bubblegutz's profile picture xprizm's profile picture killmister's profile picture
·

AI & ML interests

Trying to fill the gaps with static and imatrix GGUF quantizations, especially of older, possibly obscure models, or big models that are hard to quantize/run. Feel free to suggest models (e.g. by opening an issue on the model_requests model)

Organizations

None yet

mradermacher's activity

New activity in mradermacher/Fimburs11V3-i1-GGUF about 2 hours ago

Tested Fimburs11V3.i1-IQ3_XXS.gguf - Unsuable
#1 opened about 3 hours ago by chew1976
New activity in mradermacher/model_requests about 4 hours ago

SanjiWatsuki/Silicon-Maid-7B high perplexity

16
#70 opened 6 days ago by yttria
New activity in mradermacher/JSL-MedMNX-7B-GGUF about 4 hours ago

Thanks and Question about quanting...

16
#1 opened about 2 months ago by DavidAU
New activity in mradermacher/model_requests about 4 hours ago

nbeerbower/llama-3-SNAMD-8B

1
#79 opened about 9 hours ago by snoopynoob
New activity in mradermacher/model_requests about 9 hours ago

archangel_sft-kto_llama30b ?

6
#78 opened 1 day ago by Elfrino
New activity in mradermacher/Kancil-V1-llama3-fp16-GGUF about 9 hours ago

Usage info

1
#1 opened about 13 hours ago by catinthebag
New activity in mradermacher/llama-3-MagicDolphin-8B-GGUF about 14 hours ago

requires newer version of koboldcpp

3
#1 opened about 14 hours ago by lemon07r
New activity in HiroseKoichi/Llama-Salad-4x8B-V2 1 day ago

model.safetensors.index.json missing?

2
#1 opened 1 day ago by mradermacher
New activity in mradermacher/quill-72b-GGUF 1 day ago

Model info

1
#1 opened 1 day ago by colourspec
New activity in mradermacher/llama-3-spicy-abliterated-stella-8B-GGUF 1 day ago

Imatrix quants

1
#1 opened 1 day ago by hirosenn
New activity in mradermacher/L3-SnowStorm-v1.15-4x8B-A-i1-GGUF 1 day ago

GGUF Defect? | unknown pre-tokenizer type: 'smaug-bpe'

1
#1 opened 2 days ago by Skydea
New activity in mradermacher/model_requests 2 days ago

Quill 72b (safetensors?)

2
#77 opened 2 days ago by leafspark
New activity in mradermacher/WizardLM-2-8x22B-i1-GGUF 2 days ago

error

1
#3 opened 2 days ago by na556
New activity in mradermacher/model_requests 2 days ago

cognitivecomputations/dolphin-2.9.2-mixtral-8x22b

2
#76 opened 2 days ago by OrangeApples
New activity in mradermacher/model_requests 3 days ago

hikikomoriHaven/llama3-8b-hikikomori-v0.3

1
#75 opened 3 days ago by woofwolfy

https://huggingface.co/ChuckMcSneed/dolphin-2.9.1-dbrx-llamacppfixed

1
#74 opened 3 days ago by nicoboss
New activity in mradermacher/model_requests 4 days ago

More experiments 😸

1
#73 opened 4 days ago by saishf

Could you quantize those please?

1
#72 opened 4 days ago by xxx777xxxASD
New activity in mradermacher/JSL-MedMX-7X-GGUF 4 days ago

JSL-MedPhi2

5
#1 opened 18 days ago by eleius
New activity in mradermacher/model_requests 5 days ago

https://huggingface.co/fblgit/UNA-ThePitbull-21.4-v1

4
#71 opened 6 days ago by Dsol58

Model Request - https://huggingface.co/fblgit/UNA-ThePitbull-21.4-v1

5
#69 opened 6 days ago by USM-Valor
New activity in mradermacher/Llama-3-8B-shisa-2x8B-GGUF 5 days ago

Japanese iMatrix dataset

1
#1 opened 5 days ago by keitokei1994
New activity in ryzen88/Llama-3-70b-Uncensored-Lumi-Tess-gradient 5 days ago

Anyway to make gguf's? :)

5
#1 opened 18 days ago by vdruts
New activity in crestf411/L3-70B-daybreak-abliterated-v0.4 5 days ago

sweet nothings

2
#1 opened 5 days ago by mradermacher
New activity in mradermacher/Mahou-1.2a-llama3-8B-GGUF 6 days ago

Imatrix quants?

1
#1 opened 6 days ago by hirosenn
New activity in mradermacher/Llama-Salad-4x8B-i1-GGUF 7 days ago

Thank you!

3
#1 opened 7 days ago by HiroseKoichi
New activity in mradermacher/c4ai-command-r-v01-GGUF 7 days ago

Request for imatrix version

1
#1 opened 7 days ago by xalkoi
New activity in mradermacher/Samantha-v5-wizardlm2-GGUF 7 days ago

thanks bro!

1
#1 opened 7 days ago by Guilherme34
New activity in mradermacher/model_requests 7 days ago

https://huggingface.co/jondurbin/bagel-dpo-20b-v04-llama

3
#67 opened 7 days ago by Cran-May

ryzen88/Llama-3-70b-Arimas-story-RP-V1

1
#68 opened 7 days ago by ryzen88
New activity in mradermacher/model_requests 8 days ago

Requesting smaller i Quants of Goliath 120B Longlora version OR assistance doing it on my own PC

20
#42 opened about 1 month ago by GoldenSun3DS

https://huggingface.co/PJMixers/LLaMa-3-CursedStock-v1.6-8B

1
#66 opened 8 days ago by xzuyn

im-request: Undi95/Llama-3-Chatty-2x8B (https://huggingface.co/Undi95/Llama-3-Chatty-2x8B)

3
#65 opened 8 days ago by xpgx1

Hastagaras/Halu-8B-Llama3-v0.3

2
#64 opened 8 days ago by Hastagaras

Could you quant maldv/badger-iota-llama-3-8b?

5
#63 opened 9 days ago by maldv
New activity in mradermacher/Llama-3-70Bx2-MOE-i1-GGUF 10 days ago

Stop token fix?

2
#1 opened 10 days ago by americancookie
New activity in mradermacher/model_requests 10 days ago

Help me quantize model

16
#57 opened 12 days ago by Alsebay
New activity in Archives/FabioA810-Llama-3-8B-ForexConcepts-GGUF 11 days ago

🚩 Report

1
#1 opened 11 days ago by FabioA810
New activity in mradermacher/model_requests 11 days ago

jukofyork/Dark-Miqu-120B

1
#62 opened 11 days ago by colourspec

Get well soon,man!!

1
#61 opened 12 days ago by OmnicromsBrain
New activity in mradermacher/model_requests 12 days ago

Quantization request

2
#60 opened 12 days ago by xxx777xxxASD
New activity in failspy/Smaug-Llama-3-70B-Instruct-abliterated-v3 12 days ago

missing tokenizer?

2
#1 opened 12 days ago by mradermacher
New activity in mradermacher/model_requests 12 days ago

Deep Miqu 103b- https://huggingface.co/jukofyork/Deep-Miqu-103B

2
#56 opened 13 days ago by Dsol58

MAmmoTH2 8x7B and MAmmoTH2 8x7B Plus

1
#58 opened 12 days ago by Erilaz

request: larger context (64/256) window on uncensored models

1
#59 opened 12 days ago by exquisiteart