Hugging Face's logo
Kooten's picture
TFLOPS icon 49.6 TFLOPS
22 2 16

Kooten

Kooten
Jules-Valentine's profile picture AtonMountlook's profile picture dog3-l0ver's profile picture
·
https://ko-fi.com/kooten

AI & ML interests

AI lobotomy

Organizations

None yet

Kooten's activity

New activity in Kooten/Kunoichi-DPO-v2-7B-6bpw-exl2 5 months ago

Help. Getting Gibberish Responses?

6
#1 opened 5 months ago by deleted
New activity in Kooten/BagelMIsteryTour-v2-8x7B-3.5bpw-exl2 5 months ago

Request for Higher 4bpw Quant

3
#1 opened 5 months ago by deleted
New activity in NeverSleep/MiquMaid-v2-70B-GGUF 5 months ago

Any plan of realeasing q2_k_s quants?

4
#1 opened 5 months ago by stduhpf
New activity in Kooten/MiquMaid-v1-70B-6bpw-exl2 5 months ago

can i request 8bpw?

1
#1 opened 5 months ago by Perpetuity7
New activity in Kooten/MiquMaid-v1-70B-IQ2-GGUF 5 months ago

Thanks man!

10
#1 opened 5 months ago by Nexesenex

Thank you so much for doing this chore. IQ2 > EXL2 @ <3bpw ?

1
#2 opened 5 months ago by ProphetOfBostrom
New activity in Kooten/MiquMaid-v1-70B-3bpw-exl2 5 months ago

More quant?

2
#1 opened 5 months ago by Kotokin
New activity in Kooten/DaringMaid-20B-V1.1 5 months ago

Request for another exl quant

2
#1 opened 5 months ago by Clevyby
New activity in Kooten/DaringMaid-13B 5 months ago

It Delivers!

2
#1 opened 5 months ago by LunarAura
New activity in Kooten/FlatDolphinMaid-8x7B-4bpw-exl2 5 months ago

using context above 4096 - need to set compress_pos_emb above 1?

5
#1 opened 6 months ago by Samvanity
New activity in Kooten/Euryale-1.4-L2-70B-IQ2-GGUF 6 months ago

Kobold can run IQ2

2
#1 opened 6 months ago by Nexesenex
New activity in Kooten/Noromaid-7B-0.4-DPO-4bpw-exl2 6 months ago

This is the other model that had the same problem to my knowledge.

2
#1 opened 6 months ago by Nitral-AI
New activity in Kooten/Lelantos-Maid-DPO-7B-4bpw-exl2 6 months ago

Thanks my dude <3

3
#1 opened 6 months ago by Nitral-AI
New activity in Kooten/Noromaid-v0.4-Mixtral-Instruct-8x7b-Zloss-3.5bpw-exl2 6 months ago

VRAM usage & card recommendations

1
#1 opened 6 months ago by tensiondriven
New activity in Kooten/DaringMaid-20B 6 months ago

Thanks! I like this one :-)

1
#1 opened 6 months ago by ThiloteE
New activity in Kooten/FlatOrcamaid-13b-v0.2-4bit-mlx 6 months ago

exllama version?

2
#1 opened 6 months ago by Nexesenex
New activity in Kooten/DaringMaid-20B-GGUF 6 months ago

Which version of noromaid 0.2 or 0.1 ?

1
#2 opened 6 months ago by anmol989
New activity in Kooten/Clover3-17B-4bpw-exl2 7 months ago

3bpw?

2
#1 opened 7 months ago by idkman2
New activity in Kooten/DaringMaid-20B-GGUF 7 months ago

Suggestion for Instruction Following Model

2
#1 opened 7 months ago by PrimeD
New activity in Kooten/MLewd-ReMM-L2-Chat-20B-6bpw-exl2 8 months ago

FileNotFoundError: No such file or directory: model-00001-of-00021.safetensors"

1
#2 opened 8 months ago by maB-2
New activity in Kooten/MLewd-ReMM-L2-Chat-20B-3bpw-exl2 9 months ago

Thanks!

3
#1 opened 9 months ago by SekkSea
New activity in Kooten/MLewd-ReMM-L2-Chat-20B-6bpw-exl2 9 months ago

Hello

2
#1 opened 9 months ago by CulturedMan