Hugging Face's logo
Lone Striker's picture
208 5

Lone Striker

LoneStriker
neobbster's profile picture mikjee's profile picture mapring's profile picture
·

AI & ML interests

None yet

Organizations

unalignment's profile picture MLX Community's profile picture

LoneStriker's activity

New activity in LoneStriker/DeepSeek-Coder-V2-Instruct-GGUF 2 months ago

How good is the gguf?

3
#3 opened 2 months ago by Tom-Neverwinter
New activity in deepseek-ai/DeepSeek-Coder-V2-Lite-Instruct 2 months ago

Exl Quants please

1
#5 opened 2 months ago by rjmehta
New activity in gghfez/WizardLM-2-8x22B-Beige-GGUF 2 months ago

exl2

3
#1 opened 2 months ago by DmitryPLSKN
New activity in LoneStriker/Smaug-Llama-3-70B-Instruct-32K-4.65bpw-h6-exl2 2 months ago

4.25bpw version

4
#1 opened 3 months ago by Apel-sin
New activity in ND911/Maiden-Unquirked-20B 3 months ago

Exl Quant Request

2
#1 opened 5 months ago by Clevyby
New activity in LoneStriker/Qwen2-72B-Instruct-5.0bpw-h6-exl2 3 months ago

ExLlamaV2 inference questions

2
#1 opened 3 months ago by shawei3000
New activity in LoneStriker/SOLAR-10.7B-Instruct-v1.0-uncensored-6.0bpw-h6-exl2-2 3 months ago

have a question

2
#1 opened 3 months ago by LittenBuzz
New activity in LoneStriker/Tess-2.0-Llama-3-70B-6.0bpw-h6-exl2 3 months ago

measurement file please?

1
#1 opened 4 months ago by p1kp4k
New activity in LoneStriker/llama-3-70B-Instruct-abliterated-6.0bpw-h6-exl2 4 months ago

did you have to do anything special to quantize this one?

1
#1 opened 4 months ago by gghfez
New activity in LoneStriker/Llama-3-70B-Instruct-DPO-v0.4-2.4bpw-h6-exl2 4 months ago

Exl2 Quants of tdrussell/Llama-3-70B-Instruct-Storywriter?

5
#1 opened 4 months ago by binahz
New activity in LoneStriker/Llama-3-70B-Instruct-Gradient-262k-2.4bpw-h6-exl2 4 months ago

2.25 bpw

2
#1 opened 4 months ago by eldodemi2039
New activity in MaziyarPanahi/calme-2.4-llama3-70b 4 months ago

Exl2 quants please

3
#8 opened 4 months ago by rjmehta
New activity in LoneStriker/Meta-Llama-3-70B-Instruct-GGUF 4 months ago

Endless generation

3
#1 opened 4 months ago by qenthousiast
New activity in LoneStriker/Meta-Llama-3-70B-Instruct-2.4bpw-h6-exl2 4 months ago

Lower quants

1
#1 opened 4 months ago by Desm0nt
New activity in Undi95/Meta-Llama-3-70B-Instruct-hf 4 months ago

exl2 quants

3
#1 opened 4 months ago by Wsdfsdf
New activity in LoneStriker/Meta-Llama-3-8B-Instruct-8.0bpw-h8-exl2 4 months ago

eos_token should be <|eot_id|>

5
#1 opened 4 months ago by AUTOMATIC
New activity in dreamgen/opus-v1.2-llama-3-8b 4 months ago

Best model for RP I have ever tried

12
#2 opened 4 months ago by Franchu
New activity in LoneStriker/Fimbulvetr-10.7B-v1-6.0bpw-h6-exl2 5 months ago

The model is great but then suddenly writes weird

2
#1 opened 5 months ago by Flickaboo
New activity in LoneStriker/Liberated-Qwen1.5-72B-6.0bpw-h6-exl2 5 months ago

How come I can't

3
#1 opened 5 months ago by BigHuggyD
New activity in liminerity/M7-7b 5 months ago

Exl2 Quants

1
#3 opened 5 months ago by rjmehta
New activity in athirdpath/Harmonia-no_robots-20b 5 months ago

Exl quant request

2
#1 opened 5 months ago by Clevyby
New activity in alchemonaut/BoreanGale-70B 6 months ago

exl2 please

2
#3 opened 6 months ago by zypcastles
New activity in LoneStriker/Iambe-RP-v3-20b-8.0bpw-h8-exl2 6 months ago

Exl quant request

3
#1 opened 6 months ago by Clevyby
New activity in LoneStriker/Fimbulvetr-11B-v2-5.0bpw-h6-exl2 6 months ago

32k Context?

2
#1 opened 6 months ago by swiftwater
New activity in LoneStriker/OpenCodeInterpreter-DS-6.7B-GGUF 6 months ago

How can i transform an .safetensor to .gguf file?

2
#1 opened 6 months ago by NoneGG
New activity in LoneStriker/opus-v0.5-70b-2.4bpw-h6-exl2 6 months ago

Request for dreamgen/opus-v1.2-70b

3
#1 opened 6 months ago by homeworkace
New activity in abacusai/Liberated-Qwen1.5-72B 6 months ago

GPTQ/AWQ quant that is runable in vllm?

2
#4 opened 6 months ago by Light4Bear
New activity in LoneStriker/miqu-1-103b-2.4bpw-h6-exl2 6 months ago

Any way to speed up generation on a Windows 11 PC, using a single 24GB card (4090), with Text-Generation-WebUI

2
#2 opened 6 months ago by clevnumb
New activity in LoneStriker/goliath-120b-2.18bpw-h6-exl2 6 months ago

Will this fit on a single 24GB Video card (4090)?

1
#2 opened 6 months ago by clevnumb
New activity in abideen/Liberated-Miqu-70B 6 months ago

exl2 quants

1
#1 opened 6 months ago by Wsdfsdf
New activity in saltlux/luxia-21.4b-alignment-v1.0 6 months ago

Can you provide the EXL2 quantitative model?

1
#1 opened 6 months ago by xldistance
New activity in LoneStriker/Truthful_DPO_TomGrc_FusionNet_7Bx2_MoE_13B-4.0bpw-h6-exl2 6 months ago

License?

1
#1 opened 6 months ago by abipani
New activity in zhengr/MixTAO-7Bx2-MoE-v8.1 6 months ago

Create GGUF for this please

8
#2 opened 6 months ago by ishanparihar
New activity in altomek/Kaiju-11B-8bpw-EXL2 6 months ago

I really hope you do a 6bpw

2
#1 opened 6 months ago by bigfish3
New activity in LoneStriker/zephyr-7b-gemma-v0.1-GGUF 6 months ago

Tokens overrides (added_tokens_decoder)

2
#1 opened 6 months ago by dranger003
New activity in LoneStriker/miqu-1-103b-3.5bpw-h6-exl2 6 months ago

Update README.md
#1 opened 6 months ago by wolfram
New activity in LoneStriker/miqu-1-103b-3.0bpw-h6-exl2 6 months ago

Update README.md
#1 opened 6 months ago by wolfram
New activity in LoneStriker/miqu-1-103b-2.4bpw-h6-exl2 6 months ago

Update README.md
#1 opened 6 months ago by wolfram
New activity in LoneStriker/Air-Striker-Mixtral-8x7B-Instruct-ZLoss-3.75bpw-h6-exl2 6 months ago

What quantization is it? Can be used with vLLM?

1
#1 opened 6 months ago by rafa9
New activity in LoneStriker/Gemmalpaca-7B-GGUF 6 months ago

7b不如2b，不知道为什么，特别是写代码，和gemma一样乱，但是2b要好很多，不知道有没有和我一样的

1
#1 opened 6 months ago by laooopooo
New activity in LoneStriker/OpenCodeInterpreter-CL-34B-3.0bpw-h6-exl2 6 months ago

GGUF?

2
#1 opened 6 months ago by Vezora
New activity in wolfram/miqu-1-103b 6 months ago

Kindly asking for quants

7
#2 opened 6 months ago by wolfram
New activity in cloudyu/TomGrc_FusionNet_34Bx2_MoE_v0.1_DPO_f16 6 months ago

Can you produce a 2.4bpw exl2 quantisation of this model?

1
#2 opened 6 months ago by xldistance
New activity in LoneStriker/Gemmalpaca-7B-8.0bpw-h8-exl2 6 months ago

Wont load in TextGen Webui

1
#1 opened 6 months ago by GamingDaveUK
New activity in LoneStriker/opus-v1-34b-8.0bpw-h8-exl2 6 months ago

LMstudio config from description missing

1
#1 opened 6 months ago by ariffinsetya
New activity in LoneStriker/deepseek-coder-7b-instruct-v1.5-GGUF 6 months ago

Weirdness with offloading to VRAM

3
#3 opened 6 months ago by Bjorno
New activity in LoneStriker/Smaug-34B-v0.1-6.0bpw-h6-exl2 6 months ago

this model vs LoneStriker/Smaugv0.1-6.0bpw-h6-exl2

4
#1 opened 6 months ago by ainoob101
New activity in LoneStriker/LWM-Text-Chat-1M-AWQ 6 months ago

VRAM require

2
#1 opened 6 months ago by paperplanedeemo
New activity in LoneStriker/34b-beta-4.0bpw-h6-exl2 6 months ago

Which dataset used for quantization?

1
#1 opened 6 months ago by Yhyu13
New activity in jondurbin/bagel-34b-v0.4 6 months ago

Could you please quantify the model?

2
#1 opened 6 months ago by Serpen
New activity in LoneStriker/Qwen1.5-72B-Chat-GPTQ 6 months ago

exl2 quantization?

2
#1 opened 7 months ago by musicurgy
New activity in LoneStriker/Smaug-72B-v0.1-AWQ 6 months ago

Exl2 Quants?

3
#3 opened 7 months ago by eldodemi2039
New activity in LoneStriker/Smaug-72B-v0.1-GPTQ 6 months ago

exl2?

3
#1 opened 7 months ago by bdambrosio
New activity in LoneStriker/MiquMaid-v2-2x70B-DPO-GPTQ 6 months ago

Safetensor naming convention

10
#1 opened 7 months ago by dannysemi
New activity in CohereForAI/aya-101 6 months ago

🙏🏻Praying for Quantized

11
#12 opened 6 months ago by Tonic
New activity in appvoid/palmer-002.5 6 months ago

Guff

2
#1 opened 7 months ago by MarxistLeninist
New activity in LoneStriker/Senku-70B-Full-4.0bpw-h6-exl2 7 months ago

A minute bug

2
#1 opened 7 months ago by sethuiyer
New activity in LoneStriker/Smaug-34B-v0.1-8.0bpw-h8-exl2 7 months ago

Request for another exl Quant.

9
#1 opened 7 months ago by Clevyby
New activity in LoneStriker/Mistral-7B-Instruct-v0.2-Neural-Story-8.0bpw-h8-exl2 7 months ago

i want to quantize model exl2 and than finetune it

2
#1 opened 7 months ago by Mihir1108
New activity in LoneStriker/MiquMaid-v2-70B-DPO-4.65bpw-h6-exl2 7 months ago

This model have quantisation problem sometime (I think)

3
#1 opened 7 months ago by Belarrius