Hugging Face's logo
Lone Striker's picture
201 5

Lone Striker

LoneStriker
hassuny's profile picture ramblinguy's profile picture gl198976's profile picture
·

AI & ML interests

None yet

Organizations

unalignment's profile picture MLX Community's profile picture

LoneStriker's activity

New activity in LoneStriker/Tess-2.0-Llama-3-70B-6.0bpw-h6-exl2 13 days ago

measurement file please?

1
#1 opened 24 days ago by p1kp4k
New activity in LoneStriker/llama-3-70B-Instruct-abliterated-6.0bpw-h6-exl2 24 days ago

did you have to do anything special to quantize this one?

1
#1 opened 24 days ago by gghfez
New activity in LoneStriker/Llama-3-70B-Instruct-DPO-v0.4-2.4bpw-h6-exl2 24 days ago

Exl2 Quants of tdrussell/Llama-3-70B-Instruct-Storywriter?

5
#1 opened 26 days ago by binahz
New activity in LoneStriker/Llama-3-70B-Instruct-Gradient-262k-2.4bpw-h6-exl2 26 days ago

2.25 bpw

2
#1 opened 28 days ago by eldodemi2039
New activity in MaziyarPanahi/Llama-3-70B-Instruct-DPO-v0.4 26 days ago

Exl2 quants please

3
#8 opened 26 days ago by rjmehta
New activity in LoneStriker/Meta-Llama-3-70B-Instruct-GGUF about 1 month ago

Endless generation

3
#1 opened about 1 month ago by qenthousiast
New activity in LoneStriker/Meta-Llama-3-70B-Instruct-2.4bpw-h6-exl2 about 1 month ago

Lower quants

1
#1 opened about 1 month ago by Desm0nt
New activity in Undi95/Meta-Llama-3-70B-Instruct-hf about 1 month ago

exl2 quants

3
#1 opened about 1 month ago by Wsdfsdf
New activity in LoneStriker/Meta-Llama-3-8B-Instruct-8.0bpw-h8-exl2 about 1 month ago

eos_token should be <|eot_id|>

5
#1 opened about 1 month ago by AUTOMATIC
New activity in dreamgen/opus-v1.2-llama-3-8b about 1 month ago

Best model for RP I have ever tried

12
#2 opened about 1 month ago by Franchu
New activity in LoneStriker/Fimbulvetr-10.7B-v1-6.0bpw-h6-exl2 about 2 months ago

The model is great but then suddenly writes weird

2
#1 opened 2 months ago by Flickaboo
New activity in LoneStriker/Liberated-Qwen1.5-72B-6.0bpw-h6-exl2 about 2 months ago

How come I can't

3
#1 opened 2 months ago by BigHuggyD
New activity in liminerity/M7-7b about 2 months ago

Exl2 Quants

1
#3 opened about 2 months ago by rjmehta
New activity in athirdpath/Harmonia-no_robots-20b 2 months ago

Exl quant request

2
#1 opened 2 months ago by Clevyby
New activity in alchemonaut/BoreanGale-70B 3 months ago

exl2 please

2
#3 opened 3 months ago by zypcastles
New activity in LoneStriker/Iambe-RP-v3-20b-8.0bpw-h8-exl2 3 months ago

Exl quant request

3
#1 opened 3 months ago by Clevyby
New activity in LoneStriker/Fimbulvetr-11B-v2-5.0bpw-h6-exl2 3 months ago

32k Context?

2
#1 opened 3 months ago by swiftwater
New activity in LoneStriker/OpenCodeInterpreter-DS-6.7B-GGUF 3 months ago

How can i transform an .safetensor to .gguf file?

2
#1 opened 3 months ago by NoneGG
New activity in LoneStriker/opus-v0.5-70b-2.4bpw-h6-exl2 3 months ago

Request for dreamgen/opus-v1.2-70b

3
#1 opened 3 months ago by homeworkace
New activity in abacusai/Liberated-Qwen1.5-72B 3 months ago

GPTQ/AWQ quant that is runable in vllm?

2
#4 opened 3 months ago by Light4Bear
New activity in LoneStriker/miqu-1-103b-2.4bpw-h6-exl2 3 months ago

Any way to speed up generation on a Windows 11 PC, using a single 24GB card (4090), with Text-Generation-WebUI

2
#2 opened 3 months ago by clevnumb
New activity in LoneStriker/goliath-120b-2.18bpw-h6-exl2 3 months ago

Will this fit on a single 24GB Video card (4090)?

1
#2 opened 3 months ago by clevnumb
New activity in abideen/Liberated-Miqu-70B 3 months ago

exl2 quants

1
#1 opened 3 months ago by Wsdfsdf
New activity in saltlux/luxia-21.4b-alignment-v1.0 3 months ago

Can you provide the EXL2 quantitative model?

1
#1 opened 3 months ago by xldistance
New activity in LoneStriker/Truthful_DPO_TomGrc_FusionNet_7Bx2_MoE_13B-4.0bpw-h6-exl2 3 months ago

License?

1
#1 opened 3 months ago by abipani
New activity in zhengr/MixTAO-7Bx2-MoE-v8.1 3 months ago

Create GGUF for this please

7
#2 opened 3 months ago by ishanparihar
New activity in altomek/Kaiju-11B-8bpw-EXL2 3 months ago

I really hope you do a 6bpw

2
#1 opened 3 months ago by bigfish3
New activity in LoneStriker/zephyr-7b-gemma-v0.1-GGUF 3 months ago

Tokens overrides (added_tokens_decoder)

2
#1 opened 3 months ago by dranger003
New activity in LoneStriker/miqu-1-103b-3.5bpw-h6-exl2 3 months ago

Update README.md
#1 opened 3 months ago by wolfram
New activity in LoneStriker/miqu-1-103b-3.0bpw-h6-exl2 3 months ago

Update README.md
#1 opened 3 months ago by wolfram
New activity in LoneStriker/miqu-1-103b-2.4bpw-h6-exl2 3 months ago

Update README.md
#1 opened 3 months ago by wolfram
New activity in LoneStriker/Air-Striker-Mixtral-8x7B-Instruct-ZLoss-3.75bpw-h6-exl2 3 months ago

What quantization is it? Can be used with vLLM?

1
#1 opened 3 months ago by rafa9
New activity in LoneStriker/Gemmalpaca-7B-GGUF 3 months ago

7b不如2b，不知道为什么，特别是写代码，和gemma一样乱，但是2b要好很多，不知道有没有和我一样的

1
#1 opened 3 months ago by laooopooo
New activity in LoneStriker/OpenCodeInterpreter-CL-34B-3.0bpw-h6-exl2 3 months ago

GGUF?

2
#1 opened 3 months ago by Vezora
New activity in wolfram/miqu-1-103b 3 months ago

Kindly asking for quants

7
#2 opened 3 months ago by wolfram
New activity in cloudyu/TomGrc_FusionNet_34Bx2_MoE_v0.1_DPO_f16 3 months ago

Can you produce a 2.4bpw exl2 quantisation of this model?

1
#2 opened 3 months ago by xldistance
New activity in LoneStriker/Gemmalpaca-7B-8.0bpw-h8-exl2 3 months ago

Wont load in TextGen Webui

1
#1 opened 3 months ago by GamingDaveUK
New activity in LoneStriker/opus-v1-34b-8.0bpw-h8-exl2 3 months ago

LMstudio config from description missing

1
#1 opened 3 months ago by ariffinsetya
New activity in LoneStriker/deepseek-coder-7b-instruct-v1.5-GGUF 3 months ago

Weirdness with offloading to VRAM

3
#3 opened 3 months ago by Bjorno
New activity in LoneStriker/Smaug-34B-v0.1-6.0bpw-h6-exl2 3 months ago

this model vs LoneStriker/Smaugv0.1-6.0bpw-h6-exl2

4
#1 opened 3 months ago by ainoob101
New activity in LoneStriker/LWM-Text-Chat-1M-AWQ 3 months ago

VRAM require

2
#1 opened 3 months ago by paperplanedeemo
New activity in LoneStriker/34b-beta-4.0bpw-h6-exl2 3 months ago

Which dataset used for quantization?

1
#1 opened 3 months ago by Yhyu13
New activity in jondurbin/bagel-34b-v0.4 3 months ago

Could you please quantify the model?

2
#1 opened 3 months ago by Serpen
New activity in LoneStriker/Qwen1.5-72B-Chat-GPTQ 3 months ago

exl2 quantization?

2
#1 opened 4 months ago by musicurgy
New activity in LoneStriker/Smaug-72B-v0.1-AWQ 3 months ago

Exl2 Quants?

3
#3 opened 4 months ago by eldodemi2039
New activity in LoneStriker/Smaug-72B-v0.1-GPTQ 3 months ago

exl2?

3
#1 opened 4 months ago by bdambrosio
New activity in LoneStriker/MiquMaid-v2-2x70B-DPO-GPTQ 3 months ago

Safetensor naming convention

10
#1 opened 4 months ago by dannysemi
New activity in CohereForAI/aya-101 4 months ago

🙏🏻Praying for Quantized

11
#12 opened 4 months ago by Tonic
New activity in appvoid/palmer-002.5 4 months ago

Guff

2
#1 opened 4 months ago by MarxistLeninist
New activity in LoneStriker/Senku-70B-Full-4.0bpw-h6-exl2 4 months ago

A minute bug

2
#1 opened 4 months ago by sethuiyer
New activity in LoneStriker/Smaug-34B-v0.1-8.0bpw-h8-exl2 4 months ago

Request for another exl Quant.

9
#1 opened 4 months ago by Clevyby
New activity in LoneStriker/Mistral-7B-Instruct-v0.2-Neural-Story-8.0bpw-h8-exl2 4 months ago

i want to quantize model exl2 and than finetune it

2
#1 opened 4 months ago by Mihir1108
New activity in LoneStriker/MiquMaid-v2-70B-DPO-4.65bpw-h6-exl2 4 months ago

This model have quantisation problem sometime (I think)

3
#1 opened 4 months ago by Belarrius
New activity in LoneStriker/openchat-3.5-0106-128k-4.0bpw-h6-exl2 4 months ago

not opening in transformers

1
#1 opened 4 months ago by sujitvasanth
New activity in LoneStriker/Senku-70B-Full-2.65bpw-h6-exl2 4 months ago

Any chance for a 2.4?

3
#1 opened 4 months ago by Efaarts
New activity in LoneStriker/MiquMaid-v2-70B-2.4bpw-h6-exl2 4 months ago

What's the difference between this and the DPO version?

1
#1 opened 4 months ago by QuantumState745837
New activity in WhiteRabbitNeo/Trinity-33B-v1.0 4 months ago

Quants Please

1
#1 opened 4 months ago by migtissera
New activity in LoneStriker/miquliz-120b-4.0bpw-h6-exl2 4 months ago

RuntimeError: CUDA error

2
#2 opened 4 months ago by Hardcore7651
New activity in LoneStriker/SeaLLM-7B-v2-GGUF 4 months ago

Request to add seallm.preset.json for LM-studio to work properly
#1 opened 4 months ago by nxphi47
New activity in LoneStriker/MiquMaid-v2-70B-DPO-3.5bpw-h6-exl2 4 months ago

3.0 bpw

1
#1 opened 4 months ago by trsx