Unsloth AI

unsloth's activity

• All
• Models
• Datasets
• Spaces
• Papers
• Collections
• Community
• Posts
• Articles

shimmyshimmer 

updated 10 models 1 day ago

unsloth/DeepSeek-R1-Distill-Llama-8B-GGUF

Updated 1 day ago • 506k • 222

unsloth/DeepSeek-R1-GGUF

Text Generation • Updated 1 day ago • 2.14M • 776

unsloth/Llama-3.2-1B-unsloth-bnb-4bit

Text Generation • Updated 1 day ago • 17.3k • 2

unsloth/Llama-3.2-1B-Instruct-unsloth-bnb-4bit

Text Generation • Updated 1 day ago • 46.1k • 1

unsloth/Meta-Llama-3.1-8B-Instruct-unsloth-bnb-4bit

Text Generation • Updated 1 day ago • 1.04k • 1

unsloth/Qwen2.5-14B-unsloth-bnb-4bit

Text Generation • Updated 1 day ago • 1.77k • 1

unsloth/Qwen2.5-14B-Instruct-unsloth-bnb-4bit

Text Generation • Updated 1 day ago • 25.7k

unsloth/Qwen2.5-7B-Instruct-unsloth-bnb-4bit

Text Generation • Updated 1 day ago • 18k • 1

unsloth/Qwen2.5-7B-unsloth-bnb-4bit

Text Generation • Updated 1 day ago • 12k

unsloth/Qwen2.5-3B-unsloth-bnb-4bit

Text Generation • Updated 1 day ago • 5.17k

shimmyshimmer 

in unsloth/README 1 day ago

I can't run any of the bnb-4bit quants with TextGenerationInference

1

#6 opened 4 days ago by

v3ss0n

shimmyshimmer 

in unsloth/DeepSeek-R1-GGUF 1 day ago

8bits quantization

5

#20 opened 8 days ago by

ramkumarkoppu

shimmyshimmer 

in unsloth/DeepSeek-V3-GGUF 1 day ago

Is it worth hosting a quantized DeepSeek V3? Cost & performance insights?

2

#15 opened 6 days ago by

Techw

shimmyshimmer 

in unsloth/DeepSeek-R1-Distill-Llama-8B-GGUF 1 day ago

hey how about refine-tuning the model

1

#7 opened 5 days ago by

OqbaN

shimmyshimmer 

in unsloth/phi-4 1 day ago

About the phi-4 training Hyperparameters

3

#1 opened 6 days ago by

zj2023vegetable

shimmyshimmer 

in unsloth/DeepSeek-R1-GGUF 1 day ago

I tested dynamic 1.58bit and 2.22bit, All thoughts are empty?

7

#24 opened 4 days ago by

SongXiaoMao

IQ1_S模型合并后部署于ollama上，推理生成效果差

1

#26 opened 3 days ago by

gaozj

when using with ollama, does it support kv_cache_type=q4_0 and flash_attention=1?

1

#28 opened 3 days ago by

leonzy04

shimmyshimmer 

in unsloth/llava-1.5-7b-hf-bnb-4bit 1 day ago

Update processor_config.json

1

#1 opened 3 days ago by

RaushanTurganbay

shimmyshimmer 

in unsloth/llava-v1.6-mistral-7b-hf-bnb-4bit 1 day ago

Update processor_config.json

1

#1 opened 3 days ago by

baraujo22