unsloth
/

gemma-2-27b-it-bnb-4bit

Text Generation

text-generation-inference

4-bit precision

Model card Files Files and versions

Resources

View closed (0)

Aphrodite/VLLM/SGLang all refuse to load this model

#5 opened 8 months ago by

Dealing with the split safetensor files

#4 opened 9 months ago by

How to create gguf fromm this

#3 opened 9 months ago by

hidden state is nan

#2 opened 10 months ago by

whats the best tool to run this model

#1 opened 11 months ago by