Hugging Face's logo

alexm-nm
/
tinyllama-24-marlin24-4bit-channelwise

Text Generation
Transformers
Safetensors
llama
conversational
text-generation-inference
Inference Endpoints
4-bit precision
gptq
Model card Files Community
Edit model card
README.md exists but content is empty. Use the Edit model card button to edit it.
Downloads last month
2,718
Safetensors
Model size
253M params
Tensor type
I32
路
FP16
路
I16
路
Inference API
Text Generation
Examples
Input a message to start chatting with alexm-nm/tinyllama-24-marlin24-4bit-channelwise.
This model can be loaded on Inference API (serverless).