Convert and Quantized of TinyLlama-1.1B-intermediate-step-1431k-3T using llama.cpp

Guide to replicate

Description

This is for my own experiment with Ollama, because Ollama usually put chat fine-tuning in their library. It would be hard to know if my fine-tuning LoRA Adapter works if I don't use base/pretrain model version

Ollama

Model Page https://ollama.com/pacozaa/tinyllama
ollama run pacozaa/tinyllama

Downloads last month: 27

GGUF

Model size

1.1B params

Architecture

llama

4-bit

32-bit

Inference Providers NEW

This model is not currently available via any of the supported Inference Providers.

The model cannot be deployed to the HF Inference API: The model has no library tag.