Model description

Model type: A 1.1B parameter GPT-like model fine-tuned on a mix of publicly available, synthetic datasets.
Language(s) (NLP): Primarily English
License: MIT
Finetuned from model: PY007/TinyLlama-1.1B-intermediate-step-715k-1.5T

Safetensors

Model size

1.1B params

Tensor type

FP16

Collection including SebastianSchramm/tinyllama-1.1B-intermediate-step-715k-1.5T-dpo-lora-merged