Tinker LoRA Adapter
This repository contains a LoRA adapter exported from Tinker.
Usage
from transformers import AutoModelForCausalLM
adapter_id = "nbeerbower/Inkling-Small-Gutenberg-DPO-LoRA"
base_model = "thinkingmachines/Inkling-Small"
model = AutoModelForCausalLM.from_pretrained(adapter_id, device_map="auto")
Source
tinker://dd32a9f3-f2b5-5b27-8556-5641cdc225b8:train:0/sampler_weights/final
Details
- Base model: thinkingmachines/Inkling-Small
- LoRA rank: 32
- Trained modules: attn=True, mlp=True, unembed=True
- Downloads last month
- 10
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support
Model tree for nbeerbower/Inkling-Small-Gutenberg-DPO-LoRA
Base model
thinkingmachines/Inkling-Small