Instructions to use Ganesh01kumar02reddy/medical-llm-exp1-cot with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use Ganesh01kumar02reddy/medical-llm-exp1-cot with Transformers:
# Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("Ganesh01kumar02reddy/medical-llm-exp1-cot", dtype="auto") - Notebooks
- Google Colab
- Kaggle
Model Card for medical-llm-exp1-cot
This model is a fine-tuned version of Qwen/Qwen2.5-1.5B-Instruct. It has been trained using TRL.
Quick start
from transformers import pipeline
question = "what are the reasons for heart attacks?"
generator = pipeline("text-generation", model="Ganesh01kumar02reddy/medical-llm-exp1-cot", device="cuda")
output = generator([{"role": "user", "content": question}], max_new_tokens=128, return_full_text=False)[0]
print(output["generated_text"])
Training procedure
This model was trained with SFT.
Framework versions
- TRL: 1.3.0
- Transformers: 5.0.0
- Pytorch: 2.10.0+cu128
- Datasets: 4.8.5
- Tokenizers: 0.22.2
Citations
Cite TRL as:
@software{vonwerra2020trl,
title = {{Fine tuning, SFT, QLORA}},
author = {Ganesh Kumar Reddy Mallela},
year = {2026}
}
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support