Instructions to use pankajpandey-dev/qwen3.5-9b-hindi-instruct-lora with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- PEFT
How to use pankajpandey-dev/qwen3.5-9b-hindi-instruct-lora with PEFT:
from peft import PeftModel from transformers import AutoModelForCausalLM base_model = AutoModelForCausalLM.from_pretrained("unsloth/Qwen3.5-9B") model = PeftModel.from_pretrained(base_model, "pankajpandey-dev/qwen3.5-9b-hindi-instruct-lora") - Notebooks
- Google Colab
- Kaggle
Qwen3.5-9B Hindi Instruct โ LoRA adapter ๐ฎ๐ณ
The 29M-parameter LoRA adapter (r=16) behind pankajpandey-dev/qwen3.5-9b-hindi-instruct. Attach to base Qwen3.5-9B, or use as a starting point for your own Indic fine-tunes.
from peft import PeftModel
from transformers import AutoModelForCausalLM
base = AutoModelForCausalLM.from_pretrained("unsloth/Qwen3.5-9B", torch_dtype="bfloat16", device_map="auto")
model = PeftModel.from_pretrained(base, "pankajpandey-dev/qwen3.5-9b-hindi-instruct-lora")
Full recipe, data mix and limitations: see the main model card.
๐ฎ๐ณ About the Hindi LLM Series
Weekly open releases making small LLMs speak fluent, native Hindi โ trained on free/low-cost GPUs, shipped as GGUF for laptops and edge devices. Built by pankajpandey-dev (contact links on profile).
This release: Model ยท GGUF ยท LoRA ยท Series: ๐ฎ๐ณ Hindi LLM Collection
- Downloads last month
- 50