Bhuvandesai/phi3-text-to-sql-adapter

Phi-3 Text-to-SQL Adapter

A QLoRA fine-tuned LoRA adapter for microsoft/Phi-3-mini-4k-instruct, trained to convert natural language questions into SQL queries against a company sales database.

Training

• Base model: microsoft/Phi-3-mini-4k-instruct
• Method: QLoRA (4-bit quantization + LoRA, rank=8, alpha=16)
• Target modules: q/k/v/o/gate/up/down projections
• Dataset: Custom text-to-SQL pairs over a sales schema (employees, departments, products, sales)

Usage

Load with PEFT:

```python from peft import PeftModel from transformers import AutoModelForCausalLM, AutoTokenizer

model = AutoModelForCausalLM.from_pretrained("microsoft/Phi-3-mini-4k-instruct") model = PeftModel.from_pretrained(model, "Bhuvandesai/phi3-text-to-sql-adapter") ```

Demo: phi3-text-to-sql-studio