Instructions to use ssmurali/gemma2-2b-dorpo-both with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- PEFT
How to use ssmurali/gemma2-2b-dorpo-both with PEFT:
from peft import PeftModel from transformers import AutoModelForCausalLM base_model = AutoModelForCausalLM.from_pretrained("google/gemma-2-2b-it") model = PeftModel.from_pretrained(base_model, "ssmurali/gemma2-2b-dorpo-both") - Notebooks
- Google Colab
- Kaggle
gemma2-2b-dorpo-both
This is a PEFT LoRA adapter for google/gemma-2-2b-it.
Usage
from peft import PeftModel
from transformers import AutoModelForCausalLM, AutoTokenizer
base_model = AutoModelForCausalLM.from_pretrained("google/gemma-2-2b-it")
model = PeftModel.from_pretrained(base_model, "ssmurali/gemma2-2b-dorpo-both")
tokenizer = AutoTokenizer.from_pretrained("google/gemma-2-2b-it")
- Downloads last month
- 5
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support