Instructions to use acwkim/mod-dpo-better with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- PEFT
How to use acwkim/mod-dpo-better with PEFT:
from peft import PeftModel from transformers import AutoModelForCausalLM base_model = AutoModelForCausalLM.from_pretrained("PKU-Alignment/alpaca-7b-reproduced") model = PeftModel.from_pretrained(base_model, "acwkim/mod-dpo-better") - Notebooks
- Google Colab
- Kaggle
- Xet hash:
- 409b63d0f14ab5da7909ddcb93f85878ef0e4f19bfa91194b68ac5b45a5b6e87
- Size of remote file:
- 500 kB
- SHA256:
- 9e556afd44213b6bd1be2b850ebbbd98f5481437a8021afaf58ee7fb1818d347
·
Xet efficiently stores Large Files inside Git, intelligently splitting files into unique chunks and accelerating uploads and downloads. More info.