monsoon-nlp's picture
fix readme for this actual model
634ab27 verified
metadata
license: mit
datasets:
  - monsoon-nlp/asknyc-chatassistant-format

Adapter model / weights only for https://huggingface.co/monsoon-nlp/nyc-savvy-llama2-7b

Usage

from peft import AutoPeftModelForCausalLM
from transformers import AutoTokenizer

# this model
model = AutoPeftModelForCausalLM.from_pretrained("monsoon-nlp/nyc-savvy-llama2-7b-lora-adapter").to("cuda")
# base model for the tokenizer
tokenizer = AutoTokenizer.from_pretrained("monsoon-nlp/nyc-savvy-llama2-7b")