# Alpaca LoRa 7B This repository contains a LLaMA-7B fine-tuned model on the [Standford Alpaca](https://github.com/tatsu-lab/stanford_alpaca) cleaned version dataset. I used [LLaMA-7B-hf](decapoda-research/llama-7b-hf) as a base model # Usage ## Using the model ```python from transformers import LlamaTokenizer, LlamaForCausalLM, tokenizer = LlamaTokenizer.from_pretrained("decapoda-research/alpaca-lora-7b") model = LlamaForCausalLM.from_pretrained( "chainyo/alpaca-lora-7b", load_in_8bit=True, torch_dtype=torch.float16, device_map="auto", )