Text Generation
Adapters
llama
llama-2
calpt's picture
Upload LlamaForCausalLM
67704a4 verified
|
raw
history blame
1.03 kB
metadata
tags:
  - adapter-transformers
  - llama
datasets:
  - timdettmers/openassistant-guanaco

Adapter AdapterHub/llama2-13b-qlora-openassistant for meta-llama/Llama-2-13b-hf

An adapter for the meta-llama/Llama-2-13b-hf model that was trained on the timdettmers/openassistant-guanaco dataset.

This adapter was created for usage with the Adapters library.

Usage

First, install adapters:

pip install -U adapters

Now, the adapter can be loaded and activated like this:

from adapters import AutoAdapterModel

model = AutoAdapterModel.from_pretrained("meta-llama/Llama-2-13b-hf")
adapter_name = model.load_adapter("AdapterHub/llama2-13b-qlora-openassistant", source="hf", set_active=True)

Architecture & Training

Evaluation results

Citation