|
--- |
|
tags: |
|
- adapter-transformers |
|
- t5 |
|
datasets: |
|
- liuyanchen1015/VALUE_mnli_drop_aux |
|
--- |
|
|
|
# Adapter `liuyanchen1015/pfadapter-FLAN-T5-base-drop_aux_lr0.001` for liuyanchen1015/FLAN-T5_GLUE_finetuning_lr3e-4 |
|
|
|
An [adapter](https://adapterhub.ml) for the `liuyanchen1015/FLAN-T5_GLUE_finetuning_lr3e-4` model that was trained on the [liuyanchen1015/VALUE_mnli_drop_aux](https://huggingface.co/datasets/liuyanchen1015/VALUE_mnli_drop_aux/) dataset. |
|
|
|
This adapter was created for usage with the **[adapter-transformers](https://github.com/Adapter-Hub/adapter-transformers)** library. |
|
|
|
## Usage |
|
|
|
First, install `adapter-transformers`: |
|
|
|
``` |
|
pip install -U adapter-transformers |
|
``` |
|
_Note: adapter-transformers is a fork of transformers that acts as a drop-in replacement with adapter support. [More](https://docs.adapterhub.ml/installation.html)_ |
|
|
|
Now, the adapter can be loaded and activated like this: |
|
|
|
```python |
|
from transformers import AutoAdapterModel |
|
|
|
model = AutoAdapterModel.from_pretrained("liuyanchen1015/FLAN-T5_GLUE_finetuning_lr3e-4") |
|
adapter_name = model.load_adapter("liuyanchen1015/pfadapter-FLAN-T5-base-drop_aux_lr0.001", source="hf", set_active=True) |
|
``` |
|
|
|
## Architecture & Training |
|
|
|
<!-- Add some description here --> |
|
|
|
## Evaluation results |
|
|
|
<!-- Add some description here --> |
|
|
|
## Citation |
|
|
|
<!-- Add some description here --> |
