Commit
·
94ec2f2
1
Parent(s):
7dbf6ca
Create README.md
Browse files
README.md
ADDED
@@ -0,0 +1,46 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
1 |
+
---
|
2 |
+
language: en
|
3 |
+
tags:
|
4 |
+
- question-answering
|
5 |
+
license: Apache 2.0
|
6 |
+
---
|
7 |
+
|
8 |
+
# macaw-11b
|
9 |
+
|
10 |
+
## Model description
|
11 |
+
|
12 |
+
Macaw (<b>M</b>ulti-<b>a</b>ngle <b>c</b>(q)uestion <b>a</b>ns<b>w</b>ering) is a ready-to-use model capable of
|
13 |
+
general question answering,
|
14 |
+
showing robustness outside the domains it was trained on. It has been trained in "multi-angle" fashion,
|
15 |
+
which means it can handle a flexible set of input and output "slots"
|
16 |
+
(question, answer, multiple-choice options, context, and explanation) .
|
17 |
+
|
18 |
+
Macaw was built on top of [T5](https://github.com/google-research/text-to-text-transfer-transformer) and comes in
|
19 |
+
three sizes: [macaw-11b](https://huggingface.co/allenai/macaw-11b), [macaw-3b](https://huggingface.co/allenai/macaw-3b),
|
20 |
+
and [macaw-large](https://huggingface.co/allenai/macaw-large), as well as an answer-focused version featured on
|
21 |
+
various leaderboards [macaw-answer-11b](https://huggingface.co/allenai/macaw-answer-11b).
|
22 |
+
|
23 |
+
See https://github.com/allenai/macaw for more details.
|
24 |
+
|
25 |
+
## Intended uses & limitations
|
26 |
+
|
27 |
+
#### How to use
|
28 |
+
|
29 |
+
```python
|
30 |
+
from transformers import AutoTokenizer, AutoModelForSeq2SeqLM
|
31 |
+
tokenizer = AutoTokenizer.from_pretrained("allenai/macaw-11b")
|
32 |
+
model = AutoModelForSeq2SeqLM.from_pretrained("allenai/macaw-11b")
|
33 |
+
input_string = "$answer$ ; $mcoptions$ ; $question$ = What is the color of a cloudy sky?"
|
34 |
+
input_ids = tokenizer.encode(input_string, return_tensors="pt")
|
35 |
+
output = model.generate(input_ids, max_length=200)
|
36 |
+
|
37 |
+
>>> tokenizer.batch_decode(output, skip_special_tokens=True)
|
38 |
+
['$answer$ = gray ; $mcoptions$ = (A) blue (B) white (C) grey (D) black']
|
39 |
+
```
|
40 |
+
|
41 |
+
### BibTeX entry and citation info
|
42 |
+
|
43 |
+
```bibtex
|
44 |
+
{TBA
|
45 |
+
}
|
46 |
+
```
|