Clarify Transformers version requirements
Browse files
README.md
CHANGED
@@ -15,32 +15,25 @@ Mistral-7B-v0.1 outperforms Llama 2 13B on all benchmarks we tested.
|
|
15 |
|
16 |
For full details of this model please read our [Release blog post](https://mistral.ai/news/announcing-mistral-7b/)
|
17 |
|
18 |
-
## Model Architecture
|
|
|
19 |
Mistral-7B-v0.1 is a transformer model, with the following architecture choices:
|
20 |
- Grouped-Query Attention
|
21 |
- Sliding-Window Attention
|
22 |
- Byte-fallback BPE tokenizer
|
23 |
|
24 |
## Troubleshooting
|
|
|
25 |
- If you see the following error:
|
26 |
```
|
27 |
-
Traceback (most recent call last):
|
28 |
-
File "", line 1, in
|
29 |
-
File "/transformers/models/auto/auto_factory.py", line 482, in from_pretrained
|
30 |
-
config, kwargs = AutoConfig.from_pretrained(
|
31 |
-
File "/transformers/models/auto/configuration_auto.py", line 1022, in from_pretrained
|
32 |
-
config_class = CONFIG_MAPPING[config_dict["model_type"]]
|
33 |
-
File "/transformers/models/auto/configuration_auto.py", line 723, in getitem
|
34 |
-
raise KeyError(key)
|
35 |
KeyError: 'mistral'
|
36 |
```
|
37 |
-
|
38 |
-
Installing transformers from source should solve the issue:
|
39 |
```
|
40 |
-
|
41 |
```
|
42 |
-
This should not be required after transformers-v4.33.4.
|
43 |
|
|
|
44 |
|
45 |
## Notice
|
46 |
|
|
|
15 |
|
16 |
For full details of this model please read our [Release blog post](https://mistral.ai/news/announcing-mistral-7b/)
|
17 |
|
18 |
+
## Model Architecture
|
19 |
+
|
20 |
Mistral-7B-v0.1 is a transformer model, with the following architecture choices:
|
21 |
- Grouped-Query Attention
|
22 |
- Sliding-Window Attention
|
23 |
- Byte-fallback BPE tokenizer
|
24 |
|
25 |
## Troubleshooting
|
26 |
+
|
27 |
- If you see the following error:
|
28 |
```
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
29 |
KeyError: 'mistral'
|
30 |
```
|
31 |
+
- Or:
|
|
|
32 |
```
|
33 |
+
NotImplementedError: Cannot copy out of meta tensor; no data!
|
34 |
```
|
|
|
35 |
|
36 |
+
Ensure you are utilizing a stable version of Transformers, 4.34.0 or newer.
|
37 |
|
38 |
## Notice
|
39 |
|