ArthurZ HF staff commited on
Commit
7f975d3
1 Parent(s): dc20d8c

Update checkpoint for transformers>=4.29

Browse files

Following the merge of [a PR](https://github.com/huggingface/transformers/pull/24310) in `transformers` it appeared that this model was not properly converted. This PR will fix the inference and was tested using the following script:
```python
>>> from transformers import AutoTokenizer, MarianMTModel
>>> tokenizer = AutoTokenizer.from_pretrained('Helsinki-NLP/opus-mt-zlw-fiu')
>>> inputs = tokenizer("' >>en<< Hey how are you?'", return_tensors="pt", padding=True)
>>> model = MarianMTModel.from_pretrained('Helsinki-NLP/opus-mt-zlw-fiu')
>>> print(tokenizer.batch_decode(model.generate(**inputs)))
['<pad> Hew are you?</s>']
```

.gitattributes CHANGED
@@ -14,3 +14,4 @@
14
  *.pb filter=lfs diff=lfs merge=lfs -text
15
  *.pt filter=lfs diff=lfs merge=lfs -text
16
  *.pth filter=lfs diff=lfs merge=lfs -text
 
 
14
  *.pb filter=lfs diff=lfs merge=lfs -text
15
  *.pt filter=lfs diff=lfs merge=lfs -text
16
  *.pth filter=lfs diff=lfs merge=lfs -text
17
+ model.safetensors filter=lfs diff=lfs merge=lfs -text
config.json CHANGED
@@ -1,5 +1,4 @@
1
  {
2
- "_name_or_path": "/tmp/Helsinki-NLP/opus-mt-zlw-fiu",
3
  "activation_dropout": 0.0,
4
  "activation_function": "swish",
5
  "architectures": [
@@ -40,7 +39,8 @@
40
  "scale_embedding": true,
41
  "share_encoder_decoder_embeddings": true,
42
  "static_position_embeddings": true,
43
- "transformers_version": "4.22.0.dev0",
 
44
  "use_cache": true,
45
  "vocab_size": 59747
46
  }
 
1
  {
 
2
  "activation_dropout": 0.0,
3
  "activation_function": "swish",
4
  "architectures": [
 
39
  "scale_embedding": true,
40
  "share_encoder_decoder_embeddings": true,
41
  "static_position_embeddings": true,
42
+ "torch_dtype": "float16",
43
+ "transformers_version": "4.34.0.dev0",
44
  "use_cache": true,
45
  "vocab_size": 59747
46
  }
generation_config.json CHANGED
@@ -12,5 +12,5 @@
12
  "num_beams": 6,
13
  "pad_token_id": 59746,
14
  "renormalize_logits": true,
15
- "transformers_version": "4.32.0.dev0"
16
  }
 
12
  "num_beams": 6,
13
  "pad_token_id": 59746,
14
  "renormalize_logits": true,
15
+ "transformers_version": "4.34.0.dev0"
16
  }
model.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:873463cbc5e9ccab926a89433af7c3f1653099f2f2cd0d100212d982e9f5ed9f
3
+ size 149606230
pytorch_model.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:821f51c216a291c58c2cb8eb892709b247de79549c61e73ce60e9b02bf7d447c
3
- size 210842993
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:91a7105b063ad33c6f8daba99ed150bf63f59e2aa6fc98d90bdef774321bd700
3
+ size 149663941