TurkuNLP

/

gpt3-finnish-13B

like 12

Follow

TurkuNLP Research Group 41

When trying to use this model, the program complains that it cannot open the file. I get similar error with the 8B model, but 3B and smaller models seem to work. Is the file corrupt or do I need to open it using something else than the standard AutoModel.from_pretrained("TurkuNLP/gpt3-finnish-13B") code?

╭─────────────────────────────── Traceback (most recent call last) ────────────────────────────────╮
│ /home/iikkahau/Projektit/miniconda3/envs/fie3/lib/python3.10/site-packages/transformers/modeling │
│ _utils.py:417 in load_state_dict                                                                 │
│                                                                                                  │
│    414 │   │   │   )                                                                             │
│    415 │   │   return safe_load_file(checkpoint_file)                                            │
│    416 │   try:                                                                                  │
│ ❱  417 │   │   return torch.load(checkpoint_file, map_location="cpu")                            │
│    418 │   except Exception as e:                                                                │
│    419 │   │   try:                                                                              │
│    420 │   │   │   with open(checkpoint_file) as f:                                              │
│                                                                                                  │
│ /home/iikkahau/Projektit/miniconda3/envs/fie3/lib/python3.10/site-packages/torch/serialization.p │
│ y:777 in load                                                                                    │
│                                                                                                  │
│    774 │   │   │   # If we want to actually tail call to torch.jit.load, we need to              │
│    775 │   │   │   # reset back to the original position.                                        │
│    776 │   │   │   orig_position = opened_file.tell()                                            │
│ ❱  777 │   │   │   with _open_zipfile_reader(opened_file) as opened_zipfile:                     │
│    778 │   │   │   │   if _is_torchscript_zip(opened_zipfile):                                   │
│    779 │   │   │   │   │   warnings.warn("'torch.load' received a zip file that looks like a To  │
│    780 │   │   │   │   │   │   │   │     " dispatching to 'torch.jit.load' (call 'torch.jit.loa  │
│                                                                                                  │
│ /home/iikkahau/Projektit/miniconda3/envs/fie3/lib/python3.10/site-packages/torch/serialization.p │
│ y:282 in __init__                                                                                │
│                                                                                                  │
│    279                                                                                           │
│    280 class _open_zipfile_reader(_opener):                                                      │
│    281 │   def __init__(self, name_or_buffer) -> None:                                           │
│ ❱  282 │   │   super(_open_zipfile_reader, self).__init__(torch._C.PyTorchFileReader(name_or_bu  │
│    283                                                                                           │
│    284                                                                                           │
│    285 class _open_zipfile_writer_file(_opener):                                                 │
╰──────────────────────────────────────────────────────────────────────────────────────────────────╯
RuntimeError: PytorchStreamReader failed reading zip archive: failed finding central directory