Model type `zamba2` but Transformers does not recognize this architecture.

#4
by hg0428 - opened

I used the example code provided here and the latest version of transformers and I am getting the following error:

ValueError: The checkpoint you are trying to load has model type `zamba2` but Transformers does not recognize this architecture. This could be because of an issue with the checkpoint, or because your version of Transformers is out of date.
Zyphra org

Could you try to first run pip uninstall transformers and then install the transformers_zamba2 folder?

Could you try to first run pip uninstall transformers and then install the transformers_zamba2 folder?

That wouldn't install correctly.

          if bare_metal_version >= Version("11.8"):
             ^^^^^^^^^^^^^^^^^^
      NameError: name 'bare_metal_version' is not defined
Zyphra org

Can you share the traceback of this error? I.e., what's the code path that leads to it? That should give some additional clue.

Can you share the traceback of this error? I.e., what's the code path that leads to it? That should give some additional clue.

Collecting mamba-ssm==2.1.0 (from transformers==4.43.0.dev0)
  Using cached mamba_ssm-2.1.0.tar.gz (84 kB)
  Preparing metadata (setup.py) ... error
  error: subprocess-exited-with-error
  
  Γ— python setup.py egg_info did not run successfully.
  β”‚ exit code: 1
  ╰─> [14 lines of output]
      /private/var/folders/mm/3p04lc0x4fsdqhnkk_3j68v80000gn/T/pip-install-jjl8_mo6/mamba-ssm_05bf2b6c5b3041ed97effd1b0dcf3a08/setup.py:119: UserWarning: mamba_ssm was requested, but nvcc was not found.  Are you sure your environment has nvcc available?  If you're installing within a container from https://hub.docker.com/r/pytorch/pytorch, only images whose names contain 'devel' will provide nvcc.
        warnings.warn(
      Traceback (most recent call last):
        File "<string>", line 2, in <module>
        File "<pip-setuptools-caller>", line 34, in <module>
        File "/private/var/folders/mm/3p04lc0x4fsdqhnkk_3j68v80000gn/T/pip-install-jjl8_mo6/mamba-ssm_05bf2b6c5b3041ed97effd1b0dcf3a08/setup.py", line 189, in <module>
          if bare_metal_version >= Version("11.8"):
             ^^^^^^^^^^^^^^^^^^
      NameError: name 'bare_metal_version' is not defined
      
      
      torch.__version__  = 2.5.1
      
      
      [end of output]
  
  note: This error originates from a subprocess, and is likely not a problem with pip.
error: metadata-generation-failed

Γ— Encountered error while generating package metadata.
╰─> See above for output.

note: This is an issue with the package mentioned above, not pip.
hint: See above for details.

Sign up or log in to comment