Repository: stanford-crfm/helm
Issue: Error while installing summarization on python 3.11
Root cause: External Dependency Breakage

When installing the summarization dependencies in HELM, the process ends with an error. The behavior is reproducible on linux and MacOS:


```
etting requirements to build wheel ... error
  error: subprocess-exited-with-error
  
  × Getting requirements to build wheel did not run successfully.
  │ exit code: 1
  ╰─> [55 lines of output]
      
      Error compiling Cython file:
      ------------------------------------------------------------
      ...
                              o = self._default(o)
                              default_used = True
                              continue
                          else:
                              raise OverflowError("Integer value out of range")
                  elif PyInt_CheckExact(o) if strict_types else PyInt_Check(o):
                       ^
      ------------------------------------------------------------
      
      srsly/msgpack/_packer.pyx:193:17: undeclared name not builtin: PyInt_CheckExact
      
      Error compiling Cython file:
      ------------------------------------------------------------
      ...
                              o = self._default(o)
                              default_used = True
                              continue
                          else:
                              raise OverflowError("Integer value out of range")
                  elif PyInt_CheckExact(o) if strict_types else PyInt_Check(o):
                                                                ^
      ------------------------------------------------------------
      
      srsly/msgpack/_packer.pyx:193:58: undeclared name not builtin: PyInt_Check
      Cythonizing sources
      Compiling srsly/msgpack/_unpacker.pyx because it changed.
      Compiling srsly/msgpack/_packer.pyx because it changed.
      [1/2] Cythonizing srsly/msgpack/_packer.pyx
      Traceback (most recent call last):
        File "/Users/miguel/miniforge3/envs/crfm-helm/lib/python3.11/site-packages/pip/_vendor/pyproject_hooks/_in_process/_in_process.py", line 389, in <module>
          main()
        File "/Users/miguel/miniforge3/envs/crfm-helm/lib/python3.11/site-packages/pip/_vendor/pyproject_hooks/_in_process/_in_process.py", line 373, in main
          json_out["return_val"] = hook(**hook_input["kwargs"])
                                   ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
        File "/Users/miguel/miniforge3/envs/crfm-helm/lib/python3.11/site-packages/pip/_vendor/pyproject_hooks/_in_process/_in_process.py", line 143, in get_requires_for_build_wheel
          return hook(config_settings)
                 ^^^^^^^^^^^^^^^^^^^^^
        File "/private/var/folders/q9/t9qq0b8x06j45qnbmdqwt7nr0000gn/T/pip-build-env-6cpln6ws/overlay/lib/python3.11/site-packages/setuptools/build_meta.py", line 331, in get_requires_for_build_wheel
          return self._get_build_requires(config_settings, requirements=[])
                 ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
        File "/private/var/folders/q9/t9qq0b8x06j45qnbmdqwt7nr0000gn/T/pip-build-env-6cpln6ws/overlay/lib/python3.11/site-packages/setuptools/build_meta.py", line 301, in _get_build_requires
          self.run_setup()
        File "/private/var/folders/q9/t9qq0b8x06j45qnbmdqwt7nr0000gn/T/pip-build-env-6cpln6ws/overlay/lib/python3.11/site-packages/setuptools/build_meta.py", line 317, in run_setup
          exec(code, locals())
        File "<string>", line 138, in <module>
        File "<string>", line 125, in setup_package
        File "/private/var/folders/q9/t9qq0b8x06j45qnbmdqwt7nr0000gn/T/pip-build-env-6cpln6ws/overlay/lib/python3.11/site-packages/Cython/Build/Dependencies.py", line 1154, in cythonize
          cythonize_one(*args)
        File "/private/var/folders/q9/t9qq0b8x06j45qnbmdqwt7nr0000gn/T/pip-build-env-6cpln6ws/overlay/lib/python3.11/site-packages/Cython/Build/Dependencies.py", line 1298, in cythonize_one
          raise CompileError(None, pyx_file)
      Cython.Compiler.Errors.CompileError: srsly/msgpack/_packer.pyx
      [end of output]
  
  note: This error originates from a subprocess, and is likely not a problem with pip.
error: subprocess-exited-with-error

× Getting requirements to build wheel did not run successfully.
│ exit code: 1
╰─> See above for output.

note: This error originates from a subprocess, and is likely not a problem with pip.
```


# Full Log:

```
pip install -e '.[summarization]'
Obtaining file:///Users/miguel/Downloads/helm
  Installing build dependencies ... done
  Checking if build backend supports build_editable ... done
  Getting requirements to build editable ... done
  Preparing editable metadata (pyproject.toml) ... done
Requirement already satisfied: cattrs~=22.2 in /Users/miguel/miniforge3/envs/crfm-helm/lib/python3.11/site-packages (from crfm-helm==0.5.6) (22.2.0)
Requirement already satisfied: colorlog~=6.9 in /Users/miguel/miniforge3/envs/crfm-helm/lib/python3.11/site-packages (from crfm-helm==0.5.6) (6.9.0)
Requirement already satisfied: dacite~=1.6 in /Users/miguel/miniforge3/envs/crfm-helm/lib/python3.11/site-packages (from crfm-helm==0.5.6) (1.9.2)
Requirement already satisfied: importlib-resources~=5.10 in /Users/miguel/miniforge3/envs/crfm-helm/lib/python3.11/site-packages (from crfm-helm==0.5.6) (5.13.0)
Requirement already satisfied: Mako~=1.2 in /Users/miguel/miniforge3/envs/crfm-helm/lib/python3.11/site-packages (from crfm-helm==0.5.6) (1.3.10)
Requirement already satisfied: numpy<3,>=1.26 in /Users/miguel/miniforge3/envs/crfm-helm/lib/python3.11/site-packages (from crfm-helm==0.5.6) (1.26.4)
Requirement already satisfied: pandas~=2.0 in /Users/miguel/miniforge3/envs/crfm-helm/lib/python3.11/site-packages (from crfm-helm==0.5.6) (2.3.1)
Requirement already satisfied: pyhocon~=0.3.59 in /Users/miguel/miniforge3/envs/crfm-helm/lib/python3.11/site-packages (from crfm-helm==0.5.6) (0.3.61)
Requirement already satisfied: retrying~=1.3 in /Users/miguel/miniforge3/envs/crfm-helm/lib/python3.11/site-packages (from crfm-helm==0.5.6) (1.4.0)
Requirement already satisfied: spacy~=3.5 in /Users/miguel/miniforge3/envs/crfm-helm/lib/python3.11/site-packages (from crfm-helm==0.5.6) (3.8.7)
Requirement already satisfied: tqdm~=4.64 in /Users/miguel/miniforge3/envs/crfm-helm/lib/python3.11/site-packages (from crfm-helm==0.5.6) (4.67.1)
Requirement already satisfied: zstandard~=0.18.0 in /Users/miguel/miniforge3/envs/crfm-helm/lib/python3.11/site-packages (from crfm-helm==0.5.6) (0.18.0)
Requirement already satisfied: sqlitedict<3.0,>=2.1.0 in /Users/miguel/miniforge3/envs/crfm-helm/lib/python3.11/site-packages (from crfm-helm==0.5.6) (2.1.0)
Requirement already satisfied: bottle~=0.12.23 in /Users/miguel/miniforge3/envs/crfm-helm/lib/python3.11/site-packages (from crfm-helm==0.5.6) (0.12.25)
Requirement already satisfied: datasets~=3.1 in /Users/miguel/miniforge3/envs/crfm-helm/lib/python3.11/site-packages (from crfm-helm==0.5.6) (3.6.0)
Requirement already satisfied: pyarrow>=11.0.0 in /Users/miguel/miniforge3/envs/crfm-helm/lib/python3.11/site-packages (from crfm-helm==0.5.6) (20.0.0)
Requirement already satisfied: pyarrow-hotfix~=0.6 in /Users/miguel/miniforge3/envs/crfm-helm/lib/python3.11/site-packages (from crfm-helm==0.5.6) (0.7)
Requirement already satisfied: nltk!=3.9.0,~=3.7 in /Users/miguel/miniforge3/envs/crfm-helm/lib/python3.11/site-packages (from crfm-helm==0.5.6) (3.9.1)
Requirement already satisfied: rouge-score~=0.1.2 in /Users/miguel/miniforge3/envs/crfm-helm/lib/python3.11/site-packages (from crfm-helm==0.5.6) (0.1.2)
Requirement already satisfied: scipy>=1.10 in /Users/miguel/miniforge3/envs/crfm-helm/lib/python3.11/site-packages (from crfm-helm==0.5.6) (1.16.0)
Requirement already satisfied: uncertainty-calibration~=0.1.4 in /Users/miguel/miniforge3/envs/crfm-helm/lib/python3.11/site-packages (from crfm-helm==0.5.6) (0.1.4)
Requirement already satisfied: scikit-learn>=1.1 in /Users/miguel/miniforge3/envs/crfm-helm/lib/python3.11/site-packages (from crfm-helm==0.5.6) (1.7.0)
Requirement already satisfied: transformers<4.53.0,~=4.40 in /Users/miguel/miniforge3/envs/crfm-helm/lib/python3.11/site-packages (from crfm-helm==0.5.6) (4.52.4)
Requirement already satisfied: torch<3.0.0,>=1.13.1 in /Users/miguel/miniforge3/envs/crfm-helm/lib/python3.11/site-packages (from crfm-helm==0.5.6) (2.5.1)
Requirement already satisfied: torchvision<3.0.0,>=0.14.1 in /Users/miguel/miniforge3/envs/crfm-helm/lib/python3.11/site-packages (from crfm-helm==0.5.6) (0.20.1)
Collecting summ-eval~=0.892 (from crfm-helm==0.5.6)
  Using cached summ_eval-0.892-py3-none-any.whl.metadata (15 kB)
Collecting bert-score~=0.3 (from crfm-helm==0.5.6)
  Using cached bert_score-0.3.13-py3-none-any.whl.metadata (15 kB)
Requirement already satisfied: requests in /Users/miguel/miniforge3/envs/crfm-helm/lib/python3.11/site-packages (from bert-score~=0.3->crfm-helm==0.5.6) (2.32.4)
Requirement already satisfied: matplotlib in /Users/miguel/miniforge3/envs/crfm-helm/lib/python3.11/site-packages (from bert-score~=0.3->crfm-helm==0.5.6) (3.10.3)
Requirement already satisfied: packaging>=20.9 in /Users/miguel/miniforge3/envs/crfm-helm/lib/python3.11/site-packages (from bert-score~=0.3->crfm-helm==0.5.6) (25.0)
Requirement already satisfied: attrs>=20 in /Users/miguel/miniforge3/envs/crfm-helm/lib/python3.11/site-packages (from cattrs~=22.2->crfm-helm==0.5.6) (25.3.0)
Requirement already satisfied: filelock in /Users/miguel/miniforge3/envs/crfm-helm/lib/python3.11/site-packages (from datasets~=3.1->crfm-helm==0.5.6) (3.18.0)
Requirement already satisfied: dill<0.3.9,>=0.3.0 in /Users/miguel/miniforge3/envs/crfm-helm/lib/python3.11/site-packages (from datasets~=3.1->crfm-helm==0.5.6) (0.3.8)
Requirement already satisfied: xxhash in /Users/miguel/miniforge3/envs/crfm-helm/lib/python3.11/site-packages (from datasets~=3.1->crfm-helm==0.5.6) (3.5.0)
Requirement already satisfied: multiprocess<0.70.17 in /Users/miguel/miniforge3/envs/crfm-helm/lib/python3.11/site-packages (from datasets~=3.1->crfm-helm==0.5.6) (0.70.16)
Requirement already satisfied: fsspec<=2025.3.0,>=2023.1.0 in /Users/miguel/miniforge3/envs/crfm-helm/lib/python3.11/site-packages (from fsspec[http]<=2025.3.0,>=2023.1.0->datasets~=3.1->crfm-helm==0.5.6) (2025.3.0)
Requirement already satisfied: huggingface-hub>=0.24.0 in /Users/miguel/miniforge3/envs/crfm-helm/lib/python3.11/site-packages (from datasets~=3.1->crfm-helm==0.5.6) (0.33.4)
Requirement already satisfied: pyyaml>=5.1 in /Users/miguel/miniforge3/envs/crfm-helm/lib/python3.11/site-packages (from datasets~=3.1->crfm-helm==0.5.6) (6.0.2)
Requirement already satisfied: aiohttp!=4.0.0a0,!=4.0.0a1 in /Users/miguel/miniforge3/envs/crfm-helm/lib/python3.11/site-packages (from fsspec[http]<=2025.3.0,>=2023.1.0->datasets~=3.1->crfm-helm==0.5.6) (3.12.14)
Requirement already satisfied: MarkupSafe>=0.9.2 in /Users/miguel/miniforge3/envs/crfm-helm/lib/python3.11/site-packages (from Mako~=1.2->crfm-helm==0.5.6) (3.0.2)
Requirement already satisfied: click in /Users/miguel/miniforge3/envs/crfm-helm/lib/python3.11/site-packages (from nltk!=3.9.0,~=3.7->crfm-helm==0.5.6) (8.2.1)
Requirement already satisfied: joblib in /Users/miguel/miniforge3/envs/crfm-helm/lib/python3.11/site-packages (from nltk!=3.9.0,~=3.7->crfm-helm==0.5.6) (1.5.1)
Requirement already satisfied: regex>=2021.8.3 in /Users/miguel/miniforge3/envs/crfm-helm/lib/python3.11/site-packages (from nltk!=3.9.0,~=3.7->crfm-helm==0.5.6) (2024.11.6)
Requirement already satisfied: python-dateutil>=2.8.2 in /Users/miguel/miniforge3/envs/crfm-helm/lib/python3.11/site-packages (from pandas~=2.0->crfm-helm==0.5.6) (2.8.2)
Requirement already satisfied: pytz>=2020.1 in /Users/miguel/miniforge3/envs/crfm-helm/lib/python3.11/site-packages (from pandas~=2.0->crfm-helm==0.5.6) (2025.2)
Requirement already satisfied: tzdata>=2022.7 in /Users/miguel/miniforge3/envs/crfm-helm/lib/python3.11/site-packages (from pandas~=2.0->crfm-helm==0.5.6) (2025.2)
Requirement already satisfied: pyparsing<4,>=2 in /Users/miguel/miniforge3/envs/crfm-helm/lib/python3.11/site-packages (from pyhocon~=0.3.59->crfm-helm==0.5.6) (3.2.3)
Requirement already satisfied: absl-py in /Users/miguel/miniforge3/envs/crfm-helm/lib/python3.11/site-packages (from rouge-score~=0.1.2->crfm-helm==0.5.6) (2.3.1)
Requirement already satisfied: six>=1.14.0 in /Users/miguel/miniforge3/envs/crfm-helm/lib/python3.11/site-packages (from rouge-score~=0.1.2->crfm-helm==0.5.6) (1.17.0)
Requirement already satisfied: spacy-legacy<3.1.0,>=3.0.11 in /Users/miguel/miniforge3/envs/crfm-helm/lib/python3.11/site-packages (from spacy~=3.5->crfm-helm==0.5.6) (3.0.12)
Requirement already satisfied: spacy-loggers<2.0.0,>=1.0.0 in /Users/miguel/miniforge3/envs/crfm-helm/lib/python3.11/site-packages (from spacy~=3.5->crfm-helm==0.5.6) (1.0.5)
Requirement already satisfied: murmurhash<1.1.0,>=0.28.0 in /Users/miguel/miniforge3/envs/crfm-helm/lib/python3.11/site-packages (from spacy~=3.5->crfm-helm==0.5.6) (1.0.13)
Requirement already satisfied: cymem<2.1.0,>=2.0.2 in /Users/miguel/miniforge3/envs/crfm-helm/lib/python3.11/site-packages (from spacy~=3.5->crfm-helm==0.5.6) (2.0.11)
Requirement already satisfied: preshed<3.1.0,>=3.0.2 in /Users/miguel/miniforge3/envs/crfm-helm/lib/python3.11/site-packages (from spacy~=3.5->crfm-helm==0.5.6) (3.0.10)
Requirement already satisfied: thinc<8.4.0,>=8.3.4 in /Users/miguel/miniforge3/envs/crfm-helm/lib/python3.11/site-packages (from spacy~=3.5->crfm-helm==0.5.6) (8.3.4)
Requirement already satisfied: wasabi<1.2.0,>=0.9.1 in /Users/miguel/miniforge3/envs/crfm-helm/lib/python3.11/site-packages (from spacy~=3.5->crfm-helm==0.5.6) (1.1.3)
Requirement already satisfied: srsly<3.0.0,>=2.4.3 in /Users/miguel/miniforge3/envs/crfm-helm/lib/python3.11/site-packages (from spacy~=3.5->crfm-helm==0.5.6) (2.5.1)
Requirement already satisfied: catalogue<2.1.0,>=2.0.6 in /Users/miguel/miniforge3/envs/crfm-helm/lib/python3.11/site-packages (from spacy~=3.5->crfm-helm==0.5.6) (2.0.10)
Requirement already satisfied: weasel<0.5.0,>=0.1.0 in /Users/miguel/miniforge3/envs/crfm-helm/lib/python3.11/site-packages (from spacy~=3.5->crfm-helm==0.5.6) (0.4.1)
Requirement already satisfied: typer<1.0.0,>=0.3.0 in /Users/miguel/miniforge3/envs/crfm-helm/lib/python3.11/site-packages (from spacy~=3.5->crfm-helm==0.5.6) (0.15.3)
Requirement already satisfied: pydantic!=1.8,!=1.8.1,<3.0.0,>=1.7.4 in /Users/miguel/miniforge3/envs/crfm-helm/lib/python3.11/site-packages (from spacy~=3.5->crfm-helm==0.5.6) (2.11.7)
Requirement already satisfied: jinja2 in /Users/miguel/miniforge3/envs/crfm-helm/lib/python3.11/site-packages (from spacy~=3.5->crfm-helm==0.5.6) (3.1.6)
Requirement already satisfied: setuptools in /Users/miguel/miniforge3/envs/crfm-helm/lib/python3.11/site-packages (from spacy~=3.5->crfm-helm==0.5.6) (80.9.0)
Requirement already satisfied: langcodes<4.0.0,>=3.2.0 in /Users/miguel/miniforge3/envs/crfm-helm/lib/python3.11/site-packages (from spacy~=3.5->crfm-helm==0.5.6) (3.5.0)
Requirement already satisfied: language-data>=1.2 in /Users/miguel/miniforge3/envs/crfm-helm/lib/python3.11/site-packages (from langcodes<4.0.0,>=3.2.0->spacy~=3.5->crfm-helm==0.5.6) (1.3.0)
Requirement already satisfied: annotated-types>=0.6.0 in /Users/miguel/miniforge3/envs/crfm-helm/lib/python3.11/site-packages (from pydantic!=1.8,!=1.8.1,<3.0.0,>=1.7.4->spacy~=3.5->crfm-helm==0.5.6) (0.7.0)
Requirement already satisfied: pydantic-core==2.33.2 in /Users/miguel/miniforge3/envs/crfm-helm/lib/python3.11/site-packages (from pydantic!=1.8,!=1.8.1,<3.0.0,>=1.7.4->spacy~=3.5->crfm-helm==0.5.6) (2.33.2)
Requirement already satisfied: typing-extensions>=4.12.2 in /Users/miguel/miniforge3/envs/crfm-helm/lib/python3.11/site-packages (from pydantic!=1.8,!=1.8.1,<3.0.0,>=1.7.4->spacy~=3.5->crfm-helm==0.5.6) (4.14.1)
Requirement already satisfied: typing-inspection>=0.4.0 in /Users/miguel/miniforge3/envs/crfm-helm/lib/python3.11/site-packages (from pydantic!=1.8,!=1.8.1,<3.0.0,>=1.7.4->spacy~=3.5->crfm-helm==0.5.6) (0.4.1)
Requirement already satisfied: charset_normalizer<4,>=2 in /Users/miguel/miniforge3/envs/crfm-helm/lib/python3.11/site-packages (from requests->bert-score~=0.3->crfm-helm==0.5.6) (3.4.2)
Requirement already satisfied: idna<4,>=2.5 in /Users/miguel/miniforge3/envs/crfm-helm/lib/python3.11/site-packages (from requests->bert-score~=0.3->crfm-helm==0.5.6) (3.10)
Requirement already satisfied: urllib3<3,>=1.21.1 in /Users/miguel/miniforge3/envs/crfm-helm/lib/python3.11/site-packages (from requests->bert-score~=0.3->crfm-helm==0.5.6) (2.5.0)
Requirement already satisfied: certifi>=2017.4.17 in /Users/miguel/miniforge3/envs/crfm-helm/lib/python3.11/site-packages (from requests->bert-score~=0.3->crfm-helm==0.5.6) (2025.7.14)
Collecting gin-config (from summ-eval~=0.892->crfm-helm==0.5.6)
  Using cached gin_config-0.5.0-py3-none-any.whl.metadata (2.9 kB)
Collecting moverscore (from summ-eval~=0.892->crfm-helm==0.5.6)
  Using cached moverscore-1.0.3.tar.gz (7.7 kB)
  Preparing metadata (setup.py) ... done
Collecting pytorch-pretrained-bert (from summ-eval~=0.892->crfm-helm==0.5.6)
  Using cached pytorch_pretrained_bert-0.6.2-py3-none-any.whl.metadata (86 kB)
Requirement already satisfied: psutil in /Users/miguel/miniforge3/envs/crfm-helm/lib/python3.11/site-packages (from summ-eval~=0.892->crfm-helm==0.5.6) (7.0.0)
Collecting stanza (from summ-eval~=0.892->crfm-helm==0.5.6)
  Using cached stanza-1.10.1-py3-none-any.whl.metadata (13 kB)
Collecting sacremoses (from summ-eval~=0.892->crfm-helm==0.5.6)
  Using cached sacremoses-0.1.1-py3-none-any.whl.metadata (8.3 kB)
Requirement already satisfied: sacrebleu in /Users/miguel/miniforge3/envs/crfm-helm/lib/python3.11/site-packages (from summ-eval~=0.892->crfm-helm==0.5.6) (2.5.1)
Collecting pyemd==0.5.1 (from summ-eval~=0.892->crfm-helm==0.5.6)
  Using cached pyemd-0.5.1.tar.gz (91 kB)
  Preparing metadata (setup.py) ... done
Collecting cython (from summ-eval~=0.892->crfm-helm==0.5.6)
  Using cached cython-3.1.2-cp311-cp311-macosx_11_0_arm64.whl.metadata (5.9 kB)
Requirement already satisfied: networkx in /Users/miguel/miniforge3/envs/crfm-helm/lib/python3.11/site-packages (from summ-eval~=0.892->crfm-helm==0.5.6) (3.5)
Collecting blanc (from summ-eval~=0.892->crfm-helm==0.5.6)
  Using cached blanc-0.3.4-py3-none-any.whl.metadata (14 kB)
Requirement already satisfied: blis<1.3.0,>=1.2.0 in /Users/miguel/miniforge3/envs/crfm-helm/lib/python3.11/site-packages (from thinc<8.4.0,>=8.3.4->spacy~=3.5->crfm-helm==0.5.6) (1.2.1)
Requirement already satisfied: confection<1.0.0,>=0.0.1 in /Users/miguel/miniforge3/envs/crfm-helm/lib/python3.11/site-packages (from thinc<8.4.0,>=8.3.4->spacy~=3.5->crfm-helm==0.5.6) (0.1.5)
Requirement already satisfied: sympy==1.13.1 in /Users/miguel/miniforge3/envs/crfm-helm/lib/python3.11/site-packages (from torch<3.0.0,>=1.13.1->crfm-helm==0.5.6) (1.13.1)
Requirement already satisfied: mpmath<1.4,>=1.1.0 in /Users/miguel/miniforge3/envs/crfm-helm/lib/python3.11/site-packages (from sympy==1.13.1->torch<3.0.0,>=1.13.1->crfm-helm==0.5.6) (1.3.0)
Requirement already satisfied: pillow!=8.3.*,>=5.3.0 in /Users/miguel/miniforge3/envs/crfm-helm/lib/python3.11/site-packages (from torchvision<3.0.0,>=0.14.1->crfm-helm==0.5.6) (10.4.0)
Requirement already satisfied: tokenizers<0.22,>=0.21 in /Users/miguel/miniforge3/envs/crfm-helm/lib/python3.11/site-packages (from transformers<4.53.0,~=4.40->crfm-helm==0.5.6) (0.21.2)
Requirement already satisfied: safetensors>=0.4.3 in /Users/miguel/miniforge3/envs/crfm-helm/lib/python3.11/site-packages (from transformers<4.53.0,~=4.40->crfm-helm==0.5.6) (0.5.3)
Requirement already satisfied: hf-xet<2.0.0,>=1.1.2 in /Users/miguel/miniforge3/envs/crfm-helm/lib/python3.11/site-packages (from huggingface-hub>=0.24.0->datasets~=3.1->crfm-helm==0.5.6) (1.1.5)
Requirement already satisfied: shellingham>=1.3.0 in /Users/miguel/miniforge3/envs/crfm-helm/lib/python3.11/site-packages (from typer<1.0.0,>=0.3.0->spacy~=3.5->crfm-helm==0.5.6) (1.5.4)
Requirement already satisfied: rich>=10.11.0 in /Users/miguel/miniforge3/envs/crfm-helm/lib/python3.11/site-packages (from typer<1.0.0,>=0.3.0->spacy~=3.5->crfm-helm==0.5.6) (13.9.4)
Requirement already satisfied: parameterized in /Users/miguel/miniforge3/envs/crfm-helm/lib/python3.11/site-packages (from uncertainty-calibration~=0.1.4->crfm-helm==0.5.6) (0.9.0)
Requirement already satisfied: cloudpathlib<1.0.0,>=0.7.0 in /Users/miguel/miniforge3/envs/crfm-helm/lib/python3.11/site-packages (from weasel<0.5.0,>=0.1.0->spacy~=3.5->crfm-helm==0.5.6) (0.21.1)
Requirement already satisfied: smart-open<8.0.0,>=5.2.1 in /Users/miguel/miniforge3/envs/crfm-helm/lib/python3.11/site-packages (from weasel<0.5.0,>=0.1.0->spacy~=3.5->crfm-helm==0.5.6) (7.3.0.post1)
Requirement already satisfied: wrapt in /Users/miguel/miniforge3/envs/crfm-helm/lib/python3.11/site-packages (from smart-open<8.0.0,>=5.2.1->weasel<0.5.0,>=0.1.0->spacy~=3.5->crfm-helm==0.5.6) (1.17.2)
Requirement already satisfied: aiohappyeyeballs>=2.5.0 in /Users/miguel/miniforge3/envs/crfm-helm/lib/python3.11/site-packages (from aiohttp!=4.0.0a0,!=4.0.0a1->fsspec[http]<=2025.3.0,>=2023.1.0->datasets~=3.1->crfm-helm==0.5.6) (2.6.1)
Requirement already satisfied: aiosignal>=1.4.0 in /Users/miguel/miniforge3/envs/crfm-helm/lib/python3.11/site-packages (from aiohttp!=4.0.0a0,!=4.0.0a1->fsspec[http]<=2025.3.0,>=2023.1.0->datasets~=3.1->crfm-helm==0.5.6) (1.4.0)
Requirement already satisfied: frozenlist>=1.1.1 in /Users/miguel/miniforge3/envs/crfm-helm/lib/python3.11/site-packages (from aiohttp!=4.0.0a0,!=4.0.0a1->fsspec[http]<=2025.3.0,>=2023.1.0->datasets~=3.1->crfm-helm==0.5.6) (1.7.0)
Requirement already satisfied: multidict<7.0,>=4.5 in /Users/miguel/miniforge3/envs/crfm-helm/lib/python3.11/site-packages (from aiohttp!=4.0.0a0,!=4.0.0a1->fsspec[http]<=2025.3.0,>=2023.1.0->datasets~=3.1->crfm-helm==0.5.6) (6.6.3)
Requirement already satisfied: propcache>=0.2.0 in /Users/miguel/miniforge3/envs/crfm-helm/lib/python3.11/site-packages (from aiohttp!=4.0.0a0,!=4.0.0a1->fsspec[http]<=2025.3.0,>=2023.1.0->datasets~=3.1->crfm-helm==0.5.6) (0.3.2)
Requirement already satisfied: yarl<2.0,>=1.17.0 in /Users/miguel/miniforge3/envs/crfm-helm/lib/python3.11/site-packages (from aiohttp!=4.0.0a0,!=4.0.0a1->fsspec[http]<=2025.3.0,>=2023.1.0->datasets~=3.1->crfm-helm==0.5.6) (1.20.1)
Requirement already satisfied: marisa-trie>=1.1.0 in /Users/miguel/miniforge3/envs/crfm-helm/lib/python3.11/site-packages (from language-data>=1.2->langcodes<4.0.0,>=3.2.0->spacy~=3.5->crfm-helm==0.5.6) (1.2.1)
Requirement already satisfied: markdown-it-py>=2.2.0 in /Users/miguel/miniforge3/envs/crfm-helm/lib/python3.11/site-packages (from rich>=10.11.0->typer<1.0.0,>=0.3.0->spacy~=3.5->crfm-helm==0.5.6) (3.0.0)
Requirement already satisfied: pygments<3.0.0,>=2.13.0 in /Users/miguel/miniforge3/envs/crfm-helm/lib/python3.11/site-packages (from rich>=10.11.0->typer<1.0.0,>=0.3.0->spacy~=3.5->crfm-helm==0.5.6) (2.19.2)
Requirement already satisfied: mdurl~=0.1 in /Users/miguel/miniforge3/envs/crfm-helm/lib/python3.11/site-packages (from markdown-it-py>=2.2.0->rich>=10.11.0->typer<1.0.0,>=0.3.0->spacy~=3.5->crfm-helm==0.5.6) (0.1.2)
Requirement already satisfied: threadpoolctl>=3.1.0 in /Users/miguel/miniforge3/envs/crfm-helm/lib/python3.11/site-packages (from scikit-learn>=1.1->crfm-helm==0.5.6) (3.6.0)
INFO: pip is looking at multiple versions of blanc to determine which version is compatible with other requirements. This could take a while.
  Using cached blanc-0.3.3-py3-none-any.whl.metadata (14 kB)
  Using cached blanc-0.3.2-py3-none-any.whl.metadata (14 kB)
  Using cached blanc-0.3.1-py3-none-any.whl.metadata (14 kB)
  Using cached blanc-0.3.0-py3-none-any.whl.metadata (14 kB)
  Using cached blanc-0.2.8-py3-none-any.whl.metadata (14 kB)
  Using cached blanc-0.2.7-py3-none-any.whl.metadata (14 kB)
  Using cached blanc-0.2.6-py3-none-any.whl.metadata (14 kB)
INFO: pip is still looking at multiple versions of blanc to determine which version is compatible with other requirements. This could take a while.
  Using cached blanc-0.2.5-py3-none-any.whl.metadata (13 kB)
  Using cached blanc-0.2.2-py3-none-any.whl.metadata (13 kB)
  Using cached blanc-0.2.1-py3-none-any.whl.metadata (13 kB)
  Using cached blanc-0.2.0-py3-none-any.whl.metadata (13 kB)
  Using cached blanc-0.1.9-py3-none-any.whl.metadata (13 kB)
INFO: This is taking longer than usual. You might need to provide the dependency resolver with stricter constraints to reduce runtime. See https://pip.pypa.io/warnings/backtracking for guidance. If you want to abort this run, press Ctrl + C.
  Using cached blanc-0.1.8-py3-none-any.whl.metadata (10.0 kB)
  Using cached blanc-0.1.7-py3-none-any.whl.metadata (10.0 kB)
  Using cached blanc-0.1.6-py3-none-any.whl.metadata (9.8 kB)
  Using cached blanc-0.1.5-py3-none-any.whl.metadata (9.8 kB)
  Using cached blanc-0.1.4-py3-none-any.whl.metadata (9.8 kB)
  Using cached blanc-0.1.3-py3-none-any.whl.metadata (9.8 kB)
  Using cached blanc-0.1.1-py3-none-any.whl.metadata (9.5 kB)
  Using cached blanc-0.1.0-py3-none-any.whl.metadata (8.9 kB)
Collecting absl-py (from rouge-score~=0.1.2->crfm-helm==0.5.6)
  Using cached absl_py-2.3.1-py3-none-any.whl.metadata (3.3 kB)
Collecting tzdata>=2022.7 (from pandas~=2.0->crfm-helm==0.5.6)
  Using cached tzdata-2025.2-py2.py3-none-any.whl.metadata (1.4 kB)
Collecting typing-inspection>=0.4.0 (from pydantic!=1.8,!=1.8.1,<3.0.0,>=1.7.4->spacy~=3.5->crfm-helm==0.5.6)
  Using cached typing_inspection-0.4.1-py3-none-any.whl.metadata (2.6 kB)
Collecting typing-extensions>=4.12.2 (from pydantic!=1.8,!=1.8.1,<3.0.0,>=1.7.4->spacy~=3.5->crfm-helm==0.5.6)
  Using cached typing_extensions-4.14.1-py3-none-any.whl.metadata (3.0 kB)
Collecting threadpoolctl>=3.1.0 (from scikit-learn>=1.1->crfm-helm==0.5.6)
  Using cached threadpoolctl-3.6.0-py3-none-any.whl.metadata (13 kB)
Collecting six>=1.14.0 (from rouge-score~=0.1.2->crfm-helm==0.5.6)
  Using cached six-1.17.0-py2.py3-none-any.whl.metadata (1.7 kB)
Collecting shellingham>=1.3.0 (from typer<1.0.0,>=0.3.0->spacy~=3.5->crfm-helm==0.5.6)
  Using cached shellingham-1.5.4-py2.py3-none-any.whl.metadata (3.5 kB)
Collecting scipy>=1.10 (from crfm-helm==0.5.6)
  Using cached scipy-1.16.0-cp311-cp311-macosx_14_0_arm64.whl.metadata (61 kB)
Collecting joblib (from nltk!=3.9.0,~=3.7->crfm-helm==0.5.6)
  Using cached joblib-1.5.1-py3-none-any.whl.metadata (5.6 kB)
Collecting scikit-learn>=1.1 (from crfm-helm==0.5.6)
  Using cached scikit_learn-1.7.1-cp311-cp311-macosx_12_0_arm64.whl.metadata (11 kB)
Collecting safetensors>=0.4.3 (from transformers<4.53.0,~=4.40->crfm-helm==0.5.6)
  Using cached safetensors-0.5.3-cp38-abi3-macosx_11_0_arm64.whl.metadata (3.8 kB)
Collecting mdurl~=0.1 (from markdown-it-py>=2.2.0->rich>=10.11.0->typer<1.0.0,>=0.3.0->spacy~=3.5->crfm-helm==0.5.6)
  Using cached mdurl-0.1.2-py3-none-any.whl.metadata (1.6 kB)
Collecting markdown-it-py>=2.2.0 (from rich>=10.11.0->typer<1.0.0,>=0.3.0->spacy~=3.5->crfm-helm==0.5.6)
  Using cached markdown_it_py-3.0.0-py3-none-any.whl.metadata (6.9 kB)
Collecting pygments<3.0.0,>=2.13.0 (from rich>=10.11.0->typer<1.0.0,>=0.3.0->spacy~=3.5->crfm-helm==0.5.6)
  Using cached pygments-2.19.2-py3-none-any.whl.metadata (2.5 kB)
Collecting rich>=10.11.0 (from typer<1.0.0,>=0.3.0->spacy~=3.5->crfm-helm==0.5.6)
  Using cached rich-14.0.0-py3-none-any.whl.metadata (18 kB)
Collecting regex>=2021.8.3 (from nltk!=3.9.0,~=3.7->crfm-helm==0.5.6)
  Using cached regex-2024.11.6-cp311-cp311-macosx_11_0_arm64.whl.metadata (40 kB)
Collecting pyyaml>=5.1 (from datasets~=3.1->crfm-helm==0.5.6)
  Using cached PyYAML-6.0.2-cp311-cp311-macosx_11_0_arm64.whl.metadata (2.1 kB)
Collecting pytz>=2020.1 (from pandas~=2.0->crfm-helm==0.5.6)
  Using cached pytz-2025.2-py2.py3-none-any.whl.metadata (22 kB)
Collecting python-dateutil>=2.8.2 (from pandas~=2.0->crfm-helm==0.5.6)
  Using cached python_dateutil-2.9.0.post0-py2.py3-none-any.whl.metadata (8.4 kB)
Collecting pyarrow>=11.0.0 (from crfm-helm==0.5.6)
  Using cached pyarrow-21.0.0-cp311-cp311-macosx_12_0_arm64.whl.metadata (3.3 kB)
Collecting propcache>=0.2.0 (from aiohttp!=4.0.0a0,!=4.0.0a1->fsspec[http]<=2025.3.0,>=2023.1.0->datasets~=3.1->crfm-helm==0.5.6)
  Using cached propcache-0.3.2-cp311-cp311-macosx_11_0_arm64.whl.metadata (12 kB)
Collecting pillow!=8.3.*,>=5.3.0 (from torchvision<3.0.0,>=0.14.1->crfm-helm==0.5.6)
  Using cached pillow-11.3.0-cp311-cp311-macosx_11_0_arm64.whl.metadata (9.0 kB)
Collecting packaging>=20.9 (from bert-score~=0.3->crfm-helm==0.5.6)
  Using cached packaging-25.0-py3-none-any.whl.metadata (3.3 kB)
Collecting MarkupSafe>=0.9.2 (from Mako~=1.2->crfm-helm==0.5.6)
  Using cached MarkupSafe-3.0.2-cp311-cp311-macosx_11_0_arm64.whl.metadata (4.0 kB)
Collecting marisa-trie>=1.1.0 (from language-data>=1.2->langcodes<4.0.0,>=3.2.0->spacy~=3.5->crfm-helm==0.5.6)
  Using cached marisa_trie-1.2.1-cp311-cp311-macosx_11_0_arm64.whl.metadata (9.0 kB)
Collecting language-data>=1.2 (from langcodes<4.0.0,>=3.2.0->spacy~=3.5->crfm-helm==0.5.6)
  Using cached language_data-1.3.0-py3-none-any.whl.metadata (4.3 kB)
Collecting frozenlist>=1.1.1 (from aiohttp!=4.0.0a0,!=4.0.0a1->fsspec[http]<=2025.3.0,>=2023.1.0->datasets~=3.1->crfm-helm==0.5.6)
  Using cached frozenlist-1.7.0-cp311-cp311-macosx_11_0_arm64.whl.metadata (18 kB)
Collecting click (from nltk!=3.9.0,~=3.7->crfm-helm==0.5.6)
  Using cached click-8.2.1-py3-none-any.whl.metadata (2.5 kB)
Collecting certifi>=2017.4.17 (from requests->bert-score~=0.3->crfm-helm==0.5.6)
  Using cached certifi-2025.7.14-py3-none-any.whl.metadata (2.4 kB)
Collecting attrs>=20 (from cattrs~=22.2->crfm-helm==0.5.6)
  Using cached attrs-25.3.0-py3-none-any.whl.metadata (10 kB)
Collecting annotated-types>=0.6.0 (from pydantic!=1.8,!=1.8.1,<3.0.0,>=1.7.4->spacy~=3.5->crfm-helm==0.5.6)
  Using cached annotated_types-0.7.0-py3-none-any.whl.metadata (15 kB)
Collecting aiosignal>=1.4.0 (from aiohttp!=4.0.0a0,!=4.0.0a1->fsspec[http]<=2025.3.0,>=2023.1.0->datasets~=3.1->crfm-helm==0.5.6)
  Using cached aiosignal-1.4.0-py3-none-any.whl.metadata (3.7 kB)
Collecting aiohappyeyeballs>=2.5.0 (from aiohttp!=4.0.0a0,!=4.0.0a1->fsspec[http]<=2025.3.0,>=2023.1.0->datasets~=3.1->crfm-helm==0.5.6)
  Using cached aiohappyeyeballs-2.6.1-py3-none-any.whl.metadata (5.9 kB)
Collecting yarl<2.0,>=1.17.0 (from aiohttp!=4.0.0a0,!=4.0.0a1->fsspec[http]<=2025.3.0,>=2023.1.0->datasets~=3.1->crfm-helm==0.5.6)
  Using cached yarl-1.20.1-cp311-cp311-macosx_11_0_arm64.whl.metadata (73 kB)
Collecting multidict<7.0,>=4.5 (from aiohttp!=4.0.0a0,!=4.0.0a1->fsspec[http]<=2025.3.0,>=2023.1.0->datasets~=3.1->crfm-helm==0.5.6)
  Using cached multidict-6.6.3-cp311-cp311-macosx_11_0_arm64.whl.metadata (5.3 kB)
Collecting aiohttp!=4.0.0a0,!=4.0.0a1 (from fsspec[http]<=2025.3.0,>=2023.1.0->datasets~=3.1->crfm-helm==0.5.6)
  Using cached aiohttp-3.12.14-cp311-cp311-macosx_11_0_arm64.whl.metadata (7.6 kB)
Collecting zstandard~=0.18.0 (from crfm-helm==0.5.6)
  Using cached zstandard-0.18.0-cp311-cp311-macosx_11_0_arm64.whl
Collecting smart-open<8.0.0,>=5.2.1 (from weasel<0.5.0,>=0.1.0->spacy~=3.5->crfm-helm==0.5.6)
  Using cached smart_open-7.3.0.post1-py3-none-any.whl.metadata (24 kB)
Collecting cloudpathlib<1.0.0,>=0.7.0 (from weasel<0.5.0,>=0.1.0->spacy~=3.5->crfm-helm==0.5.6)
  Using cached cloudpathlib-0.21.1-py3-none-any.whl.metadata (14 kB)
Collecting weasel<0.5.0,>=0.1.0 (from spacy~=3.5->crfm-helm==0.5.6)
  Using cached weasel-0.4.1-py3-none-any.whl.metadata (4.6 kB)
Collecting wasabi<1.2.0,>=0.9.1 (from spacy~=3.5->crfm-helm==0.5.6)
  Using cached wasabi-1.1.3-py3-none-any.whl.metadata (28 kB)
Collecting urllib3<3,>=1.21.1 (from requests->bert-score~=0.3->crfm-helm==0.5.6)
  Using cached urllib3-2.5.0-py3-none-any.whl.metadata (6.5 kB)
Collecting uncertainty-calibration~=0.1.4 (from crfm-helm==0.5.6)
  Using cached uncertainty_calibration-0.1.4-py3-none-any.whl
Collecting typer<1.0.0,>=0.3.0 (from spacy~=3.5->crfm-helm==0.5.6)
  Using cached typer-0.16.0-py3-none-any.whl.metadata (15 kB)
Collecting tokenizers<0.22,>=0.21 (from transformers<4.53.0,~=4.40->crfm-helm==0.5.6)
  Using cached tokenizers-0.21.2-cp39-abi3-macosx_11_0_arm64.whl.metadata (6.8 kB)
Collecting hf-xet<2.0.0,>=1.1.2 (from huggingface-hub>=0.24.0->datasets~=3.1->crfm-helm==0.5.6)
  Using cached hf_xet-1.1.5-cp37-abi3-macosx_11_0_arm64.whl.metadata (879 bytes)
Collecting huggingface-hub>=0.24.0 (from datasets~=3.1->crfm-helm==0.5.6)
  Using cached huggingface_hub-0.33.4-py3-none-any.whl.metadata (14 kB)
Collecting transformers<4.53.0,~=4.40 (from crfm-helm==0.5.6)
  Using cached transformers-4.52.4-py3-none-any.whl.metadata (38 kB)
Collecting tqdm~=4.64 (from crfm-helm==0.5.6)
  Using cached tqdm-4.67.1-py3-none-any.whl.metadata (57 kB)
Collecting torchvision<3.0.0,>=0.14.1 (from crfm-helm==0.5.6)
  Using cached torchvision-0.22.1-cp311-cp311-macosx_11_0_arm64.whl.metadata (6.1 kB)
Collecting torch<3.0.0,>=1.13.1 (from crfm-helm==0.5.6)
  Using cached torch-2.7.1-cp311-none-macosx_11_0_arm64.whl.metadata (29 kB)
Collecting sympy>=1.13.3 (from torch<3.0.0,>=1.13.1->crfm-helm==0.5.6)
  Using cached sympy-1.14.0-py3-none-any.whl.metadata (12 kB)
Collecting torchvision<3.0.0,>=0.14.1 (from crfm-helm==0.5.6)
  Using cached torchvision-0.22.0-cp311-cp311-macosx_11_0_arm64.whl.metadata (6.1 kB)
Collecting torch<3.0.0,>=1.13.1 (from crfm-helm==0.5.6)
  Using cached torch-2.7.0-cp311-none-macosx_11_0_arm64.whl.metadata (29 kB)
Collecting torchvision<3.0.0,>=0.14.1 (from crfm-helm==0.5.6)
  Using cached torchvision-0.21.0-cp311-cp311-macosx_11_0_arm64.whl.metadata (6.1 kB)
Collecting torch<3.0.0,>=1.13.1 (from crfm-helm==0.5.6)
  Using cached torch-2.6.0-cp311-none-macosx_11_0_arm64.whl.metadata (28 kB)
Collecting torchvision<3.0.0,>=0.14.1 (from crfm-helm==0.5.6)
  Using cached torchvision-0.20.1-cp311-cp311-macosx_11_0_arm64.whl.metadata (6.1 kB)
  Using cached torchvision-0.20.0-cp311-cp311-macosx_11_0_arm64.whl.metadata (6.1 kB)
Collecting torch<3.0.0,>=1.13.1 (from crfm-helm==0.5.6)
  Using cached torch-2.5.0-cp311-none-macosx_11_0_arm64.whl.metadata (28 kB)
Collecting torchvision<3.0.0,>=0.14.1 (from crfm-helm==0.5.6)
  Using cached torchvision-0.19.1-cp311-cp311-macosx_11_0_arm64.whl.metadata (6.0 kB)
Collecting torch<3.0.0,>=1.13.1 (from crfm-helm==0.5.6)
  Using cached torch-2.4.1-cp311-none-macosx_11_0_arm64.whl.metadata (26 kB)
Collecting torchvision<3.0.0,>=0.14.1 (from crfm-helm==0.5.6)
  Using cached torchvision-0.19.0-cp311-cp311-macosx_11_0_arm64.whl.metadata (6.0 kB)
Collecting torch<3.0.0,>=1.13.1 (from crfm-helm==0.5.6)
  Using cached torch-2.4.0-cp311-none-macosx_11_0_arm64.whl.metadata (26 kB)
Collecting torchvision<3.0.0,>=0.14.1 (from crfm-helm==0.5.6)
  Using cached torchvision-0.18.1-cp311-cp311-macosx_11_0_arm64.whl.metadata (6.6 kB)
Collecting torch<3.0.0,>=1.13.1 (from crfm-helm==0.5.6)
  Using cached torch-2.3.1-cp311-none-macosx_11_0_arm64.whl.metadata (26 kB)
Collecting torchvision<3.0.0,>=0.14.1 (from crfm-helm==0.5.6)
  Using cached torchvision-0.18.0-cp311-cp311-macosx_11_0_arm64.whl.metadata (6.6 kB)
Collecting torch<3.0.0,>=1.13.1 (from crfm-helm==0.5.6)
  Using cached torch-2.3.0-cp311-none-macosx_11_0_arm64.whl.metadata (26 kB)
Collecting torchvision<3.0.0,>=0.14.1 (from crfm-helm==0.5.6)
  Using cached torchvision-0.17.2-cp311-cp311-macosx_11_0_arm64.whl.metadata (6.6 kB)
Collecting torch<3.0.0,>=1.13.1 (from crfm-helm==0.5.6)
  Using cached torch-2.2.2-cp311-none-macosx_11_0_arm64.whl.metadata (25 kB)
Collecting torchvision<3.0.0,>=0.14.1 (from crfm-helm==0.5.6)
  Using cached torchvision-0.17.1-cp311-cp311-macosx_11_0_arm64.whl.metadata (6.6 kB)
Collecting torch<3.0.0,>=1.13.1 (from crfm-helm==0.5.6)
  Using cached torch-2.2.1-cp311-none-macosx_11_0_arm64.whl.metadata (25 kB)
Collecting torchvision<3.0.0,>=0.14.1 (from crfm-helm==0.5.6)
  Using cached torchvision-0.17.0-cp311-cp311-macosx_11_0_arm64.whl.metadata (6.6 kB)
Collecting torch<3.0.0,>=1.13.1 (from crfm-helm==0.5.6)
  Using cached torch-2.2.0-cp311-none-macosx_11_0_arm64.whl.metadata (25 kB)
Collecting torchvision<3.0.0,>=0.14.1 (from crfm-helm==0.5.6)
  Using cached torchvision-0.16.2-cp311-cp311-macosx_11_0_arm64.whl.metadata (6.6 kB)
Collecting torch<3.0.0,>=1.13.1 (from crfm-helm==0.5.6)
  Using cached torch-2.1.2-cp311-none-macosx_11_0_arm64.whl.metadata (25 kB)
Collecting torchvision<3.0.0,>=0.14.1 (from crfm-helm==0.5.6)
  Using cached torchvision-0.16.1-cp311-cp311-macosx_11_0_arm64.whl.metadata (6.6 kB)
Collecting torch<3.0.0,>=1.13.1 (from crfm-helm==0.5.6)
  Using cached torch-2.1.1-cp311-none-macosx_11_0_arm64.whl.metadata (25 kB)
Collecting torchvision<3.0.0,>=0.14.1 (from crfm-helm==0.5.6)
  Using cached torchvision-0.16.0-cp311-cp311-macosx_11_0_arm64.whl.metadata (6.6 kB)
Collecting torch<3.0.0,>=1.13.1 (from crfm-helm==0.5.6)
  Using cached torch-2.1.0-cp311-none-macosx_11_0_arm64.whl.metadata (24 kB)
Collecting torchvision<3.0.0,>=0.14.1 (from crfm-helm==0.5.6)
  Using cached torchvision-0.15.2-cp311-cp311-macosx_11_0_arm64.whl.metadata (11 kB)
Collecting torch<3.0.0,>=1.13.1 (from crfm-helm==0.5.6)
  Using cached torch-2.0.1-cp311-none-macosx_11_0_arm64.whl.metadata (23 kB)
Collecting torchvision<3.0.0,>=0.14.1 (from crfm-helm==0.5.6)
  Using cached torchvision-0.15.1-cp311-cp311-macosx_11_0_arm64.whl.metadata (11 kB)
Collecting torch<3.0.0,>=1.13.1 (from crfm-helm==0.5.6)
  Using cached torch-2.0.0-cp311-none-macosx_11_0_arm64.whl.metadata (23 kB)
Collecting mpmath<1.4,>=1.1.0 (from sympy==1.13.1->torch<3.0.0,>=1.13.1->crfm-helm==0.5.6)
  Using cached mpmath-1.3.0-py3-none-any.whl.metadata (8.6 kB)
Collecting sympy==1.13.1 (from torch<3.0.0,>=1.13.1->crfm-helm==0.5.6)
  Using cached sympy-1.13.1-py3-none-any.whl.metadata (12 kB)
Collecting confection<1.0.0,>=0.0.1 (from thinc<8.4.0,>=8.3.4->spacy~=3.5->crfm-helm==0.5.6)
  Using cached confection-0.1.5-py3-none-any.whl.metadata (19 kB)
Collecting blis<1.3.0,>=1.2.0 (from thinc<8.4.0,>=8.3.4->spacy~=3.5->crfm-helm==0.5.6)
  Using cached blis-1.2.1-cp311-cp311-macosx_11_0_arm64.whl.metadata (7.4 kB)
Collecting thinc<8.4.0,>=8.3.4 (from spacy~=3.5->crfm-helm==0.5.6)
  Using cached thinc-8.3.6-cp311-cp311-macosx_11_0_arm64.whl.metadata (15 kB)
Collecting srsly<3.0.0,>=2.4.3 (from spacy~=3.5->crfm-helm==0.5.6)
  Using cached srsly-2.5.1-cp311-cp311-macosx_11_0_arm64.whl.metadata (19 kB)
  Using cached srsly-2.5.0-cp311-cp311-macosx_11_0_arm64.whl.metadata (19 kB)
  Using cached srsly-2.4.8-cp311-cp311-macosx_11_0_arm64.whl.metadata (20 kB)
  Using cached srsly-2.4.7-cp311-cp311-macosx_11_0_arm64.whl.metadata (20 kB)
  Using cached srsly-2.4.6-cp311-cp311-macosx_11_0_arm64.whl.metadata (20 kB)
  Using cached srsly-2.4.5-cp311-cp311-macosx_11_0_arm64.whl.metadata (17 kB)
  Using cached srsly-2.4.4.tar.gz (320 kB)
  Installing build dependencies ... done
  Getting requirements to build wheel ... error
  error: subprocess-exited-with-error
  
  × Getting requirements to build wheel did not run successfully.
  │ exit code: 1
  ╰─> [55 lines of output]
      
      Error compiling Cython file:
      ------------------------------------------------------------
      ...
                              o = self._default(o)
                              default_used = True
                              continue
                          else:
                              raise OverflowError("Integer value out of range")
                  elif PyInt_CheckExact(o) if strict_types else PyInt_Check(o):
                       ^
      ------------------------------------------------------------
      
      srsly/msgpack/_packer.pyx:193:17: undeclared name not builtin: PyInt_CheckExact
      
      Error compiling Cython file:
      ------------------------------------------------------------
      ...
                              o = self._default(o)
                              default_used = True
                              continue
                          else:
                              raise OverflowError("Integer value out of range")
                  elif PyInt_CheckExact(o) if strict_types else PyInt_Check(o):
                                                                ^
      ------------------------------------------------------------
      
      srsly/msgpack/_packer.pyx:193:58: undeclared name not builtin: PyInt_Check
      Cythonizing sources
      Compiling srsly/msgpack/_unpacker.pyx because it changed.
      Compiling srsly/msgpack/_packer.pyx because it changed.
      [1/2] Cythonizing srsly/msgpack/_packer.pyx
      Traceback (most recent call last):
        File "/Users/miguel/miniforge3/envs/crfm-helm/lib/python3.11/site-packages/pip/_vendor/pyproject_hooks/_in_process/_in_process.py", line 389, in <module>
          main()
        File "/Users/miguel/miniforge3/envs/crfm-helm/lib/python3.11/site-packages/pip/_vendor/pyproject_hooks/_in_process/_in_process.py", line 373, in main
          json_out["return_val"] = hook(**hook_input["kwargs"])
                                   ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
        File "/Users/miguel/miniforge3/envs/crfm-helm/lib/python3.11/site-packages/pip/_vendor/pyproject_hooks/_in_process/_in_process.py", line 143, in get_requires_for_build_wheel
          return hook(config_settings)
                 ^^^^^^^^^^^^^^^^^^^^^
        File "/private/var/folders/q9/t9qq0b8x06j45qnbmdqwt7nr0000gn/T/pip-build-env-6cpln6ws/overlay/lib/python3.11/site-packages/setuptools/build_meta.py", line 331, in get_requires_for_build_wheel
          return self._get_build_requires(config_settings, requirements=[])
                 ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
        File "/private/var/folders/q9/t9qq0b8x06j45qnbmdqwt7nr0000gn/T/pip-build-env-6cpln6ws/overlay/lib/python3.11/site-packages/setuptools/build_meta.py", line 301, in _get_build_requires
          self.run_setup()
        File "/private/var/folders/q9/t9qq0b8x06j45qnbmdqwt7nr0000gn/T/pip-build-env-6cpln6ws/overlay/lib/python3.11/site-packages/setuptools/build_meta.py", line 317, in run_setup
          exec(code, locals())
        File "<string>", line 138, in <module>
        File "<string>", line 125, in setup_package
        File "/private/var/folders/q9/t9qq0b8x06j45qnbmdqwt7nr0000gn/T/pip-build-env-6cpln6ws/overlay/lib/python3.11/site-packages/Cython/Build/Dependencies.py", line 1154, in cythonize
          cythonize_one(*args)
        File "/private/var/folders/q9/t9qq0b8x06j45qnbmdqwt7nr0000gn/T/pip-build-env-6cpln6ws/overlay/lib/python3.11/site-packages/Cython/Build/Dependencies.py", line 1298, in cythonize_one
          raise CompileError(None, pyx_file)
      Cython.Compiler.Errors.CompileError: srsly/msgpack/_packer.pyx
      [end of output]
  
  note: This error originates from a subprocess, and is likely not a problem with pip.
error: subprocess-exited-with-error

× Getting requirements to build wheel did not run successfully.
│ exit code: 1
╰─> See above for output.

note: This error originates from a subprocess, and is likely not a problem with pip.
```

This works for python 3.10 but not for 3.11.

@yifanmai the main issue here is that `summ-eval~=0.892` depends on `blanc`, which in turn depends on `torch<2.0`. However, newer versions of `transformers` depend on `torch>=2.1`.