Repository: EleutherAI/lm-evaluation-harness
Issue: ERROR: Package 'lm-eval' requires a different Python: 3.8.10 not in '>=3.9'
Root cause: Configuration Error

Hi all, 

I am trying to install lm-eval using "pip install -e ".[dev]"" as mentioned in the [link](https://github.com/EleutherAI/lm-evaluation-harness/blob/big-refactor/docs/new_task_guide.md). However I am getting the following error even after installing Python3.8.10 and Python3.9.
```

Defaulting to user installation because normal site-packages is not writeable
Obtaining file:///home/skrishna/lm-evaluation-harness
  Preparing metadata (setup.py) ... done
Requirement already satisfied: accelerate>=0.18.0 in /home/skrishna/.local/lib/python3.8/site-packages (from lm-eval==1.0.0) (0.21.0)
Requirement already satisfied: datasets>=2.0.0 in /usr/local/lib/python3.8/dist-packages (from lm-eval==1.0.0) (2.12.0)
Collecting evaluate (from lm-eval==1.0.0)
  Using cached evaluate-0.4.0-py3-none-any.whl (81 kB)
Requirement already satisfied: jsonlines in /usr/local/lib/python3.8/dist-packages (from lm-eval==1.0.0) (3.1.0)
Requirement already satisfied: numexpr in /usr/local/lib/python3.8/dist-packages (from lm-eval==1.0.0) (2.8.4)
Collecting omegaconf>=2.2 (from lm-eval==1.0.0)
  Using cached omegaconf-2.3.0-py3-none-any.whl (79 kB)
Requirement already satisfied: peft>=0.2.0 in /home/skrishna/.local/lib/python3.8/site-packages (from lm-eval==1.0.0) (0.4.0)
Requirement already satisfied: pybind11>=2.6.2 in /usr/local/lib/python3.8/dist-packages (from lm-eval==1.0.0) (2.10.4)
Requirement already satisfied: pycountry in /usr/local/lib/python3.8/dist-packages (from lm-eval==1.0.0) (22.3.5)
Requirement already satisfied: pytablewriter in /usr/local/lib/python3.8/dist-packages (from lm-eval==1.0.0) (0.64.2)
Requirement already satisfied: rouge-score>=0.0.4 in /usr/local/lib/python3.8/dist-packages (from lm-eval==1.0.0) (0.1.2)
Requirement already satisfied: sacrebleu==1.5.0 in /usr/local/lib/python3.8/dist-packages (from lm-eval==1.0.0) (1.5.0)
Requirement already satisfied: scikit-learn>=0.24.1 in /usr/local/lib/python3.8/dist-packages (from lm-eval==1.0.0) (1.2.2)
Requirement already satisfied: sqlitedict in /usr/local/lib/python3.8/dist-packages (from lm-eval==1.0.0) (2.1.0)
Requirement already satisfied: torch>=1.8 in /home/skrishna/.local/lib/python3.8/site-packages (from lm-eval==1.0.0) (2.0.1)
Requirement already satisfied: tqdm-multiprocess in /usr/local/lib/python3.8/dist-packages (from lm-eval==1.0.0) (0.0.11)
Requirement already satisfied: transformers>=4.1 in /home/skrishna/.local/lib/python3.8/site-packages (from lm-eval==1.0.0) (4.31.0)
Requirement already satisfied: zstandard in /usr/local/lib/python3.8/dist-packages (from lm-eval==1.0.0) (0.21.0)
Collecting black (from lm-eval==1.0.0)
  Obtaining dependency information for black from https://files.pythonhosted.org/packages/b4/32/26beae8735a859030aa93d326dd529941fa9163d88110cee18cbbbc88547/black-23.9.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata
  Using cached black-23.9.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (65 kB)
Collecting flake8 (from lm-eval==1.0.0)
  Obtaining dependency information for flake8 from https://files.pythonhosted.org/packages/b0/24/bbf7175ffc47cb3d3e1eb523ddb23272968359dfcf2e1294707a2bf12fc4/flake8-6.1.0-py2.py3-none-any.whl.metadata
  Using cached flake8-6.1.0-py2.py3-none-any.whl.metadata (3.8 kB)
Collecting pre-commit (from lm-eval==1.0.0)
  Obtaining dependency information for pre-commit from https://files.pythonhosted.org/packages/58/56/3b24f8641c39021218ca16115a9cd88512ae16eab790513e832a36269e90/pre_commit-3.4.0-py2.py3-none-any.whl.metadata
  Using cached pre_commit-3.4.0-py2.py3-none-any.whl.metadata (1.3 kB)
Collecting pytest (from lm-eval==1.0.0)
  Obtaining dependency information for pytest from https://files.pythonhosted.org/packages/df/d0/e192c4275aecabf74faa1aacd75ef700091913236ec78b1a98f62a2412ee/pytest-7.4.2-py3-none-any.whl.metadata
  Using cached pytest-7.4.2-py3-none-any.whl.metadata (7.9 kB)
Collecting pytest-cov (from lm-eval==1.0.0)
  Obtaining dependency information for pytest-cov from https://files.pythonhosted.org/packages/a7/4b/8b78d126e275efa2379b1c2e09dc52cf70df16fc3b90613ef82531499d73/pytest_cov-4.1.0-py3-none-any.whl.metadata
  Using cached pytest_cov-4.1.0-py3-none-any.whl.metadata (26 kB)
Requirement already satisfied: portalocker in /usr/local/lib/python3.8/dist-packages (from sacrebleu==1.5.0->lm-eval==1.0.0) (2.7.0)
Requirement already satisfied: numpy>=1.17 in /usr/local/lib/python3.8/dist-packages (from accelerate>=0.18.0->lm-eval==1.0.0) (1.24.3)
Requirement already satisfied: packaging>=20.0 in /usr/local/lib/python3.8/dist-packages (from accelerate>=0.18.0->lm-eval==1.0.0) (23.1)
Requirement already satisfied: psutil in /usr/local/lib/python3.8/dist-packages (from accelerate>=0.18.0->lm-eval==1.0.0) (5.9.5)
Requirement already satisfied: pyyaml in /usr/lib/python3/dist-packages (from accelerate>=0.18.0->lm-eval==1.0.0) (5.3.1)
Requirement already satisfied: pyarrow>=8.0.0 in /usr/local/lib/python3.8/dist-packages (from datasets>=2.0.0->lm-eval==1.0.0) (12.0.0)
Requirement already satisfied: dill<0.3.7,>=0.3.0 in /usr/local/lib/python3.8/dist-packages (from datasets>=2.0.0->lm-eval==1.0.0) (0.3.6)
Requirement already satisfied: pandas in /usr/local/lib/python3.8/dist-packages (from datasets>=2.0.0->lm-eval==1.0.0) (2.0.1)
Requirement already satisfied: requests>=2.19.0 in /usr/local/lib/python3.8/dist-packages (from datasets>=2.0.0->lm-eval==1.0.0) (2.30.0)
Requirement already satisfied: tqdm>=4.62.1 in /usr/local/lib/python3.8/dist-packages (from datasets>=2.0.0->lm-eval==1.0.0) (4.65.0)
Requirement already satisfied: xxhash in /usr/local/lib/python3.8/dist-packages (from datasets>=2.0.0->lm-eval==1.0.0) (3.2.0)
Requirement already satisfied: multiprocess in /usr/local/lib/python3.8/dist-packages (from datasets>=2.0.0->lm-eval==1.0.0) (0.70.14)
Requirement already satisfied: fsspec[http]>=2021.11.1 in /usr/local/lib/python3.8/dist-packages (from datasets>=2.0.0->lm-eval==1.0.0) (2023.5.0)
Requirement already satisfied: aiohttp in /usr/local/lib/python3.8/dist-packages (from datasets>=2.0.0->lm-eval==1.0.0) (3.8.4)
Requirement already satisfied: huggingface-hub<1.0.0,>=0.11.0 in /usr/local/lib/python3.8/dist-packages (from datasets>=2.0.0->lm-eval==1.0.0) (0.14.1)
Requirement already satisfied: responses<0.19 in /usr/local/lib/python3.8/dist-packages (from datasets>=2.0.0->lm-eval==1.0.0) (0.18.0)
Collecting antlr4-python3-runtime==4.9.* (from omegaconf>=2.2->lm-eval==1.0.0)
  Using cached antlr4-python3-runtime-4.9.3.tar.gz (117 kB)
  Preparing metadata (setup.py) ... done
Requirement already satisfied: safetensors in /home/skrishna/.local/lib/python3.8/site-packages (from peft>=0.2.0->lm-eval==1.0.0) (0.3.2)
Requirement already satisfied: absl-py in /usr/local/lib/python3.8/dist-packages (from rouge-score>=0.0.4->lm-eval==1.0.0) (1.4.0)
Requirement already satisfied: nltk in /usr/local/lib/python3.8/dist-packages (from rouge-score>=0.0.4->lm-eval==1.0.0) (3.8.1)
Requirement already satisfied: six>=1.14.0 in /usr/lib/python3/dist-packages (from rouge-score>=0.0.4->lm-eval==1.0.0) (1.14.0)
Requirement already satisfied: scipy>=1.3.2 in /usr/local/lib/python3.8/dist-packages (from scikit-learn>=0.24.1->lm-eval==1.0.0) (1.10.1)
Requirement already satisfied: joblib>=1.1.1 in /usr/local/lib/python3.8/dist-packages (from scikit-learn>=0.24.1->lm-eval==1.0.0) (1.2.0)
Requirement already satisfied: threadpoolctl>=2.0.0 in /usr/local/lib/python3.8/dist-packages (from scikit-learn>=0.24.1->lm-eval==1.0.0) (3.1.0)
Requirement already satisfied: filelock in /usr/local/lib/python3.8/dist-packages (from torch>=1.8->lm-eval==1.0.0) (3.12.0)
Requirement already satisfied: typing-extensions in /usr/local/lib/python3.8/dist-packages (from torch>=1.8->lm-eval==1.0.0) (4.5.0)
Requirement already satisfied: sympy in /home/skrishna/.local/lib/python3.8/site-packages (from torch>=1.8->lm-eval==1.0.0) (1.12)
Requirement already satisfied: networkx in /home/skrishna/.local/lib/python3.8/site-packages (from torch>=1.8->lm-eval==1.0.0) (3.1)
Requirement already satisfied: jinja2 in /home/skrishna/.local/lib/python3.8/site-packages (from torch>=1.8->lm-eval==1.0.0) (3.1.2)
Requirement already satisfied: nvidia-cuda-nvrtc-cu11==11.7.99 in /home/skrishna/.local/lib/python3.8/site-packages (from torch>=1.8->lm-eval==1.0.0) (11.7.99)
Requirement already satisfied: nvidia-cuda-runtime-cu11==11.7.99 in /home/skrishna/.local/lib/python3.8/site-packages (from torch>=1.8->lm-eval==1.0.0) (11.7.99)
Requirement already satisfied: nvidia-cuda-cupti-cu11==11.7.101 in /home/skrishna/.local/lib/python3.8/site-packages (from torch>=1.8->lm-eval==1.0.0) (11.7.101)
Requirement already satisfied: nvidia-cudnn-cu11==8.5.0.96 in /home/skrishna/.local/lib/python3.8/site-packages (from torch>=1.8->lm-eval==1.0.0) (8.5.0.96)
Requirement already satisfied: nvidia-cublas-cu11==11.10.3.66 in /home/skrishna/.local/lib/python3.8/site-packages (from torch>=1.8->lm-eval==1.0.0) (11.10.3.66)
Requirement already satisfied: nvidia-cufft-cu11==10.9.0.58 in /home/skrishna/.local/lib/python3.8/site-packages (from torch>=1.8->lm-eval==1.0.0) (10.9.0.58)
Requirement already satisfied: nvidia-curand-cu11==10.2.10.91 in /home/skrishna/.local/lib/python3.8/site-packages (from torch>=1.8->lm-eval==1.0.0) (10.2.10.91)
Requirement already satisfied: nvidia-cusolver-cu11==11.4.0.1 in /home/skrishna/.local/lib/python3.8/site-packages (from torch>=1.8->lm-eval==1.0.0) (11.4.0.1)
Requirement already satisfied: nvidia-cusparse-cu11==11.7.4.91 in /home/skrishna/.local/lib/python3.8/site-packages (from torch>=1.8->lm-eval==1.0.0) (11.7.4.91)
Requirement already satisfied: nvidia-nccl-cu11==2.14.3 in /home/skrishna/.local/lib/python3.8/site-packages (from torch>=1.8->lm-eval==1.0.0) (2.14.3)
Requirement already satisfied: nvidia-nvtx-cu11==11.7.91 in /home/skrishna/.local/lib/python3.8/site-packages (from torch>=1.8->lm-eval==1.0.0) (11.7.91)
Requirement already satisfied: triton==2.0.0 in /home/skrishna/.local/lib/python3.8/site-packages (from torch>=1.8->lm-eval==1.0.0) (2.0.0)
Requirement already satisfied: setuptools in /usr/lib/python3/dist-packages (from nvidia-cublas-cu11==11.10.3.66->torch>=1.8->lm-eval==1.0.0) (45.2.0)
Requirement already satisfied: wheel in /usr/lib/python3/dist-packages (from nvidia-cublas-cu11==11.10.3.66->torch>=1.8->lm-eval==1.0.0) (0.34.2)
Requirement already satisfied: cmake in /usr/local/lib/python3.8/dist-packages (from triton==2.0.0->torch>=1.8->lm-eval==1.0.0) (3.26.3)
Requirement already satisfied: lit in /home/skrishna/.local/lib/python3.8/site-packages (from triton==2.0.0->torch>=1.8->lm-eval==1.0.0) (16.0.6)
Requirement already satisfied: regex!=2019.12.17 in /usr/local/lib/python3.8/dist-packages (from transformers>=4.1->lm-eval==1.0.0) (2023.5.5)
Requirement already satisfied: tokenizers!=0.11.3,<0.14,>=0.11.1 in /usr/local/lib/python3.8/dist-packages (from transformers>=4.1->lm-eval==1.0.0) (0.13.3)
Requirement already satisfied: click>=8.0.0 in /usr/local/lib/python3.8/dist-packages (from black->lm-eval==1.0.0) (8.1.3)
Collecting mypy-extensions>=0.4.3 (from black->lm-eval==1.0.0)
  Using cached mypy_extensions-1.0.0-py3-none-any.whl (4.7 kB)
Collecting pathspec>=0.9.0 (from black->lm-eval==1.0.0)
  Obtaining dependency information for pathspec>=0.9.0 from https://files.pythonhosted.org/packages/b4/2a/9b1be29146139ef459188f5e420a66e835dda921208db600b7037093891f/pathspec-0.11.2-py3-none-any.whl.metadata
  Using cached pathspec-0.11.2-py3-none-any.whl.metadata (19 kB)
Collecting platformdirs>=2 (from black->lm-eval==1.0.0)
  Obtaining dependency information for platformdirs>=2 from https://files.pythonhosted.org/packages/14/51/fe5a0d6ea589f0d4a1b97824fb518962ad48b27cd346dcdfa2405187997a/platformdirs-3.10.0-py3-none-any.whl.metadata
  Using cached platformdirs-3.10.0-py3-none-any.whl.metadata (11 kB)
Collecting tomli>=1.1.0 (from black->lm-eval==1.0.0)
  Using cached tomli-2.0.1-py3-none-any.whl (12 kB)
Collecting mccabe<0.8.0,>=0.7.0 (from flake8->lm-eval==1.0.0)
  Using cached mccabe-0.7.0-py2.py3-none-any.whl (7.3 kB)
Collecting pycodestyle<2.12.0,>=2.11.0 (from flake8->lm-eval==1.0.0)
  Obtaining dependency information for pycodestyle<2.12.0,>=2.11.0 from https://files.pythonhosted.org/packages/31/c2/e1508ed4395793f69e40fd8c6b5a690e1d568e649aae9492076a7b6befb4/pycodestyle-2.11.0-py2.py3-none-any.whl.metadata
  Using cached pycodestyle-2.11.0-py2.py3-none-any.whl.metadata (4.5 kB)
Collecting pyflakes<3.2.0,>=3.1.0 (from flake8->lm-eval==1.0.0)
  Obtaining dependency information for pyflakes<3.2.0,>=3.1.0 from https://files.pythonhosted.org/packages/00/e9/1e1fd7fae559bfd07704991e9a59dd1349b72423c904256c073ce88a9940/pyflakes-3.1.0-py2.py3-none-any.whl.metadata
  Using cached pyflakes-3.1.0-py2.py3-none-any.whl.metadata (3.5 kB)
Requirement already satisfied: attrs>=19.2.0 in /usr/local/lib/python3.8/dist-packages (from jsonlines->lm-eval==1.0.0) (23.1.0)
INFO: pip is looking at multiple versions of lm-eval to determine which version is compatible with other requirements. This could take a while.
Collecting flake8 (from lm-eval==1.0.0)
  Using cached flake8-6.0.0-py2.py3-none-any.whl (57 kB)
Collecting pycodestyle<2.11.0,>=2.10.0 (from flake8->lm-eval==1.0.0)
  Using cached pycodestyle-2.10.0-py2.py3-none-any.whl (41 kB)
Collecting pyflakes<3.1.0,>=3.0.0 (from flake8->lm-eval==1.0.0)
  Using cached pyflakes-3.0.1-py2.py3-none-any.whl (62 kB)
Collecting flake8 (from lm-eval==1.0.0)
  Using cached flake8-5.0.4-py2.py3-none-any.whl (61 kB)
Collecting pycodestyle<2.10.0,>=2.9.0 (from flake8->lm-eval==1.0.0)
  Using cached pycodestyle-2.9.1-py2.py3-none-any.whl (41 kB)
Collecting pyflakes<2.6.0,>=2.5.0 (from flake8->lm-eval==1.0.0)
  Using cached pyflakes-2.5.0-py2.py3-none-any.whl (66 kB)
Collecting flake8 (from lm-eval==1.0.0)
  Using cached flake8-5.0.3-py2.py3-none-any.whl (61 kB)
  Using cached flake8-5.0.2-py2.py3-none-any.whl (61 kB)
  Using cached flake8-5.0.1-py2.py3-none-any.whl (61 kB)
  Using cached flake8-5.0.0-py2.py3-none-any.whl (61 kB)
  Using cached flake8-4.0.1-py2.py3-none-any.whl (64 kB)
Collecting mccabe<0.7.0,>=0.6.0 (from flake8->lm-eval==1.0.0)
  Using cached mccabe-0.6.1-py2.py3-none-any.whl (8.6 kB)
Collecting pycodestyle<2.9.0,>=2.8.0 (from flake8->lm-eval==1.0.0)
  Using cached pycodestyle-2.8.0-py2.py3-none-any.whl (42 kB)
Collecting pyflakes<2.5.0,>=2.4.0 (from flake8->lm-eval==1.0.0)
  Using cached pyflakes-2.4.0-py2.py3-none-any.whl (69 kB)
INFO: pip is still looking at multiple versions of lm-eval to determine which version is compatible with other requirements. This could take a while.
Collecting flake8 (from lm-eval==1.0.0)
  Using cached flake8-4.0.0-py2.py3-none-any.whl (64 kB)
  Using cached flake8-3.9.2-py2.py3-none-any.whl (73 kB)
Collecting pyflakes<2.4.0,>=2.3.0 (from flake8->lm-eval==1.0.0)
  Using cached pyflakes-2.3.1-py2.py3-none-any.whl (68 kB)
Collecting pycodestyle<2.8.0,>=2.7.0 (from flake8->lm-eval==1.0.0)
  Using cached pycodestyle-2.7.0-py2.py3-none-any.whl (41 kB)
Collecting flake8 (from lm-eval==1.0.0)
  Using cached flake8-3.9.1-py2.py3-none-any.whl (73 kB)
  Using cached flake8-3.9.0-py2.py3-none-any.whl (73 kB)
  Using cached flake8-3.8.4-py2.py3-none-any.whl (72 kB)
Collecting pyflakes<2.3.0,>=2.2.0 (from flake8->lm-eval==1.0.0)
  Using cached pyflakes-2.2.0-py2.py3-none-any.whl (66 kB)
Collecting pycodestyle<2.7.0,>=2.6.0a1 (from flake8->lm-eval==1.0.0)
  Using cached pycodestyle-2.6.0-py2.py3-none-any.whl (41 kB)
INFO: This is taking longer than usual. You might need to provide the dependency resolver with stricter constraints to reduce runtime. See https://pip.pypa.io/warnings/backtracking for guidance. If you want to abort this run, press Ctrl + C.
Collecting flake8 (from lm-eval==1.0.0)
  Using cached flake8-3.8.3-py2.py3-none-any.whl (72 kB)
  Using cached flake8-3.8.2-py2.py3-none-any.whl (72 kB)
  Using cached flake8-3.8.1-py2.py3-none-any.whl (72 kB)
  Using cached flake8-3.8.0-py2.py3-none-any.whl (72 kB)
  Using cached flake8-3.7.9-py2.py3-none-any.whl (69 kB)
Collecting entrypoints<0.4.0,>=0.3.0 (from flake8->lm-eval==1.0.0)
  Using cached entrypoints-0.3-py2.py3-none-any.whl (11 kB)
Collecting pyflakes<2.2.0,>=2.1.0 (from flake8->lm-eval==1.0.0)
  Using cached pyflakes-2.1.1-py2.py3-none-any.whl (59 kB)
Collecting pycodestyle<2.6.0,>=2.5.0 (from flake8->lm-eval==1.0.0)
  Using cached pycodestyle-2.5.0-py2.py3-none-any.whl (51 kB)
Collecting flake8 (from lm-eval==1.0.0)
  Using cached flake8-3.7.8-py2.py3-none-any.whl (70 kB)
  Using cached flake8-3.7.7-py2.py3-none-any.whl (68 kB)
  Using cached flake8-3.7.6-py2.py3-none-any.whl (68 kB)
  Using cached flake8-3.7.5-py2.py3-none-any.whl (68 kB)
  Using cached flake8-3.7.4-py2.py3-none-any.whl (69 kB)
  Using cached flake8-3.7.3-py2.py3-none-any.whl (69 kB)
  Using cached flake8-3.7.2-py2.py3-none-any.whl (68 kB)
  Using cached flake8-3.7.1-py2.py3-none-any.whl (70 kB)
  Using cached flake8-3.7.0-py2.py3-none-any.whl (68 kB)
  Using cached flake8-3.6.0-py2.py3-none-any.whl (68 kB)
Collecting pyflakes<2.1.0,>=2.0.0 (from flake8->lm-eval==1.0.0)
  Using cached pyflakes-2.0.0-py2.py3-none-any.whl (53 kB)
Collecting pycodestyle<2.5.0,>=2.4.0 (from flake8->lm-eval==1.0.0)
  Using cached pycodestyle-2.4.0-py2.py3-none-any.whl (62 kB)
Collecting flake8 (from lm-eval==1.0.0)
  Using cached flake8-3.5.0-py2.py3-none-any.whl (69 kB)
Collecting pyflakes<1.7.0,>=1.5.0 (from flake8->lm-eval==1.0.0)
  Using cached pyflakes-1.6.0-py2.py3-none-any.whl (227 kB)
Collecting pycodestyle<2.4.0,>=2.0.0 (from flake8->lm-eval==1.0.0)
  Using cached pycodestyle-2.3.1-py2.py3-none-any.whl (45 kB)
Collecting black (from lm-eval==1.0.0)
  Obtaining dependency information for black from https://files.pythonhosted.org/packages/2a/c2/e2cd7f95aa0f1a4d77ed0153efb213b99bfa5f086226a8f1fcc67483f62a/black-23.9.0-py3-none-any.whl.metadata
  Using cached black-23.9.0-py3-none-any.whl.metadata (64 kB)
  Obtaining dependency information for black from https://files.pythonhosted.org/packages/a7/a4/4ce0eeaccfd2665b2020cf759b05868f9be5e22a4f96b789417fce8ec57c/black-23.7.0-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata
  Using cached black-23.7.0-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (63 kB)
  Using cached black-23.3.0-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (1.6 MB)
  Using cached black-23.1.0-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (1.6 MB)
  Using cached black-22.12.0-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (1.5 MB)
  Using cached black-22.10.0-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (1.5 MB)
  Using cached black-22.8.0-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (1.5 MB)
  Using cached black-22.6.0-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (1.5 MB)
  Using cached black-22.3.0-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (1.5 MB)
  Using cached black-22.1.0-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (1.5 MB)
Collecting omegaconf>=2.2 (from lm-eval==1.0.0)
  Using cached omegaconf-2.2.3-py3-none-any.whl (79 kB)
  Using cached omegaconf-2.2.2-py3-none-any.whl (79 kB)
  Using cached omegaconf-2.2.1-py3-none-any.whl (78 kB)
ERROR: Package 'lm-eval' requires a different Python: 3.8.10 not in '>=3.9'
```

The error remains even after I try "pip install -e ."

I think as the last line of the error trace suggests upgrade to a python version 3.9 or greater.

I wish it was that simple. As mentioned in my comment above, I have tried that with a version >=3.9 as well and it still resulted in the same error. 

Can you post the error trace when you use >=3.9

Its the same stack trace actually. 

Resolved on discord.

I encountered with the same issue. And I successfully solved it.
Simply by using the following command:
pip install lm_eval
And the problem should be a piece of cake!