Repository: confident-ai/deepeval
Issue: Pandas module missing for MMLU Benchmark
Root cause: Environment Incompatibility

**Describe the bug**

When trying to run `deepeval.benchmarks.MMLU` i get an error because pandas cannot be imported.

**Steps to reproduce the behavior**

1. Run the following code in Python:
```python
from deepeval.benchmarks import MMLU
from deepeval.benchmarks.mmlu.task import MMLUTask

benchmark = MMLU()
```
2. You should get the following error message:
```
---------------------------------------------------------------------------
ModuleNotFoundError                       Traceback (most recent call last)
Cell In[4], line 4
      1 from deepeval.benchmarks import MMLU
      2 from deepeval.benchmarks.mmlu.task import MMLUTask
----> 4 benchmark = MMLU()

File c:\anaconda3\envs\benchmark-llm\Lib\site-packages\deepeval\benchmarks\mmlu\mmlu.py:25, in MMLU.__init__(self, tasks, n_shots, n_problems_per_task, verbose_mode, confinement_instructions, **kwargs)
     15 def __init__(
     16     self,
     17     tasks: Optional[List[MMLUTask]] = None,
   (...)     22     **kwargs,
     23 ):
     24     from deepeval.scorer import Scorer
---> 25     import pandas as pd
     27     assert n_shots <= 5, "MMLU only supports n_shots <= 5"
     28     super().__init__(**kwargs)

ModuleNotFoundError: No module named 'pandas'
```

**Expected behavior**

Pandas should be installed as a dependancy when Deepeval is installed to avoid this error message.

**Software versions:**
- OS: Windows 10
- Conda : conda 24.11.0
- Python : 3.11.13
- Full list of installed packages (`conda list`):
 ```
# packages in environment at C:\anaconda3\envs\benchmark-llm:
#
# Name                    Version                   Build  Channel
aiohappyeyeballs          2.6.1                    pypi_0    pypi
aiohttp                   3.12.15                  pypi_0    pypi
aiosignal                 1.4.0                    pypi_0    pypi
annotated-types           0.7.0                    pypi_0    pypi
anthropic                 0.64.0                   pypi_0    pypi
anyio                     4.10.0                   pypi_0    pypi
asttokens                 3.0.0                    pypi_0    pypi
attrs                     25.3.0                   pypi_0    pypi
backoff                   2.2.1                    pypi_0    pypi
bzip2                     1.0.8                h2bbff1b_6
ca-certificates           2025.7.15            haa95532_0
cachetools                5.5.2                    pypi_0    pypi
certifi                   2025.8.3                 pypi_0    pypi
charset-normalizer        3.4.3                    pypi_0    pypi
click                     8.2.1                    pypi_0    pypi
colorama                  0.4.6                    pypi_0    pypi
comm                      0.2.3                    pypi_0    pypi
debugpy                   1.8.16                   pypi_0    pypi
decorator                 5.2.1                    pypi_0    pypi
deepeval                  3.4.0                    pypi_0    pypi
distro                    1.9.0                    pypi_0    pypi
execnet                   2.1.1                    pypi_0    pypi
executing                 2.2.0                    pypi_0    pypi
expat                     2.7.1                h8ddb27b_0
frozenlist                1.7.0                    pypi_0    pypi
google-auth               2.40.3                   pypi_0    pypi
google-genai              1.31.0                   pypi_0    pypi
googleapis-common-protos  1.70.0                   pypi_0    pypi
grpcio                    1.74.0                   pypi_0    pypi
h11                       0.16.0                   pypi_0    pypi
httpcore                  1.0.9                    pypi_0    pypi
httpx                     0.28.1                   pypi_0    pypi
idna                      3.10                     pypi_0    pypi
importlib-metadata        8.7.0                    pypi_0    pypi
iniconfig                 2.1.0                    pypi_0    pypi
ipykernel                 6.30.1                   pypi_0    pypi
ipython                   9.4.0                    pypi_0    pypi
ipython-pygments-lexers   1.1.1                    pypi_0    pypi
jedi                      0.19.2                   pypi_0    pypi
jiter                     0.10.0                   pypi_0    pypi
jupyter-client            8.6.3                    pypi_0    pypi
jupyter-core              5.8.1                    pypi_0    pypi
libffi                    3.4.4                hd77b12b_1
markdown-it-py            4.0.0                    pypi_0    pypi
matplotlib-inline         0.1.7                    pypi_0    pypi
mdurl                     0.1.2                    pypi_0    pypi
multidict                 6.6.4                    pypi_0    pypi
nest-asyncio              1.6.0                    pypi_0    pypi
ollama                    0.5.3                    pypi_0    pypi
openai                    1.101.0                  pypi_0    pypi
openssl                   3.0.17               h35632f6_0
opentelemetry-api         1.36.0                   pypi_0    pypi
opentelemetry-exporter-otlp-proto-common 1.36.0                   pypi_0    pypi
opentelemetry-exporter-otlp-proto-grpc 1.36.0                   pypi_0    pypi
opentelemetry-proto       1.36.0                   pypi_0    pypi
opentelemetry-sdk         1.36.0                   pypi_0    pypi
opentelemetry-semantic-conventions 0.57b0                   pypi_0    pypi
packaging                 25.0                     pypi_0    pypi
parso                     0.8.5                    pypi_0    pypi
pip                       25.1               pyhc872135_2
platformdirs              4.3.8                    pypi_0    pypi
pluggy                    1.6.0                    pypi_0    pypi
portalocker               3.2.0                    pypi_0    pypi
posthog                   6.6.1                    pypi_0    pypi
prompt-toolkit            3.0.51                   pypi_0    pypi
propcache                 0.3.2                    pypi_0    pypi
protobuf                  6.32.0                   pypi_0    pypi
psutil                    7.0.0                    pypi_0    pypi
pure-eval                 0.2.3                    pypi_0    pypi
pyasn1                    0.6.1                    pypi_0    pypi
pyasn1-modules            0.4.2                    pypi_0    pypi
pydantic                  2.11.7                   pypi_0    pypi
pydantic-core             2.33.2                   pypi_0    pypi
pyfiglet                  1.0.4                    pypi_0    pypi
pygments                  2.19.2                   pypi_0    pypi
pytest                    8.4.1                    pypi_0    pypi
pytest-asyncio            1.1.0                    pypi_0    pypi
pytest-repeat             0.9.4                    pypi_0    pypi
pytest-rerunfailures      12.0                     pypi_0    pypi
pytest-xdist              3.8.0                    pypi_0    pypi
python                    3.11.13              h981015d_0
python-dateutil           2.9.0.post0              pypi_0    pypi
pywin32                   311                      pypi_0    pypi
pyzmq                     27.0.2                   pypi_0    pypi
requests                  2.32.5                   pypi_0    pypi
rich                      14.1.0                   pypi_0    pypi
rsa                       4.9.1                    pypi_0    pypi
sentry-sdk                2.35.0                   pypi_0    pypi
setuptools                78.1.1          py311haa95532_0
shellingham               1.5.4                    pypi_0    pypi
six                       1.17.0                   pypi_0    pypi
sniffio                   1.3.1                    pypi_0    pypi
sqlite                    3.50.2               hda9a48d_1
stack-data                0.6.3                    pypi_0    pypi
tabulate                  0.9.0                    pypi_0    pypi
tenacity                  9.1.2                    pypi_0    pypi
tk                        8.6.15               hf199647_0
tornado                   6.5.2                    pypi_0    pypi
tqdm                      4.67.1                   pypi_0    pypi
traitlets                 5.14.3                   pypi_0    pypi
typer                     0.16.1                   pypi_0    pypi
typing-extensions         4.14.1                   pypi_0    pypi
typing-inspection         0.4.1                    pypi_0    pypi
tzdata                    2025b                h04d1e81_0
ucrt                      10.0.22621.0         haa95532_0
urllib3                   2.5.0                    pypi_0    pypi
vc                        14.3                h2df5915_10
vc14_runtime              14.44.35208         h4927774_10
vs2015_runtime            14.44.35208         ha6b5a95_10
wcwidth                   0.2.13                   pypi_0    pypi
websockets                15.0.1                   pypi_0    pypi
wheel                     0.45.1          py311haa95532_0
xz                        5.6.4                h4754444_1
yarl                      1.20.1                   pypi_0    pypi
zipp                      3.23.0                   pypi_0    pypi
zlib                      1.2.13               h8cc25b3_1
```


After having installed manually pandas 2.3.2, i ran into a similar issue with the package datasets that is imported by  [deepeval/benchmarks/base_benchmark.py](https://github.com/confident-ai/deepeval/blob/main/deepeval/benchmarks/base_benchmark.py#L13) but not installed as a dependancy of deepeval.

@quentinmenner actually this is the correct behavior - pandas and datasets is too big a dependency to include when its only for benchmarks