RuntimeError: Failed to import transformers.pipelines because of the following error (look up to see its traceback) [undefined symbol]
Author: ramyaprabhu-alt
Pull request: no

### System Info

transformers==4.36.2
torch==2.1.2+cu121
Python==3.10.12

### Who can help?

@Narsil 

### Information

- [ ] The official example scripts
- [X] My own modified scripts

### Tasks

- [ ] An officially supported task in the `examples` folder (such as GLUE/SQuAD, ...)
- [X] My own task or dataset (give details below)

### Reproduction

I installed eleutherai's lm-eval-harness and vllm on Pytorch's NGC docker [23:10-py3] container.  Once I'm done with the installation, i get the following error message:

```
  File "/usr/local/bin/transformers-cli", line 5, in <module>
    from transformers.commands.transformers_cli import main
  File "/usr/local/lib/python3.10/dist-packages/transformers/commands/transformers_cli.py", line 25, in <module>
    from .run import RunCommand
  File "/usr/local/lib/python3.10/dist-packages/transformers/commands/run.py", line 17, in <module>
    from ..pipelines import Pipeline, PipelineDataFormat, get_supported_tasks, pipeline
  File "/usr/local/lib/python3.10/dist-packages/transformers/pipelines/__init__.py", line 49, in <module>
    from .audio_classification import AudioClassificationPipeline
  File "/usr/local/lib/python3.10/dist-packages/transformers/pipelines/audio_classification.py", line 21, in <module>
    from .base import PIPELINE_INIT_ARGS, Pipeline
  File "/usr/local/lib/python3.10/dist-packages/transformers/pipelines/base.py", line 34, in <module>
    from ..modelcard import ModelCard
  File "/usr/local/lib/python3.10/dist-packages/transformers/modelcard.py", line 48, in <module>
    from .training_args import ParallelMode
  File "/usr/local/lib/python3.10/dist-packages/transformers/training_args.py", line 69, in <module>
    from accelerate.state import AcceleratorState, PartialState
  File "/usr/local/lib/python3.10/dist-packages/accelerate/__init__.py", line 3, in <module>
    from .accelerator import Accelerator
  File "/usr/local/lib/python3.10/dist-packages/accelerate/accelerator.py", line 35, in <module>
    from .checkpointing import load_accelerator_state, load_custom_state, save_accelerator_state, save_custom_state
  File "/usr/local/lib/python3.10/dist-packages/accelerate/checkpointing.py", line 24, in <module>
    from .utils import (
  File "/usr/local/lib/python3.10/dist-packages/accelerate/utils/__init__.py", line 150, in <module>
    from .launch import (
  File "/usr/local/lib/python3.10/dist-packages/accelerate/utils/launch.py", line 32, in <module>
    from ..utils.other import is_port_in_use, merge_dicts
  File "/usr/local/lib/python3.10/dist-packages/accelerate/utils/other.py", line 36, in <module>
    from .transformer_engine import convert_model
  File "/usr/local/lib/python3.10/dist-packages/accelerate/utils/transformer_engine.py", line 21, in <module>
    import transformer_engine.pytorch as te
  File "/usr/local/lib/python3.10/dist-packages/transformer_engine/pytorch/__init__.py", line 6, in <module>
    from .module import LayerNormLinear
  File "/usr/local/lib/python3.10/dist-packages/transformer_engine/pytorch/module/__init__.py", line 6, in <module>
    from .layernorm_linear import LayerNormLinear
  File "/usr/local/lib/python3.10/dist-packages/transformer_engine/pytorch/module/layernorm_linear.py", line 15, in <module>
    from .. import cpp_extensions as tex
  File "/usr/local/lib/python3.10/dist-packages/transformer_engine/pytorch/cpp_extensions/__init__.py", line 6, in <module>
    from transformer_engine_extensions import *
ImportError: /usr/local/lib/python3.10/dist-packages/transformer_engine_extensions.cpython-310-x86_64-linux-gnu.so: undefined symbol: _ZN5torch3jit17parseSchemaOrNameERKNSt7__cxx1112basic_stringIcSt11char_traitsIcESaIcEEE
```

infact i run into this error if I run transformers-cli env too

### Expected behavior

It should run without any error



Comments:
solved it

@ramyaprabhu-alt Hi, I meet the same question. Can you tell me how did you solve it? thx

pip uninstall transformer-engine worked for me

Not sure why I was tagged. Glad you found a solution

> pip uninstall transformer-engine worked for me

worded for me too, but don't know why it works.