Issue with sentence_transformers pointing to underlying transformers and tensors manipulations
Author: aabor
Pull request: no

### System Info

Hardware Overview:

Model Name: MacBook Pro
Model Identifier: Mac14,9
Model Number: MPHE3LL/A
Chip: Apple M2 Pro
Total Number of Cores: 10 (6 performance and 4 efficiency)
Memory: 16 GB
System Firmware Version: 10151.81.1
OS Loader Version: 10151.81.1
Activation Lock Status: Disabled

Collecting environment information...
PyTorch version: 2.2.1
Is debug build: False
CUDA used to build PyTorch: None
ROCM used to build PyTorch: N/A

OS: macOS 14.3.1 (arm64)
GCC version: Could not collect
Clang version: 15.0.0 (clang-1500.1.0.2.5)
CMake version: Could not collect
Libc version: N/A

Python version: 3.11.6 (v3.11.6:8b6ee5ba3b, Oct 2 2023, 11:18:21) [Clang 13.0.0 (clang-1300.0.29.30)] (64-bit runtime)
Python platform: macOS-14.3.1-arm64-arm-64bit
Is CUDA available: False
CUDA runtime version: No CUDA
CUDA_MODULE_LOADING set to: N/A
GPU models and configuration: No CUDA
Nvidia driver version: No CUDA
cuDNN version: No CUDA
HIP runtime version: N/A
MIOpen runtime version: N/A
Is XNNPACK available: True

CPU:
Apple M2 Pro

Versions of relevant libraries:
[pip3] mypy-extensions==1.0.0
[pip3] numpy==1.26.4
[pip3] onnxruntime==1.17.1
[pip3] torch==2.2.1
[conda] numpy 1.23.5 pypi_0 pypi

### Who can help?

_No response_

### Information

- [X] The official example scripts
- [ ] My own modified scripts

### Tasks

- [ ] An officially supported task in the `examples` folder (such as GLUE/SQuAD, ...)
- [ ] My own task or dataset (give details below)

### Reproduction

I have the following code as the first lines in my main function:

```py
from sentence_transformers import SentenceTransformer
model = SentenceTransformer("all-MiniLM-L6-v2")
```

after start the following happens:
2024-03-04 20:14:50,252:INFO:Load pretrained SentenceTransformer: all-MiniLM-L6-v2
/Library/Frameworks/Python.framework/Versions/3.11/lib/python3.11/multiprocessing/resource_tracker.py:254: UserWarning: resource_tracker: There appear to be 1 leaked semaphore objects to clean up at shutdown
warnings.warn('resource_tracker: There appear to be %d '

Process finished with exit code 139 (interrupted by signal 11: SIGSEGV)

 system crash report:
Translated Report (Full Report Below)

Process: Python [2020]
Path: /Library/Frameworks/Python.framework/Versions/3.11/Resources/Python.app/Contents/MacOS/Python
Identifier: org.python.python
Version: 3.11.6 (3.11.6)
Code Type: ARM-64 (Native)
Parent Process: pycharm [756]
Responsible: pycharm [756]
User ID: 501

Date/Time: 2024-03-04 20:20:38.0394 -0800
OS Version: macOS 14.3.1 (23D60)
Report Version: 12
Anonymous UUID: 66A06743-DA8E-FC87-662F-A0460A49AFF9

Time Awake Since Boot: 930 seconds

System Integrity Protection: enabled

Crashed Thread: 14

Exception Type: EXC_BAD_ACCESS (SIGSEGV)
Exception Codes: KERN_INVALID_ADDRESS at 0x0000000000000008
Exception Codes: 0x0000000000000001, 0x0000000000000008

Termination Reason: Namespace SIGNAL, Code 11 Segmentation fault: 11
Terminating Process: exc handler [2020]

VM Region Info: 0x8 is not in any region. Bytes before following region: 4310024184
REGION TYPE START - END [ VSIZE] PRT/MAX SHRMOD REGION DETAIL
UNUSED SPACE AT START
--->
__TEXT 100e5c000-100e60000 [ 16K] r-x/r-x SM=COW .../MacOS/Python

Thread 0:: Dispatch queue: com.apple.main-thread
0 libsystem_kernel.dylib 0x184809638 __bsdthread_create + 8
1 libsystem_pthread.dylib 0x184847738 _pthread_create + 1044
2 libomp.dylib 0x298d06b54 __kmp_create_worker + 208
3 libomp.dylib 0x298cc8bb4 kmp_allocate_thread + 1060
4 libomp.dylib 0x298cc3644 kmp_allocate_team + 2320
5 libomp.dylib 0x298cc543c kmp_fork_call + 5884
6 libomp.dylib 0x298cb8088 kmpc_fork_call + 196
7 libtorch_cpu.dylib 0x2a52a5c38 at::TensorIteratorBase::for_each(c10::function_ref<void (char**, long long const*, long long, long long)>, long long) + 424
8 libtorch_cpu.dylib 0x2a78a1328 at::native::DEFAULT::direct_copy_kernel(at::TensorIteratorBase&) + 348
9 libtorch_cpu.dylib 0x2a56431b4 at::native::copy(at::Tensor&, at::Tensor const&, bool) + 2612
10 libtorch_cpu.dylib 0x2a96a4fc4 c10::impl::wrap_kernel_functor_unboxed<c10::impl::detail::WrapFunctionIntoFunctor<c10::CompileTimeFunctionPointer<at::Tensor& (c10::DispatchKeySet, at::Tensor&, at::Tensor const&, bool), &torch::ADInplaceOrView::copy(c10::DispatchKeySet, at::Tensor&, at::Tensor const&, bool)>, at::Tensor&, c10::guts::typelist::typelist<c10::DispatchKeySet, at::Tensor&, at::Tensor const&, bool>>, at::Tensor& (c10::DispatchKeySet, at::Tensor&, at::Tensor const&, bool)>::call(c10::OperatorKernel*, c10::DispatchKeySet, at::Tensor&, at::Tensor const&, bool) + 72
11 libtorch_cpu.dylib 0x2a96a2078 c10::impl::wrap_kernel_functor_unboxed<c10::impl::detail::WrapFunctionIntoFunctor<c10::CompileTimeFunctionPointer<at::Tensor& (c10::DispatchKeySet, at::Tensor&, at::Tensor const&, bool), &torch::autograd::VariableType::(anonymous namespace)::copy(c10::DispatchKeySet, at::Tensor&, at::Tensor const&, bool)>, at::Tensor&, c10::guts::typelist::typelist<c10::DispatchKeySet, at::Tensor&, at::Tensor const&, bool>>, at::Tensor& (c10::DispatchKeySet, at::Tensor&, at::Tensor const&, bool)>::call(c10::OperatorKernel*, c10::DispatchKeySet, at::Tensor&, at::Tensor const&, bool) + 576
12 libtorch_cpu.dylib 0x2a622e4c8 at::ops::copy::call(at::Tensor&, at::Tensor const&, bool) + 280
13 libtorch_python.dylib 0x299fe5d8c torch::autograd::THPVariable_copy(_object*, _object*, _object*) + 512
14 Python 0x102149784 cfunction_call + 60
15 Python 0x1020e4d78 _PyObject_MakeTpCall + 128
16 Python 0x10220c2b4 _PyEval_EvalFrameDefault + 53388
17 Python 0x1022119ec _PyEval_Vector + 156

### Expected behavior

I want to initialize SentenceTransformer("all-MiniLM-L6-v2") model, but it fails with python interpreter crash.

Comments:
cc @tomaarsen 

See also https://github.com/UKPLab/sentence-transformers/issues/2528. As mentioned there, I suspect that this is related to a `torch` installation. 

I'll close this as unrelated and resolved !