Repository: pytorch
Issue: caffe2/utils/signal_handler.cc is failing to symbolize libtorch_cpu.so
Labels: module: build,triaged

Caffe2 has a nifty signal handler that dumps stack traces of all threads when we abort due to a signal. Sometimes this signal handler even gets installed in our CI! (See #56109) Unfortunately, it doesn't seem to symbolize libtorch_cpu.so correctly (the most important thing!)

<details>

```
Apr 14 21:02:39 terminate called without an active exception
Apr 14 21:02:39 SIGABRT(6), PID: 18613, Thread 18613: 
Apr 14 21:02:39 [0] ???(0x7f70990876a9) in /opt/conda/lib/python3.8/site-packages/torch/lib/libtorch_cpu.so
Apr 14 21:02:39 [1] ???(0x7f7099087d23) in /opt/conda/lib/python3.8/site-packages/torch/lib/libtorch_cpu.so
Apr 14 21:02:39 [2] ???(0x7f70b5017980) in /lib/x86_64-linux-gnu/libpthread.so.0
Apr 14 21:02:39 [3] ???(0x7f70b501629a) in /lib/x86_64-linux-gnu/libpthread.so.0
Apr 14 21:02:39 [4] __pthread_mutex_unlock+0x42(0x7f70b5010852) in /lib/x86_64-linux-gnu/libpthread.so.0
Apr 14 21:02:39 [5] ???+0x389dd384(0x5653389dd384) in /opt/conda/bin/python
Apr 14 21:02:39 [6] _PyEval_EvalFrameDefault+0x63ce(0x5653389b869e) in /opt/conda/bin/python
Apr 14 21:02:39 [7] _PyEval_EvalCodeWithName+0x300(0x565338980760) in /opt/conda/bin/python
Apr 14 21:02:39 [8] _PyFunction_Vectorcall+0x1e3(0x565338981593) in /opt/conda/bin/python
Apr 14 21:02:39 [9] ???+0x38942add(0x565338942add) in /opt/conda/bin/python
Apr 14 21:02:39 [10] PyObject_CallFunctionObjArgs+0x9e(0x565338942d3e) in /opt/conda/bin/python
Apr 14 21:02:39 [11] ???+0x389e9394(0x5653389e9394) in /opt/conda/bin/python
Apr 14 21:02:39 [12] PyObject_ClearWeakRefs+0xe8(0x565338986cd8) in /opt/conda/bin/python
Apr 14 21:02:39 [13] ???+0x389b18f6(0x5653389b18f6) in /opt/conda/bin/python
Apr 14 21:02:39 [14] ???+0x389872e6(0x5653389872e6) in /opt/conda/bin/python
Apr 14 21:02:39 [15] ???+0x3893bec8(0x56533893bec8) in /opt/conda/bin/python
Apr 14 21:02:39 [16] _PyModule_ClearDict+0x18c(0x56533895d96c) in /opt/conda/bin/python
Apr 14 21:02:39 [17] PyImport_Cleanup+0x315(0x565338a3d825) in /opt/conda/bin/python
Apr 14 21:02:39 [18] Py_FinalizeEx+0x7d(0x565338a3d94d) in /opt/conda/bin/python
Apr 14 21:02:39 [19] Py_Exit+0x8(0x5653388fdad0) in /opt/conda/bin/python
Apr 14 21:02:39 [20] ???+0x388fdb0c(0x5653388fdb0c) in /opt/conda/bin/python
Apr 14 21:02:39 [21] ???+0x388fdb5b(0x5653388fdb5b) in /opt/conda/bin/python
Apr 14 21:02:39 [22] PyRun_SimpleStringFlags+0x4d(0x5653388fefb7) in /opt/conda/bin/python
Apr 14 21:02:39 [23] terminate called without an active exception
Apr 14 21:02:39 ???+0x389001e8(0x5653389001e8) in /opt/conda/bin/python
Apr 14 21:02:39 [24] Py_BytesMain+SIGABRT(0x396(), PID: 0x565338a3e979)18614, Thread 18614: 
Apr 14 21:02:39  in /opt/conda/bin/python
Apr 14 21:02:39 [25] [0] __libc_start_main+0xe7(0x7f70b4c35bf7) in /lib/x86_64-linux-gnu/libc.so.6
Apr 14 21:02:39 [26] ???+0x389ce185(0x5653389ce185) in /opt/conda/bin/python
Apr 14 21:02:39 
Apr 14 21:02:39 SIGABRT(6), PID: 18613, Thread 18620: 
Apr 14 21:02:39 [0] ???+0x27d7b6a9(0x7fe627d7b6a9) in /opt/conda/lib/python3.8/site-packages/torch/lib/libtorch_cpu.so
Apr 14 21:02:39 [1] ???(0x7f70990876a9) in /opt/conda/lib/python3.8/site-packages/torch/lib/libtorch_cpu.so
Apr 14 21:02:39 [1] ???+0x27d7bd23(0x7fe627d7bd23) in /opt/conda/lib/python3.8/site-packages/torch/lib/libtorch_cpu.so
Apr 14 21:02:39 [2] ???+0x43d0b980(0x7fe643d0b980) in /lib/x86_64-linux-gnu/libpthread.so.0
Apr 14 21:02:39 [3] ???+0x43d0a29a(0x7fe643d0a29a) in /lib/x86_64-linux-gnu/libpthread.so.0
Apr 14 21:02:39 [4] __pthread_mutex_unlock+0x42(0x7fe643d04852) in /lib/x86_64-linux-gnu/libpthread.so.0
Apr 14 21:02:39 [5] ???(0x5558c256a384) in /opt/conda/bin/python
Apr 14 21:02:39 [6] _PyEval_EvalFrameDefault+0x63ce(0x5558c254569e) in /opt/conda/bin/python
Apr 14 21:02:39 [7] _PyEval_EvalCodeWithName+0x300(0x5558c250d760) in /opt/conda/bin/python
Apr 14 21:02:39 [8] _PyFunction_Vectorcall+0x1e3(0x5558c250e593) in /opt/conda/bin/python
Apr 14 21:02:39 [9] ???(0x5558c24cfadd) in /opt/conda/bin/python
Apr 14 21:02:39 [10] PyObject_CallFunctionObjArgs+0x9e(0x5558c24cfd3e) in /opt/conda/bin/python
Apr 14 21:02:39 [11] ???(0x5558c2576394) in /opt/conda/bin/python
Apr 14 21:02:39 [12] PyObject_ClearWeakRefs+0xe8(0x5558c2513cd8) in /opt/conda/bin/python
Apr 14 21:02:39 [13] ???(0x5558c253e8f6) in /opt/conda/bin/python
Apr 14 21:02:39 [14] ???(0x5558c25142e6) in /opt/conda/bin/python
Apr 14 21:02:39 [15] ???(0x5558c24c8ec8) in /opt/conda/bin/python
Apr 14 21:02:39 [16] _PyModule_ClearDict+0x18c(0x5558c24ea96c) in /opt/conda/bin/python
Apr 14 21:02:39 [17] PyImport_Cleanup+0x315(0x5558c25ca825) in /opt/conda/bin/python
Apr 14 21:02:39 [18] Py_FinalizeEx+0x7d(0x5558c25ca94d) in /opt/conda/bin/python
Apr 14 21:02:39 [19] Py_Exit+0x8(0x5558c248aad0) in /opt/conda/bin/python
Apr 14 21:02:39 [20] ???(0x7f7099087d23) in /opt/conda/lib/python3.8/site-packages/torch/lib/libtorch_cpu.so
Apr 14 21:02:39 [2] ??????((0x7f70b50179800x5558c248ab0c)) in /lib/x86_64-linux-gnu/libpthread.so.0
Apr 14 21:02:39 [3]  in /opt/conda/bin/python
Apr 14 21:02:39 [21] ???(0x5558c248ab5b) in /opt/conda/bin/python
Apr 14 21:02:39 [22] __poll+0x49(0x7f70b4d28cb9PyRun_SimpleStringFlags)+ in 0x4d/lib/x86_64-linux-gnu/libc.so.6(
Apr 14 21:02:39 0x5558c248bfb7[)4 in ] /opt/conda/bin/python
Apr 14 21:02:39 ???[(230x7f70b40c390b] ) in /opt/conda/lib/python3.8/lib-dynload/select.cpython-38-x86_64-linux-gnu.so
Apr 14 21:02:39 [5] ???(0x5558c248d1e8) in /opt/conda/bin/python
Apr 14 21:02:39 [24] ???+0x389600d5(0x5653389600d5) in /opt/conda/bin/python
Apr 14 21:02:39 [6] Py_BytesMain+0x39(0x5558c25cb979) in /opt/conda/bin/python
Apr 14 21:02:39 [25] ???+0x388ea99c(0x5653388ea99c) in /opt/conda/bin/python
Apr 14 21:02:39 [7] _PyEval_EvalCodeWithName+0x300(0x565338980760) in __libc_start_main/opt/conda/bin/python
Apr 14 21:02:39 [8] +0xe7(0x7fe643929bf7) in /lib/x86_64-linux-gnu/libc.so.6
Apr 14 21:02:39 [26] _PyFunction_Vectorcall+0x1e3(0x565338981593) in /opt/conda/bin/python
Apr 14 21:02:39 [9] ???(0x5558c255b185???)+ in 0x388ea99c(0x5653388ea99c) in /opt/conda/bin/python
Apr 14 21:02:39 [10] /opt/conda/bin/python
Apr 14 21:02:39 
Apr 14 21:02:39 _PyEval_EvalCodeWithName+0x300(0x565338980760) in /opt/conda/bin/python
Apr 14 21:02:39 [11] _PyFunction_Vectorcall+0x1e3(0x565338981593) in /opt/conda/bin/python
Apr 14 21:02:39 [12] ???+0x388eb25f(0x5653388eb25f) in /opt/conda/bin/python
Apr 14 21:02:39 [13] _PyFunction_Vectorcall+0x10b(0x5653389814bb) in /opt/conda/bin/python
Apr 14 21:02:39 [14] ???+0x388ea99c(0x5653388ea99c) in /opt/conda/bin/python
Apr 14 21:02:39 [15] _PyEval_EvalCodeWithName+0x300(0x565338980760) in /opt/conda/bin/python
Apr 14 21:02:39 [16] _PyFunction_Vectorcall+0x1e3(0x565338981593) in /opt/conda/bin/python
Apr 14 21:02:39 [17] ???+0x388ea99c(0x5653388ea99c) in /opt/conda/bin/python
Apr 14 21:02:39 [18] _PyFunction_Vectorcall+0x10b(0x5653389814bb) in /opt/conda/bin/python
Apr 14 21:02:39 [19] PyObject_Call+0x414(0x56533892b874) in /opt/conda/bin/python
Apr 14 21:02:39 [20] _PyEval_EvalFrameDefault+0x2088(0x5653389b4358) in /opt/conda/bin/python
Apr 14 21:02:39 [21] _PyFunction_Vectorcall+0x10b(0x5653389814bb) in /opt/conda/bin/python
Apr 14 21:02:39 [22] ???+0x388ea99c(0x5653388ea99c) in /opt/conda/bin/python
Apr 14 21:02:39 [23] _PyFunction_Vectorcall+0x10b(0x5653389814bb) in /opt/conda/bin/python
Apr 14 21:02:39 [24] ???+0x388ea99c(0x5653388ea99c) in /opt/conda/bin/python
Apr 14 21:02:39 [25] _PyFunction_Vectorcall+0x10b(0x5653389814bb) in /opt/conda/bin/python
Apr 14 21:02:39 [26] ???+0x38981b3b(0x565338981b3b) in /opt/conda/bin/python
Apr 14 21:02:39 [27] PyObject_Call+0x414(0x56533892b874) in /opt/conda/bin/python
Apr 14 21:02:39 [28] ???+0x38a2ddce(0x565338a2ddce) in /opt/conda/bin/python
Apr 14 21:02:39 [29] ???+0x389d1b98(0x5653389d1b98) in /opt/conda/bin/python
Apr 14 21:02:39 [30] ???(0x7f70b500c6db) in /lib/x86_64-linux-gnu/libpthread.so.0
Apr 14 21:02:39 [31] cloneSIGABRT+0x3f(0x7f70b4d3571f) in /lib/x86_64-linux-gnu/libc.so.6
Apr 14 21:02:39 [32] ???(0)
Apr 14 21:02:39 
Apr 14 21:02:39 SIGABRT(6), PID: 18613, Thread 18624: 
Apr 14 21:02:39 (6), PID: [0] 18614, Thread 18622: 
Apr 14 21:02:39 [0] ???(0x7f70990876a9) in /opt/conda/lib/python3.8/site-packages/torch/lib/libtorch_cpu.so
Apr 14 21:02:39 [1] ???+0x27d7b6a9(0x7fe627d7b6a9) in /opt/conda/lib/python3.8/site-packages/torch/lib/libtorch_cpu.so???(0x7f7099088610) in /opt/conda/lib/python3.8/site-packages/torch/lib/libtorch_cpu.so
Apr 14 21:02:39 [2] ???(0x7f70b5017980) in /lib/x86_64-linux-gnu/libpthread.so.0
Apr 14 21:02:39 [3] gsignal+0xc7(0x7f70b4c52fb7) in /lib/x86_64-linux-gnu/libc.so.6
Apr 14 21:02:39 [4] abort+0x141(0x7f70b4c54921) in /lib/x86_64-linux-gnu/libc.so.6
Apr 14 21:02:39 [5] 
Apr 14 21:02:39 [__gnu_cxx::__verbose_terminate_handler()+0xbc(0x7f70923e084a) in /opt/conda/lib/libstdc++.so.6
Apr 14 21:02:39 [6] 1???(0x7f70923def47) in /opt/conda/lib/libstdc++.so.6
Apr 14 21:02:39 [7] ] ???(0x7f70923def7d) in /opt/conda/lib/libstdc++.so.6
Apr 14 21:02:39 [8] __gxx_personality_v0+0x3ca(0x7f70923dec5a) in /opt/conda/lib/libstdc++.so.6
Apr 14 21:02:39 [9] ???(0x7f709232bb97) in /opt/conda/lib/libgcc_s.so.1
Apr 14 21:02:39 [10] _Unwind_ForcedUnwind+0x6a(0x7f709232be7d) in /opt/conda/lib/libgcc_s.so.1
Apr 14 21:02:39 [11] __pthread_unwind+0x40(0x7f70b5016000) in /lib/x86_64-linux-gnu/libpthread.so.0
Apr 14 21:02:39 [12] ???(0x7f70b500dae5) in /lib/x86_64-linux-gnu/libpthread.so.0
Apr 14 21:02:39 [13] ???+0x389d8179(0x5653389d8179) in /opt/conda/bin/python
Apr 14 21:02:39 [14] ???+0x3885f476(0x56533885f476) in /opt/conda/bin/python
Apr 14 21:02:39 [15] PyEval_AcquireThread+0x24(0x5653389dd444) in /opt/conda/bin/python
Apr 14 21:02:39 [16] ???(0x7f70aa8baf11) in /opt/conda/lib/python3.8/site-packages/torch/lib/libtorch_python.so
Apr 14 21:02:39 [17] ???(0x7f70aaff0c5e) in /opt/conda/lib/python3.8/site-packages/torch/lib/libtorch_python.so
Apr 14 21:02:39 [18] c10::TensorImpl::release_resources()+0xb4(0x7f70a8e54844) in /opt/conda/lib/python3.8/site-packages/torch/lib/libc10.so
Apr 14 21:02:39 [???+0x27d7bd23(0x7fe627d7bd23) in /opt/conda/lib/python3.8/site-packages/torch/lib/libtorch_cpu.so
Apr 14 21:02:39 [2] ???+0x43d0b980(0x7fe643d0b980) in /lib/x86_64-linux-gnu/libpthread.so.0
Apr 14 21:02:39 [3] __poll+0x49(0x7fe643a1ccb9) in /lib/x86_64-linux-gnu/libc.so.6
Apr 14 21:02:39 [4] ???+0x42db790b(0x7fe642db790b) in /opt/conda/lib/python3.8/lib-dynload/select.cpython-38-x86_64-linux-gnu.so
Apr 14 21:02:39 [5] ???(0x5558c24ed0d5) in /opt/conda/bin/python
Apr 14 21:02:39 [6] ???(0x5558c247799c) in /opt/conda/bin/python
Apr 14 21:02:39 [7] _PyEval_EvalCodeWithName+0x300(0x5558c250d760) in /opt/conda/bin/python
Apr 14 21:02:39 [8] _PyFunction_Vectorcall+0x1e3(0x5558c250e593) in /opt/conda/bin/python
Apr 14 21:02:39 [9] ???(0x5558c247799c) in /opt/conda/bin/python
Apr 14 21:02:39 [10] _PyEval_EvalCodeWithName+0x300(0x5558c250d760) in /opt/conda/bin/python
Apr 14 21:02:39 [11] _PyFunction_Vectorcall+0x1e3(0x5558c250e593) in /opt/conda/bin/python
Apr 14 21:02:39 [12] ???(0x5558c247825f) in /opt/conda/bin/python
Apr 14 21:02:39 [13] _PyFunction_Vectorcall+0x10b(0x5558c250e4bb) in /opt/conda/bin/python
Apr 14 21:02:39 [14] ???(0x5558c247799c) in /opt/conda/bin/python
Apr 14 21:02:39 [15] _PyEval_EvalCodeWithName+0x300(0x5558c250d760) in /opt/conda/bin/python
Apr 14 21:02:39 [16] _PyFunction_Vectorcall+19] 0x1e3(0x5558c250e593) in /opt/conda/bin/python
Apr 14 21:02:39 [17] ???(0x5558c247799c) in /opt/conda/bin/python
Apr 14 21:02:39 [18] _PyFunction_Vectorcall+0x10b(0x5558c250e4bb) in /opt/conda/bin/python
Apr 14 21:02:39 [19] PyObject_Call+0x414(0x5558c24b8874) in /opt/conda/bin/python
Apr 14 21:02:39 [20] _PyEval_EvalFrameDefault+0x2088(0x5558c2541358) in /opt/conda/bin/python
Apr 14 21:02:39 [21] _PyFunction_Vectorcall+0x10b(0x5558c250e4bb) in /opt/conda/bin/python
Apr 14 21:02:39 [22] ???(0x5558c247799c) in /opt/conda/bin/python
Apr 14 21:02:39 [23] _PyFunction_Vectorcall+0x10b(0x5558c250e4bb) in /opt/conda/bin/python
Apr 14 21:02:39 [24] ???(0x5558c247799c) in /opt/conda/bin/python
Apr 14 21:02:39 [25] _PyFunction_Vectorcall+0x10b(0x5558c250e4bb) in /opt/conda/bin/python
Apr 14 21:02:39 [26] ???(0x5558c250eb3b) in /opt/conda/bin/python
Apr 14 21:02:39 [27] PyObject_Call+0x414(0x5558c24b8874) in /opt/conda/bin/python
Apr 14 21:02:39 [28] ???(0x5558c25badce) in /opt/conda/bin/python
Apr 14 21:02:39 [29] ???(0x5558c255eb98) in /opt/conda/bin/python
Apr 14 21:02:39 [30] ???+0x43d006db(0x7fe643d006db) in /lib/x86_64-linux-gnu/libpthread.so.0
Apr 14 21:02:39 [31] clone+0x3f(0x7fe643a2971f) in /lib/x86_64-linux-gnu/libc.so.6
Apr 14 21:02:39 [32] ???(0x7f70aa8a60c3) in /opt/conda/lib/python3.8/site-packages/torch/lib/libtorch_python.so
Apr 14 21:02:39 [20] ???(0)
Apr 14 21:02:39 
Apr 14 21:02:39 SIGABRT(6???(0x7f70aacfecd9) in /opt/conda/lib/python3.8/site-packages/torch/lib/libtorch_python.so
Apr 14 21:02:39 [21] ), PID: 18614, Thread 18626: 
Apr 14 21:02:39 [0] ???(0x7f709af09cfd) in /opt/conda/lib/python3.8/site-packages/torch/lib/libtorch_cpu.so
Apr 14 21:02:39 [22] ???+0x27d7b6a9(0x7fe627d7b6a9) in /opt/conda/lib/python3.8/site-packages/torch/lib/libtorch_cpu.so
Apr 14 21:02:39 [1] torch::jit::InterpreterState::~InterpreterState()+0xa3(0x7f709af02cd3) in /opt/conda/lib/python3.8/site-packages/torch/lib/libtorch_cpu.so
Apr 14 21:02:39 [23] ???+0x27d7c610(0x7fe627d7c610) in /opt/conda/lib/python3.8/site-packages/torch/lib/libtorch_cpu.so
Apr 14 21:02:39 [2] ???+0x43d0b980(0x7fe643d0b980) in /lib/x86_64-linux-gnu/libpthread.so.0
Apr 14 21:02:39 [3] gsignal+0xc7(0x7fe643946fb7) in /lib/x86_64-linux-gnu/libc.so.6
Apr 14 21:02:39 [4] abort+0x141(0x7fe643948921) in /lib/x86_64-linux-gnu/libc.so.6
Apr 14 21:02:39 [???(0x7f709af05a6d) in /opt/conda/lib/python3.8/site-packages/torch/lib/libtorch_cpu.so
Apr 14 21:02:39 [24] 5] __gnu_cxx::__verbose_terminate_handler()+0xbc(0x7fe6210d484a) in /opt/conda/lib/libstdc++.so.6
Apr 14 21:02:39 [6] ???+0x210d2f47(0x7fe6210d2f47) in /opt/conda/lib/libstdc++.so.6
Apr 14 21:02:39 [7] ???+0x210d2f7d(0x7fe6210d2f7d) in /opt/conda/lib/libstdc++.so.6
Apr 14 21:02:39 [8] __gxx_personality_v0+0x3ca(0x7fe6210d2c5a) in /opt/conda/lib/libstdc++.so.6
Apr 14 21:02:39 ???([0x7f709af05b5b) in /opt/conda/lib/python3.8/site-packages/torch/lib/libtorch_cpu.so
Apr 14 21:02:39 [25] 9] ???+0x2101fb97(0x7fe62101fb97) in /opt/conda/lib/libgcc_s.so.1
Apr 14 21:02:39 [10] _Unwind_ForcedUnwind+0x6a(0x7fe62101fe7d) in /opt/conda/lib/libgcc_s.so.1
Apr 14 21:02:39 [11] __pthread_unwind+0x40(0x7fe643d0a000) in /lib/x86_64-linux-gnu/libpthread.so.0
Apr 14 21:02:39 [12] ???+0x43d01ae5(0x7fe643d01ae5) in /lib/x86_64-linux-gnu/libpthread.so.0
Apr 14 21:02:39 [13] ???(0x5558c2565179) in /opt/conda/bin/python
Apr 14 21:02:39 [14] ???(0x5558c23ec476) in /opt/conda/bin/python
Apr 14 21:02:39 [15] PyEval_AcquireThread+0x24(0x5558c256a444) in /opt/conda/bin/python
Apr 14 21:02:39 [16] ???+0x395aef11(0x7fe6395aef11) in /opt/conda/lib/python3.8/site-packages/torch/lib/libtorch_python.so
Apr 14 21:02:39 [17] ???+0x39ce4c5e(0x7fe639ce4c5e) in /opt/conda/lib/python3.8/site-packages/torch/lib/libtorch_python.so
Apr 14 21:02:39 [18] c10::TensorImpl::release_resources()+0xb4(0x7fe637b48844) in /opt/conda/lib/python3.8/site-packages/torch/lib/libc10.so???(
Apr 14 21:02:39 [19] 0x7f709720804b) in /opt/conda/lib/python3.8/site-packages/torch/lib/libtorch_cpu.so
Apr 14 21:02:39 [???+0x3959a0c3(0x7fe63959a0c3) in /opt/conda/lib/python3.8/site-packages/torch/lib/libtorch_python.so
Apr 14 21:02:39 [20] 26] ???+0x399f2cd9(0x7fe6399f2cd9) in /opt/conda/lib/python3.8/site-packages/torch/lib/libtorch_python.so
Apr 14 21:02:39 [21] c10::ThreadPool::main_loop(unsigned long)+0x33b(0x7f70a8e5ae0b) in /opt/conda/lib/python3.8/site-packages/torch/lib/libc10.so
Apr 14 21:02:39 [27] ??????+0x29bfdcfd(0x7fe629bfdcfd) in /opt/conda/lib/python3.8/site-packages/torch/lib/libtorch_cpu.so
Apr 14 21:02:39 [22] (0x7f70a8e5b1fa) in /opt/conda/lib/python3.8/site-packages/torch/lib/libc10.so
Apr 14 21:02:39 torch::jit::InterpreterState::~InterpreterState()+0xa3(0x7fe629bf6cd3) in /opt/conda/lib/python3.8/site-packages/torch/lib/libtorch_cpu.so
Apr 14 21:02:39 [23] [28] ???(???+0x29bf9a6d(0x7fe629bf9a6d) in /opt/conda/lib/python3.8/site-packages/torch/lib/libtorch_cpu.so
Apr 14 21:02:39 [24] 0x7f70923fb19d) in /opt/conda/lib/libstdc++.so.6
Apr 14 21:02:39 [???+0x29bf9b5b(0x7fe629bf9b5b) in /opt/conda/lib/python3.8/site-packages/torch/lib/libtorch_cpu.so
Apr 14 21:02:39 [25] 29] ???(???+0x25efc04b(0x7fe625efc04b) in /opt/conda/lib/python3.8/site-packages/torch/lib/libtorch_cpu.so
Apr 14 21:02:39 [26] c10::ThreadPool::main_loop(unsigned long)+0x33b(0x7fe637b4ee0b) in /opt/conda/lib/python3.8/site-packages/torch/lib/libc10.so
Apr 14 21:02:39 [27] ???+0x37b4f1fa(0x7fe637b4f1fa) in /opt/conda/lib/python3.8/site-packages/torch/lib/libc10.so
Apr 14 21:02:39 [28] ???+0x210ef19d(0x7fe6210ef19d) in /opt/conda/lib/libstdc++.so.6
Apr 14 21:02:39 [29] ???+0x43d006db(0x7fe643d006db) in /lib/x86_64-linux-gnu/libpthread.so.0
Apr 14 21:02:39 [30] clone+0x3f(0x7fe643a2971f) in /lib/x86_64-linux-gnu/libc.so.6
Apr 14 21:02:39 [31] ???(0)
Apr 14 21:02:39 
Apr 14 21:02:39 SIGABRT(6), PID: 18614, Thread 18627: 
Apr 14 21:02:39 [0] 0x7f70b500c6db) in /lib/x86_64-linux-gnu/libpthread.so.0
Apr 14 21:02:39 ???+0x27d7b6a9(0x7fe627d7b6a9) in /opt/conda/lib/python3.8/site-packages/torch/lib/libtorch_cpu.so
Apr 14 21:02:39 [1] [30terminate called without an active exception
Apr 14 21:02:39 SIGABRT(6), PID: 18612, Thread 18612: 
Apr 14 21:02:39 ] [0] ???+0x27d7bd23(0x7fe627d7bd23) in /opt/conda/lib/python3.8/site-packages/torch/lib/libtorch_cpu.so
Apr 14 21:02:39 [2] ???+0x43d0b980(0x7fe643d0b980) in /lib/x86_64-linux-gnu/libpthread.so.0
Apr 14 21:02:39 [3] ???+0x43d0a1fd(0x7fe643d0a1fd) in /lib/x86_64-linux-gnu/libpthread.so.0
Apr 14 21:02:39 [4] pthread_mutex_lock+0x55(0x7fe643d03025) in /lib/x86_64-linux-gnu/libpthread.so.0
Apr 14 21:02:39 [5] c10::ThreadPool::main_loop(unsigned long)+0x68(0x7fe637b4eb38) in /opt/conda/lib/python3.8/site-packages/torch/lib/libc10.so
Apr 14 21:02:39 [6] ???+0x37b4f1fa(0x7fe637b4f1fa) in /opt/conda/lib/python3.8/site-packages/torch/lib/libc10.so
Apr 14 21:02:39 [7] ???+0x210ef19d(0x7fe6210ef19d) in /opt/conda/lib/libstdc++.so.6
Apr 14 21:02:39 [8] ???+0x43d006db(0x7fe643d006db) in /lib/x86_64-linux-gnu/libpthread.so.0
Apr 14 21:02:39 [9] clone+0x3f(0x7fe643a2971f) in /lib/x86_64-linux-gnu/libc.so.6
Apr 14 21:02:39 [10] ???(0)
Apr 14 21:02:39 
Apr 14 21:02:39 clone+0x3f(0x7f70b4d3571f???(0x7fb5808c16a9) in /opt/conda/lib/python3.8/site-packages/torch/lib/libtorch_cpu.so
Apr 14 21:02:39 [1] ) in /lib/x86_64-linux-gnu/libc.so.6
Apr 14 21:02:39 [31] ???(0)
Apr 14 21:02:39 
Apr 14 21:02:39 SIGABRT(6), PID: 18613, Thread 18625: 
Apr 14 21:02:39 [0] ???(0x7f70990876a9) in /opt/conda/lib/python3.8/site-packages/torch/lib/libtorch_cpu.so
Apr 14 21:02:39 [1] ???(0x7f7099087d23) in /opt/conda/lib/python3.8/site-packages/torch/lib/libtorch_cpu.so
Apr 14 21:02:39 [2] ???(0x7f70b5017980) in /lib/x86_64-linux-gnu/libpthread.so.0
Apr 14 21:02:39 [3] pthread_cond_wait+0x243(0x7f70b5012ad3) in /lib/x86_64-linux-gnu/libpthread.so.0
Apr 14 21:02:39 [4] std::condition_variable::wait(std::unique_lock<std::mutex>&)+0x9(0x7f70923f74cb) in /opt/conda/lib/libstdc++.so.6
Apr 14 21:02:39 [5] c10::ThreadPool::main_loop(unsigned long)+0xd8(0x7f70a8e5aba8) in /opt/conda/lib/python3.8/site-packages/torch/lib/libc10.so
Apr 14 21:02:39 [6] ???(0x7f70a8e5b1fa) in /opt/conda/lib/python3.8/site-packages/torch/lib/libc10.so
Apr 14 21:02:39 [7] ???(0x7f70923fb19d) in /opt/conda/lib/libstdc++.so.6
Apr 14 21:02:39 [8] ???(0x7f70b500c6db) in /lib/x86_64-linux-gnu/libpthread.so.0
Apr 14 21:02:39 [9] clone+0x3f(0x7f70b4d3571f) in /lib/x86_64-linux-gnu/libc.so.6
Apr 14 21:02:39 [10] ???(0)
Apr 14 21:02:39 
Apr 14 21:02:39 ???(0x7fb5808c1d23) in /opt/conda/lib/python3.8/site-packages/torch/lib/libtorch_cpu.so
Apr 14 21:02:39 [2] ???(0x7fb59c851980) in /lib/x86_64-linux-gnu/libpthread.so.0
Apr 14 21:02:39 [3] ???(0x7fb59c85029a) in /lib/x86_64-linux-gnu/libpthread.so.0
Apr 14 21:02:39 [4] __pthread_mutex_unlock+0x42(0x7fb59c84a852) in /lib/x86_64-linux-gnu/libpthread.so.0
Apr 14 21:02:39 [5] ???(0x564284388384) in /opt/conda/bin/python
Apr 14 21:02:39 [6] _PyEval_EvalFrameDefault+0x63ce(0x56428436369e) in /opt/conda/bin/python
Apr 14 21:02:39 [7] _PyEval_EvalCodeWithName+0x300(0x56428432b760) in /opt/conda/bin/python
Apr 14 21:02:39 [8] _PyFunction_Vectorcall+0x1e3(0x56428432c593) in /opt/conda/bin/python
Apr 14 21:02:39 [9] ???(0x5642842edadd) in /opt/conda/bin/python
Apr 14 21:02:39 [10] PyObject_CallFunctionObjArgs+0x9e(0x5642842edd3e) in /opt/conda/bin/python
Apr 14 21:02:39 [11] ???(0x564284394394) in /opt/conda/bin/python
Apr 14 21:02:39 [12] PyObject_ClearWeakRefs+0xe8(0x564284331cd8) in /opt/conda/bin/python
Apr 14 21:02:39 [13] ???(0x56428435c8f6) in /opt/conda/bin/python
Apr 14 21:02:39 [14] ???(0x5642843322e6) in /opt/conda/bin/python
Apr 14 21:02:39 [15] ???(0x5642842e6ec8) in /opt/conda/bin/python
Apr 14 21:02:39 [16] _PyModule_ClearDict+0x18c(0x56428430896c) in /opt/conda/bin/python
Apr 14 21:02:39 [17] PyImport_Cleanup+0x315(0x5642843e8825) in /opt/conda/bin/python
Apr 14 21:02:39 [18] Py_FinalizeEx+0x7d(0x5642843e894d) in /opt/conda/bin/python
Apr 14 21:02:39 [19] Py_Exit+0x8(0x5642842a8ad0) in /opt/conda/bin/python
Apr 14 21:02:39 [20] ???(0x5642842a8b0c) in /opt/conda/bin/python
Apr 14 21:02:39 [21] ???(0x5642842a8b5b) in /opt/conda/bin/python
Apr 14 21:02:39 [22] PyRun_SimpleStringFlags+0x4d(0x5642842a9fb7) in /opt/conda/bin/python
Apr 14 21:02:39 [23] ???(0x5642842ab1e8) in /opt/conda/bin/python
Apr 14 21:02:39 [24] Py_BytesMain+0x39(0x5642843e9979) in /opt/conda/bin/python
Apr 14 21:02:39 [25] __libc_start_main+0xe7(0x7fb59c46fbf7) in /lib/x86_64-linux-gnu/libc.so.6
Apr 14 21:02:39 [26] ???(0x564284379185) in /opt/conda/bin/python
Apr 14 21:02:39 
Apr 14 21:02:39 SIGABRT(6), PID: 18612, Thread 18621: 
Apr 14 21:02:39 [0] ???(0x7fb5808c16a9) in /opt/conda/lib/python3.8/site-packages/torch/lib/libtorch_cpu.so
Apr 14 21:02:39 [1] ???(0x7fb5808c1d23) in /opt/conda/lib/python3.8/site-packages/torch/lib/libtorch_cpu.so
Apr 14 21:02:39 [2] ???(0x7fb59c851980) in /lib/x86_64-linux-gnu/libpthread.so.0
Apr 14 21:02:39 [3] __poll+0x49(0x7fb59c562cb9) in /lib/x86_64-linux-gnu/libc.so.6
Apr 14 21:02:39 [4] ???(0x7fb59b8fd90b) in /opt/conda/lib/python3.8/lib-dynload/select.cpython-38-x86_64-linux-gnu.so
Apr 14 21:02:39 [5] ???(0x56428430b0d5) in /opt/conda/bin/python
Apr 14 21:02:39 [6] ???(0x56428429599c) in /opt/conda/bin/python
Apr 14 21:02:39 [7] _PyEval_EvalCodeWithName+0x300(0x56428432b760) in /opt/conda/bin/python
Apr 14 21:02:39 [8] _PyFunction_Vectorcall+0x1e3(0x56428432c593) in /opt/conda/bin/python
Apr 14 21:02:39 [9] ???(0x56428429599c) in /opt/conda/bin/python
Apr 14 21:02:39 [10] _PyEval_EvalCodeWithName+0x300(0x56428432b760) in /opt/conda/bin/python
Apr 14 21:02:39 [11] _PyFunction_Vectorcall+0x1e3(0x56428432c593) in /opt/conda/bin/python
Apr 14 21:02:39 [12] ???(0x56428429625f) in /opt/conda/bin/python
Apr 14 21:02:39 [13] _PyFunction_Vectorcall+0x10b(0x56428432c4bb) in /opt/conda/bin/python
Apr 14 21:02:39 [14] ???(0x56428429599c) in /opt/conda/bin/python
Apr 14 21:02:39 [15] _PyEval_EvalCodeWithName+0x300(0x56428432b760) in /opt/conda/bin/python
Apr 14 21:02:39 [16] _PyFunction_Vectorcall+0x1e3(0x56428432c593) in /opt/conda/bin/python
Apr 14 21:02:39 [17] ???(0x56428429599c) in /opt/conda/bin/python
Apr 14 21:02:39 [18] _PyFunction_Vectorcall+0x10b(0x56428432c4bb) in /opt/conda/bin/python
Apr 14 21:02:39 [19] PyObject_Call+0x414(0x5642842d6874) in /opt/conda/bin/python
Apr 14 21:02:39 [20] _PyEval_EvalFrameDefault+0x2088(0x56428435f358) in /opt/conda/bin/python
Apr 14 21:02:39 [21] _PyFunction_Vectorcall+0x10b(0x56428432c4bb) in /opt/conda/bin/python
Apr 14 21:02:39 [22] ???(0x56428429599c) in /opt/conda/bin/python
Apr 14 21:02:39 [23] _PyFunction_Vectorcall+0x10b(0x56428432c4bb) in /opt/conda/bin/python
Apr 14 21:02:39 [24] ???(0x56428429599c) in /opt/conda/bin/python
Apr 14 21:02:39 [25] _PyFunction_Vectorcall+0x10b(0x56428432c4bb) in /opt/conda/bin/python
Apr 14 21:02:39 [26] ???(0x56428432cb3b) in /opt/conda/bin/python
Apr 14 21:02:39 [27] PyObject_Call+0x414(0x5642842d6874) in /opt/conda/bin/python
Apr 14 21:02:39 [28] ???(0x5642843d8dce) in /opt/conda/bin/python
Apr 14 21:02:39 [29] ???(0x56428437cb98) in /opt/conda/bin/python
Apr 14 21:02:39 [30] ???(0x7fb59c8466db) in /lib/x86_64-linux-gnu/libpthread.so.0
Apr 14 21:02:39 [31] clone+0x3f(0x7fb59c56f71f) in /lib/x86_64-linux-gnu/libc.so.6
Apr 14 21:02:39 [32] ???(0)
Apr 14 21:02:39 
Apr 14 21:02:39 SIGABRT(6), PID: 18612, Thread 18628: 
Apr 14 21:02:39 [0] ???(0x7fb5808c16a9) in /opt/conda/lib/python3.8/site-packages/torch/lib/libtorch_cpu.so
Apr 14 21:02:39 [1] ???(0x7fb5808c2610) in /opt/conda/lib/python3.8/site-packages/torch/lib/libtorch_cpu.so
Apr 14 21:02:39 [2] ???(0x7fb59c851980) in /lib/x86_64-linux-gnu/libpthread.so.0
Apr 14 21:02:39 [3] gsignal+0xc7(0x7fb59c48cfb7) in /lib/x86_64-linux-gnu/libc.so.6
Apr 14 21:02:39 [4] abort+0x141(0x7fb59c48e921) in /lib/x86_64-linux-gnu/libc.so.6
Apr 14 21:02:39 [5] __gnu_cxx::__verbose_terminate_handler()+0xbc(0x7fb579c1a84a) in /opt/conda/lib/libstdc++.so.6
Apr 14 21:02:39 [6] ???+0x79c18f47(0x7fb579c18f47) in /opt/conda/lib/libstdc++.so.6
Apr 14 21:02:39 [7] ???+0x79c18f7d(0x7fb579c18f7d) in /opt/conda/lib/libstdc++.so.6
Apr 14 21:02:39 [8] __gxx_personality_v0+0x3ca(0x7fb579c18c5a) in /opt/conda/lib/libstdc++.so.6
Apr 14 21:02:39 [9] ???+0x79b65b97(0x7fb579b65b97) in /opt/conda/lib/libgcc_s.so.1
Apr 14 21:02:39 [10] _Unwind_ForcedUnwind+0x6a(0x7fb579b65e7d) in /opt/conda/lib/libgcc_s.so.1
Apr 14 21:02:39 [11] __pthread_unwind+0x40(0x7fb59c850000) in /lib/x86_64-linux-gnu/libpthread.so.0
Apr 14 21:02:39 [12] ???(0x7fb59c847ae5) in /lib/x86_64-linux-gnu/libpthread.so.0
Apr 14 21:02:39 [13] ???(0x564284383179) in /opt/conda/bin/python
Apr 14 21:02:39 [14] ???(0x56428420a476) in /opt/conda/bin/python
Apr 14 21:02:39 [15] PyEval_AcquireThread+0x24(0x564284388444) in /opt/conda/bin/python
Apr 14 21:02:39 [16] ???(0x7fb5920f4f11) in /opt/conda/lib/python3.8/site-packages/torch/lib/libtorch_python.so
Apr 14 21:02:39 [17] ???(0x7fb59282ac5e) in /opt/conda/lib/python3.8/site-packages/torch/lib/libtorch_python.so
Apr 14 21:02:39 [18] c10::TensorImpl::release_resources()+0xb4(0x7fb59068e844) in /opt/conda/lib/python3.8/site-packages/torch/lib/libc10.so
Apr 14 21:02:39 [19] ???(0x7fb5920e00c3) in /opt/conda/lib/python3.8/site-packages/torch/lib/libtorch_python.so
Apr 14 21:02:39 [20] ???(0x7fb592538cd9) in /opt/conda/lib/python3.8/site-packages/torch/lib/libtorch_python.so
Apr 14 21:02:39 [21] ???(0x7fb582743cfd) in /opt/conda/lib/python3.8/site-packages/torch/lib/libtorch_cpu.so
Apr 14 21:02:39 [22] torch::jit::InterpreterState::~InterpreterState()+0xa3(0x7fb58273ccd3) in /opt/conda/lib/python3.8/site-packages/torch/lib/libtorch_cpu.so
Apr 14 21:02:39 [23] ???(0x7fb58273fa6d) in /opt/conda/lib/python3.8/site-packages/torch/lib/libtorch_cpu.so
Apr 14 21:02:39 [24] ???(0x7fb58273fb5b) in /opt/conda/lib/python3.8/site-packages/torch/lib/libtorch_cpu.so
Apr 14 21:02:39 [25] ???+0x7ea4204b(0x7fb57ea4204b) in /opt/conda/lib/python3.8/site-packages/torch/lib/libtorch_cpu.so
Apr 14 21:02:39 [26] c10::ThreadPool::main_loop(unsigned long)+0x33b(0x7fb590694e0b) in /opt/conda/lib/python3.8/site-packages/torch/lib/libc10.so
Apr 14 21:02:39 [27] ???(0x7fb5906951fa) in /opt/conda/lib/python3.8/site-packages/torch/lib/libc10.so
Apr 14 21:02:39 [28] ???+0x79c3519d(0x7fb579c3519d) in /opt/conda/lib/libstdc++.so.6
Apr 14 21:02:39 [29] ???(0x7fb59c8466db) in /lib/x86_64-linux-gnu/libpthread.so.0
Apr 14 21:02:39 [30] clone+0x3f(0x7fb59c56f71f) in /lib/x86_64-linux-gnu/libc.so.6
Apr 14 21:02:39 [31] ???(0)
Apr 14 21:02:39 
Apr 14 21:02:39 SIGABRT(6), PID: 18612, Thread 18629: 
Apr 14 21:02:39 [0] ???(0x7fb5808c16a9) in /opt/conda/lib/python3.8/site-packages/torch/lib/libtorch_cpu.so
Apr 14 21:02:39 [1] ???(0x7fb5808c1d23) in /opt/conda/lib/python3.8/site-packages/torch/lib/libtorch_cpu.so
Apr 14 21:02:39 [2] ???(0x7fb59c851980) in /lib/x86_64-linux-gnu/libpthread.so.0
Apr 14 21:02:39 [3] pthread_cond_wait+0x243(0x7fb59c84cad3) in /lib/x86_64-linux-gnu/libpthread.so.0
Apr 14 21:02:39 [4] std::condition_variable::wait(std::unique_lock<std::mutex>&)+0x9(0x7fb579c314cb) in /opt/conda/lib/libstdc++.so.6
Apr 14 21:02:39 [5] c10::ThreadPool::main_loop(unsigned long)+0xd8(0x7fb590694ba8) in /opt/conda/lib/python3.8/site-packages/torch/lib/libc10.so
Apr 14 21:02:39 [6] ???(0x7fb5906951fa) in /opt/conda/lib/python3.8/site-packages/torch/lib/libc10.so
Apr 14 21:02:39 [7] ???+0x79c3519d(0x7fb579c3519d) in /opt/conda/lib/libstdc++.so.6
Apr 14 21:02:39 [8] ???(0x7fb59c8466db) in /lib/x86_64-linux-gnu/libpthread.so.0
Apr 14 21:02:39 [9] clone+0x3f(0x7fb59c56f71f) in /lib/x86_64-linux-gnu/libc.so.6
```

</details>

On the same build of PyTorch, our other implementation of stack trace dumping symbolizes fine:

```
Apr 14 21:00:09 Exception raised from addmm_impl_cpu_ at /var/lib/jenkins/workspace/aten/src/ATen/native/LinearAlgebra.cpp:852 (most recent call first):
Apr 14 21:00:09 frame #0: c10::Error::Error(c10::SourceLocation, std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> >) + 0x59 (0x7f4742c04369 in /opt/conda/lib/python3.8/site-packages/torch/lib/libc10.so)
Apr 14 21:00:09 frame #1: c10::detail::torchCheckFail(char const*, char const*, unsigned int, std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > const&) + 0xa3 (0x7f4742bbcd22 in /opt/conda/lib/python3.8/site-packages/torch/lib/libc10.so)
Apr 14 21:00:09 frame #2: at::native::addmm_cpu_out(at::Tensor const&, at::Tensor const&, at::Tensor const&, c10::Scalar const&, c10::Scalar const&, at::Tensor&) + 0xd78 (0x7f47312c7d58 in /opt/conda/lib/python3.8/site-packages/torch/lib/libtorch_cpu.so)
Apr 14 21:00:09 frame #3: at::native::mm_cpu(at::Tensor const&, at::Tensor const&) + 0x11b (0x7f47312c840b in /opt/conda/lib/python3.8/site-packages/torch/lib/libtorch_cpu.so)
Apr 14 21:00:09 frame #4: <unknown function> + 0x5d97fbd (0x7f4731fd6fbd in /opt/conda/lib/python3.8/site-packages/torch/lib/libtorch_cpu.so)
Apr 14 21:00:09 frame #5: at::redispatch::mm(c10::DispatchKeySet, at::Tensor const&, at::Tensor const&) + 0xef (0x7f4731ceec7f in /opt/conda/lib/python3.8/site-packages/torch/lib/libtorch_cpu.so)
Apr 14 21:00:09 frame #6: <unknown function> + 0x7f39dd4 (0x7f4734178dd4 in /opt/conda/lib/python3.8/site-packages/torch/lib/libtorch_cpu.so)
Apr 14 21:00:09 frame #7: <unknown function> + 0x7f3a342 (0x7f4734179342 in /opt/conda/lib/python3.8/site-packages/torch/lib/libtorch_cpu.so)
Apr 14 21:00:09 frame #8: at::Tensor::mm(at::Tensor const&) const + 0x181 (0x7f47324bba81 in /opt/conda/lib/python3.8/site-packages/torch/lib/libtorch_cpu.so)
Apr 14 21:00:09 frame #9: <unknown function> + 0x5091358 (0x7f47312d0358 in /opt/conda/lib/python3.8/site-packages/torch/lib/libtorch_cpu.so)
Apr 14 21:00:09 frame #10: at::native::matmul(at::Tensor const&, at::Tensor const&) + 0x59 (0x7f47312d5799 in /opt/conda/lib/python3.8/site-packages/torch/lib/libtorch_cpu.so)
Apr 14 21:00:09 frame #11: <unknown function> + 0x6002fb4 (0x7f4732241fb4 in /opt/conda/lib/python3.8/site-packages/torch/lib/libtorch_cpu.so)
Apr 14 21:00:09 frame #12: c10::Dispatcher::callBoxed(c10::OperatorHandle const&, std::vector<c10::IValue, std::allocator<c10::IValue> >*) const + 0x1b8 (0x7f4730f41578 in /opt/conda/lib/python3.8/site-packages/torch/lib/libtorch_cpu.so)
Apr 14 21:00:09 frame #13: <unknown function> + 0x8d538f7 (0x7f4734f928f7 in /opt/conda/lib/python3.8/site-packages/torch/lib/libtorch_cpu.so)
```

so I think maybe we can fix this by getting the signal handler to use the other backtrace implementation. (Unrelatedly, it would be really nice to figure out a solution to symbolization not working for anonymous symbols lol)

cc @malfet @seemethere @walterddr