peers: Clean up signals on multithreaded peers