WELD-1746 Don't destroy ended conversations outside of synchronized block