Don't clear the close handlers when source closes