Only kill threads if they exist