Do not reload conversation when removing inactive conversation