Bugfix: When removing tx remove associated empty conv

We can always destroy conversation if we are about to delete the txn