No, the only way you lose money is when the player(s) carrying the money take damage.