You don't lose continental coins, but if it's your first infamy, you lose all spending cash and some offshore money.