Interest. In two ways, this can be expensive. First, a credit card's interest rate on cash advances is usually much higher than the rate on purchases. Second, cash advances usually start adding interest right away.