While it's technically not a loan, you can use the 60-day rollover allowance once every 12 months to take a withdrawal from your IRA account as long as you replace that money within a 60-day timeframe.