If you are paying off your student loans, you'll probably need to use Form 1098-E while completing your taxes. Generally, if you made student loan payments, you may be eligible to deduct a portion of the interest paid on your federal tax return.