Possibly. The IRS allows you to consider a home (or dwelling unit) a residence if the number of days you personally use it during the year is greater of:
14 days; or
If rented to others at a fair rental rate, 10% of the total days it was rented during the year.
If your vacation home qualifies as a residence, you may be able to deduct the real estate taxes and mortgage interest you pay on the property.