The penalty for late filing of Form 4506 is a penalty of $50 per return, up to a maximum of $100,000 per year.