You do not have to file IRS Form 941 for a quarter in which you did not pay employees, as long as you previously filed Form 941 and checked the box indicating that you are a seasonal employer. The IRS generally expects seasonal employers to file at least one Form 941 during the tax year.