The penalty for late filing of 1099-G forms can vary depending on the circumstances, but it can range from $50 to $260 per form.