Penalties for late filing might include interest, late fees, and hefty fines. The amount of TDS involved and the length of the delay determines the precise penalty.