Yes, depending on the circumstances and seriousness of the breach of late registration. A company can be fined from 2% to 55% of the total GST due.