If your bakery fails a health inspection because of critical violations, it can be shut down in most states. Non-critical violations can be just as detrimental to your bakery as failing, and can often damage your bakery's reputation.