Yes, Fontina can go off. You can quickly recognize this by its sour taste, off smell, or moldy growth.