A food allergy causes the immune system to produce a reaction and usually means the baby cannot tolerate any amount of the food. A food intolerance produces symptoms but does not activate the immune system. Sometimes small amounts of the food can be tolerated.