Yes, it is possible to be intolerant to egg yolk. Some people have a problem digesting the proteins in the egg yolk itself.