You can develop an allergy to anything at any time.  There are very few reactions reported of the pigments themselves.