An image sensor comprising: a plurality of pixels arranged one-dimensionally or two-dimensionally, wherein each pixel includes: a photoelectric conversion portion for generating a charge in an amount according to an intensity of incident light; a first gate for controlling removal of the charge accumulated in the photoelectric conversion portion from the pixel; a charge accumulation portion provided separately from the photoelectric conversion portion and for accumulating the charge; a second gate provided between the photoelectric conversion portion and the charge accumulation portion and for controlling a transfer of the charge from the photoelectric conversion portion to the charge accumulation portion; and a third gate for controlling readout of the charge from the charge accumulation portion, and wherein the first gate removes the charge generated in the photoelectric conversion portion by incidence of first light from the pixel, the first light and second light being temporally alternately incident, the second gate transfers the charge generated in the photoelectric conversion portion by incidence of the second light to the charge accumulation portion, the third gate performs control for reading out the charge from the charge accumulation portion after the charge transfer to the charge accumulation portion is performed n times (n is an integer of 1 or more), and wherein the number n of the charge transfers is individually set for each pixel. a plurality of pixels arranged one-dimensionally or two-dimensionally, wherein each pixel includes: a photoelectric conversion portion for generating a charge in an amount according to an intensity of incident light; a first gate for controlling removal of the charge accumulated in the photoelectric conversion portion from the pixel; a charge accumulation portion provided separately from the photoelectric conversion portion and for accumulating the charge; a second gate provided between the photoelectric conversion portion and the charge accumulation portion and for controlling a transfer of the charge from the photoelectric conversion portion to the charge accumulation portion; and a third gate for controlling readout of the charge from the charge accumulation portion, and wherein the first gate removes the charge generated in the photoelectric conversion portion by incidence of first light from the pixel, the first light and second light being temporally alternately incident, the second gate transfers the charge generated in the photoelectric conversion portion by incidence of the second light to the charge accumulation portion, the third gate performs control for reading out the charge from the charge accumulation portion after the charge transfer to the charge accumulation portion is performed n times (n is an integer of 1 or more), and wherein the number n of the charge transfers is individually set for each pixel. a photoelectric conversion portion for generating a charge in an amount according to an intensity of incident light; a first gate for controlling removal of the charge accumulated in the photoelectric conversion portion from the pixel; a charge accumulation portion provided separately from the photoelectric conversion portion and for accumulating the charge; a second gate provided between the photoelectric conversion portion and the charge accumulation portion and for controlling a transfer of the charge from the photoelectric conversion portion to the charge accumulation portion; and a third gate for controlling readout of the charge from the charge accumulation portion, and wherein the first gate removes the charge generated in the photoelectric conversion portion by incidence of first light from the pixel, the first light and second light being temporally alternately incident, the second gate transfers the charge generated in the photoelectric conversion portion by incidence of the second light to the charge accumulation portion, the third gate performs control for reading out the charge from the charge accumulation portion after the charge transfer to the charge accumulation portion is performed n times (n is an integer of 1 or more), and wherein the number n of the charge transfers is individually set for each pixel.