An imaging and processing device comprising: an optical element; a single imager with a color filter array of a plurality of colors attached thereto for outputting a pixel value according to an amount of light which has been guided by the optical element and transmitted through the color filter array, thereby enabling to obtain separate images of the plurality of colors for every frame time point, wherein the color filter array includes, as one of the plurality of colors, a third color which is different from a first color and a second color; a first adder section for adding together pixel values, associated with the first color of the plurality of colors and sharing the same pixel coordinate value in different images obtained over a plurality of consecutive frames; characterized by a second adder section for adding together values of a plurality of pixels, associated with the second color of the plurality of colors other than the first color, and for adding together values of a plurality of pixels associated with the third color, of an image captured at a single frame time point; and an image restoring section for generating, as a restored image, an image including a plurality of colors at each frame time point from an image based on the first color which has been subjected to the addition by the first adder section, and an image based on the second color which has been subjected to the addition by the second adder section, and an image based on the third color which has been subjected to the addition by the second adder section, the restored image satisfying a predetermined smoothness constraint condition regarding distribution of pixel values of the restored image, or regarding image's motion distribution obtained from the restored image; an optical element; a single imager with a color filter array of a plurality of colors attached thereto for outputting a pixel value according to an amount of light which has been guided by the optical element and transmitted through the color filter array, thereby enabling to obtain separate images of the plurality of colors for every frame time point, wherein the color filter array includes, as one of the plurality of colors, a third color which is different from a first color and a second color; a first adder section for adding together pixel values, associated with the first color of the plurality of colors and sharing the same pixel coordinate value in different images obtained over a plurality of consecutive frames; characterized by a second adder section for adding together values of a plurality of pixels, associated with the second color of the plurality of colors other than the first color, and for adding together values of a plurality of pixels associated with the third color, of an image captured at a single frame time point; and an image restoring section for generating, as a restored image, an image including a plurality of colors at each frame time point from an image based on the first color which has been subjected to the addition by the first adder section, and an image based on the second color which has been subjected to the addition by the second adder section, and an image based on the third color which has been subjected to the addition by the second adder section, the restored image satisfying a predetermined smoothness constraint condition regarding distribution of pixel values of the restored image, or regarding image's motion distribution obtained from the restored image;