An imaging apparatus comprising: an image pickup device comprising a plurality of photoelectric conversion elements arrayed in a predetermined first direction and a second direction intersecting with the first direction; a color filter that is provided above a plurality of pixels configured by the plurality of photoelectric conversion elements, the color filter having a repeatedly disposed basic array pattern wherein a first filter corresponding to a first color that contributes most to obtaining a brightness signal, and second filters respectively corresponding to 2 or more second colors other than the first color, are placed in a predetermined pattern of (N x M) pixels in the first direction and the second direction, wherein N and M are integers of 3 or more with one or more of the first filter and the second filters corresponding to each of the second colors respectively placed in each line in the color filter in the first direction and the second direction, and with one or more of the first filter placed in each line in the color filter plane in the first direction, the second direction and third directions that intersect with the first direction and the second direction; a line image data generation means that reads pixel signals from a plurality of pixels running along the second direction at a set cycle in the first direction from the image pickup device, and, from the read pixel signals, generates line image data from pixel signals of pixels that are arrayed running along the second direction and are arrayed at an (N + k) line cycle in the first direction, wherein k is a positive integer such that 0 < k < N, from the plurality of pixels such that at least one of the first color and each of the second colors are respectively contained in each of the lines running along the first direction; an image data generation means that generates image data based on the line image data; and a pixel summing means that respectively sums pixels of said line image data configured from the pixel signals of the pixels that are arrayed running along the second direction and are arrayed at the (N + k) line cycle in the first direction, with corresponding pixels of the same color of line image data generated from pixel signals of pixels that are arrayed running along the second direction and are arrayed at an N line cycle in the first direction opposite to the (N + k) line image data. an image pickup device comprising a plurality of photoelectric conversion elements arrayed in a predetermined first direction and a second direction intersecting with the first direction; a color filter that is provided above a plurality of pixels configured by the plurality of photoelectric conversion elements, the color filter having a repeatedly disposed basic array pattern wherein a first filter corresponding to a first color that contributes most to obtaining a brightness signal, and second filters respectively corresponding to 2 or more second colors other than the first color, are placed in a predetermined pattern of (N x M) pixels in the first direction and the second direction, wherein N and M are integers of 3 or more with one or more of the first filter and the second filters corresponding to each of the second colors respectively placed in each line in the color filter in the first direction and the second direction, and with one or more of the first filter placed in each line in the color filter plane in the first direction, the second direction and third directions that intersect with the first direction and the second direction; a line image data generation means that reads pixel signals from a plurality of pixels running along the second direction at a set cycle in the first direction from the image pickup device, and, from the read pixel signals, generates line image data from pixel signals of pixels that are arrayed running along the second direction and are arrayed at an (N + k) line cycle in the first direction, wherein k is a positive integer such that 0 < k < N, from the plurality of pixels such that at least one of the first color and each of the second colors are respectively contained in each of the lines running along the first direction; an image data generation means that generates image data based on the line image data; and a pixel summing means that respectively sums pixels of said line image data configured from the pixel signals of the pixels that are arrayed running along the second direction and are arrayed at the (N + k) line cycle in the first direction, with corresponding pixels of the same color of line image data generated from pixel signals of pixels that are arrayed running along the second direction and are arrayed at an N line cycle in the first direction opposite to the (N + k) line image data.