A face recognition system comprising an apparatus , the apparatus comprising: a base image determiner configured to determine at least one base image from among an image registered by a user as a base image and an image considered based on a usage log of a user to demonstrate the most or least frequent facial expression of the user; a continuously photographed image generator configured to generate continuously photographed images by continuously photographing a subject; an image selector configured to select each of the continuously photographed images; a difference calculator configured to extract a feature value of a feature from the at least one base image and for each of the selected images a feature value of the feature from the selected image, respectively, and to calculate a difference between the at least one base image and each of the selected images based on the extracted feature values; and a peak image determiner configured to determine a peak image from among the continuously photographed images as an image with the greatest or smallest difference to the base image from among the plurality of continuously photographed images, wherein when the base image represents a most frequent expression of the subject, the peak image is determined as the one with the greatest difference to the base image, and when the base image represents a least frequent expression of the subject, the peak image is determined as the one with the smallest difference to the base image; and wherein the apparatus is configured to provide the continuously photographed images without the determined peak image for face recognition. a base image determiner configured to determine at least one base image from among an image registered by a user as a base image and an image considered based on a usage log of a user to demonstrate the most or least frequent facial expression of the user; a continuously photographed image generator configured to generate continuously photographed images by continuously photographing a subject; an image selector configured to select each of the continuously photographed images; a difference calculator configured to extract a feature value of a feature from the at least one base image and for each of the selected images a feature value of the feature from the selected image, respectively, and to calculate a difference between the at least one base image and each of the selected images based on the extracted feature values; and a peak image determiner configured to determine a peak image from among the continuously photographed images as an image with the greatest or smallest difference to the base image from among the plurality of continuously photographed images, wherein when the base image represents a most frequent expression of the subject, the peak image is determined as the one with the greatest difference to the base image, and when the base image represents a least frequent expression of the subject, the peak image is determined as the one with the smallest difference to the base image; and wherein the apparatus is configured to provide the continuously photographed images without the determined peak image for face recognition. <EOS>