An image processing apparatus comprising: a storage configured to store a plurality of scale factors for determining an extent of reduction of an input image; an input unit to which the image is input; and a processor configured to: receive an input image through the input unit, perform pre-processing to improve an image quality of the input image, determine a degree of degradation of the input image based on an image quality improvement rate of the pre-processed image which is measured by comparing the pre-processed image with the input image, obtain a plurality of reduced images by reducing the pre-processed image based on a scale factor corresponding to the determined degree of degradation from among the plurality of scale factors stored in the memory, obtain a texture feature corresponding to the pre-processed image, and a plurality of texture features corresponding to the plurality of reduced images, identify, among the plurality of texture features corresponding to the plurality of reduced images, a texture feature having a minimum difference from the texture feature corresponding to the pre-processed image, and obtain an output image by applying the identified texture feature to a plurality of first areas of the pre-processed image, the plurality of first areas being a portion of the pre-processed image in which a frequency of an image signal corresponding to the pre-processed image is greater than or equal to a preset frequency, wherein a size of the plurality of first areas corresponds to a size of the plurality of reduced images. a storage configured to store a plurality of scale factors for determining an extent of reduction of an input image; an input unit to which the image is input; and a processor configured to: receive an input image through the input unit, perform pre-processing to improve an image quality of the input image, determine a degree of degradation of the input image based on an image quality improvement rate of the pre-processed image which is measured by comparing the pre-processed image with the input image, obtain a plurality of reduced images by reducing the pre-processed image based on a scale factor corresponding to the determined degree of degradation from among the plurality of scale factors stored in the memory, obtain a texture feature corresponding to the pre-processed image, and a plurality of texture features corresponding to the plurality of reduced images, identify, among the plurality of texture features corresponding to the plurality of reduced images, a texture feature having a minimum difference from the texture feature corresponding to the pre-processed image, and obtain an output image by applying the identified texture feature to a plurality of first areas of the pre-processed image, the plurality of first areas being a portion of the pre-processed image in which a frequency of an image signal corresponding to the pre-processed image is greater than or equal to a preset frequency, wherein a size of the plurality of first areas corresponds to a size of the plurality of reduced images. receive an input image through the input unit, perform pre-processing to improve an image quality of the input image, determine a degree of degradation of the input image based on an image quality improvement rate of the pre-processed image which is measured by comparing the pre-processed image with the input image, obtain a plurality of reduced images by reducing the pre-processed image based on a scale factor corresponding to the determined degree of degradation from among the plurality of scale factors stored in the memory, obtain a texture feature corresponding to the pre-processed image, and a plurality of texture features corresponding to the plurality of reduced images, identify, among the plurality of texture features corresponding to the plurality of reduced images, a texture feature having a minimum difference from the texture feature corresponding to the pre-processed image, and obtain an output image by applying the identified texture feature to a plurality of first areas of the pre-processed image, the plurality of first areas being a portion of the pre-processed image in which a frequency of an image signal corresponding to the pre-processed image is greater than or equal to a preset frequency, wherein a size of the plurality of first areas corresponds to a size of the plurality of reduced images.