Method for pre-processing an image in facial recognition system

A method preprocessing scheme that improves classification accuracy of a face recognition system comprises identifying a plurality of edges of an image. The method further comprises step of identifying a plurality of discontinuities in the plurality of edges of the image. Furthermore, the method also comprises generating contiguous outline for the image. The last step of the method comprises filling a background of the image with at least one color.

TECHNICAL FIELD

The present disclosure relates to a novel preprocessing scheme that improves classification accuracy of a face recognition system.

BACKGROUND

Face Recognition is a challenging task with challenges emanating from illumination, pose, background, scale and shadow etc. Each of them affect classification accuracy. Apart from these challenges, color leakage of an input image, as depicted inFIG. 2, results into significant reduction in classification accuracy. Also, it was noted through experimentation that background color impact classification accuracy. We address both the challenges in the proposed invention. In the present disclosure, the images available in public domain are considered to illustrate the approach and use a novel method of preprocessing to improve classification accuracy. The proposed scheme works irrespective of pose, orientation and illumination of input image.

SUMMARY OF THE INVENTION

Automatic Face Recognition is an active research area. The challenges include pose, illumination, background clutter, ageing, etc. There are many approaches to extract face in the presence of background. We present a method wherein we extract face in the presence of color leakages which otherwise cause loss of accuracy in classification. To illustrate we make use of a public domain image database.

Aspects of the disclosure relate to a method a novel preprocessing scheme that improves classification accuracy of a face recognition system.

According to the one embodiment of the present disclosure, a method for preprocessing scheme that improves classification accuracy of a face recognition system comprises identifying a plurality of edges of an image. The next step of the method comprises identifying a plurality of discontinuities in the plurality of edges of the image. Identifying the plurality of edges of an image also comprises preventing the at least one color being applied on the entire image. The at least one color can be in the range of about 0-255. The color can be but not restricted to gray color. The present embodiment of the disclosure also comprises generating contiguous outline for the image. The step of generating contiguous outline for the image also comprises generating contiguous outline for the image using linear interpolation method. The final step of the present embodiment comprises filling a background of the image with at least one color. The color can be but not restricted to gray color. The present disclosure also comprises generating the plurality of edges to the image using standard algorithms. After the plurality of edges are generated an outline for the images are generated. The present disclosure also comprises, receiving an image from multiple sources which includes but not restricted to an image database or an image from a user. The present disclosure also includes a step of isolating a face portion of the image.

DETAILED DESCRIPTION

The detailed description presented in the current section is intended to enable any person skilled in the art to make and use the invention, and is provided in the context of specific applications and their requirements. Necessary modifications to preferred embodiments will readily be apparent to those skilled in the art, and generic formulations defined herein may be applied to other embodiments and applications without departing from the spirit and scope of the invention. Moreover, in the following discussion, a number of details are set forth for the purpose of explanation. However one of the ordinarily skill in the art will realize that the invention could be practiced without the use of the above specific details. In other instances, well-known structures and devices are shown in block diagram form in order not to obscure the description of the invention with unnecessary detail. Thus the present is not intended to be limited to the embodiments shown, but is to be accorded the widest scope consistent with the principles and features disclosed herein.

FIG. 1ais an illustrative drawing of edge detection using Soble operator. As noted in101, consider a color face image. For illustration, we consider image with single face image. Convert the image to gray scale as noted in102. Using Sobel operator, compute edges of the given face image,103. Store the image edges into a list as in104.

FIG. 1bis an illustrative drawing of scheme for identification of discontinuities in edges. Ideally, depending on the image gradient edge pixels are identified for every line. For the same reason of gradient, it is possible that the edges are not identified for one or more lines. In the current illustration we identify all such groups of lines and pixels for which edges are not identified.FIG. 3depicts example of discontinuous in the detected edges. As noted in201, Empirically, since start of the image, every line will normally have two edges (lk,p1) and (lkp2) for each line lkthat contains face image. However, practically, it is observed that there would be discontinuities in the edges Identify those groups of continuous lines that do not have edge pixel identified. Store the set of discontinuities in terms of start and end line and pixels,202. Collect sets of all such discontinuous groups of lines as noted in203.

FIG. 1cis an illustrative drawing of computing missing edge pixels through interpolation. The objective of entire exercise to isolate the given image from the background and fill the background with a gray scale that helps classification better. In this process, as noted in301, consider set of all start and end lines between which discontinuity is noted. We use linear interpolation to compute pixel number for each of the line numbers that lie between the start and end lines of each discontinuous pair of lines,302. The original edge output together with interpolated pixels for the missing lines forms the complete set of detected edges using Sobel operator, as noted in303.

FIG. 1dis an illustrative drawing of generating complement set of edge output. As noted in401, we consider edge output as available in303for further processing. We compute the set of all pixels that form complement to given face image. The objective is to fill up such identified region with a common gray color. The process of identification of the region is described in402. Let the given image contain line numbers, say, lstartto lend. Depending on the location of the face in the image, there will be one or two pairs of start and end pixels in a line. For example, as noted inFIG. 4, line AB refers to the region where face image is not available. Thus it has one pair of line and pixels. In case of line CD, there will be two sets pairs of line and pixels corresponding to the line segments CE and FD. Segment EF is computed using edge detector as discussed through drawing so far. We record the set of edges that form the complement set inFIG. 1d,403.

FIG. 1eis an illustrative drawing of background fill or equivalently color fill of complement region identified inFIG. 1d.FIG. 5is an illustrative drawing of filling background color without resorting to interpolation. As noted in501, we consider the complement set as noted in403. Fill the set of pixels with a common gray value,502. Carry out experiments with face recognition using Eigenfaces method to find optimal gray color that maximizes classification accuracy of the system. It was found the best classification accuracy is obtained with a gray color value of 90.FIG. 6is an illustrative example of color fill after discontinuity in detected edges is taken care.

FIG. 2is an illustrative drawing of sample images having color leakage considered from PICS[1] database. It contains three images illustrating color leakage into the background.

FIG. 3is an illustrative drawing of discontinuities in edges of an image. The figure contains three images. From left to right, the first image depicts discontinuities in the edges in the form of blue and red rectangles; the second and third images are zoomed version of discontinuities in the blue and red rectangles respectively.

FIG. 4is an illustrative drawing of Identification of Region that excludes face image.

FIG. 5is an illustrative drawing of background fill without resorting to interpolation of pixels.

FIG. 6is an illustrative drawing of background fill of an image with interpolated edges.

A computing environment may have additional features. For example, the computing environment700includes storage740, one or more input devices750, one or more output devices760, and one or more communication connections770. An interconnection mechanism (not shown) such as a bus, controller, or network interconnects the components of the computing environment700. Typically, operating system software (not shown) provides an operating environment for other software executing in the computing environment700, and coordinates activities of the components of the computing environment700.

The storage740may be removable or non-removable, and includes magnetic disks, magnetic tapes or cassettes, CD-ROMs, CD-RWs, DVDs, or any other medium which may be used to store information and which may be accessed within the computing environment700. In some embodiments, the storage740stores instructions for the software780.

The input device(s)750may be a touch input device such as a keyboard, mouse, pen, trackball, touch screen, or game controller, a voice input device, a scanning device, a digital camera, or another device that provides input to the computing environment700. The output device(s)760may be a display, a television, a hand held device, a head mounted display or a Kiosk that provides output from the computing environment700.

Implementations may be described in the general context of computer-readable media. Computer-readable media are any available media that may be accessed within a computing environment. By way of example, and not limitation, within the computing environment700, computer-readable media include memory720, storage740, communication media, and combinations of any of the above.

The sequence of instructions as explained in the method steps may include a program code adapted for identifying a plurality of edges of an image. The sequence of instructions comprises program code adapted for identifying a plurality of discontinuities in the plurality of edges of the image. The sequence of instructions further comprises program code adapted for generating contiguous outline for the image. Furthermore, the present disclosure also comprises program code adapted for filling a background of the image with at least one color.