Abstract:
An object recognition system is provided including at least one image capturing device configured to capture at least one image, wherein the image includes a plurality of pixels and is represented in an image data set, an object detection device configured to identify a plurality of pixels corresponding to objects from the at least one image, wherein an object includes a plurality of pixels and is represented in an object data set, wherein the object data set includes a set of features corresponding to each pixel in the object, and an image recognition device configured to recognize objects of interest present in an object by image correlation against a set of template images to recognize an object as one of the templates.

Description:
BACKGROUND 
       [0001]    The present invention generally relates to the imaging field of object detection and recognition. More specifically, the present invention relates to a system for the recognition of objects of interest among other objects in a captured image. 
         [0002]    The detection and recognition of objects of interest among other objects within a captured image is a field that has been the subject of intense research since the emergence of digital imaging technology. A variety of systems has been produced which attempt to accurately and precisely detect objects of interest among other objects. In particular, one application of such systems is in the detection and recognition of road signs. 
         [0003]    Initially, the detection and recognition of road signs appears to be a well-bounded problem and the solution would be quite simple. That is, road signs tend to occur in standardized positions in traffic scenes. Further, their shape, color and pictograms are known because of national, regional, and local transportation standards. However, the solution to such a problem with an object detection and recognition system is not as simple as it may initially seem. 
         [0004]    Indeed, a variety of difficulties are faced by such an object detection and recognition system. An image captured for the purpose of road sign recognition will be acquired from a moving car and the sign size and orientation will change with distance as it may be skewed and rotated. Additionally, many objects will be present in highly complex captured images such as pedestrians, other vehicles, bushes, buildings, and other signs. Some of these other objects may be very similar in shape, pattern, and color to a road sign. To further complicate matters, in many areas road signs exist in many variants that often vary significantly from the legally established standard for that nation, region, or locale. Lastly, as with all applied computer vision systems, the implemented system must be suitable for real-time implementation requiring the processing of large amounts of information in a shortened time-frame. 
         [0005]    One example of an object detection and recognition system utilizes a single camera. The images of a single camera are fed into a machine-learning algorithm such as a neural network. The machine-learning algorithm, which has previously been trained by a database of road images, attempts to classify the captured image and its contents thereby allowing a set of objects of interest to be detected as well as recognized. However, this statistical approach to machine learning requires the acquisition of large image databases that is both time-consuming and expensive. Further, this approach is not entirely effective at remedying the problems discussed above with respect to vibration, color variation, obscuring of images, complexity of captured images, and variation of road signs from established standards. 
         [0006]    In addition to the use of machine learning algorithms in a statistical approach, another method for detecting objects of interest and subsequently recognizing them is the use of color to aid object segmentation from the background imagery. However, the fast and robust color segmentation of objects is difficult as the color wavelength arriving at the camera is not invariant to the intensity of the incident light and age of the sign as they fade with time. 
         [0007]    As demonstrated above by the explanation of existing systems, many of the solutions to detecting and recognizing objects of interest in a captured image are not optimal. Therefore, a system for detecting and recognizing objects of interest in a captured image that is capable of operating in various environments is needed. 
       SUMMARY 
       [0008]    According to a disclosed embodiment, an object detection and recognition system is provided. The system includes at least one image capture device. A vision controller is configured to receive images from the image capture device. An object detector is configured to recognize an object of interest within the received images. A vehicle controller receives the object of interest and is configured to control a vehicle subsystem in response to the object of interest. 
         [0009]    In an alternative embodiment, the system includes an object segmenter configured to isolate individual objects within the received images, and an object recognizer configured to determine whether the individual objects include an object of interest. 
         [0010]    In an alternative embodiment, an object detection and recognition method is provided. The method includes the steps of receiving captured images from at least one image capture device, recognizing an object of interest within the received images, and providing object recognition information to a vehicle controller controlling a vehicle subsystem in response to the object of interest. 
         [0011]    According to another disclosed embodiment, the object segmenter receives images from at least two image capture devices to form a stereoscopic representation of the received images to obtain range information for the received images and isolates individual objects within the received images using the range information. 
         [0012]    According to another disclosed embodiment, the recognizing step further includes the steps of mapping the image pixel addresses of the isolated object into the pixel addresses of at least one object of interest image, least squares curve fitting of the mapping parameters, correlation of the mapped and object of interest image, and object recognition by selecting the at least one object of interest image having the greatest correlation. 
         [0013]    It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory only, and are not restrictive of the invention as claimed. These and other features, aspects and advantages of the present invention will become apparent from the following description, appended claims, and the accompanying exemplary embodiments shown in the drawings, which are briefly described below. 
     
    
     
       BRIEF DESCRIPTION OF THE DRAWINGS 
         [0014]      FIG. 1  illustrates a vehicle having an object detection and recognition system, according to one embodiment. 
           [0015]      FIG. 2  illustrates an object detection and recognition system, according to one embodiment. 
           [0016]      FIG. 3  illustrates a segmented sign image. 
           [0017]      FIG. 4  illustrates an object recognition system, according to one embodiment. 
           [0018]      FIG. 5  illustrates signs that are used for template generation. 
           [0019]      FIG. 6  illustrates a pixelized template and a template formed from a portion of the full image. 
           [0020]      FIG. 7  illustrates the coordinate mapping between a segmented image and a rotated template image. 
       
    
    
     DETAILED DESCRIPTION 
       [0021]    Embodiments of the present invention will be described below with reference to the accompanying drawings. It should be understood that the following description is intended to describe exemplary embodiments of the invention, and not to limit the invention. 
         [0022]    OVERVIEW: The object detection and recognition system  1  is illustrated in  FIG. 1  according to one embodiment. At least one image capture device  3  is positioned on the vehicle in order to capture images of the scene of interest. This scene includes the exterior and the interior of the vehicle. The image capture devices  3  are operably connected to a vision controller  7  and provide the images  5  to it in a typically serial format. The vision controller  7  buffers and provides the image data  9  to the object detector  11  in a compatible format  9 . The object detector  11  recognizes an object of interest within the image  9  and provides this information  13  to the vehicle controller  15 . The vehicle controller  15  responds to the recognition of an object of interest by adjusting vehicle control subsystems including the brake system  17  and driver display system  19 . 
         [0023]    A block diagram of the object detector  11  is illustrated in  FIG. 2 . The image data  9  is passed to the object segmenter  31  to isolate individual objects within the image  9 . The segmented portion  33  of the image is passed to the object recognizer  35  to determine if the image  33  includes an object of interest. The database  37  provides object of interest information  39  to the object recognizer. The object recognizer passes recognized objects of interest  13  to the vehicle controller  15 . 
         [0024]    OBJECT SEGMENTATION: The object segmenter  31  uses image processing algorithms to isolate distinct objects within the image data  9 . In one embodiment, using image data from a single image capture device  3 , the clustering of pixels into an object uses edge detection and region growing algorithms. In another embodiment, pixel color information is also used.  FIG. 3  illustrates a resulting segmented sign image. 
         [0025]    In a further embodiment, the segmenter  31  uses images  9  from at least two image capture devices  3  to form a stereoscopic representation of the imaged scene. The three dimensional stereoscopic image includes the range to as well as the vertical and lateral displacement of each pixel. Having the range information substantially enhances the segmentation process as it has a third clustering dimension to work with. Clustering in three dimensions produces the depth of the object as well as its vertical height and lateral width. These are measured in distance units (e.g. meters). 
         [0026]    OBJECT RECOGNITION: A block diagram of the object recognizer  35  is illustrated in  FIG. 4 . Each object of interest, represented by a template  39  within the database  37 , is selected and tested against the segmented image  33 . For each template  39  from the database  37 , the object recognizer  35 :
       pre-screens  41  the template  39  to qualify it;   curve fits  43  pre-screened templates to the image  33 ;   calculates  45  the correlation between the curve fitted template and image  33 ;   selects  53  the template with the maximum correlation; and   if the maximum correlation exceeds a minimum value, reports  55  the maximum correlation template to the vehicle controller  15 .       
 
         [0032]    TEMPLATES: A template  39  of an object of interest includes an image  49  of the object of interest. An image of an object of interest is formed by any graphical symbology and is not limited by language nor content. The image is represented by an equation or table mapping illumination to x-y coordinates, a pixelized image, or other means. Examples of the color and black/white graphical symbology that can be converted into template images are shown in  FIG. 5 .  FIG. 6  illustrates a pixilated sign template  61 . In one embodiment, to reduce the image storage, a pertinent portion  63  of the sign is used as a template rather than the entire image. 
         [0033]    PRE-SCREENING A TEMPLATE: Pertinent templates for the segmented object  33  are those that fit within a set of pre-screening qualifications  47 . These qualifications include agreement between the object location within the image  9 , the object geometric proportions, color, and other qualifiers. These qualifications are included in the database  37  for each template  39  and are provided  47  to the pre-screener. Other sensing systems may assist the pre-screening process. For example, if a vehicle is on a multi-lane highway, a system that can determine which lane the vehicle is in can be used to establish the minimum cross-distance that an object can appear. 
         [0034]    Given the variation in signs from locale to locale, in one embodiment templates are pre-stored in the ubiquitous GPS navigation system and provided to update the database as the location of the vehicle changes. In another embodiment the GPS position data is used directly to enable and disable templates pre-stored in the database  37 . In a further embodiment, the GPS position is used to pre-screen  41  a template. 
         [0035]    A stereoscopic image of the object provides its depth as well and height and width, and depth is used to pre-screen templates (e.g. signs have no significant depth and sign templates are eliminated should the object have significant depth). 
         [0036]    COMPARISON OF THE SEGMENTED OBJECT TO A PRE-SCREENED TEMPLATE: However an object is segmented for processing by the object recognizer  35 , the object recognizer examines the segmented image  33  from one image capture device and compares that image to pre-screened templates of objects of interest stored in the database  37 . 
         [0037]    The segmented images  33  may be scaled with distance from the vehicle, rotated with respect to the vehicle, or have color and illumination that vary with local conditions. The basis of the comparison is to map pixels from the database template  49  to segmented image pixels  33 . For example, ignoring rotation of the two images relative to each other, mapping pixel template (row template , column template ) into pixel image (row image , column image ) is performed as 
         [0000]      row image   =s   scale row template +row offset′   
         [0000]      column image   =s   scale column template +column offset    
         [0000]    where (row, column) is the pixel address of the pixel within the template or segmented image. The unknown constant s scale  compensates for image size, and row offset  and column offset  are unknown constants that compensate for centering within the image. As shown in  FIG. 7 , if image rotation is an issue, the mapping includes a rotation angle coupled with an affine transformation such as 
         [0000]      row image   =s   scale (row template  cos θ+column template  sin θ)+row offset    
         [0000]      column image =s scale (−row template  sin θ+column template  cos θ)+column offset    
         [0000]    where θ is an unknown constant rotation angle. 
         [0038]    The common s scale  for rows and columns assumes the template pixels and segmented image pixels have identical aspect ratios. If the aspect ratios are not the same, then 
         [0000]      row image =s scale (α row row template  cos θ+αcolumncolumn template  sin θ)+row offset    
         [0000]      column image =s scale (α row row template  sin θ+α column column template  cos θ)+column offset    
         [0000]    where α row  and α column  are the size ratios of the image capture device  3  to template rows and columns. 
         [0039]    In an alternate embodiment the pixels from the segmented image  33  are mapped to the pixels of the template image  49  as 
         [0000]      row template =[(row image −row offset )cos θ−(column image −column offset )sin θ]/s scale    
         [0000]      column template =[(row image −row offset )sin θ+(column image −column offset )cos θ]/s scale    
         [0000]    Since generally there are more pixels in the segmented image than in the template image, this embodiment may not be as efficient as mapping pixels from the template to the segmented image. 
         [0040]    The unknown constants (s scale , row offset , column offset , θ) are determined by minimizing the square error between the template and the mapped image. For example, if color is not involved, but only illumination, the square error to minimize is 
         [0000]    
       
         
           
             
               J 
                
               
                 ( 
                 
                   
                     λ 
                     illum 
                   
                   , 
                   
                     s 
                     scale 
                   
                   , 
                   
                     row 
                     offset 
                   
                   , 
                   
                     column 
                     offset 
                   
                   , 
                   θ 
                 
                 ) 
               
             
             = 
             
               
                 ∑ 
                 
                   r 
                   = 
                   0 
                 
                 
                   
                     R 
                     template 
                   
                   - 
                   1 
                 
               
                
               
                   
               
                
               
                 
                   ∑ 
                   
                     c 
                     = 
                     0 
                   
                   
                     
                       C 
                       template 
                     
                     - 
                     1 
                   
                 
                  
                 
                   
                     { 
                     
                       
                         
                           
                             
                               λ 
                               illum 
                             
                              
                             
                               
                                 I 
                                 image 
                               
                               [ 
                               
                                 
                                   
                                     s 
                                     scale 
                                   
                                    
                                   
                                     ( 
                                     
                                       
                                         r 
                                          
                                         
                                             
                                         
                                          
                                         cos 
                                          
                                         
                                             
                                         
                                          
                                         θ 
                                       
                                       + 
                                       
                                         c 
                                          
                                         
                                             
                                         
                                          
                                         sin 
                                          
                                         
                                             
                                         
                                          
                                         θ 
                                       
                                     
                                     ) 
                                   
                                 
                                 + 
                               
                             
                           
                         
                       
                       
                         
                           
                             
                               row 
                               offset 
                             
                             , 
                             
                               
                                 
                                   s 
                                   scale 
                                 
                                  
                                 
                                   ( 
                                   
                                     
                                       
                                         - 
                                         r 
                                       
                                        
                                       
                                           
                                       
                                        
                                       sin 
                                        
                                       
                                           
                                       
                                        
                                       θ 
                                     
                                     + 
                                     
                                       c 
                                        
                                       
                                           
                                       
                                        
                                       cos 
                                        
                                       
                                           
                                       
                                        
                                       θ 
                                     
                                   
                                   ) 
                                 
                               
                               + 
                             
                           
                         
                       
                       
                         
                           
                             
                               
                                 column 
                                 offset 
                               
                               ] 
                             
                             - 
                             
                               
                                 I 
                                 template 
                               
                                
                               
                                 [ 
                                 
                                   r 
                                   , 
                                   c 
                                 
                                 ] 
                               
                             
                           
                         
                       
                     
                     } 
                   
                   2 
                 
               
             
           
         
       
     
         [0000]    where λ illum  is an unknown constant that scales illumination, and I[r, c] is the illumination of pixel[r, c]. The terms R template  and C template  are the number of rows and columns in the template image. This can be written in vector format as 
         [0000]    
       
         
           
             
               J 
                
               
                 ( 
                 
                   p 
                   _ 
                 
                 ) 
               
             
             = 
             
               
                 ∑ 
                 
                   r 
                   = 
                   0 
                 
                 
                   
                     R 
                     template 
                   
                   - 
                   1 
                 
               
                
               
                   
               
                
               
                 
                   ∑ 
                   
                     c 
                     = 
                     0 
                   
                   
                     
                       C 
                       template 
                     
                     - 
                     1 
                   
                 
                  
                 
                     
                 
                  
                 
                   
                     ɛ 
                     ( 
                     
                       
                         p 
                         _ 
                       
                       , 
                       r 
                       , 
                       c 
                     
                     ) 
                   
                   2 
                 
               
             
           
         
       
       
         
           
             
               p 
               _ 
             
             = 
             
               
                 [ 
                 
                   
                     λ 
                     
                       illum 
                        
                       
                           
                       
                     
                   
                    
                   
                       
                   
                    
                   
                     s 
                     scale 
                   
                    
                   
                       
                   
                    
                   
                     row 
                     offset 
                   
                    
                   
                       
                   
                    
                   
                     column 
                     offset 
                   
                    
                   
                       
                   
                    
                   θ 
                 
                 ] 
               
               T 
             
           
         
       
       
         
           
             
               ɛ 
               ( 
               
                 
                   p 
                   _ 
                 
                 , 
                 r 
                 , 
                 c 
               
               ) 
             
             = 
             
               
                 
                   λ 
                   illum 
                 
                  
                 
                   
                     I 
                     image 
                   
                    
                   
                     [ 
                     
                       
                         
                           
                             s 
                             scale 
                           
                            
                           
                             ( 
                             
                               
                                 r 
                                  
                                 
                                     
                                 
                                  
                                 cos 
                                  
                                 
                                     
                                 
                                  
                                 θ 
                               
                               + 
                               
                                 c 
                                  
                                 
                                     
                                 
                                  
                                 sin 
                                  
                                 
                                     
                                 
                                  
                                 θ 
                               
                             
                             ) 
                           
                         
                         + 
                         
                           row 
                           offset 
                         
                       
                       , 
                       
                         
                           
                             s 
                             scale 
                           
                            
                           
                             ( 
                             
                               
                                 
                                   - 
                                   r 
                                 
                                  
                                 
                                     
                                 
                                  
                                 sin 
                                  
                                 
                                     
                                 
                                  
                                 θ 
                               
                               + 
                               
                                 c 
                                  
                                 
                                     
                                 
                                  
                                 cos 
                                  
                                 
                                     
                                 
                                  
                                 θ 
                               
                             
                             ) 
                           
                         
                         + 
                         
                           column 
                           offset 
                         
                       
                     
                     ] 
                   
                 
               
               - 
               
                 
                   I 
                   template 
                 
                  
                 
                   [ 
                   
                     r 
                     , 
                     c 
                   
                   ] 
                 
               
             
           
         
       
     
         [0041]    If color is considered, the illumination is made up of the color components. For example, in the RGB color reference frame 
         [0000]    
       
         
           
             
               J 
                
               
                 ( 
                 
                   p 
                   _ 
                 
                 ) 
               
             
             = 
             
               
                 ∑ 
                 
                   r 
                   = 
                   0 
                 
                 
                   
                     R 
                     template 
                   
                   - 
                   1 
                 
               
                
               
                   
               
                
               
                 
                   ∑ 
                   
                     c 
                     = 
                     0 
                   
                   
                     
                       C 
                       template 
                     
                     - 
                     1 
                   
                 
                  
                 
                     
                 
                  
                 
                   
                     
                       
                         ɛ 
                         _ 
                       
                       ( 
                       
                         
                           p 
                           _ 
                         
                         , 
                         r 
                         , 
                         c 
                       
                       ) 
                     
                     T 
                   
                    
                   
                     
                       W 
                        
                       
                           
                       
                        
                       ɛ 
                     
                     _ 
                   
                    
                   
                     ( 
                     
                       
                         p 
                         _ 
                       
                       , 
                       r 
                       , 
                       c 
                     
                     ) 
                   
                 
               
             
           
         
       
       
         
           
             
               p 
               _ 
             
             = 
             
               
                 [ 
                 
                   
                     λ 
                     R 
                   
                    
                   
                       
                   
                    
                   
                     λ 
                     G 
                   
                    
                   
                       
                   
                    
                   
                     λ 
                     B 
                   
                    
                   
                       
                   
                    
                   
                     s 
                     scale 
                   
                    
                   
                       
                   
                    
                   
                     row 
                     offset 
                   
                    
                   
                       
                   
                    
                   
                     column 
                     offset 
                   
                    
                   
                       
                   
                    
                   θ 
                 
                 ] 
               
               T 
             
           
         
       
       
         
           
             
               
                 ɛ 
                 _ 
               
               ( 
               
                 
                   p 
                   _ 
                 
                 , 
                 r 
                 , 
                 c 
               
               ) 
             
             = 
             
               [ 
               
                 
                   
                     
                       
                         
                           λ 
                           R 
                         
                          
                         
                           
                             R 
                             image 
                           
                            
                           
                             [ 
                             
                               
                                 
                                   
                                     
                                       
                                         
                                           s 
                                           scale 
                                         
                                          
                                         
                                           ( 
                                           
                                             
                                               r 
                                                
                                               
                                                   
                                               
                                                
                                               cos 
                                                
                                               
                                                   
                                               
                                                
                                               θ 
                                             
                                             + 
                                             
                                               c 
                                                
                                               
                                                   
                                               
                                                
                                               sin 
                                                
                                               
                                                   
                                               
                                                
                                               θ 
                                             
                                           
                                           ) 
                                         
                                       
                                       + 
                                       
                                         row 
                                         offset 
                                       
                                     
                                     , 
                                     
                                       s 
                                       scale 
                                     
                                   
                                 
                               
                               
                                 
                                   
                                     
                                       ( 
                                       
                                         
                                           
                                             - 
                                             r 
                                           
                                            
                                           
                                               
                                           
                                            
                                           sin 
                                            
                                           
                                               
                                           
                                            
                                           θ 
                                         
                                         + 
                                         
                                           c 
                                            
                                           
                                               
                                           
                                            
                                           cos 
                                            
                                           
                                               
                                           
                                            
                                           θ 
                                         
                                       
                                       ) 
                                     
                                     + 
                                     
                                       column 
                                       offset 
                                     
                                   
                                 
                               
                             
                             ] 
                           
                         
                       
                       - 
                       
                         
                           R 
                           template 
                         
                          
                         
                           [ 
                           
                             r 
                             , 
                             c 
                           
                           ] 
                         
                       
                     
                   
                 
                 
                   
                     
                       
                         
                           λ 
                           G 
                         
                          
                         
                           
                             G 
                             image 
                           
                            
                           
                             [ 
                             
                               
                                 
                                   
                                     
                                       
                                         
                                           s 
                                           scale 
                                         
                                          
                                         
                                           ( 
                                           
                                             
                                               r 
                                                
                                               
                                                   
                                               
                                                
                                               cos 
                                                
                                               
                                                   
                                               
                                                
                                               θ 
                                             
                                             + 
                                             
                                               c 
                                                
                                               
                                                   
                                               
                                                
                                               sin 
                                                
                                               
                                                   
                                               
                                                
                                               θ 
                                             
                                           
                                           ) 
                                         
                                       
                                       + 
                                       
                                         row 
                                         offset 
                                       
                                     
                                     , 
                                     
                                       s 
                                       scale 
                                     
                                   
                                 
                               
                               
                                 
                                   
                                     
                                       ( 
                                       
                                         
                                           
                                             - 
                                             r 
                                           
                                            
                                           
                                               
                                           
                                            
                                           sin 
                                            
                                           
                                               
                                           
                                            
                                           θ 
                                         
                                         + 
                                         
                                           c 
                                            
                                           
                                               
                                           
                                            
                                           cos 
                                            
                                           
                                               
                                           
                                            
                                           θ 
                                         
                                       
                                       ) 
                                     
                                     + 
                                     
                                       column 
                                       offset 
                                     
                                   
                                 
                               
                             
                             ] 
                           
                         
                       
                       - 
                       
                         
                           G 
                           template 
                         
                          
                         
                           [ 
                           
                             r 
                             , 
                             c 
                           
                           ] 
                         
                       
                     
                   
                 
                 
                   
                     
                       
                         
                           λ 
                           B 
                         
                          
                         
                           
                             B 
                             image 
                           
                            
                           
                             [ 
                             
                               
                                 
                                   
                                     
                                       
                                         
                                           s 
                                           scale 
                                         
                                          
                                         
                                           ( 
                                           
                                             
                                               r 
                                                
                                               
                                                   
                                               
                                                
                                               cos 
                                                
                                               
                                                   
                                               
                                                
                                               θ 
                                             
                                             + 
                                             
                                               c 
                                                
                                               
                                                   
                                               
                                                
                                               sin 
                                                
                                               
                                                   
                                               
                                                
                                               θ 
                                             
                                           
                                           ) 
                                         
                                       
                                       + 
                                       
                                         row 
                                         offset 
                                       
                                     
                                     , 
                                     
                                       s 
                                       scale 
                                     
                                   
                                 
                               
                               
                                 
                                   
                                     
                                       ( 
                                       
                                         
                                           
                                             - 
                                             r 
                                           
                                            
                                           
                                               
                                           
                                            
                                           sin 
                                            
                                           
                                               
                                           
                                            
                                           θ 
                                         
                                         + 
                                         
                                           c 
                                            
                                           
                                               
                                           
                                            
                                           cos 
                                            
                                           
                                               
                                           
                                            
                                           θ 
                                         
                                       
                                       ) 
                                     
                                     + 
                                     
                                       column 
                                       offset 
                                     
                                   
                                 
                               
                             
                             ] 
                           
                         
                       
                       - 
                       
                         
                           B 
                           template 
                         
                          
                         
                           [ 
                           
                             r 
                             , 
                             c 
                           
                           ] 
                         
                       
                     
                   
                 
               
               ] 
             
           
         
       
     
         [0000]    where each of the R, G, and B components has an associated intensity and W is a 3×3 weighting matrix assigning the relevance of the various elements of ε. For equal weighting, W is the identity matrix. The variation of color components in the segmented image as compared to the template is mitigated by considering the closest match between the components and does not require an absolute agreement. 
         [0042]    There are many standard approaches to select the unknown constant vector p to minimize the square error function. Gradient and quasilinearization are two such methods. The gradient method begins with initial estimates of p and selects better estimates in the direction of the gradient of J(p): 
         [0000]        p   i+1   =p   i   −k∇   p   J ( p   i ) 
         [0000]    where ∇ p J(p i ) is the gradient of J(p) evaluated at p i  and k controls the step size. The gradient is determined by numerical perturbation 
         [0000]    
       
         
           
             
               
                 ∇ 
                 v 
               
                
               
                 J 
                  
                 
                   ( 
                   
                     
                       p 
                       _ 
                     
                     i 
                   
                   ) 
                 
               
             
             ≈ 
             
               
                 
                   J 
                   ( 
                   
                     
                       p 
                       
                         1 
                         , 
                         i 
                       
                     
                     , 
                     … 
                      
                     
                         
                     
                     , 
                     
                       v 
                       + 
                       
                         Δ 
                          
                         
                             
                         
                          
                         v 
                       
                     
                     , 
                     … 
                   
                    
                   
                       
                   
                   ) 
                 
                 - 
                 
                   J 
                    
                   
                     ( 
                     
                       
                         p 
                         _ 
                       
                       i 
                     
                     ) 
                   
                 
               
               
                 Δ 
                  
                 
                     
                 
                  
                 v 
               
             
           
         
       
     
         [0043]    Quasilinearization begins by writing the anticipated value of J(p) as 
         [0000]    
       
         
           
             
               J 
               ( 
               
                 
                   
                     p 
                     _ 
                   
                   i 
                 
                 + 
                 
                   
                     Δ 
                      
                     
                         
                     
                      
                     p 
                   
                   _ 
                 
               
               ) 
             
             = 
             
               
                 ∑ 
                 
                   r 
                   = 
                   0 
                 
                 
                   
                     R 
                     template 
                   
                   - 
                   1 
                 
               
                
               
                   
               
                
               
                 
                   ∑ 
                   
                     c 
                     = 
                     0 
                   
                   
                     
                       C 
                       template 
                     
                     - 
                     1 
                   
                 
                  
                 
                     
                 
                  
                 
                   
                     
                       
                         ɛ 
                         _ 
                       
                       ( 
                       
                         
                           
                             
                               p 
                               _ 
                             
                             i 
                           
                           + 
                           
                             
                               Δ 
                                
                               
                                   
                               
                                
                               p 
                             
                             _ 
                           
                         
                         , 
                         r 
                         , 
                         c 
                       
                       ) 
                     
                     T 
                   
                    
                   
                     W 
                     _ 
                   
                    
                   
                     
                       ɛ 
                       _ 
                     
                     ( 
                     
                       
                         
                           
                             p 
                             _ 
                           
                           i 
                         
                         + 
                         
                           
                             Δ 
                              
                             
                                 
                             
                              
                             p 
                           
                           _ 
                         
                       
                       , 
                       r 
                       , 
                       c 
                     
                     ) 
                   
                 
               
             
           
         
       
       
         
           where 
         
       
       
         
           
             
               J 
               ( 
               
                 
                   
                     p 
                     _ 
                   
                   i 
                 
                 + 
                 
                   
                     Δ 
                      
                     
                         
                     
                      
                     p 
                   
                   _ 
                 
               
               ) 
             
             = 
             
               
                 ∑ 
                 
                   r 
                   = 
                   0 
                 
                 
                   
                     R 
                     template 
                   
                   - 
                   1 
                 
               
                
               
                   
               
                
               
                 
                   ∑ 
                   
                     c 
                     = 
                     0 
                   
                   
                     
                       C 
                       template 
                     
                     - 
                     1 
                   
                 
                  
                 
                     
                 
                  
                 
                   
                     
                       
                         ɛ 
                         _ 
                       
                       ( 
                       
                         
                           
                             
                               p 
                               _ 
                             
                             i 
                           
                           + 
                           
                             
                               Δ 
                                
                               
                                   
                               
                                
                               p 
                             
                             _ 
                           
                         
                         , 
                         r 
                         , 
                         c 
                       
                       ) 
                     
                     T 
                   
                    
                   
                     W 
                     _ 
                   
                    
                   
                     
                       ɛ 
                       _ 
                     
                     ( 
                     
                       
                         
                           
                             p 
                             _ 
                           
                           i 
                         
                         + 
                         
                           
                             Δ 
                              
                             
                                 
                             
                              
                             p 
                           
                           _ 
                         
                       
                       , 
                       r 
                       , 
                       c 
                     
                     ) 
                   
                 
               
             
           
         
       
     
         [0044]    Expanding in a Taylor series keeping only up to the 1 st  derivative 
         [0000]    
       
         
           
             
               
                 
                   
                     J 
                     ( 
                     
                       
                         
                           p 
                           _ 
                         
                         i 
                       
                       + 
                       
                         
                           Δ 
                            
                           
                               
                           
                            
                           p 
                         
                         _ 
                       
                     
                     ) 
                   
                   = 
                     
                    
                   
                     
                       ∑ 
                       
                         r 
                         = 
                         0 
                       
                       
                         
                           R 
                           template 
                         
                         - 
                         1 
                       
                     
                      
                     
                         
                     
                      
                     
                       
                         ∑ 
                         
                           c 
                           = 
                           0 
                         
                         
                           
                             C 
                             template 
                           
                           - 
                           1 
                         
                       
                        
                       
                           
                       
                        
                       
                         
                           
                             
                               ɛ 
                               _ 
                             
                             ( 
                             
                               
                                 
                                   
                                     p 
                                     _ 
                                   
                                   i 
                                 
                                 + 
                                 
                                   
                                     Δ 
                                      
                                     
                                         
                                     
                                      
                                     p 
                                   
                                   _ 
                                 
                               
                               , 
                               r 
                               , 
                               c 
                             
                             ) 
                           
                           T 
                         
                          
                         
                           W 
                           _ 
                         
                          
                         
                           
                             ɛ 
                             _ 
                           
                           ( 
                           
                             
                               
                                 
                                   p 
                                   _ 
                                 
                                 i 
                               
                               + 
                               
                                 
                                   Δ 
                                    
                                   
                                       
                                   
                                    
                                   p 
                                 
                                 _ 
                               
                             
                             , 
                             r 
                             , 
                             c 
                           
                           ) 
                         
                       
                     
                   
                 
               
             
             
               
                 
                   ≈ 
                     
                    
                   
                     
                       ∑ 
                       
                         r 
                         = 
                         0 
                       
                       
                         
                           R 
                           template 
                         
                         - 
                         1 
                       
                     
                      
                     
                         
                     
                      
                     
                       
                         ∑ 
                         
                           c 
                           = 
                           0 
                         
                         
                           
                             C 
                             template 
                           
                           - 
                           1 
                         
                       
                        
                       
                           
                       
                        
                       
                         
                           [ 
                           
                             
                               
                                 ɛ 
                                 _ 
                               
                               ( 
                               
                                 
                                   
                                     p 
                                     _ 
                                   
                                   i 
                                 
                                 , 
                                 r 
                                 , 
                                 c 
                               
                               ) 
                             
                             + 
                             
                               
                                 
                                   ∇ 
                                   
                                     p 
                                     _ 
                                   
                                 
                                  
                                 
                                   
                                     ɛ 
                                     _ 
                                   
                                   ( 
                                   
                                     
                                       
                                         p 
                                         _ 
                                       
                                       i 
                                     
                                     , 
                                     r 
                                     , 
                                     c 
                                   
                                   ) 
                                 
                               
                                
                               
                                 
                                   Δ 
                                    
                                   
                                       
                                   
                                    
                                   p 
                                 
                                 _ 
                               
                             
                           
                           ] 
                         
                         T 
                       
                     
                   
                 
               
             
             
               
                 
                     
                    
                   
                     
                       W 
                       _ 
                     
                      
                     
                       [ 
                       
                         
                           
                             ɛ 
                             _ 
                           
                           ( 
                           
                             
                               
                                 p 
                                 _ 
                               
                               i 
                             
                             , 
                             r 
                             , 
                             c 
                           
                           ) 
                         
                         + 
                         
                           
                             
                               ∇ 
                               
                                 p 
                                 _ 
                               
                             
                              
                             
                               
                                 ɛ 
                                 _ 
                               
                               ( 
                               
                                 
                                   
                                     p 
                                     _ 
                                   
                                   i 
                                 
                                 , 
                                 r 
                                 , 
                                 c 
                               
                               ) 
                             
                           
                            
                           
                             
                               Δ 
                                
                               
                                   
                               
                                
                               p 
                             
                             _ 
                           
                         
                       
                       ] 
                     
                   
                 
               
             
           
         
       
     
         [0045]    The error vector gradient is estimated as 
         [0000]    
       
         
           
             
               
                 ∇ 
                 
                   p 
                   _ 
                 
               
                
               
                 
                   ɛ 
                   _ 
                 
                 ( 
                 
                   
                     
                       p 
                       _ 
                     
                     i 
                   
                   , 
                   r 
                   , 
                   c 
                 
                 ) 
               
             
             = 
             
               [ 
               
                 
                   
                     ∇ 
                     
                       λ 
                        
                       
                           
                       
                        
                       R 
                     
                   
                    
                   
                     
                       ɛ 
                       _ 
                     
                     ( 
                     
                       
                         
                           p 
                           _ 
                         
                         i 
                       
                       , 
                       r 
                       , 
                       c 
                     
                     ) 
                   
                 
                  
                 
                     
                 
                  
                 … 
                  
                 
                     
                 
                  
                 
                   
                     ∇ 
                     θ 
                   
                    
                   
                     
                       ɛ 
                       _ 
                     
                     ( 
                     
                       
                         
                           p 
                           _ 
                         
                         i 
                       
                       , 
                       r 
                       , 
                       c 
                     
                     ) 
                   
                 
               
               ] 
             
           
         
       
       
         
           
             
               
                 ∇ 
                 v 
               
                
               
                 
                   ɛ 
                   _ 
                 
                 ( 
                 
                   
                     
                       p 
                       _ 
                     
                     i 
                   
                   , 
                   r 
                   , 
                   c 
                 
                 ) 
               
             
             ≈ 
             
               
                 
                   
                     ɛ 
                     _ 
                   
                    
                   
                       
                   
                    
                   
                     ( 
                     
                       
                         λ 
                         
                           R 
                           , 
                           i 
                         
                       
                       , 
                       … 
                        
                       
                           
                       
                       , 
                       
                         
                           v 
                           i 
                         
                         + 
                         
                           Δ 
                            
                           
                               
                           
                            
                           v 
                         
                       
                       , 
                       … 
                        
                       
                           
                       
                       , 
                       
                         θ 
                         i 
                       
                       , 
                       r 
                       , 
                       c 
                     
                     ) 
                   
                 
                 - 
                 
                   
                     ɛ 
                     _ 
                   
                   ( 
                   
                     
                       
                         p 
                         _ 
                       
                       i 
                     
                     , 
                     r 
                     , 
                     c 
                   
                   ) 
                 
               
               
                 Δ 
                  
                 
                     
                 
                  
                 v 
               
             
           
         
       
     
         [0046]    The J is minimized when its gradient is zero: 
         [0000]    
       
         
           
             
               
                 ∇ 
                 
                   
                     Δ 
                      
                     
                         
                     
                      
                     p 
                   
                   _ 
                 
               
                
               
                 J 
                 ( 
                 
                   
                     
                       p 
                       _ 
                     
                     i 
                   
                   + 
                   
                     
                       Δ 
                        
                       
                           
                       
                        
                       p 
                     
                     _ 
                   
                 
                 ) 
               
             
             ≈ 
             
               
                 - 
                 2 
               
                
               
                 
                   ∑ 
                   
                     r 
                     = 
                     0 
                   
                   
                     
                       R 
                       template 
                     
                     - 
                     1 
                   
                 
                  
                 
                     
                 
                  
                 
                   
                     ∑ 
                     
                       c 
                       = 
                       0 
                     
                     
                       
                         C 
                         template 
                       
                       - 
                       1 
                     
                   
                    
                   
                       
                   
                    
                   
                     
                       
                         
                           
                             [ 
                             
                               
                                 
                                   ɛ 
                                   _ 
                                 
                                 ( 
                                 
                                   
                                     
                                       p 
                                       _ 
                                     
                                     i 
                                   
                                   , 
                                   r 
                                   , 
                                   c 
                                 
                                 ) 
                               
                               + 
                               
                                 
                                   
                                     ∇ 
                                     
                                       p 
                                       _ 
                                     
                                   
                                    
                                   
                                     
                                       ɛ 
                                       _ 
                                     
                                     ( 
                                     
                                       
                                         
                                           p 
                                           _ 
                                         
                                         i 
                                       
                                       , 
                                       r 
                                       , 
                                       c 
                                     
                                     ) 
                                   
                                 
                                  
                                 
                                   
                                     Δ 
                                      
                                     
                                         
                                     
                                      
                                     p 
                                   
                                   _ 
                                 
                               
                             
                             ] 
                           
                           T 
                         
                       
                     
                     
                       
                         
                           
                             
                               W 
                               _ 
                             
                             [ 
                             
                                 
                             
                              
                             
                               
                                 ∇ 
                                 
                                   p 
                                   _ 
                                 
                               
                                
                               
                                 
                                   ɛ 
                                   _ 
                                 
                                 ( 
                                 
                                   
                                     
                                       p 
                                       _ 
                                     
                                     i 
                                   
                                   , 
                                   r 
                                   , 
                                   c 
                                 
                                 ) 
                               
                             
                             ] 
                           
                           = 
                           
                             0 
                             _ 
                           
                         
                       
                     
                   
                 
               
             
           
         
       
     
         [0000]    forming the iterative equation 
         [0000]    
       
         
           
             
               
                 Δ 
                  
                 
                     
                 
                  
                 p 
               
               _ 
             
             = 
             
               
                 - 
                 
                   
                     { 
                     
                       
                         ∑ 
                         
                           r 
                           = 
                           0 
                         
                         
                           
                             R 
                             template 
                           
                           - 
                           1 
                         
                       
                        
                       
                           
                       
                        
                       
                         
                           ∑ 
                           
                             c 
                             = 
                             0 
                           
                           
                             
                               C 
                               template 
                             
                             - 
                             1 
                           
                         
                          
                         
                             
                         
                          
                         
                           
                             
                               [ 
                               
                                 
                                   ∇ 
                                   
                                     p 
                                     _ 
                                   
                                 
                                  
                                 
                                   
                                     ɛ 
                                     _ 
                                   
                                   ( 
                                   
                                     
                                       
                                         p 
                                         _ 
                                       
                                       i 
                                     
                                     , 
                                     r 
                                     , 
                                     c 
                                   
                                   ) 
                                 
                               
                               ] 
                             
                             T 
                           
                            
                           
                             W 
                             _ 
                           
                            
                           
                             
                               ∇ 
                               p 
                             
                              
                             
                               
                                 ɛ 
                                 _ 
                               
                               ( 
                               
                                 
                                   
                                     p 
                                     _ 
                                   
                                   i 
                                 
                                 , 
                                 r 
                                 , 
                                 c 
                               
                               ) 
                             
                           
                         
                       
                     
                     } 
                   
                   
                     - 
                     1 
                   
                 
               
                
               
                 
                   ∑ 
                   
                     r 
                     = 
                     0 
                   
                   
                     
                       R 
                       template 
                     
                     - 
                     1 
                   
                 
                  
                 
                     
                 
                  
                 
                   
                     ∑ 
                     
                       c 
                       = 
                       0 
                     
                     
                       
                         C 
                         template 
                       
                       - 
                       1 
                     
                   
                    
                   
                       
                   
                    
                   
                     { 
                     
                       
                         
                           [ 
                           
                             
                               ∇ 
                               
                                 p 
                                 _ 
                               
                             
                              
                             
                               
                                 ɛ 
                                 _ 
                               
                               ( 
                               
                                 
                                   
                                     p 
                                     _ 
                                   
                                   i 
                                 
                                 , 
                                 r 
                                 , 
                                 c 
                               
                               ) 
                             
                           
                           ] 
                         
                         T 
                       
                        
                       
                         W 
                         _ 
                       
                        
                       
                         
                           ɛ 
                           _ 
                         
                         ( 
                         
                           
                             
                               p 
                               _ 
                             
                             i 
                           
                           , 
                           r 
                           , 
                           c 
                         
                         ) 
                       
                     
                     } 
                   
                 
               
             
           
         
       
       
         
           
             
               
                 p 
                 _ 
               
               
                 i 
                 + 
                 1 
               
             
             = 
             
               
                 
                   p 
                   _ 
                 
                 i 
               
               + 
               
                 
                   Δ 
                    
                   
                       
                   
                    
                   p 
                 
                 _ 
               
             
           
         
       
     
         [0047]    The key to efficiently minimize the J functional is to start with a good estimate of p. For example:
       intensity factor λ for each color considered are initialized as the ratio between the average intensity of the color in the segmented image to the average intensity of the color in the template image;   size scale factor s scale  is initialized as the square root of the ratio of the pixel area of the segmented image to that of the template image;   offsets are initialized to the origin of the segmented image; and   rotation angle is initialized to zero.       
 
         [0052]    For this purpose, certain statistical measures of the template image, used as initialization parameters  51 , are included with the template database information  39  such as:
       average intensity of each color in the template image;   pixel area of the template image       
 
         [0055]    Having curve fit the best fit parameter vector {circumflex over (p)}, the correlation between the resulting best fit to the template is determined in order to compare this template curve fit to those of other templates in the database. For each color considered, the correlation between the segmented image and the template is 
         [0000]    
       
         
           
             
               r 
               P 
               2 
             
             = 
             
               
                 
                   ∑ 
                   
                     r 
                     = 
                     0 
                   
                   
                     
                       R 
                       template 
                     
                     - 
                     1 
                   
                 
                  
                 
                     
                 
                  
                 
                   
                     ∑ 
                     
                       c 
                       = 
                       0 
                     
                     
                       
                         C 
                         template 
                       
                       - 
                       1 
                     
                   
                    
                   
                       
                   
                    
                   
                     
                       
                         
                           [ 
                           
                             
                               
                                 Π 
                                 image 
                               
                               ( 
                               
                                 
                                   
                                     p 
                                     ^ 
                                   
                                   _ 
                                 
                                 , 
                                 c 
                                 , 
                                 r 
                               
                               ) 
                             
                             - 
                             
                               
                                 
                                   Π 
                                   _ 
                                 
                                 image 
                               
                                
                               
                                 ( 
                                 
                                   
                                     p 
                                     _ 
                                   
                                   ^ 
                                 
                                 ) 
                               
                             
                           
                           ] 
                         
                       
                     
                     
                       
                         
                           [ 
                           
                             
                               
                                 P 
                                 template 
                               
                               ( 
                               
                                   
                               
                                
                               
                                 c 
                                 , 
                                 r 
                               
                               ) 
                             
                             - 
                             
                               
                                 P 
                                 _ 
                               
                               template 
                             
                           
                           ] 
                         
                       
                     
                   
                 
               
               
                 
                   
                     
                       
                         
                           ∑ 
                           
                             r 
                             = 
                             0 
                           
                           
                             
                               R 
                               template 
                             
                             - 
                             1 
                           
                         
                          
                         
                             
                         
                          
                         
                           
                             ∑ 
                             
                               c 
                               = 
                               0 
                             
                             
                               
                                 C 
                                 template 
                               
                               - 
                               1 
                             
                           
                            
                           
                               
                           
                            
                           
                             
                               [ 
                               
                                 
                                   
                                     Π 
                                     image 
                                   
                                   ( 
                                   
                                     
                                       
                                         p 
                                         ^ 
                                       
                                       _ 
                                     
                                     , 
                                     c 
                                     , 
                                     r 
                                   
                                   ) 
                                 
                                 - 
                                 
                                   
                                     
                                       Π 
                                       _ 
                                     
                                     image 
                                   
                                    
                                   
                                     ( 
                                     
                                       
                                         p 
                                         ^ 
                                       
                                       _ 
                                     
                                     ) 
                                   
                                 
                               
                               ] 
                             
                             2 
                           
                         
                       
                     
                   
                   
                     
                       
                         
                           ∑ 
                           
                             r 
                             = 
                             0 
                           
                           
                             
                               R 
                               template 
                             
                             - 
                             1 
                           
                         
                          
                         
                             
                         
                          
                         
                           
                             ∑ 
                             
                               c 
                               = 
                               0 
                             
                             
                               
                                 C 
                                 template 
                               
                               - 
                               1 
                             
                           
                            
                           
                               
                           
                            
                           
                             
                               [ 
                               
                                 
                                   
                                     P 
                                     template 
                                   
                                    
                                   
                                     ( 
                                     
                                       c 
                                       , 
                                       r 
                                     
                                     ) 
                                   
                                 
                                 - 
                                 
                                   
                                     P 
                                     _ 
                                   
                                   template 
                                 
                               
                               ] 
                             
                             2 
                           
                         
                       
                     
                   
                 
               
             
           
         
       
       
         
           
             
               
                 Π 
                 image 
               
               ( 
               
                 
                   
                     p 
                     ^ 
                   
                   _ 
                 
                 , 
                 c 
                 , 
                 r 
               
               ) 
             
             = 
             
               
                 
                   λ 
                   ^ 
                 
                 P 
               
                
               
                 
                   P 
                   image 
                 
                  
                 
                   [ 
                   
                     
                       
                         
                           
                             
                               
                                 
                                   s 
                                   ^ 
                                 
                                 scale 
                               
                               ( 
                               
                                 
                                   r 
                                    
                                   
                                       
                                   
                                    
                                   cos 
                                    
                                   
                                       
                                   
                                    
                                   
                                     θ 
                                     ^ 
                                   
                                 
                                 + 
                                 
                                   c 
                                    
                                   
                                       
                                   
                                    
                                   sin 
                                    
                                   
                                       
                                   
                                    
                                   
                                     θ 
                                     ^ 
                                   
                                 
                               
                               ) 
                             
                             + 
                             
                               
                                 row 
                                 ^ 
                               
                               offset 
                             
                           
                           , 
                           
                             
                               s 
                               ^ 
                             
                             scale 
                           
                         
                       
                     
                     
                       
                         
                           
                             ( 
                             
                               
                                 
                                   - 
                                   r 
                                 
                                  
                                 
                                     
                                 
                                  
                                 sin 
                                  
                                 
                                     
                                 
                                  
                                 
                                   θ 
                                   ^ 
                                 
                               
                               + 
                               
                                 c 
                                  
                                 
                                     
                                 
                                  
                                 cos 
                                  
                                 
                                     
                                 
                                  
                                 
                                   θ 
                                   ^ 
                                 
                               
                             
                             ) 
                           
                           + 
                           
                             
                               column 
                               ^ 
                             
                             offset 
                           
                         
                       
                     
                   
                   ] 
                 
               
             
           
         
       
     
         [0000]    where P is R or G or B depending on the color being considered, and  Γ  is the average value of Γ. The average values of the template  P   template  and the sum 
         [0000]    
       
         
           
             
               ∑ 
               
                 r 
                 = 
                 0 
               
               
                 
                   R 
                   template 
                 
                 - 
                 1 
               
             
              
             
                 
             
              
             
               
                 ∑ 
                 
                   c 
                   = 
                   0 
                 
                 
                   
                     C 
                     template 
                   
                   - 
                   1 
                 
               
                
               
                   
               
                
               
                 
                   [ 
                   
                     
                       
                         P 
                         template 
                       
                        
                       
                         ( 
                         
                           c 
                           , 
                           r 
                         
                         ) 
                       
                     
                     - 
                     
                       
                         P 
                         _ 
                       
                       template 
                     
                   
                   ] 
                 
                 2 
               
             
           
         
       
     
         [0000]    are included  51  in the database information  39 . When color is considered, the combined correlation among all the colors in the image is 
         [0000]    
       
         
           
             
               r 
               2 
             
             = 
             
               
                 
                   [ 
                   
                     
                       r 
                       R 
                       2 
                     
                      
                     
                         
                     
                      
                     
                       r 
                       G 
                       2 
                     
                      
                     
                         
                     
                      
                     
                       r 
                       B 
                       2 
                     
                   
                   ] 
                 
                 T 
               
                
               
                 W 
                 _ 
               
                
               
                 ⌊ 
                 
                   
                     
                       
                         r 
                         R 
                         2 
                       
                     
                   
                   
                     
                       
                         r 
                         G 
                         2 
                       
                     
                   
                   
                     
                       
                         r 
                         B 
                         2 
                       
                     
                   
                 
                 ⌋ 
               
             
           
         
       
     
         [0056]    The segmented image is compared to all pre-screened  41  templates in the database and the comparison with the greatest r 2  correlation is chosen as the closest template match. If the r 2  correlation exceeds a minimal threshold, the object recognition is accepted. 
         [0057]    Table 1 illustrates the object recognition process. The segmented image of a black/white 25 mph speed sign is compared to template images of a 25 mph sign, a 35 mph sign, and a 45 mph sign. As can be seen, with each curve fitting interation the functional J is reduced causing the r 2  correlation to increase. The recognition of a 25 mph sign is resolved by its correlation being greater than for the mph and 45 mph templates. 
         [0000]    
       
         
               
             
               
               
               
               
               
               
               
             
               
             
               
               
               
               
               
               
               
             
               
             
               
               
               
               
               
               
               
             
               
             
               
               
               
               
               
               
               
             
           
               
                 TABLE 1 
               
             
             
               
                   
               
               
                 recognition example 
               
             
          
           
               
                 J 
                 r 2   
                 s scale   
                 λ illum   
                 column offset   
                 row offset   
                 Iteration 
               
               
                   
               
             
          
           
               
                 25 mph-segmented sign vs. 25 mph template 
               
             
          
           
               
                 14721 
                 0.792 
                 0.674 
                 1.002 
                 0.023 
                 0.312 
                 initialization 
               
               
                 12314 
                 0.832 
                 0.673 
                 1.000 
                 −1.168 
                 0.926 
                 1 
               
             
          
           
               
                 25 mph-segmented sign vs. 35 mph template 
               
             
          
           
               
                 59875 
                 0.634 
                 0.639 
                 1.391 
                 0.255 
                 0.100 
                 initialization 
               
               
                 56235 
                 0.656 
                 0.644 
                 1.457 
                 −0.989 
                 0.080 
                 2 
               
               
                 51472 
                 0.689 
                 0.637 
                 1.419 
                 −0.414 
                 1.093 
                 4 
               
               
                 48877 
                 0.703 
                 0.620 
                 1.460 
                 −0.145 
                 1.804 
                 7 
               
               
                 45741 
                 0.725 
                 0.611 
                 1.454 
                 0.282 
                 1.636 
                 8 
               
               
                 41850 
                 0.750 
                 0.575 
                 1.518 
                 1.181 
                 3.449 
                 12  
               
             
          
           
               
                 25 mph-segmented sign vs. 45 mph template 
               
             
          
           
               
                 226223 
                 0.412 
                 0.808 
                 2.113 
                 0.373 
                 −0.130 
                 initialization 
               
               
                 206954 
                 0.482 
                 0.782 
                 2.109 
                 0.153 
                 −0.777 
                 2 
               
               
                 196263 
                 0.518 
                 0.790 
                 2.065 
                 −0.211 
                 0.206 
                 4 
               
               
                 195482 
                 0.378 
                 0.797 
                 2.062 
                 −0.696 
                 −0.494 
                 5 
               
               
                   
               
             
          
         
       
     
         [0058]    Experience with this procedure has emphasized the value of using the blurred pixelized acquired images versus using ‘cleaned up’ versions with, for example, edge detection. The pixel blurring provides gradient information that aids the convergence of the curve fitting process. 
         [0059]    RESPONSE TO RECOGNITION: Having recognized an object of interest by finding a pre-screened template with sufficient correlation to the segmented image, the identity of that object of interest is reported  13  to the vehicle controller  15 . The vehicle controller acts on the information by alerting  19  the driver or altering the operation of the vehicle subsystems  17 . For example, detection a speed sign indicating a speed limit, while the vehicle controller  15  speed sensor indicates the vehicle is exceeding this limit, causes an excessive speed warning being display to the driver; an extreme excess causes the vehicle controller to apply the brakes. 
         [0060]    Although the embodiments described herein have focused on road signs for illustrative purposes, the same approach is adapted for recognizing other objects within and without the vehicle. 
         [0061]    Given the disclosure of the present invention, one versed in the art would appreciate that there may be other embodiments and modifications within the scope and spirit of the invention. Accordingly, all modifications attainable by one versed in the art from the present disclosure within the scope and spirit of the present invention are to be included as further embodiments of the present invention.