License Plate Recognition From Still Images and Video Sequences: A Survey

License plate recognition (LPR) algorithms in images or videos are generally composed of the following three processing steps: 1) extraction of a license plate region; 2) segmentation of the plate characters; and 3) recognition of each character. This task is quite challenging due to the diversity of plate formats and the nonuniform outdoor illumination conditions during image acquisition. Therefore, most approaches work only under restricted conditions such as fixed illumination, limited vehicle speed, designated routes, and stationary backgrounds. Numerous techniques have been developed for LPR in still images or video sequences, and the purpose of this paper is to categorize and assess them. Issues such as processing time, computational power, and recognition rate are also addressed, when available. Finally, this paper offers to researchers a link to a public image database to define a common reference point for LPR algorithmic assessment. References [1] Martin, F., Garcia, M., Alba, J.L. New methods for automatic reading of VLP's (Vehicle License Plates) (2002) Proc. IASTED Int. Conf. SPPRA, [2] Hongliang, B., Changping, L. A hybrid license plate extraction method based on edge statistics and morphology (2004) Proc. ICPR, pp. 831-834. [3] Zheng, D., Zhao, Y., Wang, J. An efficient method of license plate location (2005) Pattern Recognit. Lett, 26 (15), pp. 2431-2438. Nov [4] Wang, S., Lee, H. Detection and recognition of license plate characters with different appearences (2003) Proc. Conf. Intell. Transp. Syst, 2, pp. 979-984. [5] Lee, H.-J., Chen, S.-Y., Wang, S.-Z. Extraction and recognition of license plates of motorcycles and vehicles on highways (2004) Proc. ICPR, pp. 356-359. [6] Comelli, P., Ferragina, P., Granieri, M.N., Stabile, F. Optical recognition of motor vehicle license plates (1995) IEEE Trans. Veh. Technol, 44 (4), pp. 790-799. Nov [7] Shi, X., Zhao, W., Shen, Y. (2005) Automatic License Plate Recognition System Based on Color Image Processing, 3483, pp. 1159-1168. O. Gervasi et al, Ed. New York: Springer-Verlag [8] Kim, K.I., Jung, K., Kim, J.H. Color Texture-Based Object Detection: An Application to License Plate Localization, 2388, pp. 293-309. S.-W. Lee and A. Verri, Eds. New York: Springer-Verlag, pp [9] Zhong, Y., Jain, A.K. Object localization using color, texture and shape (2000) Pattern Recognit, 33 (4), pp. 671-684. Apr [10] Mirmehdi, M., Petrou, M. Segmentation of color textures (2000) IEEE Trans. Pattern Anal. Mach. Intell, 22 (2), pp. 142-159. Feb [11] Kim, K.I., Jung, K., Park, S.H., Kim, H.J. Support vector machines for texture classification (2002) IEEE Trans. Pattern Anal. Mach. Intell, 24 (11), pp. 1542-1550. Nov [12] Osuna, E., Freund, R., Girosi, F. Training support vector machines: An application to face detection (1997) Proc. IEEE Conf. CVPR, pp. 130-136. [13] San Juan, Puerto Rico, Bradski, G.R. Real time face and object tracking as a component of a perceptual user interface (1998) Proc. IEEE Workshop Appl. Comput. Vis, pp. 214-219. [14] Sarasota, FL, Draghici, S. A neural network based artificial vision system for license plate recognition (1997) Int. J. Neural Syst, 8 (1), pp. 113-126. Feb [15] Broumandnia, A., Fathy, M. Application of pattern recognition for Farsi license plate recognition (2005) Proc. Int. Conf. GVIP, Cairo, Egypt [16] Wang, T.-H., Ni, F.-C., Li, K.-T., Chen, Y.-P. Robust license plate recognition based on dynamic projection warping (2004) Proc. IEEE Int. Conf. Netw., Sens. Control, pp. 784-788. [17] Cano, J., Perez-Cortes, J.C. (2003) Vehicle License Plate Segmentation in Natural Images, 2652, pp. 142-149. F. J. Perales etal, Eds. New York: Springer-Verlag [18] Zimic, N., Ficzko, J., Mraz, M., Virant, J. The fuzzy logic approach to the car number plate locating problem (1997) Proc. IIS, pp. 227-230. Grand Bahama Island, The Bahamas [19] Nijhuis, J.A.G., ter Brugge, M.H., Helmholt, K.A., Pluim, J.P.W., Spaanenburg, L., Venema, R.S., Westenberg, M.A. Car license plate recognition with neural networks and fuzzy logic (1995) Proc. IEEE Int. Conf. Neural Netw, 5, pp. 2232-2236. [20] Chang, S.-L., Chen, L.-S., Chung, Y.-C., Chen, S.-W. Automatic license plate recognition (2004) IEEE Trans. Intell. Transp. Syst, 5 (1), pp. 42-53. Mar [21] Kahraman, F., Kurt, B., Gökmen, M. (2003) License Plate Character Segmentation Based on the Gabor Transform and Vector Quantization, 2869, pp. 381-388. A. Yazici and C. Sener, Eds. New York: Springer-Verlag [22] Adorni, G., Cagnoni, S., Mordonini, M. Efficient low-level vision program design using sub-machine-code genetic programming (2002) Proc. Workshop sulla Percezione e Visione nelle Macchine, [23] Yoshimori, S., Mitsukura, Y., Fukumi, M., Akamatsu, N. (2003) License Plate Detection Using Hereditary Threshold Determine Method, 2773, pp. 585-593. V. Palade, R. J. Howlett, and L. C. Jain, Eds. New York: Springer-Verlag [24] Cui, Y., Huang, Q. Extracting characters of license plates from video sequences (1998) Mach. Vis. Appl, 10 (5-6), pp. 308-320. Apr [25] Duan, T.D., Du, T.L.H., Phuoc, T.V., Hoang, N.V. Building an automatic vehicle license-plate recognition system (2005) Proc. Int. Conf. Comput. Sci. (RIVF), pp. 59-63. [26] Hsieh, C.-T., Juan, Y.-S., Hung, K.-M. Multiple license plate detection for complex background (2005) Proc. Int Conf. AINA, 2, pp. 389-392. [27] Kim, D.-S., Chien, S.-I. Automatic car license plate extraction using modified generalized symmetry transform and image warping (2001) Proc. ISIE, pp. 2022-2027. [28] Dlagnekov, L. (2004) License Plate Detection Using AdaBoost, Mar, San Diego, CA: Comput. Sci. Eng. Dept, Univ. California, San Diego, Online, Available [29] ter Brugge, M.H., Stevens, J.H., Nijhuis, J.A.G., Spaanenburg, L. License plate recognition using DTCNNs (1998) Proc. IEEE Int. Workshop Cellular NNs Appl, pp. 212-217. [30] ter Brugge, M.H., Nijhuis, J.A.G., Spaanenburg, L. Transformational DT-CNN design from morphological specifications (1998) IEEE Trans. Circuits Syst. I, Fundam. Theory Appl, 45 (9), pp. 879-888. Sep [31] Chacon, M.I., Zimmerman, A. License plate location based on a dynamic PCNN scheme (2003) Proc. Int. Joint Conf. Neural Netw, 2, pp. 1195-1200. [32] Kim, K.K., Kim, K.I., Kim, J.B., Kim, H.J. Learning-based approach, for license plate recognition (2000) Proc. IEEE Signal Process. Soc. Workshop, NNs Signal Process, 2, pp. 614-623. [33] Zunino, R., Rovetta, S. Vector quantization for license-plate location and image coding (2000) IEEE Trans. Ind. Electron, 47 (1), pp. 159-167. Feb [34] Gray, R.M. Vector quantization (1984) IEEE ASSP Mag, 1 (2), pp. 4-29. Apr [35] Nasrabadi, N., King, R. Image coding using vector quantization: A review (1988) IEEE Trans. Commun, 36 (8), pp. 957-971. Aug [36] Ridella, S., Rovetta, S., Zunino, R. Plastic algorithm for adaptive vector quantization (1998) Neural Comput. Appl, 7 (1), pp. 37-51. Mar [37] Naito, T., Tsukada, T., Yamada, K., Kozuka, K., Yamamoto, S. Robust license-plate recognition method for passing vehicles under outside environment (2000) IEEE Trans. Veh. Technol, 49 (6), pp. 2309-2319. Nov [38] Otsu, N. A threshold selection method from gray-level histograms (1979) IEEE Trans. Syst., Man, Cybern, SMC-9 (1), pp. 62-66. Jan [39] Anagnostopoulos, C., Anagnostopoulos, I., Kayafas, E., Loumos, V. A license plate recognition system for intelligent transportation system applications (2006) IEEE Trans. Intell. Transp. Syst, 7 (3), pp. 377-392. Sep [40] Anagnostopoulos, C., Alexandropoulos, T., Boutas, S., Loumos, V., Kayafas, E. A template-guided approach to vehicle surveillance and access control (2005) Proc. IEEE Conf. Advanced Video Signal Based Surveillance, pp. 534-539. [41] Anagnostopoulos, C., Anagnostopoulos, I., Vergados, D., Kayafas, E., Loumos, V. Sliding windows: A software method for real-time inspection in textile surface (2004) Textile Res. J, 74 (7), pp. 646-651. Jul [42] Sauvola, J., Pietikäinen, M. Adaptive document image binarization (2000) Pattern Recognit, 33 (2), pp. 225-236. Feb [43] Cao, G., Chen, J., Jiang, J. An adaptive approach to vehicle license plate localization (2003) Proc. 29th Annu. Conf. IECON, pp. 1786-1791. [44] Yang, F., Ma, Z. Vehicle license plate location based on histogramming and mathematical morphology (2005) Proc. 4th IEEE Workshop Autom. Identification Advanced Technol, pp. 89-94. [45] Suryanarayana, P.V., Mitra, S.K., Baneree, A., Roy, A.K. A morphology based approach for car license plate extraction (2005) Proc. IEEE Indicon, pp. 24-27.Chennai, India, Dec [46] Xiong, J., Du, S., Gao, D., Shen, Q. Locating car license plate under various illumination conditions using genetic algorithm Proc. ICSP, pp. 2502-2505. [47] Kim, S.K., Kim, D.W., Kim, H.J. A recognition of vehicle license plate using a genetic algorithm based segmentation (1996) Proc. Int. Conf. Image Process, 1, pp. 661-664. Sep [48] Kamat, V., Ganesan, S. An efficient implementation of the Hough transform for detecting vehicle license plates using DSP'S (1995) Proc. Real-Time Technol. Appl. Symp, pp. 58-59. May 15-17 [49] Cheng, Y., Lu, J., Yahagi, T. Car license plate recognition based on the combination of principal component analysis and radial basis function networks Proc. ICSP, pp. 1455-1458. [50] Jung, C.R., Schramm, R. Rectangle detection based on a windowed Hough transform (2004) Proc. 17th SIBGRAPI, pp. 113-120. [51] Lee, E.R., Kim, P.K., Kim, H.J. Automatic recognition of a car license plate using color image processing (1994) Proc. IEEE ICIP, 2, pp. 301-305. Nov. 13-16 [52] Nomura, S., Yamanaka, K., Katai, O., Kawakami, H., Shiose, T. A novel adaptive morphological approach for degraded character image segmentation (2005) Pattern Recognit, 38 (11), pp. 1961-1975. Nov [53] Nomura, S., Yamanaka, K., Katai, O., Kawakami, H. A new method for degraded color image binarization based on adaptive lightning on grayscale versions (2004) IEICE Trans. Inf. Syst, E87-D (4), pp. 1012-1020. Apr [54] Soille, P. (1999) Morphol