title: Ð Ð°Ð·ÑÐ°Ð±Ð¾ÑÐºÐ° Ð¼Ð¾Ð´ÑÐ»Ñ ÑÐ°ÑÐ¿Ð¾Ð·Ð½Ð°Ð²Ð°Ð½Ð¸Ñ ÑÐ¸Ð¿Ð¾Ð² Ð¸ ÑÐµÐºÐ²Ð¸Ð·Ð¸ÑÐ¾Ð² Ð´Ð¾ÐºÑÐ¼ÐµÐ½ÑÐ¾Ð², Ð¿ÑÐµÐ´Ð¾ÑÑÐ°Ð²Ð»ÑÐµÐ¼ÑÑ Ð·Ð°ÑÐ²Ð¸ÑÐµÐ»ÑÐ¼Ð¸ Ð² ÑÐ°Ð¼ÐºÐ°Ñ Ð¿ÑÐµÐ´Ð¾ÑÑÐ°Ð²Ð»ÐµÐ½Ð¸Ñ Ð³Ð¾ÑÑÐ´Ð°ÑÑÑÐ²ÐµÐ½Ð½ÑÑ Ð¸ Ð¼ÑÐ½Ð¸ÑÐ¸Ð¿Ð°Ð»ÑÐ½ÑÑ ÑÑÐ»ÑÐ³
title: Ð²ÑÐ¿ÑÑÐºÐ½Ð°Ñ ÐºÐ²Ð°Ð»Ð¸ÑÐ¸ÐºÐ°ÑÐ¸Ð¾Ð½Ð½Ð°Ñ ÑÐ°Ð±Ð¾ÑÐ° Ð±Ð°ÐºÐ°Ð»Ð°Ð²ÑÐ°
titleType: Subtitle
title: Development of a module for type and details recognition of user documents for system of state and municipal services
Creators: name: ÐÐ¾ÑÐµÐ½ÐºÐ¾Ð², ÐÐ¸ÑÐ°Ð¸Ð»
Publisher: name: Ð¡Ð°Ð½ÐºÑ-ÐÐµÑÐµÑÐ±ÑÑÐ³ÑÐºÐ¸Ð¹ Ð¿Ð¾Ð»Ð¸ÑÐµÑÐ½Ð¸ÑÐµÑÐºÐ¸Ð¹ ÑÐ½Ð¸Ð²ÐµÑÑÐ¸ÑÐµÑ ÐÐµÑÑÐ° ÐÐµÐ»Ð¸ÐºÐ¾Ð³Ð¾
Year: 2020
Subjects: ÐºÐ»Ð°ÑÑÐ¸ÑÐ¸ÐºÐ°ÑÐ¸Ñ Ð¸Ð·Ð¾Ð±ÑÐ°Ð¶ÐµÐ½Ð¸Ð¹
Ð¾Ð±ÑÐ°Ð±Ð¾ÑÐºÐ° Ð¸Ð·Ð¾Ð±ÑÐ°Ð¶ÐµÐ½Ð¸Ð¹
ÑÐ°ÑÐ¿Ð¾Ð·Ð½Ð°Ð²Ð°Ð½Ð¸Ðµ ÑÐµÐºÐ²Ð¸Ð·Ð¸ÑÐ¾Ð² Ð´Ð¾ÐºÑÐ¼ÐµÐ½ÑÐ¾Ð²
Ð²ÑÐ´ÐµÐ»ÐµÐ½Ð¸Ðµ Ð³ÑÐ°Ð½Ð¸Ñ
ÑÐ°ÑÐ¿Ð¾Ð·Ð½Ð°Ð²Ð°Ð½Ð¸Ðµ ÑÐµÐºÑÑÐ°
ÑÐ²ÐµÑÑÐ¾ÑÐ½ÑÐµ Ð½ÐµÐ¹ÑÐ¾Ð½Ð½ÑÐµ ÑÐµÑÐ¸
Ð¾Ð±ÑÑÐµÐ½Ð¸Ðµ Ñ Ð¿ÐµÑÐµÐ½Ð¾ÑÐ¾Ð¼
image classification
image processing
document text recognition
bounds detection
character recognition
convolutional neural networks
transfer-learning

description: Ð¢ÐµÐ¼Ð° Ð²ÑÐ¿ÑÑÐºÐ½Ð¾Ð¹ ÐºÐ²Ð°Ð»Ð¸ÑÐ¸ÐºÐ°ÑÐ¸Ð¾Ð½Ð½Ð¾Ð¹ ÑÐ°Ð±Ð¾ÑÑ: Â«Ð Ð°Ð·ÑÐ°Ð±Ð¾ÑÐºÐ° Ð¼Ð¾Ð´ÑÐ»Ñ ÑÐ°ÑÐ¿Ð¾Ð·Ð½Ð°Ð²Ð°Ð½Ð¸Ñ ÑÐ¸Ð¿Ð¾Ð² Ð¸ ÑÐµÐºÐ²Ð¸Ð·Ð¸ÑÐ¾Ð² Ð´Ð¾ÐºÑÐ¼ÐµÐ½ÑÐ¾Ð², Ð¿ÑÐµÐ´Ð¾ÑÑÐ°Ð²Ð»ÑÐµÐ¼ÑÑ Ð·Ð°ÑÐ²Ð¸ÑÐµÐ»ÑÐ¼Ð¸ Ð² ÑÐ°Ð¼ÐºÐ°Ñ Ð¿ÑÐµÐ´Ð¾ÑÑÐ°Ð²Ð»ÐµÐ½Ð¸Ñ Ð³Ð¾ÑÑÐ´Ð°ÑÑÑÐ²ÐµÐ½Ð½ÑÑ Ð¸ Ð¼ÑÐ½Ð¸ÑÐ¸Ð¿Ð°Ð»ÑÐ½ÑÑ ÑÑÐ»ÑÐ³Â».
ÐÐ°Ð½Ð½Ð°Ñ ÑÐ°Ð±Ð¾ÑÐ° Ð¿Ð¾ÑÐ²ÑÑÐµÐ½Ð° ÑÐµÑÐµÐ½Ð¸Ñ Ð·Ð°Ð´Ð°ÑÐ¸ ÐºÐ»Ð°ÑÑÐ¸ÑÐ¸ÐºÐ°ÑÐ¸Ð¸ Ð¸Ð·Ð¾Ð±ÑÐ°Ð¶ÐµÐ½Ð¸Ð¹ Ð¾ÑÑÐºÐ°Ð½Ð¸ÑÐ¾Ð²Ð°Ð½Ð½ÑÑ Ð´Ð¾ÐºÑÐ¼ÐµÐ½ÑÐ¾Ð² Ð¸ ÑÐ°ÑÐ¿Ð¾Ð·Ð½Ð°Ð²Ð°Ð½Ð¸Ñ ÑÐµÐºÐ²Ð¸Ð·Ð¸ÑÐ¾Ð² Ð½ÐµÐºÐ¾ÑÐ¾ÑÑÑ ÑÐ¸Ð¿Ð¾Ð² Ð´Ð¾ÐºÑÐ¼ÐµÐ½ÑÐ¾Ð². ÐÐ°Ð½Ð½ÑÑ ÑÐ¸ÑÑÐµÐ¼Ñ Ð² Ð±ÑÐ´ÑÑÐµÐ¼ Ð¿ÑÐµÐ´Ð¿Ð¾Ð»Ð°Ð³Ð°ÐµÑÑÑ Ð¸ÑÐ¿Ð¾Ð»ÑÐ·Ð¾Ð²Ð°ÑÑ ÐºÐ°Ðº Ð¼Ð¾Ð´ÑÐ»Ñ Ð±Ð¾Ð»ÐµÐµ ÐºÑÑÐ¿Ð½Ð¾Ð¹ ÑÐ¸ÑÑÐµÐ¼Ñ Ð´Ð»Ñ Ð¼Ð¾Ð´ÐµÑÐ½Ð¸Ð·Ð°ÑÐ¸Ð¸ Ð¿Ð¾Ð»ÑÐ·Ð¾Ð²Ð°ÑÐµÐ»ÑÑÐºÐ¾Ð³Ð¾ Ð¸Ð½ÑÐµÑÑÐµÐ¹ÑÐ° Ð³Ð¾ÑÐ¾Ð´ÑÐºÐ¸Ñ Ð¸ ÑÐµÐ³Ð¸Ð¾Ð½Ð°Ð»ÑÐ½ÑÑ Ð¿Ð¾ÑÑÐ°Ð»Ð¾Ð² Ð³Ð¾ÑÑÐ´Ð°ÑÑÑÐ²ÐµÐ½Ð½ÑÑ ÑÑÐ»ÑÐ³. Ð¡Ð¸ÑÑÐµÐ¼Ð° Ð¿ÑÐ¸Ð·Ð²Ð°Ð½Ð° Ð¾Ð±ÐµÑÐ¿ÐµÑÐ¸ÑÑ Ð¿Ð¾Ð»ÑÐ·Ð¾Ð²Ð°ÑÐµÐ»Ñ Ð¸Ð½ÑÐ¾ÑÐ¼Ð°ÑÐ¸ÐµÐ¹ Ð¾ Ð½ÐµÐºÐ¾ÑÑÐµÐºÑÐ½Ð¾Ð¼ ÑÐ¸Ð¿Ðµ Ð¿ÑÐ¸Ð»Ð¾Ð¶ÐµÐ½Ð½Ð¾Ð³Ð¾ Ð´Ð¾ÐºÑÐ¼ÐµÐ½ÑÐ°, Ð° ÑÐ°ÐºÐ¶Ðµ Ð¿Ð¾Ð¼Ð¾ÑÑ Ð·Ð°Ð¿Ð¾Ð»Ð½Ð¸ÑÑ Ð¿Ð¾Ð»Ñ Ð°Ð½ÐºÐµÑÑ, ÑÐ²ÑÐ·Ð°Ð½Ð½ÑÐµ Ñ Ð¾Ð¿ÑÐµÐ´ÐµÐ»ÐµÐ½Ð½ÑÐ¼Ð¸ Ð¿ÑÐ¸Ð»Ð¾Ð¶ÐµÐ½Ð½ÑÐ¼Ð¸ ÐºÐ¾Ð¿Ð¸ÑÐ¼Ð¸ Ð´Ð¾ÐºÑÐ¼ÐµÐ½ÑÐ¾Ð². Ð ÑÐ°Ð¼ÐºÐ°Ñ ÑÐ°Ð±Ð¾ÑÑ Ð±ÑÐ»Ð¸ Ð¸ÑÑÐ»ÐµÐ´Ð¾Ð²Ð°Ð½Ñ ÑÑÑÐµÑÑÐ²ÑÑÑÐ¸Ðµ ÑÐµÑÐµÐ½Ð¸Ñ, Ð° ÑÐ°ÐºÐ¶Ðµ Ð¿ÑÐ¾Ð°Ð½Ð°Ð»Ð¸Ð·Ð¸ÑÐ¾Ð²Ð°Ð½Ñ ÑÐµÑÐ½Ð¾Ð»Ð¾Ð³Ð¸Ð¸ ÑÐ°Ð·ÑÐ°Ð±Ð¾ÑÐºÐ¸ Ð¿Ð¾Ð´Ð¾Ð±Ð½ÑÑ ÑÐ¸ÑÑÐµÐ¼. ÐÐ° Ð¾ÑÐ½Ð¾Ð²Ðµ Ð°Ð½Ð°Ð»Ð¸Ð·Ð° Ð±ÑÐ»Ð° ÑÐ°Ð·ÑÐ°Ð±Ð¾ÑÐ°Ð½Ð° ÑÐ¾Ð±ÑÑÐ²ÐµÐ½Ð½Ð°Ñ ÑÐ¸ÑÑÐµÐ¼Ð°, ÑÐ¾ÑÑÐ¾ÑÑÐ°Ñ Ð¸Ð· Ð¼Ð¾Ð´ÑÐ»ÐµÐ¹ ÐºÐ»Ð°ÑÑÐ¸ÑÐ¸ÐºÐ°ÑÐ¸Ð¸, Ð²ÑÐ´ÐµÐ»ÐµÐ½Ð¸Ñ Ð³ÑÐ°Ð½Ð¸Ñ Ð¸ ÑÐ°ÑÐ¿Ð¾Ð·Ð½Ð°Ð²Ð°Ð½Ð¸Ñ ÑÐµÐºÐ²Ð¸Ð·Ð¸ÑÐ¾Ð² Ð´Ð¾ÐºÑÐ¼ÐµÐ½ÑÐ° Ð½Ð° Ð¸Ð·Ð¾Ð±ÑÐ°Ð¶ÐµÐ½Ð¸Ð¸. ÐÐ»Ñ ÐºÐ°Ð¶Ð´Ð¾Ð¹ Ð¸Ð· Ð·Ð°Ð´Ð°Ñ Ð±ÑÐ» Ð¿ÑÐ¾Ð´ÐµÐ¼Ð¾Ð½ÑÑÑÐ¸ÑÐ¾Ð²Ð°Ð½ Ð¿ÑÐ¾ÑÐµÑÑ ÑÐ°Ð·ÑÐ°Ð±Ð¾ÑÐºÐ¸, Ð¾Ð±Ð¾ÑÐ½Ð¾Ð²Ð°Ð½Ð¾ Ð¸ÑÐ¿Ð¾Ð»ÑÐ·Ð¾Ð²Ð°Ð½Ð¸Ðµ ÑÐµÑ Ð¸Ð»Ð¸ Ð¸Ð½ÑÑ Ð°Ð»Ð³Ð¾ÑÐ¸ÑÐ¼Ð¾Ð² Ð¸ Ð¿ÑÐ¸ÐµÐ¼Ð¾Ð². 
ÐÑÐ»Ð¾ Ð¿ÑÐ¾Ð²ÐµÐ´ÐµÐ½Ð¾ ÑÐµÑÑÐ¸ÑÐ¾Ð²Ð°Ð½Ð¸Ðµ ÑÐ°Ð·ÑÐ°Ð±Ð¾ÑÐ°Ð½Ð½Ð¾Ð¹ ÑÐ¸ÑÑÐµÐ¼Ñ, Ð¿Ð¾Ð»ÑÑÐµÐ½Ð° Ð¾ÑÐµÐ½ÐºÐ° ÑÐ¾ÑÐ½Ð¾ÑÑÐ¸ ÐµÐµ ÑÐ°Ð±Ð¾ÑÑ. ÐÑÑÐ¾Ð´Ñ Ð¸Ð· ÑÐµÐ·ÑÐ»ÑÑÐ°ÑÐ¾Ð² ÑÐµÑÑÐ¸ÑÐ¾Ð²Ð°Ð½Ð¸Ñ Ð±ÑÐ»Ð¸ Ð²ÑÑÐ²Ð»ÐµÐ½Ñ Ð½ÐµÐ´Ð¾ÑÑÐ°ÑÐºÐ¸ Ð¸ ÑÐ¿Ð¾ÑÐ¾Ð±Ñ Ð¼Ð¾Ð´Ð¸ÑÐ¸ÐºÐ°ÑÐ¸Ð¸ ÑÐµÑ Ð¸Ð»Ð¸ Ð¸Ð½ÑÑ ÐºÐ¾Ð¼Ð¿Ð¾Ð½ÐµÐ½ÑÐ¾Ð² ÑÐ¸ÑÑÐµÐ¼Ñ.
description: The subject of the graduate qualification work is âDevelopment of a module for type and details recognition of user documents for system of state and municipal servicesâ.
The work is devoted to solving the problem of scanned documents images classification and details recognition for certain types of documents. In the future, this system is supposed to be used as a module of a larger system for modernizing the user interface of city and regional public services systems. The system is designed to provide the information for user about the incorrect type of the attached document, as well as to help with filling out the associated fields in the questionnaire. As part of the work, existing solutions were investigated, and the technology for developing similar systems was also analyzed. Based on this analysis, we developed our own system, which consists of modules for classifying, borders detection, and recognizing the details of a document in an image. For each of the tasks, the process of development was demonstrated, the use of certain algorithms and techniques was justified.
The developed system was tested, and the accuracy of the system was estimated. Based on the test results, shortcomings, and methods for modifying certain components of the system were identified.