Handwritten Amharic Character Recognition System Using Convolutional Neural Networks
Authors: Fetulhak Abdurahman
Venue:  (2020)
Keywords: Amharic
Handwritten
Character
Convolutional neural network
Recognition

Abstract: Amharic language is an official language of the federal government of the Federal Democratic Republic of Ethiopia. Accordingly, there is a bulk of handwritten Amharic documents available in libraries, information centres, museums, and offices. Digitization of these documents enables to harness already available language technologies to local information needs and developments. Converting these documents will have a lot of advantages including (i) to preserve and transfer history of the country (ii) to save storage space (ii) proper handling of documents (iv) enhance retrieval of information through internet and other applications. Handwritten Amharic character recognition system becomes a challenging task due to inconsistency of a writer, variability in writing styles of different writers, relatively large number of characters of the script, high interclass similarity, structural complexity and degradation of documents due to different reasons. In order to recognize handwritten Amharic character a novel method based on deep neural networks is used which has recently shown exceptional performance in various pattern recognition and machine learning applications, but has not been endeavoured for Ethiopic script. The CNN model is trained and tested our database that contains 132,500 datasets of handwritten Amharic characters. Common machine learning methods usually apply a combination of feature extractor and trainable classifier. The use of CNN leads to significant improvements across different machine-learning classification algorithms. Our proposed CNN model is giving an accuracy of 91.83% on training data and 90.47% on validation data.

HANDWRITTEN AMHARIC CHARACTER RECOGNI- TION SYSTEM USING CONVOLUTIONAL NEURAL
NETWORK
Abstract
Amharic language is an official language of the federal government of the Federal Democratic Republic of Ethiopia. Accordingly, there is bulk of handwritten Amharic documents available in libraries, infor- mation centres, museums, and offices. Digitization of these documents enables to harness already available language technologies to local in- formation needs and developments. Converting these documents will have a lot of advantages including (i) to preserve and transfer history of the country (ii) to save storage space (ii) proper handling of documents (iv) enhance retrieval of information through internet and other appli- cations. Handwritten Amharic character recognition system becomes a challenging task due to inconsistency of writer, variability in writ- ing styles of different writers, relatively large number characters of the script, high interclass similarity, structural complexity and degra- dation of documents due to different reasons. In order to recognize handwritten Amharic character novel method based deep neural networks is used which has recently shown exceptional performance in various pattern recognition and machine learning applications, but has not been endeavoured for Ethiopic script. The CNN model is trained and tested our database that contains 132,500 datasets of handwritten Amharic characters. Common machine learning methods usually apply a combination of feature extractor and trainable classifier. The use of CNN leads to significant improvements across different machine- learning classification algorithms. Our proposed CNN model giving an accuracy of 91.83% on training data and 90.47% on validation data.
1 Introduction
In recent years, there much interest in the area of handwritten documents recognition. Between the handwritten documents and printed documents, automatic handwritten document recognition is more challenging. Handwritten characters written by different persons are not identical and vary in both size and shape. Numerous variations in writ- ing styles of individual character make the recognition task difficult. The similarities in distinct character shapes, the overlaps, and the interconnections of the neighbouring characters further complicate the problem. Recognition is an area that covers various fields such as, face recognition, finger print recognition, image recognition, charac- ter recognition, numerals recognition, etc. Handwritten Character Recognition System Sarkhel et al. (2016) an intelligent system able to classify handwritten Characters as human see. There have been different methods that are used for offline handwritten document recognition. In the conventional methods with features engineered manually and using different classification algorithms to classify the characters based on the extracted features. On the other hand, deep learning algorithms such as convolutional neural networks are able to do the feature extraction by themselves from the raw images the handwritten document and classify characters on those features learned. Deep learning methods show better performance in different researchers work for handwritten recognition task. Among the deep learning methods convolutional neural networks, which is the one proposed for this research work, are the most commonly used algorithms. Deep Neural networks consist of input layer and multiple nonlinear hidden layers and output layer, the number of connections and trainable parameters are very large. The deep neural network needs very large set of examples to prevent over fitting. One class type of Deep Neural Network with comparatively smaller set of parameters and easier to train is Convolutional Neural Network (CNN) Liang et al.

---

(2016). CNN is multi-layer feed-forward neural network that extracts features and properties from the input data (images or sounds), CNN is trained with neural network back- propagation algorithm. CNN have the ability to learn from high-dimensional com- plex inputs, nonlinear mappings from very large number of data (images or sounds) Maitra et al. (2015). The advantage of CNN is that it automatically extracts the salient features which are invariant and a certain degree to shift and shape distortions of the input characters Shin et al. (20th). major advantage of CNN is the use of shared weight in convolutional layers, which means that the same filter is used for each input in the layer. The share weight reduces parameter number and improves pa performance [Bai et al. (2015a). Recently, Convolutional Neural Network (CNN) Lecun & Bengio (1995) is found efficient for handwritten character recognition due to its distinct features. CNNs add the new dimension for image classification systems and recognizing visual patterns directly from pixel images with minimal pre-processing. In addition, CNN automatically provides some degree of translation invariance. A CNN based model was tested on UNIPEN Guyon et al. (1994) English character dataset and found recognition rates of 93.7 percent and 90.2 percent for lowercase and up- percase characters, respectivelyyuan et al. (2012). Amharic language has its own alphabet which is significantly different from other alphabets such as Latin alphabet. Although the Ethiopic alphabet called Fidel has recently been standardized to have 435 characters. However the most commonly Ethiopic script used by Amharic has 265 characters including 27 labialized characters (characters representing two sounds) 2 7 t A. N. & & a. t x A x X h h- M. X & X 3 a m. 8. 4. 7o + X and 34 base characters with six orders representing derived vocal sounds of the base character, 21 symbols for numerals and 8 punctuation marks. There is no capital and lower case distinction. When we see the features of Amharic characters they have the following basic characteristics: Each symbol is written according to the sound it have when pronounced. Vowels are created by modifying the base characters in some form. The symbols are written in disconnected manner e.g U, U., Y, Y. The direction of writing the script is from left to right and top to bottom sequence. There is proportional space between characters and words. The Amharic language alphabet is conveniently written in a tabular form of seven columns as shown in Table 1 where each column corresponds to vocal sounds in the order of å, u, i, a, e, o, and o. Several handwritten scriptures and documents written in this language are available other material. Converting the handwritten documents into digital forms helps us to process, share and store them in electronic form. The conventional way of convert- ing the handwritten Amharic documents in to an electronic form, which is done by typing on the keyboard, is very time consuming, error prone and tedious. Due to the keyboard layout for Amharic characters which takes an average of two keystrokes to write one Amharic character, the conventional way of converting handwritten Amharic documents will be very difficult. This emphasizes the need for an automatic hand- written Amharic character recognition system which converts handwritten texts into machine-readable code that can be accepted by a computer for further processing. Amharic handwriting recognition is challenging due to mainly two reasons. First, it has huge number of symbols compared to that of the alphabet system. Second, most characters are very similar in shape. This is because of the minimal modification performed to get order of a character. For instance, 1l comes from ft, A comes from A and u+ comes from U Most core characters also show similarities to one another. One common feature is mark of palatalization which sets off palatal ăf from n, F from +, Ke from &, 'f from Y and so on. The interclass variability is even minimal in case of handwritings where mostly these modifications are forgotten or placed at a wrong position. Lack of standard way of writing aggravates the problem by increasing the intra-class variability. Nowadays, it is becoming increasingly important to have information in digital format for increased efficiency in data storage, retrieval and to make them available for users. Although a lot of work and research has been done for handwritten character recognition for other languages like English and Asian languages such as Japanese, Chinese and Korean, there is only a few research at- tempts at Amharic language. A few works has been reported in scientific literature related to the recognition of Amharic printed and handwritten document recognition. In Assabie & Bigün (2011) they develop recognition system for Ethiopic script using
paper or on any
2

---

direction field tensor mechanism. Their system is developed by extracting primitive structural features and their spatial relationship. Since there is no standard database for Ethiopic text they use thirty pages scanned image from newspaper, books and clean printouts. The achieved performance for their system 87%. They did not consider handwritten documents in their dataset. In Birhanu & Sethuraman (2015) they have used ANN approach for recognition of real life documents. They collected their dataset from 'Addis Zemen' newspaper, Amharic Bible, 'Federal NegaritGazeta' newspaper and the fiction 'FikerEskeMekabir. The performance of their system for a new test set is 11.40% which is not satisfactory and the proposed system is trained with printed documents rather than handwritten. In Meshesha & Jawahar (2007) they develop a system which uses principal component and linear discriminant analysis followed by a decision directed acyclic graph based support vector machine based classifier. Existing methods including those discussed above for Amharic document recognition systems, employ manually designed feature extractor and learned classifier and most of them use printed documents rather than handwritten. It is not easy to design an optimal feature extractor for a particular application. Hence, the performance of these algorithms is not satisfactory. Various methods have been proposed and high recognition rates are reported for the handwritten recognition of other languages. In Bai et al. (2015b) they propose shared- hiade---idde deep convolutional neural network (SHL-CNN) for image character recognition. In SHL-CNN, the hidden layers are made common across characters from different languages, performing a universal feature extraction process that aims at learning common character traits existed in different languages such as strokes, while the final softmax layer is made language dependent, trained based on characters from the destination language only. The effectiveness of the learned SHL-CNN is verified on both English and Chinese image character recog- nition tasks, showing that the SHL-CNN can reduce recognition errors by 16-30% relatively compared with models trained by characters of only one language using conventional CNN, and by 35.7% relatively compared with state-of-the-as methods. A modified LeNet-5 which is one of common CNN model with special settings of the number of neurons in each layer and the connecting way between some layers is proposed by Yuan et al. (012) for offline handwritten English character recognition. They used the UNIPEN lowercase and uppercase dataset in their experiments and at- tain recognition rate of 93.7% and 90.2% for uppercase and lowercase respectively. Authors in Wu et al.] (2014) proposed handwritten recognition method for Chinese character based relaxation convolutional neural network (R-CNN) and alternately trained relaxation convolutional neural network. The relaxation convolutional layer in their model, unlike the traditional convolution layer, does not require neurons within feature map to share the same convolutional kernel, endowing the neural network with more expressive power. Authors in Zhong et al. (2015a) applied multi-pooling and data augmentation with non-linear transformation to convolutional neural network (CNN) for multi-font printed Chinese character recognition (PCCR). They propose a multi-pooling layer on top of the final convolutional layer; this approach is found to be robust to spatial layout variations and deformations in multi-font printed Chinese characters. Outstanding recognition rate of 94.38% is achieved by combining the multi-pooling and data augmentation techniques and 99.74% by applying the multi- pooling and data augmentation techniques with non non-linear transformation jointly. In Yang et al. (2015) the authors proposed an enhancement of deep convolutional neural network for recognition of online handwritten Chinese character. The enhancement is done by incorporating a variety of domain specific knowledge, including deformation, non-linear normalization, imaginary strokes, path signature and 8-directional features. The contribution in this work is twofold. First the domain specific technologies are investigated and integrated with the deep convolutional neural network to form a composite network to achieve improved performance. Second, the resulting deep con- volutional neural networks with diversity in their domain knowledge are combined using a hybrid serial-parallel strategy. A promising accuracy of 97. 97.20% and 96.87% are achieved using CASIA-OLHWDBLI character respectively. In He et al. (2015) an effective method to analyze the recog- nition confidence of handwritten Chinese character based on softmax regression score of high performance convolutional network is studied. In Zhong et al. (2015b)
and CASIA-OLHWDBI.1 dataset for Chinese
3

---

authors proposed a deeper architecture of CNN algorithm by using streamlined version of GoogLeNet. They used the ICDAR 2013 offline Chinese character recognition system competition dataset. With incorporation of traditional directional feature maps the proposed GoogLeNet models achieve an accuracy of 96.35% and 96.74% as single and ensemble models respectively. A handwritten Hangul character recognition sys- tem using deep convolutional neural network by proposing several novel techniques to increase the performance and training speed of the networks is done by Kim & Xiel (2015). In Anii et al. (2015) Malayalam handwritten character recognition using the convolutional neural network is developed and in their work they discussed the CNN is better than the conventional handcrafted feature extractor based systems. Deep learning based large scale handwritten Devanagari character recognition is proposed by Acharya et al. (2015) with focus on the use of dropout and dataset increment approach to increase the test accuracy of their deep learning model. A combination of four dif- ferent pattern analysis techniques are used to develop a powerful and efficient system for handwritten Telgu character recognition system is proposed by Soman et al. (2013), Their system embodies convolutional neural networks, principal component analysis, support vector machines and multi-classifier systems. As compared to the handwrit- ten automated character recognition system discussed above the Amharic character recognition system is the least studied subject both in the conventional handcrafted feature extractor based systems as well as deep learning based convolutional neural networks. In the proposed method, both the feature extraction and classification tasks are done through learning from labelled data. This method overcomes the problems faced by the existing methods. Visual recognition system using convolutional neural networks Lecun et al. (1998) have shown a significant improvement in recent years. Record-breaking results have been obtained using these methods. This has motivated the researcher to investigate the success of the CNN algorithms on this challenging problem. Visual recognition using convolutional neural networks enables us to train the complete system from end to end.
2 Amharic Handwritten Character Recognition System
2.1 GENERAL ARCHITECTURE
The task of the recognition is done using convolution neural networks. The proposed system consists of two main components: pre-processing and segmentation unit, feature extraction and classification. Digitalization, noise removal, binarization, normalization belongs to the preprocessing step in the proposed system. In the segmentation step different segmentation methods are used such as line segmentation, word segmentation and character segmentation from the given scanned image of handwritten document to extract individual characters. The two essential components in recognition, feature extraction and classification, both are done in our CNN model.
2.2 ARCHITECTURE OF PROPOSED SYSTEM
In a convolutional neural network the input to a convolutional layer is M x M C image where image and C is number of channels per pixel. For gray scale image have one channel C == but RGB image have three channels C = layers (convolutional layers, pooling layers, fully connected layers). The convolutional layer will have K filters (kernels) of N x N x where N is height and width of filter (kernels) and R is the same number of image channels C or less and may vary for each filter (kernel). The filter (kernel) convolved with the image to produce K feature maps of size M-N 1. Each feature map is then pooled typically with mean max pooling over x q where q is range between 2 to 5 for large inputs. After the convolutional layers and pooling layers there may be any number of fully connected layers as in standard multi-layer neural network. Convolutional layer acts as a feature extractor that extracts salient features of the inputs such as corners, edges, endpoints. Then, the convolutional layer applies its activation function to add non
the height and width of the image, M X M is number of pixels in
CNN consists of a number of
4

---

linearity to its output. The activation function that is used in our proposed approach is Rectified Linear Units (ReLU). The ReLU non-linearity used as an activation function to the output of every convolutional layer and fully connected layer. The ReLU Nair & Hinton 2 increases the nonlinear properties of the decision function and of the overall network without affecting the receptive fields of the convolution layer EElaww ct (2017).
After each convolutional layer, there may be pooling layer. The pooling layer takes small rectangular blocks from the convolutional layer and subsamples it to produce a single output from that block. The pooling layer reduces the resolution of the image that reduces the precision of the translation (shift and distortion) effect. There are several ways to do this pooling, such taking the average the maximum, learned linear combination of the neurons in the block. Our pooling layers will always be maxpooling layers; that take the maximum of the block that they are pooling. All the max-pooling is carried out over a 2 x 2 pixel window [23].
Finally, after several convolutional and pooling layers, the high-level reasoning in the neural network is done via fully connected layers. fully connected layer takes all neurons in the previous layer (be it fully connected, pooling, or convolutional) and connects it to every single neuron it has. Fully connected layers are not spatially located anymore (you can visualize them as one-dimensional), so there can be no con- volutional layers after fully connected layer. Figure shown the proposed CNN archi- tecture for Amharic handwritten character recognition that describe as follow: INPUT-- >CONV~>RELU- - RELU- MAX
POOL--
SENV-->REUU--S MAX POOL-- CONV--- R POOL--> FC->RELU->> FC--> Softmax
Feature maps
Feature
Feature
feature
Feature naps
Festure maps 64ghh?
Festure maps 64B333
Feature maps 1253x
Festare 128ix1
#dden unts 1024
naps 64028<20
maps
naps
Oututs 265
64828x2
64914<14
64814414
648h7
cu
Cone 5a5 lame
Coru
Mar poel 2x2 kemel
Carv
Mux pool
Conw
May goel 2x2 kemel
Cary
Max Pool
Fuly connected
fuly annected
5a5 kemel
3x3 kemel
2x2 kamel
3x3 kemel
3x3 kemel
2x2 kemell
Input 28x28
Figure The proposed CNN architecture for Amharic handwritten character recognition.
The first and the second convolution layers have 64 filters of size 5x5, the next two conv layers have 64 filters with size 3x3 and the last conv layer has 32 filters with kernel size of 3x3. The second important layer in convolutional neural networks the pooling layer. This layer simply acts as a downsampling filter. After the second conv layer a max-pooling with 2x2 pixel window is used. After this polling layer we have conv---- > max pool layers with 3x3 kernel size for the convolution layer and 2x2 pixel window for the pooling layer. The size of the convolution filters are initialized based on experimental results. Experimentally select filter sizes for each conv layer by seeing the performance improvement of the network during training and validation. After each convolution layer the RELU activation function is used. The rectifier activation function is used to add non linearity to the network. The Flatten layer is use convert the final feature map, which is an output from the last max pooling layer, into a one single 1D vector. This flattening step is needed so that you can make use of fully connected layers after some convolutional/maxpaa layers. In the end the features in two fully-connected (Dense) layers which is just artificial neural networks (ANN) classifier is used. In the last fully connected layer (Dense(265, activation = "softmax")) the net outputs distribution of probability of each

---

class. Dropout is a regularization method, where proportion of nodes in the layer are randomly ignored (setting their weights to zero) for each training sample. This drops randomly a proportion of the network and forces the network to learn features in a distributed way. This technique also improves generalization and reduces the problem of overfitting. A dropout of 0.5 at the last fully connected layer is used. The RMSprop optimizer to update filter weights and improve algorithm functionality is used. The default setting of this optimizer since it is recommended to use the default setting in the documentation is used. Batch size of 70 and run the network for 70 epochs is used. The batch size and the number of epochs are selected based on the best performance measurement values of the proposed CNN network during experimental set up. Python programming language with keras deep learning library with theano backend on CPU was used during the development of the convolutional neural network architecture. Image processing libraries designed for python such as numpy, opencv2, skyimage used for processing the input image for the conv net.
2.3 ARCHITECTURE OF PROPOSED SYSTEM
In research like character recognition for handwritten documents using deep neural networks, the primary task is collecting required data and preparing it for further processing. The Amharic character benchmark dataset is still not available for the research community in public and this was the major challenge during this research work. Since the research is dealing with pattern recognition, or more specifically character recognition, the data collected are of two types. The first being data for training the convolutional neural network (recognition engine), the second will be for testing the performance of the CNN model. The Amharic Handwritten Character dataset used in our system is created by collecting the variety of handwritten Amharic characters from hand writings of different individuals from diverse fields. 500 dataset for each character were collected and having (500x265) 132,500 datasets in total. The data was collected from 250 persons who write each character 2 times in a white paper. The selected individuals can write the Amharic alphabet randomly with different educational background and different age ranges. Each individual wrote each character on the forms shown in figure 2. We divided this dataset in two groups: 20 percent for validation/ testing and the remaining for training our system. Handwritten documents are then scanned with 332 dpi Samsung galaxy note 4 CamScanner mobile application and cropped for individual characters with size of 28 28 pixels and pre-processed before feeding it to the CNN using semi-automated algorithm. The collected data was labelled based on the 265 classes for each character by using integer values to 264 for each class of the character. The disadvantage of convolutional neural network is its rapacious appetite for labelled training data. Hence, real-world data collection and applying image pre-processing methods are needed to make the system more robust and efficient. A large handwritten character dataset have been collected in our work and labelled to train well to evaluate the system performance compared with other researcher works for Amharic character recognition system.
2.4 CHALLENGES IN AMIARICC CHARACTER RECOGNITION
The challenges in handwritten character recognition vary among different languages due to distinct shape, strokes and numbers of characters. In Amharic script there are characters which have similar structure which differs with each other with little curve, line and strokes and this becomes even more challenging since such structural variations are forgotten during handwriting. Some examples of two different characters written similarly are shown in figure 3. The other big challenge is unavailability of public datasets to use for such recognition systems which needs large amount of data to be trained.

---

R
(b) Form B
(a) Form A
Figure 2: Data collection forms for Amharic characters
R
4
R
&
4
J
T
a
0
7
0
4
4
4-
7
T
Figure 3: Different characters written similarly.
3 Findings and Discussion
In this section, the performance of the CNN architecture was investigated for training and validating Amharic character recognition system. ConvNets have a large set of Syper-parameters and finding the perfect configuration for your problem domain is challenge. Different configurations of the proposed network were explored and attempted optimize the parameters based on the validation and training set accuracy. The performance of our recognition system was evaluated by using the collected dataset discussed earlier. From the collected dataset 20% (26,500) for validation and 80% (106,000) for training the proposed convolutional neural network architecture discussed earlier was used. The training and validation datasets are evenly distributed over the underlying 265 classes. In experimental set data augmentation was used to increase the number of training dataset to avoid overfitting. The performance of our proposed system was checked with and without data augmentation and training with data augmentation shows better performance result. By changing different parameter values such epoch size, batch size, optimizer selection, dropout and the layers of the network until the best fit model is found. In this section the results of experiments are presented. Based experimental analysis, the CNN architecture discussed earlier is used for the proposed Amharic handwritten character recognition system. We perform different conv, max pool and FC layer configuration and observe the training and validation accuracy for given CNN layer configuration to select the best depth of the proposed CNN. We selected the CNN layer configuration with the best performance result for our training and validation dataset. Then we improve the performance of

---

the selected CNN architecture by tuning other parameters of the network. The other network parameter we change it during our experimental analysis was the batch size selection. Table 1 illustrates an experiment conducted to observe the effect of batch size on the performance of the proposed CNN model with varying the batch size and using RMSprop optimizer with learning rate of 0.001. Using this experiment batch size of 70 selected which gives better accuracy. For the other experiments we use 70 for batch size and tune other parameters to get improved performance.
Table 1: Accuracy with varying batch size using RMSprop optimizer and 20 epochs
Batch size
Training acc.
Validation acc.
Training loss
Validation loss
60
86.7%
88.7%
0.45
0.4
65
87.2%
88.8%
0.42
0.4
70
87.4%
89.4%
0.42
0.38
75
86%
89%
0.46
0.4
80
86%
88%
0.46
0.42
85
86%
88.5%
0.45
0.41
90
86%
88.1%
0.47
0.42
The other parameter which has an effect on the performance of our proposed model the optimizer selection. Optimizers and they have their own behaviors. For our proposed model the RMSprop optimizer gives better results compared with stochastic gradient decent and Adam optimizer. Increasing the epoch size from 20 to 30 we get better results with 89.99% for training accuracy and 90.19% for validation accuracy. The training loss reduces from 3.80 0.32 and the validation loss reduces from 1.96 to 0.36. With 40 epochs the training accuracy is 90.40% and validation accuracy 90.37%. The training loss decreases from 3.80 to 0.31 and validation loss decreases from 1.96 to 0.35.Increasing the epoch size to 70 increases the training accuracy to 91.83% and the validation accuracy to 90.47%. We have get a little increase in the validation accuracy which means still the CNN model is improving its performance on test sets. The training loss decreases from 3.87 to 0.27 and the validation loss decreases from 1.87 to 0.36. Increasing the epoch size above 70 increases the processing time of the system. Due to this we take 70 epoch size for our final model. Therefore batch size respectively. The graphs in figure 4 show the accuracy and loss of training and validation respectively with 70 epochs and 70 batch size.
used for weight update of the network
are using 70 both for epoch and
train acc vs val.
loss
4.0
30
3.0
0.5
3.0
0.3
train
val
01
mam Spocth
(a)
(b)
Figure 4: (a) validation vs training accuracy (b) validation vs training loss
4 Conclusion and Recommendation
In this research we use convolutional neural networks for recognition of Amharic handwritten characters with 265 character classes. It well known that convolutional neural networks are the current state of the art algorithm for classifying image data.

---

We have collected large amount of Amharic characters from individual handwriting on prepared form for data collection. The collected handwritten document is scanned and pre-processed to get a 28 x 28 jpg character images which are given as input to the convolutional neural network for classification. We presented new public dataset for Amharic character dataset which is publicly available for any researcher and access it through contact address of the author. We developed a deep learning based Amharic handwritten character recognition system. To get the best fit model of CNN based architecture a lot of trial and error network configuration tuning mechanism has been used. Using the developed CNN model we have achieved better recognition accuracy compared with other research works based on conventional hand craft feature extraction based methods. We have achieved accuracy of 91.83% 90.47% on validation dataset. Even though there are a lot of work for recognition of handwritten characters for English, Chinese, Arabic and some other Indian languages only little work is done for Amharic language. The previous research works did not use deep learning methods for Amharic character recognition. Due lack of research works on the area there is big challenge to get dataset for Amharic language. In this research we develop a dataset which can be used by other researchers in the future. By increasing the size of the collected dataset and proposing new deep learning algorithms we will increase the performance the system. In the future, we want to extend this algorithm for recognition of Amharic words by creating new datasets.
training dataset and
References
Shailesh Acharya, Ashok Pant, and Prashnna Gyawali. Deep learning based large scale handwritten devanagari character recognition. pp. 1--6, 12 2015. doi: 10.1109/
SKTMA.2005..400041
R. Anil, Manjusha, Sachin Kumar, and K. P. Soman. Convolutional neural networks for the recognition of malayalam characters. In Suresh Chandra Satapathy, Bhabendra Narayan Biswal, Siba K. Udgata, and K. Mandal (eds.), Proceedings of the 3rd International Conference on Frontiers of Intelligent Computing: Theory and Applications (FICTA) 2014, pp. 493-5500, Cham, 2015. Springer International Publishing. ISBN 178-3-319-12012-4
Yaregal Assabie and Josef Bigün. Offline handwritten amharic word recognition. Pattern Recognition Letters, 32:1089-1099 06 2011. doi:
Jinfeng Bai, Zhineng Chen, Bailan Feng, and Bo Xu. Image character recognition using deep convolutional neural network learned from different languages. 2014 IEEE International Conference on Image Processing, ICIP 2014, pp. 2560--2644, 01
2015a. doi: 10.1109/ICIP 2.....20....5..1..
Jinfeng Bai, Zhineng Chen, Bailan Feng, and Bo Xu. Image character recognition using deep convolutional neural network learned from different languages. 2014 4 IEEE International Conference on Image Processing, ICIP 2014, pp. 2560--2564, 01
2015b. doi: 10.1109/ICIP 200.TCCIPP.011.72555551
Abay Teshager Birhanu and Ramanathan Sethuraman. Artificial neural network ap- proach to the development of ocr for real life amharic documents. 2015.
Ahmed Elsawy, Mohamed Loey, and Hazem El-Bakry. Arabic handwritten charac- ters recognition using convolutional neural network. WSEAS TRANSACTIONS on COMPUTER RESEARCH, 5:11--19, 01 2017.
Isabelle Guyon, Lambert Schomaker, Réjean Plamondon, Mark Liberman, and Stan Janet. Unipen project of on-line data exchange and recognizer benchmarks. Pro- ceedings of the 12th IAPR International Conference on Pattern Recognition, Vol. 3 Conference C: Signal Processing (Cat. No.94CH3440-5), 2:29--33 vol.2, 1994.
Meijun He, Shuye Zhang, Huiyun Mao, and Lianwen Jin. Recognition confidence analysis of handwritten chinese character with cnn. In Proceedings of the 2015 13th

---

doi: 10100//CCAA.2015...... International Conference on Document Analysis and Recognition (ICDAR), ICDAR '15, pp. 61-65,, Washington, DC, USA, 2015. IEEE Computer Society. ISBN 978-1- 4799-1805-8, doi: 10.1109/ICDARR.01155 281.78777... URL http://dxx doi org/10...1.... 1109/
ICDAR. 7333726.
In-Jung Kim and Xiaohui Xie. Handwritten hangul recognition using deep convo- lutional neural networks. Int. J. Doc. Anal. Recognit., 18(1):1--13, March 2015. ISSN 1433-2833, doi:
-10-002--1---2----- URL hhttp://dx htt//xxxoii.... org/0000111... 1007/
810032-014-0229-4
Yann Lecun and Yoshua Bengio. Pattern recognition and neural networks, MIT Press, 1995.
Yann Lecun, Léon Bottou, Yoshua Bengio, and Patrick Haffner. Gradient-based learning applied to document recognition. In Proceedings of the IEEE, pp. 2278-2324, 1998.
Yudong Liang, Jinjun Wang, Sanping Zhou, Yihong Gong, and Nanning Zheng. In- corporating image priors with deep convolutional neural networks for image super- resolution. Neurocomput., 194(C):340-344, June 2016. ISSN 0925-2312. doi: 10. [ttp:i/neeccmm.216.022..0
URL https: https://doi.oor//00 1016/j newcom. www.eeewww..........o 22016.02.000 02.0
Durjoy Sen Maitra, Ujjwal Bhattacharya, and Swapan K. Parui. Cnn based common approach to handwritten character recognition of multiple scripts. In Proceedings of the 2015 13th International Conference Document Analysis and Recognition (ICDAR), ICDAR '15, pp. 1021--1225, Washington, DC, USA, 2015. IEEE Computer URL http:
Society. ISBN 1119//10AARARRA 2010: 7333993 //dx. orgo/rr////
Million Meshesha and C. Jawahar. Optical character recognition of amharic documents. African J. Inf. Commun. Technology, 3, 08 2007. doi: 10.5130/ 101130//jict.vo. ajict.v3i2.544.
Vinod Nair and Geoffrey E. Hinton. Rectified linear units improve restricted boltzmann machines. In Proceedings of the 27th International Conference on International Con- ference on Machine Learning, ICML'10, pp. 807--844, USA, 2010. Omnipress. ISBN 978-1-60558-907-7. URL http://al acm
cfm21d-3104322. 3104445
Ritesh Sarkhel, Nibaran Das, Amit Saha, and Mita Nasipuri. multi-objective approach towards cost effective isolated handwritten bangla character and digit recognition. Pattern Recognition, 58, 04 2016. doi: 10.1016/j.patcom 20t.pa........04........ 2016.04.010.
Hoo-chang Shin, Holger Roth, Mingchen Gao, Le Lu, Ziyue Xu, Isabella Nogues, Jianhua Yao, Daniel Mollura, and Ronald Summers. Deep convolutional neural networks for computer-aided detection: Cnn architectures, dataset characteristics and transfer learning. IEEE Transactions on Medical Imaging, 35, 02 2016. doi: TTL109/TM..001..55222
Soumya Soman, Asha Kranthi Nandigam, and Srinivasa Chakravarthy. An efficient multiclassifier system based on convolutional neural network for offline handwritten telugu character recognition. pp. 1--5, 02 2013. ISBN 978-1-4673-5950-4. doi: 10.1009/NCC.2013..65588
Chunpeng Wu, Wei Fan, Yuan He, Jun Sun, and Satoshi Naoi. Handwritten character recognition by alternately trained relaxation convolutional neural network. 2014 14th International Conference on Frontiers in Handwriting Recognition, pp. 291--296, 2014.
Weixin Yang, Lianwen Jin, Zecheng Xie, and Ziyong Feng. Improved deep convolutional neural network for online handwritten chinese character recognition using domain- specific knowledge. In Proceedings of the 2015 13th International Conference on Document Analysis and Recognition (ICDAR), ICDAR '15, pp. 551--555, Washington, DC, USA, 2015. IEEE Computer Society. ISBN 978-1-4799- 1805-88 doi: 10.1109/ CCDAR.2015.733822 URL http://dx doi org/10
2015. 7333822
10

---

Aiquan Yuan, Gang Bai, Lijing Jiao, and Yajie Liu. Offline handwritten english character recognition based on convolutional neural network. In Proceedings of the 2012 10th IAPR International Workshop on Document Analysis Systems, DAS '12, pp. 125--129, Washington, DC, USA, 2012. IEEE Computer Society. ISBN 178-0-7695-466 -2. doi: 10.1109/DAS.2012..11. URL http://dx.doi..rg doi. org/ 1109/DAS. 2012. 61
Zhuoyao Zhong, Lianwen Jin, and Ziyong Feng. Multi-font printed chinese character recognition using multi-pooling convolutional neural network. 2015 13th Interna- tional Conference on Document Analysis and Recognition (ICDAR), pp. 96--100, 2015a.
Zhuoyao Zhong, Lianwen Jin, and Zecheng Xie. High performance offline handwrit- ten chinese character recognition using googlenet and directional feature maps. In Proceedings of the 2015 13th International Conference on Document Analysis and Recognition (ICDAR), ICDAR '15, pp. 846--50,, Washington, DC, USA, 2015b. IEEE Computer Society. ISBN 978-1-4799-1805-88 org/ wtt.://............0............ 2015.
doi: 20.1009/CDDAR.21155338338 URL


Reviews:
[{"review_id": "HkerBE8aYB", "reviewer": "AnonReviewer2", "summary": "", "questions": "", "limitations": "", "rating": 1, "confidence": null, "soundness": null, "presentation": null, "contribution": null, "strengths": "", "weaknesses": "", "quality": null, "clarity": null, "significance": null, "originality": null, "strengths_and_weaknesses": "", "was_revised": false, "final_justification": "", "rebuttal": "", "claims_and_evidence": "", "methods_and_evaluation_criteria": "", "theoretical_claims": "", "experimental_designs_or_analyses": "", "relation_to_broader_scientific_literature": "", "essential_references_not_discussed": "", "other_strengths_and_weaknesses": "", "other_comments_or_suggestions": "", "questions_for_authors": "", "summary_of_paper": "", "summary_of_recommendation": "", "technical_quality": "", "clarity_of_presentation": "", "potential_impact": "", "robotics_focus": "", "quality_of_limitations": "", "questions_for_rebuttal": "", "reasons_to_accept": "", "reasons_to_reject": "", "questions_to_authors": "", "main_review": "", "summary_of_the_paper": "", "summary_of_the_review": "", "strength_and_weaknesses": "", "limitations_and_societal_impact": "", "review_text": "In this paper, the authors collect and preprocess a large amount of handwritten Amharic characters and train a deep convolutional network to successfully perform character recognition on a subset of the data.\n\nI vote to reject this paper. The formatting of the paper needs work, and the work is not substantially novel.\n\nFor some reason, many sections of the paper were ill-formatted, perhaps due to using an insufficiently portable submission format. In addition, though the paper cited a few references throughout, the final reference list was not available. In addition, handwritten character recognition, by itself, is not a new field, and the authors did not contribute sufficiently to the underlying theory or mechanics. Characters with arguably the same level of complexity, such as Chinese characters, have been thoroughly explored. The application of existing technology to a different script does not, by itself, compel me to feel that this is an ICLR worthy paper.\n\nIn the future, the authors might wish to show how their particular architecture (or processes) might be better suited to their task than other architectures, or show how they have, in some way, improved the science of character recognition. That being said, I think it is quite notable the effort that went into creating the data set for Amharic character recognition. I would encourage the authors to distribute this data set so that others may join in the research efforts.", "extra_scores": {"experience_assessment": "I have published one or two papers in this area.", "review_assessment:_thoroughness_in_paper_reading": "N/A", "review_assessment:_checking_correctness_of_experiments": "I assessed the sensibility of the experiments.", "review_assessment:_checking_correctness_of_derivations_and_theory": "N/A"}, "extra_text": {}}, {"review_id": "H1ep80BntB", "reviewer": "AnonReviewer1", "summary": "", "questions": "", "limitations": "", "rating": 1, "confidence": null, "soundness": null, "presentation": null, "contribution": null, "strengths": "", "weaknesses": "", "quality": null, "clarity": null, "significance": null, "originality": null, "strengths_and_weaknesses": "", "was_revised": false, "final_justification": "", "rebuttal": "", "claims_and_evidence": "", "methods_and_evaluation_criteria": "", "theoretical_claims": "", "experimental_designs_or_analyses": "", "relation_to_broader_scientific_literature": "", "essential_references_not_discussed": "", "other_strengths_and_weaknesses": "", "other_comments_or_suggestions": "", "questions_for_authors": "", "summary_of_paper": "", "summary_of_recommendation": "", "technical_quality": "", "clarity_of_presentation": "", "potential_impact": "", "robotics_focus": "", "quality_of_limitations": "", "questions_for_rebuttal": "", "reasons_to_accept": "", "reasons_to_reject": "", "questions_to_authors": "", "main_review": "", "summary_of_the_paper": "", "summary_of_the_review": "", "strength_and_weaknesses": "", "limitations_and_societal_impact": "", "review_text": "This paper try to use CNN to build recognizer for handwritten Amharic characters. The CNN they used is simple and standard. Apparently this paper no novelty at all. They just apply CNN to a new task. This kind of work is not qualified for ICLR at all.\n\nThere are also some problems in paper organization. They should split the introduction part into several paragraphs to improve reading experience. And it seems that they forget to add reference part.\n\nGiven the quality of the writing and content, I decide to reject this paper.", "extra_scores": {"experience_assessment": "I have published one or two papers in this area.", "review_assessment:_checking_correctness_of_derivations_and_theory": "N/A", "review_assessment:_checking_correctness_of_experiments": "I did not assess the experiments.", "review_assessment:_thoroughness_in_paper_reading": "N/A"}, "extra_text": {}}, {"review_id": "BygFLIHo5S", "reviewer": "AnonReviewer4", "summary": "", "questions": "", "limitations": "", "rating": 1, "confidence": null, "soundness": null, "presentation": null, "contribution": null, "strengths": "", "weaknesses": "", "quality": null, "clarity": null, "significance": null, "originality": null, "strengths_and_weaknesses": "", "was_revised": false, "final_justification": "", "rebuttal": "", "claims_and_evidence": "", "methods_and_evaluation_criteria": "", "theoretical_claims": "", "experimental_designs_or_analyses": "", "relation_to_broader_scientific_literature": "", "essential_references_not_discussed": "", "other_strengths_and_weaknesses": "", "other_comments_or_suggestions": "", "questions_for_authors": "", "summary_of_paper": "", "summary_of_recommendation": "", "technical_quality": "", "clarity_of_presentation": "", "potential_impact": "", "robotics_focus": "", "quality_of_limitations": "", "questions_for_rebuttal": "", "reasons_to_accept": "", "reasons_to_reject": "", "questions_to_authors": "", "main_review": "", "summary_of_the_paper": "", "summary_of_the_review": "", "strength_and_weaknesses": "", "limitations_and_societal_impact": "", "review_text": "This paper considers the problem of character recognition applied to handwritten Amharic text. The authors collect a dataset of handwritten Amharic characters and apply a CNN model for character recognition. The task is contextualized within an extensive description of related work both in Amharic and other languages. The dataset is novel and would be of interest to the character recognition community, and I would encourage the authors to present it in its own right along with technical details about its collection. Unfortunately, due to methodological issues (detailed below), I do not think that the machine learning results in this paper are ready for publication at ICLR. The machine learning techniques applied are of limited novelty, however, the dataset is certainly a novel contribution.\n\nMethodological issues:\n\nThe paper describes dividing the dataset in an 80-20 train-validation split. To the best of my understanding, there is no held out test set, and so we cannot know the performance of the model on unseen data. It appears that validation accuracy was taken into account when selecting hyperparameters, and so, validation accuracy also does not represent the model's performance on unseen data.\n\nI would recommend that the authors introduce a test set into their dataset split, or designate the validation part of the dataset as a test part use cross validation for hyperparameter tuning.\n\nThe authors present the train and validation numbers on their dataset, but it is difficult to know the impact of the result without comparing to a baseline of some kind. It is challenging to compare to prior work since, according to the authors, prior work on Amharic character recognition has been focused on printed text.  However, a simple non-neural baseline would be illuminating.\n\nRecommendations:\n\n1. The authors should report results on an unseen test dataset, rather than train and validation sets.\n2. The authors spend a lot of time motivating the use of deep learning in the introduction, and later on describing convolutional neural networks, ReLU, fully connected layers, etc. in great details. I believe that this space in the paper could be better utilized describing the things that are unique to the work presented.\n3. It is really important to be able to see (a) the references and (b) the example characters, as it helps readers to situate the work and to understand the specific challenges addressed. I urge the authors to prioritize these technical details in submissions of future versions of this work.\n4. Please consider separating out the description of related work into its own section. While it is useful to describe state of the art systems applied to related datasets, it is not necessary to go into great technical detail, especially if the methods applied are quite different from those attempted in this paper.\n5. Based on the challenging nature of Amharic character recognition, it would be extremely helpful to see F1 numbers or a confusion matrix. While Figure 3 shows that different characters can be written similarly, it would be great to provide a quantitative measure of this phenomenon.\n6. For a figure such as Figure 3, please provide an indication (e.g. the character number from 0-265, or a printed version of the character) of what the drawn character is supposed to look like, to help readers who cannot read Amharic script.\n\nQuestions about dataset\n1. Please clarify what you mean by \"the data collected are of two types\". Does this refer to the train/validation split?\n2. It would be great to know more about how many individuals were selected (and the choices made about their demographics) for writing the example characters, and whether there were any interesting variations observed in the dataset based on attributes highlighted in the paper (e.g. age range)\n3. Please explain the meaning of 'Form A' and 'Form B' in Figure 2.\n4. In the text, features such as a mark of palatalization are noted. Are these addressed in the data collection? Please give further details about how the dataset addresses the special features of the Amharic script.\n5. At the top of page 6, it says that the data was labelled. Could you say more about the annotators (multiple?), and report inter annotator agreement? Or, did the writers produce each character based on a specific prompt, such that the labels are known to be correct?\n6. Section 3 mentions data augmentation. Could you describe this in more detail?\n7. Are the images in Figure 3 from your dataset? Please show some examples from the new dataset you have collected!\n", "extra_scores": {"experience_assessment": "I do not know much about this area.", "review_assessment:_checking_correctness_of_derivations_and_theory": "N/A", "review_assessment:_checking_correctness_of_experiments": "I assessed the sensibility of the experiments.", "review_assessment:_thoroughness_in_paper_reading": "I read the paper thoroughly."}, "extra_text": {}}]

Author rebuttal:

Meta-review: The submission proposes to use CNN for Amharic Character Recognition.   The authors used a straight forward application of CNNs to go from images of Amharic characters to the corresponding character.  There was no innovation on the CNN side. The main contribution of the work is the Amharic handwriting dataset and the experiments that were performed.

The reviewers indicated the following concerns:
1. There was no innovation to the method (a straight forward CNN is used) and is likely not of interest to the ICLR community
2. The dataset was divided into train/val split and does not contain a held-out test set.  Thus it was impossible to determine the generalization of the model.
3. The paper is poorly written with the initial version having major formatting issues and missing references. The revised version has fixed some of the formatting issues.  The paper still need to having more paragraph breaks to help with the readability of the paper (for instance, the introduction is still one big long paragraph).  The terminology and writing can also be improved.  For instance, in section 2.3, the authors write that "500 dataset for each character were collected".  It would be clearer to say that "500 images for each character were collected".

The submission received low reviews overall (3 rejects), which was unchanged after the rebuttal.  Due to the general consensus, there was limited discussion.  There were also major formatting issues with the initial submission.  The revised version was improved to have proper inclusion of Amharic characters in the text, missing figures, and references.  However, even after the revision, the paper still had the above issues with methodology (as noted by R4) and is likely of low interest for the ICLR community.  

The Amharic handwriting data and experiments using a CNN can be of interest to the different community and I would recommend the authors work on improving their paper based on reviewer comments and submit to different venue (such as a workshop focused on character recognition for different languages).

Decision: Reject