(healthy) animals and from animals that presented the target disease. The datasets are freely available for download and can also be considered as a contribution to this work.
By achieving this goal, we look forward to giving the ENS researchers a texture-based automatic alternative to perform the EGC image analysis and foment new computer science research with the ENS, considering its great unexplored potential. It is worth mentioning that this one may be expanded to automatically detect diseases in human histopathological and radiographic images, aiming to reduce the possible subjectivity in their analysis.
The reminding of this work is organized as follows: Section 2 presents the approach proposed in this work, describing the pre-processing, feature extraction, classification and combination phases. Section 3 presents the three degenerative diseases datasets proposed in this work. Section 4 presents the experimental analysis of the proposed approach, which is subdivided in exploratory investigation, parameters, configurations and results. In Section 5 we present the analysis and discussion regarding the obtained results and, finally, in Section 6 we describe the concluding remarks and future works.
By analyzing the content of the images investigated in this work, we can observe that texture is one of the primary visual content to be explored. In this way, we decided to organize our proposed approach mainly based on different strategies aimed at describing the textural content. Besides that, methods that can also cooperate to each other in the perspective of the combination of classifiers or representations. In this vein, we create descriptors founded both on the so-called handcrafted and non-handcrafted scenarios. An overview of the proposed approach can be seen in Figure 1 .
The handcrafted features correspond to features manually extracted, aiming to find the best representation of the addressed data through a process also known as feature engineering. These kinds of features were extracted in this work considering some widely and successfully used texture operators available in the literature. In total, three texture descriptors were broached: Local Binary Pattern (LBP) [9] , Robust Local Binary Pattern (RLBP) [10] and Local Phase Quantization (LPQ) [11] .
The handcrafted features are then used as input to well-known classification algorithms such as Support Vector Machines (SVM), Random Forests (RF), k-Nearest Neighbors (k-NN) and Naive-Bayes (NB) classification algorithms.
As aforementioned, the second scenario studied here extracts non-handcrafted features, i.e., features automatically extracted from the images, through feature learning techniques. In this work, we used three well-established Convolutional Neural Network (CNN) architectures to obtain this kind of feature: LeNet5 [12] , AlexNet [13] and MaxNet [14] .
The concept of Transfer Learning was also experimented using pre-trained CNNs to extract features from the image samples. Thus, the CNN architectures VGG16 [15] , InceptionV3 [16] and InceptionResNetV2 [17] were used. The feature learning layers of such models had their weights trained in the ImageNet dataset [18] . It is worth mentioning that the chi-square test (X 2 ) was employed as a feature selection method, aiming to reduce the number of features extracted from these CNN architectures. Differing from the traditional use of transfer learning, instead of redesigning the CNN model's classification layers, in this work, we classified the resulting features using the SVM algorithm.
The estimation of probabilities generated from the classification experiments performed was then used to combine the resulting classifiers. Thus, the sum, product, and max classification rules, proposed by Kittler et al. [19] , were applied aiming to take advantage of a possible complementarity between classifiers generated by the use of different features and techniques.
It is worth mentioning that the experiments used the Stratified K-Fold Cross-Validation technique to divide the dataset to keep the existing proportions of the problem's classes. In this work, the k value used was set to ten. More details about the concepts introduced here may be found in the following subsections.
This Section describes the handcrafted modeling, which follows the Pattern Recognition framework to classify features extracted through feature engineering. For simplicity we refer them as handcrafted features.
In this work, some pre-processing techniques were explored, considering two main goals. The first one performs variations in the image samples' coloration. To achieve it, firstly, the image samples had their colors omitted by converting them to grayscale. Motivated by the fact that all image samples have a red tonality, implying that the two other channels of the RBG color system (blue and green) may not have any influence when extracting the handcrafted Figure 1 : Representation of the approach used in this work, in which handcrafted and non-handcrafted features were approached. 4
features. Figure 2 presents a comparison between an image sample in its original coloration and the same one after the conversion to grayscale. Then, in a second approach, the image samples were pseudo-colored to create a new color pattern to highlight the EGC. The pseudo-coloring is a technique that tries to color a grayscale image sample. This is commonly achieved by mapping a single grayscale value to an RGB value, which is usually referred to as color maps. Since the image samples used in this work were originally in the RGB color system, it was necessary to convert them to the grayscale to apply such a technique. A representation of a pseudo-coloring may be observed in Figure 3 . It is worth mentioning that these kinds of operations do not affect the image samples' existing texture.
Most of the captured EGC image samples have a lack of sharpness in their edges/shapes. These images result from the immunohistochemical reaction for a protein expressed exclusively in EGC, the S10 protein. This protein can be irregularly distributed in the cell, which can form irregular outlines and, associated with the low resolution of the microscopy used, often generates images with a blurred aspect.
Considering that, the second goal aimed to reduce the existing blur in the image samples and increase the edges' definition. To achieve that, the data samples had their edges (or borders) highlighted, by detecting and adding them to the original image samples. This is made possible by edge detection methods, that generally apply a filter by using different kernels. In this work, three different filters were used: Laplacian, Sobel, and Scharr. Figure 4 presents a comparison between examples generated by using these filters.
Different methods may be used to extract features from a given image. Regarding the visual attribute captured by these descriptors, we may observe that texture descriptors can potentially obtain good results in several different situations. And it stands out in different scenarios/applications, including in medical image analysis, biometric identification, etc. [20] .
The texture of a digital image is characterized by variations in the color intensity. By observing the differences between the pixels of the images, it is possible to provide a practical way to analyze an object's texture. Such analysis overlaps other ways to make an image's interpretation, e.g., by color.
Among the different works described in the literature, carried out on diverse application domains, using texture based features extraction approaches, we can mention: music genre classification [21] , bird species classification [22] , north atlantic right whale identification [23] , identification of infants' cry motivation [24] , speech recognition [25] , acoustic scene classification [26] , and COVID-19 identification using chest X-ray images [27] , among others.
In this work, three handcrafted texture descriptor approaches were used: Local Binary Pattern (LBP), Robust Local Binary Pattern (RLBP), and Local Phase Quantization (LPQ).
The LBP was originally proposed by Ojala et al. [9] and uses a local neighborhood from every input pixel to generate a representative binary value. Two main parameters may be cited: P and R. The P parameter represents the number of neighbor pixels from a central pixel c, while R represents the distance from it. The most common setup for LBP uses eight local neighbors (P = 8) two pixels distant from c (R = 2) [28] . The representation of such configuration can be described as LBP 8,2 or LBP (8, 2) . An extension of the original LBP defines the final feature vector as the normalized histogram that counts all uniform binary patterns (a binary pattern is considered uniform if it has no more than two transitions from 1 to 0 and vice-versa when evaluated as a circular list). This one has a total length of 59 features and presents better results when compared to the histogram of all individual binary patterns [29, 28, 9] . More information about the LBP can be found in [9] .
The RLBP was originally proposed by Zhao et al. [10] as a variation of the LBP texture descriptor. According to the authors, the RLBP is more accurate to capture the textural content from images that contain noise interference, when it results in non-monotonic gray level changes (even when such changes are not significant). The RLBP searches for a bit in the LBP pattern, that possibly suffered a variation inflicted by some kind of noise and then, review it. The original LBP's robustness is increased by this method, turning the binary patterns' uniformity concept a bit more flexible [28] .
More details about the RLBP may be found in [28] .
The LPQ, was initially proposed by Ojansivu and Heikkilä [11] , being designed to be a texture descriptor more sensible to the image samples affected by blur. This descriptor has been presenting good performances, even in classification tasks, not targeted to images affected by this type of interference [29] . The LPQ uses periodic information from a bi-dimensional Discrete Fourier Transform (DFT), or specifically, a Short Term Fourier Transform (STFT). The STFT is computed in a rectangular neighborhood N x for each pixel in an image sample. The rectangular window size (N x ) is an important parameter to be varied, considering its direct impact in the generated features. After locally computing the texture of each pixel, the resulting codes are presented in a histogram, similarly as the LBP method. More detailed information about the LPQ texture descriptor can be obtained in [11] .
In the machine learning context, the supervised learning task builds a hypothesis capable of predicting an unobserved data sample label, based on the knowledge obtained from a known dataset, containing labeled data samples. In other words, given a dataset with n examples of input/output pairs (x 1 , y 1 ), (x 2 , y 2 ), ..., (x n , y n ), in which x and y may represent any value (not necessarily numerical), it is built an hypothesis (function h) that approximates to a true function f that generates each y i value starting from the x i value, i.e. y = f (x). To evaluate this hypothesis, a set of test data samples is used.
This kind of task can be divided into two categories: regression problems and classification problems. If the output y assumes a finite set of values, the task is categorized as a classification problem. Otherwise, if y assumes a continuous numerical value the task is categorized as a regression problem [30] .
To the accomplishment of classification tasks, classification algorithms may be used. Different classification algorithms are described in the literature. In this work, four of them were approached: Support Vector Machines (SVM), Random Forests (RF), Naïve Bayes (NB) and k-Nearest Neighbors (k-NN).
The SVM is a well-known method widely used by its efficiency to perform classification tasks. In its training step, a hyperplane is built, i.e., a decision limit with the shortest distance between the example points. In other words, it searches for a line (or surface) that segregates the patterns from different classes, being the margin defined as the distance from this one to the closest pattern. The support vectors are the transformed patterns that delimit such margin. The input is mapped to a higher dimensional space by a non-linear function, using what is known as Kernel Trick. Such action is performed based on the fact that some data may not be linearly separable in its original input space, but being easily separable when another dimension is added [31, 30] .
The NB, can be categorized as a Bayesian Classification Algorithm. Such a category of algorithms, identify an object based on the posterior probability. Thereby, an object's class is assumed by the Bayes's theorem. Introduced originally by Thomas Bayes (1702-1761), the Bayes's Theorem (or the Bayes's Rule) is a simple equation, quiet often used by most modern artificial intelligence systems as a base for probabilistic inferences. It allows the calculation of a new unknown probability, by using three giving known conditional probabilities, that can usually be easily found. Based on this logic, the NB classifier assumes that a dataset's attributes are conditionally independent of each other. The prediction of an unseen data sample is then performed, based on the probabilities calculated from its attribute values, giving the labeled data samples, and targeting one specific class [30] .
The RF algorithm was originally proposed as a method of building classifiers based on decision trees, being as capable of increasing the accuracy in the training step as for samples not previously observed. Its operation can be shortly described as the build of multiple decision trees in a randomly selected subspace inside the features space. Then, generalizing the classification in different complementary approaches. By the end of the method's process, the tree-structured classifiers h(x, θi), i ∈ {1, .., k}, being k equivalent to the total number of decision trees, cast individual votes for one of the possible classes of x. The final prediction is assumed to be the most popular class, i. e. the class with the greatest number of votes. More details about this algorithm may be found in [32] .
The K-NN is a instance-based learning algorithm and has its operation based on the nearest neighbor rule. Considering a dataset with n labeled samples D n = x 1 , ..., x n , a certain x sample, such that x ∈ D n , can be described as being the closest point to a test sample x. By using the nearest neighbor rule, x is classified with the same label/class as x . This rule can be naturally extended to operate with a larger number of neighbors. In this way, k nearest neighbors to x are used to perform the decision when classifying such a test sample. In other words, each of the neighbors cast a vote for one of the possible classes, and at the end, x is classified with the most popular class, i. e. the class with the largest number of votes. Considering this context, the traditional nearest neighbor rule is assumed as having k = 1. It is noteworthy that to avoid draws, the value of k always assumes an odd integer [30, 31] .
Traditionally, in the pattern recognition framework, features are extracted from the dataset and used as input in machine learning algorithms that are supposed to learn how to discriminate patterns from different classes. Thereby, a significant part of the effort put in works based on machine learning algorithms is dedicated to feature engineering. This is a time-consuming and challenging process that requires specialized knowledge.
That being said, we introduce the Feature Learning (FL), or Representation Learning (RL), concept. In this category, the techniques can automatically generate data representations, favoring the extraction of useful information during the build of classifiers and other predictive systems [33] . Among the countless ways to perform FL, Deep Learning methods, such as Convolutional Neural Networks (CNN), can be highlighted. Keeping that in mind, this Section describes the non-handcrafted modeling, which aims to classify features extracted automatically by FL, being here referred to as non-handcrafted features.
Different approaches can be described to avoid overfitting, helping to ensure better and most accurate classification rates. One of them, Data Augmentation, artificially increases the total number of image samples by performing small changes in the original samples, using different operations [34] .
This approach is usually employed as a pre-processing technique when working with CNNs, taking into account the huge amount of data required to achieve satisfactory classification rates. Such a technique was applied in this work, considering the modest quantity of image samples existing in the used datasets.
To generate new image samples based on the ones available, randomly chosen image processing operations were applied to the original samples, such as: adding Gaussian noises, contrast normalization, adding blur noises, vertical/horizontal rotations, saturation variations, sharpen and others. Some examples of generated image samples can be seen in Figure 5 .
CNN is an efficient algorithm, widely used in pattern recognition and image processing areas, due to its favorable characteristics, such as simple structure, less training parameters, and adaptability. Its shared weights structure makes it more similar to the neurons' connectivity pattern found in the human brain. Been heavily inspired in the human visual system structure, each neuron from a CNN does not globally visualize an entire image sample. But instead, only a portion of it (a local area) is visualized. This way, reducing the network model's complexity and the number of weights [35, 36] .
A CNN can be considered a variation of the Multi-Layer Perceptron networks, been capable of applying filters in visual data, keeping the neighborhood relation between the image pixels through the network processing [37] .
Traditionally, the CNN's layers can be segregated in two sets: (1) the set of layers responsible for the image sample's feature extraction by FL (in this work, named non-handcrafted features), is usually composed of convolutional and pooling layers; and (2) the set of layers responsible for the classification, being composed of one or more fully connected (dense) layers [37, 38] . It is worth mentioning that the total number of layers may differ from one CNN network architecture to another.
Traditionally, machine learning algorithms predict the label of unknown data samples using models that were previously trained in a labeled dataset. With the evolution of such algorithms and the complexity growth of the tasks that employ them, it creates the need to heave an enormous amount of training data to achieve satisfactory results [39] .
The knowledge transferring concept induces the thought that a previous knowledge, acquired for a specific purpose, may be reused in another one. Having that in mind, the Transfer Learning ideal is presented. It aims to resolve new problems faster and with better solutions by using pre-obtained knowledge [39] .
Transfer Learning extracts knowledge from a source task and uses it in a target task. When using CNNs, this method makes possible the use of pre-trained models (trained in different datasets/purposes) in new classification tasks. Thus, demanding a smaller number of data samples in CNN's training. Once the FL layers are kept unchanged, only requiring the classifications layers to be trained. It is worth mentioning that the quantity and dimensions of such layers may differ from those used originally in the base model, aiming to adapt the network to the target task. Also, it can be replaced by traditional classification algorithms, e.g., Support Vector Machines (SVM). Finally, it is essential to emphasize that the use of transfer learning in this work can be seen as a timely strategy to deal with issues regarding the dataset's modest size. In our specific application, it is not easy to enlarge the dataset since it needs new animal resources and the appliance of a long-term method.
Many classification algorithms used to generate probability estimates in their outputs. Such values reference the prediction scores for each class present in the problem, obtained from the evaluation of test samples. It is possible to perform different operations over these probability scores aiming to combine them. This way, new predictions scores are obtained based on the previously reached values, generating a final result.
Three classifiers combination rules, originally proposed by Kittler et al. [19] , were used in this work for such finality. In these equations, x refers to the pattern to be classified, n is the number of classifiers involved in the combination, c is the number of classes, y i is the output label of the i th classifier in a problem with the following possibilities of classes labels Ω = ω 1 , ω 2 , ..., ω c , and P (ω k |y i (x)) is the probability of the sample x to belong to the class ω k according to the i th classifier.
• Max Rule: for each existing class from the dataset, the maximum value between the prediction scores from different classifiers is chosen. Later on, the final result is given by the class with the biggest score. This combination rule can be represented by Equation 1 .
• Sum Rule: considering all generated classifiers, the calculated predictions are summed for each class. Then, the class with the maximum score is chosen as the final result. This combination rule can be represented by Equation 2 .
• Product Rule: this rule works similarly as the sum rule. But, instead of performing a sum operation, the values are multiplied. This combination rule can be represented by Equation 3 .
It is important to remember that by combining classifiers, we have an opportunity to merge results obtained using handcrafted and non-handcrafted features once we have probabilities predictions as output from classifiers on both modes. The combination of handcrafted and non-handcrafted approaches aiming to get a single final decision has somehow already proven to be effective in other works [40, 41] .
This work presents three novel datasets created by researchers of the Enteric Neural Plasticity Laboratory of the State University of Maringá. Such datasets are composed of image samples obtained from the ENS of rats, in which EGC can be visualized through the immunostaining of the S100 protein. Figure 6 shows some image samples taken from the datasets. Each dataset represents an investigated disease, being them: arthritis rheumatoid (AIA), cancer (TW) and diabetes mellitus (D).
Each dataset is represented by the diseases' name abbreviations (AIA, TW, and D) in this work. It is worth mentioning that in this scenario, the datasets can be also called "disease groups". The datasets are composed of two classes, one containing image samples extracted from sick animals (S) and other from control/healthy (C) ones. The exact quantity of image samples per dataset and per class, and the image samples' dimensions, can be seen in Table 1 .
The datasets were created taking into account the ethical principles under the terms set out in the Brazilian federal law 1 , established by the Brazilian Society of Science on Laboratory Animals (SBCAL). All the proceedings were submitted [44] (AIA). Variations in the animals' ages were encountered as well, in every disease investigated here. The animals' euthanasia was performed with tiopental (150 mg/kg) 3 intraperitoneally. Then, the jejunum was collected and processed to evidence the EGC.
The jejunum fixation and S100 immunostaining, were performed according to the protocol proposed by Pereira et al.
(2011) [45] . The images of the EGC were obtained using an optic microscope 4 with immunofluorescence filters and high-resolution camera 5 attached to a computer. Photomicrographs were recorded using Motic Images Plus 2.0ML software (Motic China Group Co.). The image samples were then obtained using 20x, from randomly chosen places of the animals'jejunum.
It is worth mentioning that the image samples' acquiring is variable according to the target dataset. It can be justified mainly by the possibility of distinct tissue fixations and specific immunostaining responses. More detailed information about these processes and the datasets, such as the induction of the disease, may be found in [42] (D), [43] (TW), and [44] (AIA).
The datasets used in this work were made freely available for research purposes 6 , such a way that other researches can take benefit from it, and properly compare the results obtained using different techniques with those obtained here.
In this section we describe the results obtained after performing the experimental protocol designed in this work. Subsection 4.1 describes the exploratory investigation taken that leaded to the achievement of this work's best classification rates. Subsection 4.2 presents the parameters and implementations used in the algorithms employed in this work. Finally, Subsection 4.3 presents and briefly discusses this work's results.
The experiments were performed, fallowing a result-oriented exploratory research approach. Such experiments may be divided into three categories: (1) the ones that evaluated the performance of handcrafted features; (2) the ones that evaluated the performance of non-handcrafted features; and (3) the ones that combined the resulting classifiers from the previous categories.
The set of experiments using handcrafted features was designed to evaluate different approaches, such as assessing different texture descriptors, enhancing the image samples' visual features, and testing different classification algorithms.
The first experiments aimed to evaluate the performance of features extracted based on the image samples' texture. To accomplish such a goal, we used LBP, RLBP, and LPQ texture descriptors. These were applied to the image samples, and the resulting features were used as input in the SVM classification algorithm. It is worth mentioning that the assumed values of the following parameters: neighborhood size, distance from the central pixel (LBP and RLBP), and window size (LPQ), were chosen according to the best performances obtained by Costa [29] .
From these experiments' results, it was possible to notice a tendency to find more significant results by using the LPQ texture descriptor and inducing that it would be the most appropriate for the here approached problem. This may be justified by the fact that the LPQ was created to better extract features from image samples affected by blur, a kind of signal noise present in the image samples of this work's dataset. It is worth mentioning that the AIA's classification performance reached its best values by using the RLBP texture descriptor. That can be justified because the image samples from this disease group are less affected by blur and the ones more affected by the inconvenience of different noises generated by the immunohistochemistry background.
Having that in mind, new experiments were performed to reach better classification rates. To achieve this goal, new features were extracted from the image samples, using the LPQ texture descriptor and making variations the window size value, assuming the values 3, 5, 9, 11, and 13. From these results, it is possible to observe better classification rates than the previously performed experiments. Showing that there is still a space for improvement of the LPQ performance on this task if the parameters are properly adjusted.
From this point, we aimed to evaluate the performance of experiments carried out by applying pre-processing techniques. Firstly, the image samples had their colors omitted by converting them to grayscale to achieve this goal. Since these kinds of operations do not affect the existing texture in the image samples, the texture descriptors, and their parameters, used in these experiments were the ones that reached the best classification rates until this moment. The resulting F-measure values found from these experiments showed an improvement on the AIA and D datasets.
In a second moment, the image samples were pseudo-colored. Different color maps were evaluated to perform the pseudo-coloring, such as HSV, Autumn, Jet, Rainbow, and others. The resulting images were observed, aiming to search for the best choice that created greater visibility of the EGC. From the ones tested, it was possible to note that the HSV colormap best suited the searched goal.
By analyzing the results obtained from this experiment, we observe an opposite behavior compared to the results that converted the image samples to the grayscale. For the AIA and TW datasets, the found F-Measure values were inferior to the ones found in past experiments. While for the D disease group, a slight improvement could be observed compared to the best one found until this point.
Then, considering the existing blur in the image samples, new experiments were performed aiming to reduce this kind of noise and increasing the definition of the edges. The data samples had their edges (or borders) highlighted to achieve this goal by detecting (with the Laplacian, Sobel, and Scharr filters) and adding them to the original image samples. For this approach, the LBP, RLBP, and LPQ texture descriptors were used to extract handcrafted features.
The choice for re-testing the LBP and RLBP texture descriptors in these experiments, even knowing the superior performance of the LPQ in this problem, is justified by the direct impact that the edge highlighting method generates in the image's texture. This creates the need to reevaluate the performance of these texture descriptors, giving the new environment to be explored. Besides, in this case, the test is performed with images supposedly free from undesirable effects of blurring (a characteristic that the LPQ excels at). The operations were applied in the entire dataset. From the new image samples generated, features were extracted using the texture descriptors previously mentioned and classified by the SVM classification algorithm.
By the end of these experiments, it is possible to conclude that although the image samples generated by edge highlighting methods may be visually better when used as input in classification systems, the values obtained from the classification rates were inferior to those obtained without such process. One may conclude that such an approach would be inefficient for the problem investigated here.
The experiments performed until this point, aimed to identify the best possible way to represent the data samples of the approached problem, used as input through handcrafted features. In such experiments, the SVM classification algorithm was always used. Therefore, we carried out new experiments to evaluate different classification algorithms' performance, using best-extracted features found, i.e., features that led to the best classification rates until now, as input to the algorithms. To achieve this goal, the k-NN, RF, and NB classification algorithms were tested. However, the results found during these experiments' execution were still inferior to the ones found using the SVM classification algorithm.
From this point, the methods that use non-handcrafted features, i.e. features extracted automatically by FL, are evaluated. Therefore, experiments were performed using different CNN architectures and transfer learning.
The CNN tests were performed using the LeNet5, AlexNet and MaxNet CNN architectures. From these experiments, it was possible to conclude that, although the number of samples in the dataset was artificially increased, the experimental models' training was not able to succeed in the task of abstracting the problem in question.
New experiments were them employed, aiming to investigate the efficiency of applying the Transfer Learning technique in the problem investigated here. At the end of the proposed experiments, it is possible to notice good performance rates obtained by applying the Transfer Learning technique. These rates reached equivalent or slightly greater values when compared to the ones resulted by classifying handcrafted features. Showing that such a technique would be more appropriate for the classification of two out of three datasets addressed here, AIA and D. Justified by the fact that the strategy accomplished here does not demand a huge amount of data samples, like traditional CNN classification methods do, and extracts features using pre-trained FL layers proposed to solve problems from different domains.
Previously performed experiments used handcrafted and non-handcrafted features as input to create classification models. By such experiments, it was possible to observe the performance of different feature extraction and classification techniques to ascertain the generated classifications rates' behaviors on the investigated problem. With this in mind, the last experiments performed aimed to combine the most promising classifiers presented until this point for each scenario, i.e., handcrafted and non-handcrafted.
For each dataset, six classifiers were chosen, three of them obtained from handcrafted features, and the other three from non-handcrafted features. Thus, all possible sets of configurations were generated, which is equivalent to 57 different possibilities (2 6 − 7 = 57, ignoring the empty set and the ones with length equal to one) for each disease group. These were combined using the Sum, Product, and Max rules. At the end of these experiments, one may notice an improvement in the classification rates for every disease group, which indicates a complementarity between the classifiers (handcrafted and non-handcrafted) used.
The image samples were pseudo-colored using the color-maps made available by the OpenCV library 7 . The edge enhancement and the image samples' conversion to the grayscale were performed using such a library. 7 www.opencv.org
The SVM implementation used here belongs to the libSVM library [46] . We have used the Radial Basis Function (RBF) kernel, and a grid search procedure optimized the parameters C and γ. The remaining classification algorithms implementation used here are those available in the Scikit-learn [47] library. The k-NN algorithm used five nearest neighbors (k = 5) to perform the classification. The distance was calculated by the Minkowski Distance with p = 2 and the voting system had uniform weights, i.e., the neighbors' votes had the same weight in the final prediction. The RF algorithm used ten trees, and the Gaussian version of the NB algorithm was used. Such parameters were chosen considering the default values suggested by the scikit-learn library.
The CNNs used were implemented by the use of the Keras [48] library. The created models were compiled using the Adam Optimizer [49] , with the β 1 , β 2 and decay parameters equivalent to 0.9, 0.999 and 0.0005 respectively.
The CNN tests were performed using the LeNet5, AlexNet, and MaxNet CNN architectures, with batch size equal to 128 and learning rate varying between 10 −3 and 10 −5 . The number of epochs was set to 1024. It is worth mentioning that the model's performance through the epochs was monitored by the use of early stopping, with the patience of 64 epochs. After the training step, the best model found in the iterations was saved (checkpoint) and used in the test step.
To reduce the possibility of overfitting in the CNNs that did not approached Transfer Learning, two different techniques were applied: (1) 
This section presents the classification rates found when executing the experiments accordingly to the exploratory investigation presented in Section 4.1. Table 3 reports the experiments' classification rates that extracted features using the LPQ texture descriptor and used variations in the window size value. By analyzing these experiments, it was possible to observe a better efficiency of features extracted by the LPQ texture descriptor. Table 4 compares the best results.
In Table 4 it is possible to observe F-measure values of 0.8110, 0.9712 and 0.8773 respectively for the AIA, TW, and D datasets. All of the recently mentioned values were reached by classifying handcrafted features extracted by the LPQ texture descriptor. The results for the experiments that classified the image samples converted to the grayscale are in Table 5 . In this case, one may observe an improvement in the classification rates in two of the three approached disease groups, being them: AIA and D. In both of them, the F-Measure values reached an average improvement of 2 percentage points, presenting 0.8325 and 0.8907 respectively. For the TW disease group, the greatest found F-Measure value was equivalent to 0.9471, being 0.0241 inferior to the highest value found in past experiments.
Based on these values, it is possible to observe that the best classification rates found in this work until this point, were reached with the LPQ texture descriptor for all the evaluated diseases. With the window size parameter being equivalent to 11 for AIA, and 13 for TW and D. The results of the experiments that pseudo-colored the image samples are presented in Table 6 . When analyzing them, it can be observed that for the D dataset, a slight difference of 0.006 can be noticed, when compared to the best one found, described in Table 5 .
By the end of the experiments that varied the image samples' coloration, it is possible to compare the variations applied with the image samples' on the original color system (RGB) and analyze the overall performance of them. Figure 7 presents a visual comparison between all of the best results obtained for each of the color variations applied in the image samples. It is possible to observe that a different variation of the image sample was used to achieve its best F-Measure value for each disease group. 0.8927 Figure 7 : Comparison between the best results obtained from the classifications that aimed to make variations in the image samples' coloration.
For the AIA disease group, the image samples that were converted to grayscale reached a better F-Measure than other approaches. Its value was equivalent to 0.8325, nearly 2 percentage points more than the remaining color systems. To achieve this value, the LP Q 11 texture descriptor was used.
The TW disease group, by its original color system (RGB) presented a performance of approximately 2.5 percentage points greater when compared to the other two. The best F-Measure was equivalent to 0.9712 and it was obtained by the classification of handcrafted features extracted using the LP Q 13 texture descriptor.
Finally, the D disease group achieved its best F-Measure value, equivalent to 0.8967, by the extraction of handcrafted features through the use of the LP Q 13 texture descriptor and using the image samples pseudo-colored to the HSV colormap.
The F-Measure values obtained from the experiments that highlighted the image samples' edges, are shown in Table 7 . Figure 8 presents a graphical comparison between the best results found in this tests and the ones previously obtained.
For the AIA dataset, it is possible to observe that the Scharr filter had the best results. By the use of such a filter and the LBP texture descriptor, it was reached a F-Measure value of 0.8277. Compared to the best values found by the use of each filter, the recently mentioned value performed approximately 2 percentage points better. For the TW dataset, the best F-Measure value represented 0.9471, and it was reached using the RLBP texture descriptor and the Sobel Filter. It is worth mentioning that the values found in the classification rates for this dataset showed a high similarity level. These, with few exceptions, were kept around 0.94.
Finally, for the D dataset, the highest F-Measure value obtained was equivalent to 0.8695. It was reached by features extracted with the LPQ texture descriptor and edges highlighted by the Laplacian filter. Comparing the F-Measure values obtained in these tests, it is possible to observe a higher performance when the LPQ texture descriptor was used. That shows its potential in the scenario when the image samples are less affected by blur.
The next experiments aimed to evaluate the performance of different classification algorithms. The features used as input in the experiments carried out here were extracted by:
• AIA: the LP Q 11 texture descriptor, with the image samples converted to the grayscale;
• TW: the LP Q 13 texture descriptor, with the image samples in their original coloration;
• D: the LP Q 13 texture descriptor, with the image samples pseudo-colored to the HSV colormap.
The results obtained from the execution of these tests can be seen in Table 8 . In this one, it is possible to observe that the RF classification algorithm resulted in better classification rates than the other ones. In contrast, the NB algorithm obtained the lowest classification rates in the executed tests. Compared to the ones obtained by the RF algorithm, the NB's F-Measure values were averagely 0.0837 inferior. Such results may be justified by the algorithm's nature, considering that its performance stands out usually in smaller datasets with categorical features. A comparison can be seen represented in Figure 9 . In this one, it is possible to observe the SVM algorithm's superior performance in the same set of features, having its values averagely 0.0638 greater when compared to the values achieved by the RF algorithm, which had the best classification rates in the tests here executed.
From this moment, we describe the experiments carried out using CNNs to extract the features and perform the classification for the proposed problem. The best-reached results by each used architecture can be seen in Table 9 .
In Table 9 , it is possible to observe that for the set of image samples of the AIA disease group, the LeNet5 CNN architecture presented the best F-Measure value. This leads us to conclude that a simpler architecture would be satisfactory for this work's goal in this scenario. The TW and D disease groups' set of image samples otherwise, had their best F-Measure values found by using the AlexNet architecture. This one may be considered as a more robust architecture. However, when these results are compared to the ones found through handcrafted features, it is possible to observe lower classification rates, having a difference in the F-Measure values of 0.1194 (average).
The best results from executing the experiments that employed the Transfer Learning technique may be found in Table  10 . We may notice that the InceptionResNetV2 architecture achieved the worst F-Measure values, around 22 (average) percentage points inferior to the best values found in these experiments. For the AIA disease group, the best results were reached using the InceptionV3 architecture and 4096 features. In this case, the F-Measure value was 0.8468. The TW and D disease groups reached their best results using the VGG16 architecture, with the feature quantity reduced to 2048 (TW) and 4096 (D). It is worth mentioning that the best F-Measure values for the AIA and D datasets surpassed the best ones found until this point, obtained using handcrafted-features, by 0.0143 and 0.0065 respectively.
Finally, this last experiment evaluates the impacts of combining classifiers. For this purpose, we selected the most promising classifiers presented until this point. Table 11 briefly introduces them.
The best results obtained by the combination is reported in Table 12 .
For the AIA dataset, the combination of three classifiers, through the max rule, produced a F-measure value of 0.893, which is 4.62 percentage points better than the best one found so far (available in Table 10 ). Among the classifiers used, one used handcrafted features, while the other two used non-handcrafted features. The classifiers with IDs equivalent to 3 and 4 were extremely influential to the classification rates obtained in these tests. Both of them are present in all of the best results found.
When analyzing the TW dataset classification rates, it is possible to observe that the best F-Measure value found was equivalent to 0.9845. Approximately 1.33 percentage points more than the best F-Measure value found until this point (observable in Table 3 ) for such dataset. In total, five classifiers were combined by the sum rule to achieve these values. The combination counted with three classifiers that used handcrafted features and two that used non-handcrafted features.
For the D dataset, the best F-measure value was 0.9513, which is 5.13 percentage points better than the best value found for this dataset (available in Table 10 ). This result was possible by combining three classifiers using the sum rule. In this case, two classifiers used handcrafted features and one non-handcrafted. It is worth mentioning that the classifiers with ID 1 and 2, can be considered essential to obtaining these performances. Figure 10 shows a graphical representation of the configurations used to combine the classifiers that achieved the best classification rates presented in this Section, recently displayed in Table 12 , for each dataset approached in this work. N and H Sum 0.9445 * Type(s) of classifiers involved in the combination. * * N stands for "non-handcrafted" features, and H stands for "handcrafted" features. 
In this section, we discuss the results presented so far. It will be conducted by looking for answers to the following questions, aiming to get a more comprehensive understanding of the behavior of the methods and techniques experimented on the evaluated classification tasks:
• Which features provided the best results in each feature representation scenario and disease group? • Which feature representation provided the best results? • Which disease group is easier/harder to predict? • Have the fusion strategies contributed to improving the results?
This question is three-fold, i.e., we have to consider the three different feature representation scenarios used in each dataset: The handcrafted features (LBP, RLBP, and LPQ); The non-handcrafted features with pre-configured CNNs (MaxNet, LeNet5, and AlexNet); and the non-handcrafted features with transfer learning (VGG16, InceptionV3, and InceptionResNetV2).
To answer the question, i.e., define the best features in each representation scenario/disease group, we used the statistical evaluation protocol proposed in Charte et al. (2015) [50] . Using this protocol, we calculate the ranking of the f-measures classification results obtained in all experiments with the different features based on the Friedman statistical test. The classification performances using the three different types of feature representation are ranked per disease group (from first to last), and an average rank is calculated. Then a general average ranking is computed for each one of the three feature representation scenarios.
The average rankings obtained with the previously described statistical test for the handcrafted features are presented in Table 13 . We may observe that for the AIA disease, the best-ranked feature with an average ranking of 1.50 was LBP, while for the TW and D diseases, the best-ranked feature was LPQ, with an average ranking of 1.00. Moreover, considering all disease groups, the best ranked handcrafted feature is LPQ, with an average of 1.44. Table 14 shows the average rankings for the non-handcrafted features obtained with pre-configured CNNs. We may observe that in all disease groups, AlexNet obtained the best classification results, reaching an average ranking of 1.50 for the AIA disease and 1.00 for TW and D diseases. Therefore, AlexNet is also the best-ranked feature in general, i.e., considering the three disease groups. Table 15 presents the average ranking for the non-handcrafted features obtained with transfer learning. We may note that VGG16 achieved the best overall average ranking considering all disease groups (1.13), with an average ranking of 1.40 for AIA and 1.00 for both TW and D disease groups.
To answer the second question with statistical significance, we applied the Wilcoxon Statistical Test. We hypothesize that the top-10 f-measures obtained with the handcrafted features are higher than the top-10 f-measures obtained with Table 17 . Considering a threshold of 0.05, we can statistically affirm that the classification results obtained in AIA disease are lower than the results obtained in TW disease, since the test achieved a p-value of 6.5 × e −12 (below the threshold). We can also affirm that the results obtained in D disease are lower than the results obtained in TW, since the test obtained a p-value of 7.0 × e −11 . Thus, we can conclude that TW disease is the "easiest" one to predict, as it achieved classification results higher than the two other disease groups, i.e., AIA and D.
Furthermore, we can also observe in Table 17 that the classification results obtained in AIA disease are lower then the ones obtained in D disease group, since the test achieved a p-value of 7.0 × e −4 (below the threshold). Thus, we can conclude that AIA disease is the "hardest" one to predict, as it achieved classification results lower than the two other disease groups (D and TW).
To answer this question, our hypothesis is that the top-5 classification results with the combinations of the classifiers' outputs are higher than the top-5 classification results without the combination of outputs in each disease group. The z-scores and p-values obtained with the Wilcoxon Statistical Test for this scenario are reported in Table 18 .
Considering a threshold of 0.05, we can statistically affirm that the fusion strategies did contribute to improving the overall classification results, since the p-values of the Wilcoxon test achieved 0.0216 for all disease groups. Nowadays, as the pre-clinical research advances, it is created the tendency of building methods capable of supporting such activities, aiming to decrease the manual work demanded and automatically analyze the conceived data. Thus, we proposed a method to automatically identifying chronic degenerative diseases using EGC image samples. Two types of features were considered (handcrafted and non-handcrafted). Both methodologies had their efficiency measured. Furthermore, a hybrid methodology was evaluated. Classifiers formed from such methodologies were combined to ascertain if it is possible to take advantage of a potential complementarity between them.
By experiments that were performed using handcrafted features, it was possible to observe a tendency of better results when the LPQ texture descriptor and the SVM classification algorithm were used. This descriptor's efficiency can be justified by the fact that it was developed aiming to be efficient for blurred images, like the ones existing in this work's dataset. At the end of these experiments' execution, we may observe that the best F-measure values founded reached 0.8325, 0.9712 and 0.8967 for AIA, TW, and D datasets, respectively. It is worth mentioning that for the AIA and D image samples, a pre-processing was applied, in which these were converted to grayscale (AIA) and pseudo-colored to the HSV colormap (D).
In the second approach used, non-handcrafted features were extracted using Feature Learning methods. Experiments were accomplished using CNN architectures and presented regular classification rates, but inferior to those found until that point. Better classification rates were generated by using a Transfer Learning strategy. The tests that led such results, extracted features using CNN architectures pre-trained with the ImageNet dataset, performing the classification later with the SVM classification algorithm. The best F-measure values found at the end of these tests were 0.8468, 0.9327, and 0.9043 for AIA, TW, and D datasets, respectively. Therefore, a slight improvement may be observed compared to the best ones, found by the classification of handcrafted features, for the AIA and D datasets.
Lastly, classifiers from both approaches were combined. Different configurations/architectures were created, and the target classifiers were combined by the sum, max, and product rules. By the use of this approach, this work's best results were obtained. The final F-Measure values were equal to 0.8930, 0.9845, and 0.9513 to the AIA, TW, and D datasets, respectively. These results were obtained by combining respectively three, five, and three classifiers. In all of them, classifiers created using both handcrafted and non-handcrafted features.
At the end of this work, it was possible to conclude that the classification of EGC images, aiming to identify a target disease's presence in the data samples, presented great results by classifying features extracted both on handcrafted and non-handcrafted modes. However, combining both strategies achieved the best performances for all disease groups. This corroborates the effectiveness of the proposed method.
In future works, we intend to expand the dataset aiming to include other types of cells, such as the Enteric Neuron. It could be useful to create an alternative understanding of the studied diseases and evaluate if it can improve the results described in this work.
We also intend to use the data samples as input in a segmentation methodology, using the isolated EGC to create a morphometric and quantitative analysis, aiming to perform the classification more precisely. We plan to adapt our method to analyze samples of individuals under different treatments so that it can i) automatically identify the proximity level to both classes approached in this work (control/healthy and unhealthy); ii) rank the performed treatments, displaying the most successful ones. Finally, we plan to: i) test new data augmentation methods; ii) crate a dedicated CNN architecture; iii) evaluate other texture descriptors; and iv) test different feature selection methods.