# Research on Coal and Rock Type Recognition Based on Mechanical Vision

Authors: Qiang Zhang; Jieying Gu; Junming Liu
Journal: Shock and Vibration
 (2021)

---

## Abstract

In order to identify different kinds of coal, rock, and gangue, the FPV integrated image transmission camera is used to collect images of 6 types of coal, 8 types of rocks, and 2 types of coal gangue, and the images are processed based on the two-dimensional discrete wavelet transform (2D-DWT) based on the steerable pyramid decomposition (SPD). The maximum likelihood estimation method is used to estimate the parameters, and, the coal and rock types are judged by comparing the similarity of each image. The results show the following: (1) in the eight kinds of rocks, the recognition accuracy of shale and limestone is 90%, that of anorthosite is 95%, and those of other rocks are 100%; (2) the accuracy of comprehensive identification of coal, rock, and gangue is 93%, the comprehensive of coal and gangue is 78%, and the rock classification is 97%; (3) the identification time of 6 types of coal samples, 8 types of rock samples, and 2 types of coal gangue samples are in the range of 2 s∼3 s, which is far less than 10 s, which can meet the requirements of coal and rock identification in terms of recognition speed; and (4) according to 20 groups of data, the range, variance, and standard deviation of the same coal gangue sample meet the accuracy requirements of coal and rock identification. The identification method provides an effective method to improve the efficiency of coal separation, effectively determine the distribution of coal and rock, and timely adjust the cutting height of shearer drum and the operation parameters of various fully mechanized mining equipment, so as to improve the recovery rate of coal resources.


---

## Body

## 1. Introduction

With the decrease of coal resource reserves, the development of coal resources is becoming more and more difficult, and the situation of coal and rock mixing is increasing [1, 2]. Therefore, it is necessary to judge the distribution of coal and rock, select coal seam for mining, avoid the damage of mechanical equipment caused by equipment cutting rock stratum, affect the service life of equipment, reduce the quality of coal and rock, and improve the production cost. How to identify coal and rock efficiently and accurately has been studied by scholars at home and abroad.Wang and Zhang [3] proposed a new method of dynamic identification in a coal-rock interface based on the fusion of adaptive weight optimization and multisensor information. As a result, a cutting experiment on a random coal-rock interface verified both the accuracy and speed of the proposed identification model, in comparison with the single signal, adaptive network-based fuzzy inference system (ANFIS) fusion, and improved PSO-BP. Liu et al. [4] proposed the multiscale feature fusion coal-rock recognition (MFFCRR) model based on a multiscale Completed Local Binary Pattern (CLBP) and a Convolution Neural Network (CNN). Experimental results show that the coal-rock image recognition accuracy of the proposed MFFCRR model reaches 97.9167%, which increased by 2%–3% compared with the state-of-the-art coal-rock recognition methods. Miao et al. [5] established a three-layered model of coal-rock and gave the mathematical analysis of this model. Then numerical simulation and field experiment were carried out. Finally, in order to interpret radar image, an improved image segmentation algorithm was proposed. Chen et al. [6] proposed a coal-rock recognition method based on sound signal analysis. The experiment results show that the overall recognition accuracy is 91.7% under the actual cutting condition. Zhang et al. [7–9] established the simulation and reduction image of coal and rock distribution to determine the transition area of coal and rock distribution, which improved the accuracy of coal-rock identification. Luo et al. [10, 11] proposed a hybrid-graph learning method to reveal the complex high-order relationships of the HSI, termed enhanced hybrid-graph discriminant learning (EHGDL), and proposed a sparse-adaptive hypergraph discriminant analysis (SAHDA) method to obtain the embedding features of the HSI.To sum up, there is no comprehensive study on the identification of coal and rock types. Therefore, the images of 6 types of coal, 8 types of rocks, and 2 types of coal gangue were collected in this paper. The images were divided into several subzones by 2D-DWT. The image processing was based on SPD, and the maximum likelihood estimation method was used to judge the sample types. (1) The identification of similar types of coal, rock, and gangue provides an important means for the separation after excavation. (2) Improve the coal mining efficiency, ensure that the coal under the coal mine is fully exploited, and make full use of the underground coal mine resources. (3) Effectively judge the type of rock, coal, and gangue; judge its hardness; prevent excessive wear of the pick; even damage the pick; affect the working life of the equipment in the fully mechanized mining face; and reduce the reliability of the cutting process of the shearer.


## 2. Type and Characteristic Analysis of Coal-Rock-Gangue

### 2.1. Coal Types and Characteristics Analysis

At present, the more common coal resources in China are fat coal, lignitous coal, coking coal, gas fat coal, gas coal, and anthracite. Each of the above coal has its own characteristics, and the application method is not the same. Therefore, it is necessary to analyze the above coal samples to ensure that the above coal carbons can be effectively distinguished. The coal types and characteristics of this paper are shown in Table1.Table 1
Analysis of coal types and characteristics.
Coal typesCoal characteristicsFat coalHighly volatile substances, strong bonding, good melting, high wear resistance, many cross cracks, high porosity, many cokes at the root of coke, brittleLignitous coalMostly brown or brown-black, matte, low degree of coalification, relative density of 1.2∼1.45, strong chemical reactivity, efflorescent, not easy to store and transportCoking coalMedium volatility, fairly adhesion, coke with large block size, few cracks, high crushing strength, good wear resistanceGas coalLow degree of coalification, unbonded or slightly adhesive, black, weak glass luster, dense, conchoidal or flat fractureGas fat coalHigh expansibility, high adhesion, highly volatile and colloidal layer, high exinite contentAnthraciteWhite or red, high degree of coalification, black, hard and metallic, conchoidal fracture, high carbon content, low volatile yield, high density, high hardness, and high ignition pointJudging the type of coal can be used to mine the same kind of coal in the first mining, avoiding the need for secondary classification of coal in the later stage after large-scale mining without distinguishing coal types, which increases the workload of coal sorting, takes a long time, and increases the cost of coal mining. Therefore, it is necessary to effectively classify and identify the coal.


### 2.2. Rock Types and Characteristics Analysis

Rock is very common in the coal mining work, and the rock hardness is generally large. If the rock is cut, it is easy to cause serious wear and tear [12, 13], which affects the working life of the shearer pick. Moreover, when the shearer pick is seriously worn, it is necessary to maintain the shearer. At this time, the coal mining work must not be interrupted, which reduces the coal mining efficiency and reduces the continuity of underground mining work. It has practical application value to determine rock distribution and avoid cutting high hardness rock with pick. At present, rocks are mainly divided into three categories [14–16], namely, igneous rock, sedimentary rock, and metamorphic rock. The types and characteristics of rocks studied in this paper are shown in Table 2.Table 2
Analysis of rock types and characteristics.
Rock typesRock characteristicsGraniteBright black, flat arrangement, fine and uniform grains, tight structure, high quartz content, bright lusterDiabaseFine middle grain, dark gray, diabase structure, or subdiabase structureAnorthositeLabradorite or andesine, dark minerals are orthopyroxene, clinopyroxene and hornblende, less than 10% of the total, subhedral, coarse-grained structureQuartz sandstoneLow shear strength, gentle, crisscross fracture, white, light green, dark gray, etc.LimestoneGray, gray-white, gray-black, yellow, light red, brown-red, and other colors, small hardness, calcite, accompanied by dolomite, magnesite, and other carbonate minerals of limestone.SandstoneLight brown or red, compositions include silicon, calcium, clay and iron oxide, sand content greater than 50%, consisting of quartz or feldsparShaleThin sheet or lamellar, dense surface, low hardness, dim gloss, gray-black and black with organic matter, brown-red and brown-red with iron, and yellow, green, and other colorsQuartziteGreen, gray, yellow, brown, orange-red, white, blue, purple, red, etc., quartz, block structure, granular amorphous structure, crystalline aggregatesThe identification of rock is beneficial to the removal of rock and the full utilization of underground coal seam resources [17]. At the same time, it is recognized that the rock hardness is too large, and the cutter part of the shearer should automatically adjust to avoid cutting the rock, which will bring damage to the cutter part of the shearer, affect the normal operation of the shearer, reduce the coal mining efficiency, cause mechanical damage to the fully mechanized face, and affect the overall service life of the shearer.


### 2.3. Gangue Types and Characteristics Analysis

The existence of coal gangue is an unavoidable problem in the process of coal mining. Therefore, the properties of coal gangue need to be studied. In this paper, lignitous coal gangue and bituminous coal gangue are taken as examples, and their characteristics are shown in Table3.Table 3
Analysis of gangue types and characteristics.
Gangue typesGangue characteristicsLignitous coal gangueBrown, black, high hardness, low carbon content, containing Fe2O3Bituminous coal gangueGray-white, carbonaceous rock, high hardness, components are Al2O3, SiO2, texture is very different from coal textureWhen the hardness of coal gangue is too large, it will cause serious wear and damage to the cutting part. It is necessary to use the rocker arm of the Shearer to adjust the cutting position. When meeting the coal gangue in the coal seam, the contact with coal gangue should be avoided to prevent damage to the shearer pick due to the contact between the cutting part of the shearer and the coal gangue with greater hardness.


## 2.1. Coal Types and Characteristics Analysis

At present, the more common coal resources in China are fat coal, lignitous coal, coking coal, gas fat coal, gas coal, and anthracite. Each of the above coal has its own characteristics, and the application method is not the same. Therefore, it is necessary to analyze the above coal samples to ensure that the above coal carbons can be effectively distinguished. The coal types and characteristics of this paper are shown in Table1.Table 1
Analysis of coal types and characteristics.
Coal typesCoal characteristicsFat coalHighly volatile substances, strong bonding, good melting, high wear resistance, many cross cracks, high porosity, many cokes at the root of coke, brittleLignitous coalMostly brown or brown-black, matte, low degree of coalification, relative density of 1.2∼1.45, strong chemical reactivity, efflorescent, not easy to store and transportCoking coalMedium volatility, fairly adhesion, coke with large block size, few cracks, high crushing strength, good wear resistanceGas coalLow degree of coalification, unbonded or slightly adhesive, black, weak glass luster, dense, conchoidal or flat fractureGas fat coalHigh expansibility, high adhesion, highly volatile and colloidal layer, high exinite contentAnthraciteWhite or red, high degree of coalification, black, hard and metallic, conchoidal fracture, high carbon content, low volatile yield, high density, high hardness, and high ignition pointJudging the type of coal can be used to mine the same kind of coal in the first mining, avoiding the need for secondary classification of coal in the later stage after large-scale mining without distinguishing coal types, which increases the workload of coal sorting, takes a long time, and increases the cost of coal mining. Therefore, it is necessary to effectively classify and identify the coal.


## 2.2. Rock Types and Characteristics Analysis

Rock is very common in the coal mining work, and the rock hardness is generally large. If the rock is cut, it is easy to cause serious wear and tear [12, 13], which affects the working life of the shearer pick. Moreover, when the shearer pick is seriously worn, it is necessary to maintain the shearer. At this time, the coal mining work must not be interrupted, which reduces the coal mining efficiency and reduces the continuity of underground mining work. It has practical application value to determine rock distribution and avoid cutting high hardness rock with pick. At present, rocks are mainly divided into three categories [14–16], namely, igneous rock, sedimentary rock, and metamorphic rock. The types and characteristics of rocks studied in this paper are shown in Table 2.Table 2
Analysis of rock types and characteristics.
Rock typesRock characteristicsGraniteBright black, flat arrangement, fine and uniform grains, tight structure, high quartz content, bright lusterDiabaseFine middle grain, dark gray, diabase structure, or subdiabase structureAnorthositeLabradorite or andesine, dark minerals are orthopyroxene, clinopyroxene and hornblende, less than 10% of the total, subhedral, coarse-grained structureQuartz sandstoneLow shear strength, gentle, crisscross fracture, white, light green, dark gray, etc.LimestoneGray, gray-white, gray-black, yellow, light red, brown-red, and other colors, small hardness, calcite, accompanied by dolomite, magnesite, and other carbonate minerals of limestone.SandstoneLight brown or red, compositions include silicon, calcium, clay and iron oxide, sand content greater than 50%, consisting of quartz or feldsparShaleThin sheet or lamellar, dense surface, low hardness, dim gloss, gray-black and black with organic matter, brown-red and brown-red with iron, and yellow, green, and other colorsQuartziteGreen, gray, yellow, brown, orange-red, white, blue, purple, red, etc., quartz, block structure, granular amorphous structure, crystalline aggregatesThe identification of rock is beneficial to the removal of rock and the full utilization of underground coal seam resources [17]. At the same time, it is recognized that the rock hardness is too large, and the cutter part of the shearer should automatically adjust to avoid cutting the rock, which will bring damage to the cutter part of the shearer, affect the normal operation of the shearer, reduce the coal mining efficiency, cause mechanical damage to the fully mechanized face, and affect the overall service life of the shearer.


## 2.3. Gangue Types and Characteristics Analysis

The existence of coal gangue is an unavoidable problem in the process of coal mining. Therefore, the properties of coal gangue need to be studied. In this paper, lignitous coal gangue and bituminous coal gangue are taken as examples, and their characteristics are shown in Table3.Table 3
Analysis of gangue types and characteristics.
Gangue typesGangue characteristicsLignitous coal gangueBrown, black, high hardness, low carbon content, containing Fe2O3Bituminous coal gangueGray-white, carbonaceous rock, high hardness, components are Al2O3, SiO2, texture is very different from coal textureWhen the hardness of coal gangue is too large, it will cause serious wear and damage to the cutting part. It is necessary to use the rocker arm of the Shearer to adjust the cutting position. When meeting the coal gangue in the coal seam, the contact with coal gangue should be avoided to prevent damage to the shearer pick due to the contact between the cutting part of the shearer and the coal gangue with greater hardness.


## 3. Image Acquisition and Processing

### 3.1. Image Acquisition Device

According to the analysis of the actual working situation, the FPV integrated image transmission camera is selected. HD camera has its own control chip, is easy to use, and is of low cost. The image transmission module and HD camera are shown in Figure1.Figure 1
Module and HD camera.The camera is directly connected with the image transmission module to realize the wireless transmission function of real-time video feedback. It is small and suitable for use. The camera has a wide shooting angle, which is convenient for image extraction in a larger range. The camera can reach a super wide-angle viewing angle of 135 degrees diagonally.The working voltage is 3.3 V∼6V, and the maximum working current is 140 mA. The DC3.3-6v power supply is adopted, which is convenient to connect with the image transmission and camera. The camera can be directly powered by lithium batteries, so it is convenient to use. The imaging effect is clear, the image is clear without snowflakes, 0.01LUX low illumination can still take images under the condition of insufficient light, and the effect is more perfect with the use of a high-definition image transmission acquisition card.


### 3.2. Coal-Rock-Gangue Image Acquisition

Six kinds of coal samples are collected, 30 groups of each coal are selected, and the images of different types of coal are as shown in Figure2.Figure 2
Image acquisition of different types of coal. (a) Fat coal sample. (b) Lignitous coal sample. (c) Coking coal sample. (d) Gas coal sample. (e) Gas fat coal sample. (f) Anthracite sample.
(a)(b)(c)(d)(e)(f)Eight kinds of rock samples are collected; 30 groups are selected for each type. The images of different types of rocks are shown in Figure3.Figure 3
Images of different types of rocks. (a) Granite sample. (b) Diabase sample. (c) Anorthosite sample. (d) Quartz sandstone sample. (e) Limestone sample. (f) Sandstone sample. (g) Shale sample. (h) Quartzite sample.
(a)(b)(c)(d)(e)(f)(g)(h)Two kinds of coal gangue samples are collected, 30 groups are selected for each kind of coal gangue, and the images of different kinds of coal gangue are as shown in Figure4.Figure 4
Images of different types of gangues. (a) Lignitous coal gangue Sample. (b) Bituminous coal gangue Sample.
(a)(b)


### 3.3. Image Processing of 2D-DWT Based on SPD

The image decomposition process of two-dimensional discrete wavelet transform (2D-DWT) is shown in Figure5. The low-pass filter h (n) and high-pass filter g (n) are used to output the low-frequency subband LLj − 1 from the upper-level image (or original image) by rows, and the Lj′ and Hj′ are collected to obtain Lj and Hj. By columns, a low-frequency subband LLj′ and a medium and high-frequency subband HLj′ are obtained by filtering Lj and Hj by filter h (n). By columns, Lj and Hj are filtered by g (n) to obtain medium and high-frequency subband LHj′ and one high-frequency subband HHj′. LLj′, LHj′, HLj′, and HHj′ were sampled to obtain LLj, LHj, HLj, and HHj by columns. In addition, LLj can be used as input to the next level of 2D-DWT to recursively implement multilevel 2D-DWT.Figure 5
Image decomposition using 2D-DWT.It is known that image decomposition using 2D-DWT requires row and column downsampling and that the low-pass and high-pass filters used in all levels of 2D-DWT are unchanged. Therefore, 2D-DWT is liable to cause aliasing between frequency bands. In addition, the directional resolution of 2D-DWT is still insufficient to be improved. This paper presents an image processing method based on a direction-controllable steerable pyramidal decomposition (SPD) framework. A directional derivative operator with a specific order is used as the basis function of the decomposition transformation, and a filter bank in any direction can be constructed by a linear combination of the base filters corresponding to the base functions. Therefore, the details of the image along any direction can be obtained by SPD method. From the frequency domain perspective, the SPD workflow is shown in Figure6, and the dashed range represents a recursive iteration process for multilevel SPDs.Figure 6
Flowchart of SPD.Taking anorthosite as an example, the images before and after processing are shown in Figure7.Figure 7
Sample anorthosite treatment. (a) Image before processing. (b) Histogram of gray distribution before processing. (c) Image after processing. (d) Histogram of gray distribution after processing.
(a)(b)(c)(d)As shown in Figure7, after the image collected by the camera is processed by this method, it has obvious visual enhancement effect. The color difference of the image and the surface features are very obvious. It can capture the image information more accurately and prevent the lack of recognition accuracy due to the lack of obvious image information. This method can effectively express the different features of different samples and improve the recognition accuracy. Therefore, the image processing method is effective, 2.4 Image database establishment.The pictures of the database are created by using OCR Trainer under image processing and computer vision in MATLAB. The more categories the database contains, the more comprehensive the database will be and the more reliable the visual recognition results will be. In this paper, 30 image-processed sample pictures of each type of sample are selected as the database. As shown in Figure8, when the progress bar is completed, the extraction of training samples is completed.Figure 8
Training sample extraction.


## 3.1. Image Acquisition Device

According to the analysis of the actual working situation, the FPV integrated image transmission camera is selected. HD camera has its own control chip, is easy to use, and is of low cost. The image transmission module and HD camera are shown in Figure1.Figure 1
Module and HD camera.The camera is directly connected with the image transmission module to realize the wireless transmission function of real-time video feedback. It is small and suitable for use. The camera has a wide shooting angle, which is convenient for image extraction in a larger range. The camera can reach a super wide-angle viewing angle of 135 degrees diagonally.The working voltage is 3.3 V∼6V, and the maximum working current is 140 mA. The DC3.3-6v power supply is adopted, which is convenient to connect with the image transmission and camera. The camera can be directly powered by lithium batteries, so it is convenient to use. The imaging effect is clear, the image is clear without snowflakes, 0.01LUX low illumination can still take images under the condition of insufficient light, and the effect is more perfect with the use of a high-definition image transmission acquisition card.


## 3.2. Coal-Rock-Gangue Image Acquisition

Six kinds of coal samples are collected, 30 groups of each coal are selected, and the images of different types of coal are as shown in Figure2.Figure 2
Image acquisition of different types of coal. (a) Fat coal sample. (b) Lignitous coal sample. (c) Coking coal sample. (d) Gas coal sample. (e) Gas fat coal sample. (f) Anthracite sample.
(a)(b)(c)(d)(e)(f)Eight kinds of rock samples are collected; 30 groups are selected for each type. The images of different types of rocks are shown in Figure3.Figure 3
Images of different types of rocks. (a) Granite sample. (b) Diabase sample. (c) Anorthosite sample. (d) Quartz sandstone sample. (e) Limestone sample. (f) Sandstone sample. (g) Shale sample. (h) Quartzite sample.
(a)(b)(c)(d)(e)(f)(g)(h)Two kinds of coal gangue samples are collected, 30 groups are selected for each kind of coal gangue, and the images of different kinds of coal gangue are as shown in Figure4.Figure 4
Images of different types of gangues. (a) Lignitous coal gangue Sample. (b) Bituminous coal gangue Sample.
(a)(b)


## 3.3. Image Processing of 2D-DWT Based on SPD

The image decomposition process of two-dimensional discrete wavelet transform (2D-DWT) is shown in Figure5. The low-pass filter h (n) and high-pass filter g (n) are used to output the low-frequency subband LLj − 1 from the upper-level image (or original image) by rows, and the Lj′ and Hj′ are collected to obtain Lj and Hj. By columns, a low-frequency subband LLj′ and a medium and high-frequency subband HLj′ are obtained by filtering Lj and Hj by filter h (n). By columns, Lj and Hj are filtered by g (n) to obtain medium and high-frequency subband LHj′ and one high-frequency subband HHj′. LLj′, LHj′, HLj′, and HHj′ were sampled to obtain LLj, LHj, HLj, and HHj by columns. In addition, LLj can be used as input to the next level of 2D-DWT to recursively implement multilevel 2D-DWT.Figure 5
Image decomposition using 2D-DWT.It is known that image decomposition using 2D-DWT requires row and column downsampling and that the low-pass and high-pass filters used in all levels of 2D-DWT are unchanged. Therefore, 2D-DWT is liable to cause aliasing between frequency bands. In addition, the directional resolution of 2D-DWT is still insufficient to be improved. This paper presents an image processing method based on a direction-controllable steerable pyramidal decomposition (SPD) framework. A directional derivative operator with a specific order is used as the basis function of the decomposition transformation, and a filter bank in any direction can be constructed by a linear combination of the base filters corresponding to the base functions. Therefore, the details of the image along any direction can be obtained by SPD method. From the frequency domain perspective, the SPD workflow is shown in Figure6, and the dashed range represents a recursive iteration process for multilevel SPDs.Figure 6
Flowchart of SPD.Taking anorthosite as an example, the images before and after processing are shown in Figure7.Figure 7
Sample anorthosite treatment. (a) Image before processing. (b) Histogram of gray distribution before processing. (c) Image after processing. (d) Histogram of gray distribution after processing.
(a)(b)(c)(d)As shown in Figure7, after the image collected by the camera is processed by this method, it has obvious visual enhancement effect. The color difference of the image and the surface features are very obvious. It can capture the image information more accurately and prevent the lack of recognition accuracy due to the lack of obvious image information. This method can effectively express the different features of different samples and improve the recognition accuracy. Therefore, the image processing method is effective, 2.4 Image database establishment.The pictures of the database are created by using OCR Trainer under image processing and computer vision in MATLAB. The more categories the database contains, the more comprehensive the database will be and the more reliable the visual recognition results will be. In this paper, 30 image-processed sample pictures of each type of sample are selected as the database. As shown in Figure8, when the progress bar is completed, the extraction of training samples is completed.Figure 8
Training sample extraction.


## 4. Machine Visual Recognition Based on Quantitative Discrimination of Similarity

After 2D-DWT transformation, each mid-high-frequency subband of the image to be identified obeys each parameter under the AGGD condition. The image similarity calculation is a very important issue. At present, it is common to construct feature vectors from each AGGD parameter involved in each image and use the nearest neighbor classifier to complete coal and rock identification. Most classifiers in this process assume that the metric space of the eigenvectors is Euclidean space. Therefore, Euclidean distance is used as the criterion for evaluating similarity. From the perspective of information theory, the degree of coincidence of probability distribution is often described by relative entropy. SetPx,Θ1 as the subband x1 coefficient probability distribution density function. Set Px,Θ2 as the subband x2 coefficient probability distribution density function, where Θ1 = (α1, βL1, βR1), Θ2 = (α2, βL2, βR2) define the relative entropy between x1 and x2.Given two imagesI1 and I2, the similarity between them is defined as(1)SIMG∗I1,I2=∑j=1JSsubb∗xLHj−1,xLHj−2+Ssubb∗xHLj−1,xHLj−2+Ssubb∗xHHj−1,xHHj−2.In the formula,J is the total series of 2D-DWT. xLHj−1, xHLj−1, and xHHj−1 are subbands in the horizontal, vertical, and diagonal directions of I1 after the j level 2D-DWT. xLHj−2, xHLj−2, and xHHj−2 are the corresponding directional subband for I2. The smaller the SIMG∗I1,I2, the higher the similarity between I1 and I2, and vice versa.This paper takes anorthosite-coking coal as an example, and the result of image recognition is shown in Figure9.Figure 9
Anorthosite-coking coal image. (a) Image before processing. (b) Image after processing. (c) Identification results.
(a)(b)(c)As shown in Figure9, this paper takes an anorthosite-coking coal image as an example to test the method, and the test proves that the method can effectively identify anorthosite-coking coal. In the actual test process, it is necessary to conduct repeated tests on various samples under various rock categories and various coals under various coal categories, record the working time and recognition time of each recognition process, and judge the accuracy of the image recognition process. In order to ensure the accuracy of coal and rock recognition based on machine vision, the recognition accuracy between different categories and between coal and rock samples is judged.


## 5. Coal and Rock Identification Test Based on Machine Vision

### 5.1. Coal-Rock Identification Accuracy Test

Sixteen samples are collected and 20 sets of data are tested for each sample, totaling 320 sets of data. Each sample can be placed in different directions, postures, and sizes (within the size range of sample specifications). The identification accuracy of 320 sets of data is counted, and the accuracy of sample identification is recorded and counted at the same time, as shown in Table4.Table 4
Identification accuracy test.
TypeNumber of correct identificationsTotal number of testsRecognition accuracy (%)Automatic identification numberGranite202010020Sandstone202010020Quartz sandstone202010020Diabase202010020Shale18209020Quartzite202010020Limestone18209020Anorthosite19209520Anthracite202010020Coking coal202010020Fat coal4202020Gas fat coal8204020Gas coal4202020Lignitous coal13206520Lignitous coal gangue12205020Bituminous coal gangue19209520Five of the eight rocks have 100% recognition accuracy and 96.9% average recognition accuracy, which fully meet the needs of rock identification. The recognition accuracy of coking coal, anthracite, and bituminous coal gangue is over 90%, which can meet the recognition standard. Due to the low lignite coalification, lignitous coal gangue is usually mixed in lignitous coal. The recognition accuracy of lignitous coal and lignitous coal gangue is only about 60%. Currently, the recognition accuracy of lignitous coal and lignitous coal gangue by radar and acoustic emission is less than 50%. Therefore, the coal-rock recognition method proposed in this paper has application value.The comprehensive recognition accuracy of this method is 93% for coal, rock, and gangue; 78% for coal and gangue; and 97% for rock. This method can accurately identify coal, rock, or gangue, which meets the needs of the coal and rock identification process and has practical application value.


### 5.2. Time-Consuming Test for Coal and Rock Identification

16 kinds of samples are tested, and the time of each test is counted, as shown in Table5.Table 5
Time for identify tests.
TypeTime for the first test(s)Time for the second test(s)Granite2.352.45Sandstone2.382.45Quartz sandstone2.452.46Diabase2.352.39Shale2.362.47Quartzite2.462.38Limestone2.352.36Anorthosite2.482.41Anthracite2.452.35Coking coal2.462.35Fat coal2.452.35Gas fat coal2.472.36Gas coal2.252.46Lignitous coal2.352.34Lignitous coal gangue2.412.35Bituminous coal gangue2.522.60The actual application of coal and rock identification in coal mine needs high speed. Nowadays, the recognition time of coal and rock identification technology is about 10 seconds. The experimental results show that the recognition time of 6 types of coal samples, 8 types of rock samples, and 2 types of coal gangue samples in this test is in the range of 2 s∼3 s, which is far less than 10 s, which can meet the requirements of recognition speed of coal and rock.


### 5.3. Coal-Rock Identification Morphological Parameter Test

The same sample is used to identify 20 times continuously. Taking bituminous coal gangue as an example, the average value, variance, and range of each morphological parameter are counted, as shown in Table6.Table 6
Morphological parameter test.
Statistical valueArea (mm2)Circumference (mm)Long axis (mm)Short axis (mm)RoundnessRectangularityAverage value3116.581231.493676.3375252.398870.6443440.779145Variance0.3983590.0281220.0003180.0001680.0001710.000306Standard deviation0.6311570.1676960.0056420.0129680.0001310.000175Range2.510.5860.02560.03360.000520.000622The accuracy of coal and rock image acquisition equipment has a great impact on the results of coal and rock identification. Therefore, it is necessary to test the morphological parameters in the process of coal and rock identification. In this test, 20 measurements are made on the same sample, and the range, variance, and standard deviation between the data obtained from 20 sets of data all meet the accuracy requirements of coal and rock identification. Random verification proves that the image recognition method in this paper is universal and the recognition rate is relatively stable. It has practical promotion value and can be applied in practice.


## 5.1. Coal-Rock Identification Accuracy Test

Sixteen samples are collected and 20 sets of data are tested for each sample, totaling 320 sets of data. Each sample can be placed in different directions, postures, and sizes (within the size range of sample specifications). The identification accuracy of 320 sets of data is counted, and the accuracy of sample identification is recorded and counted at the same time, as shown in Table4.Table 4
Identification accuracy test.
TypeNumber of correct identificationsTotal number of testsRecognition accuracy (%)Automatic identification numberGranite202010020Sandstone202010020Quartz sandstone202010020Diabase202010020Shale18209020Quartzite202010020Limestone18209020Anorthosite19209520Anthracite202010020Coking coal202010020Fat coal4202020Gas fat coal8204020Gas coal4202020Lignitous coal13206520Lignitous coal gangue12205020Bituminous coal gangue19209520Five of the eight rocks have 100% recognition accuracy and 96.9% average recognition accuracy, which fully meet the needs of rock identification. The recognition accuracy of coking coal, anthracite, and bituminous coal gangue is over 90%, which can meet the recognition standard. Due to the low lignite coalification, lignitous coal gangue is usually mixed in lignitous coal. The recognition accuracy of lignitous coal and lignitous coal gangue is only about 60%. Currently, the recognition accuracy of lignitous coal and lignitous coal gangue by radar and acoustic emission is less than 50%. Therefore, the coal-rock recognition method proposed in this paper has application value.The comprehensive recognition accuracy of this method is 93% for coal, rock, and gangue; 78% for coal and gangue; and 97% for rock. This method can accurately identify coal, rock, or gangue, which meets the needs of the coal and rock identification process and has practical application value.


## 5.2. Time-Consuming Test for Coal and Rock Identification

16 kinds of samples are tested, and the time of each test is counted, as shown in Table5.Table 5
Time for identify tests.
TypeTime for the first test(s)Time for the second test(s)Granite2.352.45Sandstone2.382.45Quartz sandstone2.452.46Diabase2.352.39Shale2.362.47Quartzite2.462.38Limestone2.352.36Anorthosite2.482.41Anthracite2.452.35Coking coal2.462.35Fat coal2.452.35Gas fat coal2.472.36Gas coal2.252.46Lignitous coal2.352.34Lignitous coal gangue2.412.35Bituminous coal gangue2.522.60The actual application of coal and rock identification in coal mine needs high speed. Nowadays, the recognition time of coal and rock identification technology is about 10 seconds. The experimental results show that the recognition time of 6 types of coal samples, 8 types of rock samples, and 2 types of coal gangue samples in this test is in the range of 2 s∼3 s, which is far less than 10 s, which can meet the requirements of recognition speed of coal and rock.


## 5.3. Coal-Rock Identification Morphological Parameter Test

The same sample is used to identify 20 times continuously. Taking bituminous coal gangue as an example, the average value, variance, and range of each morphological parameter are counted, as shown in Table6.Table 6
Morphological parameter test.
Statistical valueArea (mm2)Circumference (mm)Long axis (mm)Short axis (mm)RoundnessRectangularityAverage value3116.581231.493676.3375252.398870.6443440.779145Variance0.3983590.0281220.0003180.0001680.0001710.000306Standard deviation0.6311570.1676960.0056420.0129680.0001310.000175Range2.510.5860.02560.03360.000520.000622The accuracy of coal and rock image acquisition equipment has a great impact on the results of coal and rock identification. Therefore, it is necessary to test the morphological parameters in the process of coal and rock identification. In this test, 20 measurements are made on the same sample, and the range, variance, and standard deviation between the data obtained from 20 sets of data all meet the accuracy requirements of coal and rock identification. Random verification proves that the image recognition method in this paper is universal and the recognition rate is relatively stable. It has practical promotion value and can be applied in practice.


## 6. Conclusion

(1)
The images of 6 kinds of coal, 8 kinds of rocks, and 2 kinds of coal gangue are collected. The image processing is based on the two-dimensional discrete wavelet transform (2D-DWT) of steerable pyramid tower decomposition (SPD). The method has an obvious visual enhancement effect and obvious surface features. 30 groups of 480 samples of each type are selected to establish the image database.(2)
The maximum likelihood estimation method is used for machine vision recognition. The recognition accuracy of shale and limestone is 90%, that of anorthosite is 95%, and that of other rocks is 100%. In this method, the comprehensive recognition accuracy of coal, rock, and gangue is 93%, the comprehensive recognition rate of coal and gangue is 78%, and the accuracy of rock type identification is 97%.(3)
The identification time of 6 types of coal samples, 8 types of rock samples, and 2 types of coal gangue samples in this test is in the range of 2 s∼3 s, which is far less than 10 s, which can meet the requirements of coal and rock identification in terms of identification speed. The same coal gangue sample is measured for 20 times, and the range, variance, and standard deviation between the data are obtained according to 20 groups of data. The range, variance, and standard deviation of each data meet the accuracy requirements of coal and rock identification. This paper provides an effective method to improve the recognition accuracy of coal rock and gangue and provide a theoretical basis for intelligent adjustment of drum.



---

*Source: 6617717-2021-03-13.xml*