Enhancing Sustainable Automated Fruit Sorting: Hyperspectral Analysis and Machine Learning Algorithms
Authors: Khort Dmitry O. , Kutyrev Alexey , Smirnov Igor , Andriyanov Nikita , Filippov Rostislav , Chilikin Andrey , Astashev Maxim E. , Molkova Elena A. , Sarimov Ruslan M. , Matveeva Tatyana A. , Gudkov Sergey V. 
Published: November 2024

Recognizing and classifying localized lesions on apple fruit surfaces during automated sorting is critical for improving product quality and increasing the sustainability of fruit production. This study is aimed at developing sustainable methods for fruit sorting by applying hyperspectral analysis and machine learning to improve product quality and reduce losses. The employed hyperspectral technologies and machine learning algorithms enable the rapid and accurate detection of defects on the surface of fruits, enhancing product quality and reducing the number of rejects, thereby contributing to the sustainability of agriculture. This study seeks to advance commercial fruit quality control by comparing hyperspectral image classification algorithms to detect apple lesions caused by pathogens, including sunburn, scab, and rot, on three apple varieties: Honeycrisp, Gala, and Jonagold. The lesions were confirmed independently using expert judgment, real-time PCR, and 3D fluorimetry, providing a high accuracy of ground truth data and allowing conclusions to be drawn on ways to improve the sustainability and safety of the agrocenosis in which the fruits are grown. Hyperspectral imaging combined with mathematical analysis revealed that Venturia inaequalis is the main pathogen responsible for scab, while Botrytis cinerea and Penicillium expansum are the main causes of rot. This comparative study is important because it provides a detailed analysis of the performance of both supervised and unsupervised classification methods for hyperspectral imagery, which is essential for the development of reliable automated grading systems. Support Vector Machines (SVM) proved to be the most accurate, with the highest average adjusted Rand Index (ARI) scores for sunscald (0.789), scab (0.818), and rot (0.854), making it the preferred approach for classifying apple lesions during grading. K-Means performed well for scab (0.786) and rot (0.84) classes, but showed limitations with lower metrics for other lesion types. A design and technological scheme of an optical system for identifying micro- and macro-damage to fruit tissues is proposed, and the dependence of the percentage of apple damage on the rotation frequency of the sorting line rollers is obtained. The optimal values for the rotation frequency of the rollers, at which the damage to apples is less than 5%, are up to 6 Hz. The results of this study confirm the high potential of hyperspectral data for the non-invasive recognition and classification of apple diseases in automated sorting systems with an accuracy comparable to that of human experts. These results provide valuable insights into the optimization of machine learning algorithms for agricultural applications, contributing to the development of more efficient and accurate fruit quality control systems, improved production sustainability, and the long-term storage of fruits.