System and method for determining backfinned loins

The disclosure relates to a system and method for identifying one or more features in a meat sample. In one embodiment, the system and method disclosed herein uses automated methods to identify a backfinned pork loin and a non-backfinned pork loin. The system and method disclosed herein comprises imaging a meat sample with an imaging device to obtain one or more images; and using an iteratively trained feature detection model to detect and identify one or more features, including the presence or absence of the features in the images of the meat sample.

BACKGROUND OF THE INVENTION

The meat processing industry has an interest in maximizing the yield from individual animal carcasses through efficient processing methods in order to optimize meat cuts. For example, slaughterhouse systems can be designed to optimize the sorting and classification of carcasses based on a plurality of characteristics in order to predict cuts that will result in the highest yield for each carcass.

Existing solutions for sorting meat products for commercial cuts use weight as a data input for a sorting process. Weight-based sorting requires precisely calibrated scales and can still result in backfinned loins routing to a bone-in loin processing line, where backfinned loins cannot be properly processed. Other existing solutions do not sort loins according to backfinned versus non-backfinned to improve processing efficiencies. Accordingly, a need exists for an automated, objective, efficient, and accurate identification and classification of one or more features, including backfinned, in a meat sample.

BRIEF SUMMARY OF THE INVENTION

The present invention is directed generally to systems and methods for determining backfinning in meat samples. The system can be provided in the form of an advanced feature detection system designed to determine a plurality of features in a meat sample, including but not limited to backfinning, using an advanced detection training model.

According to a first embodiment, a feature detection system configured to analyze a meat sample can include a data capture device provided in a form of an image capture device. The system can further include a transport system with the meat sample positioned in a field of view of the image capture device. The system may also include a feature detection model including a processor. The processor can be configured to process a plurality of data elements received from the data capture device and identify one or more features of the meat sample. The system can further include an ejector configured to sort the meat sample according to an output of the feature detection model. In some embodiments, the system also includes a notification system designed to generate a notification provided in the form of an identification of the one or more features of the meat sample. In some embodiments, the identification includes a presence or an absence of backfinning in the meat sample. In some embodiments, the feature detection model includes an iteratively trained machine learning model. In some embodiments, the feature detection model includes a training model, a validation model, and a trained model. In some embodiments, the validation model comprises applying one or more detection models to a validation sample set to quantify the accuracy of the one or more detection models. In some embodiments, the validation sample set can include images with associated known attributes. In some embodiments, the plurality of data elements are provided in the form of high-resolution images.

According to a second embodiment, a method for determining a feature of a meat sample comprises capturing a data element provided in a form of an image of the meat sample. The method can further include extracting a feature parameter from the image of the meat sample. The method can also include processing the feature parameter using an iteratively trained feature detection training model. The method can further include determining an identification of the feature of the meat sample. The method can also include generating a signal to an ejector to sort the meat sample based on the identification of the feature. In some embodiments, the feature parameter includes an input vector. In some embodiments, the feature includes the presence or absence of backfinning in the meat sample. In some embodiments, capturing the data element comprises triggering a camera when the meat sample comes within a visual field of the camera.

According to a third embodiment, a method for determining a feature of a meat sample includes collecting an image of the meat sample from a data capture device provided in a form of a camera. The method can also include extracting a feature parameter from the image of the meat sample using a processor. The method can further include processing the feature parameter using an iteratively trained feature detection training model. The method can also include identifying a feature of the meat sample based on the output of the iteratively trained feature detection training model. The method can also include determining an identification of the feature of the meat sample. The method can further include generating a notification comprising the identification of the feature of the meat sample and storing the notification in one or more databases. In some embodiments, the method includes validating the iteratively trained feature detection training model by applying one or more detection models to a validation sample set to quantify the accuracy of the one or more detection models. In some embodiments, the step of identifying the feature of the meat sample is performed by matching one or more model feature parameters of the trained detection model with the feature parameter of the image. In some embodiments, the method also includes generating a signal to an ejector to sort the meat sample based on the identification of the feature. In some embodiments, the ejector can sort the meat sample by routing the samples to a specific processing station, a cutting station, a packaging station, a labeling station or a combination thereof, based on a presence or an absence of one or more features. In some embodiments, the method also includes displaying the notification on a user interface.

DETAILED DESCRIPTION OF THE INVENTION

The following detailed description of the invention references specific embodiments in which the invention can be practiced. The embodiments are intended to describe aspects of the invention in sufficient detail to enable those skilled in the art to practice the invention. Other embodiments can be utilized, and changes can be made without departing from the scope of the present invention. It will be appreciated that some or all of the various features and structures described and shown with respect to each of the specific embodiments referenced herein may be combined to form additional or alternative embodiments having such combinations and that such combinations are within the scope of the present invention.

Referring to the figures, one embodiment and aspect of the present invention is directed toward a system and method for generating a feature detection model to objectively characterize and sort bone-in loins. In one instance, the system and method are specifically adapted for determining the presence of backfinning in a pork loin using advanced image processing techniques and sorting the loin according to the determination. The system and processes described can also be used to iteratively train a detection training module to detect a plurality of features of a meat sample. The system is configured to process and transform raw data elements from a plurality of data sources to provide advanced loin sortation determinations based on detected meat sample features using an advanced detection training module. The system may then use an iteratively trained training module that can be updated and retrained based on updates to the data elements received from a plurality of data sources to provide a more efficient and accurate detection output.

As described in greater detail herein, the system and method of the present invention can allow for the detection of a plurality of meat sample features, like backfinning, on the cut floor. In another embodiment, the detection of a plurality of features can be determined on the kill floor while the carcass is still intact. In one embodiment, the sortation module and feature detection module may be accomplished with and without using weight as inputs. This may in turn allow for cut floor planning early in the processing phases and without a need for consistent scale calibration, thereby leading to increased efficiency and utilization of the processing resources. It will be understood that the systems and methods described herein may be utilized in connection with the processing of carcasses of various meat-producing animals including, but not limited to, hogs, beef cattle, lambs, and others. Additionally, although the system and method described herein are discussed in relation to a loin, it will be understood that other types of primal and subprimal cuts can be processed and sorted using the disclosed system and method and processes described herein. Additionally, although the system and method described herein are related to determining backfinning, other characteristics and features can be determined in connection with the processes described herein.

FIG.1illustrates an advanced feature detection system100for use in identifying and classifying one or more features in a meat sample, as described herein. In various embodiments, the feature detection system100includes a networked system designed to perform one or more processes for advanced image processing and transform data into an objective classification of the presence or absence of a feature based on one or more parameters. The feature detection system100may include, but is not limited to, a conveyor belt system110, one or more data capture devices120, a plurality of data elements125, one or more feature detection models130, one or more databases140, a network150, a controller160, a notification system170, an alert system175, and a processing unit180.

In various embodiments, the conveyor belt system110can be designed to transport meat samples (e.g., pork loins) through a meat processing system. According to some embodiments, the conveyor belt system110can be provided in the form of a roller system, a timing belt, an automated line system, a chain, a robotic system, or another form of a production line. It will be understood by those skilled in the art that the embodiments described herein that the conveyor belt system110may also include additional hardware and software components (not shown) including, but not limited to, sensing devices, controllers, switches, processors, and similar, to facilitate the operation of a production line or similar. In some embodiments, the conveyor belt system110can communicate with or be integrated with the network150for the overall feature detection system100to perform advanced analytics related to the productivity and efficiency of the production line. In another embodiment, the conveyor belt system110can be a transportation system for moving meat from one location to a second location. In another embodiment, the conveyor belt system can be communicatively coupled or otherwise integrated with the one or more data capture devices120. In some embodiments, the conveyor belt system can include one or more integrated scales or other weight capture devices. In some embodiments, a weight measurement detected by the weight capture device(s) can be transmitted to the trained feature detection model.

In various embodiments, the one or more data capture devices120can refer to a 2D camera, a 3D camera, an image capture device, scanning device, or other sensing devices. In one embodiment, the one or more data capture devices120may include an image sensor system and/or an image data capture system. In one embodiment, the data capture device120can be provided in the form of a deep learning camera. In one embodiment, the one or more data capture devices120may include a camera configured to obtain image data within a visual field. In at least this embodiment, the data capture device120can include a camera designed to trigger when a meat sample comes within the visual field of the camera. In some forms, the data capture device120is designed to self-trigger using a photoelectric sensor or similar sensing device that closes an electrical connection when an object passes by the visual field (or other sensing area) of the data capture device120, In some aspects, the data capture device120can be operated in a continuous (or near continuous) mode, such that the data capture device120is provided in the form of a live stream capturing image(s) based on an interval of frames per seconds. In some forms, the data capture device can be trained to accept or otherwise filter images where the meat sample is in the correct field of view. The accepted images can be further processed by the trained model. In one non-limiting example, the one or more data capture devices120may be configured to capture and/or retrieve the plurality of data elements125, provided in the form of image files of meat on the conveyor belt system110. In some embodiments, the image files may be provided in the form of 2D image files, 3D image files, or digital image files.

In one embodiment, the one or more data capture devices120may include an image sensor system. The image sensor system can include a presence detector system. In some embodiments, the presence detector system can be a photoelectric sensor (e.g., a photo eye). More specifically, in a non-limiting embodiment, the presence detector system can include a through-beam photoelectric sensor provided in the form of a transmitter and a detector. The transmitter can be designed to emit electromagnetic energy (e.g., infrared electromagnetic energy, visible electromagnetic energy, etc.) toward the detector. In this embodiment, the detector can be designed to detect the electromagnetic energy emitted by the transmitter. If the detector fails to detect the electromagnetic energy, the detector can generate a signal indicative of an object passing between the transmitter and the detector. In other embodiments, the presence detector system may be a through-beam photoelectric sensor that includes a transceiver in place of the detector and a reflector in place of the transmitter. In this alternative embodiment, the transceiver can emit electromagnetic energy toward the reflector, which reflects the electromagnetic energy to the transceiver. When a break in the electromagnetic energy is detected by the transceiver, the transceiver can generate a signal indicative of an object passing between the transceiver and the reflector. In other embodiments, the presence detector system may be a diffusing photoelectric sensor that is located on only one side of the transportation system and is capable of detecting the presence of an object on the conveyor belt system110.

In one embodiment, the one or more data capture devices120can be connected to a computing device (not shown) through a high-speed cable linkage, such as USB2, FireWire, or through cable linkage to an image capture card on the computer, high-speed wireless linkages (e.g., 802.11n), or other network connections described in connection with the network150below, or similar connection, or a combination thereof. In one embodiment, the one or more data capture devices120is communicatively coupled to a computing device (not shown) via the network150. In some embodiments, the one or more data capture devices120can be designed to send the plurality of data elements125to the computing device via the network150. In some embodiments, the one or more data capture devices120can be provided in the form of a camera or image sensor system with an integrated computing device, processor, or similar.

The computing device can be any device capable of executing processing options, including a network-capable device. The computing device can include a processor and a memory unit. The computing device can further include a display or other interface to configure, monitor, execute, and control various functions of the feature detection system100. The computing device may include or otherwise be in communication with a processing unit180. The processing unit180can include one or more machines on a production line that are configured to physically process carcasses, as described in more detail below.

In an embodiment where the one or more data capture devices120is a camera, and the plurality of data elements125are images or image files of meat, the resolution of an image can vary according to the distance of the camera from the surface of the meat. In this embodiment, a method for maintaining a relatively constant distance of the camera from the surface of the meat can be used to maintain a constant resolution in the images.

In one embodiment, the plurality of data elements125can include image files captured by the one or more data capture devices120. In one embodiment, the plurality of data elements125can include images of the meat samples on the conveyor belt system110. In one embodiment, the meat sample is located on the conveyor belt system110within the field of view of the one or more data capture devices120. In some embodiments, the meat sample is specifically positioned on a conveyor belt saddle to align within the field of view of the one or more data capture devices120.

In this embodiment, the one or more data capture devices120can be designed to capture the plurality of data elements125, including but not limited to images, image files, video files, or a combination thereof. In some embodiments, the image files are minimally compressed to help enhance feature detection. In some embodiments, the image files may be compressed to improve image transfer speeds. It will be recognized by one skilled in the art that other types of data elements are contemplated within the scope of the embodiments described herein, including, for example, size, color, temperature, etc.

In one embodiment, the data capture process (e.g., imaging) can be taken over a short period of time, since the object or meat, on which the measurements are taken are often moving continuously, and the cameras or other data capture devices120are fixedly positioned. In some embodiments, the one or more data capture devices120may be mounted or positioned using a movable apparatus, including a multi-directional track or adjustable axis device. In one example, exposure timing can be under 1 millisecond. In another embodiment, exposure timing can be under 50 milliseconds. In a third embodiment, exposure timing can be under 125 milliseconds. Techniques for decreasing exposure time can include, for example, increasing the illumination or increasing a camera aperture.

Returning toFIG.1, in some embodiments, the plurality of data elements125can be analyzed using one or more feature detection models130. In certain embodiments, one or more features are extracted from an image of the meat sample and analyzed using one or more feature detection models130to identify a plurality of features and classify the meat sample. In certain embodiments, the plurality of data elements125are analyzed using one or more detection models130to predict the absence or presence of a plurality of features based on one or more parameters. In some embodiments, there may be multiple feature detection models130, each develop and trained to detect and classify a particular feature. In other embodiments, the feature detection model130may be developed and trained to accurately identify and classify multiple types of features. For example, in one non-limiting embodiment, the feature detection model130may be provided in the form of an advanced image processing module, designed to identify the presence of a plurality of features in an image of a meat sample. In this embodiment, the features may include but are not limited to those shown and described in connection withFIGS.2A-3B.

In certain embodiments, the one or more detection models130can include machine learning, artificial intelligence, a linear statistical model, a non-linear model, a logistic regression, a neural network, other processing models, other modeling and analysis techniques, or a combination thereof. In certain embodiments, the one or more models are created using AlexNet™ GoogleNet™, Python™, MatLab™, Cognex VisionPro™, Cognex In-Sight Vision Suite™, AWS SageMaker™, or other publicly available neural networks and/or deep-learning vison tools. The one or more detection models130are described in more detail in connection with the processes described inFIGS.4-6.

The one or more databases140can generally refer to internal or external systems, data sources, scanning devices, or other platforms from which various data is received or collected. The one or more databases140can include the plurality of data elements125, individual data points extracted therefrom, or other information processed, collected, or received by the feature detection system100. The one or more databases140can further be used to process, clean, map, triangulate, or validate data across the feature detection system100or other embodiments of a networked feature detection system.

The collected data stored in the one or more databases140can include the plurality of data elements125, including images and image files, calibration data, parameter data, validation data, threshold data, etc. The feature detection system100can receive or retrieve image data which may include but is not limited to raw data points, pixels, vectors, measurements, or similar information. The information received or collected by the feature detection system100can be stored in the one or more databases140. In some embodiments, the one or more databases140can be provided in the form of a memory unit, processor, elastic cache system, cloud storage, or similar.

The one or more databases140can include module data associated with iteratively training the detection training module(s) and other modeling processes described herein. Non-limiting examples of module data can include but are not limited to, machine learning techniques, parameters, guidelines, emphasis values (e.g., weight values), input and output datasets, training datasets, validation sets, configuration properties, and other settings. In one example, module data includes a training dataset including historical image data, carcass composition metrics, calibration data, trim specification data, and weight. In this example, the training dataset can be used for training a detection training module to provide an objective feature classification based on a specific feature parameter or other classification value. For example, the system may use the module data to iteratively train a detection training module to identify one or more features of a meat sample, where the feature parameters are modeled based on historical data from the one or more databases140while also incorporating new data from expected new meat sample values and carcass characteristics as animal genetics and overall carcass parameters evolve over time.

In some embodiments, the devices and aspects ofFIG.1can communicate directly with one another over the network150. The network150includes, for example, the Internet, intranets, extranets, wide area networks (“WANs”), local area networks (“LANs”), wired networks, a coaxial cable data communication network, an optical fiber network, a direct wired serial communication connection (e.g., USB), wireless networks, such as a WiFi network, a radio communication network, a cellular data communication network (e.g., 4G, 5G, LTE, etc.), a direct wireless communication connection (e.g., Bluetooth, NFC, etc.), or other suitable networks, or any combination of two or more such networks. For example, such networks can include satellite networks, cable networks, Ethernet networks, and other types of networks. In some embodiments, the network may be a private network (e.g., a private LAN), a public network (e.g., the internet), or a combination of private and/or public networks.

The feature detection system100can include one or more controllers160provided in the form of a programmable logic controller (PLC), or similar control device. In some embodiments, the one or more controllers160can be constructed, programmed, configured, or otherwise adapted, to autonomously carry out a function or set of functions of the processes described herein. A controller160can include one or more components, including both software and/or hardware components, including an application-specific integrated circuit (ASIC) or field programmable gate array (FPGA), in some embodiments. In some embodiments, the controller160can include a combination of hardware and software, such as by a microprocessor system or similar processor module, wherein the process module can be designed to execute a set of program instructions by the controller to perform one or more steps of the processes provided herein.

In some embodiments, at least a portion of a controller160can be executed on the processor(s) of one or more computing platforms or computing devices to execute one or more control functions including but not limited to multitasking, multithreading, distributed (e.g., cluster, peer-peer, cloud, etc.) processing, and similar processing techniques. Further, a controller160can further include one or more subassemblies, modules, or similar, each of which can be provided in the form of an individually controlled controller.

Moreover, in the embodiments described herein, the one or more controllers160can execute functions autonomously, however semi-autonomous or operator-controlled, or similar, operations are also contemplated in some embodiments. Further, wherein one controller160is described to execute an instruction to perform a function herein, it will be understood by one skilled in the art that one or more subassemblies or controllers can execute individual tasks or functions.

The controller160can be any device capable of transmitting and/or executing processing instructions, including a network-capable device. The controller160can include a processor and a memory. The controller160can include a display or other interface to configure, monitor, execute, and control various functions of the feature detection system100. The controller160may include or otherwise be in communication with a processing unit180. In at least one embodiment, the controller160may be designed to receive and process one or more images of the meat sample and/or a weight of the meat sample, and determine the appropriate processing line or processing section for the meat sample. In this embodiment, the controller160can send a signal to the processing unit180to move or transport the meat sample to the appropriate processing line or processing section. In at least this way, the controller160can be provided in the form of a deep learning controller. In some embodiments, the data capture, data processing, and output determination may be performed by a single device configured of hardware and/or software. In some embodiments, the feature detection system100can generate a prediction or classification of the presence or absence of a feature in a meat sample. The feature detection system100can generate a notification via a notification system170to communicate a classification (e.g., presence of backfinning, normal, flipped rib, flipped fat, etc.). In some embodiments, the notification system170can include a user interface, a communication interface, or a combination thereof.

In one embodiment, a user interface of the notification system170can be a computing device and can be in communication with one or more input or output devices (not shown) that are capable of receiving inputs into and/or outputting any outputs from the computing device or other aspects of the notification system170. Embodiments of input devices can include but are not limited to, a keyboard, a mouse, a touchscreen display, a touch-sensitive pad, a motion input device, a movement input device, an audio input, a pointing device input, a joystick input, a keypad input, peripheral device, foot switch, or similar input device. Embodiments of output devices can include but are not limited to, an audio output device, a video output, a display device, a motion output device, a movement output device, a printing device, or a similar output device. In some embodiments, the user interface includes hardware that can be designed to communicate with one or more input devices and/or output devices via wired and/or wireless connections.

In some embodiments, the notification system170can further include an alert system175to provide an audible and/or visual alert at the detection of backfinning. In some embodiments, the alert system175can be in communication with the notification system. In some embodiments, both the notification system170and the alert system175may be provided in the form of integrated subsystems to the controller160. In some embodiments, the alert system175may be provided in the form of a light bar or similar illuminated notification device.

The feature detection system100can further include a processing unit180. The processing unit180can include one or more machines on a production line that are configured to physically process carcasses according to the customized processing options generated by the system and processes described herein. In some embodiments, the processing unit180can be provided in the form of an ejector designed to sort the meat samples into different sections of the production line according to the output of the feature detection system, as described in more detail in connection withFIG.4.

The feature detection system100may further include a computing environment provided in the form of one or more computing devices that communicate together over the network150. According to some embodiments, the elements of the computing environment can be provided in the form of a plurality of computing devices that may be arranged, for example, in one or more server banks or computer banks, or other arrangements. Such computing devices can be located in a single installation or may be distributed among many different geographical locations. For example, the computing environment can include a plurality of computing devices that together may include a hosted computing resource, a grid computing resource, and/or any other distributed computing arrangement. In some cases, the computing environment can correspond to an elastic computing resource where the allotted capacity of processing, network, storage, or other computing-related resources may vary over time.

Computing devices and other devices discussed herein can include a memory unit. A memory unit can comprise volatile or non-volatile memory to not only provide space to execute program instructions, algorithms, or the advanced analytics models described herein, but to provide the space to store the instructions, data, and other information. In embodiments, volatile memory can include random access memory (RAM), dynamic random access memory (DRAM), or static random access memory (SRAM), for example. In embodiments, non-volatile memory can include read-only memory, flash memory, ferroelectric RAM, hard disk, floppy disk, magnetic tape, or optical disc storage, for example. The foregoing lists in no way limit the type of memory that can be used, as these embodiments are given only by way of example and are not intended to limit the scope of the invention.

As shown inFIGS.2A and2B, in one embodiment, a high-resolution image is obtained of pork loin.FIG.2Ais a representative illustration of a backfinned pork loin.FIG.2Bis a representative illustration of a non-backfinned pork loin.

As shown inFIGS.3A and3B, in one embodiment, a high-resolution image is obtained of pork loin.FIG.3Ais a representative illustration of a flipped rib pork loin.FIG.3Bis a representative illustration of a flipped fat pork loin. In at least these embodiments, the feature detection system100can detect multiple features of the pork loin and/or positions of the loin on the conveyor belt110.

It will be recognized by one skilled in the art that various features and types of meat samples can be analyzed by the systems and processes disclosed herein. Thus, the detection methods described herein can be applied to different meat cuts from the same carcass and similar cuts from a plurality of carcasses.

In some embodiments, the system receives or retrieves feature specification data, which can include but is not limited to a plurality of trim specifications corresponding to each of the primal and sub-primal cuts to be completed by one or more processing units180or other processing devices of the system. In some embodiments, the plurality of trim specifications may include detailed processing options regarding one or more of the following: skin-on, skin-off, bone-in, boneless, target separation for a blade bone cross section, the presence or absence or protrusion(s), cut dimensions, muscle dimension(s), fat depth and/or thickness, and an attachment or removal of specific muscles, bones, and/or other carcass components.

FIGS.4-6are flow diagrams illustrating the training and operation of one or more detection models130, according to one representative embodiment. The process includes two main phases: inference (operation) of the one or more feature detection models130(FIG.5) and iteratively training the one or more feature detection models130(FIG.6).

When used throughout the present disclosure, one skilled in the art will understand that processes for “iteratively training the training module” can include machine learning processes, artificial intelligence processes, and other similar advanced machine learning processes. For example, the system and processes of the present disclosure can predict a pass/fail objective classification for a plurality of meat samples having different individualized parameters and can leverage the known characteristics of meat samples with similar metrics as an input to an iterative training process for an automated detection and objective classification of a feature based on a plurality of parameters. A representative, non-limiting example of trained learning is shown inFIG.4, in one embodiment, a trained feature model may be developed and used in a feature detection process400to determine the presence or absence of one or more of a plurality of features in meat samples. First, image data of meat samples is received or otherwise collected410. The image data of the meat sample may be received410by one or more data capture devices120, such as a camera or other imaging device. In some embodiments, the image data of the meat sample can be obtained while the meat is being transported by the conveyor belt system110, or similar transport system, as described in more detail in connection withFIG.1.

In some embodiments, the image data includes image files, video files, or other data elements125as described in connection withFIG.1. In some embodiments, the image data can include 2D image files, 3D image files, digital files, or video files of meat samples with or without a plurality of features. In some embodiments, the image data capture system used to obtain the training image data (as described in connection withFIG.6) is the same as the image data capture system that will be used to obtain image data of the meat samples after the trained image analysis model is created. In some embodiments, low-quality images (e.g., blurry, too dark, too bright, etc.) can be automatically excluded from the image data. In some embodiment, the image data may be pre-processed, filtered, or otherwise analyzed, edited, or processed before step420or throughout other steps of the feature detection process400.

In some embodiments, the image data of the meat sample is input into a trained image analysis model at step430. The trained image analysis model may be operating on a computing device, such as a local computing device at the image data capture system or a remote computing device from the local computing device. The trained image analysis model can be designed to detect the presence or absence of one or more features based on the image data. The trained image analysis model analyzes the image data and makes a determination of the presence or absence of a feature at step430, described in more detail inFIG.5.

In some embodiments, the determination of the presence or absence of a feature at step430may further include an indication of a degree of certainty as to the determination. In some embodiments, the indication of the degree of certainty can include a validation process and a calculation of an error metric.

In one specific example, the determination of the presence of a feature (e.g., backfinning) of the meat sample is communicated to a controller160communicatively coupled to a routing system that can be designed to route meat samples on a transportation system using an ejector of similar processing unit180based on receiving a signal from the controller at step450. In this example, the ejector can move a loin or other meat sample to a particular processing line based on the presence or absence of a feature at step460, such as routing backfinned samples so they do not appear in the bone-in loin processing line. In some embodiments, the ejector or other processing unit180can route meat samples to a specific processing station, cutting station, packaging station, and/or labeling station based on the presence or absence of one or more features. In some embodiments, the ejector or processing unit can push or move a meat sample to a production line with a scale to be weighed. In at least this way, the feature detection system100can provide fine-tuned and customized process sorting instructions based on one or more factors, including the output of the feature detection model and the weight of the meat sample. In another embodiment, the weight is not used in sorting and processing one or more meat samples.

In some embodiments, the trained model can be developed based on input vectors, which are indicative of a characteristic of the meat samples. In one example, the input vector may be the variation in the color of the pixels of the meat sample. In one example, the variation of the color may indicate a level of marbling of the meat sample. In other examples, the input vectors may be colors in the visible spectrum, peaks of wavelengths detected in non-visible electromagnetic energy (e.g., ultraviolet, infrared), the presence and numbers of different types of non-meat tissue (e.g., bone, fat), the presence and/or absence of a cut, the presence and/or absence of featherbones, one or more defects, or any other number of possible input vectors or parameters.

In one embodiment, the input vector may be visible backfinned featherbone boundaries visible along the interior surface of a loin, including color, size, shape etc. The use of input vectors for training may help the trained detection model identify the presence or absence of a feature in a meat sample without characteristics that a person would normally look for when manually identifying the type of the meat sample. The use of the input vectors allows the trained detection model to detect the type of the meat sample without the need for a human to identify the meat samples. After the input vectors are modeled, a trained detection model can be developed as a decision-making process based on a number of the input vectors. Examples of decision-making processes include decision trees, neural networks, and the like. In some embodiments, the decision-making process of the trained detection model is based on a determination of an acceptable arrangement of the input vectors in the decision-making process.

As shown inFIG.5, the trained detection model can further be used to perform advanced image analysis techniques on the one or more data elements125during the detection step430to identify the presence or absence of a feature in a meat sample. In some embodiments, the images collected from the one or more data capture devices120in step420ofFIG.4, are received or retrieved by the trained detection model at step510. The image(s) are then used as an input to the detection model at step520. As described in connection withFIG.4, once the trained image analysis model makes the determination of an objective identification and classification of a feature at step530, the system can generate a notification at step540and communicate the feature identification to one or more controllers160. In some embodiments, the feature detection process at step530is performed by matching one or more feature parameters of the trained detection model with one or more feature parameters of the input image data. In this embodiment, the system identifies the presence or absence of one or more features in the meat sample. In some embodiments, the notification system170generates the notification. In some embodiments, the notification can be received by one or more display or other user interface devices. The notification may also be communicated via a communication interface to one or more external devices, communicated over the network150, stored in one or more databases140, or another output method.

As depicted inFIG.6, in one embodiment, the iterative training process600for iteratively training the one or more detection models130begins with receiving or otherwise obtaining image data of meat cuts or samples with and without a feature. The image data will be labeled for the presence or absence of a feature by visual inspection620. In some embodiments, step620can be completed by a human. In another embodiment, the step620can be completed by an automated image processing or analysis system, a robotic system, an artificial intelligence system, or similar. In one example, an image can be tagged (either by user input or via image processing analysis techniques) as being an image of a backfinned loin. This image can be stored in the one or more databases140, including the associated feature parameters associated with the image. The image data and feature parameters can then be matched to other images to determine if they also have the backfinned feature. In some embodiments, low-quality images (e.g., blurry, too dark, too bright, etc.) were excluded from the training image data.

The labeled training image data can then be input into a training module630. In some embodiments, the labeled training image can be validated by either manual or automated techniques before the input step630. The labeled training image data is used to iteratively train or teach the detection model to identify a feature in a meat sample640. After the training module, a trained feature detection model for determining the presence or absence of a feature is developed650.

In some embodiments, the trained detection model includes a neural network that has several layers. In one embodiment, the neural network is a multilayer neural network. In some embodiments, the input nodes represent inputs into the trained models (e.g., image data, metadata associated with the image data, etc.), one or more of the hidden nodes (e.g., one of the layers of hidden nodes) may represent one of the input vectors determined during the development of the detection model, and the output node represents the determined type of the meat being analyzed. In some embodiments, to iteratively train the one or more detection models130, the system can compare a set of training outcomes from each of a plurality of training data sets and update one or more emphasis guidelines, classification values, characteristics, parameters, or similar. Additionally, in some embodiments, the comparison of the plurality of training data set outcomes can allow for the calculation of one or more error metrics between the input data and the output data. In at least one embodiment, the system can include a plurality of detection models130, configured to generate outcomes, predictions, or classifications based on a particular data element characteristic. In some embodiments, the particular data element characteristic can include parameters related to the meat sample, a specific feature, the type of carcass, or one or more image capture considerations (e.g., illumination consistency, glare, color, etc.). The trained detection model can be implemented for determining the presence or absence of a feature in a meat sample as outlined inFIGS.4and5.

In some embodiments, a training module performs the iterative training of the one or more detection models130. In some embodiments, the one or more detection models130can include an architecture with a certain number of layers and nodes, with biases and emphasis guidelines between the nodes. During training, the training module can determine the values of parameters weights and biases) of the machine learning model, based on a set of training samples. In one embodiment, the training module receives a training set for training. The training samples in the training set can include images captured by the camera. For supervised learning, the training set typically also includes tags or labels for the images. The tags or labels can include whether or not the meat sample has a particular feature.

In an example of iterative training, a training sample is presented as an input to the one or more detection models130, which then produces an output for a particular feature. The difference between the output of the one or more detection models130and a known output is used by the training module to evaluate and adjust (as needed) the values of the parameters in the one or more detection models130. This is iteratively repeated for a plurality of training samples to improve the performance of the one or more detection models130.

The training module can also validate the trained the one or more detection models130based on additional validation samples. For example, the training module applies the one or more detection models130to a validation sample set to quantify the accuracy of the one or more detection models130. The validation sample set can include images with associated known attributes. The output of the one or more detection models130can be compared to the known attributes of the validation sample set. In one embodiment, developing the one or more detection models130can include using validation data to compare to training data to determine if the one or more detection models130was being overfitted to the training data.

As used herein, “a,” “an,” or “the” can mean one or more than one. For example, “an” image can mean a single image or a plurality of images.

The term “and/or” as used in a phrase such as “A and/or B” herein can include both A and B; A or B; A (alone); and B (alone). Likewise, the term “and/or” as used in a phrase such as “A, B, and/or C” can include at least the following embodiments: A, B, and C; A, B, or C; A or C; A or B; B or C; A and C; A and B; B and C; A (alone); B (alone); and C (alone).

As used herein, the term “about” when referring to a measurable value such as an amount, a temporal duration, and the like, can include variations of +/−20%, more preferably +/−10%, even more preferably +1-5% from the specified value, as such variations are appropriate to reproduce the disclosed methods and systems.

As used herein, the term “meat” or “meat sample” as used herein can include a meat product, a meat cut, a trim specification, or other composition harvested from an animal.

As used herein, “muscle fiber” can include muscle filaments surrounded by a layer of connective tissue such as endomysium around a muscle fiber core. In some embodiments, the muscle fiber may be a feature detected by the system and method described herein.

As used herein, “lean muscle” can include tissue rich in muscle fiber. As used herein, “non-lean muscle” can include tissues with fat, gristle, nerve, blood vessels, or other connective tissue, etc.

In some embodiments, the lean muscle or non-lean muscle may be a feature detected by the system and method described herein.

As used herein, “statistical measures” can include the mean, the median, a percentile value, a variance, a standard deviation, or similar statistical measures, such as additional measures that can be derived from the above.

Features can include statistical measures. A feature can include one or a small number of values derived from the pixel values of the one or more data capture devices120and/or the plurality of data elements125. In some embodiments, the features can include color features, shape features, topological features, physiological features (e.g. pH or protease levels), and more. In some embodiments, analysis of the feature can reduce the very large amount of information in an image (often millions of pieces of information, as an image can have millions of pixels, each with multiple intensity values) into a small number of values for use in a decision algorithm. In some embodiments, the analysis of one or more of the features can include “calculating” the features, “computing” the features, “extracting” the features, or other such actions connoting the derivation of the features from the underlying images. In some embodiments, the image analysis and/or extraction can be performed or executed by a computing device, or similar, as described herein.

As used herein, “texture analysis” can include a value or a small number of values that incorporate information about the fine-grained structure of an image. Such information can include local pattern analysis, pixel-to-pixel contrast analysis, and more.

As used herein. “local pattern analysis” can include both local binary patterns as well as numerous other algorithms that have similar or formally identical effects.

As used herein, “topological features” can include features related to the physical arrangement of ultrastructural elements, both in an absolute sense (e.g. a size, distance, or area) as well as relative sense (e.g. relative direction, relative size, relative distance, relative area).

As used herein “color values” can include hue, saturation, lightness, red value, green value, blue value, magenta value, cyan value, yellow value, Lab space value, L*a*b* space value, or any other value derived from obtaining images from specific spectral regions, and which can involve the comparison of such values.

As used herein, “decision algorithms” can include any mapping or other process of assigning features from the high-resolution imaging, and which can additionally include values or attributes determined by means other than high-resolution imaging, into a meat analysis and feature determination.