Patent Description:
Example embodiments of the present invention relate generally to a material handling system for manipulating items, and, more particularly, to a subsystem of the material handling system for manipulating the orientation of the items.

Material handling systems can convey, sort, and organize items (e.g. cartons, cases, containers, shipment boxes, totes, packages, and/or the like) at high speeds. Depending on a configuration of the material handling system, the items may travel through the material handling systems in an unregulated manner or may be repositioned, reoriented, and/or consolidated into a single stream of items on conveyors and/or other locations. Material handling systems may rely on a conveyor controller and/or warehouse management system to organize items being conveyed and/or handled.

Generally, a material handling system may be required to handle items of different physical characteristics, for example, item type, item body shape, etc. For instance, in some cases, the material handling system handles items having a rigid body shape (e.g., totes, containers, cartons, heavy shipment boxes, and/or the like) or a flexible body shape (e.g. packages, polybags, envelopes, and/or the like). These items may need to be repositioned and/or reoriented through various stages of handling and processing by the material handling system. Typically, the material handling system include equipment adapted to handle the items depending on the physical characteristics. For instance, robotic tools are installed or deployed at various locations within the material handling environment, for picking the items and further manipulating these items (i.e. re-orienting and/or re-positioning the items).

Applicant has identified several technical challenges associated with handling items in a material handling system and other associated systems and methods. Through applied effort, ingenuity, and innovation, many of these identified challenges have been overcome by developing solutions that are included in embodiments of the present invention, many examples of which are described in detail herein. <CIT> discloses an item that is moving along a moving surface of an inventory conveyance system may be identified. An orientation of the item with respect to the moving surface may be determined based on sensing information that describes the item and a portion of the moving surface surrounding the item. A removal strategy for operating a robotic arm to remove the item from the moving surface may be determined based at least in part on the item and the orientation. The removal strategy may include a trajectory for the robotic arm to follow as part of removing the item from the moving surface. <CIT> discloses a system for manipulating articles, such as irregular mailpieces in the U. Postal Service mail processing system. The system receives an agglomeration of parcels into a first subsystem where the parcels are separated and are passed to a second subsystem where each parcel is manipulated until its addressee label is directed upward. The first subsystem includes a plurality of individually rotatable cylindrical rollers which form a support surface for the parcels. The rollers produce translation of a parcel by cooperative motion or separation of parts of a pile of parcels by differential motion. The second subsystem includes a high-friction, flexible conveyor belt which in a first mode supports a parcel and in a second mode forms a downward loop in which a parcel can be rotated and inverted. The parcels in both subsystems are manipulated by a five-axis robotic arm which is responsive to a machine vision system measuring the position and physical characteristics of each parcel. <CIT> discloses an end effector system. A vacuum type end effector is provided at the end of each of two robotic tooling fingers. Each vacuum type end effector includes a flexible bellows member on the end thereof such that it can be used for vacuum acquisition. Extending down from each finger to reside adjacent a respective bellows is a pinch member. Through robotic control of the movement of the fingers, finger gripping can be accomplished to grip an object between the two bellows using the pinch members for lateral support. As the part is captured between the two bellows, each bellows is compressed against its respective pinch member. In such manner, the bellows are at least partially collapsed such that a vacuum sensor located in the vacuum supply line to the bellows registers that a vacuum is present and, thus, a part has been acquired. That same vacuum sensor allows the robot to know when a part has been acquired by the bellows in the typical vacuum-type pick-up arrangement. <CIT> discloses an apparatus and method for pattern creation. One aspect provides for measuring a dimension of an object and using the dimension to pick and place the object. A first input device conveys an object into contact with a feed forward unit. The contact causes displacement of the feed forward unit and conditions the object. A distance sensor measures a distance to a surface of the object. One aspect provides for maintaining a pattern of objects in a desired position and orientation. A first surface, second surface, and third surface are mutually orthogonal and meet at a point to form a lowest corner. One aspect provides for transferring a pattern from a universal surface with finger wall slats to an ultimate package. The apparatus comprises a crowder plate with crowder plate slats. A portion of the crowder plate slats are sized to pass between a portion of mating finger wall slats.

The following presents a simplified summary to provide a basic understanding of some aspects of the disclosed material handling system. This summary is not an extensive overview and is intended to neither identify key or critical elements nor delineate the scope of such elements. Its purpose is to present some concepts of the described features in a simplified form as a prelude to the more detailed description that is presented later.

The claimed invention is as defined in the appended set of claims.

The above summary is provided merely for purposes of summarizing some example embodiments to provide a basic understanding of some aspects of the disclosure. Accordingly, it will be appreciated that the above-described embodiments are merely examples and should not be construed to narrow the scope of the disclosure in any way. It will be appreciated that the scope of the disclosure encompasses many potential embodiments in addition to those here summarized, some of which will be further described below.

Some embodiments of the present invention will now be described more fully hereinafter with reference to the accompanying drawings, in which some, but not all embodiments of the inventions are shown. Indeed, the disclosure may be embodied in many different forms and should not be construed as limited to the embodiments set forth herein; rather, these embodiments are provided so that this disclosure will satisfy applicable legal requirements. The terms "or" and "optionally" are used herein in both the alternative and conjunctive sense, unless otherwise indicated. The terms "illustrative" and "exemplary" are used to be examples with no indication of quality level.

The components illustrated in the figures represent components that may or may not be present in various embodiments of the invention described herein such that embodiments may include fewer or more components than those shown in the figures while not departing from the scope of the invention.

Turning now to the drawings, the detailed description set forth below in connection with the appended drawings is intended as a description of various configurations and is not intended to represent the only configurations in which the concepts described herein may be practiced. The detailed description includes specific details for the purpose of providing a thorough understanding of various concepts with like numerals denote like components throughout the several views.

Typically, in a material handling environment having items with variable physical characteristics (e.g., length of the item, width of the item, height of the item, weight of the item, center of gravity of the item, body shape of the item, material strength of the item, and/or the like) the items are to be handled carefully by equipment, with a reliability so as to avoid any physical damage at a time of handling. Also, these items are handled by the equipment, such as, robotic tools and/or conveyors, at high speeds within the material handling environment. Accordingly, the robotic tools and/or other equipment within the material handling environment are required to operate at high speeds while still maintaining the reliability of handling the items and avoiding any mishandling which may cause a physical damage to the item during its manipulation.

Various example embodiments described herein relate to a material handling system for manipulating items. Manipulating these items may be referred to hereinafter throughout the description as picking the items, gripping the items, re-positioning the items, retrieving the items, lifting the items, moving of the items, and/or reorienting the items from a first orientation to the second orientation, by equipment of the material handling system. In accordance with said example embodiments, the material handling system includes a repositioning system comprising a robotic tool. The robotic tool includes a robotic arm portion and an end effector coupled to the robotic arm portion. The robotic tool is configured to manipulate an item in a first orientation and reorient the item to a second orientation. According to various example embodiments described herein, different configurations of the end effector can be used in the repositioning system for manipulating the items.

In another example embodiment, the end effector can be a vacuum gripper having one or more flexible suction cups and at least one rigid gripper for handling items of rigid or flexible body shapes. Other configurations of the end effector are also possible as illustrated and described hereafter.

According to said example embodiments, the material handling system also includes, a vision system having one or more sensors positioned within the material handling system. The vision system is configured to generate inputs corresponding to one or more characteristics of the item. Some example characteristics of items that may be generated by the vision system may include a size of the item, position of the item, body shape of the item, orientation of the item, edges or markings on the item, presence of marker or a label on the item, and/or positioning of a label on the item.

The material handling system also includes a controller. The controller is communicatively coupled to the repositioning system, the vision system, and/or other subsystems of the material handling system. The controller includes at least one processor configured to execute instructions to cause the material handling system to at least: identify by the vision system, the item in the first orientation, based on the one or more characteristics of the item generated by the vision system, initiate, by the repositioning system, picking of the item in the first orientation, and upon picking the item in the first orientation, reorient, by the repositioning system, the item to the second orientation.

Having described example embodiments related to the present disclosure at a high level, the design of the various devices performing various example operations is provided below.

<FIG> and <FIG> illustrate a perspective view and a top view, respectively, of a material handling system <NUM>, in accordance with one or more embodiments of the present disclosure. The material handling system <NUM> may handle different types of items having varying physical characteristics. For example, the material handling system <NUM> can handle items (e.g., totes, containers, articles, shipment packages, boxes, envelops, paper bags, parcels, polybags, and/or the like) without limitation. The material handling system <NUM> may include a variety of components and/or subsystems, such as an induction conveyor, sortation system, chutes, identification systems, vision systems, robotic subsystems, and/or the like, for handling and processing items.

According to various example embodiments described herein, the material handling system <NUM> is configured to manipulate an item <NUM> from a first orientation to a second orientation. In this regard, according to some example embodiments, a repositioning system <NUM> of the material handling system <NUM> is configured to receive the item <NUM> in a first orientation from a chute <NUM> and/or a conveyor (not shown). The repositioning system <NUM> may further reorient the item <NUM> from the first orientation to a second orientation for placement onto a conveyor <NUM> and/or any downstream subsystem of the material handling system <NUM>.

As shown, the material handling system <NUM> also includes a vision system <NUM> comprising include one or more sensors such as cameras, photo detectors, proximity sensors, infra-red sensors, and/or the like. The one or more sensors of the vision system <NUM> may be positioned at various locations within the material handling system <NUM>. In some example embodiments, the one or more sensors of the vision system <NUM> are configured to generate inputs corresponding to one or more characteristics of the item <NUM>. It should be noted that the vision system <NUM> is shown as a standalone camera in <FIG>; however, the vision system <NUM> is not limited to the implementation shown in <FIG>. The vision system <NUM> may include a network of imagers, sensors, cameras, identification systems, and/or the like, for determining characteristics of one or more items conveyed in the material handling system <NUM>. The characteristics of the item <NUM> may be utilized by one or more subsystems in the material handling environment such as, but not limited to, the repositioning system <NUM>, the vision system <NUM>, and/or other equipment within the material handling system <NUM>.

The material handling system <NUM> may further include, a control system (not shown) including a controller which may be communicably coupled with the repositioning system <NUM>, the vision system <NUM>, and/or other subsystems of the material handling system <NUM>. In accordance with some example embodiments, the controller may include at least one processor that may execute instructions to cause the material handling system <NUM> to perform specific operations. In accordance with the embodiments of the present disclosure, the processor may execute instructions to cause the vision system to determine a first orientation of the item <NUM> to be conveyed. The processor may further execute instructions to cause the repositioning system <NUM> to receive the item <NUM> in the first orientation. Further, the processor may execute instructions to cause the repositioning system <NUM> to reorient the item <NUM> to a second orientation for placement onto a conveyor <NUM>, such as a downstream conveyor within the material handling system <NUM>. In this regard, the repositioning system <NUM> may include a robotic end effector for manipulating the item <NUM> including reorienting and repositioning of the item <NUM>. Details related to the end effector of the repositioning system <NUM> and its associated operations, are described later in reference to <FIG>.

In accordance with an embodiment of the present disclosure, the item <NUM>, such as a parcel, may have a label placed thereon. As described herein, a label may also refer to a marker, imprinted information, encoded information marked on a surface, and/or the like. In some example embodiments, a label may correspond to a printed medium including an identifier which includes coded information, such as a barcode, QR code, 2D-code, 3D-code, Direct part marking (DPM) code, and/or the like. The label may include information corresponding to the item, such as, but not limited to, identifier for uniquely identifying a product within the item, a type of the item, a type of the product, a size of the product, product manufacturer's information, weight of the item, delivery address of the item, and/or the like.

According to some example embodiments, information corresponding to the item <NUM> may be coded in an identifier, such as a barcode or a QR code, on the label associated with the item <NUM>. Accordingly, for handling and processing the item <NUM>, one or more subsystems of the material handling system <NUM> may scan the identifier on the label of the item <NUM> at different stages of conveyance. During conveyance, an orientation of the item <NUM> may change frequently. In some cases, the item <NUM> may be orientated such that the label may not be positioned in view of a label identification system. The label identification system may correspond to a scanner configured to scan an identifier on the label. For example, the label identification may correspond to a barcode scanner, optical reader, an RFID reader, a bi-optic scanner, and/or the like configured for scanning an identifier associated with the label.

As described above, the repositioning system <NUM> may reorient the item <NUM> in a label-up position such that an identifier and/or the label associated with the item <NUM> may be positioned on a top face of the item <NUM> for scanning. According to some example embodiments, the controller may determine an orientation of the item. For instance, the controller may determine, via the vision system <NUM>, a first orientation of the item <NUM> in which a top surface of the item <NUM> includes the label. In this case, in response to determining that the top surface of the item <NUM> includes the label, the controller may instruct the repositioning system <NUM> and/or any other subsystem of the material handling system <NUM> to transfer the item <NUM> to the conveyor <NUM> in the first orientation, that is, without reorienting the item <NUM>. Alternatively, the controller may determine, via the vision system <NUM>, another orientation of the item <NUM> in which the top surface of the item <NUM> does not includes the label. In this regard, the controller may instruct the repositioning system <NUM> and/or any other subsystem of the material handling system <NUM> to transfer the item <NUM> to the conveyor <NUM> in a second orientation different from the first orientation. In the second orientation, the label of the item would be positioned on the top surface of the item, such that, the identifier on the label is exposed in a field of view of the identification system, thereby facilitating scanning of the identifier.

In accordance with one or more embodiments of the present disclosure, the repositioning system <NUM> may include a robotic tool having a robotic arm and an end effector. The repositioning system <NUM> is configured to have different configurations of the end effector customized for manipulating items based on its one or more characteristics (e.g., body shape, type of the item, surface material of the item, and/or the like). The end effector of the repositioning system <NUM> includes a vacuum gripper for manipulating the item <NUM>. Different configurations of the end effectors of the repositioning system <NUM> are described hereinafter.

<FIG> illustrate different views of a robotic tool <NUM> of the repositioning system <NUM> of the material handling system <NUM>, as shown in <FIG> and <FIG>, in accordance with an example embodiment. As shown, the robotic tool <NUM> may include a robotic arm portion <NUM> of a robotic arm (e.g., robotic arm <NUM> illustrated in FIGS. 12a-12d) and an end effector <NUM> defined at an end thereof. The robotic arm may be any suitable robotic arm configured to provide sufficient degree of motion for picking, placing, repositioning, etc. an item and/or a group of items. According to some example embodiments, the robotic arm portion <NUM> is communicatively coupled to the control system that can control operations such as the movement, positioning, starting, and stopping, of the robotic arm portion <NUM>. The control system of the item manipulation system <NUM> may initiate movement of the robotic arm portion <NUM> so as to position the end effector <NUM> to any of a picking position, gripping position, retrieval position, and a discharging position of the item <NUM>, details of which are described hereafter.

In some alternate example embodiments, the robotic tool <NUM> including the robotic arm portion <NUM> and the end effector <NUM> may be controlled by a controller remotely positioned and/or any other subsystem of the material handling system <NUM> to pick the item <NUM> in a first orientation and reorient the item <NUM> to a second orientation for placement onto the conveyor <NUM>.

The robotic arm portion <NUM>, as shown in <FIG>, is rotatably attached to the end effector <NUM> through a mount <NUM>. The end effector <NUM> may include any manipulator with a suitable gripping means, such as, but not limited to, vacuum, claw, finger, plate, and the like, for picking and handling the item <NUM>.

In accordance with an example embodiment of the present disclosure, the end effector <NUM> may include a vacuum gripper <NUM>, as shown in <FIG>. The vacuum gripper <NUM> may include one or more flexible suction cups <NUM> and/or one or more rigid gripper <NUM>. For instance, in some example embodiments, the end effector <NUM> may define at its one end, a configuration of the vacuum gripper <NUM> having four flexible suction cups, positioned at a respective corner defined by a bottom surface of the vacuum gripper <NUM> and one rigid gripper positioned at a center of the bottom surface of the vacuum gripper. In an alternate example embodiment, the end effector <NUM> may include another configuration of the vacuum gripper <NUM> having six flexible suction cups and two rigid grippers positioned on the bottom surface of the vacuum gripper <NUM>.

Accordingly, in various example embodiments, the end effector <NUM> may include different configurations of vacuum gripper <NUM> having varying number of flexible suction cups and/or rigid grippers so as to engage items of different body shapes and different characteristics (e.g., weight, center of gravity, etc.). In this way, items are not mishandled or dropped during a movement of the end effector <NUM> and/or re-orientation of the items, as the items are handled.

According to various example embodiments described herein, the robotic tool <NUM> may further include a vacuum source or a vacuum generator (not shown) for generating a vacuum suction force within the one or more flexible suction cup <NUM> and the one or more rigid gripper <NUM>. In operation, the vacuum generator may draw vacuum suction force through the respective one or more flexible suction cups <NUM> and the one or more rigid gripper <NUM>. For instance, in some example embodiments, the one or more flexible suction cups <NUM> and the one or more rigid gripper <NUM> may engage a surface of the item <NUM> based on a first vacuum suction force generated through the flexible suction cups <NUM> and/or a second vacuum suction force generated through the one or more rigid gripper <NUM>. Each of the flexible suction cups <NUM> and the one or more rigid gripper <NUM> may be in fluidic communication with one or more vacuum generators (e.g., via a plenum or one or more vacuum rods (not shown)). In an example embodiment, the vacuum suction force drawn through the respective vacuum rods and through the respective one or more flexible suction cups <NUM> and the one or more rigid gripper <NUM> may enable the end effector <NUM> to engage a surface of the item <NUM> so as to manipulate the item <NUM>.

In some examples, the one or more flexible suction cups <NUM> may be actuated by the controller to engage items having flexible body shape (e.g., parcels, polybags, paper bags, envelops and/or the like). In some examples, the one or more rigid gripper <NUM> may be actuated to grip items having rigid body shape (e.g., boxes, cartons, containers, totes, and/or the like). In some examples, both the one or more flexible suction cups <NUM> and the one or more rigid gripper <NUM> may be actuated for engagement of the item <NUM>. Further, based on the body shape of the item <NUM> handled by the item manipulation system <NUM>, varying amounts of suction forces may be generated through the respective one or more flexible suction cups <NUM> and the one or more rigid gripper <NUM>.

As described above, the end effector <NUM> may be attached to the robotic arm portion <NUM> through a mount <NUM> such that the end effector <NUM> may be capable of rotating with respect to the robotic arm portion <NUM>. For rotating an item <NUM>, the vacuum gripper <NUM> may contact the item <NUM> in a first orientation. As described above, based on the position, size, and/or weight of the item <NUM>, a vacuum suction force may be created in one or more of the flexible suction cups <NUM> and/or the one or more rigid gripper <NUM> for picking the item <NUM> in the first orientation.

In one or more example embodiments of the present disclosure, the robotic tool <NUM> may further include one or more sensors (e.g., a force sensor, a torque sensor, and/or a distance sensor) configured to measure characteristics of the item <NUM> (e.g., weight, position, orientation, center of gravity, size, etc.). Thus, the position, size, and/or weight of the item <NUM> may be determined by the robotic tool <NUM> or any other subsystem of the material handling system <NUM>.

Further, in some example embodiments, the control system and/or any other subsystem of the material handling system <NUM> may determine, via the vision system <NUM>, that the item <NUM> is to be manipulated from the first orientation to a second orientation. For example, the control system may determine a need of reorienting the item <NUM> before placing the item <NUM> onto a downstream conveyor and/or section of the material handling system <NUM>. As an example, a label and/or a marker placed on the item <NUM> may be positioned upside down, the item <NUM> may have a longer edge that may jam in the downstream conveyor, or the item <NUM> may need to be oriented in a specific orientation to fit a palletizing pattern. Upon determining that the item <NUM> needs to be reoriented, the end effector <NUM> may be controlled to rotate about the mount <NUM> in order to change the position and/or the orientation of the item <NUM>. In some embodiments, the end effector <NUM> may be rotated in a clockwise direction to rotate the item <NUM> within a range from about <NUM> degrees to about <NUM> degrees to align a label placed on the item <NUM> for scanning. Further, once the item <NUM> is reoriented, the robotic arm portion <NUM> may be moved to position the end effector <NUM> at a position so as to place the item <NUM> on the conveyor <NUM>.

The vacuum gripper <NUM> of the end effector <NUM> also includes one or more ejectors that may be actuated for respective flexible suction cups <NUM> and/or the one or more rigid gripper <NUM> for releasing the item <NUM> onto the conveyor <NUM> in the second orientation. Accordingly, once the item <NUM> is reoriented, the robotic tool <NUM> may place the item <NUM> on the conveyor <NUM> and may activate one or more ejectors for respective one or more flexible suction cups <NUM> and/or the one or more rigid gripper <NUM> for releasing the item <NUM> onto the conveyor <NUM> in the second orientation. In an embodiment, the ejector may receive compressed air fed into the one or more flexible suction cups <NUM> and the one or more rigid gripper <NUM>. It should be noted that the robotic tool <NUM> may reorient the item <NUM> in-hand while holding the item <NUM>, or may reorient the item <NUM> in one or more steps while picking and/or placing the item <NUM>.

<FIG> illustrates an exploded view of the robotic tool <NUM>, in accordance with an embodiment of the present disclosure. The robotic tool <NUM> includes a robotic arm portion <NUM> attached to a robot flange adapter <NUM>. The robot flange adapter <NUM> may include and/or be attached to at least one sensor <NUM> mounted on a sensor mounting flange <NUM>. In an embodiment, the at least one sensor <NUM> may include a plurality of sensors (e.g., force sensor, torque sensor, distance sensor, and/or the like) to measure different characteristics of the item <NUM>. In an embodiment, the at least one sensor <NUM> may determine a weight distribution and/or center of gravity of the item <NUM> and generate sensor data. Based on processing the sensor data generated by the at least one sensor <NUM>, the control system may cause the vacuum generators to control generation of the vacuum suction force through each of the one or more flexible suction cups <NUM> and/or the one or more rigid gripper <NUM>. The sensor mounting flange <NUM> is further attached to the vacuum gripper <NUM>. The vacuum gripper <NUM> includes a dust plate <NUM> at the bottom of the vacuum gripper <NUM>, as shown in <FIG>.

In an embodiment, the robotic tool <NUM> further includes a laser range finder <NUM>, as shown in <FIG>. As shown, the laser range finder <NUM> is disposed on a distal end of the end effector <NUM>. The laser range finder <NUM> is configured to identify (e.g., periodically or continuously over a period of time), the item <NUM> positioned in the first orientation. The laser range finder <NUM> is also configured to determine a distance at which the item <NUM> is positioned with relative to the vacuum gripper <NUM>. For example, in some embodiments, the laser range finder <NUM> may determine the distance between a top surface of the item <NUM> and an end of the vacuum gripper <NUM> (e.g., between the one or more flexible suction cups <NUM> and the one or more rigid gripper <NUM>). Based on the determined distance, the controller may cause the robotic arm portion <NUM> to position the end effector <NUM> into different operating positions. For instance, in some example embodiments, based on the determined distance communicated to the controller, the end effector <NUM> may be moved into at least one of: the picking position to pick the item <NUM> in the first orientation, the gripping position in which the one or more flexible suction cups <NUM> and/or the one or more rigid gripper <NUM> can be selectively actuated to grip the item <NUM>, the retrieval position in which the end effector <NUM> is moved to retrieve the item <NUM> from amongst multiple items on a conveyor, and the discharging position, in which the end effector <NUM> is moved to place the item <NUM> in the second orientation by ejecting the item <NUM> engaged to the end effector <NUM> based on ejectors of respective of the one or more flexible suction cups <NUM> and/or the one or more rigid gripper <NUM>. In accordance with some example embodiments herein, the laser range finder <NUM> may include a light source configured to emit a laser beam or light rays, and trace a time of flight of the emitted light to contact the item <NUM> and return to the laser range finder <NUM> (e.g., reflection).

<FIG> illustrate a vision and control subsystem of the material handling system <NUM>, in accordance with one or more embodiments of the present disclosure. An identification of the item <NUM> and its orientation, (e.g., a label up orientation), may be performed by a sensing system comprising one or more sensors. For example, in some example embodiments, a vision system <NUM> may include the one or more sensors including a camera and/or multiple cameras (not shown) installed around an area in a material handling environment having the item <NUM> which is be handled by the repositioning system <NUM>. In this regard, in some example embodiments, the one or more cameras of the vision system <NUM>, may feed image data to the controller, and the controller may analyze the images at a high rate to identify a position of the item <NUM>, an orientation of the item, and/or a label placed on the item <NUM>. In addition, the cameras and/or the controller may also assess physical characteristics associated with the item, (e.g., a size, weight, and/or the like) of the item <NUM>. The one or more sensors of the vision system <NUM> may also include, e.g., a laser sensor, force sensor, torque sensor, and/or the like, to monitor such physical characteristics of the item <NUM>. The vision system <NUM> and/or the controller may also make an initial assessment of the physical characteristics of the item <NUM> to select an item handling procedure based on which the end effector <NUM> of the repositioning system <NUM>, handles the item <NUM>. For example, in some cases, the controller may perform the initial assessment to determine at least one of a type of the item <NUM>, body shape of the item, orientation of the item <NUM>, and/or the like. For instance, in some cases, the controller may determine the item <NUM> to be a bag, a box, a tote, a polybag, an envelope, and/or the like. The initial assessment may be performed based on colleting sensor and/or image data, before picking the item and/or at the time of picking the item <NUM>, and further throughout an item handling process.

Further, the vision system <NUM> and/or the controller may classify the item <NUM> based on utilizing machine learning classification. In this regard, the sensor data and/or the images collected by the controller may be used as a training set to generate a trainable model for automatically classifying the item <NUM> and selecting an item handling procedure for the end effector <NUM> based on the classification of the item <NUM>. The selection of the item handling procedure can be done, prior to picking of the item <NUM> by the end effector <NUM>. In some cases, in order to adjust a picking strategy and enabling the end effector <NUM> to react to pick the item <NUM> by using feedback from one or more sensors, such as, a force, torque, and/or vacuum sensor, to make real time assessment of how to best handle motions of one or more subsystems of the material handling system <NUM> to successfully handle the item <NUM>. Further, labels and/or other identifiers associated with the item <NUM> may be scanned while the item <NUM> is picked and/or is in motion.

<FIG>, <FIG>, and <FIG> illustrates example flowcharts of operations performed by a material handling system for manipulating an item, in accordance with example embodiments of the present invention. It will be understood that each block of the flowcharts, and combinations of blocks in the flowcharts, may be implemented by various means, such as hardware, firmware, one or more processors, circuitry and/or other devices associated with execution of software including one or more computer program instructions. For example, one or more of the procedures described above may be embodied by computer program instructions. In this regard, the computer program instructions which embody the procedures described above may be stored by a memory of an apparatus employing an embodiment of the present invention and executed by a processor in the apparatus. As will be appreciated, any such computer program instructions may be loaded onto a computer or other programmable apparatus (e.g., hardware) to produce a machine, such that the resulting computer or other programmable apparatus provides for implementation of the functions specified in the flowcharts' block(s). These computer program instructions may also be stored in a non-transitory computer-readable storage memory that may direct a computer or other programmable apparatus to function in a particular manner, such that the instructions stored in the computer-readable storage memory produce an item of manufacture, the execution of which implements the function specified in the flowcharts' block(s). The computer program instructions may also be loaded onto a computer or other programmable apparatus to cause a series of operations to be performed on the computer or other programmable apparatus to produce a computer-implemented process such that the instructions which execute on the computer or other programmable apparatus provide operations for implementing the functions specified in the flowcharts' block(s). As such, the operations of <FIG>, <FIG>, & <FIG> when executed, convert a computer or processing circuitry into a particular machine configured to perform an example embodiment of the present invention. Accordingly, the operations of <FIG>, <FIG>, & <FIG> define an algorithm for configuring a computer or processor, to perform an example embodiment. In some cases, a general purpose computer may be provided with an instance of the processor which performs the algorithm of <FIG>, <FIG>, & <FIG> to transform the general purpose computer into a particular machine configured to perform an example embodiment.

Accordingly, blocks of the flowcharts support combinations of means for performing the specified functions and combinations of operations for performing the specified functions. It will also be understood that one or more blocks of the flowcharts, and combinations of blocks in the flowchart, can be implemented by special purpose hardware-based computer systems which perform the specified functions, or combinations of special purpose hardware and computer instructions.

<FIG> illustrates a flowchart describing a method <NUM> for manipulating an item, by the material handling system <NUM>, from a first orientation to a second orientation in a material handling environment. According to some example embodiments, at step <NUM>, the material handling system <NUM> may include means such as, the vision system (<NUM>, <NUM>) and/or the end effector <NUM>, comprising one or more sensors from which at least one of a plurality of images comprising the item <NUM> or sensor data sensed by the one or more sensors, may be accessed by the controller. In this regard, in some examples, the one or more sensors may include, a force sensor, a torque sensor, a distance sensor, photo diodes, barcode scanners, RFID readers, and/or the like.

At step <NUM>, the controller of the material handling system may, via the vision system (<NUM>, <NUM>) process, either the plurality of images or the sensor data, to generate one or more characteristics of the item and a first orientation of the item <NUM>. In some examples, the one or more characteristics comprise at least one of physical characteristics of the item <NUM>, for example, a size of the item <NUM>, body shape of the item <NUM>, texture of the item <NUM>, features like, edges, blobs on body of the item <NUM>, surfaces of the item <NUM>, label of the item <NUM>, orientation of the label of the item <NUM>, location of the label of the item <NUM>, type of the item <NUM>, identifier on the label of the item <NUM>, distance of the item <NUM> from the end effector <NUM>, and/or the like.

Moving to step <NUM>, the controller of the material handling system <NUM> may select an item handling procedure indicative of a configuration of the robotic tool <NUM>, based on which the end effector <NUM> of the repositioning system <NUM> manipulates the item. In this regard, the controller may select the item handling procedure based on the identified one or more characteristics and the first orientation of the item, at step <NUM>. It may be understood that procedures for handling different items by robotic tools in a material handling system may vary depending on different physical characteristics of respective items. For instance, depending on a product type, in an example, the end effector <NUM> may be configured to manipulate the item <NUM> based on a first item handling procedure for grasping an item which is a hard-sided box. Similarly, in another example, the end effector <NUM> may be configured to manipulate the item <NUM> based on a second item handling procedure for grasping the item which is a flexible and squishy polybag. In some cases, an item handling procedure for which the end effector <NUM> is pre-configured may be adjusted based on the identified one or more characteristics of the item <NUM>.

Based on the selected item handling procedure, at step <NUM>, the material handling system <NUM> may include the repositioning system <NUM> comprising the robotic tool to pick, by the end effector <NUM>, the item in the first orientation. In this regard, the item <NUM> may be picked based on engagement of the item <NUM> with the end effector <NUM> using any suitable configurations of the end effector <NUM>, as described earlier, in various embodiments related to <FIG>.

At step <NUM>, the material handling system <NUM> may include means such as the end effector of the repositioning system <NUM> to reorient the item in a second orientation. In this regard, the item <NUM> may be reoriented based on any of: flipping of the item <NUM> or rotating of the item <NUM> etc., via any configuration of the end effector <NUM> as described earlier, in various embodiments related to <FIG>.

<FIG> illustrates another flowchart describing another method <NUM> for manipulating an item from a first orientation to a second orientation in a material handling environment by the material handling system <NUM>, as described in reference to <FIG>. In this regard, in some cases, it is required to operate the end effector <NUM> so as to, pick an item from a first conveyor, reorient the item, and place the item to either the first conveyor or a second conveyor. In accordance with some example embodiments, upon generating the one or more characteristics of the item <NUM>, as described at step <NUM> of <FIG>, at step <NUM>, the material handling system <NUM> may include means such as, the vision system (<NUM>, <NUM>) to determine the first orientation of the item <NUM> to be conveyed on a conveyor such as, the conveyor <NUM>. In this regard, at step <NUM>, the vision system (<NUM>, <NUM>) may determine if in the first orientation of the item <NUM>, a top surface of the item <NUM> includes a label. Here, the top surface of the item refers to a surface of the item which is exposed to a field of view of one or more sensors of the vision system (<NUM>, <NUM>). In response to determining that the top surface of the item <NUM> includes the label, the method moves to step <NUM>, where the controller of the material handling system <NUM>, may transfer the item to the conveyor <NUM> in the first orientation.

Otherwise, at step <NUM>, in response to determining that the top surface of the item <NUM> does not include the label, the method moves to step <NUM>, where the controller of the material handling system <NUM>, may initiate, via the reposition system <NUM>, reorientation of the item from the first orientation to the second orientation. Here, the second orientation the top surface of the item includes the label. To this extent, the reorientation of the item <NUM> may be performed using any configuration of the end effector <NUM> of the robotic tool <NUM> of the repositioning system <NUM>, based on as described earlier, in various embodiments related to <FIG>. Thus, the controller of the material handling system <NUM> causes to manipulate the item <NUM>, via the robotic tool <NUM>, from the first orientation to the second orientation for cases, where the item <NUM> includes a label which is not positioned on a top surface exposed in a field of view of the vision system (<NUM>, <NUM>). Otherwise, the item <NUM> is conveyed as such, without any handling by the robotic tool <NUM> for reorienting the item <NUM>.

<FIG> illustrates another flowchart representing a method <NUM> of repositioning the item <NUM> from a first orientation to a second orientation, by another end effector, in accordance with some example embodiments. In this regard, the end effector comprises the vacuum gripper <NUM> having the one or more flexible suction cups <NUM> and/or the one or more rigid gripper <NUM>, as described earlier in reference to <FIG>.

In accordance with some example embodiments, upon picking the item <NUM> in the first orientation by the repositioning system <NUM>, as described at step <NUM> of <FIG>. For reorienting the item in the second orientation, the method <NUM>, at step <NUM> includes, picking, by the end effector of the repositioning system <NUM>, the item <NUM> in the first orientation. In this regard, the controller may selectively actuate one or more of the flexible suction cups <NUM> and/or the one or more rigid gripper <NUM> of the end effector <NUM> to cause engage of the item <NUM> with the vacuum gripper <NUM>. For instance, in an example case, if the item <NUM> is of a flexible body shape such as, but not limited to, an envelope, a poly bag, a paper bag package and/or the like, the controller may actuate the one or more flexible suction cups <NUM> to grip the item <NUM> by vacuum suction force generated through the one or more flexible suction cups <NUM>. Accordingly, in another example case, if the item <NUM> is of a rigid body shape such as, but not limited to, a tote, a container, a heavy box, carton, and/or the like, the controller may actuate the one or more rigid gripper <NUM> to grip the item <NUM> by vacuum suction force generated through the rigid gripper <NUM>.

The method further includes, at step <NUM>, moving, the robotic arm portion <NUM> rotatably engaged to the end effector <NUM>, to reorient the item <NUM> gripped by at least one of the one or more flexible suction cups <NUM> and/or the one or more rigid gripper <NUM> of the end effector, in the second orientation. In this regard, the end effector <NUM> may be rotated to change the orientation of the item <NUM> engaged to the vacuum gripper <NUM>.

Further, upon moving the robotic arm, the method <NUM>, at step <NUM> includes, placing, by the end effector <NUM> of the repositioning system <NUM>, the item <NUM> in the second orientation. In this regard, upon placement of the item <NUM>, one or more ejectors of the end effector <NUM> may eject the item <NUM> engaged with the vacuum gripper <NUM>.

It must be noted that, as used in this specification and the appended claims, the singular forms "a," "an" and "the" include plural referents unless the content clearly dictates otherwise.

References within the specification to "one embodiment," "an embodiment," "embodiments", or "one or more embodiments" are intended to indicate that a particular feature, structure, or characteristic described in connection with the embodiment is included in at least one embodiment of the present disclosure. The appearance of such phrases in various places within the specification are not necessarily all referring to the same embodiment, nor are separate or alternative embodiments mutually exclusive of other embodiments. Further, various features are described which may be exhibited by some embodiments and not by others. Similarly, various requirements are described which may be requirements for some embodiments but not other embodiments.

It should be noted that, when employed in the present disclosure, the terms "comprises," "comprising," and other derivatives from the root term "comprise" are intended to be open-ended terms that specify the presence of any stated features, elements, integers, steps, or components, and are not intended to preclude the presence or addition of one or more other features, elements, integers, steps, components, or groups thereof.

Claim 1:
A material handling system (<NUM>) for manipulating items, the material handling system comprising:
a repositioning system (<NUM>) comprising:
a robotic tool (<NUM>), wherein the robotic tool comprises:
a robotic arm portion (<NUM>), and
an end effector (<NUM>), coupled to the robotic arm portion,
and comprising a vacuum gripper (<NUM>) rotatably engaged to the robotic arm, wherein the vacuum gripper comprises at least one flexible suction cup and at least one rigid gripper cup adapted to grip an item and rotate about an axis to manipulate the item from a first orientation to a second orientation;
a vision system (<NUM>), comprising one or more sensors positioned within the material handling system, wherein the vision system is configured to generate inputs corresponding to one or more characteristics of the item; and
a controller communicatively coupled to the repositioning system and the vision system, wherein the controller comprises at least one processor configured to execute instructions to cause the material handling system to:
identify, by the vision system, the item in the first orientation, including determining the first orientation of the item being conveyed on a conveyor;
based on the one or more characteristics of the item generated by the vision system, initiate, by the repositioning system, receiving of the item in the first orientation;
determine if in the first orientation of the item, a top surface of the item includes a label, marker, or barcode;
in response to determining that the top surface of the item includes the label, marker, or barcode, transfer the item to the conveyor in the first orientation; and
in response to determining that the top surface of the item does not include the label, marker, or barcode, initiate, via the repositioning system, reorientation of the item to the second orientation, wherein in the second orientation the top surface of the item includes the label, marker, or barcode, and transferring the item to the conveyor in the second orientation.