Ultra-wideband-based object identification

An ultra-wideband-based object identification method and system includes: transmitting, using a transmitter, an ultra wideband signal to an object; receiving, using a receiver, a reflected signal from the object; and determining, using a processor, an identity of the object based on the received reflected signal.

TECHNICAL FIELD

The invention relates to ultra-wideband-based object identification.

BACKGROUND

Operators in warehouses and factories often need to check the contents in a box or package for quality assurance or for stock taking. However, the contents in the box or package may not be visible by the operator.

One existing solution to perform checking is by manual inspection, which involves the operator opening the box and package for checking. This solution can be quite inconvenient and cumbersome. Another way to perform checking is by weighing the box or package. When the weight is determined to be within a predetermined range, the object is identified as normal. This solution is rather crude and is susceptible to measurement errors. Yet another way to perform checking is by irradiating X-ray to the box or package. This solution involves large-scale and expensive operation. Also, the ionizing radiation provided by the X-ray may not be suitable for inspection of some types of goods.

SUMMARY OF THE INVENTION

It is an object of the invention to address the above needs, to overcome or substantially ameliorate the above disadvantages or, more generally, to provide an alternative or improved ultra-wideband-based object identification method (and related system).

In accordance with a first aspect of the invention, there is provided an ultra-wideband-based object identification method, comprising: transmitting, using a transmitter, an ultra wideband signal to an object; receiving, using a receiver, a reflected signal from the object; and determining, using a processor, an identity of the object based on the received reflected signal.

Preferably, determining the identity of the object based on the received reflected signal comprises determining presence or absence of the object based on the received reflected signal.

Preferably, determining the identity of the object comprises: comparing the received reflected signal with one or more predetermined signal associated with a known object identity; and determining whether the identity of the object is the object identity associated with any of the one or more predetermined signals based on the comparison.

Preferably, determining whether the identity of the object is the object identity associated with any of the one or more predetermined signals comprises: determining that the identity of the object is the object identity associated with one of the predetermined signals if the received reflected signal matches the one of the predetermined signals.

Preferably, determining whether the identity of the object is the object identity associated with any of the one or more predetermined signals comprises: determining that the identity of the object is the object identity associated with one of the predetermined signals based on the best match of the received reflected signal with the one or more predetermined signals.

Preferably, the received reflected signal matches the one of the predetermined signals when a difference between the received reflected signal and the one of the predetermined signals is less than a difference threshold. The difference threshold may be adjustable (e.g., during operation) or may be fixed.

In one embodiment of the first aspect, the method also includes determining a matching index based on an extent of matching of the received reflected signal with the one or more predetermined signals.

Preferably, the method may also include displaying, at a display, one or more of: the matching index, an indication of the determined identity of the object, etc.

In one embodiment of the first aspect, the method also includes recording the determined identity of the object and increasing a count associated with the identified object identity by one.

In one embodiment of the first aspect, the method also includes providing an alert when the received reflected signal matches none of the one of the predetermined signals.

Preferably, the transmitter and the receiver are arranged in a transceiver unit.

Preferably, the object is arranged in a container such that the object is not visible.

In accordance with a second aspect of the invention, there is provided an ultra-wideband-based object identification system, comprising: a transmitter for transmitting an ultra wideband signal to an object; a receiver for receiving a reflected signal from the object; and a processor for determining an identity of the object based on the received reflected signal.

Preferably, the processor is arranged to determine presence or absence of the object based on the received reflected signal.

Preferably, the processor is arranged to determine the identity of the object by comparing the received reflected signal with one or more predetermined signal associated with a known object identity; and determining whether the identity of the object is the object identity associated with any of the one or more predetermined signals based on the comparison.

Preferably, the processor is arranged to determine whether the identity of the object is the object identity associated with any of the one or more predetermined signals by determining that the identity of the object is the object identity associated with one of the predetermined signals if the received reflected signal matches the one of the predetermined signals.

Preferably, the processor is arranged to determine whether the identity of the object is the object identity associated with any of the one or more predetermined signals by: determining that the identity of the object is the object identity associated with one of the predetermined signals based on the best match of the received reflected signal with the one or more predetermined signals.

Preferably, the received reflected signal matches the one of the predetermined signals when the processor determines that a difference between the received reflected signal and the one of the predetermined signals is less than a difference threshold. The difference threshold may be adjustable (e.g., during operation) or may be fixed.

In one embodiment of the second aspect, the processor is further arranged to determine a matching index based on an extent of matching of the received reflected signal with the one or more predetermined signals.

In one embodiment of the second aspect, the system also includes a display operably connected with the processor for displaying one or more of: the matching index, an indication of the determined identity of the object, etc.

Preferably, the processor is further arranged to record the determined identity of the object and increase a count associated with the identified object identity by one.

Preferably, the transmitter and the receiver are arranged in a transceiver unit.

Preferably, the object is arranged in a container such that the object is not visible.

Preferably, the system is integrated in a stand-alone object identification device. More preferably, the object identification device is portable.

DETAILED DESCRIPTION

FIG. 1shows an ultra-wideband-based (UWB-based) object identification device100in one embodiment of the invention. The device100includes a body104and a handle102coupled to the body104. The user can hold onto the handle102and use the device100as a portable device. A UWB transceiver tot is mounted on the body104for transmitting signal to an object10to be tested and for receiving signal reflected from the object10. In this embodiment, the object10is arranged in a box (or package)12that conceals the object10.

FIG. 2is a block diagram of the main components of an ultra-wideband-based object identification system200in one embodiment of the invention. The system200may have different configurations, and it may be implemented in a single device or distributively in multiple operably connected devices. The system200generally includes suitable components necessary to receive, store, and execute appropriate computer instructions, commands, or codes. In this embodiment, the main components of the system200include a UWB transceiver201with a transmitter201T and a receiver201R. The transmitter201T and receiver201R may be the same part or they may be distinct parts. The system200also includes a processor202and a memory204. The processor202may be formed by one or more CPU, MCU, controllers, logic circuits, Raspberry Pi chip, etc. The memory204may include one or more volatile memory unit (such as RAM, DRAM, SRAM), one or more non-volatile memory unit (such as ROM, PROM, EPROM, EEPROM, FRAM, MRAM, FLASH, SSD, NAND, and NVDIMM), or any of their combinations. The system200further includes one or more input devices206such as a keyboard, a mouse, a stylus, an image scanner, a microphone, a tactile input device (e.g., touch sensitive screen), and an image/video input device (e.g., camera). The system200may further include one or more output devices208such as one or more displays (e.g., monitor), speakers, disk drives, headphones, earphones, printers, 3D printers, etc. The display may include a LCD display, a LED/OLED display, or any other suitable display that may or may not be touch sensitive. The system200may further include one or more disk drives212which may encompass solid state drives, hard disk drives, optical drives, flash drives, and/or magnetic tape drives. A suitable operating system may be installed in the system200, e.g., on the disk drive212or in the memory204. The memory204and the disk drive212may be operated by the processor202. The system200also includes a communication module210for establishing one or more communication links (not shown) with one or more other computing devices such as servers, personal computers, terminals, tablets, phones, or other wireless or handheld computing devices. The communication module210may be a modem, a Network Interface Card (NIC), an integrated network interface, a radio frequency transceiver, an optical port, an infrared port, a USB connection, or other wired or wireless communication interfaces. The communication links may be wired or wireless for communicating commands, instructions, information and/or data. The transceiver201, the processor202, the memory204, the input device(s)206, the output device(s)208, the communication module210and the disk drives212are connected with each other through a bus, a Peripheral Component Interconnect (PCI) such as PCI Express, a Universal Serial Bus (USB), an optical bus, or other like data and/or power bus. Although not illustrated, the system may be powered by DC power source (e.g., battery cells, battery packs) or AC power source (e.g., with power cord and plug for connection to AC mains socket). The system may be further connected with one or more external data storage or server, through the communication module210.

A person skilled in the art would appreciate that the system200shown inFIG. 2is merely exemplary. The device500inFIG. 1may have the same construction as the ultra-wideband-based object identification system200.

FIGS. 3 and 4are exemplary UWB transmitter and receiver arrangements of the invention. InFIG. 3, the UWB transceiver301includes nine transmitter and receiver units301T/R, arranged in an array of 3 rows and 3 columns, and each operable as both a transmitter and a receiver. InFIG. 4, the UWB transceiver401includes four transmitters401T and four receivers401R, arranged in a Mills cross array, with one horizontal row of four transmitters401T and a vertical column of four receivers401R. These UWB transmitter and receiver arrangements inFIGS. 3 and 4can be incorporated in the device100ofFIG. 1and the system200ofFIG. 2.

FIG. 5illustrates an ultra-wideband-based object identification method500in one embodiment of the invention. To simply discussion, the method500makes reference to only one transmitter and receiver. It should be noted, however, that the method500can well be applied to embodiments with multiple transmitters and receivers.

The method500begins in step502, in which an ultra wideband signal is transmitted to the object, e.g., using the transmitter of the device500or system200. Then, in step504, a reflected signal (e.g., waveform) from the object is received, e.g., at the receiver of the device500or system200. In step506, the identity of the object is determined based on the received signal, e.g., using the processor of the device500or system200. The determination of the identity of the object may include determining presence or absence of object based on the received reflected signal. The method500may further include recording the determined identity of the object and increasing a count associated with the identified object identity by one, e.g., using the processor of the device500or system200.

Details of the determination in step506will be further described below with reference toFIGS. 6 and 7.

FIG. 6shows one implementation600of the determination step500ofFIG. 5. To simply discussion, the method600makes reference to only one transmitter and receiver. It should be noted, however, that the method600can well be applied to embodiments with multiple transmitters and receivers.

The method600begins in step602, in which the received reflected signal (from the object) is compared with a predetermined signal associated with a known object identity. The predetermined signal is determined prior to operation, and is stored, e.g., in the memory of the device100or system200. The comparison in step602may be performed by the processor of the device100or system200. Then, in step604, a determination is made as to whether a difference between the received reflected signal and the predetermined signal is less than a threshold. The determination step may be performed by the processor of the device100or system200. The threshold may be fixed or adjustable. Step604can be considered as determining the matching, or an extent of matching between the received reflected signal and the predetermined signal.

If the difference is determined to be less than the threshold, then in step606, the identity of the object is determined to be that of the known object identity associated with the predetermined signal. The determination step may be performed by the processor of the device100or system200. Subsequently, in step608, the count of the identified object identity is increased by one, e.g., by the processor and memory of the device100or system200. Preferably, the device100or system200maintains a count of the identified object identity for recording.

Alternatively, if the difference is determined to be not less than the threshold, then in step610, the identity of the object is determined to be not that of the known object identity associated with the predetermined signal. Subsequently, in step612, an alert is provided, e.g., by the input/output device(s) of the device100or system200.

In some embodiments, the method600may also include displaying, at the display of the device100or system200, a matching index that indicates an extent of matching of the received reflected signal with the predetermined signal, or an indication of the determined identity of the object, or both.

FIG. 7shows one implementation700of the determination step500ofFIG. 5. To simply discussion, the method700makes reference to only one transmitter and receiver. It should be noted, however, that the method700can well be applied to embodiments with multiple transmitters and receivers.

The method700begins in step702, in which the received reflected signal (from the object) is compared with multiple predetermined signals each associated with a known object identity. The predetermined signals are determined prior to operation, and are stored, e.g., in the memory of the device100or system200. The comparison in step702may be performed by the processor of the device100or system200. Then, in step704, a determination is made, e.g., by the processor of the device100or system200, as to which one(s) of the predetermined signal differ from the received reflected signal by than a respective threshold.

If it is determined that at least one of the predetermined signals differ from the received reflected signal by than a respective threshold, then the method proceeds to step706, in which a determination is made, e.g., by the processor of the device100or system200, as to which one of the predetermined signals that differ from the received reflected signal by than a respective threshold best matches the received reflected signal. The best match could be the predetermined signal with the smallest difference from the corresponding threshold. Once the best match is determined, then in step708, the identity of the object is determined to that of the known object identity associated with the bets matched predetermined signal. And in step710, the count of the respective identified object identity is increased by one, e.g., by the processor and memory of the device100or system200. Preferably, the device100or system200maintains a count of different object identities associated with the predetermined signals for recording.

Alternatively, if in step704it is determined that none of the predetermined signals differ from the received reflected signal by than a respective threshold, then the method proceeds to step712, in which an alert is provided, e.g., by the input/output device(s) of the device100or system200.

In some embodiments, the method700may also include displaying, at the display of the device100or system200, a matching index that indicates an extent of matching of the received reflected signal with the predetermined signal, or an indication of the determined identity of the object, or both.

FIG. 8Ashows an exemplary reflected received signal from the object, e.g., received by system200or device100in the above embodiments.

FIG. 8Bis a display of the output of the ultra-wideband-based object identification method ofFIG. 5in one embodiment of the invention. The display includes grids of different color, representing matching indexes between the received signal and the predetermined signals. The number “1” in the middle indicates the determined identity of the object.

FIG. 9is an ultra-wideband-based object identification system900in one embodiment of the invention. The system900has the same or similar construction as the system200ofFIG. 2and the device100ofFIG. 1. The system900generally includes a UWB transceiver operably connected with an information handling system950. The UWB transceiver901is arranged next to a conveyor belt40to scan or test object10that passes. The UWB transceiver901is operably connected with an information handling system950that includes processor, memory, input/output devices, disk drives, communication module, etc., like those in the system200ofFIG. 2. The information handling system950ofFIG. 9is operably connected with a remote server20for storage and retrieval of information and data (e.g., data measured or recorded by the system900). In this embodiment, if no match is determined by the system900, then a responsive action may be taken by the conveyor system. For example, the object10may be removed from the conveyor belt40, or it may be separated from the ones that can be identified or classified. In some embodiments, the conveyor system may separate the objects that have passed the system900according to identified classification of the objects (e.g., by directing them to different stations).

Although not required, the embodiments described with reference to the Figures can be implemented as an application programming interface (API) or as a series of libraries for use by a developer or can be included within another software application, such as a terminal or personal computer operating system or a portable computing device operating system. Generally, as program modules include routines, programs, objects, components and data files assisting in the performance of particular functions, the skilled person will understand that the functionality of the software application may be distributed across a number of routines, objects or components to achieve the same functionality desired herein.

It will also be appreciated that where the methods and systems of the invention are either wholly implemented by computing system or partly implemented by computing systems then any appropriate computing system architecture may be utilized. This will include stand-alone computers, network computers, dedicated or non-dedicated hardware devices. Where the terms “computing system” and “computing device” are used, these terms are intended to include any appropriate arrangement of computer or information processing hardware capable of implementing the function described.

It will be appreciated by persons skilled in the art that numerous variations and/or modifications may be made to the invention as shown in the specific embodiments without departing from the spirit or scope of the invention as broadly described. For example, the ultra-wideband-based object identification device, system, and method of the invention can be applied to test: object arranged in a box or package that conceals the object, object that is not arranged in any box or package, and object arranged in a box or package that only allows the object10be partly visible. The ultra-wideband-based object identification device, system, and method may be implemented on standalone device (e.g., embodiment ofFIG. 1) or distributively on multiple devices (e.g., embodiment ofFIG. 9). The UWB transceiver may take different form, orientation, number, shape, and size. The number of transmitter and receivers can be selected depending on applications (e.g., the resolution required). The display of the matching index and the indication of the determined identity of the object may take different form. Features in different embodiments can be re-grouped selectively to provide new embodiments. For example, the method in the above embodiments can be applied to the system200, the device100, or the system900, in like manner. The method embodiments may be all implemented in the system200, the device100, or the system900. Alternatively, they may be implemented selectively in the system200, the device100, or the system900. In embodiments with multiple transmitter and receiver elements, the method may be further arranged to analyze the received reflected signals (e.g., waveforms) with most information. Dynamic analysis of multiple received reflected signals received at the same receiver may be performed to reduce analysis and measurement error. In the embodiment ofFIG. 9, the information handling system can be a desktop computer, a smart phone, a tablet, a notebook computer, etc.

The described embodiments of the invention should therefore be considered in all respects as illustrative, not restrictive.