Patent Description:
The present invention may also include a system and/or method as embodied within the said station or device.

Previously, there has been a long felt need for a system or device that it is capable of safely and efficiently booking and processing passenger luggage in the airport environment.

A previous system is the BagDrop Standard Unit or system which is disclosed in de- tail at http://www. The BagDrop system is generally bulky and has severe limitations in terms of ease and/or speed of usage which is generally connected with the overall layout of the machine and location of the passenger loading luggage onto the machine.

<CIT> describes an earlier disclosed system that includes many improvements in ease of usage over the BagDrop Standard Unit. However, this disclosed system may generally lack adaptive features that allow for bulky passenger items or luggage to be processed. Additionally, the system may be improved with better systems. The disclosed system also has limitations in regard to the processing of airport tubs. <CIT> pertains to a method and apparatus for screening luggage. X-ray images derived by scanning the luggage with X-rays are received and processed with an automated threat detection (ATD) engine. A determination is then made whether to subject respective ones of the X-ray images to further visual inspection by a human operator at least in part based on results obtained by the ATD engine. In certain cases, visual inspection by human operator is by-passed and the ATD results are relied upon in order to mark luggage for further inspection or to mark luggage as clear. In another aspect, X-ray images derived by scanning the luggage using two or more X-ray scanning devices are pooled at a centralized location. ATD operations are applied to the X-ray images, which are then provided "on-demand" to a human operator for visual inspection. Results of the visual inspection are entered by the human operator and then conveyed to on-site screening technicians associated with respective X-ray scanning devices. <CIT> pertains to acquiring a volumetric image of a space from an imaging system. The space includes an object of interest and another object, and the volumetric image includes data representing the object of interest and the other object. A two-dimensional radiograph of the space is acquired from the imaging system. The two-dimensional radiograph of the space includes data representing the object of interest and the other object. The two-dimensional radiograph and the volumetric image are compared at the imaging system. A two-dimensional image is generated based on the comparison. The generated two-dimensional image includes the object of interest and excludes the other object. <CIT> pertains to a method and apparatus for assessing a threat status of a piece of luggage. The method comprises the steps of scanning the piece of luggage with penetrating radiation to generate image data and processing the image data with a computing device to identify one or more objects represented by the image data. The method also includes further processing the image data to compensate the image data for interaction between the object and the penetrating radiation to produce compensated image data and then determine the threat status of the piece of luggage.

Many earlier attempts have had issues in relation to airport security or passenger safety and it is an object of the present invention to at least address or ameliorate some of the issues. It is also an aim or objective of the present invention to provide an improved processing, system and/or method for processing luggage wherein reliability, convenience, and/or ease of usage is at least addressed or improved.

It is an object of the present invention to overcome or ameliorate at least one of the disadvantages of the prior art, or to provide a useful alternative.

A first aspect of the present invention may relate to a processing station for registering a piece of passenger's luggage for a trip, wherein the processing station comprises an injector for receiving the piece of luggage associated with the passenger; at least one sensor associated with the injector, the at least one sensor, in combination with at least the floor of the injector, creating a zone around the piece of luggage; and a controller associated with the sensor being adapted to: monitor, via the at least one sensor, intrusions through the zone to determine one or more whether a predetermined limit on dimensions of the piece of luggage has been exceeded or whether a foreign object has intruded the zone from outside, and allow further processing of the piece of luggage only if no intrusion of the zone is detected; and wherein the controller adjusts the area of the zone to accommodate different sizes of luggage.

Preferably, the zone may encompass the piece of luggage at a distance of between <NUM> to <NUM> from an outer perimeter of the piece of luggage.

Preferably, wherein the first aspect includes one or more cameras as the at least one sensor, and further the cameras may be stereoscopic cameras or infrared spectrum cameras.

Preferably, the first aspect of the present invention may also include three or more sensors and may also include at least one barcode reader.

Preferably, the first aspect of the present invention may include the injector wherein the injector includes no physical walls except for the floor; or alternately wherein the injector includes a physical front wall, physical side wall, and a physical floor.

Preferably, the zone may include concave or convex walls or walls that taper towards the centre of the injector.

Preferably, wherein the sensors include cameras, the cameras may be directed to- wards the centre of the injector, when in use.

Preferably, wherein the zone includes a virtual top wall which is generally parallel to a floor of the injector when the height of the virtual top is below a minimum threshold.

A second aspect of the present invention may include: a processing station for registering a passenger's luggage for a trip, wherein the processing station comprises: a lug- gage transportation tub having a first shape, the tub being adapted to receive the piece of luggage associated with the passenger; an injector for receiving the tub with the piece of luggage therein; at least one camera associated with the injector, wherein the at least one camera is positioned so as to allow an image of the tub to be taken; and a controller associated with the camera, the controller being adapted to control the operation of the at least one camera and wherein the controller compares the image to a database of predetermined tub shapes.

Preferably, wherein the controller confirms with the passenger the use of the tub. Also preferably, the controller may measure the combined weight of the luggage and tub and then subtracts the weight of the tub from the combined weight and records the result with the passenger's flight details.

Please note that the definition of the "centre of the injector" is intended to include the hypothetical centre or locations proximal to; and/or the equivalent point of the approximate centre of the floor or any approximate point rising from the centre of the floor ofthe injector.

In the context of the present invention, the words "comprise", "comprising" and the like are to be construed in their inclusive, as opposed to their exclusive, sense, that is in the sense of "including, but not limited to".

In the context of the present invention, the word "tub" may refer to or be construed as any tub suitable for use as a portable luggage receptacle in an airport environment. Typically, tubs include within their meaning a five shaped tray or cup shaped receptacle with a fiat bottom forming a general rectangular shape when viewed from a top view. Generally, tubs are constructed of light weight and relatively rigid material and generally are constructed of plastics or polymers including polypropylene.

The invention is to be interpreted with reference to the at least one of the technical problems described or affiliated with the background art. The present aims to solve or ameliorate at least one of the technical problems and this may result in one or more advantageous effects as defined by this specification and described in detail with reference to the preferred embodiments of the present invention.

Preferred embodiments of the invention will now be described with reference to the accompanying drawings and non-limiting examples.

The first preferred embodiment of the present invention includes a luggage process station or device that is adapted to receive luggage from a passenger. The station is adapted to safely receive the luggage and to then process the luggage. Preferably, processing the luggage may involve a multiple stage process which will be described in greater detail within this document. Preferably, the luggage processing station may include a processing area for receiving a piece of luggage.

Referring to the drawings, there is provided a processing station <NUM> for registering a passenger's luggage for a trip. The processing station <NUM> comprises an injector <NUM> for receiving a piece of luggage associated with the passenger. A plurality of or multiple sensors <NUM>-<NUM> are associated with the injector. The sensors <NUM>-<NUM> are described in detail below. A weighing machine <NUM> is also associated with the injector <NUM> for weighing the piece of luggage whilst on a bottom or lower surface of the injector <NUM>. The luggage processing station also comprises a user interface <NUM> for receiving various inputs for confirming that a passenger has checked-in. For example, the user interface <NUM> includes an electronic card reader, in the form of an RFID card scanner <NUM>, for reading an electronic identifier from an electronic RFID-enabled passenger identification card to confirm passenger check-in. Alternatively, or in addition, the scanner <NUM> may be adapted to read an electronic identifier stored on an electronic device, such as a passenger's mobile phone, and transmitted to the scanner using near-field RFID to confirm passenger check-in; or barcodes or QR codes may be used.

Preferably, the user interface also includes a scanner <NUM> for scanning various types of passenger boarding passes, such as paper boarding passes with magnetic strips and printed boarding passes with one dimensional (ID) barcodes. The user interface <NUM> may further include a magnetic card scanner for scanning magnetic strip-type passenger identification cards.

The user interface comprises a touch screen display <NUM> to display information to the passenger during processing of the piece of luggage. The screen <NUM> is adapted to display a message directing the passenger to remove their luggage and check-in prior to attempting to process their luggage if the input indicates that the passenger has not checked-in, the screen <NUM> also permits the passenger to input information to facilitate processing of the piece of luggage.

A controller <NUM> is associated with the sensors and weighing machine <NUM> and the user interface <NUM>. The controller <NUM> is adapted to accept the piece of luggage if the input received via the passenger's boarding pass or identification card indicate that the passenger has checked-in for the trip, feedback from the sensors <NUM>-<NUM> indicates that predetermined criteria, which are discussed in more detail below, are met, and if feedback from the weighing machine <NUM> indicates that weight of the piece of luggage is within a predetermined limit.

Preferably, the sensors 16a, 16b, (please note that sensors 16a and 16b are not visible in the perspective views shown in <FIG>, as there are positioned on the opposed respective inner side on injector proximal to the access opening) 16c and 16d, in combination with wails <NUM>, <NUM> and a floor <NUM> of the injector <NUM>, create a six-sided virtual box around a loaded piece of luggage. Sidewall <NUM> and top <NUM> of the virtual box are generated by the combination of sensors, respectively, such that no physical barrier is provided on these sides of the injector <NUM>, and thereby define a side access opening <NUM> to the injector <NUM> to facilitate a passenger side loading luggage into the injector <NUM> from a position adjacent the user interface <NUM>. The combination of sensors facilitate determination of whether the height and width of the loaded piece of luggage are within predetermined limits for acceptance. Sensors 16c and 16d (in cooperation with 16a and 16b respectively) include pho- to eyes for facilitating positioning of the piece of luggage in the injector <NUM> and determining whether the length of the piece of luggage is within predetermined limits for acceptance, However, in alternate embodiments, 3D imaging using cameras may be used to detect the length and width of the piece of luggage.

Physical walls <NUM> and <NUM> comprise a vertical glass panel to prevent unauthorised access to the piece of loaded luggage, whilst still allowing the piece of loaded luggage to be viewed. The initial height and width dimensions of the virtual box may be adjusted by a suitably authorised technician, for example to conform the luggage processing station to the regulatory standards on luggage dimensions for a particular airport.

The controller <NUM> is adapted to monitor, via sensors, intrusions through the virtual box to determine whether a foreign object has intruded the virtual box from outside, which may indicate that the piece of luggage has been tampered with, and allow further processing of the piece of luggage only if no intrusion of the virtual box is detected. The controller <NUM> is also adapted to monitor, via sensors <NUM>-<NUM>, whether the dimensions of the piece of luggage are within the predetermined limits applicable to the particular airport, and allow further processing of the piece of luggage only if the predetermined limits are determined not to have been exceeded. The controller <NUM> is also adapted to monitor, via sensors 16c and 16d, whether the piece of luggage is correctly positioned in the injector <NUM> and allow further processing of the piece of luggage only if this is the case. If the piece of luggage is determined to be oversized, the controller <NUM> causes the screen <NUM> to display a message for the passenger to remove the piece of luggage and proceed with same to an oversize luggage processing counter. If the piece of luggage is determined to be overweight, the controller <NUM> may cause the screen <NUM> to display a message offering for the passenger to repack the piece of luggage to reduce its weight. If the piece of luggage is accepted for further processing, the controller <NUM> causes the piece of luggage to be weighed via the weighing machine <NUM>. If the virtual box is breached after weighing of the piece of luggage is complete, the controller <NUM> is adapted to provide the passenger with a message indicating same via the user interface <NUM> or the screen <NUM>. Once the breach of the virtual box is rectified, the controller <NUM> is adapted to cause the piece of luggage to be re-weighed. If the virtual box continues to be breached by the piece of luggage, the controller <NUM> causes the screen <NUM> to display a message for the passenger to remove the piece of lug- gage and proceed with same to an oversize luggage processing counter.

The sensor <NUM>-<NUM> may also function as a user detection sensor to detect the presence of a user in a predetermined zone around the processing station <NUM>. The predetermined zone extends over an area around the user interface <NUM> and the access opening <NUM> to the injector <NUM>. The controller <NUM> is adapted to terminate processing of a piece of luggage if feedback from the sensor 16b indicates that the user has moved out of the predetermined zone prior to acceptance of the piece of luggage.

The luggage processing station <NUM> comprises detectors, comprising bar code scanners <NUM>, for detecting whether the piece of luggage has a bag tag applied that stores information for associating the piece of luggage with the passenger and the passenger's trip. Preferably, there are at least two bar code readers, wherein the first is mounted directly above the luggage and the second is mounted midway along the front wall. More preferably, the system may include <NUM> or <NUM> multi axis bar code readers mounted around the periphery of the injector to visualise the piece of luggage from multiple angles. The controller <NUM> is responsive to the detectors and is adapted to reject the piece of luggage if the detectors cannot detect the presence of a bag tag storing the required information. The trip information on the bag tag may comprise information for associating the passenger's luggage with a vehicle carrying the passenger on the trip, such as an aircraft IATA license plate. Preferably, the trip information may include any or all of the following: IATA license plate numbers, flight date, trip information, flight number, destination, passenger names. Preferably, a printed bag tag may be issued by the printer <NUM> in this embodiment or a separate kiosk electronically linked to the embodiment may be able to process and print the appropriate bag tag.

Please note that in some further embodiments, the sensors <NUM>-<NUM> may be formed by the use of cameras acting as the sensor and in these situations, at least one camera may operate as a bar code reader and in turn supply information to the controller.

The bag tag may be in the formed of a printed tag with a barcode or alternately a RFID tag may be used; or a combination of the two methodologies.

Preferably, the user interface includes a printer <NUM> for printing a luggage receipt for accepted luggage with an electronic bag tag. The tag may alternatively be a barcoded tag, such as a ID or 2D barcode paper tag, readable by barcode scanners <NUM>. The barcode scanners <NUM> are movable and are located above the floor <NUM> of the injector so as to have line of sight with the piece of luggage on the inner surface of the injector <NUM>. The barcode scanners <NUM> are also programmed to ignore barcodes sensed outside a predetermined zone that is established based on x, y and z coordinates from the barcode scanners <NUM>.

This reduces the risk of the barcode scanners <NUM> reading barcodes not associated with the piece of luggage in the injector <NUM>.

The controller <NUM> is adapted to reject the piece of luggage if the weighing machine <NUM> indicates that the piece of luggage exceeds a predetermined weight and is thereby classified as heavy, but is still less than a maximum allowable weight. In such cases, the controller <NUM> is adapted to send a message indicating same to the passenger via the screen <NUM>. Where the passenger has not exceeded their maximum luggage weight allowance, the message instructs the passenger to apply a heavy tag to the piece of luggage. To facilitate same, the controller <NUM> may cause a colour-coded, RFID, barcoded print out or a heavy tag to be dispensed by a heavy tag dispenser (not shown) associated with the injector <NUM> for application to the piece of luggage. Preferably, a colour coded RFID tag or a barcoded heavy tag may be attached to the piece of luggage and the embodiment confirms the presence of the heavy tag before accepting the piece of luggage for registration into the system.

Sequential coding of tags is also used to facilitate monitoring of stock levels of tags in the processing station <NUM>. If the sequential coding indicates that tag stock levels are below a predetermined level, the controller <NUM> is adapted to cause a message to be transmitted, for example by a beacon, SMS or paging, to alert staff to restock the tags. The dispensed heavy tag may alternatively take the form of a printed tag including visual indicia and/or a barcode for indicating weight data for the piece of luggage.

If the piece of luggage is determined to exceed the maximum allowable weight, which may be based on a limit set for occupational health and safety reasons, then the controller <NUM> may reject the piece of luggage and cause a message to be sent to the passenger, via the screen <NUM>, informing the passenger of same and offering for the passenger to repack the piece of luggage to reduce its weight. The maximum luggage weight allowance for the passenger may be affected by the payload capacity of the aircraft carrying the passenger on the trip and/or the passenger's status with the airline associated with the trip. The controller may be adapted to cause weight information associated with the piece of luggage to be sent to a flight management system for aircraft weight and trip purposes.

In some embodiments, a dispenser may be provided for dispensing paper tags for classifying the piece of luggage as being a priority piece of luggage, a piece of luggage with special handling requirements, and/or a piece of luggage of a special class. The controller <NUM> is also adapted to reject the piece of luggage if a passenger has reached the maximum number of pieces of luggage in their luggage allowance or their maximum luggage weight allowance. In such cases, the controller <NUM> is adapted to send a message indicating same to the passenger via the screen <NUM>. The message provides the passenger with options for rectifying the breach of their luggage entitlement, such as repacking their luggage to reduce weight or paying a surcharge. If the passenger elects to repack their luggage, the controller <NUM> causes the weighing machine <NUM> to re-weigh the luggage upon the passenger indicating via the touch screen <NUM> that the bags have been repacked and once the virtual box is detected to be intact.

Alternatively, the passenger may elect to pay a surcharge to increase their luggage entitlement. Once rectification action has been taken by the passenger, the controller <NUM> checks again if the luggage is now within the passenger's entitlement and, if so, accepts the piece of luggage and causes the printer <NUM> to print a luggage receipt and/or an excess luggage receipt or excess luggage advice slip. Alternatively, as discussed above, where the passenger has a compatible electronic bag tag, the controller <NUM> causes one of the RFID antennas to write to the electronic bag tag the data associating the piece of luggage with the passenger and the trip or vehicle on which the passenger is booked to travel. One of the antennas may also be adapted to write to the electronic bag tag information classifying the piece of luggage as being a priority piece of luggage, a piece of luggage with special handling requirements, and/or a piece of luggage of a special class. An injector conveyor <NUM> is provided in the floor of the injector <NUM>. The weighing machine <NUM> is located below the injector conveyor <NUM> and has a recess therein for housing one or more antennae, with a top surface of the antenna 16f being flush with the underside of the conveyor <NUM> when in position in the recess. The other RFID antennas are located above the floor of the conveyor <NUM>. The controller <NUM> is adapted to actuate the conveyor <NUM> if feedback from the sensors 16c, 16d indicates that the piece of luggage is not within a predetermined zone of the injector <NUM>, this zone being a zone within which the piece of luggage can be weighed by the weighing machine, have its maximum length checked by the sensors 16c, 16d, or other sensors (including Microsoft Kinect™ style camera based sensors) and have any bag tags thereon read by the RFID antennas and/or barcode scanners <NUM>. The controller <NUM> is also adapted to actuate the conveyor <NUM> if none of the RFID antennas and/or the barcode scanners <NUM> is able to communicate with a bag tag on the piece of luggage. In such a case, the conveyor is first moved by a distance of approximately <NUM> and communication with the bag tag is attempted again. If communication with the bag tag is still not possible, the conveyor is moved by a further distance of approximately <NUM> and communication is attempted again. If communication with the bag tag still fails after a predetermined number of movements of the conveyor <NUM> (more preferably three movements), the controller <NUM> may be adapted to transmit a message to the display screen <NUM> instructing the passenger to manually reposition the piece of luggage and/or bag tags, and/or to terminate processing of the piece of luggage.

Once a piece of luggage has been accepted, the controller <NUM> actuates the injector conveyor <NUM> to convey the piece of luggage to a downstream collector conveyor system <NUM>. The conveyor <NUM> may be actuated by a variable speed drive that runs at a lower speed during movement of the conveyor <NUM> by approximately <NUM> increments than during movement of the conveyor <NUM> to convey a piece of luggage to the downstream collector conveyor system <NUM>. The controller <NUM> may be adapted to actuate the conveyor <NUM> to move the piece of luggage in an abrupt manner when moving by the <NUM> to <NUM> increments but most preferably <NUM> increments to facilitate reorientation of the RFID tag. Preferably, the controller may jiggle the luggage using the conveyor <NUM> to move the machine-readable tags on the luggage into an orientation that may be read to the top mounted barcode reader or front mounted barcode reader.

Preferably, the injector conveyor <NUM> is oriented so that it is generally parallel with the ground to prevent the luggage from toppling off the said conveyor. The injector conveyor preferably includes an additional rubberised grip in the form of parallel lines or grooves running in a lateral direction along the length of the conveyor <NUM>. In the down- stream conveyor <NUM>, the conveyor may be elevated at a distal end away from the passenger leading to a small incline of the downstream conveyor of less than <NUM> degrees. The downstream conveyor <NUM> may include a conveyor surface with a diamond shaped grip pat- tern to improve grip and restriction forces engaging the luggage for movement. Typically, the downstream conveyor may be operated at a higher speed than the injector conveyor <NUM> for primarily safety reasons as the passenger generally comes into contact with the injector conveyor belt only.

In some embodiments, the controller <NUM> is adapted to deactivate the conveyor if an intrusion through the virtual box is detected via sensors <NUM>-<NUM> during processing of a piece of luggage in the injector <NUM>. The controller <NUM> may also be adapted to close landside to air- side barriers if an intrusion through the virtual box is detected and preferably this may occur when the light curtains or appropriate sensors above the downstream conveyor <NUM> detect an intrusion.

The controller <NUM> may further be adapted to cause a notification, such as triggering of a security alarm, to be sent to a security system or security personnel if an intrusion through the virtual box from outside by a foreign object is detected. The controller <NUM> may be adapted to allow processing of the piece of luggage to continue or to be restarted if a predetermined security code is input and/or if electronic identification meeting predetermined criteria is provided. The predetermined security code may be input via an Airline Security Identification Card (ASIC). The controller <NUM> may be adapted to allow manual pro- cessing of the piece of luggage via the processing station <NUM> to continue if the predetermined security code is input. The controller <NUM> may be adapted to allow manual actuation of the injector conveyor <NUM> in a forward or reverse direction if the predetermined security code is input to send luggage to the downstream collector conveyor system <NUM> or return a piece of luggage from downstream. The controller <NUM> may be adapted to permit deactivation of a security alarm if the predetermined security code is input. The controller <NUM> may be adapted to permit different levels of access to the luggage processing station <NUM> de- pending on the predetermined security code that is input.

Monitoring devices may be provided around the injector <NUM> to detect when luggage is placed on the bottom surface of the injector <NUM> as well as intrusion during processing of the piece of luggage and delivery of the piece of luggage to the downstream collector conveyor system. The monitoring devices may comprise one or more of lasers, photo eyes 16c and 16d and light curtains 16i.

The user interface <NUM> may be adapted to require the passenger to answer questions about the configuration of their luggage. If the passenger's answers indicate that the lug- gage may cause problems with downstream luggage handling apparatus, for example due to having straps or being unusually configured, the luggage may be classified as an awk- ward bag and the user interface <NUM> may be adapted to instinct the passenger to place the luggage into a luggage transportation tub (not shown) and to place the tub (not shown) with the luggage therein in the injector <NUM>. In other embodiments of the present invention, this verification process step may be achieved automatically by the system without further user interaction.

According to an example not part of the invention, the luggage transportation tub (not shown) may be embedded with an electronic RFID tag that is integrally connected to the tub (not shown), for example by being moulded into the tub (not shown). The controller <NUM> is adapted to only allow the awkward shaped or irregular shaped luggage to be processed if feedback from the RFID) antennas indicates that the luggage is in a tub (not shown). When a piece of luggage in a tub (not shown) is detected, the controller <NUM> is adapted to automatically deduct the weight of the tub (not shown) from the weight measured by the weighing machine <NUM> to determine the actual weight of the piece of luggage.

According to the invention, the tub with the RFID tags is replaced with a tub without RFID tags wherein the sensors <NUM>-<NUM> are constructed of cameras and the controller <NUM> includes 3D pattern recognition software. According to the invention, the controller is able to detect the use of the tub from pattern recognition software that compares the presented tub with a databases of tubs commonly used in the airport within which the station is installed. This allows the system to automatically detect the use of a standard luggage tub as used within air- port facilities.

Preferably, wherein a tub is detected as being used by a passenger, the controller may automatically detect the weight of tubs from the combined weight of the tub with luggage. The result is recorded with passenger flight information. The controller may also use the passenger interface to confirm the use of the airport tub.

One or more cameras may also be positioned around the injector to record images of luggage accepted. The cameras, or other image capturing devices, may also be used to detect the location of intrusions through the virtual box or virtual zone. Weight specific logic associated with the controller <NUM> and governing its relationship with the weighing machine <NUM> is separated from other code associated with the controller <NUM>. The weight specific logic is maintained in a first module having a unique version number and the other code is maintained in a separate module or modules having a unique version number of numbers that is distinct from the version number of the module in which the weight specific logic is maintained. In this manner, changes to non-weight related aspects of the code/logic associated with the controller <NUM> do not require recertification of the pro- cessing station <NUM> as a weighing device. The weighing device is adapted to automatically recalibrate itself to zero weight after acceptance of a piece of luggage and before weighing a new piece of luggage.

The processing station <NUM> is adapted to store a history of accepted luggage to facilitate investigations. The controller <NUM> may be adapted to allow the history to be accessed or printed if a user provides a predetermined security code. The security code may be provided in a number of formats, as discussed above with respect to overriding of security alarms.

It will be appreciated that the above described and illustrated processing station <NUM> provides many advantages over conventional passenger luggage handling systems, some of which are discussed above, but which additionally include: providing for luggage pro- cessing and injection only at the processing station <NUM>, which largely mitigates queues; providing enhanced security and safety checks to detect incidence of luggage tampering; providing the ability to write information, such as flight and weight information, to electronic bag tags; speeding up the process of checking in luggage for a flight; facilitates passenger self-service; and facilitates the passenger staying within the predetermined zone covered by sensor <NUM>-<NUM> during loading and processing of the piece of luggage due to the orientation of the access opening <NUM> transverse to the axis of the conveyor <NUM>, in combination with the positioning of walls <NUM> and <NUM> and with the positioning of the user interface <NUM> on the same side of the conveyor <NUM> as the access opening <NUM>; reducing the risk of reading from and/or writing to RFID tags not associated with a piece of luggage in the injector by housing the RFID antenna (not shown) in a recess underneath or within the conveyor <NUM>; increasing the incidence of non-communication between tags and the RFID antennas and/or barcode scanners <NUM> by automatically adjusting the position of the piece of lug- gage using the conveyor <NUM> if communication cannot be established; accepting multiple boarding pass types; accepting multiple bag tag devices; luggage acceptance area monitored with lasers, photo eyes and light curtains to detect when baggage is placed in the area as well as intrusion during the acceptance process; weighing and measurement of luggage in the baggage acceptance area; an interactive user interface; printers embedded to print out excess baggage receipts and heavy tags embedded with RFID to ensure the tag is attached when a bag is heavy; tubs embedded with RFID are used for awkward bags so that they can be detected when used; and use of cameras to record images of bags accepted.

Preferably, in these embodiments the controller may form an artificial three-dimensional zone around the piece of luggage <NUM>. This artificial three-dimensional zone may be in the form of a virtual box as shown in <FIG> and it preferably seals the area designated by the zone from third party intrusion into the zone (or sometimes referred to as field). In these embodiments, the zone is also described as a dynamic virtual box or shape. The dynamic virtual shape is preferably formed around or about a piece of luggage to be processed. Preferably, the zone may be modified in terms of shape to closely approximate the general shape of the luggage <NUM>. The closer the zone approximates the shape the lug- gage, the more reliable the system is against accidental intrusion into the zone. For example, a passenger may have loaded a piece of luggage onto the injector, whilst the passenger is also carrying a handbag with swinging straps, sometimes the swinging straps may swing over the injector. It is an advantage of the current embodiments that the controller will not react to a swinging handbag strap that does not enter the zone. This leads to better passenger experience and less wastage of time by false intrusions which may occur with other similar systems.

Preferably, the dynamic virtual shape or zone may be adjusted or modified in terms of shape or dimensions to fit the piece of luggage inserted into the injector. The dynamic virtual zone is preferably adapted to provide a secure field around the piece of luggage and to prevent intrusion of the field by the user or foreign object. Preferably, the zone sur- rounds or encompasses the piece of luggage at a distance of between <NUM> to <NUM> from the outer perimeter of the piece of luggage.

Preferably in the preferred embodiments of the present invention, the dynamic virtual box wall and ceiling may be initially set at pre-set values and may be configured at the build and commission stage of station installation. Therefore, the preferred sensor height setting may preferably be set to approximately <NUM> due to restrictions on design, which is far more than the height of most bags. The virtual box outline can be seen in <FIG>. The height and locations of the sensor walls may be dynamically altered to match the piece of luggage which is positioned within the injector by a process within the embodied system or device.

If a user then places a bag on the belt, even after the first initial scan of the bag, the laser sensor determined or LMS intrusion height preferably would not change. This there- fore may allow that the occurrence of passengers, who accidentally and unintentionally intrude due to leaning on the front glass panel, or swinging their hand luggage into the interference zone, can be quite high.

It is generally noted that other shapes other than boxes may be used to achieve a similar result or function including spheres. Additionally, it is noted that the station and system may be improved by extending the zones to other shapes rather than solely box shapes. Preferably, the dynamic virtual zone may include side walls or top walls that are deflected in a convex or concave manner to accommodate similarly shaped bags and/or luggage. Preferably, the controller includes a pattern recognition algorithm and may determine whether the piece of luggage is irregularly shaped and may bend the wails of the zone accordingly.

The virtual zone system may be modified to be dynamic using the Microsoft Kinect™ 3D camera systems or arrays instead of relying on the fixed laser sensing devices. The de- fault max height may be reduced to <NUM> (or another value if required). Please note that other stereoscopic camera systems may also be used, but the preferred systems include an array of at least two cameras to provide a three-dimensional image via stereoscopically linking the cameras. Preferably, the cameras or camera arrays may be mounted on motorised mounts to allow for rotation, if required. Additionally, the cameras may be positioned near or proximal to the upper limit of the virtual zone and may be oriented at an angle to- wards the centre of the injector wherein the luggage is received. Additionally, the preferred sensors or cameras may be adapted to operate in the infrared frequency so that they are either: not visible to passengers and to reduce noise-based interference; or less susceptible to light fluctuations in the airport facility within which they are positioned.

Preferably, the injector may be configured to include one camera array mounted on the top front of the injector and two camera arrays mounted in a tunnel over the down- stream conveyor <NUM>, wherein the two camera arrays are directed towards the area wherein the luggage is received.

With the Dynamic Virtual zone, upon placing a bag on the belt and the initial three-dimensional (3D) scan being completed, the side and height measurements will be changed to suit the dimensions of the bag. This will therefore be slightly higher than the bag placed on the conveyor and is worked out using complex 3D mathematical algorithms. The virtual ceiling will also taper off towards the front glass panel to reduce the chance of unintended intrusions where a passenger may be leaning over the panel (see <FIG> in regard the top wall <NUM>).

If a passenger does intrude after the dynamic virtual box has been set, the default size virtual box (<NUM> height) will be temporarily used until the post-intrusion scan has been completed (in order for the dynamic virtual box to be re-calculated). This allows for dynamic adjustment of the virtual box due to a changed bag position or the placement of a different bag onto the belt. The image depicted in <FIG> and <FIG> show the 'dynamic' virtu- al box adjusted to suit the size of the bag or piece of luggage on the scale conveyor.

In this specification, the laser sensing Module is also referred to as 'Intrusion Processing Module' or 'Intrusion Detection Processing Module'.

Generally, an Intrusion Processing Module consisting of one or more depth image sensors, but preferably <NUM> sensors. The sensors may be light curtains, stereoscopic cameras including but not limited to Microsoft Kinect™ devices, photo eyes. At least one default depth image sensor that has adequate field of vision of the injector. The Intrusion Pro- cessing Module is connected to a controller which may be able to allow or limit movement on the injector conveyor <NUM> and dispatch/downstream conveyor <NUM>.

In one embodiment, the default depth image sensor creates a virtual zone consisting of a relatively vertical curtain between the user and the scale conveyor and a relatively horizontal curtain above the scale conveyor. Should an intrusion occur in either of these regions, the controller will restrict or immediately stop the injector conveyor <NUM> and dis- patch or downstream conveyor <NUM> will cease moving. The controller will also stop the lug- gage from being processed for check in.

The Intrusion Processing Module is able to dynamically adjust the virtual box, surrounding the check in luggage, based on the dimensions of the passenger luggage being checked in. This will result in an optimal intrusion region, similar in height to the height of the passenger luggage, thereby, for the most part, reducing unwanted accidental intrusions due to either limbs, handbags, carry-on bags etc. entering the virtual zone.

Preferably, a luggage processing station preferably for use in processing luggage at an airport, wherein the station may include: at least one depth image sensor, (the default depth image sensor) that has adequate field of vision of the injector. That is: The depth image sensor shall have the entire scale conveyor in its field of vision, i.e. beginning at the end stop (which is preferably determined by the position of sensor 16c) and ending with the down-stream conveyor <NUM>, the depth image sensor shall have the entire sidebar in its field of vision, the depth image sensor shall have the maximum permissible bag height in its field of vision for the entire length of the scale conveyor, no point in either the side or top region of the virtual zone must be further than <NUM> from the depth image sensor.

The station may also include a real time communication module to operate between the 3D Scanner or camera (any one or more of sensors <NUM>-<NUM>) and the Intrusion Processing Module. The Intrusion Processing Module requires an up to date and accurate calibration file, for each depth image sensor relevant to the preferred injector.

If any depth image sensor's orientation is moved, the 3D Scanner will be required to recalibrate before the Intrusion Processing Module can again be declared reliable.

After each scan, the Intrusion Processing Module will require the luggage height in order to dynamically re-locate the virtual zone surrounding the piece of luggage.

At least one depth image sensor, (the default depth image sensor) that has adequate field of vision of the injector is able, in conjunction with the walls <NUM> and <NUM> and floor <NUM> of the injector, to create a virtual zone around the piece of luggage, by constructing a virtual side curtain <NUM> and virtual top curtain <NUM>. The processing module associated with the default depth image sensor will monitor any intrusions through the virtual zone, to determine one or more of whether a predetermined limit on dimensions of the piece of luggage has been exceeded or whether a foreign object has intruded the virtual zone from outside, and allow further processing of the piece of luggage only if no intrusion of the virtual zone is detected.

As part of its initialization routine, the Intrusion Processing Module will define a de- fault virtual side curtain and virtual top curtain to form the initial virtual zone. The Intrusion Processing Module will also define multiple virtual zones with a predefined minimum and maximum height at a predefined interval or step size.

The word "virtual box" or "virtual zone" throughout this specification is to be understood as meaning a zone that is wholly or in part comprised of a non-physical barrier. The virtual zone consists of a three-dimensional area that encompasses a piece of luggage and is generated by preferably two or more of the depth image sensors. Preferably, the virtual zone may encompass the piece of luggage wherein the floor forms one side of the zone and the remainder of the zone is determined by physical barriers and virtual walls generated by sensors. In some embodiments, the physical barriers (as shown in <FIG> as walls <NUM> & <NUM>) may be omitted and replaced with virtual walls.

The dimensions of the virtual zone or box may be adjusted to conform to the respective regulatory standards on luggage dimensions for a particular airport.

Both the virtual side and top curtain will have a predefined thickness, which will result in a defined minimum and maximum depth intrusion region, whereby any part of any object found to fall within this depth region will be analysed to determine whether it is a positive intrusion or not. To prevent accidental intrusions, it is generally required that the intrusion to be persistent over a predefined period of time (preferably in a range of <NUM>-2sec but most preferably <NUM>). This feature may prevent accidental intrusions and to eliminate noise.

Preferably, the intrusion size should be required by the system to exceed a predefined minimum threshold in order for the intrusion to be considered as valid (e.g. <NUM>-<NUM>).

Depth frames are processed by the Intrusion Processing Module at a sampling frequency of <NUM>. However other frequency ranges are possible.

In most implementations, the depth image sensor is situated above the maximum permissible bag height, and therefore is tilted downwards, in order to be able to fully image the injector conveyor <NUM>. Therefore, in order to maximise the viewing area of the depth image sensors, the Intrusion Processing Module can be configured so that the virtual top curtain <NUM> may not be flat (as shown in <FIG>), but tapers downwards, as the injector conveyor <NUM> approaches the downstream conveyor <NUM>. This is to counteract the depth image sensor's limitations on its field of view; so that the entire virtual top curtain remains within the depth image sensor's field of view.

The virtual side curtain <NUM> has a varying lower height in order to accurately track the side guard's height (see <FIG>). This can be calibrated to within a few millimetres (preferably between <NUM> to <NUM>) so that no piece of luggage or any other object is able to intrude, undetected, in the gap between the side guard and the bottom of the side virtual curtain.

In some of the implementations or embodiments, it may be possible that more than one depth image sensor is used on the same system for other purposes (other than creating a virtual box). When the other scanning functions are performed by other sensors mounted around the station.

Preferably, the station may include one or more sensors but in the preferred embodiments, the station may include three sensor arrays and two bar code readers.

After each scan the 3D Scanner (e.g. in this embodiment this sensor is shown as sensors <NUM>-<NUM>) will convey to the Intrusion Processing Module, the height of the current piece of luggage. Using the sum of the luggage height and a predefined safety margin, the Intrusion Processing Module will update the virtual side and top curtain with one of the multiple virtual boxes (comprising the dynamic virtual zone). The criteria in choosing the height of the dynamic virtual zone is that it is as close to the luggage height as possible, but that it lies above the sum of the luggage height and the predefined safety margin. Preferably, the zone is amended and modified between the insertion of different pieces of luggage into the injector.

The virtual side curtains or walls contained within the multiple virtual boxes or zones, accurately track the lowered virtual top curtains, so that both the side and top curtain have the same height.

Preferably, lower virtual zones (in terms of height) may comprise of virtual top walls that are generally fiat or level or generally parallel to the floor of the injector; as the virtual boxes increase in height past a minimum threshold, the virtual top curtain or wall may begin to taper towards the centre of the injector where the injector conveyor approaches the downstream conveyor to counteract the depth image sensor's limitations on its field of view.

Preferably, in some embodiments of the present inventions, all virtual side curtains or walls may be contained within the multiple virtual boxes or zones accurately track the sidebar height.

At a predefined rate of approximately <NUM>, a data packet is sent to the controller with all the necessary information generated by the Intrusion Processing Module. This information includes: whether there is currently a valid intrusion in the virtual side curtain, whether there is currently a valid intrusion in the virtual top curtain, and whether the virtual side curtain is adequately visible to the depth image sensor, whether the virtual top curtain is adequately visible to the depth image sensor.

It may also be preferred, wherein a data packet is sent from the Intrusion Processing Module to the controller, as soon as each depth image received by the depth image sensor has been received and checked for intrusions. Each data packet acts as a heartbeat to the controller, to indicate the intrusion Processing Module is alive and well. If the controller does not receive a heartbeat within a predefined duration of time, the Intrusion Processing Module is declared to be in a fault state, and the controller must take ap- propriate safety actions.

In alternate embodiments of the present invention, further improvements may be made the overall system or station. Due to the 'noise' or unreliability of some network environments, not all packets sent by the Intrusion Processing Module are received by the controller. The protocol adhered to in sending data packets is UDP which does not guaran- tee delivery of data. For this reason, the Intrusion Processing Module is configurable so that when a valid intrusion is detected, the Side or Top Intrusion bit in the data packet can be set to true for an extended predefined period, even after the intrusion is no longer pre- sent. This is to ensure that an intrusion may be registered by the controller.

The top and side virtual curtains are configurable in their height and position relative to the scale conveyor, the percentage of either virtual curtain that falls outside of the depth image sensor's field of view is declared 'out of bounds'. Should the percentage of either virtual curtain that is 'out of bounds' exceed a predefined threshold, thenthe Intrusion Processing Module cannot be relied on to accurately check for intrusions and should be reconfigured.

If a point within the depth image sensor's field of view does not have a valid depth, that point is said to be 'invisible'. Reasons for there being invisible points within a depthimage sensor's field of view include the following: sunlight in the depth image sensor's field of view; or a reflective surface in the depth image sensor's field of view e.g..

The Dynamic Virtual Box could be further improved to taper towards the virtual side curtain, i.e. towards the user, thereby further decreasing the chance of accidental intrusions, which may be due to the user's or passenger's swinging handbag straps.

A preferred embodiment of the present invention may also include a processing station for registering a passenger's luggage for a trip, the processing station comprising a luggage transportation tub having a first shape, the tub being adapted to receive a piece of luggage associated with the passenger; an injector for receiving the tub with the luggage therein; at least one camera associated with the injector, wherein the camera is positioned so as to allow an image of tub with the luggage to be taken; and a controller associated with the camera, the controller being adapted to control operation of the camera and wherein the controller compares the image to a database of predefined tub shapes.

Claim 1:
A processing station for registering a passenger's luggage (<NUM>) for a trip, the processing station comprising:
an injector (<NUM>) for receiving a luggage transportation tub, the tub being adapted to receive the luggage (<NUM>) associated with the passenger;
at least one camera (<NUM>, <NUM>) associated with the injector (<NUM>), the at least one camera being arranged to acquire an image of the luggage transportation tub; and
a controller for comparing (i) an image taken of a luggage transportation tub by the at least one sensor, and (ii) a database of predefined tub shapes including standard tub shapes to automatically detect the use of a standard luggage transportation tub, characterized in that a luggage transportation tub without RFID tags is used as luggage transportation tub, and the controller (<NUM>) is arranged to use pattern recognition software in comparing the luggage transportation tub with databases of tubs commonly used in the airport within which the processing station is installed, and
the controller is further arranged to allow further processing of the luggage (<NUM>) if the use of a standard luggage transportation tub is detected.