Safety system for tracking movable objects during vehicle production

Safety systems and methods for tracking objects such as personnel and tools during a vehicle build process and activating an alarm when the tracked object is within a safety zone where such presence is not permitted under the current circumstances. The safety system includes a multiplicity of active positioning sensors configured to detect the presence of an object at a particular distance from or within a particular area or volume of space and a controller configured to use sensor data to calculate the virtual location of each sensed object relative to a virtual computer-aided design map of the as-built aircraft design. In response to detection of the presence of an object in unacceptable proximity to or within a particular safety zone of the vehicle, an alarm is activated and the planned build process is altered.

BACKGROUND

The present disclosure relates generally to systems and methods for ensuring the safety of personnel during the production of a vehicle or other machine comprising electrical equipment. In particular, this disclosure relates to systems and methods for ensuring the safety of personnel during a “power-on” stage of a vehicle (e.g., aircraft) build process.

There are three major stages in a typical aircraft build process. The first stage is structural assembly. This step is constrained by the fact that most critical tasks need to be performed with the aircraft in a stress-free condition. Therefore, no aircraft movements are possible during execution of the structural assembly step. The second stage is equipment installations. Equipment installation includes electrical installations and hydraulic and fuel pipeline modifications. Tests that do not require aircraft power on are also included in this stage. The third stage is indoor power-on tests and first refurbishing. The tests are performed indoor with aircraft power on. The third stage also includes the refurbishing of those parts that will not be either disassembled or damaged during outdoor tests.

Tracking people and tools located in proximity to areas of an aircraft (or other vehicle) that will be electrified during a “power-on” stage of production is challenging. When electric power is turned on, safety is paramount.

SUMMARY

The subject matter disclosed in detail below is directed to safety systems and methods for tracking objects such as personnel and tools (e.g. wrenches, wire strippers, soldering guns, etc.) during a vehicle build process and activating an alarm when the tracked object is within a defined safety zone. For example, a tool or piece of equipment may be in proximity to electrical equipment of a vehicle prior to a scheduled electrification. In particular, the safety systems and methods proposed herein ameliorate or mitigate the dangers which may arise during a “power-on” stage of an aircraft build process or during operation of machinery or robots capable of causing harm to a human. The safety systems and methods disclosed herein are useful in production environments such as aircraft production facilities. The safety system includes at least one sensing device configured to detect the presence of a person or tool within a safety zone, and a controller configured to automatically alter at least one aspect of the production environment responsive to the detection of the human and/or tool presence in the safety zone.

In accordance with some embodiments, the safety system includes a multiplicity of active positioning sensors (e.g., active or passive RFID devices, smartphones or watches, blue-tooth device, etc.). The sensors are configured to detect the location an object relative to a particular area or volume of space. As used herein, the term “sensor” means a device that responds to a physical stimulus (such as heat, light, sound, pressure, magnetism or a particular motion) and transmits a resulting impulse (as for measurement or operating a control). The safety system further includes a controller that is configured to receive sensor data from sensors of a sensor network and use that sensor data to calculate the virtual location of each sensed object relative to a digital map having virtual prioritized safety zones defined in the coordinate system of the sensor network. More specifically, the controller calculates the virtual location of a sensed object in the frame of reference of a sensor network and then determines whether that virtual location is within a virtual safety zone having a known location and extent in the frame of reference of the sensor network. In response to detection of the presence of an object in unacceptable proximity to or within a particular safety zone of the vehicle in production, an alarm is activated and the planned build process is altered, e.g., by blocking electrification of electrical equipment onboard the vehicle. More specifically, the controller measures the distance separating the object from electrified areas of the vehicle and then issues a control signal that engages a lock-out of the next scheduled “power-on” phase of the vehicle build process. In addition, safety personnel may be dispatched to the vehicle to recover tools that are out of place.

One proposed implementation of the safety system has the capabilities to: (1) calculate the virtual location of the tool or personnel relative to a virtual map derived from a computer-aided design (CAD) model of the as-built vehicle as opposed to sensing the physical presence of the tool within a physical area/volume; (2) derive safety zones mathematically by offsetting three-dimensional (3-D) nested shapes (two or more) based on a 3-D CAD model of the aircraft; (3) derive plural safety zones that are not contiguous (e.g., the avionics bay and the aft landing gear), but are defined to have the same urgency and priority (thus treating the plural safety zones as a single safety zone); (4) create 3-D nested zones which are governed by programmable rules that act in safety response modes of increasing priority (e.g., warning→warning tone/noise→stop production line); (5) customize and change the rules to meet one or more of changing needs, changing safety procedures, and changing 3-D aircraft shapes (e.g., engineering changes); (6) compute whether a tag (e.g., worn on a person or attached to or incorporated in a tool) is located within a volume of space; (7) track, monitor and account for any equipment or tool in use by humans—powered or not—and ensure that the equipment or tool is returned to its proper storage location before aircraft power-up (or before any production process involving complex heavy machinery or robots may resume); and (8) use smartphones or tablets to log, detect, track, sense and alert humans while providing access to applications needed to compute the location of lost objects in 3-D space and look up part or tool information.

Although various embodiments of systems and methods for tracking personnel and tools in a vehicle production environment are described in some detail later herein, one or more of those embodiments may be characterized by one or more of the following aspects.

One aspect of the subject matter disclosed in detail below is a method for tracking objects in a vehicle production environment, the method comprising: (a) constructing a digital map including virtual boundaries of a vehicle and a virtual safety zone positioned in accordance with a coordinate system of a sensor network using vehicle model data and safety specifications; (b) receiving sensor inputs from the sensor network; (c) determining a virtual location of an object on the digital map based on sensor inputs which locate the object in the coordinate system of the sensor network; and (d) issuing an alert in response to a determination in step (c) that the virtual location of the object is within the virtual safety zone. In cases wherein the vehicle includes electrical equipment in a zone corresponding to the virtual safety zone, the method further comprises blocking electrification of the electrical equipment in response to issuing the alert. In accordance with one embodiment, step (c) further comprises estimating an actual (physical) distance separating the object from a hypothetical geometric boundary in physical space corresponding to the virtual safety zone by calculating a virtual distance separating the virtual location of the object from the virtual safety zone in the digital map.

Another aspect of the subject matter disclosed in detail below is a system for tracking objects in a vehicle production environment, the system comprising a non-transitory tangible computer-readable storage medium storing a vehicle model database, a sensor network having a coordinate system, an alarm system and a proximity tracking computer system communicatively coupled to receive sensor inputs from the sensor network and send alert signals to the alarm system, wherein the proximity tracking computer system is configured to perform operations comprising: (a) constructing a digital map including virtual boundaries of a vehicle and a virtual safety zone positioned in accordance with the coordinate system of the sensor network using vehicle model data and safety specifications; (b) receiving sensor inputs from the sensor network; (c) determining a virtual location of an object on the digital map based on sensor inputs which locate the object in the coordinate system of the sensor network; and (d) activating the alarm system to issue an alert in response to a determination in operation (c) that the virtual location of the object is within the virtual safety zone. In accordance with one embodiment, the proximity tracking computer system comprises a proximity calculations module which is configured to calculate the virtual location of the object in the coordinate system of the sensor network based on sensor inputs received from the sensor network and then calculate a proximity value equal to a distance separating the object from the virtual safety zone.

A further aspect of the subject matter disclosed in detail below is a method for tracking objects in a vehicle production environment, the method comprising: (a) registering a tool in a non-transitory tangible computer-readable storage medium of a mobile electronic device that is configured to measure a distance separating the tool from the mobile electronic device; (b) carrying the tool and the mobile electronic device in the vehicle production environment; (c) placing the tool at a location in the vehicle production environment; (d) carrying the mobile electronic device away from the location where the tool was placed; (e) measuring the distance separating the tool from the mobile electronic device as the mobile electronic device is carried away from the location where the tool was placed; (f) activating an alert device of the mobile electronic device when the measured distance equals a first specified threshold; (g) sending a wireless communication to a proximity tracking computer system when the measured distance equals a second specified threshold greater than the first specified threshold; and (h) altering an aspect of the vehicle production environment responsive to the sending of the wireless communication. In accordance with some embodiments, the mobile electronic device is an RFID-enabled smartphone, smart watch or tablet, and step (h) comprises blocking electrification of electrical equipment onboard a vehicle being produced in the vehicle production environment.

Other aspects of systems and methods for tracking personnel and tools in a vehicle production environment are disclosed below.

Reference will hereinafter be made to the drawings in which similar elements in different drawings bear the same reference numerals. Where reference is made in any one or more of the accompanying drawings to steps and/or features, which have the same reference numerals, those steps and/or features have, for the purposes of this description, the same function(s) or operation(s), unless the contrary intention is apparent.

DETAILED DESCRIPTION

Illustrative embodiments of systems and methods for tracking personnel and tools in a vehicle production environment are described in some detail below. However, not all features of an actual implementation are described in this specification. A person skilled in the art will appreciate that in the development of any such actual embodiment, numerous implementation-specific decisions must be made to achieve the developer's specific goals, such as compliance with system-related and business-related constraints, which will vary from one implementation to another. Moreover, it will be appreciated that such a development effort might be complex and time-consuming, but would nevertheless be a routine undertaking for those of ordinary skill in the art having the benefit of this disclosure.

Safety systems and methods for production environments are disclosed herein. As used herein, a production environment corresponds to any suitable facility, location, structure, or other environment where manufacturing, testing, assembling, and/or other industrial process are performed and in which one or more potential hazards for humans operating within or near the production environment are present. As illustrative, non-exclusive examples, facilities associated with the manufacture and assembly of aircraft, spacecraft, watercraft, land vehicles, and/or heavy machinery and facilities that include one or more assembly lines, machine tools, and/or robots are within the scope of production environments, as used herein.

FIG. 1schematically represents an illustrative, non-exclusive example of a production environment10associated with a safety system12. The production environment10includes an assembly line14associated with the cumulative assembly of a vehicle16as it moves along the assembly line14, with this motion represented by the arrows and with the cumulative assembly represented by the increase in size and change in shape of the schematic representation of the vehicle16. Vehicle16may correspond to an aircraft, a spacecraft, a watercraft, a land vehicle, etc.

The safety system12partly depicted inFIG. 1includes at least one sensing device24that is configured to detect the presence of an unauthorized person26(hereinafter “person26”) and/or an authorized person38(hereinafter “user38”) at least partially within a defined safety zone28. Sensing devices24may take any suitable form, such as cameras, multispectral cameras, multispectral sensors, infrared cameras, infrared sensors, optical cameras, optical sensors, ultraviolet cameras, ultraviolet sensors, combined visible and infrared cameras, and wide-dynamic-range cameras.

The safety system12further includes at least one controller30that is configured to automatically alter at least one aspect of the production environment10responsive to a sensing device24detecting the presence or imminent entry of a person within the defined safety zone28or a sub-zone thereof. Each controller may be a respective computer system. As used herein, the term “computer system” should be construed broadly to encompass a system having at least one computer or processor, and which may have multiple computers or processors that are communicatively coupled via a network (wired or wireless) or bus. As used in the preceding sentence, the terms “computer” and “processor” both refer to devices comprising a processing unit (e.g., a central processing unit) and some form of memory (e.g., a non-transitory tangible computer-readable storage medium) for storing a program which is executable by the processing unit. A controller30may take any suitable form, including (but not limited to) a computer or processor. A single controller30may be used in connection with the whole of the production environment10. Alternatively, respective controllers30may be associated with individual safety zones28, such as associated with an assembly line14, a fixed safety zone32, and/or a movable safety zone34.

As used herein, a defined safety zone28is a three-dimensional volume of space, within which a potential hazard to a person may exist at least during some period of time. A defined safety zone28may be fixed in space, insofar as the safety zone28does not move relative to the production environment10. InFIG. 1, a fixed safety zone32is schematically illustrated by the dashed box encompassing the assembly line14. However, a defined safety zone28also may be movable in space, for example, such that it moves together with the vehicle16or the assembly line14, and/or with any other structure associated with the production environment10. InFIG. 1, various movable safety zones34are schematically illustrated by the dashed boxes associated with the vehicle16that moves along the assembly line14. Moreover, a movable safety zone34may be defined at any desired moment in time. For example, as schematically illustrated inFIG. 1, vehicle16initially only has a single safety zone28in the form of a movable safety zone34associated with a single sensing device24; however, an additional movable safety zone34is established at the third representation of vehicle16, and two additional fixed safety zones32are established at the fourth representation of vehicle16.

Additionally or alternatively, the safety system12may include one or more tags36(or other markers) that are worn by personnel. A sensing device24may be configured to detect the presence of a tag36within a safety zone28and/or a sub-zone thereof. For example, a tag36may be associated with a person that is authorized to work within a given safety zone28, such as user38. A tag36may take any suitable form such that a sensing device24is configured to detect its presence within a safety zone28. For example, the tag36may be a radio-frequency identification (RFID) tag and the sensing device24may be an RFID reader. InFIG. 1, a tag36is schematically illustrated as being incorporated in a helmet40worn by the user38within the safety zone28associated with the assembly line14. Similarly, a tag36also is schematically illustrated in the form of a neck-worn badge44worn by the person26. Tags may also be attached to tools used in the production environment10, as is described in more detail below.

Various aspects of the production environment10may be altered in response to a sensing device24detecting the presence or imminent entry of a person or tool in a defined safety zone28. For example, the movement of vehicle16and/or assembly line14may be altered in response to various detections by a sensing device24. As an illustrative, non-exclusive example, the movement of vehicle16or assembly line14may be slowed or stopped. Then, upon detection of the absence of the person or tool within the defined safety zone28, the movement of the vehicle16and/or assembly line14may be automatically returned to a default configuration, such as corresponding to a default speed.

Additionally, the production environment10and/or a safety system12includes one or more alarm systems46that are configured to be activated upon various detections by a sensing device24. For example, an alarm system46may include one or more of an audible alarm48and/or a visible alarm50. InFIG. 1, two alarm systems46are schematically presented, including an alarm system46associated with assembly line14and an alarm system46associated with the whole of the production environment10. For example, if a person26enters a safety zone28, one or both of the audible alarm48and/or the visible alarm50may be activated to alert the person26or other personnel that the person26has entered the safety zone28. Additionally or alternatively, different degrees of alarm may be configured based on the extent of entry into a safety zone28. Then, upon retreat by the person26out of the safety zone28, the alarm system46may be deactivated, or otherwise cease to emit one or both of an audible alarm48and/or a visible alarm50.

The production environment10partly depicted inFIG. 1further includes an inventory control system52, for example, an inventory control system52that is configured to track the location of parts54within the production environment10. For example, the inventory control system52may utilize RFID tags56associated with parts54and/or location awareness system features58associated with parts54. Illustrative, non-exclusive examples of location awareness system features58that may be utilized with or otherwise implemented with an inventory control system52include (but are not limited to) pseudo-satellite (pseudolite) augmented global positioning system (GPS) features, laser-based tracking system features, etc. The controller30may be configured to automatically alter an aspect of the production environment10responsive to the detection by a sensing device24of the presence or movement of a predetermined part54(e.g., a tool) within a defined safety zone28.

This disclosure proposes improvements in safety systems for use in vehicle production environments. In accordance with some embodiments, the safety system includes a multiplicity of active positioning sensors (e.g., active or passive RFID devices, smartphones or watches, blue-tooth device, etc.). The sensors are configured to detect the presence of an object at a particular distance from or within a particular area or volume of space. The safety system further includes a controller that is configured to receive sensor data from the multiplicity of sensors and use that sensor data to calculate the virtual location of each sensed object relative to a virtual two- or three-dimensional (2-D/3-D) computer-aided design (CAD) map of the as-built aircraft design. More specifically, the controller calculates the virtual location of a sensed object in the frame of reference of the sensor network and then determines whether that virtual location is within a virtual safety zone having a known location and extent in the frame of reference of the sensor network. In response to detection of the presence of an object in unacceptable proximity to the vehicle or within a particular safety zone of the vehicle, an alarm is activated and the planned build process is altered, e.g., by blocking electrification of electrical equipment onboard the vehicle. More specifically, the controller measures the distance separating the object from electrified areas of the vehicle and then issues a control signal that engages a lock-out of the next scheduled “power-on” phase of the vehicle build process. In addition, safety personnel may be dispatched to the vehicle to recover tools that are out of place.

FIG. 2is a diagram representing a three-dimensional view of an aircraft2during production using a safety system that includes tool boxes20connected to the aircraft power system via electrical cables22to prevent electrification when tools are missing from a tool box. In the stage of production depicted inFIG. 2, the aircraft2includes a fuselage4, a pair of wings6aand6bextending laterally outward from the fuselage4, and a pair of engines8aand8brespectively mounted to the wings6aand6b. The aircraft2includes electrical equipment5. During production, tests are performed indoor with aircraft electrical power on.

In accordance with one embodiment, each tool box20includes proximity sensors (not shown inFIG. 2) which detect the presence of tools registered for storage in the tool box20. The tool box further includes a circuit breaker (not shown inFIG. 2) by which the source of electrical power during testing may be disconnected from the aircraft power system. The safety system further includes respective processors (incorporated within or connected to the tool boxes20) which process sensor data received from the proximity sensors inside the tool boxes20and control the states of the circuit breakers. For example, if a tool is missing from its assigned location inside the tool box20, the associated proximity sensor at the assigned location detects the absence of the missing tool, in response to which the processor triggers the circuit breaker to open, thereby preventing electrification of the aircraft power system.

FIG. 3is a diagram representing a top view of a pad91(e.g., made of semi-rigid foam material) with cavities90aand90bconfigured to receive respective tools for storage. Each cavity (also referred to herein as a “nest”) has a proximity sensor96configured and positioned to detect the presence of the tool in the cavity.

FIG. 4is a diagram representing an RFID tag98connected (via electrical wires99) to a plurality of proximity sensors96a-96darranged to detect the presence of tools in cavities90a-90dof a pad91placed inside a tool box20. The RFID tag98includes a processor (e.g., a microprocessor) and a non-transitory tangible computer-readable storage medium for storing digital data representing the identity of the tool box20, the identities of the tools designated for storage in the respective cavities90aand90b, and the states of the proximity sensors96. The information recorded inside the RFID tag98may be read periodically by an RFID reader which is mounted inside or outside the tool box20, which RFID reader in turn is communicatively coupled to the processor that controls the state of the circuit breaker.

Prior to power-up, a check is performed wherein all tools and devices must be accounted for. This can be accomplished by electronically monitoring proper tool placement in tool storage areas. Each nest or cavity90that holds a tool18has a proximity sensor96(or a mechanical sensor) that senses tool presence. If a tool or equipment is not returned, the tool box20acts like a cut-off switch to alert personnel. In rare or extreme cases, the system can be overridden once precautions have been taken or the particular tool/equipment has been accounted for.

Cavities90may be shaped to accept a specific tool18that is keyed for the cavity.FIG. 5Ais a diagram representing a top view of a tool18aequipped with an RFID tag56and a mechanical key92ahaving a first shape for preventing improper placement in a cavity.FIG. 5Bis a diagram representing a top view of a cavity90aconfigured to receive the tool18adepicted inFIG. 5Afor storage. In particular, the cavity90aincludes a key cavity94awhich is shaped to receive the mechanical key92a.FIG. 5Cis a diagram representing a top view of a tool18bequipped with an RFID tag56and a mechanical key92bhaving a second shape for preventing improper placement in a cavity.FIG. 5Dis a diagram representing a top view of a cavity90bconfigured to receive the tool18bdepicted inFIG. 5Cfor storage. In particular, the cavity90bincludes a key cavity94bwhich is shaped to receive the mechanical key92b. The second shape of mechanical key92bis sufficiently different than the first shape of mechanical key92adepicted inFIG. 5Aso that it is not possible to either seat tool18ain cavity90bor seat tool18bin cavity90a. This feature prevents misplacement of tools inside the tool box. Each RFID tag56includes a non-transitory tangible computer-readable storage medium that stores digital data representing the unique identity of the tool to which the RFID tag56is attached. The RFID can also help locate improperly placed tools. If the check reveals that tools are missing or misplaced, a search for the missing or misplaced tool is initiated. In addition, the electrification process is forestalled in order to protect humans and prevent damage to the aircraft due to foreign object debris (FOD).

In addition, the safety system proposed herein is further able to provide an automated notification to appropriate safety personnel that a metallic tool is near an electrical panel or in close proximity to wires that would be electrified during an aircraft power-up procedure.FIG. 6is a block diagram identifying components of a system65for tracking objects in a vehicle production environment, including software components of a proximity tracking computer system70configured to determine the virtual locations of humans and/or tools relative to virtual safety zones assigned to a vehicle (e.g., an aircraft) in production in accordance with one embodiment. The misplaced tools may be metallic or non-metallic (e.g., tools made by additive manufacturing). The proximity tracking computer system70includes one or more processors for executing instructions of a safety check procedure (e.g., a foreign object debris check algorithm) in accordance with controller logic72. The proximity tracking computer system70further includes a sensor input/output module76that receives sensor inputs82during execution of the check procedure. The proximity tracking computer system70further includes a map builder module74which is configured to construct a digital map60defining a virtual vehicle and virtual safety zones relative to a virtual frame of reference of a sensor network. The map building algorithm is invoked before the check procedure is initiated. The CAD model84is in the form of digital 3-D structural data and part identification metadata retrieved from a database and sent to the proximity tracking computer system70by a database server (not shown inFIG. 6). The proximity tracking computer system70further includes a proximity calculations module78which is configured to calculate the virtual location of a sensed object (e.g., a human or a tool) in the coordinate system of the sensor network based on sensor inputs82during the check procedure. The proximity calculations module is further configured to estimate an actual distance separating the object from a hypothetical geometric boundary in physical space corresponding to the virtual safety zone by calculating a virtual distance separating the virtual location of the object from the virtual safety zone in the digital map. The resulting proximity value is sent to an alert module80which is configured to determine whether the resulting proximity value is greater than a specified alert threshold or not. If the alert module80determines that the resulting proximity value is greater than the specified alert threshold (e.g., indicating that a metal tool is in proximity to electrical equipment), then the alert module80issues an alarm signal88that triggers activation of alarm devices and lock-out of the next scheduled “power-on” phase of the vehicle build process. Optionally, the alert module80is also configured to initiate a request to the inspection department to ensure that the aircraft has not been damaged. If the alert module80determines that the resulting proximity value is not greater than the specified alert threshold, then the alarm signal88is not issued.

FIG. 7is a diagram representing a digital map60generated using the system depicted inFIG. 6. The digital map60may include differently colored zones representing a virtual boundary62of a vehicle (e.g., an aircraft) surrounded by a plurality of prioritized, mutually offset virtual safety zones64,66and68, which zones are further surrounded by a space61with locations defined by a coordinate system86of a sensor network. (As used herein, the term “virtual boundary” means a boundary simulated on a computer as opposed to a physical boundary.) The digital map60may be two- or three-dimensional. The following description assumes that the digital map60is three-dimensional (3-D). The digital map60is constructed by the map builder module74and displayed on a display screen. The digital map60is derived from the “as-built” configuration of the aircraft as defined by the CAD model84. The digital map60may be “dynamically” derived in the sense that the shape and extent of the virtual safety zones may be modified at different stages of the production cycle.

In the example depicted inFIG. 7, the high-priority virtual safety zone68represents a volume of space that is coextensive with the fuselage of the virtual aircraft62. The medium-priority virtual safety zone66is contiguous with and outwardly offset from (surrounds) the high-priority virtual safety zone68. The low-priority virtual safety zone64is contiguous with and outwardly offset from (surrounds) the medium-priority virtual safety zone66. Each of the virtual safety zones64,66and68has a respective alert level associated therewith. If the presence of a tool in the low-priority virtual safety zone64is detected, then a low-level alert is issued; if the presence of a tool in the medium-priority virtual safety zone66is detected, then a medium-level alert is issued; if the presence of a tool in the high-priority virtual safety zone68is detected, then a high-level alert is issued.

In accordance with one embodiment, the virtual safety zones are created by extracting data from the CAD model84in the XYZ master coordinate system of the sensor network, sorting by the Joint Aircraft System/Component Code Table (hereinafter “JASC Code Table) and creating a convex hull algorithm (volume) of the components. The JASC Code Table is a modified version of the Air Transport Association of America, Specification 100 code. It was developed by the Federal Aviation Administration's Regulatory Support Division. This code table is constructed by using a JASC code four-digit format, along with an abbreviated code title. This table can be used as a quick reference chart, to assist in the coding and review of aircraft structures or systems data. When creating the mapped zones, the process flow is as follows:

(1) All of the 3-D parts for the particular model aircraft build are extracted from the CAD database; including the metadata and attributes attached to them.

(2) The attributes are filtered using the JASC code table for the area of interest. For example, system JASC code 32, which is the Fuselage Structure, defines the basic shape of the aircraft. The 3-D coordinates of these parts can be extracted from the CAD assembly or part and aggregated together to form the complete initial volume of the high-priority virtual safety zone68(e.g., colored red on a display screen).

(3) Next, a second volume is offset outwardly by a fixed virtual distance (e.g., 5′ or 10′) from the volume created in step 2 to create the larger nested volume of the medium-priority virtual safety zone66(e.g., colored yellow on the display screen).

(4) Finally, a third volume is offset outwardly by a larger fixed virtual distance (e.g., 20′, 25′, 30′, etc.) from the volume created in step 2 to create the even larger nested volume of the low-priority virtual safety zone64(e.g., colored green on the display screen).

The example just described is a notional embodiment. Alternatively, other JASC code can be used to create volumes of space as needed to create 3-D safety zones around particular aircraft systems (e.g., electrical systems or engines) as opposed to the entire fuselage.

The map builder module74has the ability to derive plural safety zones that are not contiguous (e.g., the avionics bay and the aft landing gear), but are defined to have the same urgency and priority (thus treating the plural safety zones as a single safety zone). In addition, map builder module74create 3-D nested zones which are governed by programmable rules that act in safety response modes of increasing priority (e.g., warning→warning tone/noise→stop the production line). The rules may be customized and changed dynamically to meet changing needs, changing safety procedures and changing 3-D aircraft shapes (e.g., engineering changes).

The proximity tracking computer system70receives sensor inputs82, such as inputs from RFID tags36and56, from a sensor network. The sensor inputs82are used to determine the virtual location of an object relative to the virtual safety zones that form the digital map60.FIG. 8is a flowchart identifying steps of a method150for tracking objects (humans and/or tools) in an aircraft production facility in accordance with one embodiment. At the start, electrical power is supplied to a sensor network152and then the proximity tracking computer system70initiates a process for verifying that the sensor network152is active (step156). During the verification process, the proximity tracking computer system70determines whether the sensor network152is active or not (step158). On the one hand, if a determination is made in step158that the sensor network152is not active, then maintenance is performed (step160). Upon completion of the maintenance procedure, the process returns to step156. On the other hand, if a determination is made in step158that the sensor network152is active, then the proximity tracking computer system70begins receiving signals from the sensor network152(step162). The proximity tracking computer system70then determines whether the signals from the sensor network152are within a valid range or not (step164). On the one hand, if a determination is made in step164that the signals from the sensor network152are not within a valid range, then the sensors are calibrated (step166). On the other hand, if a determination is made in step164that the signals from the sensor network152are within a valid range, then the controller logic72sends a control signal instructing the map builder module74to construct a digital map60.

All devices in the sensor network152(and the aircraft) are registered to the system so that the devices (and the aircraft) are in the master coordinate system of the sensor network. The locations of objects are determined with reference to the master coordinate system of the sensor network. The sensors include RFID tags, RFID readers, transmitters and receivers (e.g., GPS receivers). While some sensors may be fixed, some of the objects with attached sensors are moving (e.g., personnel and tools).

In response to that control signal, the map builder module74retrieves CAD vehicle model data from a CAD library stored in a non-transitory tangible computer-readable storage medium of a vehicle model database server215(step168), which CAD model data includes information regarding the geometry of the vehicle being produced (in this example, an aircraft). The map builder module74then constructs a digital map (in two or three dimensions) representing virtual boundaries of the vehicle in production and components thereof using the retrieved CAD vehicle model data and safety specifications (step170). For example, a safety specification may dictate safe distances of metal tools from electrical equipment such as cables, computers, electrical devices and electro-mechanical devices. In addition, the map builder module74extracts and identifies specific zones (e.g., subsystems or components) of concern within the vehicle (step172), including location, size and volume of each zone. In the example depicted inFIG. 8, the zones of concern are zones that contain electrical equipment, which equipment will be electrified when vehicle power is turned on. The map builder module74then uses the digital map of the vehicle and the location, size and volume of the zones of concern to create a digital map60that includes prioritized virtual safety zones (step174). In an alternative embodiment, the digital map60may be created prior to the receipt of signals from the sensor network152.

The proximity tracking computer system70uses the sensor inputs82to determine the virtual locations of objects relative to the virtual safety zones during execution of a foreign object debris check procedure prior to electrification of the vehicle for testing purposes. More specifically, the proximity calculations module78estimates an actual distance D separating the object from a hypothetical geometric boundary in physical space corresponding to a virtual safety zone by calculating a virtual distance separating the virtual location of the object from the virtual safety zone in the digital map (step176). The alert module80then determines whether the object is within a safety zone or not (step178). If the object is located outside the safety zone, then the distance separating the object from the safety zone will be a positive value; if the object is located within the safety zone, then the distance separating the object from the safety zone will be a negative value. On the one hand, if a determination is made in step178that the object is not within a safety zone, then the process returns to step162. On the other hand, if a determination is made in step178that the object is within a safety zone, then a series of events occur, including: activation of an alert (step180); lock-out of the next scheduled “power-on” phase of the vehicle build process (step182); initiation of a procedure to secure all personnel (step184); dispatch of technicians to inspect the vehicle (step186); and initiation of a procedure to secure all tools and equipment (step188).

To secure all tools and equipment in a production environment, the safety system in accordance with some embodiments relies on mobile smart devices which have the ability to receive and transmit tracking information received from active positioning sensors. For example, production personnel may be equipped with smartphones or smart watches programmed with applications that enable the smartphone or smart watch to communicate with an RFID reader, which RFID reader in turn may be communicatively coupled to active or passive RFID tags attached to portable tools or other equipment.

FIG. 9is a diagram showing a user38holding a tool18which has been removed from a tool box20. The safety system includes an RFID reader102which is shown attached to the tool box20, but which may, in the alternative, be incorporated inside the tool box20. The RFID reader102is capable of reading an RFID tag98of the type depicted inFIG. 4. For example, when the user38removes the tool18from the tool box20, that event is recorded in the RFID tag98shown inFIG. 4along with an identifier that identifies the removed tool18. This information is then communicated to the RFID reader102(seeFIG. 9), which in turn communicates the identity of the tool18to a smartphone100via a wireless channel104, e.g., via Bluetooth. (Bluetooth is a wireless technology standard for exchanging data between fixed and mobile devices over short distances using short-wavelength UHF radio waves in the industrial, scientific and medical radio bands, from 2.400 to 2.485 GHz, and building personal area networks.) When the user picks up a tool18with an RFID tag56, the user's smartphone100registers the tool in possession. The smartphone100hosts an application that is configured to record information about the user, a list of the tools or equipment in the user's possession, the work area or bay, the aircraft or vehicle being worked on, etc. The smartphone100is connected wirelessly to the factory network (e.g., using wireless local area network (LAN) technology).

In accordance with an alternative embodiment, the smartphone100(or a tablet) may be configured to scan the tool directly using commercially available RFID readers designed to be coupled to a smartphone. For example, an RFID sled is commercially available that enables users of smartphones and other mobile devices to read ultrahigh-frequency RFID tags by connecting their Android or iOS devices to the reader via Bluetooth. To operate the device, a user may either attach a compatible phone to the RFID sled by simply sliding the phone onto the sled's top, or carry it on his or her person. The reader captures UHF RFID data from standard UHF tags when in range, and that information is then transmitted to the user's mobile phone or tablet which is communicatively coupled to that reader, e.g., via a Bluetooth connection. The RFID sled can automatically store the collected read data until the smartphone is within range. The phone or tablet could then forward that information to a server via a wireless LAN, cellular or Bluetooth connection. The RFID sled can also be placed in a Geiger counter mode. A user would then input the identity of the missing tool which is sought using software on the smartphone100(or tablet). That instruction is then transmitted to the RFID sled, which the user may then carry in search of a tool. During this search, the RFID sled would seek a specific tag ID number and emit an audible tone when the missing tag is in range.

RFID reader technology also exists which enables a user to determine the location of a tag in three dimensions within a few centimeters. Most standard hand-held RFID readers use received signal strength indicator technology to identify where a tag may be located. In addition, some devices also utilize time domain phase difference of arrival, which consists of collecting and analyzing the sequence of data points in successive order as a reader is moving. The reader is capable of interrogating each tag hundreds of times per second. This enables a user to differentiate whether the missing tag is located forward, rearward or to one side of the reader. The hand-held FRID reader is also capable of emitting sound alerts as the distance separating the reader from tag decreases or increases, and display location data on the smartphone or tablet screen.

FIG. 10is a diagram representing stages in the operation of a smartphone100that issues alerts of increasing intensity as the distance separating the smartphone100from a registered tool18increases. If the user38leaves the tool18anywhere and walks away—the smartphone100records the last position of tool18and notifies the user38via first, second and third alerts42a-42cin the form of ringtones or vibrations, the intensities or frequencies of which increase as the separation distance increases from D1to D2to D3. In addition, the smartphone100sends corresponding alert messages to the proximity tracking computer system70(not shown inFIG. 10), which is configured to selectively activate lights11a-11cof a visual warning system. When activated, lights11a,11band11cproduce light of different colors A, B and C, respectively. In accordance with one proposed implementation, color A is green, color B is yellow and color C is red.

If the user38is out of sensing range or forgets where he/she left the tool18, the smartphone100displays the last known or logged location before going out of range.FIG. 11is a diagram representing a view of a smartphone100displaying a tool icon106in one window and displaying a tool location symbol110on a map108of the production facility in another window. The tool location symbol110points to the last logged location of the tool on the map108. If the tool has been moved, the RFID reader to which the smartphone100is coupled will scan a surrounding area until the tool is within range as user38moves toward the last known location of the tool. If the tool is not found, then the smartphone100is configured to issue a FOD alert, in response to which the alert module80of the proximity tracking computer system70disables the aircraft power-up function.

RFID-enabled mobile electronic devices other than a smartphone may be employed. For example, an RFID-enabled smart watch or notebook configured to measure a distance separating the tool from the mobile electronic device may be employed. The various RFID-enabled mobile electronic devices may be employed in a method for tracking objects in a vehicle production environment. First, a tool is registered in a non-transitory tangible computer-readable storage medium of the mobile electronic device. Then the tool and the mobile electronic device are carried by a user in the vehicle production environment. After the tool has been used, the user may place the tool at a first location in the vehicle production environment. When the user moves to a second location, the user may forget the tool at the first location. In this instance, the user may carry the mobile electronic device away from the first location where the tool was placed. As the user moves away from the first location, the mobile electronic device measures the distance separating the tool from the mobile electronic device. An alert device incorporated in the mobile electronic device is activated when the measured distance equals a first specified threshold. Then a wireless communication is sent to a proximity tracking computer system when the measured distance equals a second specified threshold greater than the first specified threshold. In response to this wireless communication, the proximity tracking computer system alters an aspect of the vehicle production environment. For example, electrification of electrical equipment onboard the vehicle being produced in the vehicle production environment is blocked until the tool is retrieved.

The RFID-enabled smartphone, tablet or wristwatch will host a software application that will list any RFID-enabled tool or part, allowing the user to scan and select the tool or part. When the user is done with the tools and returns them, the software application will list all the tools that were in the user's possession and removes the corresponding entries from the list as the tools are returned to their proper location. If there is a remaining RFID-enabled tool or part that the user forgot, the software application will inform the user the last time and where the tool was detected (in case the user ignored the alert).

As previously described, the proximity tracking computer system70is also configured to disable the aircraft power-up function in response to receipt of positioning sensor data indicating that a tool is located within the boundaries of a safety zone without permission. In accordance with one embodiment, this is accomplished by computing the distance D separating the tool18from the safety zone based on sensor inputs82(seeFIG. 6).

FIG. 12is a diagram representing a tool user38holding a tool18at a distance D from a spherical safety zone S1associated with a vehicle (e.g., an aircraft fuselage) in production. The position P1of the tool18, the position C1of the center of the spherical safety zone S1and the position P2of a point on a surface of the spherical safety zone S1that is collinear with points P1and C1in the master coordinate system of the sensor network are known to the system. The proximity tracking computer system70is configured to perform an algorithm which may be represented by the following pseudo-code:If [the computed distance D to the surface of the sphere S1is >0] then {the user is determined to be safe and will not be harmed by a powering up the aircraft.}

The distance D separating points P1and P2shown inFIG. 12may be determined as follows: Given a spherical safety zone S1having a center C1located at a coordinate position (x1, y1, z1), having a radius R and having a point P2on the surface (at distance R from center C1), and further given a point P1located at a coordinate position (x2, y2, z2) such that points P1, P2and C1are collinear, then the distance D separating points P1and P2(e.g., the distance separating a tool18at point P1from the spherical safety zone S1) is:
D=((x2−x1)2+(y2−y1)2+(z2−z1)2)−1/2−R

On the one hand, if D is a positive value, then point P1is outside of the sphere S1and the separation distance is D. No alarm will be activated. On the other hand, if D is a negative value, then point P1is inside of the sphere s1and the separation distance D is effectively 0 (zero). In this situation, the alarm will be activated.

In accordance with some embodiments, the safety zones correspond to nested volumes of space, in which case the respective distances separating the tool18from each safety zone may be calculated to more accurately determine if the tool18is in the red zone, yellow zone or green zone.

Thus, the sensor outputs (locations) associated with personnel, tools, small vehicles, carts, and other items are monitored by the system. If a tool or other equipment goes missing, the controller monitors the current location and location history of the missing equipment so it can be found and removed from the aircraft.

Each person, tool or device has an identification tag attached thereto. In an exemplary embodiment, the identification tags are passive RFID tags. Passive RFID tags do not include a power source and transmit a signal only upon receiving radio frequency signals and energy emitted from an RFID reader in proximity to the RFID tag. In alternative embodiments, the identification tags may be active RFID tags. Active RFID tags include their own power source, such as a battery, and actively broadcast their information. In other embodiments, the identification tags may be any other active or passive tag suitable for providing an identification of an asset to a device spaced apart from the asset. Identification tags store identification data concerning the particular asset to which they are attached, such as an asset type and a serial number. The RFID reader includes a transmission antenna and a receiving antenna. Each RFID tag is an electronic device that includes a microprocessor combined with an antenna housed in a compact package. The packaging is structured to allow each RFID tag to be attached to the asset to be tracked/monitored. Each microprocessor of each RFID tag is encoded with a unique identifier. In order to locate a particular asset, the RFID tag attached to the specific asset will be activated. Once the RFID tag is activated, the RFID tag will transmit a location signal encoded with the unique identifier.

Certain systems, apparatus, applications or processes have been described herein as including a number of modules. A module may be a unit of distinct functionality that may be implemented in software, hardware, or combinations thereof, except for those modules which are preferably implemented as hardware or firmware to enable streaming calculations as disclosed herein. When the functionality of a module is performed in any part through software, the module can include a non-transitory tangible computer-readable storage medium.

While systems and methods for tracking personnel and tools in a vehicle production environment have been described with reference to various embodiments, it will be understood by those skilled in the art that various changes may be made and equivalents may be substituted for elements thereof without departing from the scope of the claims set forth hereinafter. In addition, many modifications may be made to adapt the teachings herein to a particular situation without departing from the scope of the claims.

The methods described herein may be encoded as executable instructions embodied in a non-transitory tangible computer-readable storage medium, including, without limitation, a storage device and/or a memory device. Such instructions, when executed by a processor or computer, cause the processor or computer to perform at least a portion of the methods described herein.

The method claims set forth hereinafter should not be construed to require that the steps recited therein be performed in alphabetical order (any alphabetical ordering in the claims is used solely for the purpose of referencing previously recited steps) or in the order in which they are recited unless the claim language explicitly specifies or states conditions indicating a particular order in which some or all of those steps are performed. Nor should the method claims be construed to exclude any portions of two or more steps being performed concurrently or alternatingly unless the claim language explicitly states a condition that precludes such an interpretation.