Source: https://patents.google.com/patent/US9201414B2/en
Timestamp: 2019-06-24 20:39:22
Document Index: 609017885

Matched Legal Cases: ['application No. 11739256', 'Application No. 2013', 'application No. 10701430', 'application No. 201180001615', 'application No. 2013', 'application No. 2013', 'Application No. 2013108906', 'Application No. 2', 'application No. 201180001615']

US9201414B2 - Intrinsically-safe handheld field maintenance tool with image and/or sound capture - Google Patents
Intrinsically-safe handheld field maintenance tool with image and/or sound capture Download PDF
US9201414B2
US9201414B2 US13/191,604 US201113191604A US9201414B2 US 9201414 B2 US9201414 B2 US 9201414B2 US 201113191604 A US201113191604 A US 201113191604A US 9201414 B2 US9201414 B2 US 9201414B2
US13/191,604
US20120038760A1 (en
2011-07-27 Priority to US13/191,604 priority patent/US9201414B2/en
2011-10-31 Assigned to FISHER-ROSEMOUNT SYSTEMS, INC. reassignment FISHER-ROSEMOUNT SYSTEMS, INC. ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: KANTZES, CHRISTOPHER P., MATHIOWETZ, BRAD N, TOEPKE, TODD M., FRANCHUK, BRIAN A., LATTIMER, DONALD R., LUND, ADAM E., YANG, KUN
2012-02-16 Publication of US20120038760A1 publication Critical patent/US20120038760A1/en
2015-12-01 Publication of US9201414B2 publication Critical patent/US9201414B2/en
FIG. 4 is a diagrammatic view of an intrinsically safe handheld field maintenance tool interacting with an intrinsically safe camera/input device in accordance with an embodiment of the present invention.
FIG. 5 is a block diagram of an external input module in accordance with an embodiment of the present invention.
FIG. 6 is a diagrammatic view of handheld field maintenance tool receiving and/or sending previously-created audio/photo/video information from/to another handheld field maintenance tool or a personal computer in accordance with an embodiment of the present invention.
FIG. 7 is a flow diagram of a method of performing field maintenance using a handheld field maintenance tool in accordance with an embodiment of the present invention.
FIG. 3 is a diagrammatic system block diagram of a handheld field maintenance tool in accordance with an embodiment of the present invention. It is preferred that tool 52 comply with at least one intrinsic safety specification, such as that listed above, in order to help ensure safety in potentially explosive environments. Handheld field maintenance tool 52 preferably includes at least one wireless process communication module 121. Suitable examples for wireless process communication module 121 include a module that generates and/or receives proper signals in accordance with a known wireless communication protocol, such as the WirelessHART protocol (IEC 62591). Another wireless process communication protocol is set forth in ISA100.11a. While FIG. 3 shows a single wireless process communication module 121, it is expressly contemplated that any suitable number of wireless process communication modules can be used to communicate in accordance with various wireless process communication protocols now in existence or later developed.
Handheld field maintenance tool includes or is coupled to camera 157. Preferably camera 157 is an internal component of handheld field maintenance tool 52. However, embodiments of the present invention do include camera 157 being a separate intrinsically-safe external module, such as that described below with respect to FIGS. 4 and 5. Preferably, camera 157 is a known CCD (Charge Coupled Device) or CMOS Image Acquisition System. While it is preferred that camera 157 capture images (either still, video, or both) in the visible spectrum, some embodiments may include a camera that is sensitive to, or images, infrared radiation. Moreover, while embodiments of the present invention will generally be described with respect to a single camera, it is expressly contemplated that multiple such cameras could be used. For example, a first camera may be an internal component of handheld field maintenance tool 52 and be sensitive to the visible spectrum. A second camera 157 could be an intrinsically-safe external camera that transmits its image data to the handheld field maintenance tool using wireless communication. Further still, yet another external camera 157 could be configured to capture a video using high-speed image acquisition using a high frame rate (for example 1000 frames per second) to capture fleeting occurrences within a process installation.
Handheld field maintenance tool 52 can include a number of additional items that facilitate additional functionality. Specifically, tool 52 can include a position detection module, such as GPS module 150. GPS module 150 can be configured to additionally use the Wide Area Augmentation System (WAAS) for improved accuracy and/or can be configured to operate using differential GPS techniques as appropriate. Module 150 is coupled to controller 130 to provide controller 130 with an indication of the geographic position of tool 52. While position detection module 150 is preferably an internal component of tool 52, it may be external and communicatively coupled thereto using a suitable wireless or wired communication protocol, such as Bluetooth 124, RFID 128, et cetera. Further, while position detection module 150 is generally described as GPS module 150, other techniques for triangulating the position of the handheld field maintenance tool based upon relative strength of wireless communication with wireless transceivers having known fixed positions can be employed. Examples of such wireless triangulation techniques include triangulation of the position of handheld field maintenance tool 52 based upon communication with three or more fixed-position WiFi communication points, or access points. Further still, as set forth above, embodiments of the present invention may include the ability to employ one or more wireless process communication protocol modules, such as module 121.
Additionally, tool 52 also preferably comprises compass module 152 coupled to controller 130 such that tool 52 can indicate the direction in which it is pointing. Finally, tool 52 can also include tilt module 154 coupled to controller 130 to provide an indication to controller 130 relative to an angle of inclination of tool 52 relative to gravity. However, additional axes of sensing are also contemplated.
The positional location module 150, compass module 152 and tilt module 154 are particularly useful where a handheld field maintenance tool helps a technician or engineer find the physical location of a wireless field device in the field. An oil refinery is often a very large process installation with many field devices positioned at various locations, some of which may not be readily visible. Position detection module 150 preferably provides position information to controller 130 such that images and/or video acquired by the handheld field maintenance tool is stored with meta data indicative of the geographic position of the handheld field maintenance tool when the image or video was acquired. Moreover, the compass heading is also preferably stored in the image or video metadata.
When a technician is out in the field, it may sometimes be useful for the technician to have the ability to either view a picture of a field device in its location (for the purposes of identification or to compare historical pictures to a current view) or to compare the noise generated by the device (a motor, for example) to that previously recorded. In accordance with an embodiment of the present invention, an intrinsically safe handheld field maintenance tool includes, or is operably coupled to, a video and/or audio input device that provides the ability to record audio and/or photo/video of a field device. Moreover, the handheld field maintenance tool is configured, through hardware, software, or a combination thereof, to associate the recorded audio and/or video of a field device with other device information, such as a device tag, geographic position, et cetera.
FIG. 4 is a diagrammatic view of an intrinsically safe handheld field maintenance tool 200 interacting, wirelessly, with an intrinsically safe camera/input device 202. Preferably, handheld field maintenance tool 200 and external input device 202 communicate in accordance with one of the wireless communication technologies set forth with respect to FIG. 3. More preferably, the communication is in accordance with either Bluetooth communication, or WiFi communication. Wireless communication is preferred over wired communication since wireless communication does not have wired connection ports, and thus facilitates compliance with intrinsic safety requirements. Input device 202 may be a photographic camera that is able to capture one or more still images in the field. Alternatively, or additionally, device 202 may be a video camera capable of capturing and storing/streaming, or otherwise communicating video and corresponding audio information. Device 202 may also be a high-speed camera to capture fleeting process events. Further still, embodiments where the camera or the input device 202 is external to handheld field maintenance tool 200 are particularly useful in situations where a technician cannot easily view a given area. In such circumstances, the input device can simply be placed in a convenient location for viewing, and the image or video information can be viewed on the technician's handheld field maintenance tool. Moreover, embodiments of the present invention also contemplate a single handheld field maintenance tool simultaneously communicating with a plurality of such external input devices 202. In this manner, a technician viewing display 120 is able to simultaneously monitor conditions at a plurality of locations in the field. While the embodiment described above with respect to FIG. 4 employs wireless communication between the camera/input device 202 and the handheld field maintenance tool, embodiments of the present invention can be practiced where camera/input device 202 is physically coupled to the handheld field maintenance tool. In such instances, communication therebetween would preferably be via wired communication, such as through a Universal Serial Bus (USB) connection.
FIG. 5 is a block diagram of external input module 202 in accordance with an embodiment of the present invention. Module 202 includes camera subsystem 204 which may be a known CCD (Charge Coupled Device) or CMOS image acquisition system. Preferably, input device 202 is powered by an internal battery 206 that may be rechargeable. Input device 202 preferably includes a controller 208, which is preferably a microprocessor. Controller 208 includes, or is coupled to, suitable memory to contain a number of program instructions to execute the functions of image acquisition, video or photo streaming, image or photo transfer, or other suitable functions. Additionally, the memory preferably includes sufficient capacity to store a substantial number of individual images, and/or videos. Input device 202 also includes a wireless communication module 210 which preferably operates in accordance with either a Bluetooth specification or a WiFi specification. Both such specifications support high-speed data transfer over a relatively limited physical proximity, such as tens of meters.
FIG. 6 is a diagrammatic view of handheld field maintenance tool 200 receiving and/or sending previously-created audio/photo/video information from/to another handheld field maintenance tool 212, or a personal computer 214, in accordance with an embodiment of the present invention. Handheld field maintenance tool 200 is also preferably capable of loading previously created audio/photo/video information from either another handheld field maintenance tool, or a personal computer. The previously-created audio/photo/video information could have been previously created by another handheld field maintenance tool, such as tool 214, created using another type or recording device, such as a digital camera, and stored on personal computer 214, et cetera. Handheld field maintenance tool 200 allows the technician to import this audio/video/photo information and associate such information with a field device's tag/unique identification such that the next time the handheld field maintenance tool 200 connects to the field device, the technician will be able to call up, or otherwise invoke the audio/photo/video information and view it on the display of the handheld field maintenance tool and/or listen to it on headset 216 communicating with the handheld field maintenance tool via Bluetooth. Moreover, the technician also has the ability to create new information and add it to the handheld, or otherwise associate it with the field device. Such new audio/photo/video information can also be uploaded to PC 214, handheld field maintenance tool 200 and/or maintained in a library for that field device. The audio/photo/video information could also be associated with one or more assets in an asset management system.
FIG. 7 is a flow diagram of a method of performing field maintenance using a handheld field maintenance tool in accordance with an embodiment of the present invention. Method 300 begins at block 302 where a technician employs a handheld field maintenance tool to acquire an image and/or video of a field device prior to working on the field device. This is an “as-found” image of the field device. There may be more than one as-found image. For example, multiple images or video from different views may be acquired. Additionally, multiple types of camera may be used for the as-found images. For example, a still camera may take an as-found high-resolution photo in the visible spectrum, and an as-found video may be acquired in the infrared spectrum.
Next, at block 304, the technician couples the handheld field maintenance tool to the field device and performs the require maintenance work, such as calibration, diagnosis, repair, et cetera. At block 306, the technician uses the handheld field maintenance tool to acquire the “as-left” image of the field device after the maintenance has been completed at block 304. Both the as-found and as-left images or videos are stored in the handheld field maintenance tool. Preferably, optional step 308 is executed where the as-found and as-left images or videos are uploaded to another device or system, such as an asset management system. In this way, field maintenance may be better documented. The archival of such images over time may also be useful for identifying wear or corrosion, or other conditions that occur slowly over time.
a process communication module configured to communicatively couple to a field device and obtain a unique identification tag from the field device;
a camera configured to obtain a first image and a second image relative to the field device;
a wireless communication protocol module configured to communicatively couple to a wireless gateway;
a global positioning system (GPS) module configured to determine a geographic location of the handheld field maintenance tool when the first image and the second image are obtained;
a controller coupled to the process communication module and the wireless communication module, and operably coupled to the camera and the GPS module, the controller being configured to:
acquire the first image from the camera,
link the unique identification tag to the first image,
store the first image in memory as an as-found image based on the unique identification tag,
perform maintenance on the field device,
acquire the second image from the camera,
link the unique identification tag to the second image,
store the second image in memory as an as-left image based on the unique identification tag,
store the geographic location as metadata in the memory based on the unique identification tag,
access a library using the wireless gateway,
store the first image and the second image in the library based on the unique identification tag, and
store the metadata in the library based on the unique identification tag.
2. The handheld field maintenance tool of claim 1, wherein the camera is an internal component of the handheld field maintenance tool.
3. The handheld field maintenance tool of claim 1, wherein the first image includes a first photograph of the entire field device and the second image includes a second photograph of the entire field device.
4. The handheld field maintenance tool of claim 1, wherein the camera is an external module, and wherein the handheld field maintenance tool and the camera communicate using short-range, high speed wireless communication.
5. The handheld field maintenance tool of claim 1, and further comprising:
a compass module configured to determine a pointing direction of the handheld maintenance tool; and
wherein the controller is operably coupled to the compass module and further configured to include the pointing direction with the metadata.
6. The handheld field maintenance tool of claim 1, and further comprising:
a tilt module configured to determine an angle of inclination of the handheld maintenance tool; and
wherein the controller is operably coupled to the tilt module and further configured to include the angle of inclination with the metadata.
7. A method of field maintenance using an intrinsically-safe handheld field maintenance tool, the method comprising:
acquiring at least one as-found image relative to a field device;
coupling the handheld field maintenance tool to the field device and performing at least one maintenance function on the field device;
receiving a unique identification of the field device from the field device;
acquiring at least one as-left image relative to the field device after completion of the at least one maintenance function;
determining a geographic location of the handheld field maintenance tool when the at least one maintenance function is performed;
determining a pointing direction of the handheld maintenance tool when the at least one maintenance function is performed;
determining an angle of inclination of the handheld maintenance tool when the at least one maintenance function is performed;
storing the at least one as-found image and the at least one as-left image based on the unique identification;
storing the geographic location, the pointing direction, and the angle of inclination as metadata relating to the field device; and
wherein the intrinsically-safe handheld field maintenance tool complies with at least one intrinsic safety specification such that it will not generate a source of ignition even under fault conditions.
US13/191,604 2010-07-28 2011-07-27 Intrinsically-safe handheld field maintenance tool with image and/or sound capture Active 2033-01-10 US9201414B2 (en)
US13/191,604 US9201414B2 (en) 2010-07-28 2011-07-27 Intrinsically-safe handheld field maintenance tool with image and/or sound capture
US20120038760A1 US20120038760A1 (en) 2012-02-16
US9201414B2 true US9201414B2 (en) 2015-12-01
JP2004505337A (en) 2000-07-20 2004-02-19 シュテファン　グライス Production target, the method in particular for automobile manufacturing-related data supplied
JP2009038544A (en) 2007-08-01 2009-02-19 Idemitsu Kosan Co Ltd Explosion-proof network camera and image transmission system in dangerous area
WO2009026032A2 (en) 2007-08-17 2009-02-26 Franklin Fueling Systems, Inc. System, apparatus, and method for communicating sensor information of a system component that is disposed in a hazardous location
US20090228121A1 (en) 2005-07-25 2009-09-10 Tlv Co., Ltd. Device Management Method, Analysis System Used Therein, Maintenance Inspection Support Method, and Maintenance Inspection Support Apparatus Used Therein
Communication pursuant to Article 94(3) EPC fromcorresponding European patent application No. 11739256.3, from Sep. 10, 2015, [5 pages].
Decision of Rejection from Japanese Application No. 2013-521969, dispatch date Sep. 16, 2014, 6 pages with English Translation.
EPO Communication pursuant to Rules 161(I) and 162 EPC for European patent application No. 10701430.0 dated Aug. 30, 2011.
First Office Action from counterpart Chinese patent application No. 201180001615.0, issued Aug. 29, 2013. 14 pages.
First Office Action from counterpart Japanese patent application No. 2013-521969, dispatched on Jan. 28, 2014. 5 pages.
Notification of Reasons for Rejection from corresponding Japanese patent application No. 2013-521969, from Sep. 15, 2015. [49 pages with English translation].
Notification Regarding Results of Examination on Patentability from Russian Application No. 2013108906, dated Jun. 24, 2014 with English Translation. 10 pages.
Office Action from Canadian Patent Application No. 2,806,244 dated Jul. 22, 2014. 3 pages.
Rosemount 3051 SMV Quick Installation Guide 00825-0100-4803 Rev BA. Apr. 2011.
Second Office Action from counterpart Chinese patent application No. 201180001615.0, Issued Feb. 26, 2014. 17 pages.
WO2007079439A2 (en) 2007-07-12 Apparatus and method for wireless process control
CN102684720A (en) 2012-09-19 Method and apparatus for wireless communications in process control or monitoring environment
Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:KANTZES, CHRISTOPHER P.;MATHIOWETZ, BRAD N;TOEPKE, TODD M.;AND OTHERS;SIGNING DATES FROM 20111020 TO 20111026;REEL/FRAME:027146/0121