Abstract:
A system for digitizing gauges, lights and other human-readable machine gauges and functions and status without interfering with the operation of the machine or requiring re-working or interfering with the existing machine wiring, signaling, electrical or mechanical elements or operating modes, or adding new digitizing equipment to the machine.

Description:
CROSS-REFERENCE TO THE RELATED APPLICATIONS 
       [0001]    This patent application claims the benefit under 35 U.S.C. 119 and 35 U.S.C. 120 of U.S. provisional application Ser. No. 62/343,430 entitled “System for Transmission and Digitization of Machine Telemetry”, filed May 31, 2016, the complete contents of which is herein incorporated by reference 
     
    
     BACKGROUND OF THE INVENTION 
     1. Field of the Invention 
       [0002]    The present invention relates to the field of digitized imagery for the state of a machine, and more particularly, for monitoring the changing state based on imaging of analog or other physical state conditions of an apparatus that take place as the change occurs. 
       2. Brief Description of the Related Art 
       [0003]    With the ubiquity of global communications links, much of the world and its machines can be connected rapidly and easily to other machines and digital control systems on a worldwide basis. It is now possible to create digital control loops and employ global networks to enable machines to directly communicate important information to other machines (so-called M2M applications), to enable automated decision making without the intervention of humans. However, unlike human-to-human communications which may be in the form of voice or images, M2M applications generally require the transmission of digital data. One common part of many M2M applications today is simply converting analog telemetry and signals from a machine into a digital form, suitable for transmission over the internet. Examples, without limitation, include converting the electrical signals that drive analog type gauges on a mobile machine like a vehicle, boat or airplane, or which drive the gauges a remotely located machine like an oil rig or switch gear in a switch yard, into digital representations of said signals and sending the resulting digital representations of the electrical signals to another location via wired or wireless internet for further action or monitoring by another machine, or human. However, many machines are designed originally with gauges and indicator lights which are intended only for humans to view them, and enabling such machines to transmit a digital version of their indicator lights or gauges requires extensive modifications to the machine and interruption of the electrical signaling systems in such machines. The effort required to perform the analog to digital conversion or even the copying of already digital information gauges into a form transmittable over the internet, reduces the rate of adoption of M2M communication functions in system applications that could benefit. Furthermore, some machines present regulatory or safety or warranty difficulties in converting them to be able to send digital information from their control systems or gauges. For example the high voltages in switch gear or motor control gear must be fully isolated from the low voltage circuits that normally digitize and communicate data over the internet; gauges and wiring on an aircraft cannot be tampered with or changed without affecting the aircraft&#39;s airworthiness certificate; new circuitry to digitize analog gauges, or to tap into signals already present in digital form on a vehicle cannot be easily added without violating the warranty on the vehicle. 
         [0004]    What is needed is a system for digitizing gauges, lights and other human-readable machine gauges and functions and status without interfering with the operation of the machine or requiring re-working or interfering with the existing machine wiring, signaling, electrical or mechanical elements or operating modes, or adding new digitizing equipment to the machine. 
       SUMMARY OF THE INVENTION 
       [0005]    The present invention provides a system for digitizing devices, such as gauges, lights and other human-readable machine gauges and functions and status. The system operates without the need to reconfigure operations or electronic components of the device being monitored. The potential for adversely interfering with the operation of the machine is eliminated, and there is no need to re-work any of the machine components or interfere with the existing machine wiring, signaling, electrical or mechanical elements or operating modes. In addition the system may be implemented using equipment configured by the system, which does not require the addition of new digitizing equipment to the machine. 
         [0006]    These and other advantages may be provided by the invention. 
     
    
     
       BRIEF DESCRIPTION OF THE DRAWING FIGURES 
         [0007]      FIG. 1  is a preferred embodiment of the invention, depicting in perspective view a camera and a panel, and showing a diagram of a preferred implementation of the system according to a first exemplary embodiment. 
           [0008]      FIG. 2  is front elevation view of the panel of  FIG. 1  with an enlarged extracted image portion showing a specific meter of the panel, and process depictions according to an exemplary implementation of the system. 
           [0009]      FIG. 3  is a front elevation view showing a digital panel meter and process depictions according to an exemplary implementation of the system. 
           [0010]      FIG. 4A  is a depiction of an exemplary frame used to illustrate the image capture of a motor. 
           [0011]      FIG. 4B  is a depiction of the exemplary frame in  FIG. 4A  showing an exemplary variance region of an image capture area. 
           [0012]      FIG. 5  is a graph representing an exemplary depiction showing image variation of an operating device for captured images over a period of time. 
       
    
    
     DETAILED DESCRIPTION OF THE INVENTION 
       [0013]    A preferred embodiment of the invention, called the image-M2M system, is depicted in  FIG. 1 . In the preferred embodiment, a panel with meters, indictors and switches,  101 , is being monitored and any or all of the indicators are being digitized by the invention. Note that other than either ambient or purposeful illumination, the light reflected off of the panel,  101 A (without departing from generality may be infrared light or other non-visible wavelengths) is the only relationship between the panel and the invention, and there is no physical or electric connection between the invention and the machine being monitored whatsoever. A camera,  102 , is physically placed in the vicinity of the machine being monitored so that its field of view,  101 A, covers one or more gauges or lights or control panels to be monitored. According to some alternate embodiments, the camera may comprise an infrared-capable camera (and according to some embodiments the camera is capable of imaging both visible and infrared illumination). An infrared illumination means may be provided (e.g., separately, as part of the camera, or in association therewith) to illuminate the panel so that panels in dark rooms or at night may be captured by the camera. The resolution of the camera  102  is chosen to be sufficient to give a sufficient granularity on a pixel basis to provide the necessary resolution desired for the ultimate digitization of each meter or indicator. The camera,  102 , takes pictures of the panel. The rate of the picture frames may be either intermittent based on a frame timer  104  which is programmed either manually, or remotely via a local control system which may contain within it either a general or special purpose processor for executing a software or firmware program  106 A, or a processing function implemented either in hardware, software or a combination of the two, which captures frames of the panel only when a change in the panel itself occurs,  103 , or the camera may produce continuous video,  105 . The frames or video are optionally compressed, formatted and encrypted,  106 , and then made available to be either proactively sent or retrieved on demand by supervisory circuitry or computer  106 A. It should be understood that all of the functions  102 ,  103 ,  104 ,  105 ,  106  and  106 A may be combined in a single implementation in hardware, software or firmware on a single processor and may optionally be entirely contained with camera  102  and all of the functions may be optionally controlled by the supervisory control computer  106 A. These elements comprise what is termed the remote system  100 . 
         [0014]    The images are then communicated over a network connection  107 , which may be the internet, or a private communications link, and of which one or more segments may be electrically wired, optically linked, or wirelessly linked via a terrestrial wireless link or a satellite wireless link. This network connection  107  may also serve to provide command and control directives to the Supervisory control circuitry  106 A. The images provided by the remote system  100  arrive at separate supervisory and control circuitry,  108 A, and subsequent decompression, formatting and decryption functions  108 . The resulting images can then be stored either permanently or temporarily in a memory or other electronic storage device  109 . Subsequently, extraction and digitization algorithms are employed  110 ,  111 , which, as further described below, turns each image into a sequence of digital values associated with any or all of the indicators, meters, gauges or switches in the image of the panel. The extraction algorithm  110  and digitization algorithm  111  may be pre-programmed or may operate selectively on various parts of the panel on a request basis, and may include optical character recognition (OCR) sub-algorithms. The results may then optionally be stored in a memory device  112 , which can then be accessed by either a private communications system, such as a SCADA network, or a standards based network such as the internet. By the many means well known to those practiced in the art, the data available in memory  112  may be presented to the internet as individually addressable, or as sub-addressable, data elements. As indicated, all of the functions  108   a ,  108 ,  109 ,  110 ,  111  and  112  may be contained within a single sub-system of hardware and software,  120 , or within only software operating on a larger server farm (not shown). 
         [0015]    In the above manner, one or more indicators, readouts, meters and the like may become digital numbers, each addressable at an address or sub-address over the internet, without any direct connection to, or interference with, the operation of the said indicators in the panel  101 . 
         [0016]    The change detection function  103  may be programmed to provide for the capture of a frame or video when any external object interrupts the view of the panel or meters, such as a human operator adjusting controls or taking other actions. In this way, the invention provides additional security and information which would not necessarily be present in a simple digital telemetry stream which were formed by digitization of the signals within the panel itself. Also, the remote system  100  can be programmed to recognize certain alarm conditions such as a specific indicator light, or a hot temperature and instigate communications with the local system on its own. 
         [0017]    Now the readout extraction and digitization algorithms will be described, with reference to  FIGS. 2 and 3 . In the case of an analog type meter in  FIG. 2 , on the local system when the first instance of image capture occurs where there are many indicators, meters or gauges which may not need to be digitized, each meter to be digitized from the larger image  201  is extracted into a sub-image  202 , using a simple master mask or other simple sub-image extraction algorithm well known, and available in many common off-the-shelf image processing packages, such as Matlab. An image mask  201 A can be automatically or one-time manually created to assist the sub-image creation step. Once the sub-image of a particular meter or indicator is created, depending on the type of meter, various straightforward image processing and extraction methods can be employed to ascertain the meter reading. For example, for the meter in  203 , a Hough transform can be employed to ascertain automatically the angle of the indicator from horizontal, and that angle associated in a table with indicated meter values. For a generalized method, a reference image of the meter at each possible indication discernible by the pixilation of the image can be stored a priori in the local processing system, where each image is associated with a digital value indicated by the meter, and correlated against the sub-image  203  to determine which of the reference images is the closest match to the received sub-image. There are many other image processing methods generally well known to those practiced in the art of image processing that may be employed in step  203  without departing from the current invention. At the conclusion of step  203 , the meter or indicator value  204  is stored in the local system as a digital value, in this case negative five. 
         [0018]    Referring to  FIG. 3 , after sub-image creation, an existing digital panel meter  301  can be easily converted into a digital value  303  from a sub-image through simple optical character recognition program  302 , which are generally available in off-the-shelf software. 
         [0019]    The image-M2M invention system can also add additional functions to the image processing, such as perspective de-warping in the case where a camera is not mounted head-on to a meter or indicator, or where a large panel is imaged, without departing from the invention. Libraries of common meters may be maintained for easy manual and/or automated initial setup. 
         [0020]    The image-M2M invention presented has the advantages of being able to adapt to a wide variety of gauges, meters and indicators, including many which may not be easily amenable to digitization with traditional embedded telemetry measurement and analog-to-digital electrical or mechanical techniques. In addition, through the use of the camera and the image system, many meters or indicators may be captured and digitized at once. Furthermore, the image-M2M system can provide additional information not normally available from traditional telemetry, such as when an employee operated a dial, inspected a machine, or similar environmental or incidental events which would otherwise go unrecorded. In addition, a camera may be focused on a motor or engine or set of pulleys or belts, and may make a frame-to-frame comparison to determine the amount of vibration or torque movement in the motor or engine, providing information which would otherwise be very difficult to ascertain remotely, even with sophisticated telemetry. 
         [0021]    According to one exemplary embodiment, the system is configured with one or more cameras which are focused on one or more aspects of a motor or engine, including connected or associated components, such as, for example, drive or driven mechanisms. For example, a camera is positioned to have its focus directed to the engine or motor, or operating portion or component. The camera images the field of view and provides an image frame that is comprised of an image area A. The image area A is illustrated in  FIGS. 4A and 4B  showing an exemplary depiction of an image frame. In the image area A shown in  FIG. 4A , there is a depiction of a motor  310 , which is a captured image of a motor. The motor image  310  takes up a portion of the image area A. The motor image area preferably represents image coordinates, which may comprise pixels. In the depiction of the solid line motor  310  of  FIG. 4A , the motor  310  is shown in a static state, represented by the motor image area Ams. The broken-line depictions represent the motor  310  at operating positions, where the motor  310  during operation is vibrating. The images captured of the operating motor  310  within the frame area A are at different locations within the frame area A, and are represented by the motor positions Am 1 , Am 2 , Am 3  (three different positions being shown for illustration purposes). Although the vibrational motor positions are shown in a two dimensional coordinate depiction in the figures, according to alternate embodiments, the system may be configured to account for movement that is forward (into the plane of the page) or rearward (out of the plane of the page), in addition to, or alternative to, the two dimensional plane. 
         [0022]    The motor image area or an operating motor Ao may be set to image area coordinates within which the motor  310  is imaged when operating, and more preferably, when operating within acceptable ranges. In this example, the range represents an acceptable vibration level. The motor vibration is imaged by the motor positioning within the image area A. The motor image area may represent a number of separate motor images Am 1 , Am 2 , Am 3 , . . . AmN, where each separate image corresponds with a set of image coordinates or pixels of the image frame capture (at different times), which, in this example, may be represented by the image area A. The image coordinates of each image may be used to determine an operation parameter, which, in this example, is a vibration level, and an acceptable vibration level. Referring to  FIG. 4B , in this example, an image area or boundary of an operating motor image location is represented by Ao. The image area Ao of the operating motor may be generated by the represented motor positions within the camera frame that correspond with acceptable positions as a result of vibrational movement or disturbances of the operating motor under acceptable operating conditions. The motor  310  may be imaged in a non-operating state to provide a static image Ams (see  FIG. 4A ), which represents the motor static position level within the frame or area A. The vibrational variances may be determined by the position of the motor  310  within the image area A at a given time, or over a given time interval or series of frames. For example, where the boundary of acceptable motor vibration Ao is exceeded, an operating event may be detected and recorded. The system may be configured with software containing instructions to detect operating events, and generate a response when an operating event has been detected (such as a positive detection result). For example, some responses may include recording the event to a log, issuing an alert, notifying a particular individual or machine (computer), to shutting down the device (the motor in this example), or combinations of these. 
         [0023]    According to some implementations, the system is configured to process the motor image AmT (where, for example, the motor image Am represents an image at a particular time T), and compare the pixels or coordinates of the motor image location on the image field to determine whether the motor image parameters have been breached. The breach may be confirmed by a determination that the processed image reveals the motor (e.g., portion thereof) being detected at a position within the frame that is outside of a designated motor image boundary area, which in this example is the motor image boundary area Ao. For example, where Ao defines a set of coordinates within which the motor imaging is acceptable for the motor position or location, and a motor image breaches the coordinate boundary, a positive detection result may be recorded. According to some embodiments, pixel locations and values of the motor images may be compared (for example, to an absolute value or reference value), to determine whether a breach of an acceptable operating condition has occurred. 
         [0024]    Alternately, the motor vibration may be determined with reference to a deviation from the static image position Ams. For example, the separate images Am 1 , Am 2 , Am 3 , . . . AmN of the motor during operation of the motor may provide image coordinates that are different than the static image coordinates Ams (although it is possible that some of the images Am 1 , . . . AmN may correspond with the status image Ams as the motor is operating). A variance level may be determined for the image area of an operating motor, and the camera may operate as shown and described herein, with continuous imaging, or a frame rate imaging, which ascertains an image of the motor. Referring to  FIG. 5 , a plot of motor image change or variation ΔAm from a static condition image (Ams) over time T is shown. The graph depicts an acceptable variance range region, and variant range regions outside of the acceptable range region. The range or variance parameters may be designated and predetermined based on accepted movements or vibrations of the motor during normal operations or operations deemed to be acceptable. The variance may be provided to proscribe when motor vibrations exceed an acceptable or threshold level, which is represented by the motor imaging locations within an image frame, and as the motor imaging locations may be represented by pixels or coordinates. 
         [0025]    According to some alternate embodiments, the system may be configured to image a particular portion of a component, such as the motor. For example, a pulley wheel, or a portion thereof, such as, the top portion, may be imaged, and when its radial portion being imaged is detected to have breached an arc range (e.g., as defined by the frame coordinates), which previously was determined to be an acceptable operating range, a positive detection result may be initiated. In addition, an alert or other operation may be generated. 
         [0026]    The system may be configured to generate a response to a positive detection (where the motor vibration is detected and determined to be operating outside of acceptable parameters), which may be from storing the result for later use in maintenance, or to relay an instruction to shut down the motor, or any other response, which may be to send an alert to an operator or technician (and allow the motor to continue). In addition, the vibration level image data may be processed and stored, as images, or as processed information. The vibration levels may be provided to recreate motor movements that were imaged. In addition, the vibration image data, such as, for example, the position of the motor within a frame, or processed vibration data ascertained from the images, may be time-stamped to provide an indication of the time of operation. This may be useful to determine whether there is a particular load, time of day, or operation that produces an associated motor operation. 
         [0027]    Although the example is provided in conjunction with a motor, other operating components may be used and imaged, and the image information processed to determine whether the component operation is within an acceptable operation parameter or condition. In addition, a plurality of cameras may be provided to image a respective plurality of components, and the images of multiple components may be determined and detected by the system. 
         [0028]    Furthermore, the camera system may be augmented with audio information or an audio track which can record the sounds of buzzers, alarms or other audible signaling which is otherwise unobservable by the image system. Also, the sounds of motors or engines may be recorded so that if they begin to make unusual sounds, a local action can be taken for what might otherwise be an unobserved remote phenomenon. 
         [0029]    These and other advantages may be realized with the present invention. While the invention has been described with reference to specific embodiments, the description is illustrative and is not to be construed as limiting the scope of the invention. Although a plurality of motor images are shown on the image frame A of  FIG. 4A , the images may represent an image captured on separate frames and represent separately captured image frames. Various modifications and changes may occur to those skilled in the art without departing from the spirit and scope of the invention described herein and as defined by the appended claims.