Device for producing a display from monitored data

Abstract: The device for producing a display from monitored data functions to read, store, encode, and integrate monitored data of at least one data type from at least one monitoring device so that the related or unrelated datum is comprehensible at a glance by a user. Encoding data of a particular data type produces a colour indicia and a graphic indicia that are the basic integration components. Integrating indicia of at least one data type produces a single superimposed and/or multidimensional image capable of portraying a present and historical data combination reflecting the monitored data's relative value at some point in time.

Description: This invention relates to a device that produces a display, and in particular, to a device that reads, stores, encodes, and integrates monitored data from at least one monitoring apparatus into colour and/or graphic multidimensional images that are comprehensible at a glance by a user. It is a problem in the field of devices that produce displays for medical monitoring devices, to display the present and/or historic values of monitored data on a common data display device in a manner that facilitates comprehension at a glance. Among the ways comprehension at a glance is inhibited include displaying information in either a complex format, an illogical format, or a format demanding focused attention on individually displayed datum. In each case, critical information is not readily comprehensible at a glance. A display may be further complicated by attempting to represent simultaneously present and historic values for monitored data of one or more data types. Inadequacies among conventional devices that produce monitored data displays include but are not limited to the following examples. One approach is to visually represent audio input with coloured lights or Light Emitting Diodes (LEDs) which correspond to variations in the audio input's frequency, volume, or frequency of occurrence. This approach provides a present value display for monitored data but is limited in flexibility due to a fixed lighting arrangement and that it does not display a monitored data history. In addition, colour combinations create complex and often cryptic displays that limit the practical number of readily comprehensible combinations. Another approach is to use audible representations of monitored data where predetermined tones are varied in their tone frequency, volume, or frequency of occurrence. This approach, however, fails to provide a monitored data history and it often requires users to distinguish between similar tones. Audible representations also limit the practical number of simultaneous sounds since overlapping tones or tone pulses require users to sort a symphony of competing sounds. Another common arrangement is the fixed field screen display which subdivides a display screen into independent fields or regions each dedicated to displaying information relating to a single monitored data type. While this approach displays multiple data types simultaneously, a user must view and interpret information from independent screen subdivisions before the aggregate of displayed information is comprehensible. GB-2 009 934 describes a way in which data can be displayed in colour. New Electronics 15 , no 12 (June 1982) describe the use of colour to display data. Brown Boveri Review, 66 no 10 October 1979 describes colour monitors. US-3 961 306 describes a way of displaying seismic data in the form of a graph, various parts of which may be colour coded to display other information. The approaches described above do not adequately provide present value and/or historic value perspectives in colour, graphic, and/or multidimensional displays. In addition, the devices producing the above described displays fail to provide an integrated display for monitored data from multiple monitoring devices that is comprehensible at a glance, which is important in the professional and home medical monitoring apparatus field. According to one aspect of the present invention, there is provided a device for producing a display from monitored data as set out in the accompanying claims. The present invention solves the above described problems and achieves a technical advance in the field of devices producing monitored data displays for at least one monitoring apparatus. Ideally, a display integrates monitored data into a present and/or historical value display form that is readily comprehensible at a glance. To facilitate comprehension at a glance, the present invention encodes and integrates monitored data from at least one monitoring apparatus into colour and/or graphic displays that visually portray the present and/or historic values for each of a plurality of monitored data types. In practice, at least one of a plurality of monitoring apparatus attached to the device of the present invention, is configured to monitor data of a predetermined type and to make the monitored data available in analog or digital form. The device of the present invention reads the monitored data made available by each monitoring apparatus, typically by a periodic sampling of present values. Each present value can be encoded for immediate display, and/or simultaneously stored as a series of uninterpreted stored values in a data storage device or area separate from each monitoring apparatus. The reading and storing of monitored data is performed for each monitored data type whether the data is provided by one monitoring apparatus or multiple independent monitoring apparatus. Once stored, the series of present values provides the basis for a present value history for each monitored data type. To produce a display readily comprehensible at a glance, each stored value is retrieved and encoded to correspond to a representative colour indicia and a graphic indicia which are the basic elements that are subsequently integrated and projected by a display device. A colour indicia includes, but is not limited to any hue, shade, fade, colour spectrum, colour continuum, or any combination thereof that is supported by an accompanying display device. A graphic indicia includes, but is not limited to any geometric, multidimensional, alphanumeric, graphic icon, or other character combination capable of being displayed by an accompanying display device. Indicia from encoded present values are integrated into various superimposed and/or multidimensional combinations suitable for projection by a display device. For example, integrating the colour indicia and graphic indicia of a monitored datum's present value provides the basis for representing the present value as a coloured integer. Similarly, integrating the indicia from a series of present values provides the basis for a multidimensional history representing present and past values of one or many types of monitored data where each indicia is updated independently. While the present invention is useful in the medical monitoring field, it is also applicable in any field where monitored data is represented on a display device. Examples of these applications include, but are not limited to, automotive, aerospace, communications, manufacturing, mechanical, power and chemical plants, environmental systems, security systems, and transportation. An embodiment of the invention will now be described, by way of example, reference being made to the Figures of the accompanying diagrammatic drawings in which:- Figure 1 illustrates a hardware configuration in block diagram form; Figure 2 illustrates the indicia from two monitored data types integrated into a colour on graphic image; Figure 3 illustrates two indicia from one monitored data type integrated into a multidimensional graphic on colour image; Figure 4 illustrates multiple indicia from multiple monitored data types integrated into a multidimensional graphic on colour image; Figure 5 illustrates multiple indicia from multiple monitored data types integrated into a rotating polygon with graphic on colour indicia; Figure 6 illustrates multiple indicia from multiple monitored data types integrated into individual graphic on colour images; Figure 7 illustrates multiple indicia from multiple monitored data types integrated into a multidimensional colour and graphic image; Figures 8 and 9 illustrate multiple indicia from multiple monitored data types integrated into a multidimensional colour and graphic image with a historic colour perspective; and Figure 10 illustrates three indicia representing one monitored data type integrated into a graphic and colour image. Figure 1 illustrates the hardware architecture of the device 100 in block diagram form, in addition to an accompanying plurality of monitors 101 through 102, at least one user input device 119, and at least one display device 109. The plurality of monitors 101 through 102 are configured to monitor data of a predetermined type and to make the monitored data available in analog or digital form. Whether any one of the monitors 101 through 102 are configured to monitor a single data type or multiple independent data types concurrently, the most recently available monitored datum of any one data type is a present value. Therefore, a data type's present value may be updated at any time, typically by obtaining a new sample, depending on the scheme the monitor 101 through 102, or the data acquisition and flow control device 104, may follow. A former present value is called a historic value. A series of present values for a given data type is typically held in storage and defines a present value history where there is only one most recent present value, and any remaining values are historic, that is, they form a history. The data acquisition and flow control device 104 is connected either directly or indirectly to each of the plurality of monitors 101 through 102 via communication connectors 103. The communication connectors 103 can be any standard or proprietary data communication interface. The device 104 reads or otherwise acquires monitored data from any or all of the plurality of monitors 101 through 102 on a schedule that may include, but is not limited to, any combination of regular, irregular, or event driven time intervals, in any manner that is ordered or unordered, synchronized or unsynchronized, parallel or seriatim, or any combination thereof. Once read or otherwise acquired, the monitored data is stored in a data storage area or device 115 in one of a plurality of data files 116 through 117, as uninterpreted datum representing the most recent present value for a particular data type. Each data file 116 through 117 corresponds to a monitored data type from a specific monitor 101 through 102, and contains a present value series for each monitored data type. The data storage area 115 may be a common or distributed computer memory including, but not limited to, a semi-conductor type memory, but may also be an independent storage device, a plurality of distributed storage devices, or any combination thereof, each being directly or indirectly accessible to the data acquisition and flow control device 104, and containing storage media including, but not limited to, disk and tape. The data acquisition and flow control device 104 also distributes monitored data for subsequent processing by colour encoding 105 and/or graphic encoding 106. For a recently read present value, the device 104 can simultaneously store and distribute the present value for subsequent encoding, or store and distribute the present value in combination with a present value series retrieved from the data storage area 115. Similarly, the device 104 can store a recently read present value and subsequently retrieve a complete present value series that includes the recently read present value so that the complete present value series can be distributed for subsequent processing by colour and/or graphic encoding 105 and 106 as a unit. The specific data and data file from which a present value series is retrieved is either preprogrammed or subject to a user request. In either case, a representative colour indicia and/or graphic indicia is then produced by the respective encoders 105 or 106 for each present value retrieved. A colour indicia includes, but is not limited to a hue, shade, fade, colour spectrum, colour continuum, or any combination thereof that is supported by an accompanying display device. A graphic indicia includes, but is not limited to any geometric, multidimensional, alphanumeric, graphic icon, or other character combination capable of being displayed by an accompanying display device. The following definitions are also useful to further define the term colour indicia, which may be used synonymously with the word colour. A hue is a distinguishable colour typically including, but not limited to, blue, green, yellow, red, or any combination thereof. A shade is any selected gradation of any one hue, where the gradations range in the black to white spectrum so that moving toward the black end of the spectrum produces a darker version of the hue, and moving toward the white end of the spectrum produces a lighter version of the hue. Fade or fading is where a hue is incrementally diluted in its intensity or clarity, toward becoming indistinguishable from a predefined background colour that is typically, but not necessarily, neutral. A colour spectrum is the complete and continuous range of hues and shades therebetween. A colour continuum is a group of simultaneously displayed hues and/or shades where the display can be a traditional colour spectrum, or a random spectrum that may vary, repeat, and/or skip a hue or shade gradation for any reason. The display integration processor 107 integrates the encoded indicia from encoders 105 and 106 into various superimposed and/or multidimensional combinations as discussed herein and illustrated in Figures 2 through 10. The processor 107 is based on standard computer processor hardware. Each integrated indicia combination is subsequently projected by a display device 109 via display controller 108. The display device 109 may be a traditional Cathode Ray Tube, flat plasma or other projection screen, or any device capable of displaying holographic or virtual images in space or in a visor or hood. The displays produced by the device 100 are not dependent on any specific type display controller 108 or display device 109, and may exist in conjunction with any processed audio 110 and/or sensory signal produced or delivered via display device 109. The user input manager 118 is responsive to user commands delivered to device 100 through a user input device 119. The user input device 119 may be any device that accepts input by any means including but not limited to, voice instruction, direct or indirect pointing at a portion of a display screen, or keyboard commands. Integrating a present value's indicia produces numerous displays ranging from one indicia representing one present value, to multiple indicia each representing the same present value or a plurality of present values. Figure 2 illustrates two indicia corresponding to two separate present values. The figure illustrates a first present value 201 and a second present value 202 prior to encoding and integration, and the same two present values after encoding and integration 203. In 203, the first present value's encoded indicia is a numeric graphic 204 and a colour 205 that is superimposed onto the numeric graphic 204. The Figure 2 example illustrates only the most recent present values without displaying a history. Alternatively, the integrated image 203 can represent one present value in two indicia forms. For example, the first present value 201 could be encoded as a colour indicia 205 that is superimposed on its equivalent numeric graphic indicia 204. Figure 3 illustrates another scenario where two indicia represent the same present value. Here, a numeric graphic indicia 301 is superimposed on a colour indicia 302, where both indicia represent the same present value. One distinct advantage of having multiple indicia represent the same present value is that each indicia is highly recognizable on its own so that when they are integrated, each indicia reinforces the other to facilitate an observers comprehension at a glance. Where an observer believes a first indicia represents a present value in a range of present values, the initial impression is instantly confirmed by the second indicia integrated with the first; the result being comprehension at a glance. Figure 3 also illustrates a historic present value series represented by multiple overlapping cards 304 arranged from oldest value 305 to the most recent present value 303. The visible portions of the overlapping cards 304 represent former present values by displaying each card's colour indicia. Only the most recent present value 303 is represented both by the colour indicia 302 and graphic indicia 301. When a more recent present value of the same data type is available from one of the plurality of monitors 101 through 102, the more recent present value is encoded and integrated to replace the present value card 303. The present value card 303 would then be pushed back one position into the card series 304 so that only its colour indicia is visible, and the oldest card 305 is no longer displayed in the series 304. Additionally, a user wishing to view the unobstructed numeric graphic indicia of a card in the card series 304, need only identify the desired card or cards by a user command via user input device 119. Identifying a card for recall is accomplished by any means including but not limited to voice instruction, direct or indirect pointing, or keyboard command. A recalled card may be displayed in any default area or a user defined area, and would appear in a form substantially the same as the present value card 303. The operational range indicator 307 corresponds to at least one indicia concurrently on display. In Figure 3, operational range indicator 307 corresponds to the colour indicia in the present value card series 304, and indicates the relative range of potential present values that may be represented by the colour indicia. Typically, the colour indicia in an operational range is shaded. Numeric values 308, 309, and 310 assist in quantifying the relative range of potential present values. Numerically quantifying the operational range is useful where the range is portrayed by shaded colour indicia. Figure 4 illustrates a historic present value series represented as a card series 404 arranged from the oldest present value card 405 to the most recent present value card 403. Each card, however, contains indicia representing three present values: a first indicia 401 in numeric graphic form with alphabetic subtitle; a second indicia 402 in numeric graphic form with alphabetic subtitle; and a third indicia 407 in colour form derived from combining present values 401 and 402, to illustrate the combined monitored measurement state for the most recent present value card 403. In a medical application, the Figure 4 example is useful for displaying related data such as pulse rate 402, blood oxygen saturation 401, and the resulting blood colour approximation 407. Using biologically correct colours or standardized colours is not mandatory. As with Figure 3, individual cards from the card series 404 can be recalled by identifying the desired card or cards. The recalled card would appear in a form substantially the same as present value card 403. The operational range indicator 408 displays a range marked by relative terms "good" 409 and "poor" 410 in addition to the numeric references 411, 412, and 413, which provide additional meaning to each colour or number along the range indicator. Figure 5 illustrates a historic value display in the form of a polygon card series. Here, the top polygon 501 rotates as a function of time or a predetermined event's occurrence 507 while polygon shadows remain behind to display former present values as background colour indicia 502 and 503. The partially obscured polygon 503 is the oldest display, followed by the next oldest 502 and the present value polygon 501. Similar to Figure 4, Figure 5 uses different indicia to represent three present values: a first indicia 504 in numeric graphic form with alphabetic subtitle; a second indicia 505 in numeric graphic form with alphabetic subtitle; and a third indicia 506 in colour form derived from combining present values 504 and 505 to illustrate the combined monitored measurement state. In addition, the inner graphic form containing or highlighting the first indicia 504 and second indicia 505, can, but is not required to, vary in size, shape, and/or colour, to correspond to the indicia therein. Alternatively, the time elapsed since the last update for present value indicia 504, 505, and 506 can be displayed by fading each respective indicia as the polygon rotation 507 continues to mark time. The more faded the colour indicia, the older the present value. The rotational direction and number of polygon edges, however, is application specific. The rotational direction, number of polygon edges, equality of polygon edges or angles, and consistency of polygon size, however, are application specific. For this reason, the present value polygon itself can, but is not required to, vary in size and/or shape in a uniform or a non-uniform fashion corresponding to the present value being represented. Figure 6 illustrates multiple present values 601, 602, 603, and 604, each representing different monitored data types. Each present value is represented by a numeric graphic indicia 606 with alphabetic subtitle, superimposed on an equivalent colour indicia 607 which fades over time as seen in present value example 604. Because each colour indicia can be a different hue, the degree of fading relative to a time increment is displayed by the operational range indicator 605. The operational range indicator 605 corresponds to a single present value indicia, however, the range indicator 605 can also be selectably displayed for any one present value indicia, or a set of operational range indicators can be displayed simultaneously for each present value. Similarly, related data types can be displayed simultaneously where each data type is represented by a different shade. The numeric values 608, 609, and 610 indicate a time increment, here, in minutes. Figure 7 illustrates a multidimensional present value and historic value integration for multiple monitored data. Each monitored data type is displayed in an individual alley 704, 705, and 706 where each alley contains a present value card series similar to card series 703. The cards in card series 703 provide a historic perspective ordered from the oldest value card 701 to the most recent present value card 702, and only the most recent present value card in card position 702 displays a numeric graphic indicia 711 superimposed on its equivalent colour indicia 712. Subsequent cards in the card series 703, are retrievable by user command, as previously described, in order to display the numeric graphic indicia as seen on the present value card 702. Further, each card in an alley can, but is not required, to occur with the same regularity as adjacent cards in an adjacent alley. Finally, any one card in a card series 703, as illustrated in alley 706, may vary in height 707 according to its value relative to the preceding and succeeding neighbor cards 709 and 710. For example, card 707 may vary in height from the preceding card 709 and succeeding card 710, and the height variation among the cards 707, 709, and 710 is highlighted by a conforming wave form 708 which provides a readily comprehensible summary at a glance. Figure 8 illustrates another present value and historic value integration for multiple monitored data. Here, the present value series for each monitored data type is displayed as a segmented colour continuum 801, 802, and 803, where each segment in the continuum represents a present value in colour indicia form. The segments in the segmented colour continuum 803 for example, provide a historic perspective ordered from the oldest segment 804 to the most recent present value segment 805, and only the most recent present value segment 805 displays a numeric graphic indicia 807 with accompanying alphanumeric title 806 superimposed on an equivalent colour indicia 808. Individual segments in the segmented colour continuum 803 are retrievable by user command, as previously described, in order to display the numeric graphic indicia in a form substantially the same as seen on the present value segment 805. Further, each card segment in continuum 803 can, but is not required, to occur with the same regularity as segments in adjacent continuum 802 and 801. A derived measurement area 814 indicates the aggregate relationship between the most recent present values represented in areas 805, 809, and 810 respectfully. The derived measurement in area 814 is displayed by colour indicia 811 and graphic indicia 813. The graphic indicia 813 can, but is not required to, represent the derived measurement as illustrated by the polygon embodiment of Figure 5. In addition, the colour indicia 811 selected to represent the derived measurement in area 814 may indicate relative states such as green for normal or good, yellow for warning, and red for bad. Here, the colour indicia 811 indicates a normal condition as alphabetically represented by the word 812. Figure 9 is similar to Figure 8 in that a present value series for each monitored data type displayed as a segmented colour continuum 901, 902, and 903 respectfully. Each segment in the continuum represents a present value in colour indicia form from oldest 910 to most recent 911. In addition, the corresponding colour indicia 904, 905, and 906 each represents the most recent present value for each monitored data type. The most recent present value 911, for example, is also displayed as a numeric graphic indicia 907 with accompanying alphanumeric title 909, superimposed onto an equivalent colour graphic indicia 906. The wave form graphic indicia 908 displays a present value history equivalent to at least the most recent portion of the corresponding segmented colour continuum 903 along the side of the image. Figure 10 illustrates a simple two dimensional integration involving three indicia from the same monitored data type. Here a wave form graphic indicia 1001 floats on the equivalent colour indicia 1002, and the equivalent numeric graphic indicia 1003 is superimposed on the colour indicia 1002. Indicators 1004 and 1005 highlight the most recent present value's coordinates on the present value axis and time/event axis. The time/event axis represents either regular time intervals or the occurrence of a predetermined event. Together, the integrated indicia provides a present and historical perspective that includes the most recent present value for a given monitored data type. A bar graph display is another variation on the Figure 10 illustration. Figures 3, 4, and 6 each display an operational range indicator 307, 408, and 605 respectively. Although the remaining Figures do not have an operational range indicator present, the absence does not preclude having the indicator for any type scenario involving integrated indicia. The graphic form and/or size of any background graphic, foreground graphic, present value card, or operational range indicator illustrated in Figures 2-9, can, but are not required to, vary to correspond to the indicia therein. The shapes illustrated in the figures are for example only. For this reason, the graphic form implemented in practice may be a regular or irregular graphic form, or any combination of size, shape, and/or amplitude that may vary accordingly. The colours used in any colour indicia representing a present value may be randomly selected or have particular meaning. Colours having particular meaning may be as found in Figure 7 where green represents good, yellow is moderate or a warning, and red is bad. Similarly, the colour indicia may represent a commonly recognized colour, including but not limited to, shades of oxygenated blood, for example, where red represents highly oxygenated blood and blue represents a low oxygen level. Each Figure 3 through 10 contains historic value cards or segments which may be recalled by user command input through a user input device 119 and interpreted by user input manager 118. Among the user commands used to recall a historic value include, but are not limited to, voice command, direct or indirect pointing at a portion of a display screen, and keyboard commands. A recalled historic value is then displayed in any default display area or a user defined display area, and would appear in a form substantially the same as the present value card fully visible in the front of a present value series. Audio processor 110 interprets signals from the data acquisition and flow control device 104 to produce desired informational tones or tone pulses when a specific monitored data type is unavailable or otherwise unsuitable for display. One condition where data is unavailable for display is where communications fail between data acquisition and flow control device 104 and any one of the monitors 101 through 102. During a period of failed communications, any monitored data available for acquisition from any other monitor 101 through 102, continues to be acquired by the data acquisition and flow control device 104 as previously indicated. Due to the failed communications, display options include but are not limited to, sounding an audible warning for the user, providing a visual display for the user, providing a combination audio and visual indicator, processing the available monitored data around the missing data to provide an estimated display, or any combination thereof. Data unsuitable for display includes, but is not limited to, data that was corrupted or otherwise contained anomalies prior to being acquired from a monitor 101 through 102, or data that was corrupted in the storage area 115 or from other internal processing by the device 100 of the present invention. In either situation, the monitored data is known to be incorrect or unreliable, and therefore may be displayed with an audible or visual warning, or not displayed at all. One application of the present invention is a medical monitoring device for professional or home care monitoring applications. The displays cited as examples herein provide specific information at a glance where time does not permit studying a monitor display, in addition to facilitating a lay persons basic information understanding. The possible display combinations are not limited to the examples shown, rather individual examples are shown as examples of the systems flexibility.

Claims: A device (100) for producing a display from monitored data of at least one data type, said display having colour and graphic display characteristics, characterised by: means (104) for reading said monitored data from at least one monitoring apparatus (101,102) as a present value for each of said at least one data type; means (105,106) for encoding said present value for each of said at least one data type to produce for each said present value a signal capable of producing colour imagery and a signal capable of producing graphic imagery such that each of the colour imagery and the graphic imagery change when the present value changes; and means (107) for integrating the colour imagery signal and the graphic imagery signal and producing an integrated signal having both a graphic component and a colour component to display an integrated indicia representation of said present value, wherein said display is a superimposed image in at least one form selected from the group consisting of colour on graphic and graphic on colour. The device of claim 1 which further comprises a data storage device (115) connected to the monitored data reading means (104) to receive monitored data and store the data in a plurality of data files (116,117), each data file corresponding to received monitored data from an external monitor (101,102) and wherein each reception of data from the monitored data reading means (104) updates the then current value with a new current value from the external monitor (101,102). The device of claim 2, wherein the data files (116,117) each contains a series of data values and the encoding means (105,106) is capable of encoding said data values to produce a signal for displaying at one time a history of the data values. The device of claim 3, wherein the current value is displayed as said integrated indicia and the said history of the data values is displayed in colour imagery only. The device of any one of claims 1 to 3, wherein the monitored data reading means (104) is connected to a plurality of monitors (101,102), each monitor producing a different data type and the colour component of the integrated signal is derived from the current value of a plurality of current values of different data types. A method of producing a display from monitored data of at least one data type, said display having colour and graphic display characteristics, characterised by: reading said monitored data from at least one monitoring apparatus (101,102) as a present value for each of said at least one data type; encoding said present value for each of said at least one data type to produce for each said present value a signal capable of producing colour imagery and a signal capable of producing graphic imagery such that each of the colour imagery and the graphic imagery change when the present value changes; and integrating the colour imagery signal and the graphic imagery signal and producing an integrated signal having both a graphic component and a colour component to display an integrated indicia representation of said present value, wherein said display is a superimposed image in at least one form selected from the group consisting of colour on graphic and graphic on colour. The method of claim 6, which further comprises receiving monitored data and storing the data in a plurality of data files (116,117), each data file corresponding to received monitored data from an external monitor (101,102) and wherein each reception of data from the monitored data reading means (104) updates the then current value with a new current value from the external monitor (101,102). The method of claim 7, wherein the data files (116,117) each contains a series of data values and the method further comprises encoding said data values to produce a signal for displaying at one time a history of the data values. The method of claim 8, which further comprises displaying the current value as said integrated indicia and the said history of the data values in colour imagery only. The method of any one of claims 6 to 9, which comprises reading monitored data from a plurality of monitors (101,102), each monitor producing a different data type and the colour component of the integrated signal is derived from the current value of a plurality of current values of different data types.

Inventors: MARS HOWARD E JR, THAM ROBERT Q, MARS, HOWARD E., JR., THAM, ROBERT Q.
Applicants: DATEX OHMEDA INC, DATEX-OHMEDA, INC.
Application year: 1995
Main classification: G01D7
IPC codes: G01D7, G06T1, G01D1, A61B5, G06F3