Source: https://patents.google.com/patent/EP0738073A2/en
Timestamp: 2018-07-17 00:37:20
Document Index: 173815500

Matched Legal Cases: ['art 511', 'art 711', 'art 1414', 'art 1415', 'art 1416', 'art 1417', 'art 1415', 'art 1414', 'art 1414', 'art 1416', 'art 1417', 'art 1729', 'art 1208', 'art 502', 'art 511', 'art 512', 'art 511', 'art 512', 'art 513', 'art 503', 'art 504', 'art 505', 'art 502', 'art 511', 'art 511', 'art 512', 'art 511', 'art 512', 'art 504', 'art 504', 'art 505', 'art 511', 'art 511', 'art 702', 'art 711', 'art 711', 'art 703', 'art 704', 'art 705', 'art 711', 'art 711', 'art 713', 'art 711', 'art 713', 'art 1002', 'art 1011', 'art 1012', 'art 1011', 'art 1012', 'art 1011', 'art 1003', 'art 1004', 'art 1005', 'art 1002', 'art 1004', 'art 1005', 'art 1004', 'art 1003', 'art 1004', 'art 1005', 'art 1012', 'art 1102', 'art 1011', 'art 1011', 'art 1103', 'art 1104', 'art 1105', 'art 1104', 'art 1110', 'art 1105', 'art 1107', 'art 1208', 'art 1205', 'art 1307', 'art 1209', 'art 1208', 'art 1208', 'art 1414', 'art 1415', 'art 1416', 'art 1417', 'art 1418', 'art 1208', 'art 1414', 'art 1415', 'art 1416', 'art 1417', 'art 1414', 'art 1414', 'art 1519', 'art 1520', 'art 1521', 'art 1522', 'art 1520', 'art 1520', 'art 1414', 'art 1414', 'art 1414', 'art 1414', 'art 1208', 'art 1415', 'art 1208', 'art 1415', 'art 1415', 'art 1415', 'art 1210', 'art 1415', 'art 1415', 'art 1623', 'art 1624', 'art 1623', 'art 1415', 'art 1415', 'art 1416', 'art 1416', 'art 1725', 'art 1726', 'art 1727', 'art 1728', 'art 1729', 'art 1730', 'art 1731', 'art 1726', 'art 1731', 'art 1731', 'art 1727', 'art 1731', 'art 1729', 'art 2536', 'art 1729', 'art 2536', 'art 1729', 'art 2536', 'art 1731', 'art 1417', 'art 1417', 'art 1832', 'art 1833', 'art 1416', 'art 1417', 'art 1416', 'art 1417', 'art 1208', 'art 1414', 'art 1415', 'art 1208', 'art 1417', 'art 1208', 'art 2838', 'art 1208', 'art 2837', 'art 2838', 'art 2839', 'art 2838', 'art 2838', 'art 2838', 'art 2838']

EP0738073A2 - Video information adjusting apparatus, video information transmitting apparatus and video information receiving apparatus - Google Patents
EP0738073A2
EP0738073A2 EP19960105726 EP96105726A EP0738073A2 EP 0738073 A2 EP0738073 A2 EP 0738073A2 EP 19960105726 EP19960105726 EP 19960105726 EP 96105726 A EP96105726 A EP 96105726A EP 0738073 A2 EP0738073 A2 EP 0738073A2
EP0738073A3 (en )
Figure 1 is a diagram schematically showing the structure of the improved type CCD by comparison with the structure of the current type. As shown in Figure 1(1), in the current type CCD, four transfer gates are used for two pixels, so that a signal of only one packet can be transferred for two pixels.
On the other hand, the improved type CCD employs a 2-pixel, 8-gate configuration, as shown in Figure 1(2) or (3). This configuration allows a signal of a maximum of three packets to be transferred for one pixel. Japanese Laid-open Patent No. 5-145887 is incorporated herein by reference.
By increasing the number of transfer packets, as shown in Figure 1(2), signals of two different accumulation periods (for example, different shutter speeds such as 1/60 [sec] and 1/1000 [sec]) can be read out separately, and by combining these, signals of wider dynamic range can be handled.
NTSC resolution is obtained by mixing photodiode (PD) signals of even-numbered lines and odd-numbered lines. It is already known that if these two kinds of signals are handled separately rather than mixing them together, image resolution can be increased by about 30% (Ishigami, et al., "1/2-inch, 380,000-pixel Whole-Image Readout CCD Imager," Technical Report, The Institute of Television Engineers, Vol. 17, No. 16, pp. 39-44 (1993)). This report is incorporated herein by reference.
Figure 2 is a diagram showing how subjects of different illuminance levels are imaged by the improved type CCD by comparison with the current type CCD. In the current type CCD, the dynamic range is narrow, and depending on the subject, the outside background may appear "white out" or the room interior may appear "black out".
Therefore, in the current type CCD, the range of illuminance for shooting must be adjusted by using a mechanical iris while viewing the image currently being shot, or by controlling the signal accumulation time by using an electronic shutter.
On the other hand, with the improved type CCD, which has a wide dynamic range, the phenomena of "white out" and "black out" do not occur.
Figure 3 is a diagram showing the performance of the improved type CCD. In the improved type CCD, when signals of different accumulation times, such as 1/60 [sec] and 1/1000 [sec], are read independently of each other, as earlier described, the dynamic range of the CCD increases by a factor of more than 13. Further, if the shutter speed is changed to 1/100,000 [sec], the photodiode saturation level increases by a factor of more than 1,300 compared to the prior known type.
Figure 4 shows images captured using the improved type CCD. The accumulation time is 1/1,000 [sec] for a high illuminance image and 1/60 [sec] for a standard illuminance image. When the current type CCD is used, both a light bulb and a can having different illuminance levels cannot be presented clearly; on the other hand, when the improved type CCD is used, both the character on the can and the character on the light bulb can be presented.
Figure 1 is a diagram schematically showing the structure of an improved type CCD by comparison with a current type CCD;
Figure 2 is a diagram showing how subjects of different illuminance levels are imaged using the improved type CCD by comparison with the current type CCD;
Figure 3 is a diagram showing the performance of the improved type CCD;
Figure 4 is a diagram showing images captured using the improved type CCD;
Figure 5 is a diagram showing the configuration of a video information adjusting apparatus according to a first embodiment of the present invention;
Figure 6 is a diagram showing how two kinds of image information obtained from an illuminance information acquiring part 511 are adjusted and consolidated into one kind of image information and transmitted with imaging conditions appended thereto;
Figure 7 is a diagram showing the configuration of a video information adjusting apparatus according to a second embodiment of the present invention;
Figure 8 is a diagram showing how two kinds of image information obtained from an illuminance information acquiring part 711 are transmitted independently of each other;
Figure 9 is a diagram showing a process for adjusting illuminance information;
Figure 10 is a diagram showing the configuration of a video information adjusting apparatus according to a third embodiment of the present invention;
Figure 11 is a diagram showing the configuration of a video information adjusting apparatus according to a fourth embodiment of the present invention;
Figure 12 is a diagram showing the configuration of a video information adjusting apparatus according to a fifth embodiment of the present invention;
Figure 13 is a diagram showing the configuration of a video information adjusting apparatus according to the fifth embodiment of the present invention;
Figure 14 is a diagram showing the configuration of a working condition managing part;
Figure 15 is a diagram showing the configuration of a video information managing part 1414;
Figure 16 is a diagram showing the configuration of an audio information managing part 1415;
Figure 17 is a diagram showing the configuration of a window information managing part 1416;
Figure 18 is a diagram showing the configuration of a pointing information managing part 1417;
Figure 19 is a chart showing an example of information managed in the audio information managing part 1415;
Figure 20 is a chart showing an example of information managed in the video information managing part 1414;
Figure 21 is a chart showing an example of information managed in the video information managing part 1414;
Figure 22 is a chart showing an example of information managed in the window information managing part 1416 and pointing information managing part 1417;
Figure 23 is a diagram showing a method of determining a user's attention window by using window size change information;
Figure 24 is a diagram showing a method of determining a user's attention window by using window's owner information;
Figure 25 is a diagram showing a method of determining user's attention information on the basis of information from a window display area change detecting part 1729;
Figure 26 is a diagram showing a method of detecting a user's attention point in video information;
Figure 27 is a diagram showing the method of detecting a user's attention point in video information;
Figure 28 is a diagram showing the configuration of a working condition managing part 1208 or 1308 equipped with an identifying part; and
Figure 29 is a diagram showing video information adjusting apparatus equipped with an identifying part.
Referring now to Figure 5, there is shown therein a diagram showing the configuration of a video information adjusting apparatus according to a first embodiment of the present invention. The video information adjusting apparatus shown here is the type that can adjust illuminance information between terminals. More specifically, an input part 502 of a terminal 501 is a camera having an illuminance information acquiring part 511 and an illuminance information adjusting part 512. The illuminance information acquiring part 511 comprises a CCD of improved type and is responsible for image information collection. The illuminance information adjusting part 512 is a circuit which performs brightness adjustments on two kinds of information, high illuminance information and standard illuminance information, acquired by the improved type CCD, and which supplies image information, corresponding to part of the brightness-adjusted, expanded image information, and information concerning imaging conditions to an identifier appending part 513. An output part 503 allows the connection of a viewing apparatus (such as a display), an audio output apparatus (such as a speaker, amplifier, etc.), a recording apparatus (such as a VTR, hard disk, optical disk, etc.), and a printer or the like. A transmitting part 504 is a transmission device compatible with a LAN, CATV, modem, digital PBX, or the like. A terminal control part 505 is a control unit responsible for the overall control of these parts.
The input part 502 also allows the connection of an input device such as a keyboard, mouse, digitizer, touch panel, light pen, microphone, etc. For a general view of the terminal 501, refer to Figure 29(a).
For explanation purposes, it is assumed here that for transmission and reception of an image the terminal 501 in the upper part of Figure 5 acts as the transmitting terminal and the terminal 501 in the lower part as the receiving terminal.
Figure 6 is a diagram showing how the two kinds of information acquired by the illuminance information acquiring part 511 are adjusted and consolidated into one kind of image information for output. The illuminance information acquiring part 511 acquires the two kinds of image information, i.e., the high illuminance information and the standard illuminance information, and supplies them separately and independently of each other to the illuminance information adjusting part 512. The illuminance information acquiring part 511 also supplies the illuminance information adjusting part 512 with information concerning imaging conditions, including information concerning charge accumulation times, etc. obtained as imaging conditions.
The brightness adjustment of the illuminance information will be described below with reference to Figure 9 showing an example of the adjustment process. First, an addition is performed to add the high illuminance information to the standard illuminance information. Next, the slope of the expanded illuminance information obtained as a result of the addition is linearly interpolated by calculation (gamma correction). The result is the brightness-adjusted, expanded image information.
The transmitting part 504 at the transmitting end receives the changed imaging conditions from the receiving terminal 501. Based on the changed imaging conditions received by the transmitting part 504, the terminal control part 505 changes the imaging conditions of the illumination information acquiring part 511. Changing the imaging conditions can be accomplished by controlling the accumulation time in the CCD in accordance with a predetermined rule (for example, to achieve an illuminance level 16 times higher than the previous level the shutter speed of the camera for high-light-level imaging is set to 1/1000 [sec], or the shutter speed of the camera is changed according to the working condition of the user).
Further, in an alternative method of acquiring high illuminance information and standard illuminance information by the illuminance information acquiring part 511, the two kinds of illuminance information may be obtained from the same object by using a camera or CCD having two different shutter speeds, and threshold values may be set for the two kinds of illuminance information.
Referring to Figure 7, there is shown therein a diagram showing the configuration of a video information adjusting apparatus according to a second embodiment of the present invention. The apparatus shown here is the type that controls the illuminance information centrally in one location. First, the configuration of a terminal 701 will be described. An input part 702 of the terminal 701 is a camera having an illuminance information acquiring part 711. The illuminance information acquiring part 711 comprises a CCD of improved type and is responsible for image information collection. An output part 703 allows the connection of a viewing apparatus (such as a display), an audio output apparatus (such as a speaker, amplifier, etc.), a recording apparatus (such as a VTR, hard disk, optical disk, etc.), and a printer or the like. A transmitting part 704 is a transmission device compatible with a LAN, CATV, modem, digital PBX, or the like. A terminal control part 705 is a control unit responsible for the overall control of these parts.
Figure 8 is a diagram showing how the two kinds of image information acquired by the illuminance information acquiring part 711 are transmitted independently of each other. The illuminance information acquiring part 711 acquires the two kinds of image information, i.e., the high illuminance information (for example, an image captured by the improved type CCD with charge accumulation time set to 1/1,000 [sec]) and the standard illuminance information (for example, an image captured with charge accumulation time set to 1/60 [sec]), and transfers them separately and independently of each other to an identifier appending part 713. The illuminance information acquiring part 711 also supplies the identifier appending part 713 with information concerning imaging conditions, including information concerning charge accumulation times, etc. obtained as imaging conditions.
Referring to Figure 10, there is shown therein a diagram showing the configuration of a video information adjusting apparatus according to a third embodiment of the present invention. The video information adjusting apparatus shown here is the type that can adjust resolution between terminals. More specifically, an input part 1002 of a terminal 1001 is a camera having a resolution information acquiring part 1011 and a resolution information adjusting part 1012. The resolution information acquiring part 1011 comprises a CCD of improved type and outputs a PD signal of even-numbered lines and a PD signal of odd-numbered lines separately and independently of each other on a field-by-field basis. The resolution information adjusting part 1012 is a device for generating image information at prescribed resolution by using the PD signals of even-numbered lines and odd-numbered lines supplied from the resolution information acquiring part 1011. An output part 1003 allows the connection of a display apparatus (such as a display), an audio output apparatus (such as a speaker, amplifier, etc.), a recording apparatus (such as a VTR, hard disk, optical disk, etc.), and a printer or the like. A transmitting part 1004 is a transmission device compatible with a LAN, CATV, modem, digital PBX, or the like. A terminal control part 1005 is a control unit responsible for the overall control of these parts. The input part 1002 also allows the connection of an input device such as a keyboard, mouse, digitizer, touch panel, light pen, microphone, etc.
For explanation purposes, it is assumed here that for transmission and reception of image information the terminal 1001 in the upper part of Figure 10 acts as the transmitting terminal and the terminal 1001 in the lower part as the receiving terminal.
The standard resolution image information and the information concerning imaging conditions, transmitted from the transmitting terminal 1001, are received by the transmitting part 1004 in the receiving terminal 1001. The terminal control part 1005 transfers the image information received by the transmitting part 1004 to the video monitor connected to the output part 1003. The video monitor displays an image on its screen in accordance with the standard resolution image information.
The transmitting part 1004 at the transmitting end receives the code, corresponding to the arrow key, transmitted from the receiving terminal 1001. Based on the code corresponding to the arrow key, the terminal control part 1005 changes the mode of processing in the resolution information adjusting part 1012. In this case, the mode of processing is changed from standard resolution to high resolution.
Referring to Figure 11, there is shown therein a diagram showing the configuration of a video information adjusting apparatus according to a fourth embodiment of the present invention. The video information adjusting apparatus shown here is the type that controls resolution information centrally in one location. First, the configuration of a terminal 1101 will be described. An input part 1102 is a camera having a resolution information acquiring part 1011. The resolution information acquiring part 1011 comprises a CCD of improved type and outputs a PD signal of even-numbered lines and a PD signal of odd-numbered lines separately and independently of each other. An output part 1103 allows the connection of a viewing apparatus (such as a display), an audio output apparatus (such as a speaker, amplifier, etc.), a recording apparatus (such as a VTR, hard disk, optical disk, etc.), and a printer or the like. A transmitting part 1104 is a transmission device compatible with a LAN, CATV, modem, digital PBX, or the like. A terminal control part 1105 is a control unit responsible for the overall control of these parts.
Next, the configuration of a terminal support apparatus 1106 for controlling and managing a plurality of terminals 1101 will be described. A transmitting part 1104 is an information transmitting device compatible with a LAN, CATV, modem, digital PBX, etc. A resolution information adjusting part 1110 is a circuit for generating image information at standard resolution, high resolution, or low resolution by using the PD signals of even-numbered lines and odd-numbered lines transmitted from the terminal control part 1105. A terminal control part 1107 is a control unit responsible for the overall control of these parts and for the control and linagement of the plurality of terminals 1107.
Figures 12 and 13 are diagrams showing the configuration of an video information adjusting apparatus according to a fifth embodiment of the present invention. The video information adjusting apparatus shown here monitors the working condition of a terminal user, and based on the working condition, automatically adjusts the previously described illuminance information adjusting part and resolution information adjusting part. The video information adjusting apparatus is shown in two types: one is the terminal apparatus shown in Figure 12 and the other is the terminal support apparatus shown in Figure 13. A working condition managing part 1208 (or 1308) for managing the working condition of the user is controlled by a terminal control part 1205 (or terminal support control part 1307). The working condition of the user is stored in a working condition storing part 1209 (or 1309) for management.
Figure 14 is a diagram showing the configuration of the working condition managing part 1208 (or 1308). The working condition managing part 1208 (or 1308) comprises: a video information managing part 1414 for managing a change in the condition of video information (for example, a video scene change); an audio information managing part 1415 for managing a change in the condition of audio information (for example, a change in audio power or discrimination between noise and conversation); a window information managing part 1416 for managing a change in the condition of a window (for example, a window size change) being used to process information by an individual or between individuals; a pointing information managing part 1417 for managing a change in user action to point to a document (the pointing device used for pointing includes a mouse pointer, a touch panel, etc.); and a working condition control part 1418 for controlling and managing these parts. The working condition managing part 1208 (or 1308) may include all or part of the video information managing part 1414, audio information managing part 1415, window information managing part 1416, and pointing information managing part 1417.
Figure 15 is a diagram showing the configuration of the video information managing part 1414. The video information managing part 1414 comprises: a camera operation detecting part 1519 for detecting a camera operation; a video scene change detecting part 1520 for detecting a video scene change; a video channel change detecting part 1521 for detecting a change in video channel selection by the user when there are a plurality of video channels; and a video information management and control part 1522 for controlling and managing these parts.
The video scene change detecting part 1520, based on the image information captured by the camera, detects the presence or absence of a change in the image being captured. For example, the video scene change detecting part 1520 detects the presence or absence of a change in the image being captured, based on the difference between frames. If the calculated difference is greater than a prescribed value, then it can be determined that a change has occurred in the image being captured. Accordingly, when a document is being captured by a camera for shooting materials, for example, if the user points to the document, the pointing action can be detected.
Figure 20 is a chart showing an example of information managed in the video information managing part 1414. The video information managing part 1414 manages information consisting of the content of video information change, the originator of the change, the time and date of the change, and the location of the change. To implement a method of detecting a change in video information, for example, an infrared sensor for detecting the movement of a hand is attached to a camera for shooting materials for presenting a document, or a ultrasonic sensor for detecting the presence or absence of the user is attached to a person pickup camera for picking up the expression of the user; in this way, a change in the condition of video information can be detected. By using various sensors according to the purpose, information concerning the movement of the user can be obtained. The movement information can also be obtained by utilizing difference information between frames of video information obtained from the camera.
Figure 21 also is a chart showing an example of information managed in the video information managing part 1414. In this example, the video information managing part 1414 manages information consisting of the content of camera operation change, the originator of the change, the time and date of the change, and the location of the change, other than the management information for video information described with reference to Figure 20.
A description will be given of the working condition managing part 1208 (1308) when it is equipped with the audio information managing part 1415. The working condition managing part 1208 (1308) accepts audio information as input information and transfers it to the audio information managing part 1415. The audio information managing part 1415 detects a voice part and a voiceless part from the audio information. When a voice part is detected from the audio information, the audio information managing part 1415 outputs an instruction code to present video information at high resolution for the length of time predetermined by the user. In accordance with the instruction code, the resolution information adjusting part 1210 (or 1310) outputs video information at high resolution for the predetermined length of time.
Further, in the case of a teleconference in which a plurality of persons participate, if the display brightness of a full-motion window displaying a speaking participant is increased and the brightness of other windows is reduced, the overall atmosphere of the conversation being conducted within the group can be more easily grasped.
Figure 16 is a diagram showing the configuration of the audio information managing part 1415. The audio information managing part 1415 comprises an audio information dividing part 1623 for detecting a voice part from audio information, and an audio information management and control part 1624 for managing and controlling the audio information dividing part 1623.
Figure 19 is a chart showing an example of information managed in the audio information managing part 1415. The audio information managing part 1415 manages information consisting of the name of user originating voice, the start time of voice part, and the block length of the voice part.
Figure 17 is a diagram showing the configuration of the window information managing part 1416. The window information managing part 1416 comprises: a window creation/deletion detecting part 1725 for detecting the creation/deletion of a window; a window size change detecting part 1726 for detecting a window size change; a window display position change detecting part 1727 for detecting the displayed position of a window; a window focus change detecting part 1728 for detecting a change in window focus (switching the window to be edited (discussed) among users); a window display area change detecting part 1729 for detecting a change in the display area of information to be displayed in a window; an inter-window display change detecting part 1730 for detecting a change in overlapping relations among a plurality of windows; and a window information management and control part 1731 for controlling these detecting parts.
Figure 23 is a diagram showing a method of determining a user's attention window by using window size change information. Here, a method of determining a user's attention information (window) will be described by taking a window size change as an example out of the window resources. The window used to process information by an individual or between individuals is provided with a window resizing part, and when using the window, the user explicitly changes the display size of the window by using the window resizing part. The window size change detecting part 1726 detects the presence or absence of a change in the window display size, and upon detecting a display size change, notifies the window information management and control part 1731 accordingly. Then, the window information management and control part 1731 performs control by determining that the window whose display size has been changed is the window to which the user's attention is currently directed.
Figure 24 is a diagram showing a method of determining a user's attention window by using window's owner information. A common information editing area 2434, as a work area for processing information between individuals, and a personal information editing area 2435, as a work area for processing information by an individual, are provided on a monitor screen. When the user has moved a window that he desires to present to another user (a full-motion window for discussion between them) into the common information editing area 2434, the window display position change detecting part 1727 detects the movement. Then, the window information management and control part 1731 performs communication control to present the window moved into the common information editing area 2434 to that other user.
Figure 25 is a diagram showing a method of determining a user's attention information by using the information from the window display area change detecting part 1729. First, a window for displaying document information is provided with a window display area changing part 2536 so that the user can view a necessary portion of document information as needed when the document contains more information that can fit in the window. However, the user interface is not limited to the scroll bar shown in the figure, but a pushbutton type or the like may be used. The window display area change detecting part 1729 detects whether the user has operated the window display area changing part 2536 to bring a different portion of the document into the window. When the window display area change detecting part 1729 has detected an operation performed on the window display area changing part 2536, the window information management and control part 1731 determines that the window from which the operation has been detected is the window to which the user's attention is currently directed, provided that after that detection, audio information is detected for a predetermined length of time (for example, one second).
Figure 18 is a diagram showing the configuration of the pointing information management part 1417. The pointing information management part 1417 comprises a pointing information detecting part 1832 for detecting a pointing action of the user (for example, a pointing action using a mouse pointer or the like), and a pointing information management and control part 1833 for controlling and managing this detecting part.
Figure 22 is a chart showing an example of information managed in the window information managing part 1416 and the pointing information managing part 1417. The window information managing part 1416 and the pointing information managing part 1417 manage information consisting of the content of pointing operation change, the originator of the change, the time and date of the change, and the location of the change. A logical page, chapter, or section may be used as a basic unit for window operation. Further, a personal information describing means may be provided in a window, and the contents of the personal information descriptions (personal memos) may be examined.
Figures 26 and 27 are diagrams illustrating a method of detecting an object in an image to which the user's attention is directed. The working condition managing part 1208 (or 1308) equipped with a camera for shooting a document or a person detects a camera operation performed by the user and audio information by using the image information managing part 1414 and the audio information managing part 1415, respectively. Camera operations performed by the user include, for example, video channel switching when there are a plurality of video sources, camera zoom operations, and operations on recording apparatus such as VTRs. The working condition managing part 1208 (or 1308) detects an object to which the user's attention is directed, based on when and where in the image information the user has pointed to.
Figure 26 is a diagram showing a monitor screen displaying an image of a "circuit board" that a user presents using a camera for shooting materials, and an image of another user's finger pointing to the "circuit board" image, the "finger" image being overlaid on the "circuit board" image. As shown in Figure 27, pointing information generated by a pointing finger or the like is detected by an infrared sensor mounted on the camera used to present a document to participants. It is also possible to utilize difference information between image frames.
When the pointing information is detected, the pointing information managing part 1417 performs processing to overlay the detected object (in this example, the pointing finger) onto the "circuit board" displayed on the video monitor.
Figure 28 shows the working condition managing part 1208 (or 1308) equipped with an identifying part 2838. The working condition managing part 1208 (or 1308) comprises: a video information managing part 2837 for examining a change in video information; the identifying part 2838 for identifying a person or the like that has entered the vicinity of a terminal or a document being presented in a conference; and a working condition control part 2839 for controlling and managing these parts.
Figure 29 is a diagram showing video information adjusting apparatus equipped with the identifying part 2838. Figure 29(a) shows a video information adjusting apparatus used when explaining a document using a camera for shooting materials. A barcode reader, for example, may be used as the identifying part 2838. The barcode reader then identifies the document currently being presented.
Figure 29(b) shows a video information adjusting apparatus used when monitoring a cash dispenser or the like using a monitoring camera. Means that can be used as the identifying part 2838 include, for example, face identifying means for detecting human features, speaker identifying means using voice, a noncontacting IC card, and an infrared camera though it can only detect the presence or absence of a human body. The identifying part 2838 detects a person entering the vicinity of the video information adjusting apparatus or a user of the cash dispenser or the like.
A video information adjusting apparatus comprising:
image information acquiring means (511) for separately acquiring image information corresponding at least to two different kinds of illuminance ranges, from an identical shot on the basis of a prescribed imaging condition; and
image information generating means (512) for generating brightness-adjusted image information on the basis of a prescribed illuminance range and by using all or part of said image information corresponding at least to said two kinds of illuminance ranges.
A video information adjusting apparatus according to claim 1, wherein said image information acquiring means (511) acquires standard illuminance information which is image information corresponding to a first illuminance range, and high illuminance information which is image information corresponding to a second illuminance range located on a higher illuminance side than said first illuminance range.
A video information adjusting apparatus according to claim 2, wherein said image information generating means (512) generates expanded image information by adding said high illuminance information to said standard illuminance information and by correcting a high illuminance information portion of the resulting illuminance information, and generates said brightness-adjusted image information by using said expanded image information on the basis of said prescribed illuminance range.
A video information adjusting apparatus according to claim 3, further comprising transmitting means (504) for transmitting out said brightness-adjusted image information or said brightness-adjusted image information plus information concerning said prescribed imaging condition, and for receiving information concerning said prescribed illuminance range and/or said prescribed imaging condition from outside.
A video information adjusting apparatus according to claim 4, wherein said image information acquiring means (511) includes a solid-state imaging device for reading separately charge signals resulting from two different kinds of accumulation times.
A video information transmitting apparatus (701) comprising:
image information acquiring means (711) for separately acquiring image information corresponding at least to two different kinds of illuminance ranges, from an identical shot on the basis of a prescribed imaging condition; and
transmitting means (704) for separately transmitting out said image information corresponding at least to said two kinds of illuminance ranges.
A video information receiving apparatus (706) comprising:
transmitting means (704) for separately receiving image information corresponding at least to two different kinds of illuminance ranges from outside; and
image information generating means (712) for generating brightness-adjusted image information on the basis of a prescribed illuminance range and by using all or part of said image information corresponding at least to said two kinds of illuminance ranges.
image information acquiring means (511) for separately acquiring image information corresponding at least to two different kinds of illuminance ranges, from an identical shot on the basis of a prescribed imaging condition;
transmitting means (504) for separately transmitting out said image information corresponding at least to said two kinds of illuminance ranges, and for receiving other image information corresponding at least to two different kinds of illuminance ranges from outside; and
image information generating means (512) for generating brightness-adjusted image information on the basis of a prescribed illuminance range and by using all or part of said other image information corresponding at least to said two kinds of illuminance ranges.
A video information adjusting apparatus according to claim 8, wherein said image information acquiring means (511) acquires standard illuminance information which is image information corresponding to a first illuminance range, and high illuminance information which is image information corresponding to a second illuminance range located on a higher illuminance side than said first illuminance range.
A video information adjusting apparatus according to claim 9, wherein said image information generating means (512) generates expanded image information by adding said high illuminance information to said standard illuminance information and by correcting a high illuminance information portion of the resulting illuminance information, and generates said brightness-adjusted image information by using said expanded image information on the basis of said prescribed illuminance range.
A video information adjusting apparatus according to claim 10, said transmitting means (504) further transmits out information concerning said prescribed imaging condition and/or said prescribed illuminance range, and receives information concerning said prescribed imaging condition and/or said prescribed illuminance range from outside.
A video information adjusting apparatus according to claim 11, wherein said image information acquiring means (511) includes a solid-state imaging device for reading separately charge signals resulting from two different kinds of accumulation times.
image information acquiring means (1011) for separately acquiring image information of even-numbered lines and image information of odd-numbered lines on a field-by-field basis on the basis of a prescribed imaging condition;
transmitting means (1004) for receiving information concerning prescribed resolution from outside; and
image information generating means (1012) for generating image information corresponding to said prescribed resolution by using all or part of said image information of even-numbered lines and said image information of odd-numbered lines.
A video information adjusting apparatus according to claim 13, wherein said image information generating means (1012)
generates image information at standard resolution by mixing said image information of even-numbered lines and said image information of odd-numbered lines,
generates image information at resolution higher than said standard resolution by using said image information of even-numbered lines and said image information of odd-numbered lines independently of each other, or
generates image information at resolution lower than said standard resolution by using one or other of said image information of even-numbered lines or said image information of odd-numbered lines.
A video information adjusting apparatus according to claim 14, wherein said transmitting means (1004) further transmits out said image information corresponding to said prescribed resolution or said image information corresponding to said prescribed resolution plus information concerning said prescribed imaging condition, and receives information concerning said prescribed imaging condition.
A video information transmitting apparatus (1101) comprising:
image information acquiring means (1011) for separately acquiring image information of even-numbered lines and image information of odd-numbered lines on a field-by-field basis on the basis of a prescribed imaging condition; and
transmitting means (1104) for transmitting out said image information of even-numbered lines and said image information of odd-numbered lines separately.
A video information receiving apparatus (1106) comprising:
transmitting means (1104) for separately receiving image information of even-numbered lines and image information of odd-numbered lines on a field-by-field basis from outside, and for receiving information concerning prescribed resolution from outside; and
transmitting means (1004) for separately transmitting out said image information of even-numbered lines and said image information of odd-numbered lines, and for separately receiving other image information of even-numbered lines and other image information of odd-numbered lines from outside and also receiving information concerning prescribed resolution from outside; and
image information generating means (1012) for generating image information corresponding to said prescribed resolution by using all or part of said other image information of even-numbered lines and said other image information of odd-numbered lines.
A video information adjusting apparatus according to claim 18, wherein said image information generating means (1012)
A video information adjusting apparatus according to claim 19, wherein said transmitting means (1004) further transmits out information concerning said prescribed imaging condition, and receives information concerning said prescribed imaging condition from outside.
input means (502) including illuminance information acquiring means (511) for acquiring at least illuminance information and illuminance information adjusting means (512) for adjusting the illuminance information;
output means (503) for outputting information;
transmitting means (504) for transmitting information; and
terminal control means (505) for controlling and managing said input means (502), output means (503) and transmitting means (504).
a terminal apparatus (701) comprising: input means (702) including illuminance information acquiring means (711) for acquiring at least illuminance information; output means (703) for outputting information; transmitting means (704) for transmitting information; and terminal control means (705) for controlling and managing said input means (702), output means (703) and transmitting means (704); and
a terminal support apparatus (706) comprising: illuminance information adjusting means (712) for adjusting the illuminance information; transmitting means (704) for transmitting information; and terminal control means (707) for controlling and managing said illuminance information adjusting means (712) and said transmitting means (704);
said terminal support apparatus (706) controlling and managing at least said terminal apparatus (701).
A video information adjusting apparatus according to claim 21 or 22, wherein
said input means (502, 702) further includes identifier appending means (513, 713) for obtaining from said illuminance information acquiring means (511, 711) at least two different kinds of illuminance information and information concerning imaging conditions for at least one kind of illuminance information, and for appending said information concerning imaging conditions to said obtained illuminance information, and
the resulting different kinds of illuminance information are each processed as independent illuminance information.
A video information adjusting apparatus according to claim 21, wherein
said illuminance information adjusting means (512) obtains from said illuminance information acquiring means (511) at least two different kinds of illuminance information and information concerning imaging conditions for at least one kind of illuminance information, consolidates at least the two different kinds of illuminance information in accordance with a rule predetermined by a user, and
said input means (502) further includes identifier appending means (513) for appending the information concerning imaging conditions to the consolidated illuminance information.
A video information adjusting apparatus according to claim 21 or 22, wherein said input means (502, 702) further includes resolution information adjusting means (1012) for adjusting image resolution.
A video information adjusting apparatus according to claim 22, wherein said terminal support apparatus (706, 1106) further includes resolution information adjusting means (1310) for adjusting image resolution.
A video information adjusting apparatus according to claim 21 or 25, wherein
said terminal apparatus (501, 1001) further includes working condition managing means (1208) for managing a user's working condition and working condition storing means (1209) for storing and managing information concerning the working condition, and
said working condition managing means (1208) controls at least one of said illuminance information adjusting means (511) and said resolution information adjusting means (1012).
A video information adjusting apparatus according to claim 22 or 26, wherein
said terminal support apparatus (706, 1106) further includes working condition managing means (1308) for managing a user's working condition and working condition storing means (1309) for storing and managing information concerning the working condition, and
said working condition managing means (1308) controls at least one of said illuminance information adjusting means (712) and said resolution information adjusting means (1012).
A video information adjusting apparatus according to claim 27 or 28, wherein
said working condition managing means (1208, 1308) includes
video information managing means (1414) for managing a change in the condition of video information,
audio information managing means (1415) for managing a change in the condition of audio information,
window information managing means (1416) for managing a change in the condition of a window being used to process information by an individual or between individuals,
pointing information managing means (1417) for indicating to said input and output means document information being used by an individual or between individuals, and
working condition control means (1418) for controlling and managing at least one of the video information managing means (1414), audio information managing means (1415), window information managing means (1416) and pointing information managing means (1417).
A video information adjusting apparatus according to claim 29, wherein
said video information managing means (1414) includes all or part of camera operation detecting means (1519) for detecting information concerning a user's camera operation, video scene change detecting means (1520) for detecting a video scene change, and video channel change detecting means (1521) for detecting a video channel change, and
video information management and control means (1522) for managing and controlling the all or part.
A video information adjusting apparatus according to claim 29, wherein said audio information managing means (1415) further includes audio information dividing means (1623) for dividing audio information and audio information management and control means (1624) for controlling said audio information dividing means (1623).
said window information managing means (1416) includes
all or part of window creation/deletion detecting means (1725) for detecting a creation and deletion of a window, window size change detecting means (1726) for detecting a change in window size, window display position change detecting means (1727) for detecting a change in window display position, window focus change detecting means (1728) for detecting a change in window focus, window display area change detecting means (1729) for detecting a change in window display area, and inter-window display change detecting means (1730) for detecting a change in display relations among windows when a plurality of windows are displayed in overlapping fashion, in relation to a window operation performed by an individual or between individuals, and
window information management and control means (1731) for controlling the all or part.
A video information adjusting apparatus according to claim 29, wherein said pointing information managing means (1417) includes pointing information detecting means (1832) for examining a change in the condition of a user's pointing action and pointing information management and control means (1833) for controlling the pointing information detecting means (1832).
A video information adjusting apparatus according to claim 27 or 28, wherein said working condition managing means (1208, 1308) includes video information managing means (2837) for managing a change in the condition of video information and identifying means (2838) for identifying a target object.
A video information adjusting apparatus according to claim 23 or 24, wherein said illuminance information acquiring means (511, 711) includes a solid-state imaging device capable of separately reading charge signals of different accumulation times.
A video information adjusting apparatus according to claim 25 or 26, wherein said input means (1002, 1102) includes a solid-state imaging device capable of handling photodiode signals of even-numbered lines and odd-numbered lines by mixing them together and capable of handing said signals independently of each other without mixing them together.
EP0738073A2 true true EP0738073A2 (en) 1996-10-16
EP0738073A3 true EP0738073A3 (en) 1999-08-25