Source: https://patents.google.com/patent/JP2004343803A/en
Timestamp: 2020-08-05 08:47:18
Document Index: 135987136

Matched Legal Cases: ['art 4', 'art 9', 'art 10', 'art 14', 'art 5', 'art 6', 'art 7', 'art 11', 'art 15']

JP2004343803A - Control method for television camera and control method for image recording apparatus - Google Patents
Control method for television camera and control method for image recording apparatus Download PDF
JP2004343803A
JP2004343803A JP2004222950A JP2004222950A JP2004343803A JP 2004343803 A JP2004343803 A JP 2004343803A JP 2004222950 A JP2004222950 A JP 2004222950A JP 2004222950 A JP2004222950 A JP 2004222950A JP 2004343803 A JP2004343803 A JP 2004343803A
JP2004222950A
JP4205020B2 (en
允美 根岸
2004-07-30 Application filed by Hitachi Kokusai Electric Inc, 株式会社日立国際電気 filed Critical Hitachi Kokusai Electric Inc
2004-07-30 Priority to JP2004222950A priority Critical patent/JP4205020B2/en
2004-12-02 Publication of JP2004343803A publication Critical patent/JP2004343803A/en
2009-01-07 Publication of JP4205020B2 publication Critical patent/JP4205020B2/en
<P>PROBLEM TO BE SOLVED: To solve a problem that a recorded image is occasionally blurred when the motion of an approach object is quick in an input image while the shutter speed of a monitoring television camera is fixed, or the recorded image becomes too dark or white out depending on brightness of the input image while a diaphragm value of the monitoring television camera is fixed. <P>SOLUTION: A moving speed of the approach object is detected by image recognition. Further, a function is provided for recording an image without blurring by controlling the shutter speed of the monitoring television camera while using the information and moreover, a function is provided for recording an image of proper luminance by using image recognition to detect brightness near the detected approach object and using the information to control a diaphragm of the monitoring television camera. <P>COPYRIGHT: (C)2005,JPO&NCIPI
The present invention relates to an apparatus for monitoring the entry of a person by a television camera.
2. Description of the Related Art In a monitoring device such as an intruder, image data captured by a monitoring television camera is generally recorded in a recording device such as a VTR or a hard disk. Thereafter, the operator retrieves and displays required image data from the recorded image data. Such monitoring devices are installed everywhere. For example, there are stores such as banks and convenience stores, construction sites, and off-limits areas such as dams, bases, and airfields. In such places, intruders or intruders make various movements within the screen. In addition, photographing conditions vary in various ways.
Here, when the shutter speed (electronic shutter) of the surveillance television camera is constant, the recorded image may be blurred when the movement of the entering object in the input image is fast. In addition, when the aperture value of the monitoring television is constant, depending on the brightness of the input image, the image may be too dark or white.
In order to solve these problems, the present invention detects the speed of movement of an entering object in a screen by image recognition.
Further, a function is provided in which the shutter speed of the monitoring television camera is controlled using the information so that an image without blurring can be recorded.
Furthermore, a function that can record an image with an appropriate luminance by detecting the brightness near the approaching object detected using image recognition and controlling the aperture of the monitoring television using the information is provided. It was made.
Further, at this time, the edge of the entering object is detected.
The present invention provides a method and apparatus for controlling a television camera by combining these. This television camera is particularly suitable for a surveillance recording device.
Further, in the control method of the TV camera according to the present example, when an object is detected from the input image captured by the TV camera, the moving speed of the object in the screen is recognized, and the moving speed of the recognized object is determined in accordance with the moving speed of the recognized object. To change the shutter speed of the television camera.
In the control method of the television camera according to the present example, an object is detected from an input image captured by the television camera, a moving speed of the detected object in a screen is recognized, and a moving speed of the recognized object is detected. Is larger than a predetermined value, the shutter speed of the television camera is changed according to the moving speed of the object.
Further, in the control method of the television camera according to the present example, an object is detected from the input image captured by the television camera, brightness near the detected object and brightness inside the edge are obtained, and the obtained brightness is obtained. The aperture value of the television is changed based on the brightness near the object and the brightness inside the edge.
Further, in the control method of the television camera according to the present example, an object is detected from an input image captured by the television camera, and when a plurality of the detected objects are present, the object is detected in accordance with a situation of an installation position of the television camera. A priority order is assigned to the plurality of detected objects, brightness near an object having a higher priority is obtained, and an aperture value of the television camera is changed according to the obtained brightness.
In the control method of the television camera according to the present example, an object is detected from an input image captured by the television camera, a moving speed of the detected object in a screen is recognized, and a moving speed of the recognized object is detected. The shutter speed of the television camera is changed in accordance with, and the brightness in the vicinity of the detected object is obtained, and the image is taken by the television camera by changing the aperture value of the TV camera according to the brightness. Optimize the contrast of the input image.
Further, in the control method of the image recording apparatus according to the present embodiment, the object is detected from the input image captured by the television camera, the moving speed of the detected object on the screen is recognized, and the movement of the recognized object is performed. The recording frame rate of the input image to the recording means is changed according to the speed.
By image recognition, an appropriate shutter speed and aperture value can be set on the television side, so that an image can be recorded in an appropriate state. Further, by image recognition, it is possible to change the recording frame rate of the image to the recording means.
A monitoring television camera recording device will be described as an embodiment of the present invention. This monitoring television camera recording device can be shown in a block diagram as shown in FIG. This block diagram will be described.
In FIG. 1, reference numeral 1 denotes a surveillance television camera, which is controlled by the surveillance television control and recording device of the present invention, and is installed in various places such as stores, off-limits areas and the like. Reference numeral 2 denotes a monitor which displays a video or a recorded image from the monitoring television camera 1. Reference numeral 3 denotes a monitoring television control / recording device. Further, the monitoring television control / recording device 3 is composed of blocks 301 to 3090 and a bus connecting these blocks. Reference numeral 301 denotes a control device mainly composed of a CPU, 302 denotes a memory, 303 denotes an image recognition unit, 304 denotes a communication control unit, 305 denotes a video interface, 306 denotes a storage device such as a hard disk, a DVD, or a time-lapse VTR, and 307 denotes a frame buffer. A memory 308 is a monitor, 309 is an input device, and 310 is a bus connecting these blocks to the CPU 301.
Next, each of these blocks will be described. The video interface 305 has an image input interface (not shown) and an image signal output interface (not shown). Each of these interfaces is connected to the monitor 2 via the output terminal 3052, and connected to the monitoring television camera 2 via the input terminal 3051. The video interface 305 converts the moving image sent from the monitoring television camera 1 into a format handled by the monitoring television control / recording device, and sends the format to the control device 301, the image recognition unit 303, and the storage device 306. Further, the video interface 305 outputs signal information output from the storage device 306 or image information from the television camera 1 to the monitor 2.
The image recognition unit 303 detects whether there is an intruding object from the sent moving image, and further detects the brightness and moving speed of the detected object. Based on the speed and brightness, the speed and aperture of the electronic shutter of the monitoring television camera 1 are controlled. These control signals are output to the monitoring television camera 1 via the communication control unit 304. The operation of the image recognition unit 303 will be described later in detail.
The input device 309 includes an operation panel 3091, which has various recording modes and button switches for reproduction control. The storage device 306 stores the date and time when the entering object is detected and the image data. Further, as the storage device 306, a hard disk or a DVD storage device, or a remote file via a network may be used, or a plurality of them may be used instead of one. The video information stored in these storage devices is usually compressed when stored and decompressed when output. These components are controlled by control signals from the control device 301.
Next, this operation will be described in detail. When the recording button 203 on the operation panel 3091 shown in FIG. 4 is pressed, the input video signal from the monitoring television camera 1 is sent to the image recognition unit 303 via the video interface 305, and the detection of the presence or absence of an entering object is started. You. As a method of detecting the approaching object at this time, for example, a known method such as obtaining a difference between a background image and a currently input image can be sufficiently used. In this way, when an intruding object is detected in the course of performing the detection processing, the control device 301 transmits the detected date and time, the image, and information such as a detection start point, a detection intermediate point, and a detection end point. The information is recorded in the storage device 306.
In this way, the operation is continued until the operator ends the recording operation. Normally, recording is performed only when an intruding object is detected as described above. However, if the recording capacity is sufficient, continuous recording may be performed regardless of whether an intruding object is detected. During continuous recording, if a mark such as a "bookmark" is automatically superimposed and recorded on the recording data when an intruding object is detected, it is convenient to search for the intruding object later. By pressing the bookmark button 211 during recording, a “bookmark” can be manually input.
Here, the present invention has a function of detecting the moving speed of the entering object by image recognition and controlling the speed of the electronic shutter of the monitoring television camera 1 according to the detected speed. This is to prevent the recorded image from blurring and becoming difficult to see when the speed of the subject (entering object) is higher than the shutter speed. This is very important as a surveillance camera.
FIG. 5 is a flowchart showing the operation of the control device 301 and the image recognition unit 303. First, a flowchart 4 for inputting an image from a television or a mechanism. When the intruding object is detected by the image recognizing unit 303, the edge of the image is detected 5 here, and the moving amount is calculated by comparing 8 the intruding object edges between consecutive frames. At this time, when the movement amount, that is, the difference between the edge positions is small, the shutter speed is not changed (flow chart 9).
When the difference between the movement amounts of the edges is large, an optimum shutter speed is obtained, and the communication control unit 304 sets the calculated shutter speed for the monitoring television camera 1 as shown in the flowchart 10 and thereafter. Issue a command. Further, the image recognition unit 303 detects the brightness 13 near the detected approaching object, and provides a function of controlling the aperture (not shown) of the monitoring television camera 1 according to the brightness. This is because, by switching the shutter speed, if the subject (entering object) is dark against the aperture value, the subject becomes extremely dark, and in some cases, becomes black, and if it is bright, it becomes pure white. This is in order to prevent the situation (flowchart 14).
Hereinafter, this operation will be specifically described with reference to FIGS. When recording the input image, the moving speed of the intruding object on the screen (even if the actual speed is low, the moving speed on the screen will be faster if it is closer to the surveillance TV camera, and conversely if the actual speed is faster However, the moving speed on the screen becomes slower as the distance from the monitoring television camera increases, so that the image is blurred when the moving speed on the screen is high. Therefore, the moving speed of the entering object on the screen is calculated using the image recognition technique, and the shutter speed of the monitoring television camera is reset to an optimum value according to the moving speed.
As shown in FIG. 2, an input image of 640 × 480 pixels is divided into a plurality of 10 × 10 regions as an example. In the figure, as an example, the image is divided vertically and horizontally into ten parts. It is assumed that an object has entered the field of view of surveillance television camera 1 at time n + 1 (image 22) with respect to image 21 at time n. At this time, the approaching object (for example, the edge of the approaching object) is detected, for example, as the edge 241 of the block group in the shaded area of the image 22 (flowchart 5 in FIG. 5). n + 1 is the detection start time. Next, at time n + 2 (image 23), an edge 242 of the approaching object as shown in the figure is detected. Here, assuming that the entering object moves from right to left from the installation location of the monitoring television camera 1, the speed of the entering object on the screen is, for example, the left side where the edge 242 at the time of n + 2 is detected, and the speed of n + 1. It can be calculated by finding the difference between the time and the edge 242 (flowchart 6 in FIG. 5).
If the current shutter speed is inappropriate for the speed thus obtained (flowchart 7 in FIG. 5), the monitor TV camera 1 is instructed to set an appropriate electronic shutter speed. The shutter speed at this time can be determined, for example, by setting a relationship between the moving speed on the screen and the shutter speed in advance, creating a table, and referring to this table (flow chart 11).
In order to prevent a malfunction, if the number of detected edge blocks is small (for example, two or three blocks), a process is provided to exclude the detected edge from the calculation.
Next, a case where two objects having different moving speeds are present in the imaging range of the monitoring television camera will be described. For example, as shown in FIG. 3, when the right side of the image is the entrance of the store and the left side is the depth of the store (dead end), the speed is adjusted to the speed of the moving object 252 in the area closer to the entrance. This is because the object 251 has already been detected in the right area, and it is desirable to set a shutter speed according to the moving speed of the object 252. In this way, the detected objects are prioritized according to the situation of the installation position of the monitoring television camera 1, and the imaging conditions of the television camera are adjusted to the priorities.
Next, aperture control of the television camera 1 will be described. When an approaching object is detected by image recognition, the luminance of pixels around the approaching object is obtained, and the aperture value is adjusted accordingly. This is because when the background is bright, the aperture is narrowed, and the entering object becomes dark.On the other hand, when the background is dark, the aperture is opened, and the entering object becomes pure white, making it difficult to discriminate both. This is to prevent that. In this case, similarly, a function for obtaining an appropriate aperture value and controlling the monitoring television is provided. Further, as described above, the edge of the approaching object may be obtained, and the aperture may be controlled in accordance with the brightness within the edge. Here, generally, there is a correlation between the shutter speed of the monitoring television and the aperture. Therefore, an optimal value can be obtained by providing an aperture priority mode and a shutter speed priority mode. Changing the shutter speed can cause extreme contrast in the image. In such a case, the shutter speed and the aperture are optimally adjusted according to the image quality (flow chart 15).
In the above description, the shutter speed and the aperture of the monitoring television camera are simply changed, but the recording frame rate of the image recording unit 303 may be changed according to the moving speed. That is, the recording rate is increased when the moving speed of the approaching object becomes equal to or higher than the predetermined value. Normally, the monitoring apparatus records at a reduced frame rate in order to record an image for a long time. Therefore, for example, the image recording unit 303 may be controlled so as to increase the frame rate when the speed of the moving object increases.
In the embodiment described above, one monitoring television camera is used, but a plurality of monitoring television cameras may be used. In this case, an identification code unique to each television camera is superimposed on the video signal of each camera.
Further, it goes without saying that the present invention can be used not only as a monitoring device but also as a television camera having no recording device.
FIG. 1 is a configuration diagram of an embodiment of the present invention. FIG. 3 is an explanatory diagram of one embodiment of the present invention. FIG. 3 is an explanatory diagram of one embodiment of the present invention. FIG. 3 is an explanatory diagram of one embodiment of the present invention. 4 is a flowchart of an embodiment of the present invention.
1: TV camera, 2: Monitor, 3: TV camera control recording device for monitoring, 301: CPU, 302: Memory, 303: Image recognition unit, 304: Communication control unit, 305: Video interface, 306: Storage device, 307 : Frame buffer, 308: monitor.
When detecting an object from the input image captured by the TV camera, recognize the moving speed of the object in the screen,
A method for controlling a television camera, comprising changing a shutter speed of the television camera according to the moving speed of the recognized object.
Detect an object from the input image captured by the TV camera,
Recognize the moving speed of the detected object in the screen,
When the moving speed of the recognized object is higher than a predetermined value, the shutter speed of the TV camera is changed according to the moving speed of the object.
Find the brightness near the detected object and the brightness inside the edge,
A method for controlling a television camera, wherein the aperture value of the television is changed based on the obtained brightness near the object and brightness inside an edge.
When there are a plurality of the detected objects, prioritize the plurality of detected objects according to the situation of the installation position of the TV camera,
Find the brightness near the high priority object,
A method for controlling a television camera, wherein the aperture value of the television camera is changed according to the obtained brightness.
While changing the shutter speed of the TV camera according to the moving speed of the recognized object,
Find the brightness near the detected object,
A method for controlling a television camera, wherein the contrast of an input image captured by the television camera is optimized by changing an aperture value of the television camera according to the brightness.
A method for controlling an image recording apparatus, comprising: changing a recording frame rate of the input image to a recording unit in accordance with the recognized moving speed of the object.
JP2004222950A 2004-07-30 2004-07-30 Television camera control method and image recording apparatus control method Expired - Fee Related JP4205020B2 (en)
JP2004222950A JP4205020B2 (en) 2004-07-30 2004-07-30 Television camera control method and image recording apparatus control method
JP11047774 Division
JP2004343803A true JP2004343803A (en) 2004-12-02
JP4205020B2 JP4205020B2 (en) 2009-01-07
ID=33535955
JP2004222950A Expired - Fee Related JP4205020B2 (en) 2004-07-30 2004-07-30 Television camera control method and image recording apparatus control method
JP (1) JP4205020B2 (en)
JP2008016935A (en) * 2006-07-03 2008-01-24 Sanyo Electric Co Ltd Surveillance camera
JP2009049480A (en) * 2007-08-13 2009-03-05 Mitsubishi Electric Corp Image pickup device and image processing method
WO2010116400A1 (en) * 2009-03-30 2010-10-14 富士通株式会社 Object movement detection device and method
2004-07-30 JP JP2004222950A patent/JP4205020B2/en not_active Expired - Fee Related
JP5177284B2 (en) * 2009-03-30 2013-04-03 富士通株式会社 Subject motion detection apparatus and method
US8644555B2 (en) 2009-03-30 2014-02-04 Fujitsu Limited Device and method for detecting movement of object
JP4205020B2 (en) 2009-01-07
KR100470931B1 (en) 2005-02-22 Object tracking method and apparatus using template matching
KR100432870B1 (en) 2004-05-22 Intruding object monitoring method and intruding object monitoring system
JP5848507B2 (en) 2016-01-27 Image capturing apparatus and method with tracking function