Source: https://patents.google.com/patent/JP5109697B2/en
Timestamp: 2019-10-21 18:31:01
Document Index: 94571138

Matched Legal Cases: ['art, 11', 'art, 12', 'art, 13', 'art, 14', 'art, 20', 'art, 23', 'art, 24', 'art, 131', 'art, 133']

JP5109697B2 - Image transmission device, image reception device, image transmission / reception system, image transmission program, and image reception program - Google Patents
Image transmission device, image reception device, image transmission / reception system, image transmission program, and image reception program Download PDF
JP5109697B2
JP5109697B2 JP2008027366A JP2008027366A JP5109697B2 JP 5109697 B2 JP5109697 B2 JP 5109697B2 JP 2008027366 A JP2008027366 A JP 2008027366A JP 2008027366 A JP2008027366 A JP 2008027366A JP 5109697 B2 JP5109697 B2 JP 5109697B2
JP2008027366A
JP2009188792A (en
2008-02-07 Application filed by ソニー株式会社 filed Critical ソニー株式会社
2008-02-07 Priority to JP2008027366A priority Critical patent/JP5109697B2/en
2009-08-20 Publication of JP2009188792A publication Critical patent/JP2009188792A/en
2012-12-26 Publication of JP5109697B2 publication Critical patent/JP5109697B2/en
The present invention receives an image of a region of interest and an image of a region other than that transmitted from the image transmission device and an image transmission device that perform different processing by determining an image as a region of interest and a region other than that, and transmits the image. In particular, the present invention relates to an image receiving apparatus, an image transmitting apparatus including the image transmitting apparatus and the image receiving apparatus, an image transmitting program, and an image receiving program.
In the surveillance camera system, an IP (Internet Protocol) camera system using network transmission has come to be used instead of the analog camera system that has been conventionally used. The use of IP has enabled remote monitoring and construction of large-scale systems. However, as the system size increases, transmission capacity (bandwidth) increases and recording (storage) capacity increases. Has become a major issue (see Patent Documents 1 to 3).
FIG. 10 shows a block diagram of a conventional surveillance camera (IP output method). An image captured by the CCD or CMOS sensor via the lens L passes through the signal processing unit 51 and becomes digital image data. This image data is sent to a compression device (Codec) 53, and the compressed result is distributed to the network as image data. In FIG. 10, as a technique for detecting an important area, an important area is extracted by a block written as Intelligence 52. An example of this technique is motion detection. Normally, as shown in FIG. 10, an image is compressed by a compression device (Codec) 53, and at the same time, the image is detected through an intelligence process such as motion detection, for example, an intruder is detected and an alarm is issued, or the area is meta-coded. Output as data.
In particular, recently, it has become possible to shoot at a high resolution using a high-pixel CCD / CMOS image sensor and not depending on the television format used in a conventional analog surveillance camera. By photographing an object with high resolution, it is possible to set a wider monitoring area than before and to confirm an object in more detail. However, as the image resolution increases, the amount of information increases in proportion to it, so that more transmission capacity and storage capacity are required, which is a burden on system construction.
Therefore, when shooting at high resolution, it is necessary to reduce the amount of data from the viewpoint of reducing the burden caused by the increase in the amount of information as much as possible. For example, as a method for reducing the amount of image data, there are conventionally a method for increasing the compression rate of image compression (codec) to reduce the amount of data and a method for reducing an image.
JP 2006-145944 A JP 2007-108447 A JP-A-11-252428
However, the method of reducing the amount of data by increasing the compression rate of the image compression cannot fully take advantage of the high-resolution image, resulting in degradation of image quality.
In general, even when shooting at high resolution, for example, if you want to monitor a wide range, you can see unnecessary areas at the same time in addition to the area you want to monitor at the same time, or even if you want to see higher resolution than before, so much resolution at the same time An area that does not need to appear may appear at a high resolution.
In particular, when shooting with a wide field of view, there are often few important regions in the monitoring image with respect to the entire image. For example, when monitoring an intruder, only the intruder needs to be able to see or record at a high resolution, and it is not necessary to be able to confirm in detail an area or background that does not change. In other words, even if the resolution of the image sensor is increased, only the important area is maintained, and the other areas (for example, the background area) can be transmitted and recorded at a reduced resolution. -There are many advantages that lead to a reduction in recording capacity.
As a method of changing the resolution for each region, there is a method in which a low-pass filter is applied to an unimportant region with respect to a high-resolution image, and a low-pass filter is transmitted to an important region without applying the low-pass filter. In this case, since the high-frequency component is reduced by the compression device (codec) in the region to which the low-pass filter is applied, the compression rate increases, resulting in a reduction in the amount of data. However, since the resolution of the image is the original resolution, the amount of data is not greatly reduced.
Therefore, an object of the present invention is to provide a technique capable of improving the resolution for an important region while reducing the image transmission / storage capacity.
The present invention provides a region detection unit that detects a region of interest that matches a preset condition from an image, and a low pass for an image that is not a region of interest detected by the region detection unit when performing processing for reducing the resolution of the image. Select an image that has passed through a filter, and select a resolution conversion unit that selects an image that does not pass through a low-pass filter for the image of the region of interest, and an image whose resolution has been reduced by the resolution conversion unit and position information of the region of interest An image transmission apparatus including a transmission unit.
In the present invention, the resolution of the image is reduced to reduce the transmission / storage capacity, and the attention area in the image is transmitted without the low-pass filter without the low-pass filter. Since the reduced resolution is transmitted through the low-pass filter, the high-resolution conversion on the receiving side is enabled for the region of interest by an image that does not pass through the low-pass filter.
Further, the present invention provides an area detection unit that detects a region of interest that matches a preset condition from an image, and an image of the region of interest detected by the region detection unit when performing a process of reducing the resolution of the image. An image transmission apparatus comprising: a resolution conversion unit that performs processing by switching characteristics of a low-pass filter with an image that is not a region of interest; and a transmission unit that transmits an image whose resolution has been reduced by the resolution conversion unit and position information of the region of interest to a transmission destination It is.
In the present invention, the characteristics of the low-pass filter are switched between the attention area and the other area in the image while reducing the transmission / storage capacity by reducing the resolution of the image. It is possible to reduce the amount of data and transmit an image that enables high resolution conversion on the receiving side for the attention area.
In addition, the present invention provides a receiving unit that receives an image sent from an image transmission device and position information of a region of interest, and a high resolution for a region of interest obtained from position information among images received by the receiving unit. An image receiving apparatus includes a resolution restoration unit that performs image quality improvement processing, and a synthesis unit that synthesizes an image of a region of interest processed by the resolution restoration unit and an image that is not a region of interest.
In the present invention, the image sent from the image transmission apparatus and the position information of the attention area can be used, and the attention area can be subjected to the image quality enhancement processing for increasing the resolution. It becomes possible to perform processing by quantity.
In the image transmission / reception system for transmitting an image from the image transmission apparatus to the image reception apparatus, the present invention provides an area detection unit for detecting an attention area that matches a preset condition from the image, In performing the process of reducing the resolution of the image, a resolution that selects an image that has not passed through the low-pass filter for an image that is not the attention area detected by the area detection unit and that does not pass through the low-pass filter for an image in the attention area. A conversion unit; and a transmission unit configured to transmit the image whose resolution is reduced by the resolution conversion unit and the position information of the attention area to the transmission destination, and the image receiving apparatus receives the image sent from the image transmission apparatus and the position of the attention area. Receiving means for receiving information, enlarging means for enlarging an image received by the receiving means, and position information of images received by the receiving means A resolution restoration unit that performs high-quality processing for increasing the resolution of the obtained attention area, and a synthesis unit that combines the image of the attention area processed by the resolution restoration unit and the image enlarged by the enlargement unit. .
In the present invention, the image transmission device transmits the reduced resolution of the attention area in the image without using the low-pass filter while reducing the transmission / storage capacity by reducing the resolution of the image. Since the resolution-reduced image is transmitted via the low-pass filter for the region other than the region of interest, the image receiving apparatus can perform the image quality enhancement process on the image of the region of interest without using the low-pass filter.
In the image transmission / reception system for transmitting an image from the image transmission apparatus to the image reception apparatus, the present invention provides an area detection unit for detecting an attention area that matches a preset condition from the image, In the process of reducing the resolution of the image, the resolution conversion means that performs processing by switching the characteristics of the low-pass filter between the image of the attention area detected by the area detection means and the image that is not the attention area, and the resolution conversion means reduces the resolution. A receiving means for receiving the image and the position information of the attention area received from the image transmission apparatus, and a receiving means. Magnifying means for enlarging the image received in step 1, and image quality enhancement processing for increasing the resolution of the attention area obtained from the position information among the images received by the receiving means And resolution recovery means for performing, in which and a synthesizing means for synthesizing the magnified image by the image enlargement unit processing region of interest in the resolution restoring unit.
In the present invention, the image transmission apparatus switches the characteristics of the low-pass filter for the attention area and other areas in the image while reducing the transmission / storage capacity by reducing the resolution of the image. The amount of data can be reduced for areas other than the attention area, and the image quality can be improved by the image receiving apparatus for the attention area.
In the present invention, when performing a step of detecting a region of interest that matches a preset condition from the image and a process of reducing the resolution of the image, an image that is not the detected region of interest is passed through a low-pass filter. An image transmission program for selecting an image and selecting an image that does not pass through a low-pass filter for the image of the region of interest and a step of transmitting the image with reduced resolution and the position information of the region of interest to a transmission destination by a computer It is.
The present invention also includes a step of detecting a region of interest that matches a preset condition from images, and a process of reducing the resolution of the image. The image transmission program causes the computer to execute the process of switching the characteristics of the low-pass filter and the step of transmitting the image with reduced resolution and the position information of the region of interest to the transmission destination.
The present invention also includes a step of receiving an image sent from an image transmission device and position information of a region of interest, and an image quality enhancement process for increasing the resolution of the region of interest obtained from the position information in the received image. And an image receiving program that causes a computer to execute a step of synthesizing an image of a region of interest subjected to image quality enhancement processing and an image of a region not of interest.
According to the present invention, since important areas can be restored to high image quality while reducing the image transmission / storage capacity, it is possible to perform accurate monitoring work by reducing the network load of data transmission and improving the resolution for the important areas. It becomes.
<Image transmission / reception system>
FIG. 1 is a schematic diagram illustrating the configuration of an image transmission / reception system. The image transmission / reception system has a configuration in which an image transmission side device and a reception side device are connected via a network N. The transmission side device includes a camera C and a protocol conversion device 1, a camera C1 with a transmission function, and a transmission function. Examples of the attached computer PC1 and the receiving side device include a recorder / viewer 2 and a computer PC2 with a receiving function.
Here, the image transmission apparatus of the present embodiment is provided as a hardware configuration in the transmission side device. In addition, the image transmission program of this embodiment may be implemented as a software configuration in the transmission side device. The receiving device is provided with the image receiving apparatus of this embodiment as a hardware configuration. In addition, the receiving device may be implemented as the image receiving program software configuration of the present embodiment.
The protocol conversion device 1 that is one of the transmission side devices converts an image (including a still image and a moving image) captured by the camera C into a data format that conforms to the data transfer protocol in the network N, and performs transmission. is there. As the camera C connected to the protocol conversion device 1, general-purpose cameras such as RGB output, composite output, and USB connection can be applied.
The camera C1 with a transmission function is a so-called IP camera (Internet camera) having a function of outputting image data corresponding to the network N protocol, and can be used by directly connecting to a network router or a hub.
The computer PC1 with a transmission function is a general personal computer, and can be connected to a network N while being able to connect a general-purpose camera C. When the image transmission apparatus according to the present embodiment is configured as hardware, it is mounted as an expansion board of a computer, for example. When the image transmission program according to the present embodiment is implemented as software, the image transmission program according to the present embodiment installed in a storage device of a computer is executed by the CPU.
Note that the computer PC1 with a transmission function may have a configuration in which the image transmission apparatus and the image transmission program of the present embodiment are mounted as a dedicated computer, in addition to the case where a general personal computer is applied.
The recorder / viewer 2 which is one of the receiving side devices includes means for recording an image transmitted from the transmitting side device via the network N, and means for reproducing the recorded image or the transmitted image. It is a thing. A monitor M is connected to the recorder / viewer 2, and a recorded past image and a current image transmitted from the transmission side device can be selected and displayed by a user operation.
The computer PC2 with a reception function is a general personal computer, and includes a monitor that can display an image and can be connected to the network N. When the image receiving apparatus of the present embodiment is configured as hardware, for example, it is mounted as an expansion board of a computer. Further, when the image receiving program of the present embodiment is implemented as software, the image receiving program of the present embodiment installed in the storage device of the computer is executed by the CPU.
Note that the computer PC1 with a receiving function may have a configuration in which the image receiving apparatus and the image receiving program of the present embodiment are mounted as a dedicated computer, in addition to the case of applying a general personal computer.
<Image transmission device>
FIG. 2 is a block diagram illustrating the configuration of the image transmission apparatus according to the present embodiment. The image transmission apparatus of the present embodiment is configured to include at least a region detection unit 12, a resolution conversion unit 13, and a transmission unit 15.
The area detection unit 12 receives an image from the image input unit 10 via the image processing unit 11. Here, the image input unit 10 corresponds to the imaging device in the camera C1 illustrated in FIG. 1 or the camera C1 with a transmission function. In addition to inputting an image captured by the camera, the image input unit 10 may also be configured to input an image captured via the network N. The signal processing unit 11 performs predetermined image processing such as noise removal processing on the image input by the image input unit 10, and is incorporated in the camera C1 or the camera C1 with a transmission function shown in FIG. In some cases, the converter 1 is incorporated.
The region detection unit 12 performs a process of detecting a region of interest that matches a preset condition. FIG. 3 is a schematic diagram illustrating a case where moving object detection is performed as an example of detection of a region of interest. In the moving object detection, it is detected whether there is a region in which the pixel value has changed by a certain amount or more in the input image. The condition for detecting the moving object can be set in advance by the user. In the example illustrated in FIG. 3, the background portion of the video image displayed in the input image has no motion (pixel value change), and a human video image is detected as a moving object.
When a moving object is detected, a rectangular area including an image detected as a moving object is output as the attention area R. The attention area R is written in the metadata as a coordinate value in the image. The attention area R may be obtained in units of pixels, but may be switched to units of macroblocks for every 8 pixels, for example, due to the characteristics of the later codec.
The attention area R detected by the area detection unit 12 is output to the resolution conversion unit 13 and the transmission unit 15 as metadata. The resolution conversion unit 13 is a part that reduces the resolution of input image data and performs image reduction processing. At this time, details of the resolution conversion unit 13 that distinguishes between a region to be subjected to the low-pass filter and a region to be not applied based on the metadata of the attention region R detected by the region detection unit 12 will be described later.
The image reduced by the resolution conversion unit 13 is compressed and encoded by the codec 14 and output to the network N via the transmission unit 15. The transmission unit 15 outputs the image data compressed and encoded by the codec 14, the metadata detected by the region detection unit 12, and an alarm (warning) as necessary to the network N.
<Resolution converter>
FIG. 4 is a block diagram illustrating the configuration of the resolution conversion unit. The resolution conversion unit 13 includes a low-pass filter 131, a reduction unit 132, and a selection unit 133. The low-pass filter 131 is a circuit that removes a specific high-frequency component from the image data to reduce the data amount. Various filters are used as the low-pass filter 131. For example, an averaging filter of N pixels × N pixels (for example, 3 × 3) may be used. The image data input to the resolution conversion unit 13 is divided into data that passes through the low-pass filter 131 and data that does not pass through, and is input to the reduction unit 132.
The reduction unit 132 reduces the image of the image data. The reduction unit 132 performs a process of reducing the image data by thinning out pixels. For example, a process of reducing pixels to 1/2 as a reduction size is performed.
The image data reduced by the reduction unit 132 via the low pass filter 131 and the image data reduced by the reduction unit 132 without passing through the low pass filter 131 are sent to the selection unit 133. In the selection unit 133, the image data is reduced without passing through the reduced image data via the low-pass filter 131 based on the metadata (detection result of the attention region: coordinate data) output from the region detection unit 12 (see FIG. 2). Select image data. That is, when the image data is in the attention area, the reduced image data is selected without passing through the low-pass filter 131, and when the image data is not within the attention area, the image data is reduced through the low-pass filter 131. Select.
The pixel unit for selecting the image data that passes through the low-pass filter 131 and the image data that does not pass through may be switched in units of macroblocks of the codec 14 (see FIG. 2) as described above. For example, when the macroblock is 8 × 8 and the reduction size is ½, the original resolution is switched in units of 16 pixels.
<Image receiving device>
FIG. 5 is a block diagram illustrating the configuration of the image receiving apparatus according to the present embodiment. The image receiving apparatus of this embodiment is configured to include at least a receiving unit 20, a resolution restoring unit 23, and a combining unit 25.
The receiving unit 20 is a part that receives image data and metadata sent from the image transmitting apparatus described above. In this configuration, data in a format corresponding to the communication protocol of the network N (see FIG. 1) can be received.
The image data received by the receiving unit 20 is decoded (decoded) by the decoder 21. At this time, the size of the image data is ½ if it is reduced to ½ by the image transmission apparatus. The decoded image data is enlarged by the enlargement unit 22. For example, in the image data decoded in 1/2 size, the vertical and horizontal pixels are doubled to return to the original size. In this enlargement processing, a smooth image can be obtained by interpolation processing such as linear interpolation, but the resolution is deteriorated compared to the original captured image.
In the present embodiment, using the coordinate information indicating the region of interest extracted from the metadata received by the receiving unit 20, the resolution of the region of interest is restored by the resolution restoring unit 23. That is, the resolution restoration unit 23 uses the metadata together with the decoded image data, and restores only the portion of the attention area in the image data to a resolution close to the original resolution. Since the image data of the attention area is image data that does not pass through the low-pass filter 131 (see FIG. 4) in the resolution conversion unit 13 (see FIG. 2) of the image transmission apparatus, the specific high-frequency component remains. Yes. By using this, it is possible to restore to a resolution close to the original.
The image data of the attention area restored to the resolution close to the original by the resolution restoration unit 23 is temporarily stored in the memory 24. Then, it is sent together with the image data enlarged by the enlargement unit 22 to the synthesis unit 25, where it is synthesized. As a result, high-resolution image data can be output only in the region of interest, and can be displayed on the monitor.
Here, as one of resolution restoration processes for restoring a high-resolution image from a low-resolution image, there is known a technique for increasing the resolution by superimposing a plurality of time-series images in units of subpixels (for example, “ (See Shin Aoki, “Super-Resolution Processing Using Multiple Digital Image Data”, Ricoh Technical Report, November 1999, No. 24, p. 19-25)
1. From the plurality of image data itself, the deviation of the sampling position at the time of photographing each image data is estimated. At this time, it is necessary that the photographing position or the object is shifted in time series.
2. Each image data is densified using a wide-band low-pass filter that transmits all high-frequency components of the original signal including the aliasing components. At this time, folding distortion is required. If possible, the optical low-pass filter is removed.
3. By taking a weighted sum using a weight corresponding to the sampling position of each densified data, the aliasing distortion is canceled and at the same time the high frequency component of the original signal is restored.
In the case where the image transmission / reception system is used as a surveillance camera, an important region is generally a different change region such as an intruder / intruder such as a person or a car. Since the surveillance camera is generally fixed, the resolution cannot be increased by the super-resolution processing described above. However, areas that are important for surveillance cameras are intruders such as people and cars, and areas that are different from normal, and because they move and move, they are indispensable conditions for the above super-resolution processing. This satisfies the condition that the object must be shifted in time series.
Also, regarding the second requirement in super-resolution processing, “folding distortion is necessary. If possible, remove the optical low-pass filter”, the image is usually reduced using a low-pass filter when reducing the image. However, aliasing distortion can be generated if the image is reduced without using a low-pass filter. In other words, a high-resolution image is attached with an optical low-pass filter and a normal image is captured (this image cannot be increased in resolution). (If the moving body is photographed), the resolution can be increased and the original resolution image can be restored.
Although it is possible to reduce the entire area of the original resolution image without using a low-pass filter, the high-frequency component remains and the compression rate deteriorates. Since high resolution cannot be achieved without satisfying the eye requirements, data reduction is achieved by applying a low-pass filter to the background area to reduce high frequency components.
In this embodiment, in view of these situations, when capturing and transmitting using a high-resolution image sensor, the transmitted image size is transmitted with a lower resolution than the original image, but when reducing the resolution, Distinguish between important areas (notable areas) and non-critical areas, leaving the possibility that the important areas can be restored to high resolution on the playback side by reducing the resolution without going through the low-pass filter when reducing the resolution, In an unimportant area, a smooth image with a small amount of data can be reproduced by lowering the resolution through a low-pass filter. As a result, the resolution can be improved with respect to an important region with respect to the resolution improvement when the high resolution image sensor is used while reducing the transmission / storage capacity.
<Image transmission program>
FIG. 6 is a flowchart illustrating an image transmission program according to the present embodiment. The image transmission program is executed by the protocol converter 1, the camera C1 with a transmission function, and the computer PC1 with a transmission function shown in FIG. 1, and is installed in a storage unit inside the apparatus, stored in a ROM, It is stored in a recording medium or distributed via a network.
First, image data is input (step S101). The image data is input by the image input unit 10 shown in FIG. The input image data is signal-processed by the signal processing unit 11 as necessary.
Next, attention area detection processing is performed (step S102). The attention area detection process is performed by the area detection unit 12 shown in FIG. As a result, an area that matches a preset condition is detected as the attention area R (see FIG. 3) from the image data.
Next, resolution conversion processing (reduction processing) is performed (step S103). The resolution conversion process (reduction process) is performed by the resolution conversion unit 13 shown in FIG. The resolution conversion process is performed by a subroutine shown in FIG. First, it is determined whether or not the image data is an attention area that matches a preset condition (step S1031). If the region is the region of interest, the image data reduced by the reduction unit 13 is selected without passing through the low-pass filter 131 shown in FIG. 4 (step S1032). On the other hand, if it is not the attention area, the reduced image data through the low-pass filter 131 shown in FIG. 4 is selected (step S1033). Then, the selected image data is output (step S1034).
Next, returning to the flowchart of FIG. 6, the image data output from the resolution converter 13 is compression-encoded (step S104). The compression encoding is performed by the codec 14 shown in FIG. Then, the compressed image data is transmitted to the transmission destination via the network N (step S105). The transmission is performed by the transmission unit 15 shown in FIG. At this time, metadata including the position information of the region of interest R together with the image data and an alarm as necessary are also transmitted.
<Image reception program>
FIG. 8 is a flowchart illustrating an image reception program according to the present embodiment. The image transmission program is executed by the recorder / viewer 2 and the computer PC2 with a reception function shown in FIG. 1, and is installed in a storage means inside the apparatus, stored in a ROM, or stored in a recording medium. Or distributed over a network.
First, image data and metadata are received (step S201). The image data and metadata are received by the receiving unit 20 shown in FIG. Of the received data, the image data is decoded (step S202). Decoding processing is performed by the decoder 21 shown in FIG.
Next, resolution conversion (enlargement processing) of the decoded image data is performed (step S203). Resolution conversion (enlargement processing) is performed by the enlargement unit 22 shown in FIG. All of the decoded image data is enlarged and returned to the original size.
In addition, the resolution restoration processing of the image data decoded by the resolution conversion (enlargement processing) is performed (step S204). The resolution restoration process is performed by the resolution restoration unit 23 shown in FIG. In this process, using the coordinate information of the attention area included in the metadata, the resolution restoration process is executed on the image data of the attention area of the image data. The image data of the attention area is not passed through the low-pass filter when being reduced by the image transmission apparatus, and a specific high-frequency component remains. Therefore, it is possible to perform restoration to a resolution close to the original using image data including the high-frequency component. This resolution restoration process will be described later.
The image data of the attention area subjected to the resolution restoration process is stored in the memory. Thereafter, a process of combining the image data subjected to resolution conversion (enlargement process) and the image data of the attention area stored in the memory is performed (step S206). The combining process is performed by the combining unit 25 shown in FIG. At this time, resolution conversion (enlargement processing) is performed on all of the image data, and the image data after the resolution restoration processing stored in the memory for the portion of the region of interest obtained from the metadata among the image data after enlargement is obtained. Overwrite. And the process which displays the image data after a synthesis | combination is performed (step S207). The display is performed on the monitor M connected to the recorder / viewer 2 shown in FIG. 1 or the monitor of the computer PC2 with a reception function.
<Resolution restoration process>
FIG. 9 is a flowchart for explaining the resolution restoration processing. Here, an area (moving object area) in which a moving object is detected is used as the attention area. Since the moving object area is moving, the restoration process is performed by confirming whether or not the moved moving object area is the same as the previous moving object area.
Therefore, it is first confirmed whether there is a moving object detection result from the metadata (step S2041). If there is no moving object detection result, the image in the memory is cleared and returned to the initial state (step S2042), and the image is not output or is output as it is (step S2043).
On the other hand, if there is a moving object detection result, the correlation between the past metadata area in the memory and the new metadata area is obtained (step S2024). That is, it is determined whether it is the same as the previous moving object detection area. This determination can be easily made by comparing the size of the moving object region and comparing the image data (sum of absolute differences).
If it is determined that it is the same as the past moving object region (step S2045), the image of the metadata region is stored in the memory (step S2046), and the resolution restoration process (step S2047) is executed. On the other hand, when it is determined that it is not the same as the past moving object region, the resolution restoration process is not performed and the enlarged image is output.
As the internal configuration of the resolution conversion unit 13 shown in FIG. 4, the selection unit 133 passes the low-pass filter 131 and reduces the image data by the reduction unit 132 and the image reduced by the reduction unit 132 without passing through the low-pass filter 131 Although an example of selecting data is shown, a configuration in which low-pass filters having different characteristics with respect to image data through both paths may be used.
That is, in the resolution conversion unit 13, two low-pass filters having different characteristics are provided, one being a first characteristic for the purpose of reducing the amount of data and the other being a second characteristic that enables resolution restoration processing. . The selection unit 133 selects the image data compressed through the low-pass filter having the second characteristic for the image data of the attention area, and passes the low-pass filter having the first characteristic for the image data that is not the attention area. Switch to select compressed image data. This makes it possible to perform image transmission / reception that achieves both a reduction in the amount of data and a higher resolution in the region of interest.
It is a schematic diagram explaining the structure of an image transmission / reception system. It is a block diagram explaining the structure of the image transmission apparatus of this embodiment. It is a schematic diagram explaining the case where a moving body detection is performed as an example of detection of an attention area. It is a block diagram explaining the structure of a resolution conversion part. It is a block diagram explaining the structure of the image receiver of this embodiment. It is a flowchart explaining the image transmission program which concerns on this embodiment. It is a flowchart explaining the subroutine of the resolution conversion process. It is a flowchart explaining the image reception program which concerns on this embodiment. It is a flowchart explaining a resolution restoration process. It is a block diagram explaining the structure of the conventional surveillance camera.
DESCRIPTION OF SYMBOLS 1 ... Protocol conversion apparatus, 2 ... Recorder / viewer, 10 ... Image input part, 11 ... Signal processing part, 12 ... Area | region detection part, 13 ... Resolution conversion part, 14 ... Codec, 15 ... Transmission part, 20 ... Reception part, DESCRIPTION OF SYMBOLS 21 ... Decoder, 22 ... Enlargement part, 23 ... Resolution restoration part, 24 ... Memory, 25 ... Synthesis | combination part, 131 ... Low pass filter, 132 ... Reduction part, 133 ... Selection part, C ... Camera, C1 ... Camera with a transmission function, M ... monitor, N ... network, PC1 ... computer with transmission function, PC2 ... computer with reception function
An area detection unit for detecting an attention area including a moving object that matches a condition set in advance by a user from an image;
The image of the region of interest detected by the region detection unit is not subject to resolution conversion by a low-pass filter, and the resolution conversion unit reduces the resolution using a low-pass filter for an image that is not the region of interest ;
An image transmission apparatus comprising: an image whose resolution has been reduced by the resolution conversion unit; and a transmission unit that transmits position information of the region of interest to a transmission destination.
And resolution converting means for lowering the resolution of the image by switching the characteristic of the low-pass filter in the image is not the image and the target region of the target area detected in the previous SL region detecting means,
In an image transmission / reception system for transmitting an image from an image transmission device to an image reception device,
A transmission unit that transmits an image whose resolution has been reduced by the resolution conversion unit and position information of the region of interest to a transmission destination;
The image receiving device includes:
Receiving means for receiving an image sent from the image transmitting device and position information of a region of interest;
Enlarging means for enlarging the image received by the receiving means;
Resolution restoration means for performing high image quality processing for increasing the resolution of the attention area obtained from the position information among the images received by the reception means;
An image transmitting / receiving system comprising: a combining unit that combines the image of the region of interest processed by the resolution restoring unit and the image enlarged by the enlarging unit.
Detecting an attention area including a moving object that matches a condition set in advance by the user from the image;
The image of the region of interest is not subjected to resolution conversion by a low-pass filter, and the image that is not the region of interest is reduced in resolution using a low-pass filter ;
An image transmission program that causes a computer to execute the step of transmitting the image with reduced resolution and the position information of the region of interest to a transmission destination.
A step of switching the characteristics of the low-pass filter reduces the resolution of an image in the image and the image of test the region of interest out not the region of interest,
The image of the region of interest is not subjected to resolution conversion by a low-pass filter, and the image that is not the region of interest is reduced in resolution using a low-pass filter;
Transmitting the resolution-reduced image and the position information of the attention area to a transmission destination;
An image transmission method comprising:
Reducing the resolution of the image by switching the characteristics of the low-pass filter between the detected image of the attention area and the image that is not the attention area;
JP2008027366A 2008-02-07 2008-02-07 Image transmission device, image reception device, image transmission / reception system, image transmission program, and image reception program Active JP5109697B2 (en)
JP2008027366A JP5109697B2 (en) 2008-02-07 2008-02-07 Image transmission device, image reception device, image transmission / reception system, image transmission program, and image reception program
US12/367,063 US8315481B2 (en) 2008-02-07 2009-02-06 Image transmitting apparatus, image receiving apparatus, image transmitting and receiving system, recording medium recording image transmitting program, and recording medium recording image receiving program
US13/674,139 US20130071045A1 (en) 2008-02-07 2012-11-12 Image transmitting apparatus, image receiving apparatus, image transmitting and receiving system, recording medium recording image transmitting program, and recording medium recording image receiving program
JP2009188792A JP2009188792A (en) 2009-08-20
JP5109697B2 true JP5109697B2 (en) 2012-12-26
ID=40938937
JP2008027366A Active JP5109697B2 (en) 2008-02-07 2008-02-07 Image transmission device, image reception device, image transmission / reception system, image transmission program, and image reception program
US (2) US8315481B2 (en)
JP (1) JP5109697B2 (en)
JP5308391B2 (en) 2010-03-31 2013-10-09 富士フイルム株式会社 Image encoding apparatus and method, and program
JP2012147252A (en) * 2011-01-12 2012-08-02 Nippon Hoso Kyokai <Nhk> Image reduction apparatus, image enlargement apparatus and program
JP5945816B2 (en) * 2012-03-15 2016-07-05 パナソニックＩｐマネジメント株式会社 Video processing system
JP5973766B2 (en) * 2012-03-30 2016-08-23 キヤノン株式会社 Image processing device
JP2013229666A (en) * 2012-04-24 2013-11-07 Toshiba Corp Abnormality inspection device and remote monitoring inspection system
JPWO2013191193A1 (en) * 2012-06-20 2016-05-26 株式会社日立国際電気 Video compression transmission system
CN105472336B (en) * 2015-12-08 2018-10-30 成都芯软科技发展有限公司 A kind of low power image compression module
JP6322740B1 (en) * 2017-03-07 2018-05-09 株式会社ドワンゴ Image transmitting apparatus and image transmitting method, and image receiving apparatus and image receiving method
JP3889178B2 (en) * 1999-03-25 2007-03-07 富士通株式会社 Resolution-converted image compression decoding apparatus
JP2000333156A (en) * 1999-05-20 2000-11-30 Fujitsu General Ltd Moving picture transmitter
JP4517685B2 (en) * 2004-03-10 2010-08-04 沖電気工業株式会社 Moving picture coding apparatus, the moving picture decoding apparatus and a moving image emphasis conversion system
JP2005295215A (en) * 2004-03-31 2005-10-20 Victor Co Of Japan Ltd Moving image encoding device
JP2006093839A (en) * 2004-09-21 2006-04-06 Mitsubishi Electric Corp Monitoring terminal unit and monitoring system
JP2006092450A (en) * 2004-09-27 2006-04-06 Oki Electric Ind Co Ltd Image processor and image processing method
JP4433985B2 (en) * 2004-11-09 2010-03-17 日本ビクター株式会社 Monitoring the image processing apparatus
JP2006145944A (en) 2004-11-22 2006-06-08 Victor Co Of Japan Ltd Image processing system
JP4760288B2 (en) 2005-10-13 2011-08-31 ソニー株式会社 Image display system, display device, image resynthesis device, image resynthesis method, and program
JP2007194928A (en) * 2006-01-19 2007-08-02 Matsushita Electric Ind Co Ltd Remote monitoring device and method
2008-02-07 JP JP2008027366A patent/JP5109697B2/en active Active
2009-02-06 US US12/367,063 patent/US8315481B2/en active Active
2012-11-12 US US13/674,139 patent/US20130071045A1/en not_active Abandoned
US20090202169A1 (en) 2009-08-13
JP2009188792A (en) 2009-08-20
US20130071045A1 (en) 2013-03-21
US8315481B2 (en) 2012-11-20
JP2007174689A (en) 2007-07-05 Image processing device
US9860536B2 (en) 2018-01-02 System and method for high-resolution storage of images
JP4612866B2 (en) 2011-01-12 Imaging method and an imaging system
CN101536491B (en) 2012-11-28 Imaging device and imaging method
US7184077B2 (en) 2007-02-27 Digital camera
TWI468020B (en) 2015-01-01 Image processing apparatus and method