An information processing apparatus includes a display unit, a transmission unit configured to transmit, to an imaging apparatus, a mask setting command including mask setting information indicating a position of a mask selected to prevent at least a part of a region in a captured image, captured by the imaging apparatus, from being viewed, a reception unit configured to receive an image containing said mask, in which the position of the mask is specified, generated based on the mask setting information, and a display control unit configured to display the image containing said mask received by the reception unit on the display unit.

BACKGROUND OF THE INVENTION

Field of the Invention

Description of the Related Art

As discussed in Japanese Patent Application Laid-Open No. 2018-7150, a known monitoring camera provides a masking function to prevent at least a part of an image from being viewed in order to protect privacy, in which a user can set a mask at an optional position in the image.

In a case where pan-tilt-zoom control is performed after the mask is set in the monitoring camera using a pan-tilt-zoom control mechanism, the set mask does not necessarily remain located within the image. Thus, when the user attempts to check the position of the set mask by viewing the image, it is necessary for the user to perform pan-tilt-zoom control to the position where the mask is set to check the position of the mask.

This increases labor of the user.

SUMMARY OF THE INVENTION

According to an aspect of the present invention, an information processing apparatus includes a display unit, a transmission unit configured to transmit, to an imaging apparatus, a mask setting command including mask setting information indicating a position of a mask selected to prevent at least a part of a region in a captured image, captured by the imaging apparatus, from being viewed, a reception unit configured to receive an image containing said mask, in which the position of the mask is specified, generated based on the mask setting information, and a display control unit configured to display the image containing said mask received by the reception unit on the display unit.

DESCRIPTION OF THE EMBODIMENTS

Some exemplary embodiments of the present invention are described below with reference to accompanying drawings. Each of the embodiments of the present invention described below can be implemented solely or as a combination of a plurality of the embodiments. Also, features from different embodiments can be combined where necessary or where the combination of elements or features from individual embodiments in a single embodiment is beneficial.

A first exemplary embodiment of the present invention will be described below in detail.FIG. 1is a diagram illustrating an example of a configuration of a system including a monitoring camera10. The monitoring camera10and a client apparatus20are connected in a mutually-communicable state through a network35. The client apparatus20is an external apparatus that transmits, to the monitoring camera10, control commands, such as a mask setting command and a mask acquisition command. The monitoring camera10transmits, to the client apparatus20, a response to the command.

FIG. 2Ais a diagram illustrating an example of a hardware configuration of the monitoring camera10.

A central processing unit (CPU)11controls the whole of the monitoring camera10.

A memory12is used as a storage region for various data, such as a storage region of a program mainly executed by the CPU11, a work area during execution of the program, a storage region of set values such as a mask set value, and a storage region of image data generated by an imaging unit13described below.

The imaging unit13converts an analog signal that is obtained by imaging an object image formed by an imaging optical system of the monitoring camera10, into digital data, and outputs the digital data as a captured image to the memory12. When the captured image is output to the memory12, the CPU11receives an image acquisition event from the imaging unit13.

A communication unit14is used when the control commands, such as the mask setting command, are received from the external apparatus and when responses to the control commands are transmitted to the external apparatus. When a command is received from the external apparatus, the CPU11receives a command reception event from the communication unit14. By the CPU11executing processing based on a program held by the memory12, a software configuration ofFIG. 3A, processing of the monitoring camera10in a sequence diagram ofFIG. 4, and processing of flowcharts ofFIG. 6,FIG. 7,FIG. 11, andFIG. 13described below are realized.

The hardware configuration of the monitoring camera10illustrated inFIG. 2Ais illustrative, and the monitoring camera10may include, as hardware, an audio input unit, an audio output unit, an image analysis processing unit, in addition to those illustrated inFIG. 2A.

FIG. 2Bis a diagram illustrating an example of a hardware configuration of the client apparatus20.

A CPU21controls the whole of the client apparatus20.

A memory22is used as a storage region for various data, such as a storage region of a program mainly executed by the CPU21, and a work area during execution of the program.

A display unit23includes, for example, a liquid crystal display or an organic electroluminescence (EL) display. The display unit23presents, to a user of the client apparatus20, various setting screens including a mask setting screen, various data acquisition/display screen including a mask list screen, a viewer of an image received from the monitoring camera10, various kinds of messages, etc.

An input unit24includes, for example, a button, a cross key, a touch panel, and a mouse, and notifies the CPU21of information about an operation performed on a screen by the user.

A communication unit25(transmission unit) is used when control commands, such as a profile association setting command and a profile acquisition command, are transmitted to the monitoring camera10, when responses to the control commands or an image stream are received from, for example, the monitoring camera10.

When the CPU21executes processing based on a program held by the memory22, a software configuration ofFIG. 3Band processing of the client apparatus20in a sequence diagram ofFIG. 4described below are realized.

FIG. 3Ais a diagram illustrating an example of a software configuration of the monitoring camera10.

A control unit100controls processing of the whole of the monitoring camera10.

An imaging control unit101controls the imaging unit13. For example, the imaging control unit101changes an imaging range of the imaging unit13to tilt driving, pan driving, or zoom driving, in accordance with a value of panning, tilting, or zooming provided from the control unit100.

A compression encoding unit102performs compression encoding processing on the captured image provided from the imaging unit13, based on a format of Joint Photographic Experts Group (JPEG), H.264, or H.265, thereby generating image data, and outputs the image data to the memory12.

The imaging control unit101may be mounted as a hardware configuration on the monitoring camera10. Similarly, the compression encoding unit102may be mounted as a hardware configuration on the monitoring camera10.

FIG. 3Bis a diagram illustrating an example of a software configuration of the client apparatus20.

A control unit200controls processing of the whole of the client apparatus20. The control unit200is an example of the reception unit and the display control unit.

A decoding unit201decodes the compression-encoded image data that has been received through the communication unit25, based on a format of JPEG, H.264, or H.265, and develops the image data to the memory22.

The decoding unit201may be mounted as a hardware configuration on the client apparatus20.

FIG. 4is a sequence diagram of processing relating to the mask setting command and the mask acquisition command of the monitoring camera10.

The control unit200of the client apparatus20transmits the mask setting command including one or more pieces of mask setting information. The control unit100of the monitoring camera10receives the mask setting command, performs mask setting command processing30, and transmits, as a response, a mask setting response to the client apparatus20. The control unit200of the client apparatus20receives the mask setting response. The mask setting information at least indicates a position of a mask for preventing at least a part of a region in the captured image captured by the imaging unit13from being viewed.

The control unit200of the client apparatus20transmits the mask acquisition command. More specifically, when the user operates the input unit24of the client apparatus20to request a mask list screen90illustrated inFIG. 9(described below), the control unit200of the client apparatus20transmits the mask acquisition command to the monitoring camera10. The control unit100of the monitoring camera10receives the mask acquisition command, performs mask acquisition command processing31, and transmits, as a response, a mask acquisition response to the client apparatus20. The control unit200of the client apparatus20receives the mask acquisition response.

InFIG. 4, the mask setting command and the mask acquisition command are transmitted from a single client apparatus20; however, the commands may be individually transmitted from different client apparatuses20.

The mask setting command processing30and the mask acquisition command processing31are examples of the information processing.

FIG. 5is a flowchart illustrating an example of the mask setting command processing30according to the first exemplary embodiment.

In step S51, the control unit100of the monitoring camera10acquires mask setting information about a mask43from the mask setting command transmitted from the client apparatus20. The processing then proceeds to step S52. The processing in step S51is an example of processing of acquiring the mask setting information.

In step S52, the control unit100updates the mask setting information held by the memory12, with the mask setting information about the mask43transmitted from the client apparatus20. The processing then proceeds to step S53.

In step S53, the control unit100acquires the mask setting information from the memory12, and generates a mask-set image (an image containing the mask), an image at the time when the mask is set, based on the mask setting information of the mask43. The processing then proceeds to step S54. A part of the processing in step S53is an example of the processing of acquiring the mask setting information. As illustrated inFIG. 7, the mask-set image is stored in a mask setting information storage region80of the memory12, in association with the mask setting information. The mask setting information is information for setting a mask name, a mask coordinate (information indicating position of mask within a range capturable by imaging unit13), a mask color, and mask transparency.

In step S54, the control unit100generates a response to the mask setting command, and transmits the response to the mask setting command to the client apparatus20.

FIG. 6is a flowchart illustrating an example of the mask acquisition command processing31when the monitoring camera10receives the mask acquisition command.

In step S101, the control unit100acquires a mask-set image73from the memory12. The processing then proceeds to step S102.

In step S102, the control unit100generates the mask-set image73in response to the mask acquisition command, and transmits the mask-set image73to the client apparatus20. The processing in step S102is an example of processing of specifying, in accordance with the acquisition command from the client apparatus, the mask-set image held by the memory in association with the mask setting information, and transmitting the specified mask-set image to the client apparatus.

FIG. 8is a diagram illustrating an example of the mask setting screen according to the first exemplary embodiment. A mask setting screen40ofFIG. 8is displayed on the display unit23of the client apparatus20. The user operates the input unit24of the client apparatus20, draws a shape including but not limited to a square shape or a polygonal shape in a mask setting preview screen41, thereby setting the mask43. When the user selects a mask setting button42after the mask is set, the control unit200of the client apparatus20transmits the mask setting command to the monitoring camera10. Data to display the mask setting screen ofFIG. 8may be held by the client apparatus20, or may be held by the monitoring camera10and displayed on a web browser, etc. of the client apparatus20in response to a request from the client apparatus20.

FIG. 9is a diagram illustrating an example of a mask list screen. A mask list screen90ofFIG. 9is displayed on the display unit23of the client apparatus20. When the user operates the input unit24of the client apparatus20and requests the mask list screen90, the client apparatus20transmits the mask acquisition command to the monitoring camera10. The client apparatus20acquires the mask-set image73from the monitoring camera10as a response and displays the mask-set image73in a mask list display region91. Further, when the user operates the input unit24of the client apparatus20to select a mask list update button92, the client apparatus20similarly acquires the mask-set image73from the monitoring camera10, and updates and displays the mask list display region91.

As described above, the control unit100of the monitoring camera10generates and saves the mask-set image that allows the user to easily check the position of the mask when the mask setting command is received, and transmits the mask-set image to the user upon reception of the mask acquisition commend.

In this manner, the user can easily check the position of the set mask.

A second exemplary embodiment of the present invention will be described below in detail. The mask-set image generation processing when the monitoring camera10receives the mask setting command according to the present exemplary embodiment is described with reference toFIGS. 10, 11, and 12.

FIG. 10is a flowchart illustrating an example of the mask-set image generation processing.FIG. 11is a diagram illustrating an example of transition of the captured image in the mask-set image generation processing. In step S61, the control unit100stores a current pan-tilt position and a current zoom magnification in the memory12. The processing then proceeds to step S62. The captured image at this time is a captured image70on which the set mask is superimposed as illustrated inFIG. 11.

In step S62, the control unit100requests the imaging control unit101to perform pan-tilt control such that the set mask is located at a center of the screen. The imaging control unit101performs movement to the requested pan-tilt position. The captured image at this time is a captured image71which is obtained by performing pan-tilt control on the captured image70and in which the mask is displayed at the center of the screen inFIG. 11. The processing in step S62is an example of processing of performing the pan-tilt control based on the mask setting information to move the set mask to the center of the screen.

In step S65, the control unit100reads the pan-tilt position stored in the memory12in step S61, and requests the imaging control unit101to perform movement to the pan-tilt position. The imaging control unit101performs movement to the requested pan-tilt position.

FIG. 12is a diagram illustrating an example of the mask list screen. A mask list screen400ofFIG. 12is displayed on the display unit23of the client apparatus20. When the user operates the input unit24of the client apparatus20to request the mask list screen400, the client apparatus20transmits the mask acquisition command to the monitoring camera10. The client apparatus20acquires the mask-set image71from the monitoring camera10as a response, and displays the mask-set image71in a mask list display region401.

As described above, in the present exemplary embodiment, the captured image71in which the mask is displayed at the center of the screen is generated and saved as the mask-set image.

In such a manner, the user can easily check the position of the set mask as well as the image around the mask.

A third exemplary embodiment of the present invention will be described below in detail. The mask-set image generation processing when the monitoring camera10receives the mask setting command according to the present exemplary embodiment is described with reference toFIG. 13andFIG. 14.

FIG. 13is a flowchart illustrating an example of the mask-set image generation processing.FIG. 14is a diagram illustrating an example of transition of a captured image in the mask-set image generation processing. Steps S61and S62are similar to those in the second exemplary embodiment, and description thereof is omitted. In step S63, the control unit100requests the imaging control unit101to perform zoom control such that a ratio of the set mask becomes 30% of the screen. The imaging control unit101performs zooming to the requested zoom magnification. The captured image at this time is a captured image72which is obtained by performing zoom control on the captured image71and in which the mask is displayed at a ratio of 30% of the screen, inFIG. 14. The processing in step S63is an example of processing of further performing the zoom control based on the mask setting information to perform zooming such that the ratio of the set mask becomes the set ratio of the screen. The ratio of 30% is an example of the set ratio.

In step S65, the control unit100reads the pan-tilt position and the zoom magnification stored in the memory12in step S61, and requests the imaging control unit101to perform movement to the pan-tilt position and to perform zooming to the zoom magnification. The imaging control unit101performs movement to the requested pan-tilt position and performs zooming to the requested zoom magnification.

In the third exemplary embodiment, the zoom control is performed such that the ratio of the set mask to the screen becomes 30%; however, the ratio of the set mask in the screen is not limited to 30%. For example, the control unit100may perform the zoom control such that the ratio of the set mask to the screen becomes 70%.

As described above, according to the third exemplary embodiment, the zoomed captured image72in which the mask is displayed at a center of the screen is generated and saved as the mask-set image.

In such a manner, the user can easily check the position of the set mask and also easily check the image around the mask.

A fourth exemplary embodiment of the present invention will be described below in detail. The mask-set image generation processing when the monitoring camera10receives the mask setting command according to the present exemplary embodiment will be described with reference toFIG. 15andFIG. 16.FIG. 15is a flowchart illustrating an example of the mask-set image generation processing.FIG. 16is a diagram illustrating an example of transition of a captured image in the mask-set image generation processing. Steps S61, S62, and S63are similar to those in the third exemplary embodiment, and description thereof is thus omitted.

In step S64, the control unit100requests, through the imaging control unit101, the imaging unit13to generate the mask-set image73in which only a frame of the set mask is superimposed on the current captured image as illustrated inFIG. 16. The imaging control unit101stores the mask-set image73generated by the imaging unit13in the memory12in association with the mask setting information. The processing then proceeds to step S65. The processing in step S64is an example of processing of generating the mask-set image in which the frame of the set mask is superimposed on the captured image and storing the generated mask-set image in the memory in association with the mask setting information.

In step S65, the control unit100reads the pan-tilt position and the zoom magnification stored in the memory12in step S61, and requests the imaging control unit101to perform movement to the pan-tilt position and to perform zooming to the zoom magnification. The imaging control unit101performs movement to the requested pan-tilt position and performs zooming to the requested zoom magnification.

According to the fourth exemplary embodiment, only the frame of the mask is superimposed on the mask-set image73. The method for applying the transparency to the mask to be superimposed a frame line thereof, and the color thereof, however, are not limited. For example, the imaging control unit101may superimpose only a solid frame, superimpose the frame with a color that is the same as the color set for the mask, or superimpose a semitransparent mask.FIG. 17is a diagram illustrating an example of the mask list screen. A mask list screen300ofFIG. 17is displayed on the display unit23of the client apparatus20. When the user operates the input unit24of the client apparatus20to request the mask list screen300, the client apparatus20transmits the mask acquisition command to the monitoring camera10. The client apparatus20acquires the mask-set image73from the monitoring camera10as a response, and displays the mask-set image73in a mask list display region301.

As described above, in the fourth exemplary embodiment, only the frame of the mask is superimposed on the mask-set image73.

In such a manner, the user can easily check the position of the set mask and also check the current captured image under the mask.

A fifth exemplary embodiment will be described below in detail. The mask-set image generation processing when the monitoring camera10receives a mask setting command including a plurality of mask settings is described with reference toFIGS. 18 and 19.

FIG. 18is a diagram illustrating an example of a mask setting screen according to a fifth exemplary embodiment. The mask setting screen ofFIG. 18is displayed on the display unit23of the client apparatus20. The number of set masks is one inFIG. 8, whereas the number of set masks is two inFIG. 18.

The user operates the input unit24of the client apparatus20, draws a square shape or a polygonal shape in the mask setting preview screen41, thereby setting a mask44and a mask45. When the user selects the mask setting button42after the masks are set, the control unit200of the client apparatus20transmits the mask setting command to the monitoring camera10.

FIG. 19is a flowchart illustrating an example of the mask setting command processing30according to the fifth exemplary embodiment.

In step S111, the control unit100acquires mask setting information about the mask44that is first mask setting information, from the mask setting command transmitted from the client apparatus20. The processing then proceeds to step S112.

In step S112, the control unit100updates the corresponding mask setting information held by the memory12, with the mask setting information about the mask44. The processing then proceeds to step S113.

In step S113, the control unit100generates the mask-set image based on the mask setting information about the mask44. The processing then proceeds to step S114.

In step S114, the control unit100determines whether the mask-set images based on all pieces of the mask setting information transmitted from the client apparatus20have been generated. The processing proceeds to step S111because a mask-set image with the mask45has not been generated yet.

In step S111, the control unit100acquires mask setting information about the mask45that is second mask setting information, from the mask setting command transmitted from the client apparatus20.

In step S112, the control unit100updates the mask setting information held by the memory12, with the mask setting information about the mask45. The processing then proceeds to step S113.

In step S113, the control unit100generates the mask-set image based on the mask setting information about the mask45. The processing then proceeds to step S114.

In step S114, the control unit100determines whether the mask-set images based on all pieces of the mask setting information transmitted from the client apparatus20have been generated. The processing proceeds to step S115because all of the mask-set images have been generated.

In step S115, the control unit100generates a response to the mask setting command, and transmits, to the client apparatus20, the response to the mask setting command.

The control unit100generates the mask-set image that allows the user to easily check settings having been set when the mask setting command including the plurality of mask settings is received, and transmits the mask-set image to the user when the mask acquisition command is received.

In such a manner, the user can easily check the information about the mask to be set.

According to the first exemplary embodiment, the control unit100of the monitoring camera10returns the mask-set image73to the client apparatus20as the response to the mask acquisition command. Alternatively, the control unit100may transmit a uniform resource locator (URL) of the storage for the mask-set image to the client apparatus20, in place of the mask-set image73. The URL of the storage for the mask-set image is an example of the information indicating the specified mask-set image. In addition, the processing other than the processing performed by the imaging unit13may be executed by the client apparatus20. In such a case, the instruction for pan-tilt control and the imaging instruction are performed through transmission of the commands from the client apparatus20.

The present invention may be realized in such a manner that a program realizing one or more functions of the above-described exemplary embodiments is supplied to a system or an apparatus through a network or a storage medium, and one or more processors in a computer of the system or the apparatus read and execute the program. Further, the present invention may be realized by a circuit (e.g., application specific integrated circuit (ASIC)) that realizes one or more functions.

Hereinbefore, the exemplary embodiments of the present invention have been described in detail; however, the present invention is not limited to such specific exemplary embodiments.

The above-described hardware configuration of the monitoring camera10is merely an example, and the monitoring camera10may include, for example, a plurality of CPUs, a plurality of memories, and a plurality of communication units. In addition, a plurality of CPUs may execute processing with use of data, etc. held by a plurality of memories, based on programs. Moreover, a graphics processing unit (GPU) may be used in place of the CPU.

The processing of the above-described exemplary embodiments enables a user to easily check a region set with respect to the image captured by the monitoring camera10.

OTHER EMBODIMENTS

This application claims the benefit of Japanese Patent Applications No. 2017-150045, filed Aug. 2, 2017, and No. 2018-115525, filed Jun. 18, 2018, which are hereby incorporated by reference herein in their entirety.