Patent ID: 12225323

DETAILED DESCRIPTION

In the following description, for the purposes of explanation, numerous specific details are set forth in order to provide a thorough understanding of various example embodiments or implementations of the disclosure. As used herein “embodiments” and “implementations” are interchangeable words that are non-limiting examples of devices or methods employing one or more of the inventive concepts disclosed herein. It is apparent, however, that various example embodiments may be practiced without these specific details or with one or more equivalent arrangements. In other instances, well-known structures and devices are shown in block diagram form in order to avoid unnecessarily obscuring various example embodiments. Further, various example embodiments may be different, but do not have to be exclusive. For example, specific shapes, configurations, and characteristics of an example embodiment may be used or implemented in another example embodiment without departing from the inventive concepts.

Each block in the accompanying block diagram may also be performed by computer program instructions (execution engines), and these computer program instructions may be mounted on a processor of a general-purpose computer, a special-purpose computer, or another programmable data processing equipment. Thus, the instructions executed through the processor of the computer or the another programmable data processing equipment may provide means for performing functions described in each block of the block diagram.

These computer program instructions may also be stored in a computer-usable or computer-readable memory that may be directed to the computer or the another programmable data processing equipment in order to implement functions in a specific way. Therefore, the instructions stored in the computer-usable or computer-readable memory may also produce a manufacturing article including instruction means for performing the functions described in each block of the block diagram.

Furthermore, the computer program instructions may be mounted on the computer or the another programmable data processing equipment. Therefore, the instructions, which generate a process, in which a series of operation steps are performed on the computer or the another programmable data processing equipment and executed by the computer, and execute the computer or the another programmable data processing equipment, may also provide functions for performing the functions described in each block of the block diagram.

Furthermore, each block may represent a part of a module, a segment, or a code including one or more executable instructions for performing specific logical functions, and functions mentioned in blocks or steps may also occur out of order in some alternative embodiments.

That is, two blocks illustrated may also be executed at substantially the same time, and may also be executed in the reverse order of a corresponding function as necessary.

The terms used herein are for the purpose of not limiting but describing specific embodiments. Throughout the specification, when a certain part is referred to as “including” a certain component, it indicates that the part may not exclude but further include other components, unless otherwise stated. Unless otherwise defined, all terms (including technical and scientific terms) used herein have the same meaning as commonly understood by one of ordinary skill in the art to which this disclosure is a part. Terms, such as those defined in commonly used dictionaries, should be interpreted as having a meaning that is consistent with their meaning in the context of the relevant art and should not be interpreted in an idealized or overly formal sense, unless expressly so defined herein.

Hereinafter, example embodiments of the inventive concepts will be described in more detail with reference to the accompanying drawings.

FIG.1is a block diagram schematically showing a configuration of a network surveillance camera system according to an embodiment of the disclosure.

Referring toFIG.1, the network surveillance camera system according to an embodiment of the disclosure may include a camera100, a network200, a video receiving and/or searching device (hereinafter, referred to as a video receiving/searching device)300, and a video backup device400. In the network surveillance camera system, video information acquired by the camera100may be transmitted to the video receiving/searching device300over the network200, and an administrator may search for the transmitted multi-channel video information using the video receiving/searching device300. That is, in an embodiment of the disclosure, the camera100may serve as a server that transmits data, and the video receiving/searching device300may serve as a client that receives the transmitted data.

Also, the video backup device400may perform an operation of storing and playing back event-oriented channel-wise video backup information generated according to the video search result of the video receiving/searching device300. In this case, the video backup information may include a video backup file generated for each channel and a video playback software player.

The camera100, which captures a surveillance area to acquire video and audio signals for the surveillance area, may capture the surveillance area in real time for the purpose of surveillance or security. In an embodiment of the disclosure, the camera100may be implemented in a plurality, and the plurality of cameras100may capture a plurality of surveillance areas, acquire video information for each surveillance area, and transmit the video information acquired for each surveillance area over a corresponding channel. In other words, according to an embodiment of the disclosure, the camera100may be implemented in a plurality to perform an operation of acquiring video information of a video signal for each surveillance area. That is, each of the plurality of cameras100may perform an operation of generating and transmitting a multi-channel video signal corresponding to the surveillance area.

The camera100may be implemented as a pan-tilt-zoom (PTZ) camera capable of panning and tilting and capable of adjusting lens zoom magnification, and the camera100may be implemented as a network camera for performing an intelligent video analysis function.

As an example, the camera100according to an embodiment of the disclosure may generate and transmit video information including video signals corresponding to the surveillance area and also video analysis information for the video information in the form of metadata. The metadata may be created in a text format and may be implemented in various forms interpretable by a system. As an example, the metadata may be implemented in a text format with rules such as EXtensible Markup Language (XML) and JavaScript Object Notation (JSON) or in a binary form defined by its own protocol.

The metadata may include one or more of object detection information (e.g., movement, sound, intrusion into a designated area, etc.) captured in the surveillance area, object identification information (e.g., person, car, face, hat, clothing, etc.), and unique identifier information of an object for object tracking, location information (e.g., coordinates, size, etc.) of a detected object, and time information. The metadata may be transmitted to the video receiving/searching device300through the network200in real time together with the video and audio signals detected in the surveillance area and then may be used for real-time control and video search to improve control convenience and search efficiency.

In the following embodiment, the camera100will be described as, for example, a network camera that performs an intelligent video analysis function and generates the video analysis signal, but the operation of the network surveillance camera system according to an embodiment of the disclosure is not necessarily limited thereto. As an example, the camera100may transmit video information corresponding to each surveillance area, and when the video information is received, the video receiving/searching device300may analyze the video information and generate video analysis information for the video information.

The camera200according to an embodiment of the disclosure may capture a still image for a specific analysis area among the video analysis information while generating the metadata, and may transmit the still image in real time. As an example, the still image may be implemented as a JPEG image file.

The camera100may transmit information to the video receiving/searching device300using various wired/wireless communication schemes such as Ethernet, Wi-Fi, and Bluetooth and may receive instructions from the video receiving/searching device300.

The network200may encompass wired networks such as local area networks (LANs), wide area networks (WANs), metropolitan area networks (MANs), and Integrated Service Digital Network (ISDN) and wireless networks such as wireless LANs, code division multiple access (CDMA), Bluetooth, satellite communication, etc., but the scope of the disclosure is not limited thereto.

The video receiving/searching device300may receive and store data transmitted from the camera200and may perform an operation of analyzing and monitoring the data.

In the following embodiment, the video receiving/searching device300is illustrated as one block, but the configuration and operation of the video receiving/searching device300according to the embodiment of the disclosure are not limited thereto.

More specifically, the video receiving/searching device300may implement a function of a video receiving device for receiving and storing data transmitted from the camera200and a function of a video searching device for performing an operation of analyzing and monitoring the data. In this case, the video receiving device and the video searching device may be physically separated from each other or may be implemented together through one server system.

As an example, the video receiving device may be implemented as a digital video recorder (DVR), a network video recorder (NVR), a video management system (VMS), etc., and the video searching device may be implemented as a separate device or application software that performs a function of searching for and analyzing camera video data stored in the video receiving device. Thus, an administrator may search for the transmitted multi-channel video information using the video receiving/searching device300.

The video backup device400may perform an operation of storing and playing back event-oriented channel-wise video backup information generated according to the video search result of the video receiving/searching device300. In this case, the video backup information may include a video backup file generated for each channel and a video playback software player.

As an example, the video backup device400may be implemented as an external storage medium such as Universal Serial Bus (USB) and may play back the video backup file stored in the video backup device400through an external terminal connected to the video backup device400, e.g., a user's laptop, cell phone, etc.

FIG.2is a block diagram showing a configuration of the camera shown inFIG.1, andFIG.3is a block diagram showing an example of an internal configuration of a processor shown inFIG.2. As described above, the camera100shown inFIGS.2and3will be described as, for example, a network camera that performs an intelligent video analysis function and generates the video analysis signal, but the operation of the network surveillance camera system according to an embodiment of the disclosure is not necessarily limited thereto.

First, referring toFIG.2, the camera100may include an image sensor110, an encoder120, a memory130, a processor140, and a communication interface150.

The image sensor110, which performs a function of capturing a surveillance area to acquire a video, may be implemented as, for example, a charge-coupled device (CCD) sensor, a complementary metal-oxide-semiconductor (CMOS) sensor, etc.

The encoder120may perform an operation of encoding a video acquired through the image sensor110into a digital signal, and may follow, for example, H.264, H.265, Moving Picture Experts Group (MPEG), and Motion Joint Photographic Experts Group (M-JPEG) standards.

The memory130may store video data, voice data, a still image, metadata, etc. As described above, the metadata may be data including any one or more of object detection information (e.g., movement, sound, intrusion into a designated area, etc.) captured in the surveillance area, object identification information (e.g., person, car, face, hat, clothing, etc.), and detected location information (e.g., coordinates, size, etc.).

Also, the still image, which is generated together with the metadata and stored in the memory130, may be generated by capturing image information for a specific analysis area among the video analysis information. As an example, the still image may be implemented as a JPEG image file.

As an example, the still image may be generated by cropping a specific area of video data determined to include an identifiable object among video data of the surveillance area detected in a specific area of a surveillance area for a specific period and may be transmitted in real time together with the metadata.

The communication interface150transmits the video data, the sound data, the still image, and/or the metadata to the video receiving/searching device300. The communication interface150according to an embodiment may transmit the video data, the sound data, the still image, and/or the metadata to the video receiving/searching device300in real time. The communication interface150may perform a communication function of at least one of a local area network (LAN), Wi-Fi, ZigBee, Bluetooth, and near field communication.

The processor140, which controls the overall operation of the camera100, may be configured to process computer program instructions by performing basic arithmetic, logic, and input/output operations. The instructions may be provided to the processor140by the memory130or the communication interface150. As an example, the processor140may be configured to execute an instruction received according to program code stored in a recording device such as the memory130. The processor140may include a program module that is implemented by software such as C, C++, Java, Visual Basic, and Visual C to perform various functions.

Referring toFIG.3, the processor140of the network camera200according to an embodiment of the disclosure may include a metadata generation unit142and a still image generation unit144.

Here, the processor140may be implemented to execute an instruction according to at least one of program code and operating system code included in the memory130. In this case, the components of the processor140, that is, the metadata generation unit142and the still image generation unit144, may be understood as separately representing different functions performed by the processor140according to a control instruction provided by the program code stored in the camera200.

The metadata generation unit142may perform a function of generating video analysis information corresponding to the surveillance area of each camera in the form of metadata. The metadata may include one or more of object detection information (e.g., movement, sound, intrusion into a designated area, etc.) captured in the surveillance area, object identification information (e.g., person, car, face, hat, clothing, etc.), and unique identifier information of an object for object tracking, location information (e.g., coordinates, size, etc.) of a detected object, and time information, and the metadata may be transmitted to the video receiving/searching device300through the network200in real time together with the video and audio signals detected in the surveillance area and then may be used for real-time control and video search to improve control convenience and search efficiency.

The processor140of the camera200according to an embodiment of the disclosure captures and generates a still image for a specific analysis area among the video analysis information through the still image generation unit144while generating the metadata, and the still image generated through the still image generation unit144may be stored in the memory130.

As an example, the still image may be generated by cropping a specific area of video data determined to include an identifiable object among video data of the surveillance area detected in a specific area for a specific period.

More specifically, the still image may be a still image generated by cropping a specific area of video data among the video analysis information corresponding to the surveillance area created in the metadata, i.e., a video portion corresponding to the identifiable object detected in the surveillance area.

For example, the still image may be selected by the processor140(e.g., the still image generation unit144) as a “best shot” still image most suitable for recognizing a specific object among the video data captured in the surveillance area and then may be transmitted to the video receiving/searching device300in real time together with the metadata. Thus, a client such as the video receiving/searching device300may utilize the still image as a thumbnail image when searching for the transmitted video data without performing decoding as an example of separate video processing.

FIG.4is a block diagram showing a configuration of the video receiving/searching device shown inFIG.1, andFIG.5is a block diagram showing an example of an internal configuration of a processor shown inFIG.4. Also,FIG.6is a diagram showing an example of searching for multi-channel video information through the video receiving/searching device according to an embodiment of the disclosure.

The video receiving/searching device300may receive and store data transmitted from the camera200and may serve as a client for analyzing and monitoring the data. As an example, the video receiving/searching device300implements a video receiving function for receiving multi-channel video information from the cameras200and a video search function for analyzing and searching for the received multi-channel video information. In particular, the video search function may be operated by installing an application program capable of implementing the function in a server system forming the video receiving device. However, as described above, in another example embodiment, the video receiving/searching device300may be implemented with a video receiving device and a video searching device as separate components.

A search viewer as shown inFIG.6may be provided through an application program for performing the video search function, and thus an administrator may search for the transmitted multi-channel video information using the video receiving/searching device300.

First, referring toFIG.4, the video receiving/searching device300according to an embodiment of the disclosure may include a memory310, a database320, a processor330, a communication module350, and an input/output (I/O) interface340.

The memory310, which is a computer-readable recording medium, may include a non-volatile mass storage device such as a random-access memory (RAM), a read-only memory (ROM), or a disk drive. The memory310may store signals transmitted from the camera100shown inFIG.1, for example, video data, sound data, a still image, and metadata corresponding to the surveillance area of the camera.

The database320may store and retain unique information (e.g., a camera ID, etc.) of the camera100shown inFIG.1. That is, when surveillance cameras connected to the video receiving/searching device300are added and/or changed, the database320may also be updated with corresponding information.

The processor330may be configured to process computer program instructions by performing basic arithmetic, logic, and input/output operations. The instructions may be provided to the processor330by the memory310or the communication module350. As an example, the processor330may be configured to execute an instruction received according to program code stored in a recording device such as the memory310. The processor330may include a program module that is implemented by software such as C, C++, Java, Visual Basic, or Visual C to perform various functions.

The communication module350may provide a function of enabling communication with the camera100through the network200. As an example, a control signal, an instruction, and the like which are provided under the control of the processor330of the video receiving/searching device300may be transmitted to the camera100via the network200through the communication module350. Likewise, captured video information and/or location information generated through the camera100may be transmitted to the video receiving/searching device300via the network200.

The I/O interface340may serve to provide an interface between an output device such as a display and an input device implemented as a keyboard or a mouse.

Referring toFIG.5, the processor330of the video receiving/searching device300according to an embodiment of the disclosure may include a metadata receiving unit332, a still image receiving unit334, and a thumbnail image generation unit336.

Here, the processor330may be implemented to execute an instruction according to at least one of program code and operating system code included in the memory310. In this case, the components of the processor330, that is, the metadata receiving unit332, the still image receiving unit334, and the thumbnail image generation unit336, may be understood as separately representing different functions performed by the processor330according to a control instruction provided by the program code stored in the video receiving/searching device300.

The metadata receiving unit332may be a functional block corresponding to the metadata generation unit142, which is a functional block in the processor140of the camera200described above with reference toFIG.3, and may perform a function of receiving metadata generated and transmitted by the metadata generation unit142.

The metadata may include one or more of object detection information (e.g., movement, sound, intrusion into a designated area, etc.) captured in the surveillance area, object identification information (e.g., person, car, face, hat, clothing, etc.), and unique identifier information of an object for object tracking, location information (e.g., coordinates, size, etc.) of a detected object, and time information, and the metadata may be transmitted to the video receiving/searching device300through the network200in real time together with the video and audio signals detected in the surveillance area and then may be used for real-time control and video search to improve control convenience and search efficiency. An example of utilizing the metadata for a video search will be described in detail below with reference toFIG.6.

The still image receiving unit334may be a functional block corresponding to the still image generation unit144, which is a functional block in the processor140of the camera200described above with reference toFIG.3, and may perform a function of receiving a still image generated and transmitted by the still image generation unit144. As an example, the still image may be generated by cropping a specific area of video data determined to include an identifiable object among video data of the surveillance area detected in a specific area for a specific period. More specifically, the still image may be a still image generated by cropping a specific area among the video analysis information corresponding to the surveillance area created in the text-based metadata, i.e., a video portion corresponding to the identifiable object detected in the surveillance area. That is, the still image may be selected as a “best shot” still image most suitable for recognizing a specific object among the video data captured in the surveillance area.

The thumbnail image generation unit336performs a function of generating a thumbnail image using the still image received through the still image receiving unit334when searching for video data corresponding to the surveillance area transmitted from the camera200.

That is, by generating the still image as a thumbnail image and displaying the thumbnail image, the video receiving/searching device300may utilize the corresponding image to play back the transmitted video data of the surveillance area. More specifically, a client may display a “best shot” still image corresponding to the metadata information as a thumbnail image in addition to displaying the video analysis information transmitted in the form of the metadata received through the metadata receiving unit332with respect to the surveillance area.

Thus, the video receiving/searching device300may efficiently use the resources of the client by utilizing the still image as the thumbnail image without performing a separate video decoding procedure, and as a result, it is possible to more quickly and accurately search for video data of a surveillance area. An example of utilizing the best shot still image for a video search will be described in detail below with reference toFIG.6.

FIG.6is a diagram showing an example of searching for multi-channel video information through a video receiving/searching device according to an embodiment of the disclosure.FIG.6shows an example of a function provided by an application program that implements the video search function of the video receiving/searching device for analyzing and searching for received multi-channel video information.

Specifically,FIG.6shows a screen of a search viewer application program for searching for multi-channel video information received from the cameras200. A user may select an “AI search (610)” mode, which is an intelligent video search mode, from among the modes of the search viewer. When the user selects the “AI search (610)” mode, a desired identification object may be selected from among objects such as “person,” “face,” and “vehicle” as object identification information of channel-wise metadata provided in the “AI search610” mode. That is, the search viewer according to an embodiment of the disclosure may provide object identification information of the channel-wise metadata transmitted from the cameras. In the embodiment shown inFIG.6, a screen corresponding to a case in which “person” is selected from the object identification information is displayed.

Referring toFIG.6, “best shot” still images corresponding to metadata corresponding to an object “person” among video information acquired for each channel from a plurality of cameras may be displayed as thumbnail images, and a user may specify and select an object corresponding to an event or accident from among the “best shot” still images displayed as the thumbnail images. In the embodiment shown inFIG.6, three “best shot” still images620,622, and624are selected by a user. In an embodiment of the disclosure, video information associated with the three selected “best shot” still images620,622, and624is generated as video backup information, and the video backup information is provided to the video backup device400.

The video backup device400may perform an operation of storing and playing back the generated event-oriented channel-wise video backup information in response to the video search result of the video receiving/searching device300.

As an example, the three “best shot” still images620,622, and624may correspond to video signals acquired from different cameras or may correspond to video signals acquired for different periods of time. Therefore, according to an embodiment of the disclosure, video information to be backed up is not simply backed up around a specific period, but by specifying an object related to an event and securing video information of a plurality of cameras that have captured the object, it is possible to play back corresponding video information along the route of the object. That is, by performing an intelligent video search through the network surveillance camera system by backing up and playing back the search result in an event-oriented manner according to an embodiment of the disclosure, it is possible to provide convenience to a user and improve accuracy and efficiency in tracking the object.

The video backup information may include a video backup file generated for each channel and a video playback software player.

FIG.7is a diagram showing an example of a header of a channel-wise video backup file included in video backup information according to an embodiment of the disclosure.

Referring toFIG.7, the video backup file, which is video information associated with a “best shot” still image selected by a user as described above with reference toFIG.6, may include all of a camera's recording timeline, metadata, a still image, a video signal, and an audio signal. That is, the video backup file may include the timeline, video, audio, metadata, and still images of a final video channel chosen as the search result.

More specifically, the channel-wise video backup file may include basic information and detailed information.

The basic information of the video backup file may include information such as, for example, format version information, creator information, basic information of an original camera list, and start offset position information of each piece of recorded data in a file.

The creator information is unique identification information such as a file creation date, a creator, a camera location, and a MAC address, and the basic information of the original camera list includes original source information such as a video channel model, a channel name, and a recording section.

The basic information may further include digital signature information, and when digital signature is performed, the basic information may include certificate data.

The basic information may further include encryption information, and when encryption is performed, the basic information may include all data encryption processing information and decryption information through a user input password.

The detailed information of the video backup file may include, for example, a timeline database (Timeline DB), a key frame index database (Key frame Index DB), a video frame header (Video Header) and video data (Video DATA), an audio frame header (Audio Header) and audio data (Audio DATA), a metadata header (Meta Header) and metadata (Attributes, Region Information, etc.), and a best shot still image header (BestShot Header) and a best shot still image file (Jpeg Image).

In this case, the video frame header may include codec information, a frame type, resolution, pts (Presentation Time Stamp), dts (Decoding Time Stamp), and a data size, and the audio frame header may include codec information, a channel, a sample rate, pts, a bit rate, and a data size.

The format of the backup file according to an embodiment of the disclosure is not limited to the file format shown inFIG.7. For example, in another embodiment, an existing media container format and a separate metadata format may be utilized.

In this case, the existing media container format may be largely classified into a video coding format, an audio coding format, and a subtitle/capture format. As an example, MP4 (MPEG-4), MKV (Matroska Video Container), and AVI (Audio Video Interlaced) are widely used as standard video file formats.

FIGS.8A to8Dare diagrams showing examples of a video playback mode executed by a video playback software player included in video backup information according to an embodiment of the disclosure.

The video playback software player included in the video backup information according to an embodiment of the disclosure, which is video playback software for effectively playing back a video backup file that has been shown inFIG.7, may combine metadata, video data, and time information stored in the video backup file so that a user may play back a selected event-oriented video.

First, as shown inFIG.8A, the video playback software player800amay operate in a sequential playback mode. This operation may include an operation of sorting and sequentially playing back “best shot” still images810and820in a chronological order as thumbnail images previously selected as described inFIG.6. In this case, when there are a plurality of camera recording sections (e.g., recording sections by a plurality of cameras) at the same time, the video playback software player800amay be automatically switched to a multi-channel mode to play back multiple channel videos at the same time (seeFIG.8B).

As shown inFIG.8B, a video playback software player800bmay operate in a simultaneous playback mode. This operation may be an operation of simultaneously playing back sections in which an object is detected in the “best shot” still images810and820as the thumbnail images previously selected as described inFIG.6.

Also, as shown inFIG.8C, a video playback software player800cmay operate in a same-period playback mode. This means that “best shot” still images selected as thumbnail images are played back in a chronological order from the earliest time on a timeline. However, when there are recording sections of a plurality of channels in the same period, the video playback software player800cmay be switched to the simultaneous playback mode.

Further, as shown inFIG.8D, a video playback software player800dmay operate in an individual-time playback mode. This means that channel-wise camera videos are simultaneously played back for the “best shot” still images as the selected thumbnail images. A user may control the timelines of individual cameras and may display object detection information on timeline sections.

While examples of a video playback mode are described with reference toFIGS.8A-8D, it should be understood by a person of ordinary skill in the art that the video playback mode may not include all of the video playback modes inFIGS.8A-8Dand may include any other video playback mode(s).

FIG.9is a diagram illustrating a method of operating a network surveillance camera system according to an embodiment of the disclosure.

A method of operating a network surveillance camera system according to an embodiment of the disclosure will be described with reference toFIGS.1to9.

A network surveillance camera system according to an embodiment of the disclosure includes the camera100configured to capture a surveillance area to acquire video and audio signals for the surveillance area and the video receiving device (a video receiving/searching device)300configured to receive data transmitted from the camera100and store and monitor the data. More specifically, as described above in detail, the video receiving/searching device300may provide an application program for searching for the multi-channel video information received from the cameras200, and thus an administrator may search for the transmitted multi-channel video information using the video receiving/searching device300. That is, in an embodiment of the disclosure, the camera100may serve as a server that transmits data, and the video receiving/searching device300may serve as a client that receives the transmitted data.

The video backup device400may perform an operation of storing and playing back event-oriented channel-wise video backup information generated according to the video search result of the video receiving/searching device300. In this case, the video backup information may include a video backup file generated for each channel and a video playback software player.

As an example, the video backup device400may be implemented as an external terminal such as a USB and may play back the video backup file stored in the video backup device400through an external terminal connected to the video backup device400, e.g., a user's laptop, cell phone, etc.

The camera100may be implemented as a network camera that performs an intelligent video analysis function. Accordingly, the camera100according to an embodiment of the disclosure may generate video analysis information corresponding to the surveillance area in the form of text-based metadata (ST900).

In an embodiment of the disclosure, the video analysis function of the camera100may be set through a protocol such as an http interface provided by the camera100, and in this case, the setting values may be for a surveillance area for video analysis, a type to be identified, and the like. As an example, coordinate information for the surveillance area, an object type to be subjected to video analysis (e.g., car, person, bag, etc.), and an object type analyzed as metadata may be set or confirmed.

The metadata may include one or more of object detection information (e.g., movement, sound, intrusion into a designated area, etc.) captured in the surveillance area, object identification information (e.g., person, car, face, hat, clothing, etc.), and detected location information (e.g., coordinates, size, etc.).

While generating the metadata, the camera100may capture and generate a still image for a specific analysis area among the video analysis information (ST910). As an example, the still image may be generated by cropping a specific area of video data determined to include an identifiable object among video data of the surveillance area detected for a specific area and a specific period and may be implemented as a JPEG image file.

An object to be captured in the still image may correspond to an object type included in the previously set video analysis function of the camera100. More specifically, the still image may be a still image generated by cropping a specific area among the video analysis information corresponding to the surveillance area created in the metadata, i.e., a video portion corresponding to the object detected in the surveillance area. That is, the still image may be selected as a “best shot” still image most suitable for recognizing a specific object among the video data captured in the surveillance area.

In an embodiment of the disclosure, the above-described metadata and a corresponding still image are transmitted to the client, that is, the video receiving/searching device300, in addition to the video data and audio data for the surveillance area captured by the camera100(ST920).

As an example, when the client additionally transmits “Require: Best Shot” in the operation of sending an RTSP DESCRIBE instruction to a server, an RTSP server that provides a function of generating and providing the above-described still image (e.g., a best shot) may transmit the metadata and the corresponding still image to the client in addition to the video data/audio data.

Subsequently, the video receiving/searching device300may provide an application for searching for the multi-channel video information received from the cameras200as the client, and thus an administrator may search for the transmitted multi-channel video information using the video receiving/searching device300.

First, the video receiving/searching device300may receive the transmitted metadata, and the metadata together with the video and audio signals detected in the surveillance area may be transmitted to the video receiving/searching device300through the network200in real time and may be used for real-time control and video search to increase control convenience and search efficiency (ST930).

Likewise, the video receiving/searching device300may receive the transmitted still image, and the still image may be a still image generated by cropping a specific area among the video analysis information corresponding to the surveillance area created in the metadata, i.e., a video portion corresponding to the identifiable object detected in the surveillance area. That is, the still image may be selected as a “best shot” still image most suitable for recognizing a specific object among the video data captured in the surveillance area.

Also, by generating the still image as a thumbnail image and displaying the thumbnail image when searching for video data corresponding to the surveillance transmitted by the camera200, the video receiving/searching device300may utilize the corresponding image to play back the transmitted video data of the surveillance area. More specifically, the video receiving/searching device300may display a “best shot” still image corresponding to the metadata information as a thumbnail image in addition to displaying the video analysis information transmitted in the form of the metadata with respect to the surveillance area.

Thus, the video receiving/searching device300may efficiently use the resources of the client by utilizing the still image as the thumbnail image without performing a separate video decoding procedure, and as a result, it is possible to more quickly and accurately search for video data of a surveillance area (ST940).

An example of utilizing the metadata and the best shot still image for a video search has been described in detail above with reference toFIG.6, and thus a detailed description thereof will be omitted.

Subsequently, video information associated with predetermined “best shot” still images selected during the video search may be backed up, and the backed-up video information may be generated as video backup information and transmitted to the video backup device400(ST950). The video backup device400may perform an operation of storing and playing back the generated event-oriented channel-wise video backup information in response to the video search result of the video receiving/searching device300(ST960). In this case, the video backup information may include a video backup file generated for each channel and a video playback software player.

That is, the backup of the channel-wise video information by the video receiving/searching device300may include the backup of metadata and/or still images included in the surveillance-area-wise video information, and thus the backup information that is played back in the video backup device400enables channel-wise video playback in an event-oriented manner. Accordingly, the metadata included in the video information is extracted when the channel-wise video information is backed up, and is contained in the video backup file generated for each channel.

An example configuration of the video backup file has been described in detail with reference toFIG.7, and the video backup file may be played back by the image playback software player included in the video backup information in various modes according to a user's selection, examples of which has been described in detail through the embodiments ofFIGS.8A to8D.

According to an embodiment of the disclosure, video information to be backed up is not simply backed up around a specific period, but by specifying an object related to an event and securing video information of a plurality of cameras that have captured the object, and therefore, it is possible to reproduce corresponding video information along the route of the object.

That is, by performing an intelligent video search through the network surveillance camera system according to an embodiment of the disclosure and by backing up and playing back the search result in an event-oriented manner, it is possible to provide convenience to a user and increase search efficiency and accuracy.

According to the embodiments of the disclosure, by providing a still image of an identifiable specific area among video analysis information for a surveillance area, it is possible for a client such as a video receiving/searching device to more quickly and accurately search for video data of the surveillance area using image information without performing a separate video decoding procedure.

Also, when searching for multi-channel video information transmitted from a plurality of network cameras or multi-channel video information for the network cameras generated through the video receiving/searching device, it is possible to specify a predetermined object and search for the video information. Thus, by backing up and playing back the search result in an event-oriented manner, it is possible to provide convenience to a user.

While having been described herein, example embodiments and application examples have been provided to merely help more general understanding of the disclosure, and the disclosure is not limited to the example embodiments. A person having ordinary knowledge in the art to which the disclosure pertains may change or modify the disclosure in various ways based on the foregoing description.

Accordingly, the spirit of the disclosure should not be determined based on only the described embodiments, and all changes equivalents to the claims and equivalent modifications thereof may be construed as belonging to the category of the spirit of the disclosure.