Source: http://www.google.com/patents/US20040246376?dq=5166694
Timestamp: 2014-03-10 06:48:16
Document Index: 97316103

Matched Legal Cases: ['art 5', 'art 5', 'art 5', 'art 5', 'art 5', 'art 1', 'art 1', 'art 1', 'art 1', 'art 1', 'art 1', 'art 1', 'art 5', 'art 5', 'art 5', 'art 5', 'art 5', 'art 5', 'art 1', 'art 1', 'art, 6', 'art, 6', 'art, 6', 'art, 6', 'art 6', 'art 6', 'art 6', 'art 6', 'art 6', 'art 6', 'art 6', 'art 6', 'art 6', 'art 6', 'art 6', 'art 6', 'art 6', 'art 6', 'art 6', 'art, 7', 'art, 7', 'art 7', 'art 7', 'art 7', 'art 7', 'art 7', 'art 5', 'art 7', 'art 7', 'art 7', 'art 7', 'art 7', 'art 7', 'art 7', 'art 6', 'art 6', 'art 6', 'art 6', 'art 6']

Patent US20040246376 - Video content transmission device and method, video content storage device ... - Google PatentsSearch Images Maps Play YouTube News Gmail Drive More »Sign inAdvanced Patent SearchPatentsVideo contents are presented in the forms requested by viewers in a quick and accurate manner based on a request condition at a video viewing side. In a content delivery server 5, a content extraction part 5A inquires the presence or absence of video contents, which belong to a requested classification,...http://www.google.com/patents/US20040246376?utm_source=gb-gplus-sharePatent US20040246376 - Video content transmission device and method, video content storage device, video content reproduction device and method, meta data generation device, and video content management methodAdvanced Patent SearchPublication numberUS20040246376 A1Publication typeApplicationApplication numberUS 10/493,823PCT numberPCT/JP2003/004520Publication dateDec 9, 2004Filing dateApr 9, 2003Priority dateApr 12, 2002Also published asDE60334079D1, EP1482735A1, EP1482735A4, EP1482735B1, WO2003088668A1Publication number10493823, 493823, PCT/2003/4520, PCT/JP/2003/004520, PCT/JP/2003/04520, PCT/JP/3/004520, PCT/JP/3/04520, PCT/JP2003/004520, PCT/JP2003/04520, PCT/JP2003004520, PCT/JP200304520, PCT/JP3/004520, PCT/JP3/04520, PCT/JP3004520, PCT/JP304520, US 2004/0246376 A1, US 2004/246376 A1, US 20040246376 A1, US 20040246376A1, US 2004246376 A1, US 2004246376A1, US-A1-20040246376, US-A1-2004246376, US2004/0246376A1, US2004/246376A1, US20040246376 A1, US20040246376A1, US2004246376 A1, US2004246376A1InventorsKohtaro Asai, Shinichi Kuroda, Yoshimi Moriya, Hirofumi Nishikawa, Fuminobu Ogawa, Kenji Otoi, Shunichi Sekiguchi, Yoshihisa YamadaOriginal AssigneeShunichi Sekiguchi, Hirofumi Nishikawa, Yoshimi Moriya, Yoshihisa Yamada, Kenji Otoi, Shinichi Kuroda, Fuminobu Ogawa, Kohtaro AsaiExport CitationBiBTeX, EndNote, RefManReferenced by (18), Classifications (58), Legal Events (1) External Links: USPTO, USPTO Assignment, EspacenetVideo content transmission device and method, video content storage device, video content reproduction device and method, meta data generation device, and video content management methodUS 20040246376 A1Abstract Video contents are presented in the forms requested by viewers in a quick and accurate manner based on a request condition at a video viewing side. In a content delivery server 5, a content extraction part 5A inquires the presence or absence of video contents, which belong to a requested classification, to a content database 4 based on a content classification request 1E-1 in query information 1E, converts the video contents into the form of a content URI list 5C, and sends them to a content processing part 5D along with a content view form request 1E-2. The content processing part 5D requests, based on the content view form request 1E-2, the whole or parts of video contents needed to be presented according to the requested view form among the video contents of view candidates designated by the URI list 5C to the content database 4, grabs and processes video contents comprising video data 3A and metadata 3B, so that a content delivery part 5F delivers the video contents thus processed to a user terminal 1. Images(9) Claims(15)
BEST MODE FOR CARRYING OUT THE INVENTION [0031] Now, preferred embodiments of the present invention will be described below. [0032] Embodiment 1. [0033] In a first embodiment of the present invention, reference will be made, as an example of a video content management and operation system, to a video exchange server system and its configuration, which collects video contents from video terminals of certain users connected to an IP network and delivers the video contents to other users in the forms of presentation meeting their individual requests. [0034]FIG. 1 shows the system configuration of the video content management and operation system according to the present invention. As shown in this figure, the video content management and operation system of the present invention includes user terminals 1 corresponding to video content reproduction devices of the present invention, a service host 2, authoring proxies 3 corresponding to metadata creation devices of the present invention, a content database 4 corresponding to a video content storage device of the present invention, and content delivery servers 5 corresponding to video content sending devices of the present invention, these components being connected with one another through the IP network or the like. Here, note that as shown in FIG. 1, the user terminals 1 include a user terminal, which is equipped with a control information sending and receiving part 1A, a video imaging (picture taking) and sending part 1B, etc., and has the function of sending video data 1C to be registered, and a user terminal with a receiver function alone, which is not equipped with such a control information sending and receiving part 1A, such a video imaging and sending part 1B, etc., and hence has no function of transmitting video data 1C to be registered. [0035]FIG. 2 shows the operational flow of the video content management and operation system of the present invention illustrated in FIG. 1. [0036] The function and operation of the system will be explained separately based on these views while being divided into content registration processing, authoring processing, content delivery processing, and content reproduction and query processing. Here, it is to be understood that in all the following preferred embodiments. video data includes not only data containing only videos (images or pictures) but also audio visual data containing videos and its accompanying audio data. [0037] Content Registration Processing [0038] A user terminal 1 having a video sending function consigns the management and operation of video data to this system by uploading thereto and registering therein the video data. The service host 2 takes care of the overall management of this system. The service host 2 performs interaction with the user terminals 1 so that it takes charge of user authentication, and carries out the operation and management of the authoring proxies 3, the content database 4, the content delivery servers 5, etc., which are resources available in the system. Here, note that in FIG. 1, broken lines connected from the service host 1 to the respective resources in the system are hereinafter taken as control lines for the operation and management of the respective resources. [0039] First of all, a user, who wants to register his or her contents, sends a request for content registration from the control information sending and receiving part 1A of a user terminal 1 (hereinafter referred to as the user terminal 1 concerned) to the service host 2 (S1). This request information includes information on whether the user wants the creation of metadata with video analysis in the form of authoring. The service host 2 having received the request authenticates whether the requesting user is a person to be supported by this system (S2). If the authentication is OK, an authoring proxy 3 and the content database 4 available in the system are specified (S3). At the same time, the resource use state of the user who made the request is checked. For instance, it is checked whether the total amount of data of the video contents to be registered by the user concerned exceeds an upper limit. Then, the user terminal 1 concerned is notified of the permission or non-permission of the requested registration as well as an available authoring proxy 3 and an address in the content database 4 in the case of the registration being permitted (S4). [0040] If the permission of the requested registration is verified by the notification from the service host 2, the user terminal 1 concerned having a transmission function transmits or forwards video data 1C to be registered to the available authoring proxy 3 through the video imaging and sending part 1 B (S5). Here, the video data 1C can take various data formats depending upon the specification of the user terminal 1 concerned. For example, video data conforming to the MPEG-4 video might be used in the case of a terminal which assumes that an access line to which the video data is sent is a transmission path critical for video transmission, such as a mobile communication line, etc. On the other hand, in the case of a terminal to be connected with an access line that is sufficiently wideband, video data of the DV format and the MPEG-2 format may be used. In addition, regarding transport protocols, a protocol such as RTP/UDP/IP suitable for real-time media is used when real-time registration is needed, whereas when real-time registration is not necessarily needed, the video data 1C can be registered in a reliable manner by using a highly reliable transport protocol such as TCP/IP or the like. [0041] Authoring Processing [0042] In this first embodiment, the authoring proxies 3 are subjected to processing loads such as the image analysis of the video data 1C, the conversion of video data format necessary for registration to the content database 4, etc, and hence they are arranged on the IP network in a decentralized or distributed manner so as to decentralize or distribute the processing load of the entire system, but even the use of only one authoring proxy may of course be possible if it has sufficient capacity. Incidentally, when the user do not want the creation of metadata requiring the processing of analyzing videos or images, a notification is made from the user terminal 1 concerned to the service host 2, instead of the video data 1C to be registered being transmitted to an authoring proxy 3 (S5), so that a video or image analysis in that authoring proxy 3 can be turn off. [0043] When the video data 1C is sent to the authoring proxy 3 concerned so as to create metadata for the video data 1C, the authoring proxy 3 analyzes the video data 1C received (S6). Here, note that analysis processing means that the signal feature of the video data 1C is extracted, and the scene structure of the video and/or a feature quantity in the signal level of each scene are automatically extracted based on the video data feature thus extracted. By describing the scene structure of a video content, it becomes possible to carry out flexible presentation of the video content at the time of the user viewing the video content in such a manner that a part of the video content desired by the viewing user can be reproduced in a summarized manner, or a plurality of parts thereof can be combined with one another so as to be viewed continuously. [0044] Moreover, by describing the video signal feature quantity of each scene, it is possible to improve the efficiency of access in such a manner that a candidate of a scene similar in terms of picture patterns to a certain prescribed scene can be instantaneously found. The extraction of the scene structure of the video can be achieved for example by detecting scene change points based on the continuity of interframe correlation of the video. For the feature extraction at the signal level of each scene, the processing of creating the values of descriptors related, for example, to representative colors, color histogram, the level and distribution of motion, etc., are used. [0045] Further, audio data accompanying the video can be used as auxiliary information for the scene structure extraction depending upon circumstances. In general, it is difficult to completely coincide the result of scene segmentation obtained by the automatic detection of scene change points with the result of scene segmentation which is considered to be appropriate subjectively by a picture taker at the user terminal 1 concerned, and hence it may be constructed such that interaction between the user terminal 1 concerned and the authoring proxy 3 connected thereto is carried out for correction to the automatic scene segmentation result, that is, editing of the metadata (S6 a). For instance, this is achieved by exchanging control information between the control information sending and receiving part 1A of the user terminal 1 concerned and the authoring proxy 3 connected thereto. In particular, a system of interaction (S6 a) for editing such metadata becomes indispensable for enabling the picture taker of the user terminal 1 concerned to perform processing such as putting a key word to each scene so as to explain the semantic content or meaning of each individual scene. [0046] Furthermore, the user terminal 1 concerned sends information 1D necessary for the content registration to the authoring proxy 3 concurrently with sending the video data 1C. Such information 1D includes a kind of information explicitly input by the user, and another kind of information automatically sent by the terminal 1 concerned. The former kind of information includes the user's name (it can be automatically sent if already registered in the terminal), the title and genre, etc., of each individual video which has been taken by the user. The latter kind of information includes the time and data of picture taking, the place of picture taking (it can be designated by advanced registration in case of a fixed terminal, or automatically registered through the use of appropriate means such as GPS in case of a mobile terminal), or attribute information on media such as the video encoding method, video resolution, frame rate, bit rate, etc., of the video data 1C sent by the terminal. [0047] As a result of the video analysis processing in the authoring proxy 3, video data 3A and metadata 3B are output therefrom. [0048]FIG. 3 shows one example of the metadata 3B of the video data 1C created by the authoring proxy 3. The metadata 3B consequentially comprises, as shown in FIG. 3, various elements including the attribute information as the entire content of the video data 1C such as, for example, the video encoding method, resolution, frame rate, URI, content production information, etc., based on the above-mentioned content registration information 1D, as well as the scene structure in the time direction of the video data 1C, key word information given in units of each scene, and feature quantities of the video signal level such as color, motion, etc., obtained as a result of the video or image analysis. These pieces of information are described in a format conforming to MPEG-7, which is a multimedia metadata format of the international standard, and it is assumed that all the authoring proxies 3, which are component elements of this system, describe and output the metadata in the common MPEG-7 metadata format. [0049] As a result, the content database 4 can always receive the metadata 3B in the unified data format from the different authoring proxies 3, and at the same time can unify the processing format of the metadata in the use thereof when video contents are thereafter delivered, so that the entire system and individual devices constituting the system component elements can be reduced in their costs. Here, note that since the video data 3A, though basically equivalent to the video data 1C, are temporarily accumulated or stored in the authoring proxies 3 for their authoring processing and registered in the content database 4 in a file format, they are given numbers different from those of the video data 1C. In addition, the video data 1C may sometimes be converted into the video format types designated by the content database 4. [0050] Hereinafter, each pair of video data 3A and metadata 3B are called a video content, and data are registered in the content database 4 in units of such pairs (S6). In this first embodiment, the video data 3A and the metadata 3B are handled as independent data files, respectively, and it is assumed that the correlation between the video data 3A and the metadata 3B is achieved by specifying the URI information or the like of the video data 3A in the metadata 3B. However, it may be constructed such that the metadata 3B and the video data 3A may be multiplexed so as to be handled and managed as a single stream or a single file. The content database 4 is one node on the IP network, and in order to manage video contents in an internal storage medium within the content database 4 based on a prescribed management method, the URI of the video data 3A is determined at the stage when positioned in place on the internal storage medium. This URI information can also be constructed such that it is registered in the content database 4 by being added to the metadata 3B at the time of the content being registered into the content database 4. Moreover, though not illustrated in the drawings, it may be constructed such that such URI information is determined based on the interaction between the content database 4 and the authoring proxies 3 in the process of creation of the metadata 3B specified by MPEG-7 in the authoring proxy 3. [0051] Content Delivery Processing [0052] The video contents registered in the content database 4 according to the above-mentioned procedure are delivered to the user terminals 1 by means of the content delivery servers 5 in the view forms desired by users. That is, this system enables users themselves to send video contents to the system while consigning the management thereof to the system, and at the same time to view other. video contents, whose management has been similarly consigned to the system by other users, in the forms desired by themselves. Thus, services equivalent to the static image exchange system referred to before as a known example can be constructed for video contents. For example, a user sometimes wants to view the whole of a video content or at other times wants to view a digest of a video content that collects only scenes of a specific favor or interest. In addition, even in cases where a user terminal can not support the reproduction of moving pictures or videos, it is still possible for one to view only representative images (key frames) of wanted scenes in a video content. Selection among these dynamic video content presentation forms is not achieved until matching is made between the metadata associated with video data and the request of a user. [0053] In the flow of FIG. 2, delivery processing is started by a reproduction request from a user terminal 1 in step S7. Similar to the time when video contents are registered, the service host 2 authenticates whether the user who issued the reproduction request is a user to be supported (S2). If the authentication is OK, the most appropriate content delivery server 5 in the system for the delivery of video contents to the requesting user is allocated (S8). The result of such delivery server allocation along with the permission or non-permission of the requested reproduction is notified to the user requesting the reproduction (S9). If it is verified that the system accepted the reproduction request, the user terminal 1 sends query information 1E on the contents to be viewed to the allocated content delivery server 5, as shown in FIG. 4. [0054]FIG. 4 shows the internal configuration of a content delivery server 5, and the relation between that the content delivery server 5, the user terminal 1 and the content database 4. [0055] The query information 1E including, as its component elements, a request condition for reproducing a variety of video contents, is converted into data in a metadata processor 1G, and transmitted from the user terminal 1 to the content delivery server 5 according to a prescribed protocol. Though not illustrated, in general, original data for creation of the query information 1E is sent from the user terminal 1 to the system by the user's making a Web access to the system from the user terminal 1 through its user interface 1F, whereby the query information 1E is sent to the content delivery server 5 based on the original data. Alternatively, in cases where the user has beforehand registered in a video content exchange service provided by this system, it may be constructed such that original data for the creation of the query information 1E is provided through the form of push delivery. [0056] Here, the original data for the creation of the query information 1E is registered in the content database 4 for example, and it may be expressed by list information or the like on the video contents which the user is permitted to view, or a service provider employing this system may present a recommendation menu, or the user may be able to explicitly create a new query in the form of keyboard entry, etc. Based on such information, the user sends, explicitly or automatically, the content requested by himself or herself in the form of the query information 1E. [0057] In addition, the query information 1E includes two kinds of information. One is information on a request condition concerning the classification of the video contents wanted by the user, this being, for example, the information for designating contents of a specific genre. The other is information on a request condition concerning the content presentation forms as to in what forms the user wants to view the contents. The latter information includes a first request condition concerning the tastes or preferences related to the user's view content to be described later, and a second request condition concerning data formats or the like based on constraints on the content reproduction capability which the user terminal itself has as its functional specification. In the following, the former is described as a content classification request 1E-1, and the latter is described as a content view form request 1E-2. [0058] In the content delivery server 5, the content extraction part 5A first inquires the presence or absence of video contents, which belong to the requested classification, to the content database 4 based on the content classification request 1E-1 in the query information 1E. Accordingly, the content delivery server 5 retrieves video contents in the content database 4 (S11), and creates video content retrieval information 5B, whereby the video contents corresponding to the requested classification are listed. Here, it may be constructed such that the content database 4 to which an inquiry is made is not limited to one, but instead such an inquiry can be made to a plurality of content databases 4, if provided. In this case, the content databases 4, being arranged in such a decentralized manner, serve to distribute the load on the entire system due to video content accesses, thereby making it possible to stabilize the system. Moreover, to reduce the frequency of database accesses, the content delivery server 5 may be constructed such that it internally caches a video content list for hits in the past and their classification information. As a result, the enquiry frequency to the databases is decreased, thus making it possible not only to speed up the response to the user but also to reduce the system load. [0059] The video contents listed in the content extraction part 5A are sent to the content processing part 5D in the form of a content URI list 5C along with the content view form request 1E-2. [0060] The content processing part 5D requests, based on the content view form request 1E-2, the whole or parts of the video content needed to be presented according to the requested view form among the video contents of view candidates designated by the URI list 5C to the content database 4 as a video content grab request 5E. [0061] Then, the video contents comprising video data 3A and metadata 3B are first grabbed or taken into the content delivery server 5 from the content database 4 by means of the video content grab request 5E. [0062] The materials of the video contents thus grabbed are processed by the content processing part 5D according to the content view form request 1E-2 (S11). This processing corresponds to the case where the locations or parts of the grabbed video content materials to be reproduced are specified by matching the metadata 3B contained in the video contents with the requested condition information on the user's tastes particularly related to view contents or view forms such as, for instance, �I want to see a digest within three minutes�, �videos on which ◯◯ appears�, �information including the spectacle of ΔΔ�, etc., among the content view form request 1E-2. [0063] The results thereof are reflected on the final view forms through various processing such as, for example, describing locations or parts to be reproduced of the grabbed video contents as multimedia reproduction control description data such as SMIL, subjecting the grabbed video contents to media conversion according to the user's view condition, e.g., converting the representative images including the contents wanted by the user into a group of static images in JPEG format or the like or into other user viewable video encoding schemes, etc. [0064] When the presentation forms of the video contents are determined by the above processing, the video data to be delivered to the user terminal 1 is sent to the content delivery part 5F, so that the processed video contents are delivered to the requested user terminal 1 according to video (or image) media delivery protocols between the content delivery server 5 and the user terminal 1 (S12). [0065] Content Reproduction and Requery Processing [0066] The video contents delivered to the user terminal 1 according to the above-mentioned procedure comprises video data 5G processed pursuant to the view forms requested by the user, and metadata 5H associated with the video contents to be processed, as shown in FIG. 1 and FIG. 4. [0067] The video data 5G is input to a video decoder 1G of the user terminal 1 in the data format corresponding to a video encoding method transmitted as the query information 1E to the content delivery server 5, as stated above. The decoded videos or images are reproduced through the user interface 1F. For example, when the video decoder 1G is compliant with the MPEG-4 video coding scheme, the video data 5G is converted in advance in the MPEG-4 video data format and then delivered. In addition, in the case of a user terminal 1 only supporting decoding and displaying JPEG images, the video data 5G is received as key frame image sequence data according to JPEG. In another example, when the user terminal 1 supports synchronized media reproduction compliant with SMIL, the results of video content processing in the content delivery server 5 are further transmitted as SMIL files to the user terminal 1, where the video decoder 1G serves to exchange the video data 5G between the content delivery server 5 and the user terminal 1 according to the SMIL specification. [0068] The metadata 5H is expanded to the user interface 1F in the metadata processor 1G, so that it can be used for information presentation to show what collections of video contents each video content to be delivered is originally composed of. This information can be reused as the information, based on which the query information 1E is originally created. With this information being used as the origin, the query information 1E can be created again and resent, so that video contents can be requested again (S13). With such a mechanism or arrangement, the user is able to receive not only those parts of video contents which are to be actually viewed but also the whole contents thereof as metadata. For example, with respect to a request for retrieving other video contents resembling, in terms of picture patterns, a part of a video content which the user wants to view, a search can be carried out by using, triggers, the signal level feature quantities of video scenes at view locations or parts included in the above-mentioned metadata. Accordingly, it is possible for the user to smoothly execute re-access to all the video contents that can be the objects of user's interest by using, as a starting point, the contents of the videos automatically processed by the system according to the user's request. Though not illustrated in FIG. 1, the system may be configured such that the video data 5G and the metadata 5H are further sent to an authoring proxy 3 where the video data 5G is subjected to video or image analysis processing thereby to revise the metadata 5H and at the same time to register again the video contents thus processed themselves. [0069] Here, note that though stated above, the user terminals 1 need not necessarily have the video uploading function. For example, the system may include, as a system component, a user terminal having only the function of browsing video contents without the provision of the control information sending and receiving part 1A, the video imaging and sending part 1B, etc. Although not described in detail in this first embodiment, it is necessary to perform the management of access rights to the video contents in a satisfactory manner. However, such a security mechanism or arrangement is off the subject of the present invention, and the present invention is predicated on a sufficiently secure video content management and operation system, and provides a technology of improving the convenience thereof. [0070] Therefore, according to the video content management and operation system of this first embodiment, it is possible to achieve a video content management and operation system capable of presenting video contents on a platform having various video reproduction environments mixed with one another in a quick and adequate manner based on the tastes or preferences of viewers related to the video reproduction capabilities of their terminals and the contents of the video contents, which are the request condition at the side of viewing the video contents. [0071] In particular, it is possible to process the video contents dynamically in compliance with a view request by means of a mechanism of managing the video contents in metadata pairs corresponding to video data. [0072] Embodiment 2 (P2P IP Video Exchange System) [0073] Although in the first embodiment, reference has been made to a configuration with the content database 4 and the user terminal 1 separated from each other, a second embodiment of the present invention describes a system configuration in which a user terminal of a user connected to the IP network itself includes a part or all of the functions of the content database 4 and performs video content exchange according to a request of another user. [0074]FIG. 5 shows the internal configuration of a user terminal 6 in this second embodiment. In FIG. 5, 6A designates a content database part, 6B a video encoding part, 6 d an authoring part, 6H a content delivery part, 6K a metadata processor, 6M a video decoder, and 6N a user interface. [0075] Next, the operation of the user terminal 6 in this second embodiment will be explained below while being divided into content registration processing, authoring processing, content delivery processing, and content reproduction processing. [0076] Content Registration Processing [0077] First of all, the user terminal 6 performs the management of video data by registering the video data in the internal content database part 6A. First, an input video is converted into video data 6C to be accumulated or stored in the content database part 6A through the video encoding part 6B, and then forwarded to the authoring part 6D. [0078] Authoring Processing [0079] The authoring part 6D performs the video analysis processing of the video data 6C, and creates metadata for the video data 6C. Here, note that the analysis processing is equivalent in its content to that described in the first embodiment, and hence an explanation thereof is omitted herein. The metadata is created by integrating the result of the video analysis processing and content registration information 6E. The content registration information 6E includes a kind of information explicitly input by the user, and another kind of information automatically inserted by the terminal. The former kind of information includes the user's name (it can be automatically sent if registered in the terminal), the title and genre, etc., of each individual video which has been taken by the user. The latter kind of information includes the time and data of picture taking, the place of picture taking (it can be designated by advanced registration in case of a fixed terminal, or automatically registered through the use of appropriate means such as GPS in case of a mobile terminal), or attribute information on media such as the video encoding method, video resolution, frame rate, bit rate, etc., of the video data 1C sent by the terminal. [0080] As a result of the video analysis processing in the authoring part 6D, video data 6F and metadata 6G are output therefrom. The metadata 6G consequentially comprises various elements such as the attribute information of the entire contents of the video data 6C such as, for example, the video encoding method, resolution, frame rate, URI, content production information, etc., based on the above-mentioned content registration information 1D, as well as the scene structure in the time direction of the video data 6C, key word information given in units of each scene, and feature quantities of the video signal level such as color, motion, etc., obtained as a result of the video or image analysis. These pieces of information are described in a format conforming to MPEG-7, which is a multimedia metadata format of the international standard, as illustrated in FIG. 3. [0081] Here, each pair of video data 6F and metadata 6G are called a video content, and data are registered in the content database 6A in units of such pairs. In this second embodiment, the video data 6F and the metadata 6G are handled as independent data files, respectively, and it is assumed that the correlation between the video data 6F and the metadata 6G is achieved by specifying the URI information or the like of the video data 6F in the metadata 6G. However, it may be constructed such that the metadata 6G and the video data 6F may be multiplexed so as to be handled and managed as a single stream or a single file. [0082] Moreover, the user terminal 6 is one node on the IP network, and in order to manage video contents in an internal storage medium within the content database 6A based on a prescribed management method, the URI of the video data 6F is determined at the stage when positioned in place on the internal storage medium. This URI information can also be constructed such that it is registered in the content database 6A by being added to the metadata 6G at the time of the content being registered into the content database 6A. [0083] Content Delivery Processing [0084] The video contents registered in the content database part 6A in the user terminal 6 according to the above procedure are delivered to another user terminal accessed by the content delivery part 6H according to the access and view request condition from the outside. That is, with user terminals in this second embodiment, the user himself or herself accumulates or stores video contents in the terminal 6, manages them, and delivers the managed video contents based on a request from another user terminal. [0085] Further, the user requesting the delivery of a video content can request a user's desired view form to that user terminal 6, as in the case of making a request to the content delivery server 5 of the first embodiment. Thus, a service equivalent to the static image exchange system referred to before as a known example can be constructed as a peer to peer system for video contents. For example, it is considered that the user terminal 6 is in the form of a digital video camera capable of installing thereon an external mass storage medium for storing the results of videos or pictures taken. In addition, by the provision of a mechanism for responding to a delivery request, like the content delivery part 6H, video information can be freely exchanged among individual users. A user sometimes wants to view the whole of a video content or at other times wants to view a digest of a video content that collects only scenes of a specific favor or interest. Further, even in cases where a user terminal can not support the reproduction of moving pictures or videos, it is still possible for one to view only representative images (key frames) of wanted scenes in a video content. Selection among these dynamic video content presentation forms is achieved by matching between the metadata associated with video data and the request of a user. [0086] The internal configuration of the content delivery part 6H is similar to the configuration of the content delivery server 5 of the first embodiment as shown in FIG. 4. However, it is necessary to read the interaction thereof with the content database 4 in a different way, so that it is replaced by an internal interaction thereof with the content database part 6A. The content delivery part 6H specifies contents for view candidates from the content database part 6A based on the query information 1E from another user terminal 1 requesting a content, and delivers them as video data 61 and metadata 6J after processing them into the view forms requested by the query information 1E. [0087] In this manner, as stated in the first embodiment, too, the user terminal having received the content delivery can re-create query information based on the metadata 6J, thus making a request for contents again. [0088] Content Reproduction Processing [0089] By the provision of the metadata processor 6K and the video decoder 6M, the user terminal 6 can process the video contents stored in the internal content database part 6A in a various manner to enable the user to view them, and at the same time it can request content delivery to another user terminal. Moreover, the user terminal 6 can receive video data and metadata by requesting a video content to the content database part 6A or other user terminals based on query information 6L. [0090] Therefore, according to this second embodiment, since the user terminal 6 has a function equivalent to the content delivery server 5 and the content database 4 of the first embodiment, it is possible to achieve flexible video content exchanges between a plurality of user terminals possessing video contents without depending upon a conventional client-server model. [0091] Embodiment 3. (Home Server Model) [0092] A third embodiment of the present invention refers, by way of example, to a storage type broadcasting compliant receiver as a case of a video content management and operation system, and describes the configuration thereof. In this third embodiment, assuming the case where metadata in a format common to the MPEG-7 metadata described in the first and second embodiments is given to video contents for broadcasting, a device configuration is provided which is capable of storing the broadcasting video contents in a receiver, and presenting, from among the broadcasting video contents thus stored in the receiver, the video contents wanted by a user in a quick and adequate manner according to various reproduction conditions. [0093]FIG. 6 shows the internal configuration of a storage type broadcasting compliant receiver 7 in this third embodiment. In FIG. 6, 7C designates a content database part, 7D a video encoding part, 7E a metadata processor, 71 a video decoder, and 7J a user interface. [0094] Next, reference will be made to the operation of the storage type broadcasting compliant receiver 7 according to this third embodiment while dividing it into content storage processing and content reproduction processing. [0095] Content Storage Processing [0096] The receiver 7 receives broadcasting video contents comprising video data 7A and metadata 7B from a content delivery server of the first embodiment illustrated in FIG. 1, etc., or a user terminal 6 illustrated in FIG. 5, etc., and accumulates or stores them in the content database part 7C. Here, it is assumed that the metadata 7B conforms to the MPEG-7 compliant metadata (see FIG. 3) described in the first and second embodiments. [0097] Content Reproduction Processing [0098] The video contents registered in the content database part 7C are displayed on a video monitor (not shown) connected with this receiver 7 according to the view request condition of a user. The user's view request condition may be that the user wants to view through the whole of a video content, or watch a digest that collects only scenes of a specific favor, or it may even be a request that the user wants to view only representative images (key frames) of wanted scenes in a video content. Selection among these dynamic video content presentation forms is achieved by matching between the metadata associated with video data and the request of a user. In addition, the content processing of collecting only scenes of a specific favor or interest, etc., is performed by the content processing part 7D. [0099] The most portions of the internal configuration of the content processing part 7D are similar to the configuration of the content delivery server 5 illustrated in FIG. 4, but in cases where the video monitor of a display system is not connected to the content processing part 7D through a network, the content delivery part 5F is unnecessary. However, it is necessary to read the interaction of the content delivery server 5 with the content database 4 in a different way, so that it is replaced by an internal interaction thereof with the content database part 7C. [0100] In the content processing part 7D, when request information on the user's tastes, etc., is input from the user to the metadata processor 7E through the user interface 7J, query information 7F is created by the metadata processor 7E and input to the content processing part 7D. The content processing part 7D specifies contents for view candidates in the content database part 7C based on the query information 7E, and outputs them as video data 7G and metadata 7H after processing them into the view forms requested by the query information 7F. The video data 7G is reproduced on a video monitor (not shown) by the video decoder 71 through the user interface 7J, etc., and on the other hand, the metadata 7H can be input to the metadata processor 7E where it is used as materials for requery information. In order to comply with various view forms, the video decoder 71 may be provided with a multi-format decoder compliant with various video formats such as, for example, MPEG-2, MPEG-4, MPEG-2, JPEG, etc. [0101] Although in the above-mentioned explanation, reference has been made to the system with broadcasting video contents as its input as shown in FIG. 6, the broadcasting video contents can be interpreted as video contents recorded in recording mediums such as DVDs, as illustrated in FIG. 7. In this case, the content database part 7C is interpreted as a DVD reproduction part as it is. The DVD reproduction part has a function of interpreting a DVD as a storage medium instead of the local storage medium in the system, and outputting the video contents to be processed based on a request from the content processing part 7D. The configuration of this embodiment other than the above is the same as the configuration or operation of the system illustrated in the above-mentioned FIG. 6. [0102] Further, as shown in FIG. 8, the receiver 7 in this fourth embodiment has a function of inputting, from the outside, the broadcasting video contents comprising the video data 7A and the metadata 7B illustrated in FIG. 6 and FIG. 7 or the video contents recorded in a recording medium (note, however, that FIG. 8 shows the case where the broadcasting video contents illustrated in FIG. 6 are input), as well as an authoring function provided by the video encoding part 6B and the authoring part 6D as in the user terminal 6 of the second embodiment shown in FIG. 5, so that the video contents produced by the user himself or herself through the use of the authoring function can be handled similar to broadcasting video contents. In this figure, the video encoding part 6B, the video data 6C and the authoring part 6D are equivalent in functions to the members of the same names in the user terminal 6 of the second embodiment illustrated in FIG. 5, and hence identified by the same symbols. [0103] Thus, according to this third embodiment, assuming the case where metadata in a format common to the MPEG-7 metadata described in the first and second embodiments is given to broadcasting video contents, the broadcasting video contents are stored in the receiver 7, so that the video contents wanted by a user can be presented from among the broadcasting video contents thus stored in the receiver 7 in a quick and adequate manner according to various reproduction conditions. As a result, a system can be achieved which is capable of presenting the video contents for example stored in a receiver 7 in a home in a flexible manner in accordance with a variety of user's view conditions such as indoor or outdoor, etc. [0104] Furthermore, the above-mentioned system can be constructed into a system which supports IP protocol groups (RTP/UDP/IP, TCP/IP, RTSP, etc.) for Internet connection and video delivery, by reading �the video contents for Internet delivery� for �the broadcasting video contents comprising the video data 7A and the metadata 7B�. [0105] Further, by the provision of the function of the content delivery part 6H in the user terminal 6 of the second embodiment illustrated in FIG. 5, it is possible to achieve the function of delivering videos or images to another terminal with an IP connection indoor or outdoor. With such a system, it is possible to construct a system in which users can view, at any time and in any place, the video contents stored in a database while adapting them to dynamically varying view conditions such as, for instance, the type of terminals, place, time, tastes for view forms, etc. EFFECTS OF THE INVENTION [0106] As described in the foregoing, according to the present invention, when video contents comprising video data and metadata related to the video data are sent, one or more video contents for presentation candidates are extracted based on a request condition concerning the presentation forms of the video contents, the extracted video contents are processed into video contents in the forms to be presented, based on the above-mentioned request condition concerning the presentation forms of the video contents and the metadata of the above-mentioned extracted video contents, so that the processed video contents can be sent out according to a prescribed protocol. As a result, it is possible to present video contents on a platform having various video reproduction environments mixed with one another in a quick and adequate manner based on the request condition at the side of viewing the video contents. In particular, it is possible to process the video contents dynamically in compliance with a view request by means of a mechanism of managing the video contents in metadata pairs corresponding to video data. [0107] In addition, in the present invention, the analysis processing of the video data is carried out to create metadata related to the video data, and video contents comprising the video data and the thus created metadata related to the video data are stored. Accordingly, it is possible to present the video contents wanted by the user from among the broadcasting video contents thus stored in a quick and proper or accurate manner according to various reproduction conditions, as a consequence of which there can be provided a system capable of presenting the video contents for example stored in a receiver 7 in a house in a flexible manner in accordance with a variety of user's view conditions such as in house or outdoor, etc. On the other hand, by further providing a function of delivering the video data, it is possible to achieve flexible video content exchanges between a plurality of user terminals possessing video contents without depending upon a conventional client-server model. INDUSTRIAL APPLICABILITY [0108] The present invention can be applied to a system which collectively manages video contents so as to present desired videos or images from among a huge amount of video contents in a quick and accurate manner on a platform with various reproduction environments mixed with one another. In particular, the present invention is applicable to a video content sending device and method, which are necessary for a system construction technology related to the management, operation and processing of digital video information, and it is also applicable to a video content storage device, a video content reproduction device and method, a metadata creation device, and a video content management and operation method. Referenced byCiting PatentFiling datePublication dateApplicantTitleUS7644139 *May 2, 2006Jan 5, 2010Research In Motion LimitedMethod and system for optimizing metadata passing in a push content processing protocolUS7725876 *Jun 6, 2005May 25, 2010Ntt Docomo, Inc.Original contents creation apparatus, derived contents creation apparatus, derived contents using apparatus, original contents creation method, derived contents creation method, and derived contents using method and verification methodUS7853691 *Nov 2, 2007Dec 14, 2010Broadcom CorporationMethod and system for securing a network utilizing IPsec and MACsec protocolsUS8019892 *May 2, 2006Sep 13, 2011Research In Motion LimitedMulti-layered enveloped method and system for push content metadataUS8037105Mar 18, 2005Oct 11, 2011British Telecommunications Public Limited CompanyComputer apparatusUS8095607 *Dec 30, 2009Jan 10, 2012Research In Motion LimitedMethod and system for optimizing metadata passing in a push content processing protocolUS8209729 *Apr 20, 2006Jun 26, 2012At&T Intellectual Property I, LpRules-based content managementUS8392947 *Jun 30, 2006Mar 5, 2013At&T Intellectual Property I, LpSystem and method for home audio and video communicationUS8402491 *Dec 11, 2007Mar 19, 2013Samsung Electronics Co., Ltd.Apparatus and method for searching TV programUS8464066 *Jun 30, 2006Jun 11, 2013Amazon Technologies, Inc.Method and system for sharing segments of multimedia dataUS8561081 *Nov 13, 2007Oct 15, 2013Accenture Global Services LimitedSystem and method for dynamic brokering of digital content requestsUS8621542 *Aug 10, 2004Dec 31, 2013Warner Bros. Entertainment Inc.Digital media distribution deviceUS20060198438 *May 18, 2006Sep 7, 2006Shinji NegishiScene description generating apparatus and method, scene description converting apparatus and method, scene description storing apparatus and method, scene description decoding apparatus and method, user interface system, recording medium, and transmission mediumUS20080275876 *Jul 23, 2008Nov 6, 2008Samsung Electronics Co., Ltd.Storage medium storing search information and reproducing apparatus and methodUS20100251313 *Mar 31, 2010Sep 30, 2010Comcast Cable Communications, LlcBi-directional transfer of media content assets in a content delivery networkUS20110179003 *Jan 21, 2010Jul 21, 2011Korea Advanced Institute Of Science And TechnologySystem for Sharing Emotion Data and Method of Sharing Emotion Data Using the SameUS20110219322 *Mar 2, 2010Sep 8, 2011Twentieth Century Fox Film CorporationDelivery of encoded media contentWO2008074053A1 *Nov 27, 2007Jun 26, 2008Canon KkDynamic layouts* Cited by examinerClassifications U.S. Classification348/468, 375/E07.024, 348/460, 348/E07.071, 348/E07.073, 348/473, 725/136, 348/461, 725/135International ClassificationH04N7/173, G06F17/30, G06F13/00, H04N5/765, H04N5/76Cooperative ClassificationH04N7/17336, H04N21/6125, H04N21/6175, H04N21/25891, H04N21/25833, H04N21/2181, H04N21/23109, H04N21/84, H04N21/235, H04N21/47202, H04N21/23412, H04N21/858, H04N21/2353, H04N21/435, H04N21/4722, H04N7/17318, H04N21/8456, H04N21/2668, H04N21/4755, H04N21/4828, H04N21/854, H04N21/2225European ClassificationH04N21/218R, H04N21/234C, H04N21/231D, H04N21/84, H04N21/858, H04N21/258C3, H04N21/235M, H04N21/482S, H04N21/258U3, H04N21/61D3, H04N21/475P, H04N21/4722, H04N21/854, H04N21/61U3, H04N21/472D, H04N21/845T, H04N21/2668, H04N21/2225, H04N21/435, H04N21/235, H04N7/173B4, H04N7/173B2Legal EventsDateCodeEventDescriptionApr 28, 2004ASAssignmentOwner name: MITSUBISHI DENKI KABUSHIKI KAISHA, JAPANFree format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:SEKIGUCHI, SHUNICHI;NISHIKAWA, HIROFUMI;MORIYA, YOSHIMI;AND OTHERS;REEL/FRAME:015696/0903Effective date: 20040309RotateOriginal ImageGoogle Home - Sitemap - USPTO Bulk Downloads - Privacy Policy - Terms of Service - About Google Patents - Send FeedbackData provided by IFI CLAIMS Patent Services©2012 Google