Source: https://patents.google.com/patent/KR20110042067A/en
Timestamp: 2020-01-23 22:28:25
Document Index: 9577076

Matched Legal Cases: ['art 202', 'art 708', 'art 804', 'art 805', 'art 806', 'art 806', 'art 805', 'art 708', 'art5', 'art5']

KR20110042067A - Data transmission device, data reception device, method for transmitting data, method for receiving data, and method for controlling audio-visual environment - Google Patents
Data transmission device, data reception device, method for transmitting data, method for receiving data, and method for controlling audio-visual environment Download PDF
KR20110042067A
KR20110042067A KR1020117002446A KR20117002446A KR20110042067A KR 20110042067 A KR20110042067 A KR 20110042067A KR 1020117002446 A KR1020117002446 A KR 1020117002446A KR 20117002446 A KR20117002446 A KR 20117002446A KR 20110042067 A KR20110042067 A KR 20110042067A
KR1020117002446A
야스아끼 도꾸모
요시아끼 오기사와
슈히찌 와따나베
노리오 이또
다꾸야 이와나미
2008-07-15 Priority to JP2008183813 priority Critical
2008-07-15 Priority to JPJP-P-2008-183813 priority
2009-01-27 Priority to JP2009015429 priority
2009-01-27 Priority to JPJP-P-2009-015429 priority
2009-07-14 Application filed by 샤프 가부시키가이샤 filed Critical 샤프 가부시키가이샤
2011-04-22 Publication of KR20110042067A publication Critical patent/KR20110042067A/en
The present invention provides a data transmission device, a data reception device, a data transmission method, a data reception method, and a viewing environment control method for controlling a peripheral device intended by a content producer to realize high viewing of content. The data transmission apparatus is provided to the video encoding unit 101, the audio encoding unit 102, the viewing environment control data encoding unit 103, the viewing environment control data input unit 104, the data multiplexing unit 105, and the transmitting unit 106. It is composed. The viewing environment control data input unit 104, as the viewing environment control data for one or more peripheral devices in the viewing environment space for reproducing video data and / or audio data, includes control specified values for the peripheral devices, and Manufacturer preference information indicative of the error tolerance for the control specified value is input and transmitted together with the video data and / or the audio data.
Data transmitting device, data receiving device, data transmitting method, data receiving method and viewing environment control method {DATA TRANSMISSION DEVICE, DATA RECEPTION DEVICE, METHOD FOR TRANSMITTING DATA, METHOD FOR RECEIVING DATA, AND METHOD FOR CONTROLLING AUDIO-VISUAL ENVIRONMENT}
The present invention provides a data transmission device, a data reception device, a data transmission method, a data reception method, and a viewing environment for transmitting and receiving data for operating various peripheral devices in conjunction with video / audio content in order to realize high viewing of content. It relates to a control method.
In recent years, a method of realizing viewing of content with high realism has been proposed by operating various peripheral devices such as lighting, a fan, and an air conditioner in a viewing space in association with video / audio content. For example, Patent Documents 1 and 2 disclose an illumination control method capable of obtaining a high sense of reality by controlling viewing environment lighting in association with an image displayed on an image display device.
Japanese Patent Laid-Open No. 2000-173783 Japanese Patent Laid-Open No. 2001-343900
However, in the conventional method, when the specification of the lighting device of the user does not strictly support the lighting condition (for example, the brightness or the color temperature of the lighting) intended by the content creator, the user attaches the lighting. It was difficult to judge whether or not it should. In addition, depending on the time, place, and state when viewing these contents, the user may need to adjust the execution of additional effects that cause a high realism, such as lighting, due to consideration to others. The operation setting of the peripheral device had to be performed.
SUMMARY OF THE INVENTION The present invention has been made to solve the above problems, and a data transmission device, a data reception device, a data transmission method, a data reception method, and a viewing environment control that realize content viewing with high realism by controlling peripheral devices intended by a content producer. Its purpose is to provide a method.
In order to solve the said subject, the 1st technical means of this invention is a viewing environment with respect to one or more peripheral devices in the viewing environment space which reproduces the video data and / or audio data, and the said video data and / or audio data. A data transmission device comprising a transmission means for multiplexing control data and transmitting the data, wherein the viewing environment control data includes a manufacturer preference information indicating a control specified value for the peripheral device and an error tolerance range for the control specified value. It is characterized by including.
The second technical means multiplexes the video data and / or audio data and identification information for identifying the viewing environment control data for one or more peripheral devices in the viewing environment space for reproducing the video data and / or audio data. A data transmission device comprising multiplexed data and transmission means for transmitting the viewing environment control data, wherein the viewing environment control data indicates a control designation value for the peripheral device and an error tolerance range for the control designation value. It is characterized by including producer preference information.
The third technical means is provided with transmission means for transmitting viewing environment control data to one or more peripheral devices in a viewing environment space for reproducing predetermined video data and / or audio data in response to a request from the outside. And a viewing apparatus, wherein the viewing environment control data includes control specification values for the peripheral apparatuses and producer preference information indicating an error tolerance range for the control specification values.
The fourth technical means, in any of the first to third technical means, the producer preference information includes allowed type information for allowing the peripheral device to be controlled only by the control specified value. It is.
The fifth technical means, in any one of the first to third technical means, the producer preference information includes permission type information for allowing the peripheral device to be controlled to a value smaller than the control specified value. It is characterized by.
The sixth technical means, in any one of the first to third technical means, the producer preference information includes permission type information for allowing the peripheral device to be controlled to a value larger than the control specified value. It is characterized by.
The seventh technical means, in any one of the first to third technical means, permits the author preference information to permit the peripheral device to be controlled to a value within a predetermined range including the control specified value. It is characterized by including the category information.
The eighth technical means, in any one of the fifth to seventh technical means, wherein the producer preference information includes approximate tolerance information indicating a range in which the value is allowed as a ratio with respect to the control specified value. It is characterized by.
The ninth technical means is the technical means according to any one of the first to eighth aspects, wherein the control designation value is represented by a quantized value.
The tenth technical means is that, in any of the first to ninth technical means, the producer preference information is described as an XML attribute.
The eleventh description means is that, in any one of the first to ninth description means, the producer preference information is described as an XML element.
The twelfth technical means is one of the first to eleventh technical means, wherein the viewing environment control data is described in scene units of the video data.
The thirteenth technical means is one of the first to eleventh technical means, wherein the viewing environment control data is described in units of shots of the video data.
The fourteenth technical means is one of the first to eleventh technical means, wherein the viewing environment control data is described in units of frames of the video data.
The fifteenth technical means is any one of the first to fourteenth technical means, wherein the viewing environment control data is lighting control data for one or more lighting devices in the viewing environment space.
The sixteenth technical means receives multiplexed data including video data and / or audio data and viewing environment control data for one or more peripheral devices in a viewing environment space for reproducing the video data and / or audio data. A data receiving apparatus having a receiving means, wherein the viewing environment control data includes control preference values for the peripheral apparatuses and producer preference information indicating an error tolerance range for the control specification values. .
The seventeenth technical means includes video data and / or audio data and identification information for identifying viewing environment control data for one or more peripheral devices in the viewing environment space for reproducing the video data and / or audio data. A data receiving device comprising receiving means for receiving multiplexed data and receiving the viewing environment control data based on the identification information, wherein the viewing environment control data includes a control designation value for the peripheral device and the control. It is characterized by including manufacturer preference information indicating an error tolerance range for a specified value.
The eighteenth technical means receives a video data and / or audio data and controls a viewing environment for at least one peripheral device in a viewing environment space that reproduces the video data and / or audio data based on a user's request. A data receiving apparatus having a receiving means for receiving data, wherein the viewing environment control data includes a manufacturer's preference information indicating a control specification value for the peripheral device and an error tolerance range for the control specification value. It is a feature.
The nineteenth technical means is the technical means according to any one of the sixteenth to eighteenth aspects, wherein the producer preference information includes allowable type information for allowing the peripheral device to be controlled only by the control specified value. It is.
The twentieth technical means, in any of the sixteenth to eighteenth technical means, wherein the producer preference information includes permission type information for allowing the peripheral device to be controlled to a value smaller than the control specified value. It is characterized by.
The twenty-first technical means according to any of the sixteenth to eighteenth technical means, wherein the producer preference information includes permission type information for allowing the peripheral device to be controlled to a value larger than the control specified value. It is characterized by.
The twenty-second technical means allows, in any one of the sixteenth to eighteenth technical means, the author preference information to permit the peripheral device to be controlled to a value within a predetermined range including the control specified value. It is characterized by including the category information.
The twenty-third technical means is the technical means in any one of twentieth to twenty-second aspects, wherein the producer preference information includes approximate allowable range information indicating a range in which the value is allowed as a ratio with respect to the control specified value. It is characterized by.
The twenty-fourth technical means is the technical means according to any one of sixteenth to twenty-third, wherein the control specified value is represented by a quantized value.
The twenty-fifth technical means is one of the sixteenth to twenty-fourth technical means, wherein the producer preference information is represented by an XML attribute.
The twenty sixth technical means is one of the sixteenth to twenty-fourth technical means, wherein the producer preference information is represented by an XML element.
The twenty-seventh technical means is one of the sixteenth to twenty-sixth technical means, wherein the viewing environment control data is represented by a new unit of the video data.
The twenty-eighth technical means is one of the sixteenth to twenty-sixth technical means, wherein the viewing environment control data is expressed in units of shots of the video data.
The twenty-ninth technical means is one of the sixteenth to twenty-sixth technical means, wherein the viewing environment control data is expressed in units of frames of the video data.
The thirtieth technical means is the technical means according to any one of sixteenth to twenty-ninth aspects, wherein the viewing environment control data is lighting control data for one or more lighting devices in the viewing environment space.
The thirty-first technical means further has acquisition means for acquiring the user's preference data for limiting the operation of the peripheral device based on the viewing environment control data in any one of the sixteenth to thirty technical means. It is characterized by.
The thirty-third description means is that, in the thirty-first description means, the preference data of the user includes information on operation of the peripheral device and / or restriction information on the control designation value.
The thirty-third description means is that, in the thirty-first or thirty-second description means, the preference data of the user includes viewing environment information describing conditions under which the preference data of the user is applied.
The thirty-fourth technical means is the thirty-third technical means wherein the viewing environment information includes information on a time and / or a place to which the preference data of the user is applied.
The thirty-fifth technical means is a data transmission method for multiplexing and transmitting video data and / or audio data and viewing environment control data for one or more peripheral devices in a viewing environment space for reproducing the video data and / or audio data. And the viewing environment control data includes control preference values for the peripheral apparatuses and producer preference information indicating an error tolerance range for the control specification values.
The thirty-sixth technical means multiplexes the video data and / or audio data and identification information for identifying the viewing environment control data for one or more peripheral devices in the viewing environment space for reproducing the video data and / or audio data. A data transmission method for transmitting multiplexed data and the viewing environment control data, wherein the viewing environment control data includes producer preference information indicating a control specified value for the peripheral device and an error tolerance range for the control specified value. It is characterized by including.
The thirty-seventh technical means is a data transmission method for transmitting viewing environment control data to one or more peripheral devices in a viewing environment space for reproducing predetermined video data and / or audio data in response to a request from the outside. The viewing environment control data is characterized by including control preference values for the peripheral devices and producer preference information indicating an error tolerance range for the control specification values.
The thirty-eighth technical means is further configured to receive multiplexed data including video data and / or audio data and viewing environment control data for one or more peripheral devices in a viewing environment space for reproducing the video data and / or audio data. It is a data reception method, The said viewing environment control data is characterized by including the manufacturer's preference information which shows the control specification value with respect to the said peripheral apparatus, and the tolerance range with respect to the said control specification value.
The thirty-third technical means includes video data and / or audio data and identification information for identifying viewing environment control data for one or more peripheral devices in the viewing environment space that reproduces the video data and / or audio data. A data receiving method of receiving multiplexed data and receiving the viewing environment control data based on the identification information, wherein the viewing environment control data includes a control designation value for the peripheral device and an error in the control designation value. It is characterized by including manufacturer preference information indicating an allowable range.
The forty-th technical means controls viewing environment for one or more peripheral devices in the viewing environment space for receiving the video data and / or audio data and reproducing the video data and / or audio data based on a user's request. A data receiving method for receiving data, wherein the viewing environment control data includes producer preference information indicating a control specification value for the peripheral device and an error tolerance range for the control specification value.
The forty-first technical means receives multiplexed data including video data and / or audio data and viewing environment control data for one or more peripheral devices in a viewing environment space for reproducing the video data and / or audio data. A viewing environment control method, wherein the viewing environment control data includes control preference values for the peripheral devices and producer preference information indicating an error tolerance range for the control specification values.
The 42nd technical means includes image data and / or audio data, and identification information which identifies viewing environment control data for at least one peripheral device in the viewing environment space for reproducing the image data and / or audio data. A viewing environment control method for receiving multiplexed data and receiving the viewing environment control data based on the identification information, wherein the viewing environment control data includes a control designation value for the peripheral device and a control designation value. It is characterized by including manufacturer preference information indicating an error tolerance range.
The 43rd technical means receives a video data and / or audio data, and controls viewing environment with respect to one or more peripheral devices in the viewing environment space which reproduces the video data and / or audio data based on a user's request. A viewing environment control method for receiving data, wherein the viewing environment control data includes a control specification value for the peripheral device and producer preference information indicating an error tolerance range for the control specification value. .
The forty-fourth technical means receives multiplexed data including video data and / or audio data and viewing environment control data for one or more peripheral devices in a viewing environment space for reproducing the video data and / or audio data. A data receiving device comprising a receiving means and acquiring means for acquiring preference data of a user for limiting the operation of the peripheral device based on the viewing environment control data, wherein the viewing environment control data is stored in the peripheral device. And at least one control specified value, and the preference data of the user includes information on operation of the peripheral device and / or restriction information on the control specified value.
The forty-fifth technical means includes video data and / or audio data and identification information for identifying viewing environment control data for one or more peripheral devices in the viewing environment space for reproducing the video data and / or audio data. Receiving means for receiving the multiplexing data and receiving the viewing environment control data based on the identification information, and obtaining preference data of a user for limiting the operation of the peripheral device based on the viewing environment control data. A data receiving apparatus having acquisition means, wherein the viewing environment control data includes at least a control designation value for the peripheral device, and the preference data of the user includes information on operation of the peripheral device and / or the And limit information on the control designation value.
The forty-sixth technical means controls viewing environment for one or more peripheral devices in the viewing environment space for receiving the video data and / or audio data and reproducing the video data and / or audio data based on a user's request. A data receiving apparatus comprising: receiving means for receiving data and acquisition means for acquiring preference data of a user for limiting the operation of the peripheral device based on the viewing environment control data, wherein the viewing environment control data includes: And at least a control designation value for the peripheral device, and the preference data of the user includes information on whether the peripheral device is operated and / or restriction information on the control designation value.
The forty-ninth technical means, in any of the forty-fourth to forty-ninth technical means, wherein the user's preference data includes viewing environment information describing conditions under which the user's preference data is applied. It is.
The forty-eighth technology means in the forty-eighth technology means, wherein the viewing environment information includes information of time and / or place to which the preference data of the user is applied.
The forty-ninth technical means receives multiplexed data including video data and / or audio data and viewing environment control data for one or more peripheral devices in a viewing environment space for reproducing the video data and / or audio data. And a data receiving method for acquiring preference data of a user for limiting an operation of the peripheral device based on the viewing environment control data, wherein the viewing environment control data includes at least a control specified value for the peripheral device. The preference data of the user may include operation information on the peripheral device and / or restriction information on the control specified value.
The fifty technical means includes identification data identifying video data and / or audio data and viewing environment control data for one or more peripheral devices in the viewing environment space for reproducing the video data and / or audio data. A data receiving method for receiving multiplexed data, receiving the viewing environment control data based on the identification information, and obtaining preference data of a user for limiting the operation of the peripheral device based on the viewing environment control data. And the viewing environment control data includes at least a control designation value for the peripheral device, and the preference data of the user includes information on whether to operate the peripheral device and / or restriction information on the control designation value. It is characterized by including.
The fifty-first technical means receives a video data and / or audio data and controls a viewing environment for at least one peripheral device in a viewing environment space that reproduces the video data and / or audio data based on a user's request. A data receiving method for receiving data and obtaining preference data of a user for limiting an operation of the peripheral device based on the viewing environment control data, wherein the viewing environment control data is a control designation value for the peripheral device. And at least the preference data of the user includes information on whether to operate the peripheral device and / or restriction information on the control specified value.
According to the present invention, by describing the preferences of the content producer or the content provider as the viewing environment control data corresponding to the viewing content, it is possible to perform appropriate control intended by the content producer or the content provider for the peripheral device in the content viewing environment. In this way, content viewing with a high sense of presence can be realized. In addition, the user (viewer) can realize the viewing environment control in accordance with the viewing situation by setting execution conditions for viewing environment control in accordance with the user's preferences and viewing situation.
1 is a functional block diagram showing a schematic configuration of a data transmission device according to an embodiment of the present invention.
FIG. 2 is a diagram showing a schematic configuration in the case of transmitting the viewing environment control data to a network different from the video / audio multiplexing data in the data transmitting apparatus of FIG. 1; FIG.
3 is a functional block diagram showing an internal configuration of a viewing environment control data input unit;
4 is a diagram illustrating an example of description content in an effect input unit.
5 is a diagram illustrating an example of description contents of a producer preference in a preference input unit.
Fig. 6 is a diagram showing an example of XML description of the viewing environment control data according to the first embodiment.
7 is an XML schema description example of the viewing environment control data format according to the first embodiment;
8 is a functional block diagram showing a schematic configuration of a data receiving apparatus according to an embodiment of the present invention.
FIG. 9 is a diagram showing a schematic configuration in the case of receiving viewing environment control data from a network different from video / audio multiplexing data in the data receiving apparatus shown in FIG. 8; FIG.
10 is a functional block diagram showing an internal configuration of a device control section.
11 is a flowchart for explaining an operation of a device controller.
It is a figure for demonstrating the application example of the manufacturer preference in one Embodiment of this invention.
Fig. 13 is an XML description example of viewing environment control data according to another embodiment of the present invention.
14 is an XML schema description example of a viewing environment control data format according to another embodiment of the present invention.
Fig. 15 is a diagram showing the operation flow of the device control unit in another embodiment of the present invention.
Fig. 16 is an example of XML description of viewing environment control data according to still another embodiment of the present invention.
17 is an XML schema description example of a viewing environment control data format according to another embodiment of the present invention.
18 shows an example of quantization of color temperature values.
19 shows an example of quantization of wind speed values.
Fig. 20 is a diagram showing an example of data of user preferences describing an execution method for each additional effect.
21 is a functional block diagram illustrating a modification of the data receiving device.
Fig. 22 is a functional block diagram illustrating a modification of the internal configuration of the device control unit.
Fig. 23 is a flowchart showing operation of the device control unit in still another embodiment of the present invention.
24 is a diagram for explaining an application example of a user preference.
Fig. 25 is a diagram showing an example of data describing information of a viewing environment in a user preference.
Fig. 26 is a diagram illustrating an example of description of a user preference using viewing environment information and control information of additional effects.
Fig. 27 is an example of XML description of a user preference in still another embodiment of the present invention.
Fig. 28 illustrates an XML schema description example of a user preference format according to still another embodiment of the present invention.
29 is a diagram illustrating an example of a filtering technique of an additive effect.
First, a data transmission apparatus will be described. 1 is a functional block diagram showing a schematic configuration of a data transmission apparatus according to an embodiment of the present invention.
The data transmission apparatus is provided to the video encoding unit 101, the audio encoding unit 102, the viewing environment control data encoding unit 103, the viewing environment control data input unit 104, the data multiplexing unit 105, and the transmitting unit 106. It is composed.
The input video data is compressed and encoded by the video encoder 101 and output to the data multiplexer 105. For video encoding, various compression methods such as ISO / IEC 13818-2 (MPEG-2 Video), ISO / IEC 14496-2 (MPEG-4 Visual), ISO / IEC 14496-10 (MPEG-4 AVC) can be used. .
Similarly, the input speech data is compressed and encoded by the speech encoding unit 102 and output to the data multiplexing unit 105. Various compression schemes such as ISO / IEC 13818-7 (MPEG-2 AAC) and ISO / IEC 14496-3 (MPEG-4 Audio) can be used for speech coding.
In addition, the viewing environment control data input from the viewing environment control data input unit 104 is compressed and encoded by the viewing environment control data encoding unit 103 and output to the data multiplexing unit 105. In addition, the detail of viewing environment control data is mentioned later. As a method of describing the viewing environment control data, for example, an XML (Extensible Markup Language) format or the like is used. As the compression method of the viewing environment control data, a BiM (Binary format for MPEG-7) method or the like in ISO / IEC 15938-1 (MPEG-7 Systems) can be used. Alternatively, the output may be performed in XML format without compression.
The encoded video data, audio data, and viewing environment control data are multiplexed by the data multiplexer 105, and transmitted or accumulated through the transmitter 106. As the multiplexing method, for example, MPEG-2 transport stream packet (TSP), IP packet, RTP packet or the like in ISO / IEC 13818-1 (MPEG-2 Systems) can be used.
For example, in the case of using a transport stream packet (TSP) specified in MPEG-2, the viewing environment control data is described in the extended header portion, following the header in which the information specified in MPEG-2 is described. It is possible to transmit the video data and the audio data in the payload following the extended header. Alternatively, the viewing environment control data may be transmitted in the payload as in the video data or the audio data. In addition, different data streams of video data, audio data, and viewing environment control data may be multiplexed and transmitted.
In the above description, the video, audio, and viewing environment control data are multiplexed and transmitted, but the video / audio multiplexing data and viewing environment control data may be transmitted to different networks. For example, video / audio multiplexing data is transmitted as broadcast data, and viewing environment control data is transmitted to the Internet.
FIG. 2 is a diagram illustrating a schematic configuration in a case where the viewing environment control data is transmitted to a network different from the video / audio multiplexing data in the data transmission device of FIG. 1. In FIG. 2, the same code | symbol is attached | subjected to the block of the same function as FIG.
The viewing environment control data encoded by the viewing environment control data encoding unit 103 is accumulated in the accumulation unit 1403 from the viewing environment control data transmission unit 1401 via the viewing environment control data server 1402. In addition, the data multiplexing unit 105 notifies the data multiplexing unit 105 of a Uniform Resource Locator (URL) for identifying the viewing environment control data from the viewing environment control data transmitting unit 1401, and multiplexes the image / audio data to transmit the data receiving apparatus. Since the side can acquire the viewing environment control data from the viewing environment control data server 1402 based on the URL as this identification information, the side can link the video / audio multiplexing data and the viewing environment control data. The transmission of the viewing environment control data may be performed simultaneously with the transmission of the video / audio multiplexing data, or may be performed upon the request of an external user.
In addition, when the viewing environment control data is transmitted to a network different from the video / audio multiplexing data, the identification information for associating the viewing environment control data with the video / audio multiplexing data is not limited to the above-mentioned URL, but is a TV-Anytime standard. The identification information may specify a correspondence relationship between the video / audio multiplexing data and the viewing environment control data such as a CRID (Content Reference ID) and a content name.
Alternatively, only viewing environment control data may be recorded and distributed on a separate recording medium. For example, video / audio data may be distributed in a large capacity recording medium such as a Blu-ray Disc or DVD, and viewing environment control data may be distributed in a small semiconductor recording medium or the like. Even in this case, when recording and distributing a plurality of contents, identification information capable of specifying a correspondence relationship between video / audio data and viewing environment control data is required.
Next, the viewing environment control data input unit 104 will be described. 3 is a functional block diagram illustrating an internal configuration of the viewing environment control data input unit 104. The viewing environment control data input unit 104 includes an effect input unit 201, a preference input unit 202, and a format unit 203.
4 is a diagram illustrating an example of the description content in the effect input unit. In the effect input unit 201, effect types and conditions (values indicating effects) added to the content are input.
For example, in the case of the lighting effect, as shown in FIG. 4, the brightness (unit: lx) of the lighting in the recommended viewing environment of the content creator or the content provider, the color temperature (unit: K) of the lighting, etc. It is specified as an illumination condition. In addition, you may use candela (Cd), lumen (lm), etc. instead of lx (lx) for expression of brightness. In addition, you may use an XYZ color system, an RGB color system, a YCbCr color system, etc. instead of color temperature.
Here, the video data can produce the atmosphere and the realism of each scene by the illumination light, and the illumination condition for the illumination device is useful information.
For example, by controlling the illumination of the viewing environment, the realism of each scene of the modern and contemporary dramas can be improved. That is, the color temperature of the light of the lighting equipment generally used in the modern drama is about 5000K for fluorescent lamps (day white), about 6700K for fluorescent lamps (daylight color), and about 2800K for incandescent bulbs. On the other hand, the color temperature of the flame of the candle which is often used as a light source of the night in the historical drama is about 1800-2500K. Moreover, in modern theater, the lighting intensity is strong, and in the historical drama, the lighting intensity tends to be weak.
Therefore, when the indoor scene of the sunset is photographed in the period drama, the realism is not obtained in the viewing in an environment where the color temperature of the illumination is high and the illumination intensity is strong, so that the viewing is performed in a viewing environment that is contrary to the intention of the content producer or the content provider.
For this reason, when the content producer or the content provider views the video data or the audio data, it is recommended that the content producer or the content provider specify the conditions for the various peripheral devices for the proper control intended by the producer to the peripheral devices in the content viewing environment. Preferably, as this condition, a content producer or a content provider can actually create the video data or audio data, for example, by designating lighting conditions (brightness, color temperature) in each scene. Alternatively, by analyzing the image data or the image coded data, the average brightness or the dominant color of the entire screen or the periphery of the screen is automatically extracted, and the lighting conditions such as the brightness of the illumination or the color temperature based on the extracted luminance information or color information. May be determined. In addition, what is necessary is just to add and specify the manufacturer preference mentioned later at that time.
In addition, although illumination, wind, and temperature are shown by effect type in FIG. 4, what kind of thing may be used as long as it gives a real sense to a viewing space in conjunction with vibration, a fragrance, and reproduction of content besides these.
The viewing environment control data can be added in a frame unit, a shot unit, or a scene unit of the video data. At least the viewing environment control data may be added in a new unit. However, when the viewing environment control data is added in units of frames, a finer viewing environment can be controlled. For example, the viewing environment control data may be added only to a specific frame (such as a scene change frame) in accordance with the intention of the videographer (writer, director, etc.).
In addition, by adding viewing environment control data in each shot unit, it is possible to realize appropriate control of viewing environment lighting even in the case of including indoor and outdoor shots even in the same scene. In addition, you may comprise so that viewing environment control data may be added in GOP (Group of Picture) units etc. which become a unit of random access of video data.
The preference input unit 202 recommends whether the content producer should strictly reproduce the lighting conditions (brightness or color temperature values), etc. specified by the effect input unit 201, or whether the content producer has a permissible range indicated by a predetermined threshold. Or as a preference (symbol) of the content provider.
As an example of the description contents of the preference, as shown in Fig. 5A, for example, " Strict " that permits reproduction of only a specified value, and " Under " , Four types of allowable types of "Over" which allow substitution to an approximate value larger than the specified value, "Both" which permits the substitution to an approximate value smaller than or greater than the specified value, and FIG. 5B. The tolerance range shown as a percentage of the approximate permissible range with respect to a designation value shown by is shown.
In addition, the content (value) input by the preference input part 202 shall be called manufacturer preference or producer preference information. Therefore, the viewing environment control data includes the effect type to be added to the content, its condition (the value indicating the effect, which becomes the control instruction value), and the producer preference.
The format unit 203 outputs the contents input by the effect input unit 201 and the preference input unit 202 according to a predetermined format.
FIG. 6A is an example in which the viewing environment control data for the lighting effect including the producer preference is described in XML, and FIG. 6B shows the XML description in FIG. 6A. It is a figure which shows typically in tree structure.
In FIG. 6, there are two lighting control data (Device Control Data: light1, light2) as device control data of the entire content, and two control data (Control Data (1) and Control Data (2), respectively). ) Is described. Here, Control Data (1) and Control Data (2) are control data arranged in time series, and time information (not shown) is provided to each Control Data.
Each ControlData describes the light's brightness, color temperature, and manufacturer preferences. For example, the ControlData (2) of light1 has a brightness of 200 (lx) and a color temperature of 3000 (K), and a manufacturer's preference of -10%, that is, a brightness of 180 to 200 (lx) and a color temperature. Has a permissible range of 2700 to 3000 (K).
FIG. 7 is a diagram illustrating an XML schema corresponding to the XML description of FIG. 6. Here, the provider preference (ProviderPreference) is defined as an attribute of a ControlData element, but it is not necessarily limited to this. For example, even if it is defined as a child element of a ControlData element. do.
In this way, by adding the effects of lighting, wind, temperature, and the like to the contents, and the preference of the content producer or the content provider for the effects to the viewing environment control data, the specification of the peripheral device in the viewing environment (the In this case, even if the support range of the brightness and the color temperature does not meet the specified conditions, the control intended by the producer can be performed, thereby providing content viewing with a sense of reality.
(Data receiving device)
Next, the data receiving apparatus will be described. 8 is a functional block diagram showing a schematic configuration of a data receiving apparatus according to an embodiment of the present invention.
The data receiving apparatus includes a receiving unit 701, a data separating unit 702, a video decoding unit 703, an audio decoding unit 704, a viewing environment control data decoding unit 705, a video reproducing unit 706, and audio reproduction. The unit 707, the device control unit 708, and the lighting device 709 as an example of the control target device.
The multiplexed data (eg, MPEG-2 transport stream) including the video, audio, and viewing environment control data received by the receiving unit 701 may be used for the video encoding data, the audio encoding data, and the viewing. It is separated into environmental control data and output to the video decoding unit 703, the audio decoding unit 704, and the viewing environment control data decoding unit 705, respectively.
The video encoded data is decoded by the video decoding unit 703 and reproduced by the video reproducing unit 706. The speech encoded data is decoded by the speech decoder 704 and reproduced by the speech reproducer 707. The viewing environment control data is decoded by the viewing environment control data decoding unit 705 and output to the device control unit 708.
The device control unit 708 controls the lighting device 709 in accordance with the inputted viewing environment control data description. In addition, in this embodiment, although only the lighting apparatus 709 is described as a control object apparatus of the apparatus control part 708, a fan, an air conditioner, a vibration apparatus, a fragrance generating apparatus, etc. can also be made into a control object.
In the above description, the video, audio, and viewing environment control data is configured to receive multiplexed data. However, the video, audio multiplexing data and viewing environment control data may be received from different networks. For example, video / audio multiplexing data may be received from broadcast data, and viewing environment control data may be received from the Internet.
FIG. 9 is a diagram showing a schematic configuration in the case of receiving viewing environment control data from a network different from video / audio multiplexing data in the data receiving apparatus shown in FIG. 8. The same code | symbol is attached | subjected to the block of the same function as the data receiving apparatus shown in FIG. 8, and the data transmitting apparatus shown in FIG.
In addition, the data receiving apparatus shown in FIG. 9 corresponds to the data transmitting apparatus shown in FIG.
The viewing environment control data receiving unit 1501 receives the viewing environment control data stored in the accumulating unit 1403 via the viewing environment control data server 1402, and outputs it to the viewing environment control data decoding unit 705. In addition, the viewing environment control data receiving unit 1501 is, for example, a URL (Uniform Resource) for identifying the viewing environment control data multiplexed together with the video / audio data, as described above, from the data separating unit 702. Locator) and the viewing environment control data from the viewing environment control data server 1402 based on this URL, thereby linking the video / audio multiplexing data and the viewing environment control data. The reception of the viewing environment control data may be performed at the timing of obtaining the URL for identifying the viewing environment control data from the data separation unit 702 or may be performed based on a user's request.
The identification information associating the viewing environment control data with the video / audio multiplexing data is not limited to the above URL as described above.
In addition, only viewing environment control data may be acquired from a separate recording medium. For example, video / audio data is obtained from a large capacity recording medium such as a Blu-ray Disc, DVD, and viewing environment control data is obtained from a compact semiconductor recording medium such as a compact flash (registered trademark) or an SD card. A case is mentioned.
Next, the device control unit 708 will be described. FIG. 10 is a functional block diagram showing an internal configuration of the device control unit 708. For convenience of explanation, the lighting device 709 is also described.
The device control unit 708 includes an analysis unit (parser) 801, an effect extraction unit 802, a preference extraction unit 803, a device capability acquisition unit 804, a control value determination unit 805, and a command issuing unit. 806.
The viewing environment control data (FIG. 6) for the lighting control output from the viewing environment control data decoding unit 705 is parsed by the analysis unit 801, and information indicating lighting conditions such as the brightness of the illumination and the color temperature is stored. Information indicating the preference is further output to the effect extraction section 802.
11 is a flowchart for explaining the operation of the device control unit 708, and will be described below based on the processing contents of each step.
First, the analysis unit 801 parses the viewing environment control data output from the viewing environment control data decoding unit 705, and the effect extraction unit 802 specifies a designated value (brightness, Color temperature, etc.) (step S91). On the other hand, the apparatus capability acquisition part 804 acquires the value (support range) of the apparatus capability of the illumination device 709 (step S92).
Next, the control value determination unit 805 compares the specified value of the illumination condition with the support range of the illumination device (step S93). If the specified value is within the support range, the process proceeds to step S94. The command issuing unit 806 issues a command to the lighting device 709 to turn on the lighting at the brightness and color temperature specified by the specified value. The process ends.
If the specified value is out of the support range in step S93, the flow advances to step S95, where the preference extraction unit 803 parses the producer preferences (permissible type and allowable range) from the viewing environment control data parsed by the analysis unit 801. Get. Next, the flow advances to step S96, and the control value determination unit 805 compares the allowable range of the illumination condition derived from the preference with the support range of the illuminating device obtained in step S92. And if it is possible to support in an allowable range, it progresses to step S98 and the control value determination part 805 determines the approximation value closest to the specified value within the support range of a lighting apparatus, and approximates to the command issuing part 806. To pass. The command issuing unit 806 issues a command to the lighting device 709 to turn on the illumination to the approximation value (step S99).
In addition, in step S96, when support is not possible even within the permissible range guide | induced by the preference, it progresses to step S97, and the command issuing part 806 does not issue a command for lighting to a lighting apparatus (step S97), The processing ends with the lighting turned off.
Here, an application example of the manufacturer's preference in the case where each user has three kinds of lighting devices A, B, and C having different specifications will be described with reference to FIG. 12.
The lighting condition designation value of the content producer is 300 (lx) in brightness, and the preference is "Under" 10%, that is, the allowable range is 270 to 300 (lx).
Since the illumination device A has a support range of brightness of 290 to 340 (lx), illumination to the designated value 300 (lx) can be turned on.
In addition, the lighting device B has a support range of brightness of 230 to 280 (lx), and does not support the specified value of 300 (lx), but within the allowable range (270 to 300 (lx)) derived from the preference. Since some 270-280 (lx) are supported, illumination can be turned ON by 280 (lx) closest to a specified value, for example.
Next, the illuminating device C has a support range of 360 to 410 (lx) and does not support the designated value 300 (lx). In addition, the lighting is turned OFF because it does not support the allowable range derived from the preference.
As the illuminating device 709 connected to the data receiving apparatus, it can be comprised by LED which emits light of three primary colors of RGB, for example with predetermined color. However, the illuminating device 709 should just be a structure which can control the illumination color and brightness of the surrounding environment of a video display device, and is not limited to the combination of LED which emits the above-mentioned predetermined color, but is suitable for a white LED and a color filter. Or a combination of a white light bulb, a fluorescent tube and a color filter, a color lamp, or the like. In addition, one or more lighting devices 709 may be provided.
In addition, if the command issuing unit 806 can generate RGB data according to a specified value (brightness, color temperature, etc.) of the lighting condition from the control value determining unit 805 and output it to the lighting apparatus 709, do.
In this way, when the lighting apparatus does not satisfy the designated lighting conditions, the lighting control intended by the manufacturer can be appropriately performed by controlling the lighting ON / OFF to an approximate value according to the preference.
The schematic structure of the data transmission apparatus in this embodiment is the same as that of FIG. 1, FIG. 2, and FIG. In the present embodiment, the operation of the viewing environment control data input unit 104 is different from the first embodiment.
FIG. 13A illustrates an example in which the viewing environment control data for the lighting effect including the producer preference is described in XML, and FIG. 13B illustrates the XML description of FIG. 13A. It is a figure which shows typically in tree structure.
In FIG. 13, unlike the first embodiment, descriptions of preferences are applied not only to the control data (ControlData) but also to a plurality of layers such as device control data (DeviceControlDescription) and lighting control data (DeviceControlData: light1, light2) of the entire content. It is possible. In addition, the description of the preference is not essential, and if not described, for example, the preference of the upper layer (parent element) is referred to. In addition, when there is no description even when referring to the uppermost hierarchy, a preference (for example, allowable type "Both", allowable range 10%, etc.) set as a default is used.
FIG. 14 is a diagram showing an XML schema corresponding to the XML description shown in FIG. Here, the preference (ProviderPreference) is defined as an attribute of a DeviceControlDescription element, a DeviceControlData element, and a ControlData element, but is not necessarily limited to this, and may be defined as a child element for each element, for example.
In this way, by adding the effects of lighting, wind, temperature, and the like to the contents, and the preference of the content producer or the content provider for the effects to the viewing environment control data, the specification of the peripheral device in the viewing environment (the In this case, even if the support range of the brightness and the color temperature does not meet the specified conditions, the control intended by the producer can be performed, thereby providing content viewing with a sense of reality. In addition, by adding the producer preferences to the higher level elements or by adding only the necessary elements, the problem of unnecessarily increasing the amount of data or the burden of adding the producer preferences can be avoided.
The schematic structure of the data receiving apparatus in Embodiment 2 is the same as that of FIG. 8, FIG. 9, and FIG. The operation of the device control unit 708 is different from the first embodiment.
In the present embodiment, unlike the first embodiment, the operation of step S95 for obtaining the preference in the flowchart shown in FIG. 11 is the same as that shown in FIG. 15.
If the specified value is out of the support range in step S93 of FIG. 11, the flow advances to step S131 of FIG. 15, and whether or not the preference is described in the element in the analysis unit 801 and the preference extraction unit 803. Determine. When the preference is described, the process proceeds to step S96 of FIG. 11 to perform subsequent processing.
In addition, in step S131, when the preference is not described in the element, the analysis unit 801 determines whether there is a parent element with respect to the element (step S132). The program moves to the parent element (step S134), and the process proceeds to step S131.
In addition, when there is no higher level element in step S132, it progresses to step S133, and the control value determination part 805 advances to step S96 of FIG. 11 by using a predetermined preference, and performs a subsequent process.
In the example shown in FIG. 13, since the ControlData (1) of light1 has an allowable range of + 5% as a preference, this preference is used, but the ControlData (2) of light1 does not have a preference. The "Strict" is applied to allow the reproduction of only the specified value, which is the preference of DeviceControlData (light1) of the upper layer. In addition, since the ControlData (2) of light2 does not have a preference, and the DeviceControlData (light2) of the higher layer does not have a preference, the preference of the higher-level DeviceControlDescription (permissible type "Both", allowable range 10). %) Is applied.
In Embodiment 1 and 2, although the example of the preference which acts on an illumination control unit was shown, you may also describe the 2nd preference which acts on the whole viewing environment control data. In other words, when the control condition of any lighting is not satisfied, the entire control of the lighting in the content is to be denied (the control of the lighting in which the condition is satisfied is not allowed) or only the control of the lighting in which the condition is not satisfied. You may make it describe the disallowed type flag which selects whether to make into disallow (permission of the control of the said lighting with conditions satisfied).
Further, the disallowed type flag may be transmitted and received collectively together with each control data in the content, or may be transmitted and received before the actual control data.
FIG. 16A illustrates an example in which the viewing environment control data for lighting effect including the permission type flag (PermissionFlag) is described in XML. FIG. 16B is a diagram schematically showing the XML description of FIG. 16A in a tree structure. PermissionFlag = "1" means the former (disallowing the entire control of the illumination in the content when the control condition of the arbitrary illumination is not satisfied). That is, if any of the lighting control data for light1 does not satisfy the condition, all control of light1 is disabled. On the other hand, PermissionFlag = "0" means the latter (only the control of the above lighting that the condition is not satisfied is allowed). That is, even if there is control data that does not satisfy the condition among the light control data for light2, not all the controls of light2 are denied, but only the control of light2 that does not satisfy the condition is denied. If PermissionFlag = "0", at the same time, as the author's preference, PermissionType (equivalent to the Permission attribute in Example 1 or 2) and PermissionRange (equivalent to the Range attribute in Example 1 or 2) ) May be described.
17 is a diagram showing an XML schema for the XML description shown in FIG. Here, PermissionFlag, PermissionType, and PermissionRange are defined as child elements of the Condition element, but are not necessarily limited thereto, and may be defined as attributes of the Condition element, for example.
Alternatively, it may be described as an attribute or child element of the root element (EffectDescription, DeviceControlDescription, etc.) of the metadata.
In this way, when the lighting device does not satisfy the specified lighting conditions, the lighting control of the entire content may be turned OFF according to the intention (second preference) of the producer, so in some scenes, the lighting is ON, and In the scene, the lighting is turned bright and dim through the entire contents such as the lighting is turned off.
In Embodiments 1 to 3, examples of application of the manufacturer's preference to control specified values such as brightness (lx), color temperature (K), wind speed (m / s), and temperature (° C) are shown. The application example in the case where it is quantized according to this predetermined method is demonstrated.
The method of applying the manufacturer preference to the quantized color temperature value (quantization index of the color temperature) will be described with reference to the drawings.
18 is a diagram illustrating an example of quantization of color temperature values. The color temperature range 1667 (K) to 25000 (K) is classified into four categories (Hot, Warm, Moderate, and Cool) (2 bits), and the color temperature values in each category are quantized to 6 bits.
For the quantized color temperature value (quantization index of the color temperature), the manufacturer's preference (allowable type and allowable range) can be applied according to the following formula.
Strict: Min (g (i)) ~ Max (g (i))
Under: Min (g (i)) × (1-Range) ~ Max (g (i))
Over: Min (g (i)) ~ Max (g (i)) × (1 + Range)
Both: Min (g (i)) × (1-Range)
Max (g (i)) × (1 + Range)
g (): inverse quantization function
i: quantization index
Range: Permissible range in manufacturer preferences (%)
Min (): minimum value
Max (): maximum value
The application of the manufacturer's preference will be described as an example in which the quantization index value = " 01000000 (binary) &quot;, that is, 2251 (K) or more and less than 2267 (K) is specified as the control designation value.
When the allowable type of the producer preference is "Strict", control is allowed at the color temperature value indicated by the quantization index, that is, 2251 (K) or more and less than 2267 (K).
When the allowable type of the manufacturer preference is "Under" and the allowable range is "10%", from -10% to ± 0%, that is, 2026 (K) or more and less than 2267 (K) from the color temperature value indicated by the quantization index. Allow control from
When the allowable type of the manufacturer preference is "Over" and the allowable range is "10%", ± 0% to + 10% from the color temperature value indicated by the quantization index, that is, 2251 (K) or more and less than 2494 (K). Allow control from
When the allowable type of the manufacturer preference is "Both" and the allowable range is "10%", from the color temperature value indicated by the quantization index, -10% to + 10%, that is, 2026 (K) or more and less than 2494 (K). Allow control from
Alternatively, the allowable range of the manufacturer's preference may be a ratio when the maximum quantization index value is 100%. For example, the allowable range of the quantization index value when quantized with n bits is, respectively.
Strict: ± 0
Under: -Range × 2 n ~ ± 0
Over: ± 0 ~ + Range × 2 n
Both: -Range × 2 n ~ + Range × 2 n
Alternatively, the allowable range may be described as the maximum difference value of the quantization index values instead of the ratios.
Under: -Range ~ ± 0
Over: ± 0 ~ + Range
Both: -Range ~ + Range
In the above description, the manufacturer preference is applied to the color temperature value of the illumination. However, when the illumination condition is specified by the RGB value or the like, it is applied to the correlated color on value obtained according to a predetermined conversion equation, If it is luminance, you may apply about the approximation value calculated | required from the designated RGB value.
For example, the correlation color temperature T can be obtained by converting from the RGB color system to the XYZ color system, obtaining chromaticity coordinates (x, y), and approximating with a predetermined function f as follows.
In addition, this invention is not limited to application to a lighting apparatus, but is applicable to various peripheral apparatuses, such as a fan and an air conditioner.
19 is a diagram illustrating an example of quantization of wind speed values. The wind speeds are classified into 13 categories and quantized into 4 bits. In this case, too, the manufacturer preference can be applied as in the case of the color temperature. The control designation value is not limited to the wind speed (m / s) but may be a rotation speed (rpm) of the fan. In addition, the number of quantization bits is not limited to the above.
In Embodiments 1 to 4, the producer preferences (permissible values for effect reproduction, etc.) for the additional effects of the contents of the content producer or the content provider, and a method of using the same have been described. In this embodiment, the use of the user preference in the content having the user preference and the producer preference that enjoys the content addition effect is shown.
Here, the user preferences describe the user's preferences, and usually describe the user's attribute information, the genre of the desired content, a keyword, a method of operating the device, and the like. By using the user preference, the AV device can be used for personalization (customization) such as extracting only a desired genre from the accumulated contents, or enabling a series of frequently performed device operations with one button. In the present embodiment, in addition to the above preference information, the preference for the operation of the additional effect of the content is described in the user preference.
As described above, the addition effect of the content is an effect for enhancing the realism at the time of viewing the content, such as lighting control, aroma effect, vibration control, or the like. These additive effects are effective for the production of high realism. However, in the viewing environment conditions of the user, for example, in the late-night viewing, each time the content is played back when the user does not desire to execute the effect due to the reason that the vibration effect is disturbed to others, It is necessary to take measures such as setting the execution of the effect to off, or not connecting the playback device with a control target device (for example, a lighting device or a vibration device) that produces the additional effect. For this reason, the execution condition of each effect is described in the user preference data as the user preference, and the device analyzes it, thereby reducing the user's trouble and enjoying the sense of reality according to the viewing environment and preferences.
The user preferences for the additional effects of the content describe execution conditions for the additional effects of the object. 20 is a data example of user preferences describing execution conditions for each additional effect.
As shown in Fig. 20, the user preferences related to reproduction of additional effects are composed of fields of a target effect, operation status, restriction type, and restriction value. In the object effect field, an additional effect which desires to control reproduction such as lighting is described. In the operation status field, whether or not reproduction of the additional effect described in the target effect field is described as TRUE or FALSE.
If the value of the field is FALSE, the additional effect is turned off. TRUE indicates that there is a limit to execution. This restriction is described in the restriction type field and the restriction value field. The restriction type field specifies a method of describing the restriction value field as an identifier. This identifier needs to be able to identify a method of describing the limit value field. In this embodiment, RangeOfRendering indicates a representation of the control specification as a percentage, and DifferenceValue indicates a representation of the control specification as a difference value. use.
When the restriction type field is RangeOfRendering, the restriction value field means a percentage notation with respect to the control specification value, and when the restriction type field is DifferenceValue, it means that the restriction value field is a difference value with respect to the control specification value.
The operation status field does not need to be TRUE and FALSE as long as it is possible to determine whether the reproduction of the additive effect is off or limited, and may be a combination of 1 and 0, or the like.
In FIG. 20, the code | symbol 1601 shows the fragrance effect in the effect object field, and since the operation field is FALSE, when the fragrance effect is contained in the addition effect of reproduction content, this fragrance effect is not performed. Reference numeral 1602 denotes a control in which the effect target field is vibration, the motion availability field is TRUE, and the restriction type field is RangeOfRendering, so that the restriction value field is a display of a percentage. That is, playback is performed at 10% to the control specified value. In addition, when reproducing at a value exceeding a control specified value, reproducing is possible by setting a value of 100% or more.
Reference numeral 1603 denotes a control in which the effect target field is an illumination and the operation whether or not the field is TRUE, so that playback is restricted. Because the restriction type field is DiffernceValue, the restriction value field is the difference notation of the control specification. Since the value of the limit value field is -50, the lighting is reproduced at a value of 50 [lx] smaller than the control specified value specified in the content. At this time, the unit of the limit value field is determined for each additional effect. For example, for lighting, it is lux (lx), for audio, decibels (db).
As described above, the user preferences for the additional effects in the present invention describe the target effect and its operation. In addition, additional effects not described (not limited) in the user preferences are executed with control specified values.
The reception apparatus using the user preference will be described below. FIG. 21 is a device control unit which has expanded its function so that the data receiving apparatus shown in FIG. 8 can be operated by adding a user preference manager 1701 and a user preference in order to operate using the user's preference. And a data receiving apparatus 1702. Moreover, the vibration apparatus 1703 is added as a control object apparatus. In Fig. 21, those having the same functions as those of the data receiving apparatus shown in Fig. 8 are assigned a common code.
In the present embodiment, it is assumed that the user preference manager 1701 accumulates user preferences including control techniques for additional effects set by the user in advance. As an example of the user preference manager 1701, a hard disk or a large-capacity recording medium typified by a Blu-Ray Disc, a small semiconductor recording medium such as an SD card or a smart card can be used.
Similar to the data receiving apparatus shown in FIG. 8, in the data receiving apparatus illustrated in FIG. 21, the multiplexed data including the video, audio, and viewing environment control data received by the receiving unit 701 is the data separating unit 702. Are separated into respective pieces of video encoded data, audio encoded data, and viewing environment control data, and outputted to the video decoding unit 703, the audio decoding unit 704, and the viewing environment control data decoding unit 705, respectively. The video encoded data is decoded by the video decoding unit 703 and reproduced by the video reproducing unit 706. The speech encoded data is decoded by the speech decoder 704 and reproduced by the speech reproducer 707. The viewing environment control data is decoded by the viewing environment control data decoding unit 705 and output to the device control unit 1702. Here, the device control unit 1702 analyzes the inputted viewing environment control data description content, and obtains the user preference from the user preference management unit 1701.
The device control unit 1702 compares the acquired user preference with the analyzed content of the viewing environment control data description, and determines whether or not to control the control target device and the control value. When it is determined that controllability is possible, the determined control value is outputted to the illuminating device 709 when the subject's additional effect is illumination and to the vibrating device 1703 if the vibration effect is controlled.
In the present embodiment, the data receiving device shown in FIG. 21 is described as a device to be controlled by the device control unit 1702 as a lighting device 709 and a vibrating device 1703, but a fan, an air conditioner, and a fragrance generating device. And the like can also be controlled. In the data receiving apparatus shown in Fig. 21, the video, audio, and viewing environment control data is inputted with multiplexed data, but the video / audio multiplexing data and viewing environment control data are inputted from individual paths. You may also
Here, the device control unit 1702 will be described. FIG. 22 is a functional block diagram showing the internal configuration of the device control unit 1702, and for the convenience of description, also describes the lighting device 709 and the vibration device 1703. FIG.
The device control unit 1702 is composed of an analysis unit (parser) 801, an effect extraction unit 802, a control value determination unit 1802, a command issuing unit 806, and a user preference acquisition unit 1801. In addition, the same code | symbol is attached | subjected to what has the function similar to the apparatus control part 708 shown in FIG.
23 is a flowchart for explaining the operation of the device control unit 1702, and will be described below based on the processing contents of each step.
First, the analysis unit 801 parses the viewing environment control data output from the viewing environment control data decoding unit 705, and the effect extraction unit 802 adds an additional effect attached to the content among the viewing environment control data. The control specified value (brightness, color temperature, vibration intensity) is acquired (step S1901).
Next, the flow advances to step S1902, and the user preference acquisition unit 1801 acquires the user preferences from the user preference management unit 1701.
The control value determination unit 1802 determines whether the acquired additional effect is included in the entry of the additional effect of the user preference description, that is, whether there is a restriction on the additional effect (step S1903). .
If there is no entry of the target additional effect in the user preference, the flow proceeds to step S1907, and since the user preference has no description, the command issuing unit 806 is controlled to the control specified value of the additional effect. Issue a command to turn on the device.
If there is an entry of the additional effect of the target in the user preferences in step S1903, the flow advances to step S1904 to check an operation field in the user preference of the additional effect of the playback target. If the operation status field is FALSE (no additional effects are reproduced), the process proceeds to step S1908, and since the command issuing unit 806 does not perform additional effect control, it does not issue a command.
If the operation state field is TRUE in step S1904, the flow advances to step S1905, and the control value determination unit 1802 calculates a control value for additional effect control. Here, when the control value of the additional effect is described in the user preference, the control value determination unit 1802 controls the control designation value extracted in step S1901 based on the control value field included in the user preference. Calculate the value. When the control value for the additive effect is not described in the user preference, the control designation value extracted in step S1901 is used.
In step S1906, the command issuing unit 806 issues a command to turn on the control target device with the control value (the brightness and the color temperature or the intensity of vibration) calculated by the control value determination unit 1802 (the control target device ( Lighting device 709 or vibration device 1703).
The device control unit 1702 performs the above process on all the additional effects included in the content.
24 is a diagram for explaining an application example of user preferences.
In FIG. 24A, the control designation 2001 relating to the addition effect of vibration and illumination is added to the content. This indicates that vibration and lighting addition effects (vibrate in accordance with a scene or lighting are turned on in accordance with a video effect) are performed in accordance with reproduction of the content. On the other hand, the user to reproduce has a user preference 2002 for controlling the execution of the additional effect of the content. In the user preference 2002, the effect of adding vibration is not described. In this case, because of the limitation on the vibration effect included in the additional effect of the content, the playback device performs only the lighting effect.
On the other hand, in FIG. 24B, as the user preference 2003, it is described that the vibration effect is reduced to 50% and reproduced. In this case, the vibration effect included in the addition effect of the content is 38db, which is 50% of the control designation value, and the lighting effect is executed at 300 lx of the control designation value 2001.
The user preferences described so far are always applied when the user preference data exists. However, the preference for reproduction of additional effects may change depending on the viewing situation. For example, when a user with a family watches a content containing an additional effect at night, the user may want to turn off the vibration effect so as not to be a nuisance, or use a mobile device in a public place such as an office or a train. When watching content, it is considered to desire to turn off the lighting effect. In order to realize these, the viewing environment information can be introduced into the user preferences that limit the additional effects.
25 is a diagram illustrating an example of data describing information of a viewing environment in a user preference. In description of city hall environment information, place and time are described. In the place information field, an office, a train, a living room, a room, and the like are described according to the user's environment. As for the value described, what is necessary is just to be able to discriminate | determine a data receiving apparatus from a user input, the installation position of an apparatus, etc., and there is no restriction | limiting in particular. In the time information field, a plurality of description formats are prepared, tags for identifying each are prepared, and specifically, there are ones in the format shown in FIG.
In FIG. 25, the tag 2101 is a TIMEPOINT tag for describing with reference time and duration. The tag 2102 is a START_END_TIME tag for describing the start time and end time. The tag 2103 is a PLACE tag indicating a place. The description method is not limited to these methods. If the description method can be determined, a description method such as MediaTimedatatype defined in ISO / IEC 15938-5 and MPEG-7 Part5: MDS may be used.
At least one of place information and time information should just exist in viewing environment information. For example, if there is no place information, reproduction control of the additional effect is performed at any place in accordance with the time information. If both exist, reproduction control of the addition effect is performed at the designated time at the designated place.
It is a figure which shows the example of description of user preference using the viewing environment information and the control information of an additional effect.
In Fig. 26, the time information of the viewing environment information is designated from 10:00 PM for 8 hours (that is, 06:00 AM), and it is described that the vibration effect is 50% as an additional effect. When the device control unit 1702 acquires and applies this user preference, when the user watches the content having the vibration effect and the lighting effect at 11:00 PM, the vibration effect is executed at 50% (38db) of the control specified value (Fig. 26 (A)). On the other hand, when viewing at 9:00 AM, since it is out of the range of time information, control by a user preference is not performed and a vibration effect is reproduced with a control specification value (76db) (FIG. 26 (B). )).
In FIG. 26, although the example in the case where time information exists as viewing environment information was shown, it is the same also in the case where place information is included in viewing environment information. Also in this case, the device control unit 1702 acquires information of a place that the user views from the position acquisition information unit (not shown).
For example, if the receiving device has a function of receiving GPS (Grobal Positioning System), the location may be specified from the positional information and the map information received from the GPS, and the receiving device and the viewing place (for example, RFID may be provided at the entrance of each room of the house or inside the vehicle of the train, and the position of the receiving device may be specified by communicating between the receiving device and the RFID of the viewing place.
Alternatively, the reception device may acquire location information from a mobile phone owned by the user or an access point of a communication network such as a local area network (LAN), or the like, and the device control unit 1702 can specify the location information of the reception device. However, the means for obtaining them may be used. In addition, when the location information acquisition unit does not exist in the reception device, the device control unit 1702 may inquire the user of the viewing place at the time of viewing the content including the additional effect. As described above, the device control unit 1702 obtains the place information, so that the user preference shown in FIG. 25 can be applied similarly to the time information.
27 shows an example in which user preferences are described in XML. In FIG. 27, the format prescribed | regulated by ISO / IEC 15938-5 and MPEG-7 Part5: MDS is used for description of user information, time information, and place information. In Fig. 27, the preferences of John and Mary as users are described. John's preferences indicate that when viewing from 10 pm to 6 am in the living room, the vibration effect is performed at 50% of the control specified value. On the other hand, Mary's preference indicates that the lighting effect is not always performed when viewing in the office. FIG. 28 is an example of a representation in an XML schema for the XML description of FIG. 27.
In addition, in the case where two or more persons having preferences watch content having additional effects, attention may be paid only to the additional effects common to each user, and control of the additional effects satisfying all the preferences may be performed. do.
For example, when John and Mary are watching content together, John's preferences describe a lighting effect off and a vibration effect of 50%, and Mary's preferences contain 70% lighting effect and aroma effect off. When the reference is described, only the lighting effect is limited, and the vibration effect and the scent effect are not limited, in case of limiting only common additional effects.
On the other hand, when the preference is performed to satisfy all the preferences, the execution of the lighting effect, the vibration effect, and the scent effect is limited.
In addition, although it does not specifically limit about the method of restricting each effect, For example, in the case of a lighting effect, you may select the limit value (70% of Mary) which performs more additional effects, and the value which added more restriction (John Off) may be selected.
In addition, user information may be set as an individual as shown in FIG. 27, and may be set for groups, such as a family.
In addition, in the user preferences described so far, all the controls for the additional effects desired by the user must be described. That is, the execution is performed for all additional effects other than the lighting effects considered to be included in the content, such as when only one lighting effect among several additional effects (such as a lighting effect, a vibration effect, a scent effect, etc.) included in the content is to be effective. It should be stated that it does not. In order to avoid this, the user preference may describe an additional effect that allows execution, and filter the additional effect.
Specifically, this is accomplished by preparing and setting a technique indicating execution permission in a user preference. In this example, the above technique takes either of Allow and Deny. If the value of the above description is Allow, only the described additional effects are allowed to be executed, and the non-described additional effects are not executed. If the value of the technology is Deny, the described additional effects are not executed, and additional effects other than the technology can be executed.
Fig. 29 shows a description example of the filtering by the user preference.
In FIG. 29A, Allow is set for vibration and aroma effects. In this case, the vibration and fragrance effects are executed, but other additive effects are not performed. Similarly, in FIG. 29B, Deny is set to the lighting effect. In this preference, no additional effects of lighting are performed. An operation example is shown in FIG. 29C. When viewing content having the maker preference 2501 of illumination and vibration based on the user preferences 2502 and 2503, since only the vibration and the fragrance are allowed in the user preference 2502, the addition of illumination is added. The effect is not executed, and only the vibration effect is executed. However, since the vibration effect has a user preference 2503 to be executed at 50% of the control specified value, the vibration effect is executed at 50% of the control specified value, that is, 38 db.
In addition, by combining the filtering with the viewing environment information as shown in FIG. 29D, the filtering of the additional effect according to the viewing environment may be realized. In FIG. 29D, only the vibration and fragrance effects are allowed to be executed for eight hours from 10:00 PM. In this example, the permission to execute the additional effect has been described using Allow and Deny, but the execution permission in each of the additional effects is not limited thereto. As described above, by applying the additional effect control to the additional effects allowed to be executed by filtering, it is possible to execute the additional effects desired by the user with a value according to preference.
In the present embodiment, the description of the user preference has described the reproduction states of the individual additional effects, but may be described not only in the additional effects but also in specific parameters. For example, if it is an illumination effect, you may describe control information about each of brightness and brightness. In addition, when viewing environment control data relating to an operation such as lighting blinking effect is included in the content, a technique of controlling the blinking interval or the like in the user preference may be performed.
In this way, by describing the reproduction state of the additional effect in the user preference, the reproduction method of the additional effect of the user preference and the reproduction of the additional effect suitable for the time or place of viewing can be performed without setting the operation of the peripheral device for each viewing. .
101: video encoder
102: speech encoder
103: viewing environment control data encoder
104: viewing environment control data input unit
105: data multiplexer
201: effect input unit
202: preference input unit
203: format section
701: receiver
702: data separator
703: video decoder
704: voice decoder
705: Viewing environment control data decoding unit
706: video playback unit
707: voice playback unit
708, 1702: device control
709: lighting device
801: parser (parser)
802: effect extraction unit
803: preference extraction unit
804: device capability acquisition unit
805, 1802: control value determining unit
806: command issuing unit
1401: viewing environment control data transmitter
1402: viewing environment control data server
1403: accumulation
1501: viewing environment control data receiving unit
1701: user preference management unit
1703: vibration device
1801: user preference acquisition unit
A data transmitting apparatus comprising: transmitting means for multiplexing and transmitting video data and / or audio data and viewing environment control data for at least one peripheral device in a viewing environment space for reproducing the video data and / or audio data. ,
And the viewing environment control data includes a manufacturer's preference information indicating a control specification value for the peripheral device and an error tolerance range for the control specification value.
Multiplexing data obtained by multiplexing video data and / or audio data and identification information for identifying viewing environment control data for at least one peripheral device in a viewing environment space for reproducing the video data and / or audio data; A data transmitting apparatus comprising a transmitting means for transmitting environmental control data,
A data transmitting device comprising transmitting means for transmitting viewing environment control data to one or more peripheral devices in a viewing environment space for reproducing predetermined video data and / or audio data in response to a request from the outside,
And the producer preference information includes permission type information for allowing the peripheral device to be controlled only by the control specified value.
And the producer preference information includes permission type information for allowing the peripheral device to be controlled to a value smaller than the control specified value.
And the producer preference information includes allowed type information for allowing the peripheral device to be controlled to a value larger than the control specified value.
And the producer preference information includes allowable type information for allowing the peripheral device to be controlled to a value within a predetermined range including the control specified value.
And the producer preference information includes approximate tolerance range information indicating a range in which the value is allowed as a ratio with respect to the control specified value.
And said control specified value is represented by a quantized value.
And the producer preference information is described as an XML attribute.
And the producer preference information is described as an XML element.
And the viewing environment control data is described in units of scenes of the video data.
And the viewing environment control data is described in units of shots of the image data.
And the viewing environment control data is described in units of frames of the video data.
And the viewing environment control data is lighting control data for one or more lighting devices in the viewing environment space.
Data having receiving means for receiving multiplexed data including image data and / or audio data and viewing environment control data for at least one peripheral device in a viewing environment space for reproducing the image data and / or audio data As a receiving device,
The viewing environment control data includes a control preference value for the peripheral device and producer preference information indicating an error tolerance range for the control specification value.
Receiving multiplexed data including video data and / or audio data and identification information for identifying viewing environment control data for at least one peripheral device in a viewing environment space that reproduces the video data and / or audio data; A data receiving apparatus comprising receiving means for receiving the viewing environment control data based on the identification information,
Receiving means for receiving video data and / or audio data and receiving viewing environment control data for one or more peripheral devices in a viewing environment space for reproducing the video data and / or audio data based on a user's request. A data receiving device having:
And the producer preference information includes permission type information for allowing the peripheral device to be controlled to a value larger than the control specified value.
And the producer preference information includes permission type information for allowing the peripheral device to be controlled to a value within a predetermined range including the control specified value.
The method according to any one of claims 16 to 23, wherein
The method according to any one of claims 16 to 24,
And the producer preference information is represented by an XML attribute.
The producer preference information is represented by an XML element.
The method according to any one of claims 16 to 26,
And the viewing environment control data is represented by a new unit of the image data.
And the viewing environment control data is represented in units of shots of the image data.
And the viewing environment control data is represented in units of frames of the image data.
The method according to any one of claims 16 to 29, wherein
The method according to any one of claims 16 to 30,
And acquisition means for acquiring preference data of the user for limiting the operation of the peripheral device based on the viewing environment control data.
The preference data of the user includes information on whether to operate the peripheral device and / or restriction information on the control specified value.
33. The method of claim 31 or 32,
The preference data of the user includes viewing environment information describing conditions under which the preference data of the user is applied.
And the viewing environment information includes information of a time and / or a place to which preference data of the user is applied.
A data transmission method for multiplexing and transmitting video data and / or audio data and viewing environment control data for at least one peripheral device in a viewing environment space for reproducing the video data and / or audio data.
And the viewing environment control data includes a control specification value for the peripheral device and producer preference information indicating an error tolerance range for the control specification value.
Multiplexing data obtained by multiplexing video data and / or audio data and identification information for identifying viewing environment control data for at least one peripheral device in a viewing environment space for reproducing the video data and / or audio data; As a data transmission method for transmitting environmental control data,
A data transmission method for transmitting viewing environment control data for one or more peripheral devices in a viewing environment space for reproducing predetermined video data and / or audio data in response to a request from the outside,
A data receiving method for receiving multiplexed data including video data and / or audio data and viewing environment control data for at least one peripheral device in a viewing environment space for reproducing the video data and / or audio data.
The viewing environment control data includes a control preference value for the peripheral device and producer preference information indicating an error tolerance for the control specification value.
Receiving multiplexed data including video data and / or audio data and identification information for identifying viewing environment control data for at least one peripheral device in a viewing environment space that reproduces the video data and / or audio data; A data receiving method for receiving the viewing environment control data based on the identification information,
Receiving video data and / or audio data, and receiving data for receiving viewing environment control data for at least one peripheral device in a viewing environment space for reproducing the video data and / or audio data based on a user's request. As a method,
A viewing environment control method for receiving multiplexed data including video data and / or audio data and viewing environment control data for at least one peripheral device in a viewing environment space for reproducing the video data and / or audio data.
Receiving multiplexed data including video data and / or audio data and identification information for identifying viewing environment control data for at least one peripheral device in a viewing environment space that reproduces the video data and / or audio data; A viewing environment control method for receiving the viewing environment control data based on the identification information,
A viewing environment that receives video data and / or audio data and receives viewing environment control data for one or more peripheral devices in a viewing environment space that reproduces the video data and / or audio data based on a user's request. As a control method,
Receiving means for receiving multiplexed data including video data and / or audio data and viewing environment control data for at least one peripheral device in a viewing environment space for reproducing the video data and / or audio data;
A data receiving device comprising acquisition means for acquiring preference data of a user for limiting the operation of the peripheral device based on the viewing environment control data,
The viewing environment control data includes at least a control specified value for the peripheral device,
Receiving multiplexed data including video data and / or audio data and identification information for identifying viewing environment control data for at least one peripheral device in a viewing environment space that reproduces the video data and / or audio data; Receiving means for receiving the viewing environment control data based on the identification information;
Receiving means for receiving video data and / or audio data and receiving viewing environment control data for one or more peripheral devices in a viewing environment space for reproducing the video data and / or audio data based on a user's request. and,
47. The method of any of claims 44-46,
Receiving multiplexed data including video data and / or audio data and viewing environment control data for one or more peripheral devices in a viewing environment space for reproducing the video data and / or audio data,
A data receiving method for acquiring preference data of a user for limiting the operation of the peripheral device based on the viewing environment control data,
The preference data of the user includes information on operation of the peripheral device and / or restriction information on the control specified value.
Receiving multiplexed data including video data and / or audio data and identification information for identifying viewing environment control data for at least one peripheral device in a viewing environment space that reproduces the video data and / or audio data; Receiving the viewing environment control data based on the identification information,
Receiving viewing data and / or audio data, and receiving viewing environment control data for one or more peripheral devices in the viewing environment space for reproducing the video data and / or audio data based on a user's request,
KR1020117002446A 2008-07-15 2009-07-14 Data transmission device, data reception device, method for transmitting data, method for receiving data, and method for controlling audio-visual environment KR20110042067A (en)
JP2008183813 2008-07-15
JPJP-P-2008-183813 2008-07-15
JP2009015429 2009-01-27
JPJP-P-2009-015429 2009-01-27
KR20110042067A true KR20110042067A (en) 2011-04-22
ID=41550389
KR1020117002446A KR20110042067A (en) 2008-07-15 2009-07-14 Data transmission device, data reception device, method for transmitting data, method for receiving data, and method for controlling audio-visual environment
US (1) US20110149156A1 (en)
EP (1) EP2315441A4 (en)
JP (1) JPWO2010007987A1 (en)
KR (1) KR20110042067A (en)
CN (1) CN102090058A (en)
BR (1) BRPI0916770A2 (en)
WO (1) WO2010007987A1 (en)
PL212162B1 (en) 2010-02-15 2012-08-31 Instytut Inżynierii Materiałów Polimerowych I Barwników Process for the preparation of bisphenol A of polycarbonate purity
JP6411069B2 (en) * 2013-05-24 2018-10-24 イマージョン コーポレーションＩｍｍｅｒｓｉｏｎ Ｃｏｒｐｏｒａｔｉｏｎ METHOD AND SYSTEM FOR ENCODING AND STREAMING Haptic Data
EP3079367A4 (en) * 2013-12-02 2016-11-02 Panasonic Ip Man Co Ltd Relay apparatus, cooperative system, delivery apparatus, processing method of relay apparatus, and program
US20170214962A1 (en) * 2014-06-24 2017-07-27 Sony Corporation Information processing apparatus, information processing method, and program
US20170134785A1 (en) * 2015-11-10 2017-05-11 International Business Machines Corporation Television system including automatic light control based on metadata associated with a received signal
CN106507172B (en) * 2016-11-30 2019-10-18 微鲸科技有限公司 Information coding method, coding/decoding method and device
JP4052556B2 (en) * 2002-05-07 2008-02-27 日本放送協会 External device-linked content generation device, method and program thereof
CN101427577A (en) * 2006-04-19 2009-05-06 夏普株式会社 Data transmitting device, data transmitting method, audiovisual environment control device, audiovisual environment control system and audiovisual environment control method
KR101390010B1 (en) * 2007-08-14 2014-04-29 엘지전자 주식회사 Apparatus and method for setting the viewing conditions
2009-07-14 JP JP2010520868A patent/JPWO2010007987A1/en active Pending
2009-07-14 KR KR1020117002446A patent/KR20110042067A/en not_active Application Discontinuation
2009-07-14 WO PCT/JP2009/062736 patent/WO2010007987A1/en active Application Filing
2009-07-14 CN CN2009801274773A patent/CN102090058A/en not_active IP Right Cessation
2009-07-14 US US13/054,422 patent/US20110149156A1/en not_active Abandoned
2009-07-14 EP EP09797912.4A patent/EP2315441A4/en not_active Withdrawn
2009-07-14 BR BRPI0916770A patent/BRPI0916770A2/en not_active IP Right Cessation
BRPI0916770A2 (en) 2018-02-20
EP2315441A1 (en) 2011-04-27
EP2315441A4 (en) 2014-07-16
JPWO2010007987A1 (en) 2012-01-05
US20110149156A1 (en) 2011-06-23
WO2010007987A1 (en) 2010-01-21
CN102090058A (en) 2011-06-08
US7038581B2 (en) 2006-05-02 Method for adjusting parameters for the presentation of multimedia objects
EP1525747B1 (en) 2008-10-08 Method of and system for controlling an ambient light and lighting unit
2014-08-15 WITN Withdrawal due to no request for examination