Abstract:
A virtual world processing apparatus and method. An angle value is obtained by measuring an angle of a body part of a user of a real world using sensor capability, which is information on capability of a bending sensor, and is transmitted to a virtual world, thereby achieving interaction between the real world and the virtual world. In addition, based on the sensor capability and the angle value denoting the angle of the body part, control information is generated to control a part of an avatar of the virtual world, corresponding to the body part, and then transmitted to the virtual world. Accordingly, interaction between the real world and the virtual world is achieved.

Description:
CROSS-REFERENCE TO RELATED APPLICATIONS 
       [0001]    This application is a U.S. National Phase application of PCT/KR2011/002408 filed Apr. 6, 2011 and claims the priority benefit of Korean Application No. 10-2011-0024448 filed Mar. 18, 2011 and Korean Application No. 10-2010-0033947 filed Apr. 13, 2010 in the Korean Intellectual Property Office, the contents of each of which are incorporated herein by reference. 
     
    
     BACKGROUND 
       [0002]    1. Field 
         [0003]    Example embodiments of the following description relate to a virtual world processing apparatus and method, and more particularly, to an apparatus and method for applying detection information measured by a bending sensor to the virtual world. 
         [0004]    2. Description of the Related Art 
         [0005]    In the current market, the consumers&#39; interest in experience-type games has been increasing. MICROSOFT CORPORATION introduced PROJECT NATAL at the “E3 2009” Press Conference. PROJECT NATAL may provide a user body motion capturing function, a face recognition function, and a voice recognition function by combining MICROSOFT&#39;s XBOX 360 game console with a separate sensor device that includes a depth/color camera and a microphone array, thereby enabling a user to interact with a virtual world without a dedicated controller. In addition, SONY CORPORATION introduced WAND which is an experience-type game motion controller. The WAND enables interaction with a virtual world through input of a motion trajectory of a controller by applying, to the SONY PLAYSTATION 3 game console, a location/direction sensing technology obtained by combining a color camera, a marker, and an ultrasonic sensor. 
         [0006]    The interaction between a real world and a virtual world operates in one of two directions. In one direction, data information obtained by a sensor in the real world may be reflected to the virtual world. In the other direction, data information obtained from the virtual world may be reflected to the real world using an actuator. 
         [0007]    Accordingly, there is a desire to implement an improved apparatus and method for applying information sensed from a real world by a bending sensor to a virtual world. 
       SUMMARY 
       [0008]    According to an aspect of the present disclosure, there is provided a virtual world processing apparatus including a receiving unit to receive an angle value of at least one sensed location and sensor capability of a bending sensor from the bending sensor; a processing unit to generate control information for controlling an object of a virtual world corresponding to the at least one sensed location, based on the angle value and the sensor capability; and a transmission unit to transmit the control information to the virtual world. 
         [0009]    According to an aspect of the present disclosure, there is provided a virtual world processing method including receiving an angle value of at least one sensed location and sensor capability of a bending sensor from the bending sensor; generating control information for controlling an object of a virtual world corresponding to the at least one sensed location, based on the angle value and the sensor capability; and transmitting the control information to the virtual world. 
         [0010]    According to an aspect of the present disclosure, there is provided a method of interacting between a real world and a virtual world, the method including: sensing angle values, by plural bending sensors, respectively disposed at plural sensed locations of a user; and generating control information for controlling an avatar of a virtual world corresponding to the plural sensed locations, based on the sensed angle values and sensor capability. 
     
    
     
       BRIEF DESCRIPTION OF THE DRAWINGS 
         [0011]      FIG. 1  is a diagram illustrating a virtual world processing system that controls data exchange between a real world and a virtual world, according to example embodiments; 
           [0012]      FIG. 2  is a diagram illustrating a structure of a virtual world processing apparatus, according to example embodiments; 
           [0013]      FIG. 3  is a diagram illustrating an operation of measuring a sensed location by a plurality of bending sensors, according to example embodiments; 
           [0014]      FIG. 4  is a diagram illustrating an operation of calculating an angle value by a virtual world processing apparatus, according to example embodiments; 
           [0015]      FIG. 5  is a diagram illustrating a structure of an avatar control features type, according to example embodiments; and 
           [0016]      FIG. 6  is a flowchart illustrating a virtual world processing method, according to example embodiments. 
       
    
    
     DETAILED DESCRIPTION 
       [0017]    Reference will now be made in detail to example embodiments, examples of which are illustrated in the accompanying drawings, wherein like reference numerals refer to the like elements throughout. Example embodiments are described below to explain the present disclosure by referring to the figures. 
         [0018]      FIG. 1  illustrates a virtual world processing system that controls data exchange between a real world and a virtual world, according to example embodiments. 
         [0019]    Referring to  FIG. 1 , the virtual world processing system includes a real world  110 , a virtual world processing apparatus, and a virtual world  140 . 
         [0020]    The real world  110  may denote a sensor that detects information on the real world  110  or a sensory device that implements information on the virtual world  140  in the real world  110 . 
         [0021]    The virtual world  140  may denote the virtual world  140  itself implemented by a program or a sensory media playing apparatus that plays contents including sensory effect information implementable in the real world  110 . 
         [0022]    A sensor according to example embodiments may sense information on a movement, state, intention, shape, and the like of a user in the real world  110 , and transmit the information to the virtual world processing apparatus. 
         [0023]    Depending on embodiments, the sensor may transmit sensor capability  101 , sensor adaptation preference  102 , and sensed information  103  to the virtual world processing apparatus. 
         [0024]    The sensor capability  101  may denote information on the capability of the sensor. The sensor adaptation preference  102  may denote information on preference of the user with respect to the sensor capability. The sensed information  103  may denote information sensed in relation to the real world  110  by the sensor. 
         [0025]    The virtual world processing apparatus may include an adaptation real world to virtual world (RV)  120 , virtual world information (VWI)  104 , and an adaptation real world to virtual world/virtual world to real world (RV/VR)  130 . 
         [0026]    The adaptation RV  120  may convert the sensed information  103  sensed by the sensor in relation to the real world  110  to information applicable to the virtual world  140 , based on the sensor capability  101  and the sensor adaptation preference  102 . Depending on embodiments, the adaptation RV  120  may be implemented by an RV engine. 
         [0027]    The adaptation RV  120  according to example embodiments may convert the VWI  104  using the converted sensed information  103 . 
         [0028]    The VWI  104  denotes information on a virtual object of the virtual world  140 . 
         [0029]    The adaptation RV/VR  130  may generate virtual world effect metadata (VWEM)  107 , which denotes metadata related to effects applied to the virtual world  140 , by encoding the converted VWI  104 . Depending on embodiments, the adaptation RV/VR  130  may generate the VWEM  107  based on virtual world capabilities (VWC)  105  and virtual world preferences (VWP)  106 . 
         [0030]    The VWC  105  denotes information on characteristics of the virtual world  140 . The VWP  106  denotes information on preferences of the user with respect to the characteristics of the virtual world  140 . 
         [0031]    The adaptation RV/VR  130  may transmit the VWEM  107  to the virtual world  140 . Here, the VWEM  107  may be applied to the virtual world  140  so that effects corresponding to the sensed information  103  may be implemented in the virtual world  140 . 
         [0032]    According to an aspect of the present disclosure, an effect event generated in the virtual world  140  may be driven by a sensory device, that is, an actuator in the real world  110 . 
         [0033]    The virtual world  140  may encode sensory effect information, which denotes information on the effect event generated in the virtual world  140 , thereby generating sensory effect metadata (SEM)  111 . Depending on embodiments, the virtual world  140  may include the sensory media playing apparatus that plays contents including the sensory effect information. 
         [0034]    The adaptation RV/VR  130  may generate sensory information  112  based on the SEM  111 . The sensory information  112  denotes information on an effect event implemented by the sensory device of the real world  110 . 
         [0035]    The adaptation VR  150  may generate information on a sensory device command (SDcmd)  115  for controlling operation of the sensory device of the real world  110 . Depending on embodiments, the adaptation VR  150  may generate the information on the SDcmd  115  based on information on sensory device capabilities (SDCap)  113  and information on user sensory preference (USP)  114 . 
         [0036]    The SDCap  113  denotes information on capability of the sensory device. The USP  114  denotes information on preference of the user with respect to an effect implemented by the sensory device. 
         [0037]      FIG. 2  illustrates a structure of a virtual world processing apparatus  200  according to example embodiments. 
         [0038]    Referring to  FIG. 2 , the virtual world processing apparatus  200  includes a receiving unit  210 , a processing unit  220 , and a transmission unit  230 . In another example embodiment, which will be discussed later, the virtual world processing apparatus  200  additionally includes a calculation unit  240 . 
         [0039]    The receiving unit  210  may receive, from a bending sensor  260 , an angle value of a sensed location measured by the bending sensor  260  and sensor capability related to capability of the bending sensor  260 . 
         [0040]    The bending sensor  260  measures sensed information related to a bending degree of an object of a real world. The sensed information denotes a measured value of the bending degree, that is, an angle of the sensed location measured by the bending sensor  260 . 
         [0041]    Depending on embodiments, the bending sensor  260  may be attached or connected to the sensed location to measure the bending degree, that is, the angle of the sensed location. For example, when a user  250  attaches the bending sensor  260  to an elbow, the bending sensor  260  may sense a bending degree of the elbow of the user, that is, an angle of the elbow. Here, the bending sensor  260  may transmit an angle value of the elbow and sensor capability of the bending sensor  260  to the virtual world processing apparatus  200 , thereby controlling an elbow movement of an avatar, for example. As shown in  FIG. 2 , as an example, when the user  250  rotates an elbow, such that an arm rotates upward, the virtual world processing apparatus  200  may process the angle value and sensor capability, transmitted by the bending sensor  260 , thereby controlling an avatar  280 . 
         [0042]    The bending sensor  260  may be connected to other joints of the user  250 , including elbows, finger joints, a neck, shoulders, and the like, to measure bending degrees of the joints. 
         [0043]    The sensor capability denotes the capability of the bending sensor  260 . 
         [0044]    According to example embodiments, the sensor capability of the bending sensor  260  may include maxValue, minValue, Num of Locations, Distance between Location, numOfAxes, and numOfSensors, however, the present disclosure is not limited thereto. 
         [0045]    The maxValue may denote a maximum angle value measurable by the bending sensor  260 . The minValue may denote a minimum angle value measurable by the bending sensor  260 . The bending sensor  260  may measure an angle of the sensed location within a range from greater than the minValue to smaller than the maxValue. 
         [0046]    The Num of Locations may denote the number of the sensed locations sensed by the bending sensor  260 . According to an aspect of the present disclosure, the bending sensor  260  may singly and simultaneously sense bending degrees of a plurality of sensed locations. Here, the Num of Locations may be a number of the plurality of sensed locations measured by the single bending sensor  260 . Depending on embodiments, a plurality of the bending sensors  260  may measure a plurality of the sensed locations. In this case, the Num of Locations may be a number of the plurality of sensed locations measured by the plurality of the bending sensors  260 . 
         [0047]    The Distance between Location may denote the distance between the adjacent sensed locations. A plurality of the bending sensors  260  may sense a plurality of the sensed locations. 
         [0048]    The numOfAxes may denote dimension of the angle value measurable by the bending sensor  260 . 
         [0049]    The numOfSensors may denote segments measurable by a plurality of the bending sensors  260  when the plurality of sensed locations are measured by the plurality of the bending sensors  260 . 
         [0050]    Depending on embodiments, the sensor capability of the bending sensor  260  may further include accuracy and offset. 
         [0051]    The accuracy may denote information on a measurement error. 
         [0052]    The offset may denote a value for zero point adjustment of the angle value measured by the bending sensor  260 . 
         [0053]    Table 1 shows an extensible markup language (XML) syntax with respect to a bending sensor capability type according to example embodiments. The bending sensor capability type may denote information on basic sensor capability of the bending sensor  260 . 
         [0000]    
       
         
               
             
           
               
                 TABLE 1 
               
               
                   
               
             
             
               
                   &lt;!-- ################################################ --&gt; 
               
               
                   &lt;!-- Bending Sensor capability type    --&gt; 
               
               
                   &lt;!-- ################################################ --&gt; 
               
               
                   &lt;complexType name=“BendSensorCapabilityType”&gt; 
               
               
                     &lt;complexContent&gt; 
               
               
                       &lt;extension base=“cid:SensorCapabilityBaseType”&gt; 
               
               
                         &lt;attribute name=“numOfLocations” 
               
               
                 type=“nonNegativeInteger” use=“optional”/&gt; 
               
               
                         &lt;attribute name=“distanceBtwnLocations” 
               
               
                 type=“float” use=“optional”/&gt; 
               
               
                         &lt;attribute name=“numOfAxes” 
               
               
                 type=“nonNegativeInteger” use=“optional” default=“1”/&gt; 
               
               
                         &lt;attribute name=“numOfSensors” 
               
               
                 type=“nonNegativeInteger” use=“optional” default=“1”/&gt; 
               
               
                       &lt;/extension&gt; 
               
               
                     &lt;/complexContent&gt; 
               
               
                   &lt;/complexType&gt; 
               
               
                   
               
             
          
         
       
     
         [0054]    Table 2 shows semantics related to the bending sensor capability type according to example embodiments. 
         [0000]    
       
         
               
               
             
           
               
                 TABLE 2 
               
               
                   
               
               
                 Name 
                 Definition 
               
               
                   
               
             
             
               
                 BendingSensorCapabilityType 
                 Tool for describing a bending  
               
               
                   
                 sensor capability. 
               
               
                 maxValue 
                 Describes the maximum value that the  
               
               
                   
                 bending sensor can perceive  
               
               
                   
                 in terms of degree. 
               
               
                 minValue 
                 Describes the minimum value  
               
               
                   
                 that the bending sensor can 
               
               
                   
                 perceive in terms of degree. 
               
               
                 numOfLocations 
                 Describes the number of locations that  
               
               
                   
                 a bending sensor can 
               
               
                   
                 sense bending angles. 
               
               
                 distanceBtwnLocations 
                 Describes the distance between the  
               
               
                   
                 adjacent sensing locations. 
               
               
                 numOfAxes 
                 Describes the dimension that the bending  
               
               
                   
                 sensor can perceive the bending angles. 
               
               
                 numOfSensors 
                 Describes the number of segments that an  
               
               
                   
                 array of bending sensors can perceive. 
               
               
                   
               
             
          
         
       
     
         [0055]    According to an aspect of the present disclosure, the sensor capability may include metadata encoded into a binary format. In details, the bending sensor  260  may generate the metadata by encoding the sensor capability into the binary format, and transmit the metadata to the virtual world processing apparatus  200 . Here, the receiving unit  210  may receive the sensor capability that includes the metadata encoded into the binary format. 
         [0056]    Table 2-2 shows binary representation syntax related to the bending sensor capability type, according to example embodiments. 
         [0000]    
       
         
               
               
               
             
               
               
               
             
           
               
                 TABLE 2-2 
               
               
                   
               
               
                   
                 (Number  
                   
               
               
                 BendingSensorCapabilityType{ 
                 of bits) 
                 (Mnemonic) 
               
               
                   
               
             
             
               
                   
               
             
          
           
               
                  numOfLocationFlag 
                 1 
                 bslbf 
               
               
                  distanceBtwnLocationFlag 
                 1 
                 bslbf 
               
               
                  numOfAxisFlag, 
                 1 
                 bslbf 
               
               
                  numOfSensorsFlag 
                 1 
                 bslbf 
               
               
                  SensorCapabilityBase 
                   
                 SensorCapabilityBaseType 
               
               
                  if(numOfLocationFlag){ 
                   
                   
               
               
                   numOfLocation 
                 16 
                 uimsbf 
               
               
                  } 
                   
                   
               
               
                  if(distanceBtwnLocationFlag){ 
                   
                   
               
               
                   distanceBtwnLocation 
                 32 
                 fsbf  
               
               
                  } 
                   
                   
               
               
                  if(numOfAxesFlag){ 
                   
                   
               
               
                   numOfAxes 
                 2 
                 uimsbf 
               
               
                  } 
                   
                   
               
               
                  if(numOfSensorsFlag){ 
                   
                   
               
               
                   numOfSensors 
                 8 
                 uimsbf 
               
               
                  } 
                   
                   
               
               
                 } 
               
               
                   
               
             
          
         
       
     
         [0057]    Table 2-3 shows semantics related to binary encoding of the bending sensor capability type, according to example embodiments. 
         [0000]    
       
         
               
               
             
           
               
                 TABLE 2-3 
               
               
                   
               
               
                 Name 
                 Definition 
               
               
                   
               
             
             
               
                 numOfLocationFlag 
                 This field, which is only present in the binary representation,  
               
               
                   
                 indicates the presence of the “numOfLocation” attribute. A value 
               
               
                   
                 of “1” implies that the attribute shall be used and a value of “0” 
               
               
                   
                 implies that the attribute shall not be used. 
               
               
                 distanceBtwnLocationFlag 
                 This field, which is only present in the binary representation,  
               
               
                   
                 indicates the presence of the “distanceBtwnLocation” attribute. A 
               
               
                   
                 value of “1” implies that the attribute shall be used and a value of 
               
               
                   
                 “0” implies that the attribute shall not be used. 
               
               
                 numOfAxesFlag 
                 This field, which is only present in the binary representation, 
               
               
                   
                 indicates the presence of the “numOfAxes” attribute. A value of “1” 
               
               
                   
                 implies that the attribute shall be used and a value of “0” implies 
               
               
                   
                 that the attribute shall not be used. 
               
               
                 numOfSensorsFlag 
                 This field, which is only present in the binary representation,  
               
               
                   
                 indicates the presence of the “numOfSensors” attribute. A value of 
               
               
                   
                 “1” implies that the attribute shall be used and a value of “0” 
               
               
                   
                 implies that the attribute shall not be used. 
               
               
                 NumOfLocations 
                 Same as above. 
               
               
                   
                 For the binary representation, the type of data is 16-bit unsigned 
               
               
                   
                 integer. 
               
               
                 DistanceBtwnLocations 
                 Same as above. 
               
               
                   
                 For the binary representation, the type of data is 32 bit floating 
               
               
                   
                 value. 
               
               
                 numOfAxes 
                 Same as above. 
               
               
                   
                 For the binary representation, 2-bit data field is reserved to 
               
               
                   
                 support up to 3 axes. 
               
               
                 numOfSensors 
                 Same as above. 
               
               
                   
                 For the binary representation, 8-bit data field is reserved to 
               
               
                   
                 support an array of bend sensors. 
               
               
                   
               
             
          
         
       
     
         [0058]    Referring to Table 2-3, the metadata encoded into the binary format may include a data field related to at least one attribute selected from the Num of Locations, the numOfAxes, and the numOfSensors, for example. That is, the sensor capability which is the metadata encoded into the binary format may limit data size by including the data field related to the at least one attribute selected from the Num of Locations, the numOfAxes, and the numOfSensors, for example. 
         [0059]    Table 3 shows an example sensor capability of the bending sensor  260 . 
         [0000]    
       
         
               
             
           
               
                 TABLE 3 
               
               
                   
               
             
             
               
                   cidl:SensorDeviceCapability xsi:type= 
               
               
                 “scdv:BendingSensorCapabilityType” id=“BS001” maxValue=“90.0” 
               
               
                 minValue=“−30.0” numOfLevels=“2500” offset=“0.05” &gt; 
               
               
                     &lt;cidl:Accuracy xsi:type=“cidl:ValueAccuracy” value=“0. 1”/&gt; 
               
               
                   &lt;/cidl:SensorDeviceCapability&gt; 
               
               
                   
               
             
          
         
       
     
         [0060]    Referring to Table 3, an identifier ID of the bending sensor  260  may be ‘BS001.’ The maxValue of the bending degree, that is, the angle, of the sensed location measurable by the bending sensor  260  may be ‘90.0 degree’ while the minValue may be ‘−30.0 degree.’ In addition, a number of levels (numOfLevels) may be ‘2500 level.’ The accuracy of the bending sensor  260  may be ‘0.1 degree.’ The offset of the bending sensor  260  may be ‘0.05 degree.’ 
         [0061]    Table 4 shows XML syntax with respect to a bending sensor type according to an example embodiment. The bending sensor type may denote information on the sensed information measured by the bending sensor  260 . 
         [0000]    
       
         
               
             
           
               
                 TABLE 4 
               
               
                   
               
             
             
               
                   &lt;!--#################################### --&gt; 
               
               
                   &lt;!--Definition of Bending Sensor type --&gt; 
               
               
                   &lt;!--#################################### --&gt; 
               
               
                   &lt;complexType name=“BendingSensorType”&gt; 
               
               
                     &lt;complexContent&gt; 
               
               
                       &lt;extension base=“iidl:SensedInfoBaseType”&gt; 
               
               
                         &lt;sequence&gt; 
               
               
                           &lt;element name=“Value” type=“float” 
               
               
                 minOccurs=“0” maxOccurs=“unbounded”/&gt; 
               
               
                         &lt;/sequence&gt; 
               
               
                         &lt;attribute name=“unit” type=“mpegvct:unitType” 
               
               
                         use=“optional”/&gt; 
               
               
                       &lt;/extension&gt; 
               
               
                     &lt;/complexContent&gt; 
               
               
                   &lt;/complexType&gt; 
               
               
                   
               
             
          
         
       
     
         [0062]    The bending sensor type according to example embodiments may include Timestamp, Unit, and Value. 
         [0063]    The Timestamp denotes information on time when the bending sensor  260  measures the angle value of the sensed location. Depending on embodiments, the Timestamp may be information on an interval of time when the bending sensor  260  measures the angle value. 
         [0064]    The Unit denotes a unit of the angle measured by the bending sensor  260 . Depending on embodiments, the Unit may include ‘degree.’ 
         [0065]    The Value denotes an angle value measured by the bending sensor  260 . Depending on embodiments, when a plurality of the bending sensors  260  measure the angle value with respect to one sensed location, the angle value of the sensed location may be a sum total of a plurality of angle values measured by the plurality of bending sensors  260 . 
         [0066]    Hereinafter, an operation of measuring the angle value by the plurality of the bending sensors  260  will be described with reference to  FIG. 3 . 
         [0067]      FIG. 3  illustrates an operation of measuring a sensed location by a plurality of bending sensors  310 , according to example embodiments. 
         [0068]    Referring to  FIG. 3 , the plurality of the bending sensors  310  may measure a bending degree, that is, an angle, of a sensed location  320 . 
         [0069]    Here, a sum total of angle values measured by the plurality of the bending sensors  310  may represent the total angle value of the sensed location  320 . For example, when ten bending sensors  310  measure the angle values of the sensed location  320 , and the respective angle values measured by the bending sensors  310  are 1 degree, 3 degrees, 5 degrees, 10 degrees, 12 degrees, 12 degrees, 9 degrees, 5 degrees, 2 degrees, and 1 degree, the angle value of the sensed location  320  may be 60 which is the sum total of the respective angle values. 
         [0070]    Referring back to  FIG. 2 , Table 4-2 shows semantics related to the bending sensor type according to the above example embodiment. 
         [0000]    
       
         
               
               
             
           
               
                 TABLE 4-2 
               
               
                   
               
               
                 Name 
                 Definition 
               
               
                   
               
             
             
               
                 BendingSensorType 
                 Tool for describing sensed information with  
               
               
                   
                 respect to a Bending sensor. 
               
               
                 TimeStamp 
                 Describes the time that the information is  
               
               
                   
                 acquired (sensed).  
               
               
                 unit 
                 Specifies the unit of the sensed value, if a unit  
               
               
                   
                 other than the default unit is used, as a 
               
               
                   
                 reference to a classification scheme term  
               
               
                   
                 provided by UnitTypeCS defined in A.2.1 of  
               
               
                   
                 ISO/IEC 23005-6. If the unit is not defined  
               
               
                   
                 here, the default unit is degree.  
               
               
                 value 
                 Describes the sensed value by the bending  
               
               
                   
                 with respect to the default unit or 
               
               
                   
                 the unit defined in the unit attribute. The values 
               
               
                   
                 can be multiple if the bending sensor provides  
               
               
                   
                 multiple angle values at multiple locations. 
               
               
                   
               
             
          
         
       
     
         [0071]    Table 4-3 shows binary representation syntax related to the bending sensor type according to the above example embodiment. 
         [0000]    
       
         
               
               
               
             
               
               
               
             
           
               
                 TABLE 4-3 
               
               
                   
               
               
                   
                 Number 
                   
               
               
                 BendSensorType{ 
                 of bits 
                 Mnemonic 
               
               
                   
               
             
             
               
                   
               
             
          
           
               
                  unitFlag 
                 1 
                 bslbf 
               
               
                  SensedInfoBaseType 
                   
                 SensedInfoBaseType 
               
               
                  numOfSensors 
                 16 
                 uimsbf 
               
               
                  numOfAxis 
                 2 
                 uimsbf 
               
               
                  numOfLocations 
                 16 
                 uimsbf 
               
               
                  for(i=0 ;k&lt;numOfSamples ;i ++){ 
                   
                   
               
               
                  for(j = 0; j&lt; numOfAxis; j++){ 
                   
                   
               
               
                   for(k=0;k&lt; numOfLocations;k++){  
                   
                   
               
               
                    ArrayValue[ (i-1)* numOfLocation* 
                 32 
                 fsbf 
               
               
                 numOfAxis + (j-1)* NumOfLocations + k ] 
                   
                   
               
               
                   } 
                   
                   
               
               
                  } 
                   
                   
               
               
                  If (unitFlag == 1){ 
                   
                   
               
               
                    unit 
                   
                 unitType 
               
               
                  } 
                   
                   
               
               
                 } 
               
               
                   
               
             
          
         
       
     
         [0072]    Table 4-4 shows semantics related to binary encoding of the bending sensor type according to the above example embodiment. 
         [0000]    
       
         
               
               
             
           
               
                 TABLE 4-4 
               
               
                   
               
               
                 Name 
                 Definition 
               
               
                   
               
             
             
               
                 numOfSensors 
                 This field, which is only present in the binary  
               
               
                   
                 representation, signals the number of bend sensors. 
               
               
                 numOfAxis 
                 This field, which is only present in the  
               
               
                   
                 binary representation, signals the dimension 
               
               
                   
                 of the data at the sensing locations. 
               
               
                 numOfLocations 
                 This field, which is only present in the binary  
               
               
                   
                 representation, signals the number of sensing locations. 
               
               
                   
               
             
          
         
       
     
         [0073]    Table 5 shows XML syntax with respect to a bending sensor type according to another example embodiment. 
         [0000]    
       
         
               
             
           
               
                 TABLE 5 
               
               
                   
               
             
             
               
                   &lt;!--#################################### --&gt; 
               
               
                   &lt;!--Definition of Bending Sensor type --&gt; 
               
               
                   &lt;!--#################################### --&gt; 
               
               
                   &lt;complexType name=“BendingSensorType”&gt; 
               
               
                     &lt;complexContent&gt; 
               
               
                       &lt;extension base=“iidl:SensedInfoBaseType”&gt; 
               
               
                         &lt;sequence&gt; 
               
               
                           &lt;element name=“ArrayBendingValue” 
               
               
                 type=“mpeg7:FloatMatrixType” minOccurs=“0” 
               
               
                 maxOccurs=“unbounded”/&gt; 
               
               
                           &lt;element name=“Value” type=“float”/&gt; 
               
               
                         &lt;/sequence&gt; 
               
               
                         &lt;attribute name=“unit” type=“mpegvct:unitType” 
               
               
                         use=“optional”/&gt; 
               
               
                       &lt;/extension&gt; 
               
               
                     &lt;/complexContent&gt; 
               
               
                   &lt;/complexType&gt; 
               
               
                   
               
             
          
         
       
     
         [0074]    Table 5-2 shows semantics related to the bending sensor type according to this example embodiment. 
         [0000]    
       
         
               
               
             
           
               
                 TABLE 5-2 
               
               
                   
               
               
                 Name 
                 Definition 
               
               
                   
               
             
             
               
                 BendingSensorType 
                 Tool for describing sensed information with  
               
               
                   
                 respect to a Bending sensor. 
               
               
                 TimeStamp 
                 Describes the time that the information  
               
               
                   
                 is acquired (sensed). 
               
               
                 unit 
                 Specifies the unit of the sensed value, if a unit  
               
               
                   
                 other than the default unit is used, as a 
               
               
                   
                 reference to a classification scheme 
               
               
                   
                 term provided by UnitTypeCS defined in  
               
               
                   
                 A.2.1 of ISO/IEC 23005-6. If the unit is not  
               
               
                   
                 defined here, the default unit is degree. 
               
               
                 ArrayBendingValue 
                 Describes the sensed value by bending according  
               
               
                   
                 to 3-axis with respect to the default unit  
               
               
                   
                 or the unit defined in the unit attribute. 
               
               
                   
                 Note: the ArrayValue defines by the number of  
               
               
                   
                 locations and the number of axis.  
               
               
                   
                 Ten by three matrix indicates that the 
               
               
                   
                 arrayValue has 10 sensing locations, each of  
               
               
                   
                 which has 3-axis bending angles. 
               
               
                 value 
                 Describes the sensed value by bending in scalar.  
               
               
                   
                 This element shall be used, if the sensor is  
               
               
                   
                 capable of sensing only a degree of bending. 
               
               
                   
               
             
          
         
       
     
         [0075]    Table 6 shows XML syntax with respect to a bending sensor type according to yet another example embodiment. 
         [0000]    
       
         
               
             
           
               
                 TABLE 6 
               
               
                   
               
             
             
               
                   &lt;!--#################################### --&gt; 
               
               
                   &lt;!--Definition of Bending Sensor type --&gt; 
               
               
                   &lt;!--#################################### --&gt; 
               
               
                   &lt;complexType name=“BendingSensorType”&gt; 
               
               
                     &lt;complexContent&gt; 
               
               
                       &lt;extension base=“iidl:SensedInfoBaseType”&gt; 
               
               
                         &lt;sequence&gt; 
               
               
                           &lt;element name=“ArrayBendingValue” 
               
               
                 type=“mpeg7:FloatMatrixType” minOccurs=“1” 
               
               
                 maxOccurs=“unbounded”/&gt; 
               
               
                         &lt;/sequence&gt; 
               
               
                         &lt;attribute name=“unit” type=“mpegvct:unitType” 
               
               
                         use=“optional”/&gt; 
               
               
                       &lt;/extension&gt; 
               
               
                     &lt;/complexContent&gt; 
               
               
                   &lt;/complexType&gt; 
               
               
                   
               
             
          
         
       
     
         [0076]    Table 6-2 shows semantics related to the bending sensor type according to this example embodiment. 
         [0000]    
       
         
               
               
             
           
               
                 TABLE 6-2 
               
               
                   
               
               
                 Name 
                 Definition 
               
               
                   
               
             
             
               
                 BendingSensorType 
                 Tool for describing sensed information with  
               
               
                   
                 respect to a Bending sensor. 
               
               
                 TimeStamp 
                 Describes the time that the information  
               
               
                   
                 is acquired (sensed). 
               
               
                 unit 
                 Specifies the unit of the sensed value, if a unit  
               
               
                   
                 other than the default unit is used,  
               
               
                   
                 as a reference to a classification scheme 
               
               
                   
                 term provided by UnitTypeCS defined in A.2.1 
               
               
                   
                 of ISO/IEC 23005-6. If the unit is not defined 
               
               
                   
                 here, the default unit is degree. 
               
               
                 ArrayBendingValue 
                 Describes the set of sensed values by the bending  
               
               
                   
                 with respect to the default unit or the unit defined  
               
               
                   
                 in the unit attribute on each joint. 
               
               
                   
                 Note: the ArrayValue defines by the number of axes  
               
               
                   
                 and the number of locations. Three 
               
               
                   
                 by ten matrix indicates that the 
               
               
                   
                 arrayValue has 10 sensing locations, each of which  
               
               
                   
                 has 3-axis bending angles. The order 
               
               
                   
                 of values in each row of the matrix 
               
               
                   
                 may be started from the fingertip to the palm side. 
               
               
                   
               
             
          
         
       
     
         [0077]    Table 7 shows binary representation syntax related to a bending sensor type according to example embodiments. 
         [0000]    
       
         
               
               
               
             
               
               
               
             
           
               
                 TABLE 7 
               
               
                   
               
               
                   
                 Number 
                   
               
               
                 BendSensorType{ 
                 of bits 
                 Mnemonic 
               
               
                   
               
             
             
               
                   
               
             
          
           
               
                  unitFlag 
                 1 
                 bslbf 
               
               
                  SensedInfoBaseType 
                   
                 SensedInfoBaseType 
               
               
                  numOfSensors 
                 16 
                 uimsbf 
               
               
                  numOfAxes 
                 2 
                 uimsbf 
               
               
                  numOfLocations 
                 16 
                 uimsbf 
               
               
                  for(i=0 ;k&lt;numOfSensors ;i ++ ){ 
                   
                   
               
               
                  for(j = 0; j&lt; numOfAxes; j++){ 
                   
                   
               
               
                   for(k=0;k&lt; numOfLocation;k+ + ){ 
                   
                   
               
               
                    ArrayValue [ (i-1)* numOfLocation* 
                 32 
                 fsbf 
               
               
                 numOfAxis + (j-1)* NumOfLocations + k ] 
                   
                   
               
               
                   } 
                   
                   
               
               
                  } 
                   
                   
               
               
                  If (unitFlag == 1){ 
                   
                   
               
               
                    unit 
                   
                 unitType 
               
               
                  } 
                   
                   
               
               
                 } 
               
               
                   
               
             
          
         
       
     
         [0078]    Table 7-2 shows semantics related to binary encoding of the bending sensor type according to example embodiments. 
         [0000]    
       
         
               
               
             
           
               
                 TABLE 7-2 
               
               
                   
               
               
                 Name 
                 Definition 
               
               
                   
               
             
             
               
                 numOfSensors 
                 This field, which is only present in the  
               
               
                   
                 binary representation, 
               
               
                   
                 signals the number of bend sensors. 
               
               
                 numOfAxes 
                 This field, which is only present in the  
               
               
                   
                 binary representation, signals the dimension 
               
               
                   
                 of the data at the sensing locations. 
               
               
                 numOfLocations 
                 This field, which is only present in the 
               
               
                   
                 binary representation, signals 
               
               
                   
                 the number of sensing locations. 
               
               
                   
               
             
          
         
       
     
         [0079]    Table 8 shows an example of sensed information measured by the bending sensor  260 . 
         [0000]    
       
         
               
             
           
               
                 TABLE 8 
               
               
                   
               
             
             
               
                   &lt;iidl:SensedInfo xsi:type=“siv:BendingSensorType″ id=″bending01″ 
               
               
                 activate=″true″ sensorIdRef=″bendingID01″&gt; 
               
               
                     &lt;iidl:TimeStamp xsi:type=″mpegvct:ClockTickTimeType″ 
               
               
                 timeScale=″100″ pts=″60000″/&gt; 
               
               
                   &lt;/iidl:SensedInfo&gt; 
               
               
                   
               
             
          
         
       
     
         [0080]    Referring to Table 8, an ID of the sensed information may be ‘bending01’ and an ID of the bending sensor  260  may be ‘bendingID01.’ That is, the sensed information measured by the bending sensor  260  of ‘bendingID01’ may be ‘bending01.’ In addition, a timestamp of the bending sensor  260  may be ‘60000’ for 100 clock ticks per second. 
         [0081]    The processing unit  220  may generate control information for controlling an object  280  of a virtual world  270  corresponding to the sensed location, based on the angle value and the sensor capability. 
         [0082]    For example, when an angle of the elbow of the user  250  changes from 180 degrees to 90 degrees, the bending sensor  260  may measure the angle value and transmit the angle value to the virtual world processing apparatus  200 . Here, based on the angle value and the sensor capability, the processing unit  220  may generate the control information for controlling the object  280  of the virtual world  270 , for example an avatar, which corresponds to the sensed location, that is, the elbow, to also move the elbow. 
         [0083]    According to an aspect, the processing unit  220  may generate the control information when the angle value measured by the bending sensor  260  is within a range, i.e., less than or equal to the maximum value measurable by the bending sensor  260  and greater than or equal to the minimum value measurable by the bending sensor  260 . 
         [0084]    Depending on embodiments, when the angle value is greater than the maximum value, the processing unit  220  may generate the control information considering the angle value as the maximum value. When the angle value is less than the minimum value, the processing unit  220  may generate the control information considering the angle value as the minimum value. 
         [0085]    The transmission unit  230  may transmit the generated control information to the virtual world  270 . 
         [0086]    Depending on embodiments, the transmission unit  230  may encode the control information into metadata of an XML format and transmit the metadata to the virtual world  270 . In addition, the transmission unit  230  may encode the control information into binary metadata and transmit the binary metadata to the virtual world  270 . Also, the transmission unit  230  may encode the control information into first metadata of the XML format, encode the first metadata into second metadata of a binary format, and transmit the second metadata to the virtual world  270 . 
         [0087]    The virtual world processing apparatus  200  may further include a calculation unit  240 . 
         [0088]    The calculation unit  240  may calculate a third angle value related to a third sensed location disposed between a first sensed location and a second sensed location, based on a first angle value related to the first sensed location and a second angle value related to the second sensed location. 
         [0089]    Here, the processing unit  220  may generate the control information based on the first angle value, the second angle value, the third angle value, and the sensor capability. 
         [0090]    Hereinafter, an operation of calculating the third angle value will be described in detail with reference to  FIG. 4 . 
         [0091]      FIG. 4  illustrates an operation of calculating an angle value by a virtual world processing apparatus according to example embodiments. 
         [0092]    Referring to  FIG. 4 , a bending sensor  410  according to the example embodiments may measure a first angle value related to a first sensed location  401 , for example, a shoulder. Another bending sensor  420  may measure a second angle value related to a second sensed location  403 , for example, a wrist. 
         [0093]    The virtual world processing apparatus may calculate the third angle value of a third sensed location  402  not sensed by the bending sensors  410  and  420 , based on the first angle value and the second angle value. That is, the number of sensors needed may be reduced as the third angle is calculated using the sensed first angle value and the second angle value. 
         [0094]    Depending on embodiments, the virtual world processing apparatus  200  may set an average of the first angle value and the second angle value as the third angle value. 
         [0095]    Depending on embodiments, the virtual world processing apparatus may further include a database collecting and storing the third angle value based on the first angle value and the second angle value. The virtual world processing apparatus may calculate the third angle value based on information stored in the database, the first angle value, and the second angle value. 
         [0096]      FIG. 5  illustrates a structure of an avatar control features type  510  according to example embodiments. 
         [0097]    Referring to  FIG. 5 , the avatar control features type  510  may include attributes  520 , control body features  530 , and control face features  540 , for example. 
         [0098]    The avatar control features information denotes information on features of an avatar, used for control of the avatar of a virtual world. Here, the avatar control features type  510  denotes information on a type of the avatar control features type  510 . 
         [0099]    The attributes  520  denotes information on attributes of the avatar control features information. Depending on embodiments, the attributes  520  may include name information of the features, used for control of the avatar. 
         [0100]    The control body features  530  denote features included in a body part of the avatar, used for control of the avatar. 
         [0101]    Depending on embodiments, the control body features  530  may include HeadBones  531 , UpperBodyBones  532 , DownBodyBones  533 , and MiddleBodyBones  534 . 
         [0102]    For example, the UpperBodyBones  532  may include information on features corresponding to a hand structure of the avatar. 
         [0103]    The hand structure may include a sub structure such as a wrist, finger joints, and the like. 
         [0104]    Table 9 shows the sub structure of the hand structure according to example embodiments. 
         [0000]    
       
         
               
               
               
             
           
               
                 TABLE 9 
               
               
                   
               
             
             
               
                   
                 LWrist 
                 Left wrist 
               
               
                   
                 LHand 
                 Left hand 
               
               
                   
                 LThumb 
                 Thumb proximal phalange 
               
               
                   
                 LPhalanges1 
                 Thumb proximal phalange 
               
               
                   
                 LThumb2 
                 Thumb distal phalange 
               
               
                   
                 LPhalanges2 
                 Thumb distal phalange 
               
               
                   
                 LIndex 
                 Index finger metacarpal 
               
               
                   
                 LPhalanges3 
                 Index finger proximal phalange 
               
               
                   
                 LPhalanges4 
                 Index finger middle phalange 
               
               
                   
                 LPhalanges5 
                 Index finger distal phalange 
               
               
                   
                 LMiddle 
                 Middle finger metacarpal 
               
               
                   
                 LPhalanges6 
                 Middle finger proximal 
               
               
                   
                   
                 phalange 
               
               
                   
                 LPhalanges7 
                 Middle finger middle phalange 
               
               
                   
                 LPhalanges8 
                 Middle finger distal phalange 
               
               
                   
                 LRing 
                 Ring finger metacarpal 
               
               
                   
                 LPhalanges9 
                 Ring finger proximal phalange 
               
               
                   
                 LPhalanges10 
                 Ring finger middle phalange 
               
               
                   
                 LPhalanges11  
                 Ring finger distal phalange 
               
               
                   
                 LPinky 
                 Pinky metacarpal 
               
               
                   
                 LPhalanges12  
                 Pinky proximal phalange 
               
               
                   
                 LPhalanges13 
                 Pinky middle phalange 
               
               
                   
                 LPhalanges14  
                 Pinky distal phalange 
               
               
                   
               
             
          
         
       
     
         [0105]    According to an aspect, the virtual world processing apparatus may generate control information for controlling the avatar control features corresponding to sensed locations, based on sensed information measured by a bending sensor. That is, the sensed locations measured by the bending sensor may correspond to at least one of the avatar control features. 
         [0106]    For example, when the bending sensor measures a bending degree of a wrist of a user, the virtual world processing apparatus may generate the control information for controlling a movement of a wrist of the avatar of the virtual world, which corresponds to the wrist of the user. 
         [0107]      FIG. 6  illustrates a virtual world processing method according to example embodiments. 
         [0108]    Referring to  FIG. 6 , the virtual world processing method may receive an angle value of a sensed location and sensor capability of a bending sensor, from the bending sensor, in operation  610 . 
         [0109]    The bending sensor may measure sensed information on a bending degree of an object in a real world. The sensed information denotes a measured value of the bending degree, that is, an angle of the sensed location measured by the bending sensor. 
         [0110]    Depending on embodiments, the bending sensor may be attached or connected to the sensed location to measure the bending degree, that is, the angle of the sensed location. For example, when a user attaches the bending sensor to an elbow, the bending sensor may sense a bending degree of the elbow, that is, an angle of the elbow. At this time, the virtual world processing method may receive the angle value of the elbow and the sensor capability of the bending sensor, from the bending sensor. 
         [0111]    The bending sensor may be connected to other joints of the user, including elbows, finger joints, a neck, shoulders, and the like, to measure bending degrees of the joints. That is, bending sensors may be placed at various joints of the user and simultaneously sense bending degrees of the various joints. 
         [0112]    The sensor capability denotes the capability of the bending sensor. 
         [0113]    According to example embodiments, the sensor capability of the bending sensor may include at least any combination of maxValue, minValue, Num of Locations, Distance between Location, numOfAxes, and numOfSensors. 
         [0114]    The maxValue may denote a maximum angle value measurable by the bending sensor. The minValue may denote a minimum angle value measurable by the bending sensor. The bending sensor may measure an angle of the sensed location within a range from greater than the minValue to smaller than the maxValue. 
         [0115]    The Num of Locations may denote the number of the sensed locations sensed by the bending sensor. According to an aspect, the bending sensor may singly and simultaneously sense bending degrees of a plurality of sensed locations. Here, the Num of Locations may be a number of the plurality of sensed locations measured by the single bending sensor. Depending on embodiments, a plurality of the bending sensors may measure a plurality of the sensed locations. In this case, the Num of Locations may be a number of the plurality of sensed locations measured by the plurality of the bending sensors. 
         [0116]    The Distance between Location may denote the distance between the adjacent sensed locations. A plurality of the bending sensors may sense a plurality of the sensed locations. 
         [0117]    The numOfAxes may denote dimension of the angle value measurable by the bending sensor. 
         [0118]    The numOfSensors may denote segments measurable by a plurality of the bending sensors when the plurality of sensed locations are measured by the plurality of the bending sensors. 
         [0119]    Depending on embodiments, the sensor capability of the bending sensor may further include accuracy and offset. 
         [0120]    The accuracy may denote information on a measurement error. 
         [0121]    The offset may denote a value for zero point adjustment of the angle value measured by the bending sensor. 
         [0122]    According to an aspect, the sensor capability may include metadata encoded into a binary format. The metadata encoded into the binary format may include a data field related to at least one attribute selected from the Num of Locations, the numOfAxes, and the numOfSensors. That is, the sensor capability which is the metadata encoded into the binary format may limit data size by including the data field related to the at least one attribute selected from the Num of Locations, the numOfAxes, and the numOfSensors. 
         [0123]    The bending sensor type may denote information on the sensed information measured by the bending sensor. 
         [0124]    According to example embodiments, the bending sensor type may include Timestamp, Unit, and Value. 
         [0125]    The Timestamp denotes information on time when the bending sensor measures the angle value of the sensed location. Depending on embodiments, the Timestamp may be information on an interval of time when the bending sensor measures the angle value. 
         [0126]    The Unit denotes a unit of the angle measured by the bending sensor. Depending on embodiments, the Unit may include ‘degree.’ 
         [0127]    The Value denotes an angle value measured by the bending sensor. Depending on embodiments, when a plurality of the bending sensors measure the angle value with respect to one sensed location, the angle value of the sensed location may be a sum total of a plurality of angle values measured by the plurality of bending sensors. 
         [0128]    In operation  620 , the virtual world processing method may generate control information for controlling an object of a virtual world corresponding to the sensed location, based on the angle value and the sensor capability received from the bending sensor. 
         [0129]    For example, when an angle of the elbow of the user changes from 180 degrees to 90 degrees, the bending sensor may measure the angle value. Here, based on the angle value and the sensor capability, the virtual world processing method may generate the control information for controlling the object of the virtual world, for example an avatar  280 . That is, using the virtual world processing method, changing an angle of the user&#39;s elbow may also move the corresponding location of the avatar, i.e., the elbow of an avatar  280 . 
         [0130]    According to an aspect, the virtual world processing method may generate the control information when the angle value measured by the bending sensor is within a range, i.e., less than or equal to the maximum value measurable by the bending sensor and greater than or equal to the minimum value measurable by the bending sensor. 
         [0131]    Depending on embodiments, when the angle value is greater than the maximum value, the virtual world processing method may generate the control information considering the angle value as the maximum value. When the angle value is less than the minimum value, the virtual world processing method may generate the control information considering the angle value as the minimum value. 
         [0132]    In operation  630 , the virtual world processing method may transmit the generated control information to the virtual world. 
         [0133]    Depending on embodiments, the virtual world processing method may encode the control information into metadata of an XML format and transmit the metadata to the virtual world. In addition, the virtual world processing method may encode the control information into binary metadata and transmit the binary metadata to the virtual world. Also, the virtual world processing method may encode the control information into first metadata of the XML format, encode the first metadata into second metadata of a binary format, and transmit the second metadata to the virtual world. 
         [0134]    The virtual world processing method may calculate a third angle value related to a third sensed location disposed between a first sensed location and a second sensed location, based on a first angle value related to the first sensed location and a second angle value related to the second sensed location. 
         [0135]    The methods according to the above-described example embodiments may be recorded in non-transitory computer-readable media including program instructions to implement various operations embodied by a computer. The embodiments can be implemented in computing hardware (computing apparatus) and/or software, such as (in a non-limiting example) any computer that can store, retrieve, process and/or output data and/or communicate with other computers. The results produced can be displayed on a display of the computing hardware. The media may also include, alone or in combination with the program instructions, data files, data structures, and the like. The program instructions recorded on the media may be those specially designed and constructed for the purposes of the example embodiments, or they may be of the kind well-known and available to those having skill in the computer software arts. Examples of non-transitory computer-readable media include magnetic media such as hard disks, floppy disks, and magnetic tape; optical media such as CD ROM disks and DVDs; magneto-optical media such as optical disks; and hardware devices that are specially configured to store and perform program instructions, such as read-only memory (ROM), random access memory (RAM), flash memory, and the like. The media may be transfer media such as optical lines, metal lines, or waveguides including a carrier wave for transmitting a signal designating the program command and the data construction. Examples of program instructions include both machine code, such as produced by a compiler, and files containing higher level code that may be executed by the computer using an interpreter. The described hardware devices may be configured to act as one or more software modules in order to perform the operations of the above-described example embodiments, or vice versa. Examples of the magnetic recording apparatus include a hard disk device (HDD), a flexible disk (FD), and a magnetic tape (MT). Examples of the optical disk include a DVD (Digital Versatile Disc), a DVD-RAM, a CD-ROM (Compact Disc-Read Only Memory), and a CD-R (Recordable)/RW. 
         [0136]    Further, according to an aspect of the embodiments, any combinations of the described features, functions and/or operations can be provided. 
         [0137]    Moreover, the virtual world processing apparatus discussed above may include at least one processor to execute at least one of the above-described units and methods. 
         [0138]    Although example embodiments have been shown and described, it would be appreciated by those skilled in the art that changes may be made in these example embodiments without departing from the principles and spirit of the present disclosure, the scope of which is defined in the claims and their equivalents.