Abstract:
Embodiments of the present invention provide a file operation method and a file operation apparatus for use in a network video conference system. The method comprises: acquiring a user image in real time; identifying a user&#39;s limb; judging whether or not the user&#39;s limb is associated with a file; and if the user&#39;s limb is associated with the file, matching a limb action of the user with a predetermined action set, so as to operate the file. When using the network video conference system, users can operate the file on a desktop through the limb actions, so as to facilitate the communication between the users and improve the user experience.

Description:
CROSS-REFERENCE TO RELATED APPLICATIONS 
       [0001]    The present application claims priority to Chinese Patent Application No. 201310339668.4 filed before the Chinese Patent Office on Aug. 6, 2013 and entitled “File Operation Method and File Operation Apparatus for Use in Network Video Conference System”, which is incorporated herein by reference in its entirety. 
       TECHNICAL FIELD 
       [0002]    The present invention relates to the field of communication, in particular to a file operation method and a file operation apparatus for use in a network video conference system. 
       BACKGROUND 
       [0003]    Recently, along with the rapid development of the network, for users in different places, an identical desktop may be displayed in two places via a shared desktop, so that a local user and a remote user can work under the same desktop. 
         [0004]    However, in the prior art, usually operations on files such as pictures and documents cannot be performed cooperatively, i.e., the files will be operated by one side and viewed by the other. In addition, files and information need to be transmitted and expressed by virtue of physical devices such as a mouse or a keyboard, which results in unsmooth communication and poor user experience. 
       SUMMARY 
       [0005]    An object of the present invention is to provide a file operation method and a file operation apparatus for use in a network video conference system. 
         [0006]    One aspect of the present invention provides a file operation method for use in a network video conference system, comprising:
       acquiring a user image in real time;   identifying a user&#39;s limb;   judging whether or not the user&#39;s limb is associated with a file; and   if the user&#39;s limb is associated with the file, matching a limb action of the user with a predetermined action set, so as to operate the file.       
 
         [0011]    Another aspect of the present invention provides a file operation apparatus for use in a network video conference system, comprising:
       an image acquisition unit configured to acquire a user image in real time;   a limb identification unit configured to identify a user&#39;s limb; and   a limb action processing unit configured to judge whether or not the user&#39;s limb is associated with a file, and if the user&#39;s limb is associated with the file, match a limb action of the user with a predetermined action set so as to operate the file.       
 
         [0015]    According to the embodiments of the present invention, when using the network video conference system, the user can operate the file on a desktop through the limb actions, so as to facilitate the communication between the users and improve the user experience. 
     
    
     
       BRIEF DESCRIPTION OF THE DRAWINGS 
         [0016]      FIG. 1  is a flow chart of a file operation method  1000  for use in a network video conference system according to one embodiment of the present invention; and 
           [0017]      FIG. 2  is a diagram showing a file operation apparatus  100  for use in a network video conference system according to one embodiment of the present invention. 
       
    
    
     DETAILED DESCRIPTION 
       [0018]    Embodiments of the present invention will be described hereinafter in conjunction with the drawings. 
         [0019]      FIG. 1  is a flow chart of a file operation method  1000  for use in a network video conference system according to one embodiment of the present invention. As shown in  FIG. 1 , the method comprises a step S 110  of acquiring a user image in real time, a step S 120  of identifying a user&#39;s limb, a step S 130  of judging whether or not the user&#39;s limb is associated with a file, a step S 140  of, if the user&#39;s limb is associated with the file, matching a limb action of the user with a predetermined action set, and a step S 150  of operating the file according to the matched limb action. 
         [0020]    In step S 110 , the user image may be acquired via a camera. In step S 120 , the acquired user image may be converted from a RGB color space into an HSV color space, and then a skin color detection may be executed to identify the user&#39;s limb. For example, an image within a threshold range may be identified as the user&#39;s limb, and an image and a 2D coordinate of the identified limb may be stored in an array. For instance, the threshold range may be set as 0&lt;H&lt;20, 51&lt;S&lt;255, 0&lt;V&lt;255. The image and the 2D coordinate of the identified limb are extracted from the array, user&#39;s head and hands are identified according to convex hulls, and then convex hull process is performed on images of the user&#39;s hands so as to identify a hand action of the user. For example, the user&#39;s hand action may include the action of a single finger, a palm and a fist. In addition, a center of gravity of the head may be calculated so as to distinguish between left and right hands. 
         [0021]    For example, when the user is desired to perform a selection operation on a picture through his fist, a user image is acquired at first through a camera, and the user&#39;s head and hands are identified. Then, it is to judge whether there is an intersection between a 2D coordinate of the user&#39;s hands and a 2D coordinate of the picture. If yes, it is to judge whether or not the user&#39;s hand action matches a “selection” action in the action set. For example, in the action set, the hand action being a fist indicates the “selection” action, and when it is judged that the user&#39;s hand action is a fist, the picture will be selected by the user through the hand action. After the user selects the picture, when the user moves his hand, the picture will move too. When the user moves beyond an effective range of the camera, the picture will disappear, and when the user enters again the effective range, the picture will still be attached to the user&#39;s hand. When a user&#39;s gesture is changed from fist to palm, the selection of the picture will be cancelled, and the picture is fixed at a position of a screen where the user&#39;s hand is located when the selection is cancelled. 
         [0022]    When the local and remote users place their fists on the picture simultaneously, the picture will be selected and then operated cooperatively by the users. The cooperative operations that may be performed by both the local and remote users include zooming in, zooming out and rotating, and these operations may be performed in real time. The picture may be zoomed in and out along with a change of the distance between the local user&#39;s hand and the remote user&#39;s hand. When the distance increases, the picture will be zoomed in, and when the distance decreases, the picture will be zoomed out. In addition, the picture may be rotated along with a change of an angle between the two hands and the X axis. When the gesture of any one of the users is changed from fist to palm, the cooperative operation will be ended. 
         [0023]    For another example, when a user places a single finger on the picture, the picture will be selected and then annotated (doodled). Along with the movement of the user&#39;s finger, annotations will be left in the picture. When the gesture of the user is changed from single finger to palm, the selection will be cancelled and the annotations will be stored in the picture. 
         [0024]      FIG. 2  is a diagram showing a file operation apparatus  100  for use in a network video conference system according to one embodiment of the present invention. As shown in  FIG. 2 , the apparatus  100  comprises an image acquisition unit  10  configured to acquire a user image in real time, a limb identification unit  20  configured to identify a user&#39;s limb, and a limb action processing unit  30  configured to judge whether or not the user&#39;s limb is associated with a file, and if yes, match a limb action of the user with a predetermined action set so as to operate the file. 
         [0025]    For example, the image acquisition unit  10  may be a camera for acquiring the user image. The limb identification unit  20  may convert the user image from a RGB color space into an HSV color space, and perform a skin color detection to identify the user&#39;s limb. For examiner, the limb identification unit  20  will identify an image within a threshold range as the user&#39;s limb and store an image and a 2D coordinate of the identified limb in an array. For instance, the threshold range may be set as 0&lt;H&lt;20, 51&lt;S&lt;255, 0&lt;V&lt;255. The limb identification unit  20  is further configured to extract the image and the 2D coordinate of the identified limb from the array, identify user&#39;s head and hands, and perform convex hull processing on images of the user&#39;s hands so as to identify a hand action of the user. The user&#39;s hand action may include the action of a single finger, a palm and a fist. In addition, the limb identification unit  20  may be further configured to calculate a center of gravity of the head so as to distinguish between left and right hands. 
         [0026]    For example, when the user is desired to perform a selection operation on a picture through his fist, at first the image acquisition unit  10  (e.g., the camera) acquires the user image and the limb identification unit  20  identifies the user&#39;s head and hands. Then, the limb action processing unit  30  judges whether there is an intersection between a 2D coordinate of the user&#39;s hands and a 2D coordinate of the picture, and if yes, judges whether or not the user&#39;s hand action matches a “selection” action in the action set. For example, in the action set, the hand action being a fist indicates the “selection” action, and when it is judged that the user&#39;s hand action is a fist, the picture will be selected by the user through the hand action. 
         [0027]    The above are merely the preferred embodiments of the present application, and these embodiments are not used to limit the protection scope of the present application. It should be noted that, a person skilled in the art may further make improvements and modifications without departing from the principle of the present invention, and these improvements and modifications shall also be considered as the scope of the present invention.