Method and device for switching video pictures

A method and device for switching video pictures are disclosed in the invention, which belong to video conference field. Said method includes: obtaining correspondence relations between participants and venues; finding, when a participant is called, a venue corresponding to the called participant according to the correspondence relations; and switching the video pictures to the venue corresponding to the called participant. According to the invention, it is possible to find the venue corresponding to the called participant according to the correspondence relations, and automatically switch the video to the venue or request to an MCU for switching the video to the venue, without a manual intervention of the participant or waiting for a response from the participant, so that continuity of the video conference is ensured, the video pictures can be switched in time, and “face to face” communion experience of the participants in the video conference is improved.

CROSS-REFERENCE TO RELATED APPLICATIONS

This application is a continuation of International Application No. PCT/CN2010/076770, filed on Sep. 9, 2010, which claims priority to Chinese Patent Application No. 201010002289.2, filed on Jan. 18, 2010, both of which are hereby incorporated by reference in their entireties.

FIELD OF THE INVENTION

The present invention relates to the field of video conference, and particularly, to a method and a device for switching video pictures.

BACKGROUND OF THE INVENTION

Video technology realizes a remote transmission that integrates information such as voice, images and data, so that peoples who are remotely communicating with each other using the video technology can not only hear voice of the other party, but also see moving images and film contents thereof, thus the communication becomes far more cordial and telepresent.

A video conference system consists of a Multipoint Control Unit (MCU) and terminals. Each terminal corresponds to a venue, collects and encodes sounds and images of the venue, and transmits the sounds and images to the MCU. The MCU processes the sounds and images in a certain manner, such as sound mixing, image forwarding or multi-picture formation, and transmits the processed sounds and images to respective terminals. The terminals decode and output the sounds and images from the far-end venues, thereby realizing a remote communication.

There are mainly two methods for switching video pictures in a cur rent video conference.

The first method is one of requesting via a remote controller. When a participant in Venue1wants to watch a picture of Venue2, he/she shall send conference control information through the remote controller, and request to the MCU for watching a picture of Venue2. Upon receiving the control information “Venue1request watching a picture of Venue2” sent from the terminal of Venue1, the MCU forwards the video stream of Venue2to Venue1. As a result, Venue1performs the picture switching function one time.

The second method is a voice exciting image (also referred to as voice activated switch) method, which determines a venue at which the current speaker is located by comparing the volumes of the voices at respective venues in the conference, and automatically broadcasts the picture of the venue to other venues for watching.

During the implementation of the present invention, the inventors find that the existing technology at least has the following problem:

The method of requesting via a remote controller frequently switches pictures through the remote controller, which affects continuity and interactivity of the conference. The method of voice activated switch broadcasts a picture of a venue to other venues for watching only when a speech is made in the venue, thereby causing a certain hysteresis.

SUMMARY OF THE INVENTION

In order to ensure continuity of a video conference and switch video pictures in time, the embodiments of the present invention provide a method and a device for switching video pictures.

The technical solutions are given as follows.

A method for switching video pictures includes:obtaining correspondence relations between participants and venues;finding, when a participant is called, a venue corresponding to the called participant according to the correspondence relations; andswitching the video pictures to the venue corresponding to the called participant.

A device for switching video pictures includes:a relation obtaining module configured to obtain correspondence relations between participants and venues;a venue finding module configured to find, when a participant is called, a venue corresponding to the called participant according to the correspondence relations obtained by the relation obtaining module; anda video switching module configured to switch the video pictures to the venue corresponding to the called participant found by the venue finding module.

A device for switching video pictures includes:a relation obtaining module configured to obtain correspondence relations between participants and venues;a venue finding module configured to find, when a participant is called, a venue corresponding to the called participant according to the correspondence relations obtained by the relation obtaining module; anda switch requesting module configured to send to a Multipoint Control Unit (MCU) a video switching request, which includes an identification of the venue corresponding to the called participant, so that the MCU switches the video pictures to the venue corresponding to the called participant.

The technical solutions of the embodiments of the present invention achieve the following beneficial effect:

When a participant is called, it is possible to find a venue corresponding to the called participant by obtaining the correspondence relations between the participants and the venues and automatically switch the video to the venue or request to the MCU for switching the video to the venue, without a manual intervention of the participant or waiting for a response from the participant, so that the continuity of the video conference is ensured, the video pictures can be switched in time, and “face to face” communion experience of the participants in the video conference is improved.

DETAILED DESCRIPTION OF THE EMBODIMENTS

In order to make the object, technical solutions and advantages of the present invention be clearer, the embodiments of the present invention will be further detailedly described as follows with reference to the drawings.

A method for switching video pictures according to this embodiment is described hereinafter with reference toFIG. 1.

In step101, correspondence relations between participants and venues are obtained.

In step102, when a participant is called, a venue corresponding to the called participant is found according to the correspondence relations.

In step103, video pictures are switched to the venue corresponding to the called participant.

According to the method of the embodiment, when a participant is called, it is possible to find a venue corresponding to the called participant by obtaining correspondence relations between the participants and the venues and automatically switch the video to the venue or request to the MCU for switching the video to the venue, without a manual intervention of the participant or waiting for a response from the participant. Thus continuity of the video conference is ensured, and the video pictures can be switched in time, so that “face to face” communion experience of the participants in the video conference is improved.

Next, the method for switching video pictures is described by way of examples of obtaining correspondence relations by the MCU and a venue terminal, respectively.

In this embodiment, a method for switching video pictures is described hereinafter by way of an example of obtaining correspondence relations by the MCU with reference toFIG. 2.

In step201, the MCU obtains correspondence relations between participants and venues.

Herein, there may be two methods for the MCU to obtain the correspondence relations. One of the two methods is to preset the correspondence relations between the participants and the venues. Particularly, a table of correspondence relations between the participants and the venues is preset in the MCU, so that “Zhang San” is corresponding to Venue1, “Li Si” is corresponding to Venue2, and “Wang Wu” is corresponding to Venue N, for example. The other method is to obtain the correspondence relations between the participants and the venues through “study”. The method for obtaining the correspondence relations through “study” is specifically described as follows.

Firstly, the method for obtaining the correspondence relations through “study” makes use of two habits of people freely communicating in a multipoint conference:

1. When a speaker calls a participant, his/her speech usually contains the participant's name, e.g., “Mr. Zhang San, how are you getting on with your work recently?”, or “next, please listen to the speech of Mr. Li Si”.

2. The called participant will speak in priority after the speaker stops his/her speech.

Based on the above consensus and with reference toFIG. 3, the method for obtaining the correspondence relations through “study” is described hereinafter.

In step201a, the MCU receives a voice signal.

In step201b, the MCU determines that the voice signal is toward a certain participant, and determines a venue corresponding to the participant after the participant responds to the voice signal.

Specifically, the MCU determines through a voice recognition technology that the voice signal is toward a certain participant, i.e., requires the called participant to respond to the voice signal.

Herein, the voice recognition process may include:

1) Recognizing whether the voice signal contains a name. For example, the Hundred Family Names and colloquial names (e.g., Lao Li) may be preset, and if the voice signal matches one of the preset Hundred Family Names or colloquial names, it means that the voice signal contains a name; otherwise the voice signal does not contain any name;

2) Presetting the grammar for calling the participant, including, but not limited to, the name appears at the beginning of the voice signal, or the word “please” occurs together with the name. For example, when the received voice signal is “next, please listen to the speech of Mr. Li Si”, the MCU determines through the voice recognition technology that the voice signal contains the name “Li Si”, which occurs together with the word “please”, and determines that “Li Si” is called.

Particularly, after the participant responds to the voice signal, a venue corresponding to the participant is determined by detecting voice energy or voice activity. Herein, the venue may be identified with, but not limited to, venue name, location, port number, ID, etc.

Further, the MCU can determine that the voice signal is a normal speech, so that the video shall not be switched, and the current video shall still be forwarded to the venue terminals. For example, the voice signal such as “the theme of this conference is environment protection” or “this work is charged by Mr. Li Si” is a normal speech and the video shall not be switched. Herein, the normal speech may contain the participant's name, and the MCU determines through the voice recognition technology that the voice signal mentions the participant rather than is toward the participant.

Then, in step201c, a correspondence relation between the participant and the venue corresponding thereto is recorded.

For example, at the initial stage of a video conference, when there is no speech at any venue, correspondence relations recorded in the MCU are nulls, as illustrated inFIG. 4. Herein, Terminal1is a terminal of Venue1, Terminal2is a terminal of Venue2, and Terminal N is a terminal of Venue N. After “Zhang San” calls “Li Si” and “Wang Wu” at Venue1, the MCU records that “Li Si” is corresponding to Venue2, and “Wang Wu” is corresponding to Venue N, as illustrated inFIG. 5. Next, when “Li Si” or “Wang Wu” is called again by Venue1, the MCU finds the venue corresponding to the name from the recorded correspondence relations, and sends the video picture of the venue to Venue1for watching. Since Venue2and Venue N do not voluntarily call any other venue, their records are still nulls.

The above two methods for obtaining correspondence relations need not to add any special control command in voice, and improve “face to face” communication experience. The above two methods also have other advantages, respectively. The first method of presetting is simple and easy to be implemented. The second method of “study” can automatically obtain the correspondence relations and update at any time.

Returning toFIG. 2, in step202, the MCU receives the voice signal, and determines that the voice signal is toward a participant.

Particularly, the MCU determines through the voice recognition technology that the voice signal is toward a participant.

Furthermore, the MCU may determine that the voice signal is a normal speech, so that the video shall not be switched, and the current video shall still be forwarded to the venue terminals. It is already described specifically with respect to step201band thus omitted herein.

In step203, it is determined whether the called participant is involved in the correspondence relations. If it is determined that the called participant is involved in the correspondence relations, the procedure goes to step204; otherwise, the procedure goes to step205.

In step204, the MCU finds the venue corresponding to the called participant according to the correspondence relations and switches the video pictures to the venue.

In step205, after the called participant responds to the voice signal, the venue corresponding to the called participant is obtained, and the correspondence relation between the called participant and the venue corresponding thereto is recorded.

Particularly, the process for obtaining the venue corresponding to the called participant includes, but not limited to, determining the venue corresponding to the called participant by detecting voice energy (also referred to as voice envelope) or voice activity.

Herein, the MCU concerned in the embodiment may be independent from the venues, or integrated with a terminal of a certain venue.

According to the method of this embodiment, when a participant is called, the MCU can find a venue corresponding to the called participant by obtaining the correspondence relations between the participants and the venues and automatically switch the video to the venue, without a manual intervention of the participant or waiting for a response from the participant, so that the continuity of the video conference is ensured, the video pictures can be switched in time, and the “face to face” communion experience of the participants in the video conference is improved. In addition, since the MCU obtains the correspondence relations and determines the venue to be switched to, the requirement on performance of the venue terminals is decreased, and it is convenient to collectively mange the correspondence relations.

In this embodiment, a method for switching video pictures is described hereinafter by way of an example of obtaining correspondence relations by avenue terminal with reference toFIG. 6.

In step301, a venue terminal obtains correspondence relations between participants and respective venues. Herein, the obtaining process includes but not limited to:

1) A method of presetting correspondence relations between participants and respective venues at respective venue terminals.

2) A method of distributing, by the MCU, the correspondence relations to respective venue terminals upon obtaining the correspondence relations. Herein, the method for the MCU to obtain the correspondence relations may use the method according to Embodiment 2.

3) A method of obtaining the correspondence relations through “study”. This method is described hereinafter with reference toFIG. 7.

In step301a, a venue terminal calls a participant.

In step301b, once the participant responds to the call, the calling venue terminal receives a venue corresponding to the participant sent by the MCU.

Particularly, once the participant responds to the call through its venue terminal, the MCU determines and sends the venue corresponding to the participant. Herein, the method for determining the venue corresponding to the participant includes, but not limited to, determining the venue corresponding to the participant by detecting voice energy (also referred to as voice envelope) or voice activity. In addition, the venue corresponding to the participant may be identified with, but not limited to, venue name, location, port number, ID, etc.

Further, when the MCU is integrated with the calling venue terminal, the calling venue terminal obtains the venue corresponding to the participant once the participant responds to the call.

In step301c, the calling venue terminal records the correspondence relation between the participant and the venue corresponding thereto.

The above three methods for obtaining correspondence relations need not to add any special control command in the voice, and improve “face to face” communication experience. The above three methods also have other advantages, respectively. The first method of presetting is simple and easy to be implemented. The second method of distributing by the MCU facilitates the centralized management and decreases the requirement on performance of the venue terminals. The third method of “study” can automatically obtain the correspondence relations and update at any time.

Returning toFIG. 6, in step302, when the venue terminal calls a participant, it is determined whether the called participant is involved in the correspondence relations. If the determination result is yes, the procedure goes to step303; otherwise, the procedure goes to step304.

In step303, the venue corresponding to the called participant is found according to the correspondence relations, and a video switching request is automatically sent to the MCU, which includes the identification of the venue corresponding to the called participant, so that the MCU switches the video pictures to the venue corresponding to the called participant.

In step304, once the called participant responds to the call, the venue corresponding to the called participant is obtained, and the correspondence relation between the called participant and the venue corresponding thereto is recorded.

Herein, the method for obtaining the venue corresponding to the called participant includes: receiving the venue corresponding to the called participant sent by the MCU. The method for the MCU to obtain and send the venue corresponding to the participant has been described with reference to step301b.

Herein, the MCU concerned in the embodiment may be independent from the venues, or integrated with the terminal of a certain venue.

According to the method of this embodiment, when a participant is called, the venue terminal can find a venue corresponding to the called participant by obtaining the correspondence relations between the participants and the venues, without a manual intervention of the participant or waiting for a response from the participant, and request to the MCU for switching the video to the venue, so that continuity of the video conference is ensured, the video pictures can be switched in time, and “face to face” communion experience of the participants in the video conference is improved.

Referring toFIG. 8, this embodiment provides a device for switching video pictures, including:a relation obtaining module401configured to obtain correspondence relations between participants and venues;a venue finding module402configured to find, when a participant is called, a venue corresponding to the called participant according to the correspondence relations obtained by the relation obtaining module401; anda video switching module403configured to switch the video pictures to the venue corresponding to the called participant found by the venue finding module402.

Referring toFIG. 9, the relation obtaining module401includes:a voice receiving unit401aconfigured to receive a voice signal;a venue determining unit401bconfigured to determine, through voice recognition technology, that the voice signal received by the voice receiving unit401ais towards a participant, and determines a venue corresponding to the participant by detecting voice energy or voice activity upon receiving a response from the participant; anda relation recording unit401cconfigured to record a correspondence relation between the participant and the venue corresponding thereto determined by the venue determining unit401b.

Alternatively, the relation obtaining module401includes:a relation setting unit401dconfigured to preset correspondence relations between participants and venues.

Further, the device may also include a call determining module404configured to receive a voice signal, and determine through voice recognition technology that the voice signal is towards a participant, and then performs the venue finding module402.

Further, the device may also include a relation determining module405configured to determine whether the called participant is involved in the correspondence relations obtained by the relation obtaining module401, and if not, obtain the venue corresponding to the called participant once the called participant responds to the call, and record the correspondence relation between the called participant and the venue corresponding thereto.

Particularly, the device of this embodiment may be the MCU.

According to the device of this embodiment, when a participant is called, it is possible to find a venue corresponding to the called participant by obtaining the correspondence relations between the participants and the venues, without a manual intervention of the participant or waiting for a response from the participant, and automatically switch the video to the venue, so that continuity of the video conference is ensured, the video pictures can be switched in time, and “face to face” communion experience of the participants in the video conference is improved. In addition, since the device obtains the correspondence relations and determines the venue to be switched to, the requirement on performance of the venue terminals is decreased, and it is convenient to collectively mange the correspondence relations.

Referring toFIG. 10, this embodiment provides a device for switching video pictures, including:a relation obtaining module501configured to obtain correspondence relations between participants and venues;a venue finding module502configured to find, when a participant is called, a venue corresponding to the called participant according to the correspondence relations obtained by the relation obtaining module501; anda switch requesting module503configured to send to an MCU a video switching request, which includes an identification of the venue corresponding to the called participant, so that the MCU switches the video pictures to the venue corresponding to the called participant.

Referring toFIG. 11, the relation obtaining module501includes:a calling unit501aconfigured to call a participant;a receiving unit501bconfigured to receive a venue corresponding to the participant sent by the MCU once the participant responds to the call, or obtain a venue corresponding to the participant once the participant responds to the call; anda recording unit501cconfigured to record a correspondence relation between the participant called by the calling unit501aand the venue corresponding to the participant received by the receiving unit501b.

Alternatively, the relation obtaining module501includes:a relation setting unit501dconfigured to preset the correspondence relations between the participants and the venues.

Further, the device may also include:a relation determining module504configured to determine whether the called participant is involved in the correspondence relations obtained by the relation obtaining module501, and if not, receive the venue corresponding to the called participant sent by the MCU once the called participant responds to the call, and record the correspondence relation between the called participant and the venue corresponding thereto.

Particularly, the device of this embodiment may be a venue terminal.

According to the device of this embodiment, when a participant is called, it is possible to find a venue corresponding to the called participant by obtaining the correspondence relations between the participants and the venues, without a manual intervention of the participant or waiting for a response from the participant, and request to the MCU for switching the video to the venue, so that continuity of the video conference is ensured, the video pictures can be switched in time, and “face to face” communion experience of the participants in the video conference is improved.

All or parts of the technical solutions according to the above embodiments can be implemented through software programming, and the software program is stored in a readable storage medium such as a hard disk, an optical disk or a floppy disk in computer.

The above descriptions are just preferred embodiments of the present invention, rather than limitations thereto. Any modification, equivalent replacement, improvement, etc. made under the spirit and principle of the present invention shall fall within the protection scope of the present invention.