METHOD FOR PROVIDING CONTENTS INFORMATION AND BROADCAST RECEIVING APPARATUS

A method of providing contents information and broadcast receiving apparatus are provided. The method of providing contents information includes requesting, according to user input, a contents providing server to perform a contents search; receiving contents data on contents searched in response to the contents search request from the contents providing server; converting the contents data into audio data using a Text-To-Speech technology; and processing the audio data and outputting the processed audio data, according to at least one characteristic of the searched contents and/or user input.

DETAILED DESCRIPTION

Certain exemplary embodiments are described in detail below with reference to the accompanying drawings.

In the following description, like drawing reference numerals are used for the like elements, even in different drawings. The matters defined in the description, such as a detailed construction and elements, are provided to assist in a comprehensive understanding of exemplary embodiments. However, exemplary embodiments can be practiced without those specifically defined matters. Also, well-known functions or constructions are not described in detail since they would obscure the application with unnecessary detail.

FIG. 1is a view illustrating a dialogue type voice recognition system10, according to an exemplary embodiment. As illustrated inFIG. 1, the dialogue type voice recognition system10includes a broadcast receiving apparatus100, a first server200, a second server300and a contents providing server400. In an exemplary embodiment, the broadcast receiving apparatus100is implemented as an apparatus such as a smart TV, but this is merely an exemplary embodiment, and thus, the broadcast receiving apparatus100may be implemented as other types of apparatuses, such as, for example, a monitor or set top box.

When a user's voice is input by a voice input device, the broadcast receiving apparatus100converts the input user's voice into a digital signal, and transmits the converted digital signal to the first server200. According to an exemplary embodiment, the term “voice” may refer to a voice command spoken by a user, where the voice command may be, for example, a command to perform a search, a request for information, etc. When the digital signal is received from the broadcast receiving apparatus100, the first server200converts the received digital signal corresponding to the user's voice into text information using at least one of various mechanisms, such as, for example, a language model, sound model, and pronunciation dictionary, and transmits the text information to the broadcast receiving apparatus100.

In addition, the broadcast receiving apparatus100transmits the text information received from the first server200to the second server300. When the text information is received from the broadcast receiving apparatus100, the second server300generates response information corresponding to the received text information and transmits the generated response information to the broadcast receiving apparatus100. In an exemplary embodiment, the response information includes at least one of a response message, a control signal, and a contents search result corresponding to the user's voice. A response message is text information responding to a user's voice. For example, if the user's voice says “would you search ______?”, the response message may be text information such as “yes” which responds to the user's voice. A control signal is a signal for controlling the broadcast receiving apparatus100corresponding to the user's voice. For example, if the user's voice says “change the channel to ______ (channel name)”, the control signal may be a signal that controls a tuner of the broadcast receiving apparatus100to select the channel corresponding to the user's voice. A contents search result is information responding to a contents search request by a user. For example, if the user's voice is “who is the main character in ______ (movie title)?”, the contents search result may be information identifying the main character searched in response to the user's voice.

The second server300may determine whether received text information is a contents search request. In a case where the received text information is a contents search request, the second server300transmits the contents search request to the contents search server400and receives contents data on contents searched in response to the contents search request made by the user, from the contents search server400. In addition, the second server300may transmit contents data to the broadcast receiving apparatus100as response information.

Based on the response information, the broadcast receiving apparatus100may perform various functions corresponding to a user's voice. For example, when a user's voice for changing a channel is input, the broadcast receiving apparatus100may select the corresponding channel and display the selected channel. In this case, at the same time as the channel is selected, the broadcast receiving apparatus100may provide a response message corresponding to the corresponding function. In the aforementioned example, the broadcast receiving apparatus100may output information on the changed channel or a message showing that the channel changing has been completed in a voice or text format.

The broadcast receiving apparatus100may output the response message corresponding to the user's voice in a voice or text format, and may output contents data which is related to the searched contents. For example, when a user's voice says “what are the recently released movies?”, which is a request for contents information, the broadcast receiving apparatus100outputs a response message, such as “I will tell you the recently released movies” from the second server300as audio, and displays contents data on the searched recently released movies.

The broadcast receiving apparatus100may use a TTS algorithm to convert the received contents data into audio data, and may output the converted audio data according to a user's request. In an embodiment, the broadcast receiving apparatus100may process the audio data and output the processed audio data, according to at least one characteristic of the searched contents and/or user input (for example, a user's voice). For example, the broadcast receiving apparatus100may process the audio data and output the processed audio data in different settings according to a type of the searched contents, and may process the audio data and output the processed audio data according to an intonation of the user's voice.

In addition, after generating and displaying a contents list using contents data on the searched contents, the broadcast receiving apparatus100may output the contents information of the contents displayed on the contents list as audio data.

In an exemplary embodiment, the broadcast receiving apparatus100is connected to the contents providing server400through the second server300, but this is merely an exemplary embodiment, and the broadcast receiving apparatus100may perform communication with the contents providing server400directly or through other connection configurations. Also, the second server300may be connected to the contents providing server400in various ways, for example, the second server300may be connected to the contents providing server400over the Internet.

According to the dialogue type voice recognition system10described above, a user is provided with contents information using an audio UI. In addition, by processing audio data according to a contents characteristic or user input, the broadcast receiving apparatus100achieves a high entertainment value.

Hereinbelow is a detailed explanation of the broadcast receiving apparatus100according to an exemplary embodiment.

As illustrated inFIG. 2, the broadcast receiving apparatus100includes a voice input unit110, a TTS conversion unit120, a user input unit130, a storage unit140(e.g., a memory, a storage, etc.), a communication unit150, an audio output unit160, a display unit170(e.g., a display, etc.)_ and a controller180.

The voice input unit110receives a user's voice (e.g., a voice command) and performs a signal processing operation so as to enable voice recognition. More specifically, the voice input unit110converts an analogue type user voice, which has been input into the voice input unit110, into a digital signal. In addition, the voice input unit110calculates the energy of the converted digital signal and determines whether the energy of the digital signal is greater than or equal to a predetermined value. If the energy of the digital signal is below the predetermined value, the voice input unit110determines that the digital signal which has been input is not a user's voice, and waits for another user's voice. If the energy of the digital signal is greater than or equal to the predetermined value, the voice input unit110removes noise from the digital signal. Specifically, the voice input unit110removes noise (for example, sounds created by an air conditioner or a vacuum cleaner, music, etc.) that may occur in a home environment from which the digital signal has been input. In addition, the voice input unit110outputs the digital signal from which noise has been removed to the communication unit150.

According to an exemplary embodiment, the voice input unit110may be implemented as a voice input device such as a microphone. The voice input device may be built in the broadcast receiving apparatus100to form an all-in-one system, or may be implemented to be separated from the broadcast receiving apparatus100. In a case where the voice input device is implemented to be separated from the broadcast receiving apparatus100, the voice input device may be implemented as a type that may be grasped by a user, and/or a type that may be placed on a table. Furthermore, the voice input device may be connected to the broadcast receiving apparatus100either through a wired connection or wirelessly.

The TTS conversion unit120uses a TTS algorithm to convert text data into audio data. A TTS algorithm may be one of various types of TTS algorithms.

The TTS conversion unit120may convert text data extracted from metadata of contents data received from the contents search server400into audio data.

The user input unit130receives a user command for controlling the broadcast receiving apparatus100. The user input unit130may receive a user command for a content search. The user input unit130may be implemented as one of various input devices such as a remote control, a mouse, a keyboard, etc.

The storage unit140stores various programs and data for driving the broadcast receiving apparatus100. When a user's voice is input, the storage unit140may store a result of an analysis of characteristics of the user's voice. For example, the storage unit140may analyze a frequency, etc., of the user's voice, and store information on an intonation, speed, etc. of the user's voice.

The communication unit150performs communication with the external servers200,300,400. The communication unit150may transmit a digital signal corresponding to a user's voice received from the voice input unit110, and may receive text information corresponding to the user's voice from the first server200. In addition, the communication unit150may transmit text information corresponding to the user's voice to the second server300, and may receive response information corresponding to the text information from the second server300. According to an exemplary embodiment, the response information may include contents data of the contents requested by the user.

In addition, the communication unit150may be implemented as a wireless communication module which is connected to an external network and performs communication according to a wireless communication protocol, such as Wifi, IEEE, etc. The wireless communication module may further include mobile communication modules which access a mobile communication network and perform communication according to various mobile communication standards, such as 3rd Generation (3G), 3rd Generation Partnership Project (3GPP), Long Term Evolution (LTE), etc.

In the aforementioned exemplary embodiment, the communication unit150for communicating with the first server200and second server300is an integrated type, but this is merely an exemplary embodiment, and thus, the communication unit150for communication with the first server200and the second server300may be separated as a first communication unit which communicates with the first server200and a second communication unit which communicates with the second server300.

The audio output unit160outputs audio data. According to an exemplary embodiment, the audio output unit160may output audio data converted from contents data. The audio output unit160may be implemented as an output port, such as a speaker, a jack, etc.

The display unit170may be implemented as a liquid crystal display (LCD), organic light emitting display (OLED), plasma display panel (PDP) etc., and includes a display screen which may be integrated into the broadcast receiving apparatus100. The display unit170may display a response message corresponding to a user's voice in a text or image format. In addition, the display unit170may generate a contents list generated by using contents data received from the contents providing server400.

The controller180controls overall operations of the broadcast receiving apparatus100according to a user command input through the voice input unit110and user input unit120. The controller180may control the communication unit150to request the contents providing server400for a contents search according to user input, and to receive contents data on contents searched in response to the contents search request from the contents providing server400. In addition, the controller180controls the TTS conversion unit120to convert the received contents data into audio data. In addition, the controller180processes the audio data and outputs the processed audio data through the audio output unit160, according to at least one characteristic of the searched contents and/or user input.

More specifically, the controller180requests for a contents search according to a user command input through the voice input unit110and/or user input unit130. For example, if a user's voice stating: “what are the recently released movies?” is input through the voice input unit110, the controller180may perform a voice recognition using the first server200and second server300, and request the contents providing server400for contents data of the recently released movies. As another example, if a user's command to “search for recently released movies” is input through the user input unit130, the controller180may request the contents providing server400for contents data on the recently released movies.

Furthermore, the controller180may receive contents data corresponding to a contents search request from the contents providing server400through the communication unit150. For example, when a contents search request for recently released movies is received from the broadcast receiving apparatus100, the contents providing server400may transmit contents data on the movies released within a certain period (for example, 2 weeks) to the broadcast receiving apparatus100. According to an exemplary embodiment, the contents data may store contents information such as a title, genre, playback time, story line, main characters, director, producer, provided languages, etc., as metadata.

When the contents data is received from the contents providing server400, the controller180parses the metadata of the received contents data and extracts text data corresponding to the contents information.

In addition, the controller180may use the text data corresponding to the contents information, to display the contents information on the searched contents on the display unit170.

When a user command for outputting the contents information as audio data is input, the controller180may use TTS technology to convert the text data corresponding to the contents information into audio data, and then control the audio output unit160to output the audio data. For example, in a state where contents information on “______ (movie title)” is displayed, when a user command for an audio output of the contents information (for example, when a user selects a certain button on a remote control) is input, the controller180may convert the contents information on “______” (for example, at least one of a title, genre, playback time, story line, main characters, director, producer, provided languages, etc.) into audio data, and then output the converted audio data.

The contents data which has been output may be altered by a user setting. For example, in a case where the user sets only the title and story line of the contents, the controller180may convert information on only the title and story line of the contents into audio data and output the converted audio data.

According to an exemplary embodiment, the controller180may process the audio data according to at least one characteristic of the contents and/or user input.

More specifically, the controller180may process the audio data in an audio setting corresponding to a genre of the contents. For example, if the genre of the movie contents is “horror movie”, the controller180may process the audio data to be output as a spooky human voice so as to correspond to the “horror movie” genre. As another example, if the genre of the movie contents is “children's movie”, the controller180may process the audio data to be output as a child's voice so as to correspond to the “children's movie” genre.

In addition, the controller180may analyze a user's voice, and process the audio data differently according to a characteristic of the user's voice. For example, if the user's voice is faster than a predetermined speed and there are severe changes in the intonation, the controller180may analyze the user's voice and determine that the user is agitated, and process the audio data to be output as a calm human voice.

As described above, by processing audio data according to at least one characteristic of the contents and/or user input, the broadcast receiving apparatus100achieves a high entertainment value.

In addition, the controller180may use the received contents data and generate a contents list. For example, as illustrated inFIG. 3, the controller180may generate a movie contents list300.

When an audio playback command requesting contents information of all contents contained in the contents list is input, the controller180may output contents information on all contents contained in the contents list as audio data in a display order. For example, as illustrated inFIG. 3, in a state where the contents list300is displayed, when an audio playback command requesting the contents information of all contents is input, the controller180may output contents information of all the contents in the contents list300, for example, a list of movies (e.g., The Shawshank Redemption, Happy Together, Help, Farewell My Concubine, etc.) as audio data, in an order in which the contents are displayed. As illustrated inFIG. 3, the controller180may also display a notice message310which notifies that contents information is being output as audio data.

According to an exemplary embodiment, the contents information being output may be altered by a user setting. For example, if the user sets only a title and story line of the contents, the controller180may convert only the title and story line of the contents and output the converted information.

In addition, when one of the contents contained in the contents list is selected, the controller180may display the contents information on the selected contents on the display unit170and output the contents information as audio data. For example, in a state where the contents list300such as inFIG. 3is displayed, when “The Shawshank Redemption” is selected by a user command, the controller180may display information on “The Shawshank Redemption” which is the contents information of the selected movie as illustrated inFIG. 4, and output the contents information as audio data.

By the aforementioned broadcast receiving apparatus100, the user is provided with contents information through an audio UI.

Hereinbelow is an explanation on a method of providing contents information, according to an exemplary embodiment, referring toFIG. 5.

First, a broadcast receiving apparatus100requests an externally located contents providing server400to perform a contents search at operation S510. The broadcast receiving apparatus100may request the contents search in response to receiving a user's voice (e.g., a voice command) or user input transmitted through a user input device (for example, a keyboard, mouse, touchpad, etc.).

Next, the broadcast receiving apparatus100receives contents data on searched contents from the contents providing server400at operation S520. The contents data may store contents information including, for example, at least one of a title, genre, playback time, story line, main characters, director, producer, and provided languages of the searched contents, as metadata.

Next, the broadcast receiving apparatus100converts the contents data into audio data using TTS technology at operation S530. More specifically, the broadcast receiving apparatus100may parse the metadata of the received contents data to extract text data including the contents information, and convert the text data into audio data using TTS technology.

Next, the broadcast receiving apparatus100processes the audio data according to at least one characteristic of the searched contents and/or user input, and outputs the processed audio data at operation5540. More specifically, the broadcast receiving apparatus100may process the audio data in an audio setting corresponding to the genre of the contents. For example, in a case where the genre of the movie contents is “honor movie”, the broadcast receiving apparatus100may process the audio data to be output as a spooky human voice so as to correspond to the “honor movie” genre. As another example, in a case where the genre of the movie contents is “children's movie”, the broadcast receiving apparatus100may process the audio data to be output as a child's voice so as to correspond to the “children's movie” genre. In addition, the broadcast receiving apparatus100may analyze the user's voice, and process the audio data differently so as to correspond to the characteristics of the user's voice. For example, if the user's voice is faster than a predetermined speed and there are severe changes in the intonation, the broadcast receiving apparatus100may analyze the user's voice and determine that the user is agitated, and process the audio data to be output as a calm human voice.

By the aforementioned method of providing contents, a user is able to receive contents information in an audio method, and as audio data of different settings can be output according to the genre of the contents, the mood of the user, and other characteristics, the broadcast receiving apparatus100may achieve a high entertainment value.

A program code for performing a method of providing contents information according to the aforementioned various exemplary embodiments may be stored in a non-transitory computer readable medium. A non-transitory computer readable medium refers to a computer readable medium which stores data semi-permanently unlike media such as a resistor, cache, and memory etc. which stores data for a short time. More specifically, the aforementioned various applications or programs may be stored and provided in a non-transitory computer readable medium such as a CD, a DVD, a hard disk, a blu-ray disk, USB, memory card, and ROM etc.