Patent Description:
In addition, the present disclosure relates to an Artificial Intelligence (AI) system that imitates the functions of human brain such as recognition and determination using a machine learning algorithm and applications thereof.

The Artificial Intelligence (AI) system is a computer system that may implement a human-level intelligence, and unlike the conventional rule-based smart system, the Artificial Intelligence (AI) system is a smart system where a machine trains and determines by itself and gets smarter. The use of artificial intelligence system increases a recognition rate and facilitates understanding a user's taste more accurately. Therefore, the conventional rule-based smart system has been gradually replaced by a deep-learning based artificial intelligence system.

The artificial intelligence technology includes a machine learning (ex. deep-learning) technology and elemental technologies which utilize the machine learning technology. The machine learning technology may refer, for example, to an algorithm technique which sorts characteristics of input data and trains by itself. The elemental technology uses a machine learning algorithm such as the deep-learning and includes the techniques such as linguistic understanding, visual understanding, inference/prediction, knowledge representation, motion control, etc..

The artificial intelligence technology is applied to various technical fields. For example, linguistic understanding is a technique for recognizing and applying/processing human language/characters and includes the functions of natural language processing, machine translation, dialogue system, query response, voice recognition/synthesis, and the like. Visual understanding is a technique for recognizing and processing objects from a human's point of view, including object recognition, object tracking, image search, human recognition, scene understanding, spatial understanding, image enhancement, and the like. The inference/prediction is a technique for determining, logically inferring and predicting information, including knowledge/probability based inference, optimization prediction, preference-based planning, recommendation, and the like. Knowledge representation is a technique for automating human experience information into knowledge data, including knowledge building (data generation/classification), knowledge management (data utilization), and the like. Motion control is a technique for controlling an autonomous running of a vehicle and the motion of the robot, including motion control (navigation, collision and running), operation control (behavior control), and the like.

An existing chatting server could not do much more than retrieving and providing a pre-stored response for not fully understanding user utterance. Since all the chatting servers are embodied to have the same specification, resources are overly used when even a simple question is processed. <CIT> discloses methods, systems and apparatus for handing off a user conversation between computer-implemented agents. <CIT> discloses systems and methods to join a user to pre-existing primary communication channels based upon the information obtained from a user profile.

An aspect of the disclosure relates to providing an electronic apparatus capable of evaluating a difficulty level of natural language input by a user based on artificial intelligence technology and matching a chatting server having an optimal specification based on the evaluated difficulty level with the input natural language, a controlling method thereof and a non-transitory computer readable recording medium.

The technical solution consists of an electronic apparatus <NUM> as claimed in independent claim <NUM>, a method as claimed in independent claim <NUM> and a computer program as claimed in independent claim <NUM>. Further optional features are included in the appended dependent claims.

According to various embodiments of the present disclosure, an optimal chatting server is provided to a user by dynamically changing a chatting server according to a natural language input by a user. In addition, when a chatting-based user response service is provided, unnecessary use of resources may be reduced.

The above and other aspects, features and attendant advantages of the present disclosure will become more apparent from the following detailed description, taken in conjunction with the accompanying drawings, in which like reference numerals refer to like elements, and wherein:.

All the terms used in this disclosure including technical and scientific terms have the same meanings as would be generally understood by those skilled in the related art. However, these terms may vary depending on the intentions of the person skilled in the art, legal or technical interpretation, and the emergence of new technologies. In addition, some terms may be arbitrarily selected. These terms may have a meaning defined herein and, unless otherwise specified, may be construed based on the entire contents of this disclosure and common technical knowledge in the art.

The terms such as "first," "second," and so on may be used to describe a variety of elements, but the elements should not be limited by these terms. The terms are used simply to distinguish one element from other elements. For example, without departing from the scope of the present disclosure, the first component may be referred to as a second component, and similarly, the second component may also be referred to as a first component. The term "and/or" may include any combination of a plurality of related items or any of a plurality of related items.

The terms used in the application are merely used to describe particular example embodiments, and are not intended to limit the disclosure. Singular forms in the disclosure are intended to include the plural forms as well, unless the context clearly indicates otherwise. It will be further understood that terms such as "including" or "having," etc., are intended to indicate the existence of the disclosed features, numbers, operations, actions, components, parts, or combinations thereof, and are not intended to preclude the possibility that one or more other features, numbers, operations, actions, components, parts, or combinations thereof may exist or may be added.

In an example embodiment, 'a module', 'a unit', or 'a part' perform at least one function or operation, and may be realized as hardware, such as a processor or integrated circuit, software that is executed by a processor, or any combination thereof. In addition, a plurality of 'modules', a plurality of 'units', or a plurality of 'parts' may be integrated into at least one module and may be realized as at least one processor except for 'modules', 'units' or 'parts' that should be realized in a specific hardware.

Hereinafter, various example embodiments will be described in greater detail with reference to the accompanying drawings.

<FIG> is a diagram illustrating an example concept of a chatting bot system according to an embodiment of the present disclosure.

Referring to <FIG>, a chatting bot system <NUM> may include an electronic apparatus <NUM> and first, second and third chatting servers <NUM>, <NUM> and <NUM>. A plurality of chatting servers <NUM>, <NUM> and <NUM> may have different specifications, resources and response processing models. For example, the plurality of chatting servers <NUM>, <NUM> and <NUM> may have different CPU functions.

The chatting bot system <NUM> includes the electronic apparatus <NUM> capable of responding to a natural language input by a user and a server <NUM>. For example, examples of the electronic apparatus <NUM> may, for example, and without limitation, include a PC, a smart TV, a smart phone, a tablet PC, a voice recognition device, an audio device, or the like. The server <NUM> may include a series of chatting server devices, or may be embodied as a single device including a plurality of processors, each operating as a separate chatting bot.

According to an embodiment, the electronic apparatus <NUM> selects one of the plurality of chatting servers <NUM>, <NUM> and <NUM> based on the natural language input by the user. The natural language input by the user, for example, may be a sentence the user uttered in voice or a sentence the user input in text format. The sentences the user uttered or entered may include both a subject and a verb, or may include one or more of subject, verb, or object. Alternatively, the sentences uttered or input by the user may include only specific words.

For example, the electronic apparatus <NUM> may determine whether the natural language relates to a simple query or requires language understanding through inference. Based on the result of determination, the electronic apparatus <NUM> may select one of the plurality of chatting servers <NUM>, <NUM> and <NUM>.

The electronic apparatus <NUM> transmits the natural language input by the user to one of the plurality of chatting servers <NUM>, <NUM> and <NUM> selected by the electronic in order to receive a response with respect to the natural language input by the user. Each of the plurality of chatting servers <NUM>, <NUM> and <NUM> may include a different model for generating a response. For example, a beginner level model for generating a response to a specific natural language, an intermediate level model for grasping a context and an advanced level model for understanding a language by inference may, for example, and without limitation, be respectively stored in the plurality of chatting servers <NUM>, <NUM> and <NUM>.

According to another embodiment which is not claimed, the electronic apparatus <NUM> may perform only an input/output function, and the server <NUM> may match a corresponding chatting server by analyzing a natural language. The electronic apparatus <NUM> may operate in a plurality of chatting modes with different frequency of use of resources. For example, and without limitation, the electronic apparatus <NUM> may operate in one of a first chatting mode with the limited CPU performance of up to <NUM>%, a second chatting mode with the limited CPU performance of up to <NUM>%, and a third chatting mode with the limited CPU performance up to <NUM>%. The electronic apparatus <NUM> may use a different response model depending on the degree of CPU performance limitation. For example, the electronic apparatus <NUM> may use a response model for a simple response when <NUM>% of the CPU performance is used and a response model including an inference function when <NUM>% of the CPU performance is used.

Hereinafter, as illustrated in <FIG>, an example embodiment will be described where the electronic apparatus <NUM> determines a difficulty level of a natural language and matches a corresponding chatting server.

<FIG> is a block diagram illustrating an example configuration of an electronic apparatus according to an embodiment of the present disclosure. Referring to <FIG>, the electronic apparatus <NUM> may include an input unit (e.g., including input circuitry) <NUM>, a communicator (e.g., including communication circuitry) <NUM> and a processor (e.g., including processing circuitry) <NUM>.

The input unit <NUM> may include various input circuitry and receive a natural language from a user. For example, and without limitation, the input unit <NUM> may be embodied as a microphone, or the like, to receive a voice uttered by the user as a natural language. According to another non-limiting example, the input unit <NUM> may be embodied as a keyboard, a touchscreen, or the like, to receive a natural language input by the user in the text format, instead of the voice format.

The communicator <NUM> may include various communication circuitry and perform communication with a plurality of external chatting servers. For example, the communicator <NUM> may transmit the natural language input through the input unit <NUM> to a chatting server. The communicator <NUM> may receive a response with respect to the natural language from the chatting server.

The processor <NUM> may include various processing circuitry and analyze a characteristic of the natural language. For example, the processor <NUM> may perform a pre-processing of the input natural language. The processor <NUM> may analyze a characteristic of the preprocessed natural language. Based on the characteristic of the natural language and the characteristic of the user, the processor <NUM> may determine the most suitable chatting server for processing the natural language among the plurality of chatting servers. For example, the processor <NUM> may determine a difficulty level of the natural language and determine a least resource consuming chatting server, among a plurality of chatting servers capable of processing the natural language at the determined difficulty level, as a chatting server corresponding to the natural language.

The processor <NUM> may change a chatting server corresponding to the natural language in real time. For example, in the case where a natural language at a low difficulty level is input and then a natural language at a high difficulty level is input, the processor <NUM> may re-determine a chatting server using a response model with a high processing performance as a chatting server corresponding to the natural language. When the chatting server is changed, the processor <NUM> may provide the contents of dialogues performed with the previous chatting server to a new chatting server. Through data synchronization, the processor <NUM> may easily change a chatting server.

The electronic apparatus <NUM> may provide a corresponding response depending on the contents of a query, emotion of the user, or the like. By differentiating specifications of chatting servers for providing various levels of responses, unnecessary use of resources may be reduced.

<FIG> is a block diagram illustrating an example of an electronic apparatus according to an embodiment of the present disclosure. Referring to <FIG>, an electronic apparatus <NUM> may include an input unit (e.g., including input circuitry) <NUM>, a communicator (e.g., including communication circuitry) <NUM>, a processor (e.g., including processing circuitry) <NUM>, a memory <NUM>, a display <NUM> and a speaker <NUM>.

The input unit <NUM> may include various input circuitry and receive voices, texts, or the like, from a user. For example, the input unit <NUM> may process voice signals received from the user. The input unit <NUM>, in response to an analog form user voice being received, may perform sampling of the input user voice and covert the input user voice into digital signals. The input unit <NUM> may calculate (determine) energy of the digital signals and determine whether the energy of the digital signals is greater than a predetermined value. If the energy of the digital signals is greater than the predetermined value, the input unit <NUM> may remove noise components from the digital signals and transmit the digital signal from which the noise elements are removed to the processor <NUM>. For example, the noise component may be the sudden noise that may occur in the surrounding environment.

The communicator <NUM> may include various communication circuitry and perform communication with the server <NUM> at an external source. The electronic apparatus <NUM> may directly perform, for example, and without limitation, voice recognition, matching score calculation, corresponding server determination, or the like, or request for the voice recognition, matching score calculation, corresponding server determination, or the like, to the server <NUM> by transmitting data to the server <NUM>. For example, the communicator <NUM> may transmit a user voice input to the server <NUM> and receive a response corresponding to the user voice from the server <NUM>.

To this end, the communicator <NUM> may include various communication modules comprising various communication circuitry such as, for example, and without limitation, a short-distance wireless communication module (not shown), a wireless communication module (not shown), or the like. The short-distance wireless communication module may, for example, be a module including circuitry for performing communication with an external device located at a short distance in accordance with a short-distance wireless communication method such as Bluetooth, Zigbee or the like. The wireless communication module may, for example, be a module including circuitry that is connected to an external network and performs communication according to wireless communication protocols such as WiFi, WiFi direct, IEEE, and the like. In addition, the wireless communication module may further include a mobile communication module that is connected to a mobile communication network according to various mobile communication standards such as 3rd Generation (<NUM>), 3rd Generation Partnership Project (3GPP), Long Term Evolution (LTE), LTE Advanced (LTE-A), or the like.

The memory <NUM> may store various modules, software and data for driving the electronic apparatus <NUM>. For example, the memory <NUM> may store recognized voice information, history information of dialogues performed with a chatting server, context information with respect to a situation to which a natural language is input, user information, or the like. The user information may be collected by conducting a user satisfaction survey, etc. after a response is provided.

According to another embodiment, the memory <NUM> may store an Acoustic Model (AM) and a Language Model (LM) used for recognizing user voice. In addition, the memory <NUM> may store Corpus, which is a set of extracted language samples for processing a natural language.

The memory <NUM> may, for example, be a storage medium for storing various programs necessary for operating the electronic apparatus <NUM> and implemented in the form of a flash memory, a Hard Disk Drive (HDD), and/or a Solid State Drive (SSD). For example, the memory <NUM> may include a ROM for storing a program for performing an operation of the electronic apparatus <NUM> and a RAM for temporarily storing data according to an operation of the electronic apparatus <NUM>.

The memory <NUM> may store programs and data for forming various screens to be displayed on the display <NUM>. In addition, the memory <NUM> may store programs, applications and data for performing a specific service.

The display <NUM> and the speaker <NUM> may function as an output unit. According to the embodiment type of the electronic apparatus <NUM>, at least one of the display <NUM> and the speaker <NUM> may be included. The electronic apparatus <NUM> may visually provide a response through the display <NUM> or audibly provide a response through the speaker <NUM>.

The display <NUM> may display a response corresponding to the input natural language. In addition, the display <NUM> may display all the responses with respect to the input natural language.

The display <NUM> may be implemented, for example, and without limitation, as a liquid crystal display (LCD), an organic light emitting diode (OLED), a plasma display panel (PDP), or the like and display various available screens through the electronic apparatus <NUM>.

The speaker <NUM> may output a voice. For example, the speaker <NUM> may output a response where a voice is converted into a voice signal. The speaker <NUM> may be mounted in the electronic apparatus <NUM> or may, for example, and without limitation, be embodied in the form of an output port such as a jack, or the like.

The processor <NUM> may include various processing circuitry and control the above-described configurations of the electronic apparatus <NUM>. For example, the processor <NUM> may control the communicator <NUM> to transmit the natural language to the chatting server determined as the chatting server corresponding to the natural language, among the plurality of chatting servers.

The processor <NUM> may, for example, and without limitation, be implemented as a single CPU to perform a voice recognition operation, a language understanding operation, a matching score analysis operation and chatting server determination operation, may include a plurality of processors, or may, for example, and without limitation, be implemented as an Integrated Processor (IP) for performing a specific function. For example, the processor <NUM> may perform voice recognition based on a conventional Hidden Markov Model (HMM) or perform deep learning-based voice recognition such as a Deep Neural Network (DNN).

The processor <NUM> may preprocess the input natural language. The processor <NUM> may perform operations such as, for example, and without limitation, natural language cleansing, natural language separation, morphological analysis, entity extraction, or the like, as a pre-processing for processing the natural language. For example, the processor <NUM> may perform an operation of converting an input string to a morpheme string. The morpheme may, for example, be the smallest unit of meaning.

The processor <NUM> may analyze the preprocessed natural language. For example, the processor <NUM> may perform natural language analysis, dialogue pattern analysis, emotional analysis, user age/gender analysis, metadata analysis, and user log analysis, or the like. The processor <NUM> may represent each analysis result as a calculated matching score. Based on the calculated matching scores, the processor <NUM> may determine a corresponding chatting server.

In response to an additional natural language being input, the processor <NUM> may determine a corresponding chatting server through analysis of the additional natural language. If the chatting server corresponding to the additional natural language is different from the chatting server corresponding to the natural language previously processed, the processor <NUM> may transmit history information of dialogues performed with the chatting server corresponding to the natural language processed previously to the chatting server corresponding to the additional natural language. As described above, although a chatting server (or a chatting bot) is changed, the processor <NUM> may share the data, thereby preventing waste of resources while maintaining the consistency of the response.

The more detailed description of the operation of the processor <NUM> will be made below with reference to the illustrative drawings.

<FIG> is a block diagram illustrating a processor (e.g., including processing circuitry and/or program elements) <NUM> according to some embodiments of the present disclosure. According to an embodiment, the processor <NUM> may include a data training unit (e.g., including processing circuitry and/or program elements) <NUM> and a data recognition unit (e.g., including processing circuitry and/or program elements) <NUM>. The processor <NUM> may be the processor <NUM> of the electronic apparatus <NUM> or a processor of at least one of the plurality of chatting servers <NUM>, <NUM> and <NUM> of the server <NUM>.

The data training unit <NUM> may train the criteria for voice recognition, language understanding, text recognition and determination of a difficulty level of a natural language. The data recognition unit <NUM> may recognize contents of the input natural language based on the trained criteria. The processor <NUM> may determine to which chatting server a natural language may be transmitted based on the recognized contents. The processor <NUM> may analyze the input user voice itself, or convert the user voice into the text and analyze the text. The data training unit <NUM> may determine which data to use for recognizing the contents. The data training unit <NUM> may obtain the data used for training and apply the obtained data to data recognition models to be described below to train the criteria for voice recognition, language understanding and contents recognition.

The data training unit <NUM> may be included each of the plurality of chatting servers. The data training unit <NUM> included in each of the plurality of chatting servers may train the criteria for providing a response by recognizing the natural language input by the user. The data training unit <NUM> included in each of the plurality of chatting servers may store a data recognition model, which is generated or refined as a result of training, in each of the plurality of chatting servers. For example, the plurality of chatting servers may include a beginner level model trained for generating a response to a specific natural language, an intermediate level model for understanding a context and an advanced level model for understanding languages by inference. Each data training unit <NUM> may store the generated or refined data recognition model in an additional data base server.

The data training unit <NUM> may obtain data to be used for training and train a data recognition model according to a training method or non-training method.

For example, the plurality of chatting servers may be classified according to a dialogue difficulty level (e.g. a beginner level, an intermediate level and an advanced level) or a dialogue style. The plurality of chatting servers may be classified according to user opinion (e.g. very positive, positive, neutral, negative and very negative). Alternatively, or additionally, the plurality of chatting servers may be classified according to user emotion (e.g. calmness, joy, anger, sadness, depression, surprise and fear). The plurality of chatting servers may be classified according to age, gender, region and education, or the like, of the user.

In the case where the plurality of chatting servers are classified according to the above criteria, different data for training used in the data training unit <NUM> may be included in each of the plurality of chatting servers.

For example, in the case where the plurality of chatting servers are classified according to the dialogue difficulty level or the dialogue style, the data training unit <NUM> included in a first chatting server among the plurality of chatting servers may use {formal language, response to natural language} entity as a training purpose data. The data training unit <NUM> included in a second chatting server among the plurality of chatting servers may use {informal natural language, response to natural language} entity as the training purpose data. In addition, the data training unit <NUM> included in a third chatting server among the plurality of chatting servers may use {informal term/slang natural language, response to natural language} entity as the training purpose data.

According to another embodiment, in the case where the plurality of chatting servers are classified according to the user opinion, the data training unit <NUM> included in each of the plurality of chatting servers may user each of {very positive natural language, response to natural language} entity, {positive natural language, response to natural language} entity, {neutral natural language, response to natural language} entity, {negative natural language, response to natural language} entity and {very negative natural language, response to natural language} as the training purpose data.

According to another embodiment, in the case where the plurality of chatting servers are classified according to the user emotion, the data training unit <NUM> included in each of the plurality of chatting servers may use each of {normalized natural language, response to natural language} entity, {joyful language, response to natural language} entity, {angry natural language, response to natural language} entity, {grieving natural language, response to natural language} entity, {depressed natural language, response to natural language} entity and {fearful natural language, response to natural language} entity as the training purpose data.

According to another embodiment, in the case where the plurality of chatting servers are classified according to the user age, the data training unit <NUM> included in each of the plurality of chatting servers may use each of {natural language input by boy, response to natural language} entity, {natural language input by young man, response to natural language} entity, {natural language input by middle age, response to natural language} entity and {natural language input by old age, response to natural language} entity as the training purpose data.

According to another embodiment, in the case where the plurality of chatting servers are classified according to the region of the user, the data training unit <NUM> included in each of the plurality of chatting servers may use {natural language input by person in Seoul, response to natural language} entity, {natural language input by person in Gyeongsang-do, response to natural language and} entity, {natural language input by person in Jeolla-do, response to natural language} entity and {natural language input by Chungcheong-do, response to natural language} as the training purpose data.

The data recognition unit <NUM> may recognize a situation from predetermined data using the trained data recognition model. The data recognition unit <NUM> may obtain the predetermined data according to predetermined criteria by training and use the data recognition model using the obtained data as an input value. For example, using the trained acoustic model and language model, the data recognition unit <NUM> may recognize the input natural language. In addition, using the data obtained by recognizing the natural language as an input value, the data recognition unit <NUM> may refine a data recognition model. The data recognition unit <NUM> may use Big Data and user input data for natural language recognition and natural language analysis.

The data recognition unit <NUM> may be included in each of the plurality of chatting servers. The data recognition unit <NUM> included in each of the plurality of chatting servers may provide a recognition result with respect to recognition purpose data using the data recognition model for providing a response with respect to the natural language.

In response to the processor <NUM> of the server <NUM> or the processor <NUM> of the electronic apparatus <NUM> analyzing the natural language input by the user and determining a chatting server to transmit the natural language, the natural language input by the user or a natural language into which the natural language input by the user is preprocessed may be transmitted to the determined chatting server.

The data recognition unit <NUM> included in each of the plurality of chatting servers may apply the natural language input by the user or the preprocessed natural language to the data recognition model as an input value, and obtain (or estimate, infer, or predict) the response with respect to the natural language as a recognition result. The chatting server may transmit the response with respect to the natural language obtained by the data recognition unit <NUM> to the electronic apparatus <NUM>.

At least one of the data training unit <NUM> and the data recognition unit <NUM> may be manufactured, for example, and without limitation, in the form of one or a plurality of hardware chips and mounted in the electronic apparatus <NUM>. For example, and without limitation, at least one of the data training unit <NUM> and the data recognition unit <NUM> may be manufactured in the form of a hardware chip for Artificial Intelligence (AI) only, or manufactured as a part of an existing generic processor (e.g. a CPU or an application processor) or an IP for a specific function to be mounted on the electronic apparatus <NUM> in a variety of types. The hardware chip for Artificial Intelligence (AI) may, for example, be a processor specialized in probability computation having a higher parallel processing performance than the conventional generic processor, thereby quickly performing an arithmetic operation in the artificial intelligence field such as machine learning.

<FIG> illustrates both the data training unit <NUM> and the data recognition unit <NUM> mounted on the electronic apparatus <NUM>, but the data training unit <NUM> and the data recognition unit <NUM> each may be mounted on a separate device. For example, one of the data training unit <NUM> and the data recognition unit <NUM> may be included in the electronic apparatus <NUM>, and the other one may be included in the server. In addition, the data training unit <NUM> and the data recognition unit <NUM> may be connected to each other by wire or wireless, the model information constructed by the data training unit <NUM> may be provided to the data recognition unit <NUM>, or the data input to the data recognition unit <NUM> may be provided to the data training unit <NUM> as additional training data.

At least one of the data training unit <NUM> and the data recognition unit <NUM> may be embodied as a software module including various program elements. In the case where at least one of the data training unit <NUM> and the data recognition unit <NUM> is embodied as a software module (or, a program module including instructions), the software module may be stored in a non-transitory computer readable recoding medium. At least one software module may be provided by an Operation System (OS) or a predetermined application. Alternatively, or additionally, part of at least one software module may be provided by the operation system and the remaining of the software module may be provided by the predetermined application.

<FIG> is a block diagram illustrating an example data training unit according to some embodiments of the present disclosure. Referring to <FIG>, the data training unit <NUM> of <FIG> according to some embodiments may include a data acquisition unit (e.g., including processing circuitry and/or program elements) <NUM>-<NUM>, a preprocessing unit (e.g., including processing circuitry and/or program elements) <NUM>-<NUM>, a training data selection unit (e.g., including processing circuitry and/or program elements) <NUM>-<NUM>, a model training unit (e.g., including processing circuitry and/or program elements) <NUM>-<NUM> and a model evaluation unit (e.g., including processing circuitry and/or program elements) <NUM>-<NUM>. The data training unit <NUM> according to some embodiments may include the data acquisition unit <NUM>-<NUM> and the model training unit <NUM>-<NUM> and further selectively include the preprocessing unit <NUM>-<NUM>, the training data selection unit <NUM>-<NUM> and the model evaluation unit <NUM>-<NUM>, or may not include the preprocessing unit <NUM>-<NUM>, the training data selection unit <NUM>-<NUM> and the model evaluation unit <NUM>-<NUM>.

The data acquisition unit <NUM>-<NUM> may obtain data necessary for situation determination. The data acquisition unit <NUM>-<NUM> may obtain a natural language from the input unit <NUM>. For example, the data acquisition unit <NUM>-<NUM> may obtain voice data where a user voice signal input through a microphone is converted into a digital signal. The data acquisition unit <NUM>-<NUM> may receive the training purpose data from a server or a network such as Internet through the communicator <NUM>. For example, the data acquisition unit <NUM>-<NUM> may receive natural languages at different levels as training purpose data.

The preprocessing unit <NUM>-<NUM> may preprocess the obtained data so that the obtained data may be used for training the situation determination. The preprocessing unit <NUM>-<NUM> may process the obtained data in a predetermined format so that the model training unit <NUM>-<NUM> to be described below may use the obtained data for training the situation determination. For example, the preprocessing unit <NUM>-<NUM> may perform morphological analysis, natural language separation, and entity extraction on the obtained natural language. Alternatively, in the case where the natural language is voice data, the preprocessing unit <NUM>-<NUM> may convert the voice data into text data. The preprocessing unit <NUM>-<NUM> may perform morphological analysis, natural language separation, and entity extraction on the text data.

The training data selection unit <NUM>-<NUM> may select data necessary for training from the preprocessed data. The selected data may be provided to the model training unit <NUM>-<NUM>. The training data selection unit <NUM>-<NUM> may select the data necessary for training from the preprocessed data according to the predetermined criteria for the situation determination. The training data selection unit <NUM>-<NUM> may select data based on the predetermined criteria by training by the model training unit <NUM>-<NUM> to be described below. The predetermined criteria may include, for example, at least one of attributes of data, a generation time of data, a creator of data, a reliability of data, an object of data, a generation area of data, and a size of data.

According to another embodiment, in the early stage of training, the training data selection unit <NUM>-<NUM> may remove natural language data having high similarity among the natural language data. In other words, for the early training, the training data selection unit <NUM>-<NUM> may select natural language data having low similarity to train criteria easy to distinguish.

The training data selection unit <NUM>-<NUM> may select natural language data which commonly satisfy one of the predetermined criteria by training. The model training unit <NUM>-<NUM> may train different criteria from the already trained criteria.

The model training unit <NUM>-<NUM> may train criteria for recognizing a natural language based on training data. The model training unit <NUM>-<NUM> may a training criterion about which training data may have to be used for natural language analysis.

The training data selection unit <NUM>-<NUM> may select a natural language which satisfies a training criterion from a plurality of training purpose data. For example, in the case where a device where the training data selection unit <NUM>-<NUM> operates is a chatting server, the training data selection unit <NUM>-<NUM> may select a natural language suitable for the purpose of the chatting server and an entity including the response with respect to the natural language. Specifically, in the case where the chatting server has a purpose of providing a response with respect to a formal natural language, the training data selection unit <NUM>-<NUM> may select the formal natural language from the plurality of training purpose data and an entity including a response with respect to the formal natural language.

The model training unit <NUM>-<NUM> may train the data recognition model used for the situation determination based on the training data. In this case, the data recognition model may be a pre-built model. For example, the data recognition model may be a pre-built model that receives basic training data (e.g., sample audio data). According to another embodiment, the data recognition model may be a pre-built text analysis model using Big Data.

The data recognition model may be configured in consideration of the application field of a recognition model, the purpose of training, or the computer performance of a device. The data recognition model may be, for example, a model based on a neural network. The data recognition model may be designed to simulate the human brain structure on a computer. The data recognition model may include a plurality of weighted network nodes that simulate neurons of a human neural network. A plurality of network nodes may each establish a connection relationship to simulate a synaptic activity of neurons sending and receiving signals via synapses. The data recognition model may include, for example, a neural network model or a deep-learning model developed from the neural network model. In the deep-learning model, a plurality of network nodes may be located at different depths (or layers), and exchange data according to a convolution connection relationship. For example, models such as Deep Neural Network (DNN), Recurrent Neural Network (RNN), and Bidirectional Recurrent Deep Neural Network (BRDNN) may be used as a data recognition model, but the present disclosure is not limited thereto.

According to various embodiments, when there are a plurality of pre-built data recognition models, the model training unit <NUM>-<NUM> mat determine a data recognition model having a large relation between the input training data and the basic training data. In this case, the basic training data may be pre-classified according to the data type, and the data recognition model may be pre-built for each data type. For example, the basic training data may be pre-classified by various criteria such as an area where the training data is generated, a time at which the training data is generated, a size of the training data, a genre of the training data, a creator of the training data, types of objects in the training data, and the like.

The model training unit <NUM>-<NUM> may also train a data recognition model using a training algorithm including, for example, an error back-propagation method or a gradient descent method.

For example, the model training unit <NUM>-<NUM> may train a data recognition model through supervised training using the training data as an input value. According to another embodiment, the model training unit <NUM>-<NUM> may train a data recognition model through unsupervised training, which finds a criterion for determining a situation by training the types of data necessary for the situation determination without further guidance. According to another embodiment, the model training unit <NUM>-<NUM> may train a data recognition model through reinforcement training using feedback on whether the result of the situation determination based on the training is correct.

In the case where the model training unit <NUM>-<NUM> is included in each of the plurality of chatting servers, the model training unit <NUM>-<NUM> may train a data recognition model using different training purpose data according to the purpose of each of the plurality of chatting servers. Various embodiments of the training purpose may correspond to the examples of the data training unit <NUM> of <FIG> using the various training purpose data and thus, the description will not be repeated here.

In response to the data recognition model being trained, the model training unit <NUM>-<NUM> may store the trained data recognition model. The model training unit <NUM>-<NUM> may store the trained data recognition model in the memory <NUM> of the electronic apparatus <NUM>. The model training unit <NUM>-<NUM> may store the trained data recognition model in a memory of the server <NUM> connected to the electronic apparatus <NUM> by wire or wireless network. The model training unit <NUM>-<NUM> may store the trained data recognition model in an additional data base server.

The memory <NUM> that stores the trained data recognition model may store a command or data related to at least one of other configurations of the electronic apparatus <NUM>. The memory <NUM> may store a software and/or a program. For example, the program may include a kernel, a middleware, an application programming interface (API) and/or an application program (or "application"), or the like.

The model evaluation unit <NUM>-<NUM> may input evaluation data to a data recognition model and if a recognition result output from the evaluation data does not satisfy a predetermined criterion, allow the model training unit <NUM>-<NUM> to train again. The evaluation data may be predetermined data for evaluating the data recognition model.

For example, the model evaluation unit <NUM>-<NUM>, if the number or ratio of the evaluation data of which recognition result is not exact is greater than a predetermined threshold value, among recognition results of the trained data recognition model with respect to the evaluation data, may determine that the case does not satisfy the predetermined criterion. For example, if the predetermined criterion is determined as a ratio <NUM>%, when the trained data recognition model outputs an incorrect recognition result with respect to evaluation data which exceeds <NUM> out of the total number of <NUM> evaluation data, the model evaluation unit <NUM>-<NUM> may evaluate that the trained data recognition model is inappropriate.

In the case where there are a plurality of trained data recognition models, the model evaluation unit <NUM>-<NUM> may evaluate whether each trained data recognition model satisfies a predetermined criterion and determine a trained data recognition model that satisfies the predetermined criterion as a final data recognition model. In the case where there are a plurality of trained data recognition models that satisfy the predetermined criterion, the model evaluation model <NUM>-<NUM> may determine any one or the predetermined number of data recognition models as a final data recognition model in order of highest score.

At least one of the data acquisition unit <NUM>-<NUM>, the preprocessing unit <NUM>-<NUM>, the training data selection unit <NUM>-<NUM>, the model training unit <NUM>-<NUM> and the model evaluation unit <NUM>-<NUM> in the data training unit <NUM> may, for example, and without limitation, be manufactured in the form of at least one hardware chip including various circuitry and mounted on the electronic apparatus. For example, at least one of the data acquisition unit <NUM>-<NUM>, the preprocessing unit <NUM>-<NUM>, the training data selection unit <NUM>-<NUM>, the model training unit <NUM>-<NUM> and the model evaluation unit <NUM>-<NUM> may be made in the form of a hardware chip for Artificial Intelligence (AI) only, or may be fabricated as part of an existing generic processor (e.g., a CPU or an application processor) or an IP for a particular function to be mounted on the electronic apparatus <NUM> in a variety of types.

The data acquisition unit <NUM>-<NUM>, the preprocessing unit <NUM>-<NUM>, the training data selection unit <NUM>-<NUM>, the model training unit <NUM>-<NUM>, and the model evaluation unit <NUM>-<NUM> may be mounted on a single electronic apparatus, or each may be mounted on a separate electronic apparatus. For example, part of the data acquisition unit <NUM>-<NUM>, the preprocessing unit <NUM>-<NUM>, the training data selection unit <NUM>-<NUM>, the model training unit <NUM>-<NUM> and the model evaluation unit <NUM>-<NUM> may be included in the electronic apparatus <NUM>, and the remaining may be included in the server <NUM>.

At least one of the data acquisition unit <NUM>-<NUM>, the preprocessing unit <NUM>-<NUM>, the training data selection unit <NUM>-<NUM>, the model training unit <NUM>-<NUM> and the model evaluation unit <NUM>-<NUM> may, for example, and without limitation, be implemented with a software module including various program elements. In the case where at least one of the data acquisition unit <NUM>-<NUM>, the preprocessing unit <NUM>-<NUM>, the training data selection unit <NUM>-<NUM>, the model training unit <NUM>-<NUM>, and the model evaluation unit <NUM>-<NUM> is embodied with a software module (or, a program module including instructions), the software module may be stored on a non-transitory computer-readable recording medium. At least one software module may be provided by an Operating System (OS) or by a predetermined application. Alternatively, or additionally, part of the at least one software module may be provided by the OS and part of the remaining may be provided by the predetermined application.

<FIG> is a block diagram illustrating a data recognition unit <NUM> according to some embodiments of the present disclosure. Referring to <FIG>, the data recognition unit <NUM> of <FIG> according to some embodiments may include a data acquisition unit (e.g., including processing circuitry and/or program elements) <NUM>-<NUM>, a preprocessing unit (e.g., including processing circuitry and/or program elements) <NUM>-<NUM>, a recognition data selection unit (e.g., including processing circuitry and/or program elements) <NUM>-<NUM>, a recognition result providing unit (e.g., including processing circuitry and/or program elements) <NUM>-<NUM> and a model refining unit <NUM>-<NUM>. The data recognition unit <NUM> according to some embodiments may necessarily include the data acquisition unit <NUM>-<NUM> and the recognition result providing unit <NUM>-<NUM> and selectively include the preprocessing unit <NUM>-<NUM>, the recognition data selection unit <NUM>-<NUM> and the model refining unit <NUM>-<NUM>.

The data acquisition unit <NUM>-<NUM> may obtain data necessary for the situation determination, and the preprocessing unit <NUM>-<NUM> may preprocess the obtained data so that the obtained data may be used for the situation determination. The preprocessing unit <NUM>-<NUM> may process the obtained data into a predetermined format so that the recognition result providing unit <NUM>-<NUM>, which will be described below, may use the obtained data for the situation determination. For example, in the case where the obtained data is natural language data, the preprocessing unit <NUM>-<NUM> may perform morphological analysis, natural language separation and entity extraction on the natural language data. In the case where the natural language data is audio data, the preprocessing unit <NUM>-<NUM> may convert the audio data into text data. The preprocessing unit <NUM>-<NUM> may perform morphology analysis, natural language separation and entity extraction on the text data.

The recognition data selection unit <NUM>-<NUM> may select data necessary for the situation determination from the preprocessed data. The selected data may be provided to the recognition result providing unit <NUM>-<NUM>. The recognition data selection unit <NUM>-<NUM> may select some or all of the preprocessed data according to a predetermined criterion for the situation determination. The recognition data selection unit <NUM>-<NUM> may select data according to a predetermined criterion by training by the model training unit <NUM>-<NUM>. The predetermined criterion may include, for example, at least one of attributes of data, a generation time of data, a creator of data, a reliability of data, an object of data, a generation area of data, and a size of data.

The recognition result providing unit <NUM>-<NUM> may determine a situation by applying the selected data to the data recognition model. The recognition result providing unit <NUM>-<NUM> may provide the recognition result according to the data recognition purpose. The recognition result providing unit <NUM>-<NUM> may apply the selected data to the data recognition model using the data selected by the recognition data selecting unit <NUM>-<NUM> as an input value. In addition, the recognition result may be determined by the data recognition model.

For example, the recognition result providing unit <NUM>-<NUM> may recognize the natural language input by the user according to criteria determined by the data recognition model. Using the data recognition model, the recognition result providing unit <NUM>-<NUM> may recognize contents of the natural language and determine a processing difficulty level.

The recognition result providing unit <NUM>-<NUM> may apply the input natural language or the preprocessed natural language to the data recognition model as an input value and obtain a response with respect to the natural language as a recognition result.

The model refining unit <NUM>-<NUM> may refine the data recognition model based on the evaluation of the recognition result provided by the recognition result providing unit <NUM>-<NUM>. For example, the model refining unit <NUM>-<NUM> may allow the model training unit <NUM>-<NUM> to refine the data recognition model by providing the recognition result provided by the recognition result providing unit <NUM>-<NUM> to the model training unit <NUM>-<NUM>.

At least one of the data acquisition unit <NUM>-<NUM>, the preprocessing unit <NUM>-<NUM>, the recognition data selection unit <NUM>-<NUM>, the recognition result providing unit <NUM>-<NUM>, and the model refining unit <NUM>-<NUM> included in the data recognition unit <NUM> may, for example, and without limitation, be manufactured in the form of at least one hardware chip including various circuitry and mounted on the electronic apparatus. For example, at least one of the data acquisition unit <NUM>-<NUM>, the preprocessing unit <NUM>-<NUM>, the recognition data selection unit <NUM>-<NUM>, the recognition result providing unit <NUM>-<NUM>, and the model refining unit <NUM>-<NUM> may be made in the form of a hardware chip for Artificial Intelligence (AI) only, or may be fabricated as part of an existing generic processor (e.g., a CPU or an application processor) or an IP for a particular function to be mounted on the electronic devices <NUM> in a variety of types.

The data acquisition unit <NUM>-<NUM>, the preprocessing unit <NUM>-<NUM>, the recognition data selection unit <NUM>-<NUM>, the recognition result providing unit <NUM>-<NUM>, and the model refining unit <NUM>-<NUM> may be mounted on a single electronic device, or each may be mounted on a separate electronic apparatus. For example, part of the data acquisition unit <NUM>-<NUM>, the preprocessing unit <NUM>-<NUM>, the recognition data selection unit <NUM>-<NUM>, the recognition result providing unit <NUM>-<NUM>, and the model refining unit <NUM>-<NUM> may be included in the electronic apparatus <NUM> and some of which may be included in server <NUM>.

At least one of the data acquisition unit <NUM>-<NUM>, the preprocessing unit <NUM>-<NUM>, the recognition data selection unit <NUM>-<NUM>, the recognition result providing unit <NUM>-<NUM>, and the model refining unit <NUM>-<NUM> may be implemented with a software module including various program elements. In the case where at least one of the data acquisition unit <NUM>-<NUM>, the preprocessing unit <NUM>-<NUM>, the recognition data selection unit <NUM>-<NUM>, the recognition result providing unit <NUM>-<NUM>, and the model refining unit <NUM>-<NUM> is implemented with a software module (or a program module including instructions), the software module may be stored on a non-transitory computer readable recording medium. At least one software module may be provided by an Operating System (OS) or by a predetermined application. Alternatively, or additionally, some of at least one software module may be provided by the OS and some of the remaining may be provided by the predetermined application.

According to an embodiment of the present disclosure, the processor <NUM> may determine a difficulty level of the natural language input by the user using a plurality of analysis methods. For example, the processor <NUM> may calculate a matching score based on each of the analysis methods. The matching score may be a possibility value which indicates a degree of match with each chatting server. Based on a final matching score obtained by summing the calculated scores, the processor <NUM> may determine a chatting server corresponding to the natural language among a plurality of chatting servers.

The plurality of chatting servers may include first to third chatting servers that provide a response with respect to the natural language according to a characteristic of the natural language input by the user and a characteristic of the user. The first to third chatting servers may be classified based on a method for providing a response. In addition, according to a resource required for each response providing method, the first to third chatting servers may include different specifications such as CPU, memory, or the like.

For example, a first chatting server <NUM> may provide a response corresponding to the natural language input by the user based on pre-stored response data base. A second chatting server <NUM> may use a first response model for providing a response by determining a context of the natural language input by the user. A third chatting server <NUM> may use a second response model for providing a response by inferring a question included in the natural language input by the user.

<FIG> is a table illustrating an example method for determining a difficulty level of a natural language according to an embodiment of the present disclosure. As illustrated in <FIG>, a plurality of chatting bots (or chatting servers) may include a plurality of chatting bots with different response providing methods and resources (e.g. a chatting bot A, a chatting bot B, a chatting bot C,. , and a chatting bot N).

Referring to <FIG>, the processor <NUM> may calculate (determine) a matching score (or a probability score) for each chatting bot (or a chatting server) based on each analysis method. Each matching score may be calculated to have a value between <NUM> and <NUM> through normalization. The processor <NUM> may determine a chatting bot to be used for generating a response based on a final matching obtained by summing matching scores. In <FIG>, a sine final matching score value of the chatting bot C is the largest, the processor <NUM> may select the chatting bot C as a chatting bot corresponding to the natural language. According to various embodiments, the processor <NUM> may determine a chatting bot based on a final matching score, which is a sum of at least one matching score among a plurality of matching scores.

If there are a plurality of chatting bots having the same final matching score, the processor <NUM> may determine a chatting bot corresponding to the natural language based on the performance of a chatting bot. For example, the processor <NUM> may determine a least resource consuming chatting bot, among the plurality of chatting bots having the same final matching score, as a chatting bot corresponding to the natural language.

Hereinafter, various methods for determining a difficulty level of a natural language input by a user will be described in greater detail.

<FIG> are tables illustrating an example method for calculating matching scores by analyzing a natural language according to an embodiment of the present disclosure. The processor <NUM> may, for example, and without limitation, calculate a matching score based on a weight values given to words of a natural language and a Term Frequency/Inverse Document Frequency (TF/IDF) value.

<FIG> is a table illustrating an example of giving a weight value to each word. The processor <NUM> may give a low weight value to a generic word and a high weight value to a proper noun such as a product a user inquires about. For example, the processor <NUM> may give low weight values to words such as 'goodbye', 'inquiry', 'question' and the like. The processor <NUM> may give high weight values to words such as 'cable', 'liquid crystal', 'screen' and the like.

<FIG> is a table illustrating an example of a value obtained by calculating Term Frequency/Inverse Document Frequency (TF/IDF) values of words in each sentence. The TF/IDF value may be statistical figures indicating how important a specific word is in a specific document. For example, the processor <NUM> may extract key words of the document through the TF/IDF value.

The TF value may, for example, be a value indicating how frequently a specific word appears in a sentence. The DF value may, for example, be a value indicating how frequently a specific word itself appears in a document. As TF value becomes higher and the DF value becomes lower, the specific word may be determined as an important word, the TF/IDF value may be obtained by multiplying the TF value by an IDF value, which is a reciprocal of the DF value.

<FIG> is a table illustrating an example method for calculating matching scores by analyzing a dialogue pattern according to an embodiment of the present disclosure. Referring to <FIG>, chatting servers are classified according to a dialogue difficulty level (a beginner level, an intermediate level and an advanced level). The processor <NUM> may calculate similarity to the natural language input by the user using dialogue pattern data processed in the beginner level, intermediate level and advanced level chatting servers. For example, the processor <NUM> may calculate a matching score through cosine similarity score calculation. The cosine similarity score may be calculated by the following Equation <NUM>:
<MAT>.

According to an embodiment, the processor <NUM> may calculate a matching score through emotion analysis. The processor <NUM> may calculate a matching score with respect to each chatting server through sentiment analysis and emotion analysis.

The sentiment analysis may be a method for classifying a natural language into five steps of very positive, positive, neutral, negative and very negative and calculating a matching score with respect to each chatting server. The emotion analysis may be a method for classifying a natural language into seven types of emotion of calmness, joy, anger, sadness, depression, surprise, fear and calculating a matching score with respect to each chatting server.

The processor <NUM> may merge the results of the sentiment analysis and the emotion analysis and perform normalization of the result to have a value between <NUM> and <NUM>.

According to an embodiment of the present disclosure, the processor <NUM> may calculate a matching score through user analysis. The processor <NUM> may establish a user analysis model based on age, gender, region, education, etc. of the user who uses the existing chatting server. The processor <NUM> may calculate a matching score based on the established user analysis model. The machine learning method that uses artificial intelligence technology such as a deep-learning method may be used for establishing a user analysis model and determining a user analysis reference.

According to an embodiment of the present disclosure, the processor <NUM> may calculate a matching score through metadata analysis. The processor <NUM> may establish a metadata analysis model using registration information, classification contents of the product the user inquires about. The processor <NUM> may calculate a matching score based on the established metadata analysis model.

According to an embodiment of the present disclosure, the processor <NUM> may calculate a matching score through log analysis. The processor <NUM> may determine a frequency of use of each chatting server based on the previous log record of the user. The processor <NUM> may predict which chatting server to use and calculate a matching score.

As described above, the processor <NUM> may calculate a matching score with respect to each chatting sever based on various criteria. The criteria is not limited to these <NUM> (six). Considering the characteristic of the natural language input by the user and the availability of user information, the processor <NUM> may use part of the various criteria.

The processor <NUM> may calculate a final matching score by summing the calculated matching scores. The processor <NUM> may determine a chatting server having a highest final matching score as a chatting server that generates a response corresponding to the natural language.

After a chatting server is determined with the input natural language, an additional natural language may be input through the input unit <NUM> from the user. The processor <NUM> may determine a chatting server to generate a response with respect to the additional natural language through the same matching score calculation.

In response that the chatting server to generate the response is the same as a predetermined chatting server, a chatting server (or a chatting bot) may not need to be changed, so that there will be no problem. However, in response that a chatting server corresponding to the existing natural language is different from the chatting server corresponding to the additional natural language, due to the change of the chatting server, the dialogue context with the user may not be continued. Therefore, it is desirable that the processor <NUM> may prevent the user from recognizing that the chatting server is changed.

According to an embodiment of the present disclosure, the processor <NUM> may synchronize history information of dialogues performed with the existing chatting server and context information with a new chatting server in the case where the chatting server is changed. In other words, the processor <NUM> may transmit the history information of dialogues performed with the existing chatting server and the context information along with the additionally input natural language to the new chatting server.

<FIG> is a block diagram illustrating an example configuration of a chatting bot system according to another embodiment of the present disclosure. Referring to <FIG>, the server <NUM> may include the plurality of chatting bots <NUM>, <NUM>, <NUM> and <NUM> and a matching bot <NUM> that matches one of the plurality of chatting bots with the input natural language. The electronic apparatus <NUM> may receive the natural language from the user and function as an input/output device outputting a response. The electronic apparatus <NUM> may perform preprocessing and converting voice data to text data via voice recognition.

The server <NUM> may include a storage <NUM> storing dialogue history information and context information to realize synchronization of information between the plurality of chatting bots <NUM>, <NUM>, <NUM> and <NUM>.

According to various embodiments, the matching bot <NUM> may determine a chatting bot matched with the natural language input by the user among the plurality of chatting bots <NUM>, <NUM>, <NUM> and <NUM> based on the trained data recognition model. The data recognition model the matching bot <NUM> uses may be a rule-based model or an artificial intelligence model which is trained using neural network algorithms such as Deep Neural Network (DNN), Recurrent Neural Network (RNN), and Bidirectional Recurrent Deep Neural Network (BRDNN).

The matching bot <NUM> may train a base data recognition model and generate or refine a data recognition model that is set to determine a chatting bot matched with the natural language input by the user. The matching bot <NUM> may apply the natural language input by the user to the data recognition model and provide identification information of the chatting bot matched with the natural language input by the user as a recognition result. To this end, the matching bot <NUM> may include at least one of the data training unit <NUM> and the data recognition unit <NUM> described in <FIG>.

In this case, the data training unit <NUM> of the matching bot <NUM> may generate or refine a data recognition model for determining a chatting bot using {natural language, identification information of a chatting server matched with natural language} entity as training purpose data. The data recognition unit <NUM> of the matching bot <NUM> may apply the natural language input by the user as an input value of a data recognition model for determining a chatting bot and obtain the identification information of the chatting bot matched with the natural language input by the user as a recognition result.

<FIG> illustrates that the matching bot <NUM> is included in the server <NUM>, but depending on an implement method, the matching bot <NUM> may be included in an additional server or device, or included in the electronic apparatus <NUM> of the present disclosure.

<FIG> is a flowchart illustrating an example method for controlling an electronic apparatus according to various embodiments of the present disclosure. Referring to <FIG>, the electronic apparatus <NUM> may receive a natural language input by a user at step S1010. The electronic apparatus <NUM> may perform preprocessing of the natural language input by the user at step S1020.

The electronic apparatus <NUM> may analyze the preprocessed natural language and determine a chatting server for generating a response with respect to the input natural language at step S1030. For example, the electronic apparatus <NUM> may analyze a characteristic of the preprocessed natural language and a characteristic of the user and determine a chatting server corresponding to the input natural language among a plurality of chatting servers.

For example, the plurality of chatting servers may include a first chatting server, a second chatting server and a third chatting server that provide a response with respect to the natural language input by the user according to the characteristic of the natural language input by the user and the characteristic of the user. However, the chatting server types are not limited to <NUM> (three), but the chatting server type may be added in case where the response model types using different resources for providing a response are segmented.

For example, the first chatting server may be a chatting server that provides the response corresponding to the natural language input by the user using pre-stored response data base. Such the chatting server may be the simplest response model having a lowest level specification among the plurality of chatting servers. The second chatting server may be a server that provides a response by determining a context of the natural language input by the user using a first response model and the third chatting server may be a chatting server that provides a response by inferring a question included in the natural language input by the user using a second response model.

The electronic apparatus <NUM> may calculate matching scores with respect to criteria to determine one of the plurality of chatting servers. For example, with respect to each of the plurality of chatting servers, the electronic apparatus <NUM> may calculate a first matching score with respect to the natural language, a second matching score with respect to a dialogue pattern including the natural language, a third matching score with respect to emotion of the user and a fourth matching score with respect to a characteristic of the user. The electronic apparatus <NUM> may calculate a final matching score by adding the first to fourth matching scores with respect to the plurality of chatting servers.

For example, the electronic apparatus <NUM> may calculate a first matching score based on weighted values given to words included in the natural language and a Term Frequency/Inverse Document Frequency (TF/IDF) value. In addition, the electronic apparatus <NUM> may calculate a second matching score based on similarity to pre-stored dialogue pattern data. In addition, the electronic apparatus <NUM> may calculate a third matching score based on sentiment analysis and emotion analysis on the natural language and a fourth matching score based on at least one of age, gender, region and education of the user.

The electronic apparatus <NUM> may determine a chatting server having a highest matching score of the plurality of chatting servers as the chatting server corresponding to the natural language. The electronic apparatus <NUM> may transmit the natural language to the determined chatting server at step S1040. In response to the response being received from the chatting server, the electronic apparatus <NUM> may output the response to the user.

According to various embodiments, the electronic apparatus <NUM> may be coupled to a chatting server through short-distance communication or long-distance communication. Connecting the electronic apparatus <NUM> and a chatting server to each other may indicate that the electronic apparatus <NUM> and the chatting server are directly connected to each other, or coupled to each other via an additional element (e.g. at least one of third elements such as an access point (AP), a hub, a transmission device, a base station, a router, a gateway, or the like).

An interface for transmitting/receiving data between the electronic apparatus <NUM> and a chatting server may be defined. For example, an Application Program Interface (API) having training purpose data or recognition purpose data to be applied to a data recognition model of a chatting server as a factor value (or an intermediate value or a transfer value) may be defined. The API is may be defined as a set of subroutines or functions that is called for a processing of any one protocol (e.g., a protocol defined in the electronic apparatus <NUM>) to another protocol (e.g., a protocol defined in a chatting server). In other words, the operation of another protocol may be performed in any one of the protocols through the API.

<FIG> is a flowchart illustrating an example method for controlling an electronic apparatus according to various embodiments of the present disclosure. <FIG> illustrates an example case where a chatting server is changed according to an additional natural language. Therefore, it is assumed that one of a plurality of chatting servers is determined according to an existing input natural language.

The electronic apparatus <NUM> may receive an additional natural language from a user after receiving a natural language at step S1110. The electronic apparatus <NUM> may analyze the additional natural language in the similar manner as <FIG> and determine a chatting server corresponding to the additional natural language at step S1120.

The electronic apparatus <NUM> may determine whether a chatting server that generates a response with respect to the existing natural language is the same as a chatting server corresponding to the additional natural language at step S1130. In response to a chatting server not being changed at step S1130-N, the electronic apparatus <NUM> may transmit the additional natural language to the chatting server and request a response with respect to the additional natural language at step S1150.

On the other hand, in response to the chatting server being changed at step S1130-Y, the electronic apparatus <NUM> may transmit history information of dialogues performed with the existing chatting server and context information to a new chatting server at step S1140. The electronic apparatus <NUM> may transmit the additional natural language to the new chatting server at step S1150. The new chatting server may generate a response based on the dialogue history information, the context information and the additional natural language and transmit the response to the electronic apparatus <NUM>. By sharing the dialogue history information and the context information, the electronic apparatus <NUM> may continue to a dialogue based on the data of dialogues between the user and the existing chatting server.

<FIG> are diagrams illustrating example concepts of a chatting bot system according to another embodiment of the present disclosure.

The description of the electronic apparatus <NUM> and the plurality of chatting servers <NUM>, <NUM> and <NUM> of <FIG> has been described in <FIG>. Therefore, the descriptions thereof will not be repeated here.

Referring to <FIG>, a chatting bot system may include a matching bot <NUM> (a matching server or a matching unit) performing communication by wire or wireless. The purpose or function of the matching bot <NUM> corresponds to those of the matching bot <NUM> in <FIG>.

According to an embodiment, in <FIG>, in response to the electronic apparatus <NUM> receiving a natural language input by a user, the electronic apparatus <NUM> may transmit the natural language to the matching bot <NUM>. The natural language may be text data, voice data or text data from which the voice data is preprocessed.

The matching bot <NUM> may obtain identification information of a chatting server corresponding to the natural language based on the received natural language. For example, as described in <FIG>, the matching bot <NUM> may obtain identification information of the chatting server matched with the natural language using a data recognition model.

The matching bot <NUM> may transmit the natural language to a chatting server corresponding to the obtained identification information of the chatting server. The matching bot <NUM> may preprocess the natural language and transmit the preprocessed natural language. Based on the received natural language, the chatting server may obtain a response with respect to the natural language. The chatting server may transmit the obtained response to the electronic apparatus <NUM> through the matching bot <NUM> or directly transmit the obtained response to the electronic apparatus <NUM>.

According to another embodiment, as illustrated in <FIG>, in response to the electronic apparatus <NUM> transmitting the natural language to the matching bot <NUM>, the matching bot <NUM> may obtain identification information of the chatting server matched with the natural language based on the natural language. For example, as described in <FIG>, the matching bot <NUM> may obtain the identification information of the chatting server matched with the natural language using a data recognition model. The matching bot <NUM> may transmit the obtained identification information of the chatting server to the electronic apparatus <NUM>. The electronic apparatus <NUM> may transmit the natural language to the chatting server corresponding to the received identification information of the chatting server. The chatting sever may obtain a response with respect to the natural language and transmit the response to the electronic apparatus <NUM>.

<FIG> is a sequence diagram illustrating an example method for controlling a matching bot according to an embodiment of the present disclosure.

In <FIG>, a first element <NUM> may be the electronic apparatus <NUM>, and a second element <NUM> may be a server where a matching bot using the data recognition model is stored. In addition, the first element <NUM> may be a generic processor and the second element <NUM> may be an artificial intelligent processor. Alternatively, the first element <NUM> may be at least one application and the second element <NUM> may be one module of the Operation System (OS). In other words, the second element <NUM> may be more integrated, specialized, less delayed, outperformed, or have more resources, thereby performing a bunch of calculations required for generating, refining and using the data recognition model more quickly and effectively than the first element <NUM>.

An interface for transmitting and receiving data between the first element <NUM> and the second element <NUM> may be defined. For example, an API having training purpose data or recognition purpose data to be applied to the data recognition model as a factor value (or an intermediate value or a transfer value).

Referring to <FIG>, the first element <NUM> may receive a natural language input by a user at step S1310.

The first element <NUM> may transmit the natural language to the second element <NUM> at step S1320. For example, the first element <NUM> may apply the natural language as a factor value of an API function for using the data recognition model. Through the API function, the natural language may be transmitted to the second element <NUM> as recognition data for applying the natural data to the data recognition model. The natural language may be processed or supplemented considering a communication format.

The second element <NUM> may apply the received natural language to the data recognition model for determining a chatting server as a trained data recognition model at step S1330. As a result of applying, the second element <NUM> may obtain identification information of the chatting server matched with the natural language at step S1340. The second element <NUM> may transmit the obtained identification information of the chatting server to the first element <NUM> at step S1350. The identification information of the chatting sever may be processed or complemented considering a communication format.

The first element <NUM> that receives the identification information of the chatting server may transmit the natural language input by the user to the chatting server corresponding to the identification information at step S1360.

In response to a response with respect to the natural language input by the user being received from the chatting server, the first element <NUM> may provide the received response to the user.

The above-described methods may be implemented in the form of program commands which are performed through various computers, processors, or the like, and may be recorded on a computer-readable medium. The computer readable medium may include program commands, data files, and data structures either alone or in combination. The program commands recorded in the computer-readable recording medium may be especially designed and implemented for the present disclosure or be known to those skilled in a field of computer software. Examples of the computer-readable medium include magnetic recording media such as hard disks, floppy disks and magnetic tapes, optical recording media such as CD-ROMs and DVDs, magneto-optical recording media such as floptical disks, and hardware devices such as ROMs, RAMs and flash memories that are especially configured to store and execute program commands. Examples of the program commands include machine language codes created by a compiler, and high-level language codes that can be executed by a computer using an interpreter. The hardware device may be configured to operate as one or more software modules to perform the operation of the present disclosure, and the reverse can be applied.

A method according to embodiments may be implemented with a computer program product.

Examples of the computer program product may include a S/W program, a computer readable recording medium where the S/W program is stored or a product traded between a seller and a buyer.

For example, examples of the computer program product may include the electronic apparatus <NUM>, the server <NUM>, the matching bot <NUM> or a product in the form of S/W program (e.g. a downloadable application) distributed on electronic systems through a manufacturer of the manufacturer of the above devices or an application store. For electronic distribution, at least part of the S/W program may be stored in a recoding medium, or temporarily generated. In this case, the recoding medium may be included in a server of the manufacturer or the application store or a transmission server.

Claim 1:
An electronic apparatus (<NUM>), comprising:
an input unit (<NUM>) comprising input circuitry;
a communicator (<NUM>) comprising communication circuitry configured to perform communication with a plurality of chatting servers (<NUM>; <NUM>; <NUM>), each chatting server comprising one of a plurality of AI, Artificial Intelligence, models; and
a processor (<NUM>) configured to:
based on receiving natural language input through the input unit (<NUM>) from a user, preprocess the natural language input by morphologically analyzing the natural language input,
with respect to each of a plurality of chatting servers, determine a first matching score with respect to the preprocessed natural language input by analyzing a dialogue pattern of the natural language input, a second matching score with respect to the preprocessed natural language input by analyzing an emotion of the natural language input and a third matching score with respect to the preprocessed natural language input by analyzing a characteristic of the user and a fourth matching score by analyzing a frequency of use of each of the plurality of chatting servers, wherein the characteristic of the user includes one of age, gender and region of the user,
with respect to each of the plurality of chatting servers, determine a final matching score by summing the first matching score, the second matching score, the third matching score and the fourth matching score,
identify a chatting server having a highest final matching score among the plurality of chatting servers as a chatting server corresponding to the natural language input,
control the communicator to transmit information of the natural language input to the identified chatting server in order to receive a response with respect to the natural language input.