Terminal device and cooking apparatus control system

Disclosed herein is a terminal device and a cooking apparatus capable of guiding an arrangement of a food item in the cooking apparatus comprising a plurality of heat sources to form a plurality of cooking zones having different heating characteristics. The terminal device comprises an imaging device, a user interface provided to display an image captured through the imaging device and provided to receive an input from a user, and a controller configured, in response to determining that the captured image corresponds to an image of a cooking apparatus and in response to obtaining food item information from the user, to control the user interface to display an augmented reality (AR) image of the food item superimposed on a recommended cooking zone among a plurality of cooking zones of the cooking apparatus.

BACKGROUND

The present disclosure relates to a terminal device and a cooking apparatus configured to guide an arrangement of a food item corresponding to a cooking object in the cooking apparatus including a plurality of cooking zones.

2. Description of Related Art

A cooking apparatus is an appliance for heating and cooking a food item, such as a food material, and refers to a device capable of providing various functions related to cooking, such as heating, defrosting, drying, and sterilizing of the food item.

The cooking apparatus includes an oven that cooks a food item by transferring heat directly to the food item through a heat source such as a heater or heating an inside of a cooking chamber, and a microwave oven that cooks a food item by intermolecular frictional heat that is generated by disturbing a molecular arrangement of a cooking object with a high frequency by using a magnetron as a heat source.

Recently, a cooking apparatus configured to simultaneously cook a plurality of food items by including a plurality of heat sources, such as including both a heater and a magnetron, has emerged.

SUMMARY

The present disclosure is directed to providing a terminal device and a cooking apparatus capable of guiding an arrangement of a food item in the cooking apparatus including a plurality of heat sources to form a plurality of cooking zones having different heating characteristics.

One aspect of the present disclosure provides a terminal device including an imaging device, a user interface provided to display an image captured through the imaging device and provided to receive an input from a user, and a controller configured, in response to determining that the captured image corresponds to an image of a cooking apparatus and in response to obtaining food item information from the user, to control the user interface to display an augmented reality (AR) image of the food item superimposed on a recommended cooking zone among a plurality of cooking zones of the cooking apparatus.

In response to the food item including a plurality of ingredients, the controller may be configured to control the user interface to display an AR image of each of the plurality of ingredients superimposed on a corresponding recommended cooking zone with the image of the cooking apparatus.

The controller may be configured to determine an AR image of the food item to display a recommended cooking amount of the food item.

The controller may be configured to determine an AR image of the food item to display a recommended arrangement form of the food item.

The controller may be configured to control the user interface to display an AR image representing each of the plurality of cooking zones superimposed on the image of the cooking apparatus.

The image of the cooking apparatus may be an image of a cooking chamber or an image of a shelf mounted to the cooking chamber.

The controller may be configured to control the user interface to output a notification in response to determining that the food item is arranged in a cooking zone other than the recommended cooking zone.

In response to obtaining the food item information, the controller may be configured to determine a recommended food item that may be cooked in a cooking zone other than the recommended cooking zone, and configured to control the user interface to display an AR image of the recommended food item superimposed on a corresponding cooking zone with the image of the cooking apparatus.

In response to obtaining the food item information, the controller may be configured to determine a recommended meal that uses the food item as an ingredient, configured to determine other food item that is required for making the recommended meal, and configured to control the user interface to display an AR image of the other food item superimposed on a corresponding cooking zone with the image of the cooking apparatus.

Based on receiving a list of food items stored in a refrigerator, the controller may be configured to control the user interface to display the list of food items and based on a user selection for at least one food item in the list of food items, configured to obtain information on the food item.

The controller may be configured to obtain the food item information by processing the image of the food item captured through the imaging device.

Based on a selection of a meal completed from the user, the controller may be configured to determine a plurality of food items that is required for making the meal, and configured to control the user interface to display an AR image of each of the plurality of food items superimposed on a corresponding recommended cooking zone with the image of the cooking apparatus.

Based on receiving a list of meals, which may be made with a food item stored in a refrigerator, from a server, the controller may be configured to control the user interface to display the list of meals, and based on a user selection for any one meal in the list of meals, configured to obtain information on the food item.

Based on the captured image corresponding to an image of the recommended cooking zone, the controller may be configured to control the user interface to enlarge and display an AR image of the food item.

Based on the captured image corresponding to an image of the recommended cooking zone, the controller may be configured to control the user interface to display at least one of an amount of calories in the food item, an image before cooking the food item, an image after cooking the food item, or a recipe of the food item.

Another aspect of the present disclosure provides a cooking apparatus including a cooking chamber including a plurality of cooking zones, a plurality of heat sources configured to heat at least one cooking zone among the plurality of cooking zones, a light emitter configured to emit light to an inside of the cooking chamber, a user interface provided to receive an input from a user, and a controller configured, in response to obtaining food item information from the user, to control the light emitter to emit light to a recommended cooking zone among the plurality of cooking zones.

In response to the food item including a plurality of ingredients, the controller may be configured to control the light emitter to emit light having a different shape for each recommended cooking zone of each of the plurality of ingredients.

In response to determining that the food item is arranged in the recommended cooking zone, the controller may be configured to control at least one of the plurality of heat sources to heat the recommended cooking zone based on a recipe corresponding to the food item.

The cooking apparatus may further include an imaging device configured to image the cooking chamber, and the controller may be configured to determine a recipe of the food item based on an image of an identifier of the food item obtained through the imaging device.

In response to the food item provided in a plurality, the controller may be configured to determine a recipe for each recommended cooking zone of each of the plurality of foods items based on each recipe of the plurality of food items, and configured to control at least one of the plurality of heat sources to heat a recommended cooking zone of each of the plurality of food items based on the determined recipe.

The cooking apparatus may further include a communication circuitry configured to communicate with a server, and based on receiving information on a recipe corresponding to the food item from the server, the controller may be configured to determine a recipe corresponding to the food item.

The controller may be configured to control the user interface to output a notification in response to determining that the food item is arranged in a cooking zone other than the recommended cooking zone.

In response to determining that the food item is arranged in a cooking zone other than the recommended cooking zone, the controller may be configured to control at least one of the plurality of heat sources to heat a cooking zone in which the food item is placed, based on a recipe corresponding to the food item.

In response to obtaining the food item information, the controller may be configured to determine at least one of a recommended food item, which may be cooked in a cooking zone other than the recommended cooking zone, or a meal menu, which uses the food item as an ingredient, and configured to control the user interface to display at least one of the recommended food item or the meal menu.

Another aspect of the present disclosure provides a cooking apparatus control system including a cooking apparatus including a cooking chamber including a plurality of cooking zones, and a plurality of heat sources configured to heat at least one of the plurality of cooking zones, and a terminal device including an imaging device, and a user interface provided to display an image captured through the imaging device and provided to receive an input from a user. The terminal device is configured, in response to the captured image corresponding to an image of the cooking apparatus and in response to obtaining food item information from the user, to control the user interface to display an augmented reality (AR) image of the food item superimposed on a recommended cooking zone among the plurality of cooking zones of the cooking apparatus.

The terminal device may be configured to determine an AR image of the food item to display a recommended cooking amount of the food item.

The terminal device may be configured to determine an AR image of the food item to display a recommended arrangement form of the food item.

A terminal device and a cooking apparatus may guide an arrangement of a cooking object in the cooking apparatus that includes a plurality of heat sources to form a plurality of cooking zones having different heating characteristics. Accordingly, a user of the cooking apparatus can place the cooking object to an optimized cooking zone and thus it is possible to maximize a cooking efficiency.

DETAILED DESCRIPTION

Embodiments described in the disclosure and configurations shown in the drawings are merely examples of the embodiments of the disclosure, and may be modified in various different ways at the time of filing of the present application to replace the embodiments and drawings of the disclosure.

It will be understood that when an element is referred to as being “connected” another element, it can be directly or indirectly connected to the other element, wherein the indirect connection includes “connection via a wireless communication network”.

Also, the terms used herein are used to describe the embodiments and are not intended to limit and/or restrict the disclosure. The singular forms “a,” “an” and “the” are intended to include the plural forms as well, unless the context clearly indicates otherwise. In this disclosure, the terms “including”, “having”, and the like are used to specify features, numbers, steps, operations, elements, components, or combinations thereof, but do not preclude the presence or addition of one or more of the features, elements, steps, operations, elements, components, or combinations thereof.

It will be understood that, although the terms first, second, third, etc., may be used herein to describe various elements, but elements are not limited by these terms. These terms are only used to distinguish one element from another element. For example, without departing from the scope of the disclosure, a first element may be termed as a second element, and a second element may be termed as a first element.

In the following description, terms such as “unit”, “part”, “block”, “member”, and “module” indicate a unit for processing at least one function or operation. For example, those terms may refer to at least one process processed by at least one hardware such as Field Programmable Gate Array (FPGA), Application Specific Integrated Circuit (ASIC), at least one software stored in a memory or a processor.

An identification code is used for the convenience of the description but is not intended to illustrate the order of each step. The each step may be implemented in the order different from the illustrated order unless the context clearly indicates otherwise.

FIG.1is a view of a cooking apparatus control system according to one embodiment of the present disclosure.

Referring toFIG.1, a cooking apparatus control system1includes a terminal device10, a cooking apparatus20, a server30, a network40, and a refrigerator50.

The terminal device10according to one embodiment is an electronic device that may include an imaging device, a communication module, and a user interface provided to display an captured image and receive an input from a user, and the electronic device may transmit and receive information with the cooking apparatus20, the server30, and the refrigerator50through the network40.

For example, the terminal device10may correspond to a user terminal such as a smart phone, and may communicate with the cooking apparatus20, the server30, and the refrigerator50through a known wireless communication protocol. However, the type of the terminal device10is not limited thereto, and may be provided as a known type of user terminal including an imaging device, a communication module, and a user interface.

The terminal device10according to one embodiment may receive an input for the cooking apparatus20from a user, and may control the cooking apparatus20by transmitting the user input to the cooking apparatus20.

In addition, in response to receiving a food item corresponding to a cooking object to be cooked through the cooking apparatus20, the terminal device10according to one embodiment may guide a user about an arrangement of the food item in the cooking apparatus20.

In this case, the food item is an object to be cooked in the cooking apparatus20, and may be an ingredient of food, a meal kit, and a home meal replacement (HMR). The food item may become a meal by being cooked by the cooking apparatus20. That is, the meal may correspond to the result of cooking of the food item by the cooking apparatus20.

The terminal device10may obtain information on a food item to be cooked by directly receiving a food item from a user, receiving a food item through an imaging device, or receiving information on a food item from the cooking apparatus20.

Further, according to embodiments, the terminal device10may receive a list of food items stored in the refrigerator50from the server30or the refrigerator50, and display the list of food items. Accordingly, the terminal device10may receive a user selection for at least one food item from the list and may obtain information on the food item to be cooked.

Further, according to embodiments, the terminal device10may receive a list of meals, which may be made with food items stored in the refrigerator50, from the server30. The terminal device10may display the list of meals to receive a user selection for a single meal in the list of meals and determine a food item that is required for the selected meal, thereby obtaining information on a food item that is to be cooked. In this case, the terminal device10may determine the food item required for making the meal by using pre-stored correlation information between the meal and the food item, or by receiving information on the food item required for making the meal, from the server30.

The cooking apparatus20may include a cooking chamber and a plurality of heat sources, and the cooking chamber may be divided into a plurality of cooking zones having different heating characteristics depending on a location and type of each of the plurality of heat sources.

That is, the terminal device10may guide the user to place the food item to a recommended cooking zone having a heating characteristic suitable for cooking the food item, among the plurality of cooking zones.

Particularly, in response to imaging the cooking apparatus20by the imaging device, the terminal device10may display an image of the cooking apparatus20and display an augmented reality (AR) image of a food item superimposed on a recommended cooking zone among a plurality of cooking zones. In this case, Augmented Reality (AR) is a technology for showing one image by superimposing a three-dimensional virtual image on a real image, and the AR image corresponds to a three-dimensional virtual image displayed overlaid on a real image.

The terminal device10may pre-store arrangement information corresponding to a food item, and in response to the arrangement information not being stored, the terminal device10may request information on a recommended cooking zone to the cooking apparatus20or the server30. The arrangement information may include information on a recommended cooking zone corresponding to a food item, and may further include information on a recommended cooking amount that may be cooked at one time and information on a recommended arrangement form.

The cooking apparatus20according to one embodiment may be operated based on an input inputted from a user or may be operated based on a user input received from the terminal device10.

As described above, the cooking apparatus20according to one embodiment may include a plurality of heat sources, and may include a plurality of cooking zones having heating characteristics different from each other according to locations and types of the plurality of heat sources.

In order to guide the arrangement of the food item, the cooking apparatus20may emit light to a recommended cooking zone, corresponding to a food item, among the plurality of cooking zones according to embodiments, or transmit a message requesting for imaging of the cooking apparatus20, to the terminal device10.

The cooking apparatus20may pre-store arrangement information corresponding to the food item, and in response to the arrangement information of the food item not being stored, the cooking apparatus20may request information on the recommended cooking zone to the server30.

The server30according to one embodiment may store arrangement information for each food item, and may update arrangement information for each food item by receiving the arrangement information on the food item from a manager.

The server30according to one embodiment may receive a request for arrangement information on a specific food item from the terminal device10or the cooking apparatus20, and transmit the requested arrangement information for the specific food item to the terminal device10or the cooking apparatus20.

In addition, based on information on the food item selected by the user through the terminal device10, the server30according to one embodiment may determine a recommended meal that uses the selected food item as an ingredient, and determine other food item for making the recommended meal. Further, the server30may provide information on the recommended meal and information on other food item to the terminal device10.

In addition, the server30according to one embodiment may determine a list of meals, which may be made with the stored food item, based on a list of food items stored in the refrigerator50that is received from the refrigerator50, and provide the list of meals to the terminal device10. The server30may provide information on a food item, which is required for the meal, based on information on a meal that is selected by a user through the terminal device10, to the terminal device10.

The network40according to one embodiment may include at least one of a telecommunication network, such as a computer network (for example, LAN or WAN), the Internet, or a telephone network.

The refrigerator50according to one embodiment may identify a food item stored in the refrigerator50, determine a list of food items stored in the refrigerator50, and transmit the list of food items to the terminal device10or the server30.

According to embodiments, the refrigerator50may include an imaging device provided in a storage compartment for storing food items, and may process an image of a food item captured by the imaging device to identify the food item. For example, the refrigerator50may store food item image information for each type, and may identify the type of the captured food item by comparing the obtained food item image with food item image information for each type. Further, the refrigerator50may identify an identifier (for example, a QR code, a barcode, and an icon) attached to the food item by processing an image of the food item, so as to identify the food item. However, the image processing algorithm for identifying the food item is not limited to the above example, and the food item stored in the refrigerator50may be identified using a known type of image processing algorithm. Alternatively, according to embodiments, the refrigerator50may identify the food item by using a weight sensor provided on a shelf of the storage compartment in addition to the imaging device.

The terminal device10, the cooking apparatus20, the server30and the refrigerator50according to one embodiment may be connected to the network40wired or wirelessly to transmit/receive information to and from each other. However, the terminal device10, the cooking apparatus20, and the refrigerator50may be directly connected to each other and perform direct communication without passing through the network40, according to embodiments.

In the above description, the cooking apparatus control system1has been briefly described. Hereinafter the terminal device10and the cooking apparatus20included in the cooking apparatus control system1will be described in detail.

First, a structure of the cooking apparatus20and the plurality of cooking zones formed in the cooking chamber of the cooking apparatus20will be described in detail.

FIG.2is a perspective view of the cooking apparatus20according to one embodiment of the present disclosure,FIG.3is a view of a partial configuration of an inside of the cooking apparatus20according to one embodiment of the present disclosure,FIG.4is a cross-sectional view of the cooking apparatus20according to one embodiment of the present disclosure, andFIG.5is a view of a heat source and a shelf of the cooking apparatus20according to one embodiment of the present disclosure.

Referring toFIG.2, the cooking apparatus20includes an outer housing21forming an exterior and a door22configured to open and close an opening of the cooking chamber provided in the outer housing21.

The door22according to one embodiment may be provided with a user interface220configured to receive an input from a user or display operation information. However, the user interface220may be provided on the outer housing21according to embodiments.

The user interface220according to one embodiment may include an inputter221configured to receive an input from a user, and a display222provided to display operation information. Further, the user interface220may further include a speaker provided to output a sound for operation information, according to embodiments.

The inputter221according to one embodiment may include a first inputter221aprovided in the form of a jog dial to receive a selection of a cooking temperature, a selection of a cooking time, a selection of a cooking zone, a selection of a food item, and a selection of a meal, and a second inputter221bprovided in the form of a button or an icon to receive an input of starting a cooking operation, stopping a cooking operation, and selecting a control target. However, the inputter221is not limited to the example, and may be provided in various types capable of receiving an input for controlling the cooking apparatus20from a user according to embodiments.

The display222according to one embodiment may display information inputted by a user, such as information on a cooking temperature, a cooking time, and a cooking zone selected by the user. In addition, the display222may display a notification about the arrangement of the food item, information on a recommended food item that may be cooked simultaneously with the food item, or information on a recommended meal that may be made with the food item. For this, the display222may be provided with a known type of display panel.

The display222may be provided as a touch screen according to embodiments, and in this case, the inputter221may be provided integrally with the display222.

In addition, unlike that illustrated inFIG.2, the door22may be formed of a transparent member to allow a user to observe the inside of the cooking chamber23even when the door22closes the cooking chamber23according to embodiments.

Referring toFIGS.3and4, the cooking apparatus20may include the cooking chamber23arranged inside the outer housing21and in which a food item corresponding to a cooking object is placed, an inner housing24arranged inside the outer housing21and provided to form the cooking chamber23, and a separation space27formed between the outer housing21and the inner housing24.

The outer housing21and the inner housing24are provided to open in a first direction A, which is a front direction of the cooking apparatus20. A user can place the food item to the cooking chamber23through the opening of the inner housing24formed in the first direction A.

Further, according to embodiments, on a front surface of the cooking apparatus20, an identifier28(for example, a QR code, a barcode, and an icon) provided to allow the terminal device10to identify the cooking apparatus20in response to imaging the cooking apparatus20by the terminal device10may be provided. Accordingly, the terminal device10may identify the cooking apparatus20and may use the identifier28as a reference position for outputting a virtual reality image. The identifier28may be provided on a front portion of the separation space27to be captured upon opening the door22, but is not limited thereto. Accordingly, the identifier28may be arranged in any position as long as being captured upon opening the door22. Alternatively, the identifier28may be arranged in a front portion of the outer housing21or the door22so as to be captured upon closing the door22.

The cooking apparatus20according to one embodiment may include the cooking chamber23having a rectangular parallelepiped shape that is long in a second direction B and relatively short in the first direction A. In other words, the cooking chamber23may have a rectangular parallelepiped shape having a long side23L in the second direction B.

The cooking apparatus20may include an electric room26formed inside the outer housing21and arranged below the cooking chamber23. Various electrical components for operating the cooking apparatus20may be arranged inside the electric room26.

The cooking apparatus20may include the shelf25mounted to the cooking chamber23and in which a food item is placed. The shelf25is provided to be detachable from the cooking chamber23. A user can place a food item to the shelf25coupled to the cooking chamber23. Alternatively, after a user separates the shelf25from the cooking chamber23to position the shelf25to the outside of the cooking chamber23, the user can place the food item to the shelf25and then couple the shelf25to the cooking chamber23.

The cooking chamber23may include a support23cformed on opposite sides of the cooking chamber23to allow the shelf25to be mounted between an upper surface23aand a lower surface23bof the cooking chamber23.

The support23cmay be provided in plurality in a third direction C to allow the shelf25to be mounted at various heights. The third direction C is a direction perpendicular to the first direction A or the second direction B with respect to a vertical direction.

The shelf25may include a main body25aand a cooking surface25bon which a food item is arranged. The cooking surface25bmay be provided to face the upper surface23aof the cooking chamber23in response to mounting the shelf25. The cooking surface25baccording to one embodiment may have a rectangular shape having a long side in the second direction B and a short side in the first direction A.

According to embodiments, an identifier25d(for example, a QR code, barcode, and icon) may be provided on the front surface of the cooking apparatus20to allow the terminal device10to identify the shelf25in response to imaging the shelf25by the terminal device10. Accordingly, the terminal device10may identify the shelf25and use the identifier25das a reference position for outputting a virtual reality image. The identifier25dmay be provided on a surface of the main body25ain the same direction as the cooking surface25bto be captured in response to imaging the cooking surface25b.

The cooking apparatus20may include a heat source260configured to supply heat to the inside of the cooking chamber23to cook a food item by using heat. The heat source260may heat a food item arranged in the cooking chamber23. For example, the heat source260may heat a food item positioned on the shelf25and a food item positioned on the lower surface23bof the cooking chamber23.

The cooking apparatus20may include a plurality of heat sources260, and each of the plurality of heat sources260is provided at different positions with respect to the cooking chamber23according to embodiments. Accordingly, an amount of radiated heat may vary for different positions in the cooking chamber23. In addition, each of the plurality of heat sources260may be provided in different types (for example, heaters, and magnetrons) according to embodiments, and thus the type of heating applied to different positions in the cooking chamber23may vary.

The cooking apparatus20may include the plurality of heat sources260in which at least one of installation positions or types is different, and thus it is possible to form a plurality of cooking zones having heating characteristics different from each other in the cooking chamber23.

For example, the plurality of heat sources260may include a plurality of heaters261:261a,261b,261c, and261darranged on the upper surface23aof the cooking chamber23and a magnetron262arranged below the lower surface23bof the cooking chamber23. Hereinafter for convenience of explanation, it will be described that the plurality of heat sources260includes the plurality of heaters261and the magnetron262as an example, but the positions and types of the plurality of heat sources260are not limited thereto. For example, the heat source of the lower surface23bof the cooking chamber23may be provided as a heater instead of a magnetron according to embodiments.

The plurality of heaters261according to one embodiment generate heat based on power supplied from a power supply device (not shown), thereby supplying heat to the food item placed in the cooking chamber23. The heater261may include a sheath heater, a planar heating heater, and a halogen lamp heater, but the type of the heater261is not limited to the above example.

The magnetron262according to one embodiment may oscillate a high frequency into the cooking chamber23. The high frequency generated by the magnetron262may repeatedly change the molecular arrangement of moisture contained in the food item, and thus the food item may be heated by frictional heat between the moisture molecules.

According to embodiments, the magnetron262may be arranged in the electric room26. The magnetron262may supply heat to a food item positioned on the lower surface23bof the cooking chamber23by oscillating a high frequency from the electric room26toward the lower surface23bof the cooking chamber23. The high frequency may pass through the lower surface23band then be radiated to the shelf25, thereby supplying heat to a food item positioned on the shelf25.

According to embodiments, the shelf25may further include a heat generator25cto allow heat to be efficiently transferred to a lower portion of a food item arranged on the shelf25.

The heat generator25cmay be arranged on the opposite side of the cooking surface25bin the main body25aof the shelf25. The heat generator25cmay be provided to face the lower surface23bof the cooking chamber23in response to mounting the shelf25to the cooking chamber23.

The heat generator25cmay generate heat by absorbing the high frequency generated from the magnetron262. The heat generated by the heat generator25cmay be transferred to the cooking surface25bthrough the main body25aof the shelf25. That is, while the heat generated by the heat generator25cis conducted to the cooking surface25b, the heat may be supplied to the lower portion of the food item positioned on the cooking surface25bof the shelf25. The heat generator25cmay be formed of a ferrite material to absorb a high frequency. However, the present disclosure is not limited thereto, and a material capable of generating heat by a high frequency may be mixed with ceramic to form the heat generator25c.

Accordingly, even if a user does not turn over the food item in the middle of a cooking process, the heat may be supplied to the food item in the vertical direction, and thus the cooking may proceed efficiently.

According to embodiments, the heat generator25cmay be formed of a heating material such that at least one of a heating type or a heating amount varies for each position of the shelf25. Accordingly, the heating characteristics may vary depending on the position of the shelf25. For example, the heat generator25cmay include a first heat generator positioned to correspond to the left half of the shelf25and formed of a heating material having superior heat generating performance according to high frequencies, and a second heat generator positioned to correspond to the right half of the shelf25and formed of a heating material having a relatively low heat generating performance according to high frequencies.

As described above, the cooking apparatus20may include the plurality of heat sources260that differ in at least one of a heat source installation location or a heat source type, and the cooking apparatus20may control the amount of heat output from the plurality of heat sources260so as to form the plurality of cooking zones having different heating characteristics from each other, in the cooking chamber23.

For example, the plurality of cooking zones formed in the cooking chamber23may be defined as a first cooking zone201and a second cooking zone202formed on the shelf25, and a third cooking zone203formed on the lower surface23bof the cooking chamber23. However, the plurality of cooking zones is not limited to the above example, and may vary depending on the installation location of the heat source260, the type of the heat source260, the configuration of the heat generator25c, or the number of shelves25. Hereinafter for convenience of description, it will be described that the plurality of cooking zones200includes the first cooking zone201and the second cooking zone202formed on the shelf25, and the third cooking zone203formed on the lower surface23bof the cooking chamber23.

Particularly, there is a situation in which a plurality of food items having different cooking temperatures is simultaneously put into the cooking chamber23to cook. That is, different food items may be arranged on each of the cooking zones201and202on the shelf25and the lower surface23bof the cooking chamber23.

In this case, the cooking apparatus20may set different temperatures of heat generated by the plurality of heaters261:261a,261b,261c, and261d. That is, the cooking apparatus20may adjust the output of the plurality of heaters261:261a,261b,261c, and261d, independently of each other. Further, the cooking apparatus20may independently adjust the output of the magnetron262. Accordingly, the cooking apparatus20may transfer a different heat energy to the plurality of food items arranged in the cooking zones201and202of the shelf25and the third cooking zone203of the lower surface23bof the cooking chamber23, respectively.

In response to the plurality of heaters261being arranged on the upper surface23aof the cooking chamber23, the plurality of food items may be arranged at positions corresponding to the positions of the plurality of heaters261. For example, the cooking surface25bof the shelf25may be divided into the first cooking zone201and the second cooking zone202. The first cooking zone201and the second cooking zone202of the shelf25may be heated to different temperatures. The plurality of food items may be located in each of the cooking zones201and202of the shelf25. Accordingly, a different thermal energy may be provided to each of the plurality of food items.

According to embodiments, the plurality of heaters261and the cooking zones201and202of the shelf25may be formed to face each other with respect to the third direction C. Different heat generated by each of the plurality of heaters261may be directly transferred to the first cooking zone201and the second cooking zone202of the shelf25.

Accordingly, even when a plurality of food items having different cooking temperatures is simultaneously put into the cooking chamber, each of the food items may be cooked at different temperatures. In other words, in response to a food item being arranged in each of the first cooking zone201, the second cooking zone202, and the third cooking zone203, each food item may be cooked at a different temperature. Alternatively, the food item arranged in each of the first cooking zone201, the second cooking zone202, and the third cooking zone203may be cooked at the same temperature.

The cooking apparatus20according to one embodiment includes the plurality of heaters261:261a,261b,261c, and261dhaving a long axis261L extending in the first direction A. Each of the heaters261a,261b,261c, and261dmay be spaced apart from each other in the second direction B corresponding to the long side23L of the cooking chamber23. On the cooking surface25bof the shelf25, the plurality of cooking zones201and202receiving heat of different temperatures may be partitioned along the second direction B.

As the plurality of heaters261a,261b,261c, and261dis spaced apart in the second direction B, and the cooking zones201and202of the shelf25are partitioned along the second direction B, a width of each cooking zone may be increased, and the temperature difference between the cooking zones may be increased. In addition, because it is not necessary to place the plurality of food items deeply on the rear surface of the cooking chamber23upon placing the plurality of food items, it is easy to observe the food items arranged on the shelf25.

Alternatively, according to embodiments, the plurality of heaters261a,261b,261c, and261dmay be spaced apart from each other in the first direction A, and the cooking zones201and202of the shelf25may be partitioned along the first direction A.

Hereinafter the plurality of heaters261a,261b,261c, and261daccording to one embodiment and the plurality of cooking zones201and202partitioned on the shelf25will be described in detail.

Referring toFIG.5, each of the plurality of heaters261a,261b,261c, and261daccording to one embodiment may have the long axis261L extending in the first direction A, and the plurality of heaters261a,261b,261c, and261dmay be spaced apart from each other in the second direction B corresponding to the long side23L of the cooking chamber23. A separation distance between the plurality of heaters261a,261b,261c, and261daccording to one embodiment may be a first separation distance d1and/or a second separation distance d2.

For example, the first heater261aand the third heater261cmay be arranged to have the first separation distance d1on the first cooking zone201, and the second heater261band the fourth heater261dmay be arranged to have the first separation distance d1on the second cooking zone202. The first heater261aand the second heater261bmay be arranged to have the second separation distance d2. The second separation distance d2may be greater than the first separation distance d1. This is to provide a temperature difference between the first cooking zone201and the second cooking zone202. Alternatively, according to embodiments, the first separation distance d1and the second separation distance d2may be the same.

In the above description, it has been described that the plurality of heaters261includes the first heater261a, the second heater261b, the third heater261c, and the fourth heater261d, but the present disclosure is not limited thereto. The plurality of heaters261may be composed of the first heater261aand the second heater261b, or may be composed of four or more heaters according to embodiments.

With respect to the second direction B, the first heater261amay be arranged on one side of the cooking apparatus20, and the second heater261bmay be arranged on the opposite side of the first heater261a. Particularly, the first heater261amay be arranged on one side and the second heater261bmay be arranged on the opposite side with respect to a center line G of the cooking surface25b. The third heater261cmay be arranged adjacent to the first heater261a, and the fourth heater261dmay be arranged adjacent to the second heater261b.

The first heater261aand the third heater261cmay generate heat at the same temperature. The second heater261band the fourth heater261dmay generate heat at the same temperature. The first heater261aand the second heater261bmay generate heat of different temperatures. Similarly, the third heater261cand the fourth heater261dmay generate heat of different temperatures. That is, the heating temperature on the left side and the heating temperature on the right side with respect to the center line G may be different from each other.

For example, the cooking apparatus20may set a heating temperature of the first heater261ahigher than the heating temperature of the second heater261b. In this case, the first heater261aand the second heater261bmay be independently controlled based on a set temperature. The first heater261a, the second heater261b, the third heater261c, and the fourth heater261dmay be independently and/or selectively controlled.

Meanwhile, although the heating temperature of each of the plurality of heaters261a,261b,261c, and261dis set to be the same, a driving method of each heater may be controlled differently. For example, during an entire cooking time, the cooking apparatus20may continuously drive the first heater261aand the third heater261c, and but repeatedly turn on/off the second heater261band the fourth heater261d. Accordingly, a thermal energy provided by the first and third heaters261aand261cmay be greater than a thermal energy provided by the second and fourth heaters261band261d.

By differently controlling the installation position, heating temperature, or driving method of each of the plurality of heaters261, the cooking surface25bof the shelf25may be divided into the first cooking zone201and the second cooking zone202. The first cooking zone201may be formed on the left side of the center line G and the second cooking zone202may be formed on the right side of the center line G. Although the two cooking zones200of the shelf25are illustrated, three or more cooking zones200may be formed by changing the installation position, heating temperature, or driving method of each of the plurality of heaters261.

The heater261may provide heat to at least one of the first cooking zone201or the second cooking zone202of the shelf25. The first heater261aand the third heater261cmay be arranged at positions corresponding to the first cooking zone201with respect to the third direction C. The second heater261band the fourth heater261dmay be arranged at positions corresponding to the second cooking zone202with respect to the third direction C.

As described above, in response to heat, which is generated by the first and third heaters261aand261cand the second and fourth heaters261band261d, being different from each other, the thermal energy transferred to the first and second cooking zones201and202may be different. That is, heat generated by the first heater261aand the third heater261cmay be transferred from the upper surface23ato the first cooking zone201. Heat generated by the second heater261band the fourth heater261dmay be transferred from the upper surface23ato the second cooking zone202.

In addition, heat conducted from the heat generator25cmay be transferred to the first cooking zone201and the second cooking zone202. The heat generator25cmay be heated by a high frequency generated from the magnetron262arranged on the lower surface23bof the cooking chamber23. Heat generated by the heat generator25cmay be conducted to the cooking surface25b. As described above, according to embodiments, the heat generator25cmay be formed of a heating material such that at least one of a heating type or a heating amount varies for each position of the shelf25. For example, the heat generator25cmay include a first heat generator positioned to correspond to the first cooking zone201and formed of a heating material having superior heat generating performance according to high frequencies, and a second heat generator positioned to correspond to the second cooking zone202and formed of a heating material having a relatively low heat generating performance according to high frequencies. As described above, the cooking zone200formed on the shelf25may be formed by changing the configuration of the heat generator25cin addition to the plurality of heaters261.

The heat generated by the first and third heaters261aand261cand the heat generated by the second and fourth heaters261band261dare different from each other and the heat transferred to the first cooking zone201and the second cooking zone202is different from each other. Therefore, food items having different cooking temperatures may be arranged in the first cooking zone201and the second cooking zone202, respectively, and cooked at the same time.

As described above, the cooking apparatus20may include the plurality of heat sources260that differ in at least one of a heat source installation location or a heat source type, and the cooking apparatus20may control the amount of heat output from the plurality of heat sources260so as to form the plurality of cooking zones having different heating characteristics from each other, in the cooking chamber23.

In this case, each of the different types of food item may have unique heating characteristics, such as varying specific heat according to constituent materials forming the food item. Further, different types of food item may have different optimum cooking temperatures, to be cooked, from each other.

Accordingly, a cooking efficiency may increase as each of the different types of food item is cooked in a cooking zone, which provides an optimal thermal energy to the food item, among the plurality of cooking zones200of the cooking chamber23.

However, a user may feel inconvenient to always check which cooking zone among the plurality of cooking zones200of the cooking chamber23corresponds to the optimal cooking zone corresponding to the corresponding food.

Accordingly, in response to a food item being input, the terminal device10and the cooking apparatus20according to one embodiment more intuitively guide an optimal cooking zone for each input food item. Therefore, the user can easily recognize the optimal cooking zone for each food item and thus it possible to increase the cooking efficiency of the food item.

Hereinafter one embodiment in which the terminal device10and the cooking apparatus20guide the arrangement of food item in consideration of the plurality of cooking zones200having different heating characteristics will be described in detail.

FIG.6is a diagram of the terminal device10according to one embodiment of the present disclosure.

Referring toFIG.6, the terminal device10according to one embodiment includes the imaging device110, the user interface120provided to display an image captured through the imaging device110and configured to receive an input from a user, a controller130configured, in response to obtaining food item information, to control the user interface120to display an AR image of the food item superimposed on the image of the cooking apparatus20, a communication circuitry140configured to communicate with an external device, and a storage150configured to store various information required for control.

However, each component of the terminal device10illustrated inFIG.6may be omitted according to embodiments, and a component not shown may be added as necessary.

The imaging device110according to one embodiment may be provided in the main body of the terminal device10, and configured to obtain image data for the external area by imaging the external area of the terminal device10. For this, the imaging device110may include a known type of imaging sensor. For example, the imaging device110may include a camera, and a video capturing device.

As described later, image data obtained through the imaging device110may be displayed on the display122of the user interface120under the control of the controller130.

A user can place the terminal device10to in front of the cooking apparatus20to allow the imaging device110to obtain image data for the cooking apparatus20, and the image of the cooking apparatus20may be displayed on the display122.

According to embodiments, the imaging device110may be located on a rear surface of one surface of the main body on which the display122is located.

The user interface120according to one embodiment may include the inputter121configured to receive an input from a user, the display122provided to display image data obtained through the imaging device110, and a speaker123configured to output a sound.

The inputter121according to one embodiment may receive information about a food item to be cooked from a user. According to embodiments, the inputter121may receive a selection of a meal completed from a user. Further, the inputter121may receive a setting value necessary for controlling the cooking apparatus20according to embodiments.

For this, the inputter121may be provided as a known type of input device, or according to embodiments, may be provided as a touch screen integrally configured with the display122.

The display122according to one embodiment may display image data obtained through the imaging device110. Particularly, the display122may display an image of the cooking apparatus20obtained through the imaging device110. In this case, the image of the cooking apparatus20may correspond to an image of the cooking chamber23or an image of the shelf25separated from the cooking chamber23.

For this, the display122may be provided as a display panel for displaying image data, and the type of the display panel is not limited thereto.

The display122may display the AR image of the food item superimposed on the image of the cooking apparatus20based on the control of the controller130according to embodiments. This will be described in detail again later.

Further, according to embodiments, the display122may display various notifications based on the control of the controller130. For example, the display122may display a notification in the form of a message. However, the type of notification is not limited thereto, and may be provided in various types such as icons.

The speaker123according to one embodiment may output various sound notifications based on the control of the controller130. For this, the speaker123may be configured as a known type of a speaker device.

The controller130according to one embodiment may obtain information on a food item to be cooked from a user.

Particularly, by directly receiving a food item from a user or by processing an image of the food item obtained through the imaging device110or by receiving information on a food item from the cooking apparatus20, the controller130may obtain information on the food item to be cooked.

Further, according to embodiments, the controller130may receive a list of food items stored in the refrigerator50from the server30or the refrigerator50, and display the list of food items. Accordingly, the controller130may receive a user selection for at least one food item in the list so as to obtain information on the food item to be cooked.

Further, according to embodiments, the controller130may receive a list of meals, which may be made with food items stored in the refrigerator50, from the server30. The controller130may display the list of meals to receive a user selection for at least one meal in the list of meals and determine a food item that is required for the selected meal, thereby obtaining information on the food item to be cooked. In this case, the terminal device10may determine the food item required for making the meal by using pre-stored correlation information between the meal and the food item, or by receiving information on the food item required for making the meal, from the server30.

In response to an image, which is obtained by the imaging device110, corresponding to an image of the cooking apparatus20, and in response to obtaining food item information from a user, the controller130according to one embodiment may control the user interface120to display an AR image of the food item superimposed on a recommended cooking zone among the plurality of cooking zones200.

That is, in response to obtaining food item information, to be cooked, the controller130may determine a recommended cooking zone corresponding to the food item, among the plurality of cooking zones200of the cooking apparatus20, and the controller130may control the user interface120to display an AR image of the food item superimposed on the image of the cooking apparatus20so as to allow the AR image of the food item to be displayed on the recommended cooking zone.

In response to the plurality of food items, the controller130may control the user interface120to display an AR image of each of the plurality of food items superimposed on the recommended cooking zone with the image of the cooking apparatus20. That is, in response to the food item, to be cooked, being provided in plurality, the controller130may determine a recommended cooking zone corresponding to each of the plurality of food items, and control the user interface120to display the AR image of each of the plurality of food items superimposed on the image of the cooking apparatus20so as to allow the AR image of each of the plurality of food items to be displayed in a corresponding recommended cooking zone.

For example, in response to the food item including a plurality of ingredients, such as a meal kit or HMR, the controller130may control the user interface120to display an AR image of each of the plurality of ingredients superimposed on a corresponding recommended cooking zone with the image of the cooking apparatus20.

The controller130may configure an AR image of a food item in the form of the food item to allow a user to identify the AR image as the food item.

In addition, the controller130according to one embodiment may determine an AR image of the food item to display a recommended cooking amount of the food item. Particularly, the controller130may determine the AR image of the food item such that the AR image of the food item includes the number of the food items corresponding to the recommended cooking amount.

Further, the controller130according to one embodiment may determine an AR image of the food item to display the recommended arrangement form of the food item. Particularly, the controller130may determine a shape of the food item to correspond to the recommended arrangement form, and determine the AR image of the food item to include the determined shape of the food item.

In response to obtaining the food item information, the controller130may determine a recommended cooking zone, a recommended cooking amount or a recommended arrangement form for the corresponding food item by using food item arrangement information corresponding to the obtained food item information, among the arrangement information stored in the storage150. However, in response to the arrangement information not being stored in the storage150, the controller130may request the arrangement information on the food item to the server30and determine a recommended cooking zone, a recommended cooking amount or a recommended arrangement form for the corresponding food item, based on the arrangement information received from the server30.

The controller130according to one embodiment may control the user interface120to display an AR image indicating each of the plurality of cooking zones of the cooking apparatus20superimposed on the image of the cooking apparatus20.

In addition, the controller130according to one embodiment may control the user interface120to output a notification in response to determining that the food item is arranged in a cooking zone other than the recommended cooking zone.

In addition, in response to obtaining food item information from a user, the controller130according to one embodiment may determine a recommended food item that may be cooked in a cooking zone other than the recommended cooking zone, and control the user interface120to display an AR image of the recommended food item superimposed on a corresponding cooking zone.

In addition, in response to obtaining food item information from a user, the controller130according to one embodiment may determine a recommended meal that uses the food item as an ingredient, and control the user interface120to display the recommended meal. In this case, the controller130may determine other food item that is required for the recommended meal, and control the user interface120to display an AR image of the other food item superimposed on a corresponding cooking zone, according to embodiments.

In addition, based on a selection of a meal, which is to be completed, from a user, the controller130according to one embodiment may determine a plurality of food items that is required for making the meal, and control the user interface120to display an AR image of each of the plurality of food items superimposed on a corresponding cooking zone with the image of the cooking apparatus20.

The controller130according to one embodiment may control the user interface120so as to enlarge and display an AR image of food item based on an image, which is captured by the imaging device110, corresponding to an image of a recommended cooking zone.

In addition, based on the image, which is captured by the imaging device110, corresponding to the image of the recommended cooking zone, the controller130according to one embodiment may control the user interface120to display at least one of an amount of calories in the food item, an image before cooking of the food item, an image after cooking of the food item, or a recipe of the food item.

The controller130may include at least one memory configured to store a program for performing the above-described operation and an operation to be described later, and at least one processor configured to execute the stored program.

The communication circuitry140according to one embodiment may communicate with the cooking apparatus20or the server30through wireless communication or wired communication. For this, the communication circuitry140may include a known type of communication module.

The communication circuitry140may transmit a setting value inputted by a user to the cooking apparatus20, or may receive information on a food item from the cooking apparatus20according to embodiments.

Further, the communication circuitry140may receive arrangement information on a food item from the cooking apparatus20or the server30according to embodiments. That is, in response to the arrangement information on the food item not being stored, the communication circuitry140may request the arrangement information on the corresponding food item to the cooking apparatus20or the server30under the control of the controller130.

The storage150according to one embodiment may be provided as a known type of storage medium to store various types of information required for control.

The storage150may store arrangement information for each food item. In this case, the arrangement information for each food item may include information on the correlation between the food item and the cooking zone, information on the correlation between the food item and the cooking amount of the food item, and information on the correlation between the food item and the arrangement form.

FIG.7is a diagram of the cooking apparatus20according to one embodiment of the present disclosure.

Referring toFIG.7, the cooking apparatus20according to one embodiment includes an imaging device210configured to image the cooking chamber23, the user interface220configured to receive an input from a user and provided to display operation information, a controller230configured, in response to obtaining food item information, to guide a recommended cooking zone corresponding to the food item, a communication circuitry240configured to communicate with an external device, a storage250configured to store a variety of information for the control, the heat source260configured to radiate heat to the cooking chamber23and a light emitter270configured to emit light to the cooking chamber23.

However, each component of the cooking apparatus20illustrated inFIG.7may be omitted according to embodiments, and a component not shown may be added as necessary.

The imaging device210according to one embodiment may be configured to obtain image data of the cooking chamber23by imaging the cooking chamber23. For this, the imaging device210may be arranged on the upper surface23aof the cooking chamber23and include a known type of imaging sensor. For example, the imaging device210may include a camera, and a video capturing device.

The user interface220according to one embodiment may include the inputter221configured to receive an input from a user, the display222provided to display operation information, and the speaker223provided to output a sound.

As illustrated inFIG.2, the inputter221according to one embodiment may receive a selection of a cooking temperature, a selection of a cooking time, a selection of a cooking zone, starting a cooking operation, stopping a cooking operation, and a selection of a control target.

As illustrated inFIG.2, the display222according to one embodiment may display information inputted by a user, such as information on a cooking temperature, a cooking time, and a cooking zone selected by a user. In addition, the display222may display a notification about the arrangement of the food item, information on a recommended food item that may be cooked simultaneously with the food item, or information on a recommended meal that may be made with the food item.

The speaker223according to one embodiment may output various sound notifications based on the control of the controller130. For this, the speaker223may be provided as a known type a speaker device.

The controller230according to one embodiment may control the heat source260to cook a food item based on a user input inputted through the inputter221.

Further, the controller230according to one embodiment may control the heat source260to cook a food item based on a user input received from the terminal device10through the communication circuitry240.

In response to obtaining food item information, the controller230according to one embodiment may control the light emitter270to emit light to a recommended cooking zone among the plurality of cooking zones200of the cooking apparatus20.

That is, in response to obtaining food item information, to be cooked, the controller230may determine a recommended cooking zone corresponding to the food item among the plurality of cooking zones200of the cooking apparatus20, and control the light emitter270to emit light to the recommended cooking zone.

In response to the plurality of food items, the controller230may control the light emitter270to emit light that has a different shape for each recommended cooking zone of each of the plurality of food items. That is, in response to the plurality of food items to be cooked, the controller230may determine a recommended cooking zone corresponding to each of the plurality of food items, and the controller230may control the light emitter270to emit light that has a different shape for each recommended cooking zone corresponding to each of the plurality of food items.

According to embodiments, in response to obtaining the food item information, the controller230may transmit a notification requesting for imaging the cooking apparatus20through the terminal device10, to the terminal device10. In addition, according to embodiments, in response to obtaining the food item information, the controller230may control the user interface220to display a notification requesting for imaging the cooking apparatus20through the terminal device10.

In response to the food item being arranged in the recommended cooking zone, the controller230according to one embodiment may control at least one of the plurality of heat sources260to heat the recommended cooking zone based on a recipe corresponding to the food item.

In this case, the recipe may include information on a cooking temperature and a cooking time corresponding to the food item. In other words, the recipe may include at least one of a cooking temperature, a cooking time, or an output of the heat source260as a cooking parameter for the operation of the heat source260. In this case, as for the recipe, information on the recipe for each food item may be pre-stored in the storage250. Further, the recipe to be applied to each cooking zone may be determined based on a user input. Information on a recipe for each food item may be received from the server30according to embodiments.

The controller230according to one embodiment may identify a food item based on image processing of the image of the cooking chamber23obtained through the imaging device210, and may determine a recipe for the food item.

Particularly, the controller230may identify the food item based on an image of an identifier of the food item that is included in the image of the cooking chamber23, and determine the recipe for the food item. In this case, the identifier of the food item may be displayed on a container of the food item, and may be provided as a QR code, a barcode, an icon, or the like. In response to the recipe, corresponding to the identified food item, being stored, the controller230may control the heat source260based on the stored recipe, and in response to the recipe, corresponding to the identified food item, not being stored, the controller230may request the recipe to the server30and then receive the recipe, thereby controlling the heat source260.

In response to the plurality of food items, the controller130may identify each of the plurality of food items based on an image of an identifier of each of the plurality of food items and determine a recipe for each of the plurality of food items. In this case, the controller230may determine the recipe for each recommended cooking zone of the plurality of food items based on the recipe for each of the plurality of food items, and control at least one of the plurality of heat sources260to heat each recommended cooking zone based on the determined recipe for each recommended cooking zone.

In response to the food item being arranged in a cooking zone other than the recommended cooking zone, the controller230according to one embodiment may control the user interface220to output a notification.

In addition, in response to the food item being arranged in a cooking zone other than the recommended cooking zone, the controller230according to one embodiment may control at least one of the plurality of heat sources260to heat the cooking zone, in which the food item is arranged, based on the recipe corresponding to the food item.

In addition, in response to obtaining food item information from a user, the controller230according to one embodiment may determine a recommended food item that may be cooked in a cooking zone other than the recommended cooking zone, and control the user interface220to display the recommended food item.

In addition, in response to obtaining food item information from a user, the controller230according to one embodiment may determine a recommended meal that uses the food item as an ingredient, and control the user interface220to display the recommended meal.

The controller230may include at least one memory configured to store a program for performing the above-described operation and an operation to be described later, and at least one processor configured to execute the stored program.

The communication circuitry240according to one embodiment may communicate with the terminal device10or the server30through wireless communication or wired communication. For this, the communication circuitry240may include a known type of communication module.

The communication circuitry240may receive a user input for controlling the cooking apparatus20from the terminal device10, and may request arrangement information on a food item to the server30and receive the arrangement information on the food item from the server30.

The storage250according to one embodiment may be provided as a known type of storage medium to store various types of information required for control.

The storage250may store arrangement information for each food item and a recipe for each food item. In this case, the arrangement information for each food item may include information on the correlation between the food item and the cooking zone, information on the correlation between the food item and the cooking amount of the food item, and information on the correlation between the food item and the arrangement form.

The heat source260according to one embodiment may be provided in plurality, and configured to supply heat to the cooking chamber23. For example, the heat source260may include the plurality of heaters261a,261b,261c, and261dprovided on the upper surface23aof the cooking chamber23, and the magnetron262provided in the electric room26of the cooking chamber23.

As illustrated inFIGS.2to5, each of the plurality of heat sources260may form the plurality of cooking zones200in the cooking chamber23by changing at least one of the installation location or type.

The light emitter270according to one embodiment may be provided in the cooking chamber23to emit light to each of the plurality of cooking zones200. For this, the light emitter270may include a light emitting device such as a light emitting diode (LED) and a laser. In this case, the light emitter270may include a plurality of light emitting devices provided at positions corresponding to each of the plurality of cooking zones200according to embodiments. In addition, according to embodiments, the light emitter270may emit light to each of the plurality of cooking zones200by mechanically adjusting an emission angle using a motor or the like. The light emitter270may be provided as a light emitting element array to perform phase adjustment so as to electrically adjust the emission angle. Accordingly, the light emitter270may emit light to each of the plurality of cooking zones200.

In the above description, each component of the terminal device10and the cooking apparatus20has been described. Hereinafter one embodiment in which the terminal device10and the cooking apparatus20guide the arrangement of the food item in consideration of the plurality of cooking zones200having different heating characteristics will be described in more detail.

FIG.8Ais a signal flow diagram illustrating a state in which the terminal device according to one embodiment of the present disclosure obtains food item information according to a selection of a food item,FIG.8Bis a view illustrating a state in which the terminal device10according to one embodiment of the present disclosure displays an augmented reality (AR) image of a food item with an image of a cooking chamber23as a background,FIG.8Cis a view illustrating a state in which the terminal device10according to one embodiment of the present disclosure displays an AR image of a food item with an image of the shelf25as a background, andFIG.8Dis a view illustrating a state in which the terminal device according to one embodiment of the present disclosure displays an AR image of a food item with an image of the cooking chamber as a background when the food item includes a plurality of ingredients.

Referring toFIGS.8A to8D, in response to an image, which is captured by the imaging device110, corresponding to an image of the cooking apparatus20, and in response to obtaining food item information from a user, the controller130according to one embodiment may control the user interface120to display an AR image of the food item superimposed on a recommended cooking zone among the plurality of cooking zones200.

The image of the cooking apparatus20may be an image of the cooking chamber23or an image of the shelf25separated from the cooking chamber23.

Hereinafter displaying of an AR image of a food item820by the terminal device10will be described in more detail.

The refrigerator50according to one embodiment may transmit a list of food items stored in the storage compartment to the terminal device10(step81). The terminal device10may obtain information on the food item by displaying the list of food items (step82) and receiving a user selection for at least one food item from the list of food items (step83). In this case, the list of food items may be directly transmitted from the refrigerator50to the terminal device10, or may be transmitted through the server30according to embodiments.

However, according to embodiments, the terminal device10may obtain information on a food item to be cooked by directly receiving a food item inputted from a user through the inputter121, or processing an image of the food item captured through the imaging device110, or receiving the food item information from the cooking apparatus20.

That is, according to embodiments, the terminal device10may obtain information on the food item to be cooked from the user through the inputter121.

According to embodiments, the terminal device10may obtain the food item information based on image data of the food item obtained through the imaging device110. In this case, the controller130may obtain the food item information by identifying what the food item is or by identifying an identifier displayed on a container of the food item through the image processing.

That is, a user inputs the food item information through the inputter121or images the food item through the imaging device110. Accordingly, the user can allow the terminal device10to obtain the food item information.

Further, according to embodiments, the terminal device10may obtain the food item information by receiving the food item information from the cooking apparatus20. The cooking apparatus20may obtain the food item information based on a user input through the inputter221or image data acquisition through the imaging device210.

That is, a user inputs the food item information through the inputter221of the cooking apparatus20or places the food item to the cooking chamber23. Accordingly, the user can allow the terminal device10to obtain the food item information.

The terminal device10according to one embodiment may transmit the food item information to the server30(step84). The server30may determine arrangement information and recipe information based on the food item information (step85), and transmit the arrangement information to the terminal device10(step86-1), and transmit the recipe information to the cooking apparatus20(step86-2).

In this case, the server30may store the correlation between the food item and the recommended cooking zone as table information, and determine the arrangement information corresponding to the food item information. Further, the server30may store the correlation between the food item and the recipe as table information and determine the recipe information corresponding to the food item information.

However, according to embodiments, the server30may determine the arrangement information and the recipe information using an artificial neural network. Particularly, the server30may input the food item information into the artificial neural network and obtain the arrangement information and the recipe information as output data. In this case, the artificial neural network may use cooking zone setting data according to a food item and recipe setting data according to a food item, which are received from a plurality of terminal devices or a plurality of cooking apparatus connected to the server30, as training data. That is, because the artificial neural network is trained by using data, which is set by a user through various devices connected to the server30, as training data, the artificial neural network may determine the arrangement information and the recipe information optimized for the food item.

According to embodiments, in response to the recipe information being stored as the table information, the server30may determine the recipe information, which is stored as the table information, rather than the recipe information output by the neural network, as the recipe information corresponding to the food item information, and transmit the recipe information.

Thereafter, the controller130may determine a recommended cooking zone of the food item based on the arrangement information (step87), and control the user interface120to display an AR image of the food item superimposed on a recommended cooking zone among the plurality of cooking zones200of the cooking apparatus20(step88). In this case, the cooking apparatus20may control the heat source260configured to heat the recommended cooking zone based on the recipe information.

That is, in response to obtaining the food item information, to be cooked, the controller130may determine a recommended cooking zone corresponding to the food item among the plurality of cooking zones200of the cooking apparatus20, and control the user interface120to display the AR image of the food item820superimposed on the image of the cooking apparatus20so as to allow the AR image of the food item820to be displayed on the recommended cooking zone.

However, according to embodiments, the controller130may determine the recommended cooking zone of the food item based on the pre-stored arrangement information in the storage150without a request for the arrangement information to the server30. In addition, according to embodiments, the cooking apparatus20may also control the heat source260based on the pre-stored recipe information in the storage250without a request for the recipe information to the server30.

In response to the plurality of food items, the controller130may control the user interface120to display an AR image of each of the plurality of food items superimposed on the recommended cooking zone with the image of the cooking apparatus20. That is, in response to the food item, to be cooked, being provided in plurality, the controller130may determine a recommended cooking zone corresponding to each of the plurality of food items, and control the user interface120to display the AR image of each of the plurality of food items superimposed on the image of the cooking apparatus20so as to allow the AR image of each of the plurality of food items to be displayed on a corresponding recommended cooking zone.

The controller130may configure the AR image of the food item820in the form of the food item to allow a user to identify the AR image as the food item.

In addition, in response to obtaining the food item information, the controller130may determine the recommended cooking zone of the corresponding food item by using the arrangement information of the food item corresponding to the obtained food item information among the arrangement information stored in the storage150. However, in response to the arrangement information of the food item not being stored, the controller130may request the arrangement information on the food item to the server30, and determine the recommended cooking zone of the food item based on the arrangement information received from the server30.

For example, in response to an image, which is captured through the imaging device110, corresponding to the cooking chamber image800, and in response to obtaining the food item information, such as meat, vegetables, and instant rice, from a user, the terminal device10may determine a recommended cooking zone corresponding to each food item based on the arrangement information. Particularly, the controller130may determine the first cooking zone201as a recommended cooking zone for meat, determine the second cooking zone202as a recommended cooking zone for vegetables, and determine the third cooking zone203as a recommended cooking zone for instant rice. That is, based on the arrangement information, the controller130may determine the first cooking zone201that provides a relatively more heat energy, as the recommended cooking zone for meat, determine the second cooking zone202that provides a relatively less heat energy, as the recommended cooking zone for vegetables, and determine the third cooking zone203that provides a relatively high frequency, as the recommended cooking zone for instant rice.

Thereafter, as illustrated inFIG.8B, the terminal device10may display an AR image of meat821, an AR image of vegetables822, and an AR image of instant rice823superimposed on a corresponding recommended cooking zone with the cooking chamber image800. Particularly, the terminal device10may display the AR image of meat821superimposed on the first cooking zone201, display the AR image of vegetables822superimposed on the second cooking zone202, and display the AR image of instant rice823superimposed on the third cooking zone203.

That is, by imaging the cooking chamber23of the cooking apparatus20through the imaging device110of the terminal device10, a user receives the arrangement position of the food item in the cooking chamber23in the augmented reality (AR) manner. Accordingly, the user can more intuitively recognize the recommended cooking zones of meat, vegetables, and instant rice to be cooked, and finally, the cooking efficiency of each of meat, vegetables, and instant rice may be increased.

In addition, the controller130according to one embodiment may control the user interface120to display an AR image representing each of the plurality of cooking zones of the cooking apparatus20superimposed on the image of the cooking apparatus20. As illustrated inFIG.8B, the terminal device10may display a circle icon, including an identification number, representing AR images801,802, and803representing each of the plurality of cooking zones201,202, and203. However, the AR image representing the cooking zone is not limited to the above example, and a type of an AR image may vary as long as a user can distinguish each cooking zone.

Particularly, the terminal device10may display the first AR image801, representing the first cooking zone201, superimposed on the first cooking zone201, display the second AR image802, representing the second cooking zone202, superimposed on the second cooking zone202, and the third AR image803, representing the third cooking zone203, superimposed on the third cooking zone203. Accordingly, a user can more efficiently identify each of the plurality of cooking zones200.

In addition, the controller130according to one embodiment may control the user interface120to further display a message850guiding the recommended cooking zone of each food item. For example, the terminal device10may further display the message850for placing meat to the first cooking zone201, placing vegetables to the second cooking zone202, and placing instant rice to the third cooking zone203.

In addition, in response to an image, captured through the imaging device110, corresponding to a shelf image900, and in response to obtaining the food item information, such as meat and vegetables, from a user, the terminal device10may determine a recommended cooking zone corresponding to each food item based on the arrangement information. Particularly, the controller130may determine the first cooking zone201as a recommended cooking zone for meat and determine the second cooking zone202as a recommended cooking zone for vegetables.

Thereafter, as illustrated inFIG.8C, the terminal device10may display the AR image of meat821and the AR image of vegetables822superimposed on a corresponding recommended cooking zone with the shelf image900. Particularly, the terminal device10may display the AR image of meat821superimposed on the first cooking zone201, and display the AR image of vegetables822superimposed on the second cooking zone202.

That is, by imaging the shelf25, which is separated from the cooking chamber23and located outside the cooking apparatus20, through the imaging device110of the terminal device10, a user may receive an arrangement position of the food item in the AR manner. Accordingly, the user can more intuitively recognize the recommended cooking zone of food items to be cooked, and finally, the cooking efficiency of each of food items may be increased.

Further, even when the terminal device10images the shelf image900through the imaging device110, the terminal device10may further display the AR images801and802representing the plurality of cooking zones201and202, and further display the message850guiding the recommended cooking zone of each of food item according to embodiments, as illustrated inFIG.8C.

In response to the food item including a plurality of ingredients, the controller130may control the user interface120to display an AR image of each of the plurality of ingredients superimposed on a corresponding recommended cooking zone with the image of the cooking apparatus20.

For example, as illustrated inFIG.8D, in response to a food item corresponding to a steak meal kit including ingredients such as meat, vegetables, and mushrooms, the terminal device10may determine the first cooking zone201as a recommended cooking zone for meat, the second cooking zone202as a recommended cooking zone for vegetables, and the third cooking zone203as a recommended cooking zone for mushrooms.

The terminal device10may display an AR image of meat821, an AR image of vegetables822and an AR image of mushrooms823to be superposed on a corresponding cooking zone with the cooking chamber image800. Particularly, the terminal device10may display the AR image of meat821superimposed on the first cooking zone201, display the AR image of vegetables822superimposed on the second cooking zone202, and the AR image of mushrooms823superimposed on the third cooking zone203.

As mentioned above, in response to a selection of a food item (for example, a meal kit and HMR) including a plurality of ingredients, by a user, the AR image of each of the plurality of ingredients may be displayed superimposed on the corresponding cooking zone. Accordingly, the user can more intuitively recognize the cooking zone and it is possible to efficiently cook the plurality of ingredients of the food item, at one time.

Hereinafter a state, in which the image captured through the imaging device110is the cooking chamber image800, will be described as an example, but the described technical feature may be applied to a state in which an image captured through the imaging device110is the shelf image900.

FIG.9Ais a signal flow diagram illustrating a state in which the terminal device according to one embodiment of the present disclosure obtains food item information according to a selection of a meal, andFIG.9Bis a view illustrating a state in which the terminal device according to one embodiment of the present disclosure displays an AR image of a plurality of food items forming a meal with an image of the cooking chamber as a background.

Referring toFIG.9A, the refrigerator50according to one embodiment may transmit a list of food items stored in the storage compartment to the server30(step91). The server30may determine a list of meals that are made with the food items in the list (step92). In this case, the server30may determine the list of meals based on table information indicating the correlation between the food item and the meal, or may determine the list of meals using an artificial neural network. Particularly, the server30may input the list of food items into the artificial neural network and obtain the list of meals, as output data. In this case, the artificial neural network may use setting meal data, which is according to the food item and received from a plurality of terminal devices or a plurality of cooking apparatus connected to the server30, as training data. That is, because the artificial neural network is trained by using data, which is set by a user through various devices connected to the server30, as training data, the artificial neural network may determine the list of meals that are made with the food item.

Thereafter, the server30may transmit the list of meals to the terminal device10(step93). The terminal device10may display the list of meals (step94), receive a user selection for a meal in the list of meals (step95), and determine a food item for the selected meal (step96), thereby obtaining information on the food item. In this case, the terminal device10may determine the food item required to make the meal using table information indicating the correlation between the food item and the meal, and according embodiments, the terminal device10may receive information on the food item that is required to make the meal, from the server30.

However, according to embodiments, the terminal device10may directly receive a meal from a user through the inputter121, and may obtain the food item information by determining the food item required to make the selected meal.

The terminal device10according to one embodiment may transmit the food item information to the server30(step97). The server30may determine arrangement information and recipe information based on the food item information (step98), and transmit the arrangement information to the terminal device10(step99-1), and transmit the recipe information to the cooking apparatus20(step99-2).

In this case, the server30may store the correlation between the food item and the recommended cooking zone as table information, and determine the arrangement information corresponding to the food item information. Further, the server30may store the correlation between the food item and the recipe as table information and determine the recipe information corresponding to the food item information.

However, according to embodiments, the server30may determine the arrangement information and the recipe information using an artificial neural network. Particularly, the server30may input the food item information into the artificial neural network and obtain the arrangement information and the recipe information as output data. In this case, the artificial neural network may use cooking zone setting data according to the food item and recipe setting data according to the food item, which are received from a plurality of terminal devices or a plurality of cooking apparatus connected to the server30, as training data. That is, because the artificial neural network is trained by using data, which is set by a user through various devices connected to the server30, as training data, the artificial neural network may determine the arrangement information and the recipe information optimized for the food item.

Thereafter, the controller130may determine a recommended cooking zone of the food item based on the arrangement information, and control the user interface120to display an AR image of the food item superimposed on a recommended cooking zone among the plurality of cooking zones200of the cooking apparatus20(88). In this case, the cooking apparatus20may control the heat source260to heat the recommended cooking zone based on the recipe information.

That is, in response to obtaining the food item information, to be cooked, the controller130may determine a recommended cooking zone corresponding to the food item among the plurality of cooking zones200of the cooking apparatus20, and control the user interface120to display the AR image of the food item820superimposed on the image of the cooking apparatus20so as to allow the AR image of the food item820to be displayed on the recommended cooking zone.

However, according to embodiments, the controller130may determine the recommended cooking zone of the food item based on the pre-stored arrangement information in the storage150without a request for the arrangement information to the server30. In addition, according to embodiments, the cooking apparatus20may also control the heat source260based on the pre-stored recipe information in the storage250without a request for the recipe information to the server30.

For example, as illustrated inFIG.9B, in response to the meal selected by a user, corresponding to a steak, the terminal device10may determine meat, vegetables, and mushrooms as food items for the steak, and display an AR image of each of the food items superimposed on a corresponding recommended cooking zone with the image of the cooking apparatus20. That is, based on the arrangement information, the terminal device10may determine the first cooking zone201as a recommended cooking zone for meat, the second cooking zone202as a recommended cooking zone for vegetables, and the third cooking zone203as a recommended cooking zone for mushrooms.

The terminal device10may display an AR image of meat821, an AR image of vegetables822and an AR image of mushrooms823to be superposed on a corresponding cooking zone with the cooking chamber image800. Particularly, the terminal device10may display the AR image of meat821superimposed on the first cooking zone201, display the AR image of vegetables822superimposed on the second cooking zone202, and the AR image of mushrooms823superimposed on the third cooking zone203.

As mentioned above, the terminal device10may receive the list of meals, which are made with the stored food item, from the server30. In response to a selection of a meal to be made, the terminal device10may display an AR image of each of the food items, which are required to make the meal, superimposed on the recommended cooking zone. Therefore, a user can more intuitively recognize the cooking zone and efficiently cook the plurality of food items at once, thereby easily making the meal.

FIG.10is a view illustrating a state in which the terminal device10according to one embodiment of the present disclosure determines an AR image of a food item820to display a cooking amount.

Referring toFIG.10, the controller130according to one embodiment may determine an AR image of food item820to display a recommended cooking amount of the food item. Particularly, the controller130may determine the AR image of the food item820to include the number or quantity of the food item corresponding to the recommended cooking amount.

In this case, the recommended cooking amount is a recommended cooking amount based on a single operation of the cooking apparatus20, and may be determined in consideration of the specific heat of each food item and a total amount of thermal energy provided by the cooking apparatus20.

For example, as illustrated inFIG.10, in response to obtaining food item information, such as dumplings, from a user, the terminal device10may determine a recommended cooking amount of dumplings as five pieces based on the arrangement information, and determine an AR image, including five dumplings corresponding to the recommended cooking amount, and display the AR image on a recommended cooking zone.

In this case, the terminal device10may use information on the correlation between the food item and the recommended cooking amount among the arrangement information stored in the storage150, and in response to the recommended cooking amount of the corresponding food item not being stored, the terminal device10may transmit a request for the corresponding information to the server30.

Further, according to embodiments, the controller130may control the user interface120to further display a message1050guiding the recommended cooking amount. For example, as illustrated inFIG.10, the terminal device10may further display the message1050guiding to arrange five dumplings.

That is, in response to the instant food, such as a meal kit or HMR, corresponding to the food item to be cooked, the terminal device10may intuitively inform a user of a recommended amount of food item to be cooked at once, through the AR image. In other words, the user can image the cooking apparatus20through the imaging device110of the terminal device10so as to receive an AR image indicating the amount of food item to be cooked once. Accordingly, the user can intuitively recognize the recommended amount of food item and finally, the cooking efficiency of the food item may be increased.

FIG.11Ais a view illustrating a state in which the terminal device10according to one embodiment of the present disclosure determines an AR image of a food item820to display an arrangement form, andFIG.11Bis a view illustrating a state in which the terminal device10according to one embodiment of the present disclosure enlarges and displays an AR image of a food item.

Referring toFIG.11A, the controller130according to one embodiment may determine an AR image of a food item to display a recommended arrangement form of the food item. Particularly, the controller130may determine a shape of the food item to correspond to the recommended arrangement form, and determine the AR image of the food item to include the determined shape of the food item.

For example, as illustrated inFIG.11A, in response to obtaining food item information, such as a fish, from a user, the terminal device10may determine a shape, in which a head of the fish faces a wall of the cooking chamber, as a recommended arrangement form of the fish based on the arrangement information, and determine the shape, in which the head faces the wall of the cooking chamber, as an AR image of the fish820. That is, the terminal device10may determine the shape, in which the head faces the wall of the cooking chamber, as the AR image of the fish820so as to allow a body of the fish to be arranged at a center of the cooking chamber23in which a thermal energy is transmitted more efficiently. The terminal device10may display the determined AR image of the fish820superimposed on the cooking chamber image800.

As another example, in response to obtaining food item information, such as a dumpling, from a user, the terminal device10may determine a shape, in which a flat bottom surface of the dumpling faces the bottom of the cooking zone, as the arrangement form, and determine the shape, in which the flat bottom surface faces the bottom of the cooking zone, as an AR image of the dumpling820.

In this case, the terminal device10may use information on the correlation between the food item and the recommended arrangement form among the arrangement information stored in the storage150, and in response to the recommended arrangement form of the corresponding food item not being stored, the terminal device10may transmit a request for the corresponding information to the server30, and receive the corresponding information.

Further, according to embodiments, the controller130may control the user interface120to further display a message1110guiding the recommended arrangement form. For example, as illustrated inFIG.11A, the terminal device10may further display the message1110guiding to arrange the head of the fish to face the wall of the cooking chamber23.

As mentioned above, the terminal device10may determine the arrangement form with a high cooking efficiency, as the AR image820of the food item and display the determined AR image820superimposed on the cooking chamber image800. Accordingly, a user can more intuitively recognize the recommended arrangement form of the food item, and finally, the cooking efficiency of the food item may be increased.

In addition, the terminal device10may control the user interface120to enlarge and display the AR image820of the food item based on the image, captured by the imaging device110, corresponding to an image of the recommended cooking zone.

For example, in response to the first cooking zone201, which corresponds to the recommended cooking zone of the fish, being captured through the terminal device10by a user, the terminal device10may display an image of the first cooking zone201, as illustrated inFIG.11B. In this case, the terminal device10may control the user interface120to display the AR image of the fish820, which is in the image that is captured through the imaging device110, to be enlarged in comparison with an image of an entire cooking zone.

That is, in response to a specific cooking zone being captured through the imaging device110by a user, the terminal device10may enlarge and display the AR image of the food item corresponding to the specific cooking zone. Accordingly, the user can more clearly recognize what food item is to be located in the corresponding cooking zone.

Further, according to embodiments, in response to a specific cooking zone being captured by a user, the terminal device10may further display a message1130indicating detailed information on a food item corresponding to the specific cooking zone. That is, the terminal device10may display detailed information on the food item corresponding to the recommended cooking zone based on the image, which is captured by the imaging device110, corresponding to an image of the recommended cooking zone.

For example, in response to the first cooking zone201being captured by a user, the terminal device10may further display a message1130indicating the detailed information of the fish corresponding to the first cooking zone201, as illustrated inFIG.11B. In this case, the message1130indicating the detailed information of the food item may include at least one of calories of the food item, an image before cooking the food item, an image after cooking the food item, and a recipe of the food item.

As mentioned above, in response to obtaining the food item information, the terminal device10may provide an optimal arrangement position for cooking the food item among the plurality of cooking zones of the cooking apparatus20, as an AR image of the food item, and further provide the cooking amount of the food item or the arrangement form of the food item, as an AR image. According to embodiments, on the display222, the cooking apparatus20may display an AR image of the food item820superimposed on the image of the cooking chamber23obtained through the imaging device210.

Hereinafter one embodiment, in which information, for increasing a cooking efficiency in relation to cooking of a food item, is provided to a user, will be described in detail.

FIG.12is a view illustrating a state in which the terminal device10according to one embodiment of the present disclosure outputs a notification regarding the arrangement of food item,FIG.13is a view illustrating a state in which the terminal device10according to one embodiment of the present disclosure displays a recommended food item that may be cooked simultaneously with the food item, andFIGS.14A and14Bare views illustrating a state in which the terminal device10according to one embodiment of the present disclosure displays a recommended meal using the food item.

Referring toFIG.12, the controller130according to one embodiment may control the user interface120to output a notification in response to a food item being arranged in a cooking zone other than the recommended cooking zone.

According to embodiments, the controller130may determine whether the food item is arranged in the recommended cooking zone or not, based on the image processing on the cooking chamber image800obtained by the imaging device110.

Further, according to embodiments, the controller130may receive information, indicating whether the food item is arranged in the recommended cooking zone, from the cooking apparatus20and determine whether the food item is arranged in the recommended cooking zone. In this case, the cooking apparatus20may obtain information indicating whether the food item is arranged in the recommended cooking zone, based on the processing of the image of the cooking chamber23obtained from the imaging device210.

According to embodiments, the terminal device10may obtain the cooking chamber image800obtained from the imaging device210of the cooking apparatus20and process the cooking chamber image800, thereby determining whether the food item is arranged in the recommended cooking zone.

In response to the food item being arranged in a cooking zone other than the recommended cooking zone, the terminal device10according to one embodiment may output a notification informing that the food item is misplaced.

For example, as illustrated inFIG.12, the terminal device10may control the display122to display a message1250informing that the food item is misplaced. However, the type of notification may include an icon in addition to the message, and the type of notification may vary as long as the type of notification may notify that the food item is misplaced.

Further, according to embodiments, the terminal device10may control the speaker123to output a sound notification indicating that the food item is misplaced.

Accordingly, a user may intuitively recognize that the food item is not placed in the recommended cooking zone, and by placing the food item to the recommended cooking zone, the cooking efficiency of the food item may be increased.

In this case, in response to the food item being arranged in the recommended cooking zone, the cooking apparatus20may control at least one heat source260corresponding to the recommended cooking zone to heat the recommended cooking zone based on the recipe for the food item.

In the same manner as the terminal device10, the cooking apparatus20may also control the user interface220to output a notification in response to the food item not being arranged in the recommended cooking zone.

According to embodiments, in response to the food item being arranged in a cooking zone other than the recommended cooking zone, the cooking apparatus20control at least one of the plurality of heat sources260to heat the cooking zone, in which the food item is placed, based on the recipe corresponding to the food item.

Referring toFIG.13, in response to obtaining food item information from a user, the controller130according to one embodiment may determine a recommended food item that may be cooked in a cooking zone other than a recommended cooking zone, and control the user interface120to display the recommended food item.

Particularly, the controller130may obtain the food item information and determine a recommended cooking zone for the obtained food item. In response to a cooking zone being present other than the recommended cooking zone among the plurality of cooking zones, the controller130may determine a recommended food item that may be cooked simultaneously with the obtained food item in the cooking zone other than the recommended cooking zone, and control the user interface120to display the recommended food item.

In this case, according to embodiments, the recommended food item may be a food highly related to the food item to be cooked, and information on the relation between the food item and the recommended food item may be stored in the storage150. For example, the recommended food item may be a food that is often cooked simultaneously with the food item or a food that is often added simultaneously with the food item to one meal menu. The information on the relation between the food item and the recommended food item may be set by a user through the inputter121or updated based on information received from the server30.

For example, in response to obtaining food item information, such as meat, from a user, the terminal device10may determine the first cooking zone201as a recommended cooking zone for meat. In this case, as illustrated inFIG.13, the terminal device10may determine a potato and a garlic as a recommended food item that is placed in each of the second cooking zone202and the third cooking zone203excluding the first cooking zone201among the plurality of cooking zones200, and display a message1350indicating that the recommended food item (potato) in the second cooking zone202and the recommended food item (garlic) in the third cooking zone203on the display122. Further, the terminal device10may control the speaker123to output a voice guiding the recommended food item.

Further, according to embodiments, the terminal device10may control the user interface120to display the AR image of the recommended food item superimposed on the corresponding cooking zone with the image of the cooking apparatus20. That is, as illustrated inFIG.13, the terminal device10may display an AR image of meat821superimposed on the first cooking zone201, an AR image of potato822superimposed on the second cooking zone202, and an AR image of garlic823superimposed on the third cooking zone203.

Accordingly, a user can intuitively recognize the food item that may be simultaneously cooked with the food item to be cooked, and by cooking the food item and the recommended food item at the same time, it is possible to reduce the cooking time while improving the completeness of the meal.

In the same manner as the terminal device10, the cooking apparatus20may determine a recommended food item and control the user interface220to output the recommended food item.

Referring toFIGS.14A and14B, in response to obtaining food item information from a user, the controller130according to one embodiment may determine a recommended meal that uses the food item as an ingredient, and control the user interface120to display the recommended meal.

Particularly, according to embodiments, the controller130may determine a recommended meal corresponding to the food item based on pre-stored information on the correlation between the food item and the recommended meal. Further, according to embodiments, the controller130may determine the recommended meal corresponding to the food item based on the information on the correlation between the food item and the recommended meal received from the server30. In this case, the server30may determine the recommended meal based on the table information indicating the correlation between the food item and the meal or determine the recommended meal using an artificial neural network. Particularly, the server30may input the food item information into the artificial neural network and obtain the recommended meal as output data. In this case, the artificial neural network may use setting meal data, which is according to the food item and received from a plurality of terminal devices or a plurality of cooking apparatus connected to the server30, as training data. That is, because the artificial neural network is trained by using data, which is set by a user through various devices connected to the server30, as training data, the artificial neural network may determine the recommended meal that is made with the food item.

Thereafter, the controller130may control the user interface120to output the determined recommended meal. That is, the controller130may control the display122to display the determined recommended meal, and may control the speaker123to output the determined recommended meal by voice.

For example, as illustrated inFIG.14A, in response to obtaining food item information, such as sausage, onion, and carrot, the terminal device10may determine a sausage vegetable stir-fry as the recommended meal, and display a message1450indicating that the sausage vegetable stir-fry is the recommended meal, on the display122.

Further, based on the arrangement information, the terminal device10may display an AR image of each of the plurality of food items superimposed on a corresponding recommended cooking zone with the image of the cooking apparatus20. That is, the terminal device10may determine the first cooking zone201as a recommended cooking zone for sausage, the second cooking zone202as a recommended cooking zone for onions, and the third cooking zone203as a recommended cooking zone for carrots.

Thereafter, the terminal device10may display an AR image of sausage821, an AR image of onion822, and an AR image of carrot823superimposed on each corresponding cooking zone with the cooking chamber image800. Particularly, the terminal device10may display the AR image of sausage821superimposed on the first cooking zone201, the AR image of onion822superimposed on the second cooking zone202, and the AR image of carrot823superimposed on the third cooking zone203.

In addition, in response to obtaining the food item information, the terminal device10may determine other food item that is required for the recommended meal while determining the recommended meal that is made with the food item, and the terminal device10may display an AR image of other food item superimposed on a corresponding cooking zone with the image of the cooking apparatus20.

For example, as illustrated inFIG.14B, in response to a food item, which is selected by a user, corresponding to a sausage, the terminal device10may determine a sausage vegetable stir-fry as a recommended meal, and determine an onion and a carrot as the recommended food item that is required for making the sausage vegetable stir-fry.

The terminal device10may display a message1470including a user-selected food item, a recommended meal, and a recommended food item required for the recommended meal, and may display an AR image of each of the user-selected food item and the recommended food item superimposed on a corresponding cooking zone with the image of the cooking apparatus20.

That is, the terminal device10may display the AR image of sausage821, the AR image of onion822, and the AR image of carrot823superimposed on each corresponding cooking zone with the cooking chamber image800. Particularly, the terminal device10may display the AR image of sausage821superimposed on the first cooking zone201, the AR image of onion822superimposed on the second cooking zone202, and the AR image of carrot823superimposed on the third cooking zone203.

In this case, the terminal device10may determine a food item required for the meal based on the table information indicating the correlation between the food item and the meal or according to embodiments, may receive information on the food item required for the meal, from the server30.

The server30may determine the food item required for making the meal, based on the table information indicating the correlation between the food item and the meal or determine the food item required for making the meal using an artificial neural network. Particularly, the server30may input the meal information into the artificial neural network and obtain information on the food item required for the meal, as output data. In this case, the artificial neural network may use setting meal data according to the food item, which is received from a plurality of terminal devices or a plurality of cooking apparatus connected to the server30, as training data. That is, because the artificial neural network is trained by using data, which is set by a user through various devices connected to the server30, as training data, the artificial neural network may determine the information on the food item required for making the meal.

Accordingly, a user can intuitively recognize a menu that may be completed with the food item to be cooked, and can experience a fresh menu by being provided with a more diverse menu.

In the same manner as the terminal device10, the cooking apparatus20may determine the recommended meal and control the user interface220to output the recommended meal.

Hereinafter one embodiment of the cooking apparatus20for guiding an arrangement position of a food item will be described.

FIG.15is a view illustrating a state in which the cooking apparatus20according to one embodiment of the present disclosure displays an arrangement position of a food item.

Referring toFIG.15, in response to obtaining the food item information, the controller230according to one embodiment may control the light emitter270to emit light to a recommended cooking zone among the plurality of cooking zones200of the cooking apparatus20.

According to embodiments, the controller230may obtain the food item information based on a user input inputted through the inputter221, and according to embodiments, the controller230may obtain the food item information by receiving the food item information from the terminal device10.

Further, according to embodiments, the controller230may process the image of the cooking chamber23obtained through the imaging device210so as to identify a food item located in the cooking chamber23, and to obtain information on the food item.

in response to obtaining the food item information, to be cooked, the controller230may determine a recommended cooking zone corresponding to the food item among the plurality of cooking zones200based on the arrangement information, and control the light emitter270to emit light to the recommended cooking zone.

A shape of light that is emitted to the cooking zone may be provided in a shape provided to identify the cooking zone, such as a figure of a predetermined shape or a number indicating the number of the cooking zone, according to embodiments.

The controller230may determine the recommended cooking zone corresponding to the food item based on the arrangement information stored in the storage250or the controller230may determine the recommended cooking zone corresponding to the food item based on the arrangement information received from the server30.

As mentioned above, by displaying the recommended cooking zone of the food item through light emission, the cooking apparatus20may guide a user to more intuitively arrange the food item.

In addition, in response to the food item being provided in plurality, the controller230may control the light emitter270to emit light having a different shape for each recommended cooking zone of each of the plurality of food items. That is, in response to the plurality of food items to be cooked, the controller230may determine a recommended cooking zone corresponding to each of the plurality of food items, and control the light emitter270to emit light having a different shape for each recommended cooking zone corresponding to each of the plurality of food items.

For example, as illustrated inFIG.15, in response to the each of the first cooking zone201and the second cooking zone202being determined as a recommended cooking zone for different food items, the cooking apparatus20may control the light emitter270to emit light1511in a rectangular shape to the first cooking zone201and to emit light1512in a triangular shape to the second cooking zone202.

According to embodiments, the controller230may control the light emitter270to emit light in a shape of a food item corresponding to each recommended cooking zone.

Accordingly, a user can intuitively recognize the plurality of recommended cooking zones, and the user can place a food item to the plurality of recommended cooking zones, thereby increasing the cooking efficiency.

According to embodiments, in response to obtaining the food item information, the controller230may transmit a notification requesting for imaging the cooking apparatus20by the terminal device10, to the terminal device10. According to embodiments, in response to obtaining the food item information, the controller230may control the user interface220to display a notification requesting for imaging the cooking apparatus20by the terminal device10.

Accordingly, a user can receive an AR image of the food item by imaging the cooking apparatus20through the terminal device10, and place the food item to the recommended cooking zone, thereby increasing the cooking efficiency.

FIG.16is a view illustrating a state in which the cooking apparatus20according to one embodiment of the present disclosure determines a recipe through an identifier of a food item, andFIG.17is a view illustrating a state in which the cooking apparatus20according to one embodiment of the present disclosure determines a recipe for a plurality of food items.

Referring toFIG.16, in response to a food item1610being arranged in a recommended cooking zone, the controller230according to one embodiment may control at least one of the plurality of heat sources260to heat the recommended cooking zone based on a recipe corresponding to the food item1610.

In this case, the recipe may include information on a cooking temperature and a cooking time corresponding to the food item. In other words, the recipe may include at least one of a cooking temperature, a cooking time, or an output of the heat source260as a cooking parameter for the operation of the heat source260. In this case, as for the recipe, information on the recipe for each food item may be pre-stored in the storage250. Further, the recipe to be applied to each cooking zone may be determined based on a user input.

The controller230according to one embodiment may identify the food item1610based on the image processing of the image of the cooking chamber23obtained through the imaging device210, and may determine a recipe for the food item1610.

Particularly, the controller230may identify the food item1610based on an image of an identifier1615of the food item1610that is included in the image of the cooking chamber23and determine the recipe for the food item1610. In this case, the identifier1615of the food item1610may be displayed on a container of the food item1610, and may be provided as a QR code, a barcode, an icon, or the like. In response to the recipe, corresponding to the identified food item1610, being stored, the controller230may control the heat source260based on the stored recipe or the controller230may control the heat source260by receiving the recipe, corresponding to the identified food item1610, from the server30.

Referring toFIG.17, in response to a plurality of food items, the controller230according to one embodiment may identify each of the plurality of food items1710and1720based on an image of an identifier1715and1725of each of the plurality of food items1710and1720and determine a recipe for each of the plurality of food items1710and1720.

In this case, the controller230may determine the recipe for each recommended cooking zone of the plurality of food items1710and1720based on the recipe for each of the plurality of food items1710and1720.

For example, the controller230may change at least one of a cooking time or a cooking temperature included in each of a first recipe of the first food item1710and a second recipe of the second food item1720, and determine the changed first recipe as a recipe of the first cooking zone201corresponding a recommended cooking zone of the first food item1710, and determine the changed second recipe as a recipe of the second cooking zone202corresponding a recommended cooking zone of the second food item1720.

The change of the first recipe may be performed according to the second recipe that is selected about other cooking zone, and the storage250may store at least one of program, algorithm or application configured to perform change or modification of a recipe that is performed in response to the plurality of food items.

Thereafter, the controller230may control at least one of the plurality of heat sources260to heat each recommended cooking zone based on the determined recipe for each recommended cooking zone.

Hereinafter one embodiment of a control method of the terminal device10and the cooking apparatus20according to an aspect will be described. The terminal device10and the cooking apparatus20according to the above-described embodiment may be used for the control method of the terminal device10and the cooking apparatus20. Accordingly, the contents described above with reference toFIGS.1to17may be equally applied to the control method of the terminal device10and the cooking apparatus20.

FIG.18is a flowchart illustrating a state of displaying an AR image of a food item in a control method of the terminal device10according to one embodiment of the present disclosure.

Referring toFIG.18, the terminal device10according to one embodiment may obtain information on a food item (step1810).

According to embodiments, the terminal device10may obtain information on the food item, to be cooked, from a user through the inputter121.

Further, according to embodiments, the terminal device10may obtain the food item information based on image data of the food item obtained through the imaging device110. In this case, the controller130may obtain the food item information by identifying what the food item is or by identifying an identifier displayed on a container of the food item through the image processing.

That is, a user inputs the food item information through the inputter121or images the food item through the imaging device110to allow the terminal device10to obtain the food item information.

According to embodiments, the terminal device10may obtain the food item information by receiving the food item information from the cooking apparatus20. The cooking apparatus20may obtain the food item information based on a user input through the inputter221or image data acquisition through the imaging device210.

That is, a user inputs the food item information through the inputter221of the cooking apparatus20or places the food item to the cooking chamber23. Accordingly, the user can allow the terminal device10to obtain the food item information.

Further, according to embodiments, the controller130may receive a list of food items stored in the refrigerator50from the server30or the refrigerator50, and display the list of food items. Accordingly, the controller130may receive a user selection for at least one food item in the list of food items, thereby obtaining information on the food item to be cooked.

Further, according to embodiments, the controller130may receive a list of meals, which may be made with food items stored in the refrigerator50, from the server30. The controller130may display the list of meals to receive a user selection for a single meal in the list and determine a food item that is required for the selected meal, thereby obtaining information of the food item to be cooked. In this case, the terminal device10may determine the food item required for the meal by using the pre-stored correlation information between the meal and the food item, or by receiving the information on the food item required for making the meal, from the server30.

The terminal device10according to one embodiment may determine a recommended cooking zone corresponding to the food item among the plurality of cooking zones of the cooking apparatus20(step1820).

That is, in response to obtaining the food item information, the controller130may determine the recommended cooking zone of the corresponding food item by using the arrangement information of the food item corresponding to the obtained food item information among the arrangement information stored in the storage150. However, in response to the arrangement information of the food item not being stored, the controller130may request the arrangement information on the food item to the server30, and determine the recommended cooking zone of the food item based on the arrangement information received from the server30.

In response to the cooking chamber23being captured by the imaging device110(yes in step1830), the terminal device10according to one embodiment may display an AR image of a food item superimposed on a recommended cooking zone with the image of the cooking chamber23(step1840).

In addition, in response to the shelf25being captured by the imaging device110(yes in step1850), the terminal device10according to one embodiment may display an AR image of a food item superimposed on a recommended cooking zone with the image of the shelf25(step1860).

That is, in response to obtaining the food item information, to be cooked, the controller130may determine a recommended cooking zone corresponding to the food item, among the plurality of cooking zones200of the cooking apparatus20, and the controller130may control the user interface120to display an AR image of the food item820superimposed on the image of the cooking apparatus20so as to allow the AR image of the food item820to be displayed on the recommended cooking zone.

In response to the plurality of food items, the controller130may control the user interface120to display an AR image of each of the plurality of food items superimposed on the recommended cooking zone with the image of the cooking apparatus20. That is, in response to the food item, to be cooked, being provided in plurality, the controller130may determine a recommended cooking zone corresponding to each of the plurality of food items, and control the user interface120to display the AR image of each of the plurality of food items superimposed on the image of the cooking apparatus20so as to allow the AR image of each of the plurality of food items to be displayed in a corresponding recommended cooking zone.

For example, in response to the food item including a plurality of ingredients, such as a meal kit or HMR, the controller130may control the user interface120to display an AR image of each of the plurality of ingredients superimposed on a corresponding recommended cooking zone with the image of the cooking apparatus20.

In this case, the controller130may configure an AR image of a food item in the form of the food item so as to allow a user to identify the AR image as the food item.

That is, by imaging the cooking apparatus20through the imaging device110of the terminal device10, a user receives an arrangement position of the food item in the plurality of cooking zones, in the AR manner. Accordingly, the user can more intuitively recognize the recommended cooking zones of the food item to be cooked, and finally, the cooking efficiency of each of food items may be increased.

FIG.19is a flowchart illustrating a state of determining an AR image of a food item to display a recommended cooking amount in the control method of the terminal device10according to one embodiment of the present disclosure.

Referring toFIG.19, the terminal device10according to one embodiment may obtain information on a food item (step1910), and in response to information on a recommended cooking amount of the food item being stored (yes in step1920), the terminal device10may determine an AR image of the food item to display the recommended cooking amount of the food item (step1940).

In response to information on the recommended cooking amount of the food item not being stored (no in step1920), the terminal device10according to one embodiment may receive information on the recommended cooking amount of the food item from the server30(step1930), and determine an AR image of the food item to display the recommended cooking amount of food item based on the received information (step1940).

Particularly, the controller130may use information on the correlation between the food item and the recommended cooking amount among the arrangement information stored in the storage150. Alternatively, in response to information on the recommended cooking amount on the corresponding food item not being stored, the controller130may request the corresponding information to the server30and receive the corresponding information from the server30. Thereafter, the controller130may determine the AR image of the food item820to include the number or quantity of the food item corresponding to the recommended cooking amount, based on the information on the recommended cooking amount of the food item.

In this case, the recommended cooking amount is a recommended cooking amount based on a single operation of the cooking apparatus20, and may be determined in consideration of the specific heat of each food item and a total amount of thermal energy provided by the cooking apparatus20.

The terminal device10according to one embodiment may display the AR image of the food item superimposed on the image of the cooking apparatus20(step1950).

That is, in response to the instant food, such as a meal kit or HMR, corresponding to the food item to be cooked, the terminal device10may intuitively inform a user of a recommended amount of food item to be cooked at one time through the AR image. In other words, because the user receives the AR image indicating the amount of food item to be cooked at one time, by imaging the cooking apparatus20through the imaging device110of the terminal device10, the user can intuitively recognize the recommended amount of food item and finally, the cooking efficiency of the food item may be increased.

FIG.20is a flowchart illustrating a state of determining an AR image of a food item to display a recommended arrangement in the control method of the terminal device10according to one embodiment of the present disclosure.

Referring toFIG.20, the terminal device10according to one embodiment may obtain information on a food item (step2010), and in response to information on a recommended arrangement form of a food item being stored (yes in step2020), the terminal device10may determine an AR image of the food item to display the recommended arrangement form of the food item (step2040).

In addition, in response to information on the recommended arrangement form of the food item not being stored (no in step2020), the terminal device10may receive the information on the recommended arrangement form of the food item from the server30(step2030), and determine an AR image of the food item to display the recommended arrangement form of the food item based on the received information (step2040).

That is, the controller130may determine the AR image of the food item to display the recommended arrangement form of the food item. Particularly, the controller130may determine the shape of the food item to correspond to the recommended arrangement form, and determine the AR image of the food item to include the determined shape of the food item. In this case, the controller130may use information on the correlation between the food item and the recommended arrangement form among the arrangement information stored in the storage150, and in response to the recommended arrangement form information on the corresponding food item the food not being stored, the controller130may request the corresponding information to the server30and receive the corresponding information from the server30.

The terminal device10according to one embodiment may display the AR image of the food item superimposed on the image of the cooking apparatus20(step2050).

As mentioned above, the terminal device10may determine the AR image of the food item820in the arrangement form with the high cooking efficiency, and by displaying the determined AR image820superimposed on the cooking chamber image800, a user can more intuitively recognize the recommended arrangement form of the food item. Accordingly, the user can place the food item to a form with the high cooking efficiency, and finally, the cooking efficiency of the food item may be increased.

FIG.21is a flowchart illustrating a state of outputting a notification in the control method of the terminal device10according to one embodiment of the present disclosure.

Referring toFIG.21, the terminal device10according to one embodiment may display an AR image of food item superimposed on a recommended cooking zone with the image of the cooking apparatus20(step2110).

In response to determining that the food item not is arranged in the recommended cooking zone (no in step2120), the terminal device10according to one embodiment may control the user interface120to output a notification (step2130).

In response to determining that the food item is arranged in a cooking zone other than the recommended cooking zone, the controller130may control the user interface120to output a notification.

According to embodiments, the controller130may determine whether the food item is arranged in the recommended cooking zone, through the image processing on the cooking chamber image800obtained through the imaging device110.

Further, according to embodiments, the controller130may receive information, indicating whether the food item is arranged in the recommended cooking zone, from the cooking apparatus20and determine whether the food item is arranged in the recommended cooking zone. In this case, the cooking apparatus20may obtain information indicating whether the food item is arranged in the recommended cooking zone, based on the processing of the image of the cooking chamber23obtained from the imaging device210.

According to embodiments, the terminal device10may obtain the cooking chamber image800obtained from the imaging device210of the cooking apparatus20and process the cooking chamber image800, thereby determining whether the food item is arranged in the recommended cooking zone.

Accordingly, a user may intuitively recognize that the food item is not placed in the recommended cooking zone, and by placing the food item to the recommended cooking zone, the cooking efficiency of the food item may be increased.

In this case, in response to determining the food item is arranged in the recommended cooking zone, the cooking apparatus20may control at least one heat source260corresponding to the recommended cooking zone to heat the recommended cooking zone based on the recipe for the food item.

FIG.22is a flowchart illustrating a state of outputting a recommended food item in the control method of the terminal device10according to one embodiment of the present disclosure.

Referring toFIG.22, the terminal device10according to one embodiment may obtain information on a food item (2210), and determine a recommended cooking zone corresponding to the food item among the plurality of cooking zones of the cooking apparatus20(2220).

The terminal device10according to one embodiment may determine a recommended food item that may be cooked in a cooking zone other than the recommended cooking zone (2230), and may control the user interface120to display the recommended food item (2240).

Particularly, the controller130may obtain the food item information and determine a recommended cooking zone for the obtained food item. In response to a cooking zone being present other than the recommended cooking zone among the plurality of cooking zones, the controller130may determine a recommended food item that may be cooked simultaneously with the obtained food item in the cooking zone other than the recommended cooking zone, and control the user interface120to display the recommended food item.

According to embodiments, the controller130may control the user interface120to display the AR image of the recommended food item superimposed on the corresponding cooking zone.

In this case, according to embodiments, the recommended food item may be a food highly related to the food item to be cooked, and information on the relation between the food item and the recommended food item may be stored in the storage150. For example, the recommended food item may be a food that is often cooked simultaneously with the food item or a food that is often added simultaneously with the food item to one meal menu. The information on the relation between the food item and the recommended food item may be set by the user through the inputter121or updated based on information received from the server30.

Accordingly, a user can intuitively recognize a food that may be simultaneously cooked with the food item to be cooked, and by cooking the food item and the recommended food item at the same time, it is possible to reduce the cooking time while improving the completeness of the meal.

FIG.23is a flowchart illustrating a state of outputting a recommended meal in the control method of the terminal device10according to one embodiment of the present disclosure.

Referring toFIG.23, the terminal device10according to one embodiment may obtain information on a food item (2310), determine a recommended meal that uses the food item as an ingredient (2320), and control the user interface120to display the recommended meal (2330).

Particularly, according to embodiments, the controller130may determine a recommended meal corresponding to the food item based on the pre-stored information on the correlation between the food item and the recommended meal. Further according to embodiments, the controller130may determine the recommended meal corresponding to the food item based on the information on the correlation between the food item and the recommended meal received from the server30.

Thereafter, the controller130may control the user interface120to output the determined recommended meal. That is, the controller130may control the display122to display the determined recommended meal, and may control the speaker123to output the determined recommended meal by voice.

In addition, according to embodiments, the controller130may determine other food item that is required for making the recommended meal and the controller130may display an AR image of other food item superimposed on a corresponding cooking zone.

Accordingly, a user can intuitively recognize a menu that may be completed with the food item to be cooked, and can experience a fresh menu by being provided with a more diverse menu.

FIG.24is a flowchart illustrating a state of guiding an arrangement of a food item in a control method of the cooking apparatus20according to one embodiment of the present disclosure.

Referring toFIG.24, the cooking apparatus20according to one embodiment may obtain information on a food item (2410), and determine a recommended cooking zone corresponding to the food item among the plurality of cooking zones of the cooking apparatus20(2420), and control the light emitter270to emit light to the recommended cooking zone (2430).

A shape of light that is emitted to the cooking zone may be provided in a shape provided to identify the cooking zone, such as a figure of a predetermined shape or a number indicating the number of the cooking zone, according to embodiments.

The controller230may determine a recommended cooking zone corresponding to the food item based on the arrangement information stored in the storage250or the controller230may determine a recommended cooking zone corresponding to the food item based on the arrangement information received from the server30.

As mentioned above, by displaying the recommended cooking zone of the food item through light emission, the cooking apparatus20may guide a user to more intuitively arrange the food item.

In addition, in response to the plurality of food items, the controller230may control the light emitter270to emit light having a different shape for each recommended cooking zone of each of the plurality of food items. That is, in response to the plurality of food items, the controller230may determine a recommended cooking zone corresponding to each of the plurality of food items, and control the light emitter270to emit light having a different shape for each recommended cooking zone corresponding to each of the plurality of food items.

Accordingly, a user can intuitively recognize the plurality of recommended cooking zones, and the user can place a food item to the plurality of recommended cooking zones, thereby increasing the cooking efficiency.

In response to determining that the food item is arranged in the recommended cooking zone (yes in2440), the cooking apparatus20according to one embodiment may control the corresponding heat source260to heat the recommended cooking zone based on a recipe corresponding to the food item (2450).

In response to determining that the food item is not arranged in the recommended cooking zone (no in2440), the cooking apparatus20according to one embodiment may control the corresponding heat source260to heat a cooking zone, in which the food item is placed, based on a recipe corresponding to the food item (2460).

FIG.25is a flowchart illustrating a state of determining a recipe corresponding to a food item in the control method of the cooking apparatus20according to one embodiment of the present disclosure.

Referring toFIG.25, the cooking apparatus20according to one embodiment may obtain an image of an identifier of a food item through the imaging device210(2510), and the cooking apparatus20may receive a recipe of the food item from the server30based on the image of the identifier of the food item (2520).

In response to the plurality of food items (yes in2530), the cooking apparatus20according to one embodiment may determine a recipe for each cooking zone corresponding to each of the plurality of food items based on the recipes of each of the plurality of food items (2540), and control the heat source260to heat a cooking zone corresponding to each of the plurality of food items based on the determined recipe (2550).

In addition, in response to a single food item (no in2530), the cooking apparatus20according to one embodiment may control the heat source260to heat a cooking zone corresponding to the food item based on the received recipe.

Particularly, the controller230may identify the food item1610based on an image of an identifier1615of the food item1610that is included in the image of the cooking chamber23and determine the recipe for the food item1610. In this case, the identifier1615of the food item1610may be displayed on a container of the food item1610, and may be provided as a QR code, a barcode, an icon, or the like. In response to the recipe, corresponding to the identified food item1610, being stored, the controller230may control the heat source260based on the stored recipe or the controller230may control the heat source260by receiving the recipe, corresponding to the identified food item1610, from the server30.

In this case, the recipe may include information on a cooking temperature and a cooking time corresponding to the food item. In other words, the recipe may include at least one of a cooking temperature, a cooking time, or an output of the heat source260as a cooking parameter for the operation of the heat source260. In this case, as for the recipe, information on the recipe for each food item may be pre-stored in the storage250. Further, the recipe to be applied to each cooking zone may be determined based on a user input or the recipe may be received from the server30.

In response to a plurality of food items, the controller230according to one embodiment may identify each of the plurality of food items1710and1720based on an image of an identifier1715and1725of each of the plurality of food items1710and1720, and determine a recipe for each of the plurality of food items1710and1720.

In this case, the controller230may determine the recipe for each recommended cooking zone of the plurality of food items1710and1720based on the recipe for each of the plurality of food items1710and1720.

Thereafter, the controller230may control at least one of the plurality of heat sources260to heat each recommended cooking zone based on the determined recipe for each recommended cooking zone.

Meanwhile, the disclosed embodiments may be embodied in the form of a recording medium storing instructions executable by a computer. The instructions may be stored in the form of program code and, when executed by a processor, may generate a program module to perform the operations of the disclosed embodiments. The recording medium may be embodied as a computer-read able recording medium.

The computer-readable recording medium includes all kinds of recording media in which instructions which can be decoded by a computer are stored. For example, there may be a Read Only Memory (ROM), a Random Access Memory (RAM), a magnetic tape, a magnetic disk a flash memory, and an optical data storage device.