Patent ID: 12256851

DETAILED DESCRIPTION

Hereinafter, example embodiments will be described in greater detail with reference to the accompanying drawings. When describing the example embodiments with reference to the accompanying drawings, like reference numerals refer to like elements and a repeated description related thereto may not be provided.

FIG.1is a block diagram illustrating an example electronic device101in a network environment100according to various example embodiments. Referring toFIG.1, the electronic device101in the network environment100may communicate with an electronic device102via a first network198(e.g., a short-range wireless communication network), or communicate with at least one of an electronic device104and a server108via a second network199(e.g., a long-range wireless communication network). According to an example embodiment, the electronic device101may communicate with the electronic device104via the server108. According to an example embodiment, the electronic device101may include a processor120, a memory130, an input module150, a sound output module155, a display module160, an audio module170, and a sensor module176, an interface177, a connecting terminal178, a haptic module179, a camera module180, a motor187, a power management module188, a battery189, a communication module190, a subscriber identification module (SIM)196, or an antenna module197. In various example embodiments, at least one of the components (e.g., the connecting terminal178) may be omitted from the electronic device101, or one or more other components may be added to the electronic device101. In various example embodiments, some of the components (e.g., the sensor module176, the camera module180, or the antenna module197) may be integrated as a single component (e.g., the display module160).

The processor120may execute, for example, software (e.g., a program140) to control at least one other component (e.g., a hardware or software component) of the electronic device101connected to the processor120and may perform various data processing or computations. According to an example embodiment, as at least a part of data processing or computations, the processor120may store a command or data received from another component (e.g., the sensor module176or the communication module190) in a volatile memory132, process the command or the data stored in the volatile memory132, and store resulting data in a non-volatile memory134. According to an example embodiment, the processor120may include a main processor121(e.g., a central processing unit (CPU) or an application processor (AP)), or an auxiliary processor123(e.g., a graphics processing unit (GPU), a neural processing unit (NPU), an image signal processor (ISP), a sensor hub processor, or a communication processor (CP)) that is operable independently from or in conjunction with the main processor121. For example, when the electronic device101includes the main processor121and the auxiliary processor123, the auxiliary processor123may be adapted to consume less power than the main processor121or to be specific to a specified function. The auxiliary processor123may be implemented separately from the main processor121or as a part of the main processor121.

The auxiliary processor123may control at least some of functions or states related to at least one (e.g., the display module160, the sensor module176, or the communication module190) of the components of the electronic device101, instead of the main processor121while the main processor121is in an inactive (e.g., sleep) state or along with the main processor121while the main processor121is an active state (e.g., executing an application). According to an example embodiment, the auxiliary processor123(e.g., an ISP or a CP) may be implemented as a portion of another component (e.g., the camera module180or the communication module190) that is functionally related to the auxiliary processor123. According to an example embodiment, the auxiliary processor123(e.g., an NPU) may include a hardware structure specifically for artificial intelligence model processing. An artificial intelligence model may be generated by machine learning. The machine learning may be performed by, for example, the electronic device101, in which artificial intelligence is performed, or performed via a separate server (e.g., the server108). Learning algorithms may include, but are not limited to, for example, supervised learning, unsupervised learning, semi-supervised learning, or reinforcement learning. The artificial intelligence (AI) model may include a plurality of artificial neural network layers. An artificial neural network may include, for example, a deep neural network (DNN), a convolutional neural network (CNN), a recurrent neural network (RNN), a restricted Boltzmann machine (RBM), a deep belief network (DBN), and a bidirectional recurrent deep neural network (BRDNN), a deep Q-network, or a combination of two or more thereof, but is not limited thereto. The AI model may additionally or alternatively include a software structure other than the hardware structure.

The memory130may store various pieces of data used by at least one component (e.g., the processor120or the sensor module176) of the electronic device101. The various pieces of data may include, for example, software (e.g., the program140) and input data or output data for a command related thereto. The memory130may include the volatile memory132or the non-volatile memory134.

The program140may be stored as software in the memory130and may include, for example, an operating system (OS)142, middleware144, or an application146.

The input module150may receive, from outside (e.g., a user) the electronic device101, a command or data to be used by another component (e.g., the processor120) of the electronic device101. The input module150may include, for example, a microphone, a mouse, a keyboard, a key (e.g., a button), or a digital pen (e.g., a stylus pen).

The sound output module155may output a sound signal to the outside of the electronic device101. The sound output module155may include, for example, a speaker or a receiver. The speaker may be used for general purposes, such as playing multimedia or playing a recording. The receiver may be used to receive an incoming call. According to an example embodiment, the receiver may be implemented separately from the speaker or as a part of the speaker.

The display module160may visually provide information to the outside (e.g., a user) of the electronic device101. The display module160may include, for example, a control circuit for controlling a display, a hologram device, or a projector and control circuitry to control its corresponding one of the display, the hologram device, and the projector. According to an example embodiment, the display module160may include a touch sensor adapted to detect a touch, or a pressure sensor adapted to measure the intensity of force of the touch.

The audio module170may convert sound into an electric signal or vice versa. According to an example embodiment, the audio module170may obtain the sound via the input module150or output the sound via the sound output module155or an external electronic device (e.g., the electronic device102, such as a speaker or headphones) directly or wirelessly connected to the electronic device101.

The sensor module176may detect an operational state (e.g., power or temperature) of the electronic device101or an environmental state (e.g., a state of a user) external to the electronic device101and generate an electric signal or data value corresponding to the detected state. According to an example embodiment, the sensor module176may include, for example, a gesture sensor, a gyro sensor, an atmospheric pressure sensor, a magnetic sensor, an acceleration sensor, a grip sensor, a proximity sensor, a color sensor, an infrared (IR) sensor, a biometric sensor, a temperature sensor, a humidity sensor, or an illuminance sensor.

The interface177may support one or more specified protocols to be used by the electronic device101to couple with the external electronic device (e.g., the electronic device102) directly (e.g., by wire) or wirelessly. According to an example embodiment, the interface177may include, for example, a high-definition multimedia interface (HDMI), a universal serial bus (USB) interface, a secure digital (SD) card interface, or an audio interface.

The connecting terminal178may include a connector via which the electronic device101may physically connect to an external electronic device (e.g., the electronic device102). According to an example embodiment, the connecting terminal178may include, for example, an HDMI connector, a USB connector, an SD card connector, or an audio connector (e.g., a headphones connector).

The haptic module179may convert an electric signal into a mechanical stimulus (e.g., a vibration or a movement) or an electrical stimulus, which may be recognized by a user via their tactile sensation or kinesthetic sensation. According to an example embodiment, the haptic module179may include, for example, a motor, a piezoelectric element, or an electric stimulator.

The camera module180may capture a still image and moving images. According to an example embodiment, the camera module180may include one or more lenses, image sensors, ISPs, and flashes.

A driving module may drive the electronic device101. The driving module may include the motor187and a wheel connected to the motor187. InFIG.2to be described below, illustrated is an example of a pair of wheels spaced and disposed along an axis (e.g., a lateral axis) perpendicular to a driving direction (e.g., a longitudinal axis) at a bottom center of the electronic device101, but examples are not limited thereto. The disposition and number of wheels of the motor187of the driving module may vary depending on a design.

The power management module188may manage power supplied to the electronic device101. According to an example embodiment, the power management module188may be implemented as, for example, at least a part of a power management integrated circuit (PMIC).

The battery189may supply power to at least one component of the electronic device101. According to an example embodiment, the battery189may include, for example, a primary cell, which is not rechargeable, a secondary cell, which is rechargeable, or a fuel cell.

The communication module190may support establishing a direct (e.g., wired) communication channel or a wireless communication channel between the electronic device101and the external electronic device (e.g., the electronic device102, the electronic device104, or the server108) and performing communication via the established communication channel. The communication module190may include one or more CPs that are operable independently from the processor120(e.g., an AP) and that support direct (e.g., wired) communication or wireless communication. According to an example embodiment, the communication module190may include a wireless communication module192(e.g., a cellular communication module, a short-range wireless communication module, or a global navigation satellite system (GNSS) communication module) or a wired communication module194(e.g., a local area network (LAN) communication module, or a power line communication (PLC) module). A corresponding one of these communication modules may communicate with the external electronic device, for example, the electronic device104, via the first network198(e.g., a short-range communication network, such as Bluetooth™, wireless-fidelity (Wi-Fi) direct, or infrared data association (IrDA)) or the second network199(e.g., a long-range communication network, such as a legacy cellular network, a 5G network, a next-generation communication network, the Internet, or a computer network (e.g., a LAN or a wide area network (WAN)). These various types of communication modules may be implemented as a single component (e.g., a single chip), or may be implemented as multiple components (e.g., multiple chips) separate from each other. The wireless communication module192may identify and authenticate the electronic device101in a communication network, such as the first network198or the second network199, using subscriber information (e.g., international mobile subscriber identity (IMSI)) stored in the SIM196.

The wireless communication module192may support a 5G network after a 4G network, and next-generation communication technology, e.g., new radio (NR) access technology. The NR access technology may support enhanced mobile broadband (eMBB), massive machine type communications (mMTC), or ultra-reliable and low-latency communications (URLLC). The wireless communication module192may support a high-frequency band (e.g., a mmWave band) to achieve, e.g., a high data transmission rate. The wireless communication module192may support various technologies for securing performance on a high-frequency band, such as, e.g., beamforming, massive multiple-input and multiple-output (MIMO), full dimensional MIMO (FD-MIMO), an array antenna, analog beam-forming, or a large scale antenna. The wireless communication module192may support various requirements specified in the electronic device101, an external electronic device (e.g., the electronic device104), or a network system (e.g., the second network199). According to an example embodiment, the wireless communication module192may support a peak data rate (e.g., 20 Gbps or more) for implementing eMBB, loss coverage (e.g., 164 dB or less) for implementing mMTC, or U-plane latency (e.g., 0.5 ms or less for each of downlink (DL) and uplink (UL), or a round trip of 1 ms or less) for implementing URLLC.

The antenna module197may transmit or receive a signal or power to or from the outside (e.g., the external electronic device) of the electronic device101. According to an example embodiment, the antenna module197may include an antenna including a radiating element including a conductive material or a conductive pattern formed in or on a substrate (e.g., a printed circuit board (PCB)). According to an example embodiment, the antenna module197may include a plurality of antennas (e.g., an antenna array). In such a case, at least one antenna appropriate for a communication scheme used in a communication network, such as the first network198or the second network199, may be selected by, for example, the communication module190from the plurality of antennas. The signal or power may be transmitted or received between the communication module190and the external electronic device via the at least one selected antenna. According to an example embodiment, another component (e.g., a radio frequency integrated circuit (RFIC)) other than the radiating element may be additionally formed as a part of the antenna module197.

According to various example embodiments, the antenna module197may form a mmWave antenna module. According to an example embodiment, the mmWave antenna module may include a PCB, an RFIC on a first surface (e.g., the bottom surface) of the PCB, or adjacent to the first surface of the PCB and capable of supporting a designated high-frequency band (e.g., a mmWave band), and a plurality of antennas (e.g., array antennas) disposed on a second surface (e.g., the top or a side surface) of the PCB, or adjacent to the second surface of the PCB and capable of transmitting or receiving signals of the designated high-frequency band.

At least some of the above-described components may be coupled mutually and exchange signals (e.g., commands or data) therebetween via an inter-peripheral communication scheme (e.g., a bus, general purpose input and output (GPIO), serial peripheral interface (SPI), or mobile industry processor interface (MIPI)).

According to an example embodiment, commands or data may be transmitted or received between the electronic device101and the external electronic device (e.g., the electronic device104) via the server108coupled with the second network199. Each of the external electronic devices (e.g., the electronic device102or104) may be a device of the same type as or a different type from the electronic device101. According to an example embodiment, all or some of operations to be executed by the electronic device101may be executed by one or more external electronic devices (e.g., the electronic devices102and104and the server108). For example, if the electronic device101needs to perform a function or a service automatically, or in response to a request from a user or another device, the electronic device101, instead of, or in addition to, executing the function or the service, may request the one or more external electronic devices to perform at least part of the function or service. The one or more external electronic devices receiving the request may perform the at least part of the function or service, or an additional function or an additional service related to the request and may transfer a result of the performance to the electronic device101. The electronic device101may provide the result, with or without further processing the result, as at least part of a response to the request. To that end, cloud computing, distributed computing, mobile edge computing (MEC), or client-server computing technology may be used, for example. The electronic device101may provide ultra low-latency services using, e.g., distributed computing or MEC. In an example embodiment, the external electronic device (e.g., the electronic device104) may include an Internet-of-things (IoT) device. The server108may be an intelligent server using machine learning and/or a neural network. According to an example embodiment, the external electronic device (e.g., the electronic device104) or the server108may be included in the second network199. The electronic device101may be applied to intelligent services (e.g., a smart home, a smart city, a smart car, or healthcare) based on 5G communication technology or IoT-related technology.

The electronic device according to various example embodiments may be one of various types of electronic devices. The electronic device may include, for example, a portable communication device (e.g., a smartphone), a computer device, a portable multimedia device, a portable medical device, a camera, a wearable device, a home appliance device, or the like. According to an example embodiment of the disclosure, the electronic device is not limited to those described above.

It should be understood that various example embodiments of the present disclosure and the terms used therein are not intended to limit the technological features set forth herein to particular embodiments and include various changes, equivalents, or replacements for a corresponding embodiment. In connection with the description of the drawings, like reference numerals may be used for similar or related components. It is to be understood that a singular form of a noun corresponding to an item may include one or more of the things unless the relevant context clearly indicates otherwise. As used herein, “A or B”, “at least one of A and B”, “at least one of A or B”, “A, B or C”, “at least one of A, B and C”, and “A, B, or C,” each of which may include any one of the items listed together in the corresponding one of the phrases, or all possible combinations thereof. Terms such as “first”, “second”, or “first” or “second” may simply be used to distinguish the component from other components in question, and do not limit the components in other aspects (e.g., importance or order). It is to be understood that if an element (e.g., a first element) is referred to, with or without the term “operatively” or “communicatively”, as “coupled with,” “coupled to,” “connected with,” or “connected to” another element (e.g., a second element), the element may be coupled with the other element directly (e.g., by wire), wirelessly, or via a third element.

As used in connection with various example embodiments of the disclosure, the term “module” may include a unit implemented in hardware, software, or firmware, or any combination thereof, and may interchangeably be used with other terms, for example, “logic,” “logic block,” “part,” or “circuitry”. A module may be a single integral component, or a minimum unit or part thereof, adapted to perform one or more functions. For example, according to an example embodiment, the module may be implemented in a form of an application-specific integrated circuit (ASIC).

Various example embodiments as set forth herein may be implemented as software (e.g., the program140) including one or more instructions that are stored in a storage medium (e.g., the internal memory136or the external memory138) that is readable by a machine (e.g., the electronic device101). For example, a processor (e.g., the processor120) of the machine (e.g., the electronic device101) may invoke at least one of the one or more instructions stored in the storage medium and execute it. This allows the machine to be operated to perform at least one function according to the at least one instruction invoked. The one or more instructions may include code generated by a compiler or code executable by an interpreter. The machine-readable storage medium may be provided in the form of a non-transitory storage medium. Here, the “non-transitory” storage medium is a tangible device, and may not include a signal (e.g., an electromagnetic wave), but this term does not differentiate between where data is semi-permanently stored in the storage medium and where the data is temporarily stored in the storage medium.

According to an example embodiment, a method according to various example embodiments of the disclosure may be included and provided in a computer program product. The computer program product may be traded as a product between a seller and a buyer. The computer program product may be distributed in the form of a machine-readable storage medium (e.g., a compact disc read-only memory (CD-ROM)), or be distributed (e.g., downloaded or uploaded) online via an application store (e.g., PlayStore™), or between two user devices (e.g., smartphones) directly. If distributed online, at least part of the computer program product may be temporarily generated or at least temporarily stored in the machine-readable storage medium, such as a memory of the manufacturer's server, a server of the application store, or a relay server.

According to various example embodiments, each component (e.g., a module or a program) of the above-described components may include a single entity or multiple entities, and some of the multiple entities may be separately disposed in different components. According to various example embodiments, one or more of the above-described components may be omitted, or one or more other components may be added. Alternatively or additionally, a plurality of components (e.g., modules or programs) may be integrated into a single component. In such a case, according to various example embodiments, the integrated component may still perform one or more functions of each of the plurality of components in the same or similar manner as they are performed by a corresponding one of the plurality of components before the integration. According to various example embodiments, operations performed by the module, the program, or another component may be carried out sequentially, in parallel, repeatedly, or heuristically, or one or more of the operations may be executed in a different order or omitted, or one or more other operations may be added.

FIG.2is a diagram illustrating an example electronic device implemented as a serving robot according to various example embodiments.

An electronic device210(e.g., the electronic device101ofFIG.1) may be implemented as a serving robot as illustrated inFIG.2. For example, the electronic device210may be a public mobile robot, which is a serving robot configured to autonomously drive and visit a plurality of destinations (e.g., a table). The electronic device210may establish communication with an order server220(e.g., the server108ofFIG.1) and receive, from the order server220, information related to orders of customers among the plurality of destinations.

The order server220may manage order information of each destination. For example, the order server220may collect order information (e.g., point-of-sale (POS) data) on a customer of each destination from the electronic device210and/or an external device (e.g., a mobile terminal of a customer, a tablet terminal of an employee, and a kiosk terminal). The order information may include at least one of seated information of each destination, order receiving information, ordered menu item information, or serving information. The seated (e.g., seating) information of each destination may include identification information (e.g., a table number and a table location) of the destination, whether a customer sits in the destination, and the number of seated customers. The order receiving information of each destination may include whether a customer seated in the destination places an order and the time of the order. The ordered menu item information of each destination may include a type of item ordered by a seated customer at the destination and the number of ordered items. The serving information of each destination may include whether each item ordered from each destination has been served. In addition, the order information may include a side item (e.g., a side menu item) accompanying an ordered main item (e.g., a main dish), a special order (e.g., whether additional tableware is needed), additional food, whether a customer is a customer with a reservation, the number of visits of the customer, and whether the customer is a very-important-person (VIP) customer.

The electronic device210may include a display module (e.g., including a display)211(e.g., the display module160ofFIG.1), a camera module (e.g., including a camera)212(e.g., the camera module180ofFIG.1), a lighting module (including light emitting circuitry)213, a serving tray214, a sensor module (e.g., including a sensor)215(e.g., the sensor module176ofFIG.1), a sound output module (e.g., including sound output circuitry)216(e.g., the sound output module155ofFIG.1), a communication module (e.g., including communication circuitry218(e.g., the communication module190ofFIG.1), and a driver (e.g., including a motor)219(e.g., the motor187ofFIG.1). Although inFIG.2, the sensor module215, the sound output module216, the communication module218, and the driver219are illustrated as being included in a base driving platform217, examples are not limited thereto. The base driving platform217may further include a battery (e.g., the battery189ofFIG.1) and a power management module (e.g., the power management module188ofFIG.1).

The display module211may include a display and visually output information related to item delivery to at least one of a user and a customer. For example, the display module211may output visual information (e.g., text and an image) that guides the user and the customer to an item to be delivered to a destination where the electronic device210reaches.

In addition, the electronic device210may further include an input module (e.g., the input module150ofFIG.1) including various input circuitry integrated with the display module211. The electronic device210, through the input module, may receive at least one of a touch input and a voice input from at least one of a user and a customer.

The camera module212may include a camera and face each serving tray. For example, inFIG.2, the camera module212may face a serving tray from the ceiling facing the serving tray. In other words, the camera module212may have a view angle for capturing the serving tray. The camera module212may capture an image including an item (e.g., food) on the serving tray. A processor (e.g., the processor120ofFIG.1) of the electronic device210, based on an image captured by the camera module212, may recognize a type (e.g., a food type) of item on each serving tray and the number of items (e.g., the number of food items).

The lighting module213may be a module and include various circuitry for projecting light onto a serving tray. The lighting module213, when the electronic device210reaches a first destination to which a target item on a serving tray needs to be delivered, may light up the serving tray and the target item on the serving tray.

Each serving tray (e.g., the serving tray214) may be a tray for accommodating an item. Although inFIG.2three serving trays are illustrated as being spaced and in a direction perpendicular to the ground, the number and structure of the serving tray214may not be limited thereto and may vary depending on a design. At least one serving tray among a plurality of serving trays may be on the same surface as another serving tray. The electronic device210may include one or more serving trays (e.g., the serving tray214). For example, a first serving tray among the plurality of serving trays may accommodate a basic item (e.g., a menu, water, tableware, and a plate). The basic item may be an item that needs to be basically provided before a main item (e.g., a main dish) being provided to a seated customer at a destination. For reference, the main item may be served to the seated customer by another serving robot or an employee. A second serving tray may accommodate an auxiliary item (e.g., a side dish). The auxiliary item may be an item accompanying an item (e.g., the main item) ordered by a customer and may be provided with the ordered item as a set. A third serving tray may accommodate an additional item (e.g., kids tableware, shared tableware, and special tableware). However, the foregoing example is merely an example for helping understanding, and an item accommodated in each serving tray may not be limited thereto.

The sensor module215may include a sensor for driving the electronic device210. For example, the sensor module215may include at least one of a light detection and ranging (LiDAR) sensor, a depth sensor (e.g., a time-of-flight (ToF) sensor), and an ultrasonic sensor. The electronic device210, through the sensor module215, may set a driving route by detecting an object and the background around the electronic device210and perform a maneuver for avoiding an obstacle.

The sound output module216may include various sound output circuitry and output, to a customer, a sound signal (e.g., voice guidance) for indicating information (e.g., the name and number of currently delivered items) related to item delivery. The sound output module216may record a sound signal (e.g., guidance to a customer) to be delivered from a user to the customer and a sound signal (e.g., a request from the customer) to be delivered from the customer to the user. InFIG.2, for example, a speaker of the sound output module216is illustrated as being at the lower part of the electronic device210, and a microphone of the sound output module216may be integrated with the display module211.

The communication module218may include various communication circuitry and establish wired or wireless communication with the order server220. The processor of the electronic device210may include various processing circuitry and establish communication with the order server220using the communication module218and may receive order information from the order server220. The order information may include at least one of seated information of each destination, order receiving information, ordered menu item information, and serving information. The order information may be generated based on POS data. For example, the communication module218may receive POS data from the order server220. The POS data may include one or more pieces of order data that indicate an item ordered by each customer. The item, for example, may include food items and things. The communication module218, when delivery of a target item is completed by the electronic device210, may report the completed delivery of the target item (e.g., served food) to the order server220. In addition, the communication module218may establish communication with an external device (e.g., another terminal of a user and a wearable device) other than the order server220. The communication module218may transfer an anomaly detected by the electronic device210to the other terminal of the user.

The driver219may move the electronic device210. The driver219may include a motor and wheels. The driver219may move the electronic device210forward and backward and rotate the electronic device210on the ground by driving the motor. For example, the processor of the electronic device210may move the electronic device210along a route including a point of departure and one or more destinations (e.g., a first destination) using the driver219. The point of departure may be a reference point at which a route starts and may be a position where the electronic device210waits before initiating a circular drive. For example, the route may be a circular route.

The electronic device210may serve simultaneously prepared items (e.g., simultaneously cooked food items) in a service space (e.g., a restaurant) to multiple destinations (e.g., multiple tables) in one drive. For reference, an example of the electronic device210accommodating an item visiting the first destination is mainly described herein, but examples are not limited thereto. When the electronic device210visits a plurality of destinations (e.g., first and second destinations), the electronic device210may visit the destinations in a serving sequence by identifying an item on each serving tray.

FIG.3is a flowchart illustrating an example circular serving method of an electronic device according to various example embodiments.

In operation310, an electronic device (e.g., the electronic device101ofFIG.1) may collect order information of each destination. As described above, the electronic device may collect, as order information, seated information (e.g., sitting completion, the number of customers, destination identification information, and seated time), order receiving information (e.g., order received time), order menu item information (e.g., a name of a menu item ordered by a customer, a quantity, and whether an order is a general order or a special order), and serving information (e.g., whether serving is completed). In addition, the electronic device may collect additional information (e.g., whether a child is accompanied, a customer type, such as gender, and whether a reservation has been made). The general order may be an order for a menu item providing only a main item (e.g., food), and a special order may be an order for a menu item requesting an additional item (e.g., kids tableware, tableware for sharing food, and other special tableware). The tableware for sharing food may be an item (e.g., a knife) for dividing a sharable food item (e.g., pizza and steak).

In operation320, the electronic device may determine a destination to be visited, based on order information. The electronic device may generate a route including a point of departure and a first destination determined based on the order information. For example, the electronic device may identify a service state of an individual destination, based on the order information described above. The service state may be a state of service being provided for an order received at each destination. An example of the service state may be described below with reference toFIG.3. The electronic device may determine whether to visit a destination, based on a service state determined for each destination. The electronic device may generate a route, based on one or more destinations (e.g., a first destination) determined to be visited. The electronic device may be a serving robot for accommodating an item universally needed at each destination and circularly driving itself, and the route may be a route set for a circular drive of the serving robot.

In operation330, the electronic device may sense the inventory of items on a plurality of serving trays. The electronic device may monitor a type and quantity of items on each serving tray, based on data collected using a sensor installed on each of the plurality of serving trays. For example, the electronic device may sense the items on each serving tray through vision recognition using a camera module. The electronic device may compare a prepared item with an item needed for each destination. For example, the electronic device may identify whether an item is recognized and a type (e.g., a type of side dish, a place, and tableware) and quantity of a recognized item. The electronic device may replenish an insufficient item when the number of prepared items on each serving tray is less than the number of items needed for each of a plurality of serving destinations included in a determined route. For example, the electronic device may request a user (e.g., a manager and an employee) to replenish inventory or may move to a region where inventory replenishment may be performed.

In operation340, the electronic device may perform interaction determined based on order information when reaching a destination (e.g., a first destination) to be visited. For example, the electronic device may perform an operation of indicating a serving tray accommodating an item needed for a visited destination through interaction. The electronic device may indicate the above-described serving tray through at least one of a display module, a sound output module, and a lighting module. The electronic device may output speech guiding to an item through the sound output module. The electronic device may illuminate light on a serving tray. The electronic device may slide a serving tray accommodating an item toward a customer by mechanically actuating the serving tray. The electronic device may provide guiding information customized for a service state of each destination or provide an item corresponding to an ordered menu item and a customer's characteristics at a destination.

In operation350, the electronic device may revisit each destination by repeating a circular drive. For example, the electronic device may identify a destination to be revisited, based on order information based on POS data updated in real time. The electronic device may distinguish a destination requesting a revisit from a destination refusing a revisit, based on a service refusal history of each destination. The electronic device may identify a user's intent to request or refuse a revisit service through questions and answers, gesture recognition, and a variety of feedback. In addition, the electronic device, other than the service refusal history, may determine whether a customer sits in a destination and finishes their meal through vision recognition. Furthermore, the electronic device may determine when to initiate a drive along a current route, based on the amount of time elapsing from a drive along a previous route. Operations340and350described above may be performed repeatedly after initiating a first circular drive.

However, operations310to350described above may not be limited to being performed sequentially, and each operation may be performed sequentially with or in parallel to another operation. For example, sensing inventory in operation330may be illustrated as being performed before operation340, but examples are not limited thereto. The electronic device may perform inventory sensing while performing operation340, between performing operations340and350, or while performing operation350.

The electronic device may be implemented as a serving robot and may operate in a public environment (e.g., a family restaurant and a franchise restaurant) involving a circular drive.

FIG.4is a diagram illustrating an example operation of determining a service state according to various example embodiments.

An electronic device (e.g., the electronic device101ofFIG.1) may classify each destination into one of a plurality of service states, based on order information. For example, a service state may be classified into order waiting410, order complete420, service incomplete430, and serving complete440. However, the service state may not be limited to the foregoing example and may further include payment complete and destination empty.

TABLE 1Service stateRequired visit countsRequired itemorder waiting1 visitmenu, water,tableware, plateorder completeno visit requirednoneserving incomplete1 visitside dishserving complete1 or more visitsside dish

The order waiting410may be a state in which a customer sits in a destination and is yet to place an order. Delivery of a basic item (e.g., a menu, water, tableware, and a plate) may be needed for a destination of which a state is determined to be the order waiting410. The electronic device may guide a customer to a serving tray accommodating the basic item and provide the basic item to the customer by visiting the destination determined to be the order waiting410once. The order complete420may be a state in which a customer sitting in a destination orders an item and the ordered item is yet to be served. For example, the order complete420may refer to a state after receiving an order from at least one customer at a destination (e.g., a first destination) and before delivering at least one item indicated in the order from the destination. A destination determined to be the order complete420may not need a visit because there is no required item. The serving incomplete430may be a state in which some items are delivered among ordered items and a state in which a customer places an order, receives some ordered food items but not all ordered food items. The serving complete440may be a state in which all ordered items are delivered and a state in which all ordered food items are completely served. A destination determined to be the serving incomplete430or the serving complete440may need delivery of an auxiliary item related to an ordered item. The electronic device may guide a customer to a serving tray accommodating the auxiliary item and provide the auxiliary item to the customer by visiting the destination determined to be the serving incomplete430or the serving complete440one or more times. In addition, the electronic device, according to an order, may further guide the customer to a serving tray accommodating an additional item.

InFIG.4, an example is illustrated as table D being the order waiting410, table A being the order complete420, table B being the serving incomplete430, and table C being the serving complete440.

Payment complete may be a state in which all items are completely served and payment for the served items is also completed. Destination empty may be a destination in which a seated customer has left or a customer is yet to be seated.

FIG.5is a flowchart illustrating an example operation of determining a route according to various example embodiments.

In operation511, the electronic device, as described above with reference toFIG.4, may classify a service state of each destination. In operation512, the electronic device may determine, among a plurality of destinations, whether a first destination is in an order waiting state. In operation513, the electronic device, when the first destination is in an order waiting state, may determine whether the first destination has a previously visited history. For example, the electronic device may determine whether to visit the first destination in an order waiting state at least once. In operation515, the electronic device may exclude the first destination from a route when visiting the first destination in an order waiting state at least once. In operation514, the electronic device, when the first destination is not in an order waiting state, may determine whether a state of the first destination is serving incomplete or serving complete. In operation515, the electronic device may exclude the first destination from the route when the first destination is not in a serving incomplete or serving complete state, in other words, is in an order complete state. In operation516, the electronic device may determine whether a visit is needed for the first destination in a serving incomplete or serving complete state.

In operation516described above, the electronic device may determine whether the visit is needed according to a priority of each destination. The electronic device may determine a visiting order based on order information including at least one of seated information of each destination, order receiving information, order menu information, serving information, and whether an additional item has been requested. For example, the electronic device may form a route in a visiting order determined based on at least one of a seated time (e.g., a time elapsing from when a customer is seated) of each destination, order receiving information (e.g., receiving an order), or whether an additional item has been requested. The electronic device may determine a destination of which a seated time is the longest among the plurality of destinations to be a destination to be preferentially visited. Then, the electronic device may determine a destination identified to be in an order waiting state to be a destination to be visited. The destination in an order waiting state may need to be provided with a basic item for having a meal. In addition, the electronic device may determine a destination with a special order to be a destination to be visited with the next priority. As described above, the special order may require an additional item, and the additional item may include, for example, special tableware, tableware for sharing food, or additional tableware. On the other hand, a general order may be an order for a menu item only providing a main item.

In operation517, the electronic device may determine a route including the first destination being in an order waiting state and having no previously visited history and to which a visit is determined to be needed. For example, the electronic device may drive itself along a route (e.g., a default route) including a plurality of default destinations using a driver. The electronic device, when a drive along the route has been completed, in operation516described above, may modify the route by excluding, among the plurality of default destinations included in the default route, a destination to which a visit is determined to be skipped. The electronic device may drive itself along the modified route using the driver.

For reference, when determining a route, the electronic device may exclude, from the route, a destination where intent of refusal is expressed. The electronic device may exclude the destination from the route until a customer expressing the intent of refusal leaves. However, after the customer expressing the intent of refusal leaves, the electronic device may reset a service refusal history related to the intent of refusal expressed at the destination.

The electronic device may perform operations512to517described above after completing an individual circular drive and before initiating a next circular drive. However, examples are not limited thereto.

FIG.6is a diagram illustrating an example operation of sensing inventory according to various example embodiments.

An electronic device600(e.g., the electronic device101ofFIG.1) may further include a sensor module that may sense an inventory item on each serving tray. The electronic device600may sense, through the sensor module, an inventory quantity of the inventory item on each serving tray accommodating each inventory item. Although inFIG.6, for example, a camera module is illustrated as the sensor module, examples are not limited thereto. Various examples of the sensor module may be described below with reference toFIG.7.

In operation631, the electronic device600may sense an inventory item and a quantity of the inventory item on each serving tray. For example, the electronic device600may capture an image including an inventory item on a serving tray through a camera sensor and may identify the type and quantity of the inventory item by analyzing the captured image.

In operation632, the electronic device600may compare an item needed for each destination with the sensed inventory item. For example, the electronic device600may match the type and quantity of the needed item, based on order information of each destination, with the types and quantities of inventory items on serving trays. In the example illustrated inFIG.6, side dishes on a first serving tray may be needed for tables A and B. Cutlery and plates on a second serving tray may be needed for tables A, B, and E. Water and glasses on a third serving tray may be needed for tables A, B, and E.

In operation633, the electronic device600, in response to insufficient inventory as a result of comparing the item needed for each destination with the sensed inventory item, may transmit a message for requesting inventory replenishment to an external device. For example, the electronic device600may transmit a signal for requesting the supply of inventory items to a terminal (e.g., a wearable device) of a user (e.g., an employee). However, examples are not limited to the foregoing example. The electronic device600may move to a region (e.g., a storage where inventory is stocked or a region adjacent to the storage) for replenishing inventory when inventory is insufficient.

The electronic device600may perform a circular drive according to operation340when inventory is determined to be sufficient.

FIG.7is a diagram illustrating an example inventory sensor according to various example embodiments.

Electronic devices700aand700bmay further include a sensor module including at least one of a camera sensor for capturing an inventory item on each serving tray, a weight sensor710afor measuring the weight of the inventory item on each serving tray, and a distance sensor for measuring the distance from the distance sensor to the inventory item on each serving tray.

The electronic device700aillustrates an example of an inventory sensor including the weight sensor710a. The weight sensor710amay be included in each serving tray and may measure the weight of an object on a serving tray. The electronic device700amay determine whether the object's weight detected by the weight sensor710ain each serving tray is greater than or equal to a threshold weight. The electronic device700a, when the object's weight is less than the threshold weight, may determine that an inventory item on a serving tray is insufficient. The electronic device700b, when the object's weight is greater than the threshold weight, may determine that an inventory item on a serving tray is sufficient.

The electronic device700billustrates an example of an inventory sensor including a depth sensor710b. The depth sensor710bmay include, for example, a time-of-flight (ToF) sensor. The depth sensor710bmay measure a distance to an inventory item. In other words, the electronic device700b, through the distance to the inventory item measured by the depth sensor710b, may estimate a height, from the bottom of each serving tray, of stacked inventory items on a serving tray. The electronic device700bmay determine a quantity of inventory items, based on the estimated height of the stacked inventory items and a volume defined for each type of inventory item.

In the foregoing examples, a type of inventory items accommodated in each serving tray may be predetermined. For example, a first serving tray that is highest may accommodate side dishes, a second serving tray in the middle may accommodate tableware, and a third serving tray that is lowest may accommodate tableware related to an alcoholic beverage. The electronic devices700aand700bmay determine the height and weight corresponding to a required quantity, based on item types designated for each serving tray. Accordingly, the electronic devices700aand700bmay verify whether an inventory item is on a serving tray even though there is no vision recognition based on a camera or the vision recognition is unavailable.

FIG.8is a diagram illustrating an example operation of modifying a route for a revisit, according to various example embodiments.

An electronic device (e.g., the electronic device101ofFIG.1) may determine a subsequent route (e.g., a current route) to a route (e.g., a previous route) based on a service refusal history received from a customer at a destination included in the route, when completing a drive along the route. For example, the electronic device, after performing a circular drive along the previous route in operation340, may determine the current route in operation350. For reference, the electronic device may determine the route, based on whether each destination has completed payment except for the service refusal history. For example, the electronic device, by excluding a destination having completed payment among destinations included in the previous route, may generate the current route.

For example, the electronic device, before initiating a drive along the subsequent route (e.g., the current route), may determine the subsequent route, based on seated information of each destination in the subsequent route and a detection result of a predefined action at each destination. In operation811, the electronic device may determine whether at least one customer sits in each of destinations potentially to be visited in the current route. For example, the electronic device, by analyzing an image capturing a destination through a camera module, may detect a customer within a region corresponding to the destination. In operation815, the electronic device may exclude a destination in which no one sits from destinations in the current route. In other words, the electronic device may exclude a destination with no customers from the current route.

In operation812, the electronic device may determine whether a predefined action is detected in a destination in which at least one customer sits among the destinations in the current route. For example, the electronic device may detect, as a predefined action, whether a customer is eating. The electronic device may identify a customer's action by analyzing an image capturing a destination. The electronic device may determine whether the customer performs an action of holding tableware and bringing their hands from a plate to the mouth one or more times within a threshold time. In operation814, the electronic device may determine whether a threshold time elapses from when all serving has been completed for a destination where a predefined action is not detected. In operation815, the electronic device may exclude, from the destinations of the current route, a destination where a predefined action is not detected and a threshold time elapses after all serving has been completed. In other words, the electronic device may exclude a destination where a customer has finished eating and the threshold time has elapsed from the current route.

According to operations811,812,814, and815described above, the electronic device may modify the current route by maintaining or excluding destinations potentially included in the current route.

In operation813, the electronic device, after determining the current route, may determine whether a waiting time for driving again elapses after a drive along the previous route. The waiting time for driving again may be a threshold time interval set between previous and current circular drives and may be set for cyclical, circular serving that is temporally spaced apart from another serving. For example, the electronic device may determine from when to initiate a drive along the subsequent route (e.g., the current route), based on a waiting time elapsing after completing the drive along the route (e.g., the previous route). In operation820, the electronic device may sequentially visit destinations along the current route when the waiting time for driving again has elapsed after a previous drive. In other words, the electronic device may perform serving along the current route when the waiting time for driving again elapses after completing serving along the previous route.

In operation831, the electronic device may determine whether a person (e.g., a customer) at a first destination expresses intent of refusal. The intent of refusal may be intent to refuse a service provided by a serving robot. The electronic device may determine the intent of refusal, based on at least one of a voice input received from a customer, a gesture input based on vision recognition, and other inputs. For example, the electronic device may receive a voice input through a microphone, identify speech from the voice input through a speech recognition engine (e.g., a machine-learning model), and determine whether the identified speech includes intent of refusal. The electronic device may identify a customer's gesture from an image capturing the customer and determine whether the identified gesture (e.g., shaking their head) includes intent of refusal. As another example, the electronic device may also verify the intent of refusal through a direct input (e.g., a touch input) to an input module from a customer. When the intent of refusal is verified at the first destination, the electronic device may record the intent of refusal in a service refusal history received from the customer at the first destination.

In operation832, the electronic device, in response to the intent of refusal expressed by the customer at the first destination, may determine whether an additional service is needed. The additional service may be a service involving the intervention of a user (e.g., an employee). In operation833, the electronic device, in response to determining that the additional service is needed, may receive a feedback input (e.g., a voice input, a gesture input, and a direct input) from a customer and may inform a manager (e.g., the user) of the received feedback input. For example, the electronic device may transmit the feedback input received from the customer to a terminal (e.g., a wearable device) of the user. After completing the current circular drive, in operation834, the electronic device may exclude, from a next route, the first destination where there is the customer that expressed the intent of refusal. The next route may be a route where the electronic device circulates after completing a circular drive along a current route.

In operation835, unlike operation834described above, the electronic device may perform a dynamic interaction at the first destination. An example of a dynamic interaction is described below with reference toFIGS.9to13. In operation836, the electronic device may include the first destination in the next route since the customer at the first destination did not express an intent of refusal.

The electronic device, by sequentially visiting the destinations in the current route and performing operations831to836described above, may maintain each destination in the next route or exclude each destination from the next route.

In operation837, the electronic device may detect a service state change from at least one destination. For example, the electronic device may repeatedly revisit along a route, as illustrated inFIG.8, before a service state change occurs. As another example, the electronic device, in response to the service state change from at least one destination, may return to operation320, generate a new route, and perform serving along the new route.

FIG.9is a diagram illustrating an example operation of performing a circular drive on a plurality of destinations having the same serving state by an electronic device according to various example embodiments.

As described above, an electronic device900(e.g., the electronic device101ofFIG.1) may determine whether to visit each destination, based on a service state of each destination, and may drive itself along a route including a destination determined to be visited. The electronic device900reaching each destination may perform an interaction corresponding to a service state of each destination.

In the example illustrated inFIG.9, destinations910,920,930, and940included in the route may be in an order waiting state. The electronic device900, while moving along the route using a driver, in response to not receiving an order from a first destination on which identified is seated information indicating at least one seated customer, may perform an operation of outputting information indicating a serving tray accommodating a basic item when reaching the first destination. For example, the outputting information indicating a serving tray accommodating a basic item may include at least one of outputting, on a display module, visual information indicating the serving tray accommodating the basic item, outputting, from a sound output module, auditory information indicating the serving tray accommodating the basic item, and emitting light indicating the serving tray accommodating the basic item through a lighting module. For example, a second serving tray902among a plurality of serving trays may accommodate the basic item (e.g., a menu, water and tableware). The electronic device900may output speech sound indicating the second serving tray and emit light on the second serving tray.

FIG.10is a diagram illustrating an example drive along a route including a destination to which a special order is received by an electronic device according to various example embodiments.

An electronic device1000may store items for each type on each of the plurality of serving trays and may travel along a circulation route. For example, a first serving tray1001of the electronic device1000may accommodate an auxiliary item (e.g., a side dish including pickles and sauce). A second serving tray1002may accommodate a basic item. A third serving tray1003may accommodate an additional item (e.g., kids tableware and a pizza cutter). The electronic device1000may perform an interaction based on a service state of a destination at each destination to be visited while driving itself along a route.

In the example illustrated inFIG.10, the electronic device1000may sequentially visit a first destination1021(e.g., table B), a second destination1041(e.g., table D), a third destination1031(e.g., table C), and a fourth destination1011(e.g., table A). Some of ordered items may have been delivered to the first, second, third, and fourth destinations1021,1041,1031, and1011.

The electronic device1000, in response to recognizing delivery of at least one item indicated in an order received from a destination, may perform an operation of indicating a serving tray accommodating an auxiliary item relevant to the at least one item. For example, the electronic device1000may perform at least one of outputting, on a display module, an image indicating the serving tray accommodating the auxiliary item, outputting, from a sound output module, speech sound indicating the serving tray accommodating the auxiliary item, and emitting, from a lighting module, light indicating the serving tray accommodating the auxiliary item. The lighting module may emit light toward an item on a serving tray or light from one side of the serving tray. In the example illustrated inFIG.10, the electronic device1000, at the third destination1031, may output a guide1032(e.g., speech sound and text) to the first serving tray1001accommodating an auxiliary item (e.g., sauce) accompanied by one (e.g., steak) of the delivered items. The electronic device1000, at the fourth destination1011, may output a guide1012to the first serving tray1001accommodating an auxiliary item (e.g., pickles) accompanied by a delivered item (e.g., a salad).

In addition, the electronic device1000, based on a type of order received independently from a service state, may determine a serving tray to be guided at each destination. For example, an order (e.g., a pizza order) involving an additional item (e.g., kids tableware and tableware for sharing food) may be received from the first destination1021. The electronic device1000, in response to receiving an order for which an additional item is needed from a customer at the first destination1021, may perform an operation of indicating a serving tray accommodating the additional item at the first destination1021. For example, the electronic device1000may perform at least one of outputting, on a display module1009, an image indicating the serving tray accommodating the auxiliary item, outputting, from a sound output module, speech sound indicating the serving tray accommodating the auxiliary item, and emitting, from a lighting module, light indicating the serving tray accommodating the auxiliary item. In the example illustrated inFIG.10, the electronic device1000may output a guide1022to the third serving tray1003accommodating tableware for sharing food (e.g., a pizza cutter) as an additional item needed for an item (e.g., pizza) delivered to the first destination1021. In addition, the electronic device1000may output the guide1022to the third serving tray1003accommodating an additional item (e.g., kids tableware) for a child customer among customers at the first destination1021.

The electronic device1000may guide a customer to a serving tray (e.g., the second serving tray1002) accommodating a basic item at a destination where all auxiliary and additional items needed to be provided in a service state of the destination have been provided. For example, at the second destination1041, an auxiliary item (e.g., ketchup) accompanied by an item (e.g., French fries) delivered in a serving incomplete state may have been delivered already. The electronic device1000may output a guide1042to a basic item at the second destination1041.

FIG.11is a diagram illustrating an example drive along a route including a plurality of destinations having different service states by an electronic device according to various example embodiments.

An electronic device1100, when a drive along a route is completed, in response to not delivering, to a first destination, at least one item indicated in an order received from the first destination, may exclude the first destination from the route. For example, the electronic device1100may exclude, from the route, a destination having completed payment or a destination where an order has been received and at least one item indicated in the order is yet to be delivered. For example, in the example illustrated inFIG.11, a fourth destination1111may be in a payment complete state and may not need to be visited. A third destination1131may be in an order complete state where an order has been received but none of the ordered items have been delivered at all. The electronic device1100may determine not to visit the third and fourth destinations1131and1111respectively in operations1132and1112and exclude the third and fourth destinations1131and1111from a route1190. Accordingly, the electronic device1100, unlike the description provided with reference toFIGS.9and10, may drive itself along the route1190modified from a default route.

However, examples are not limited to a destination in an order complete state, such as the third destination1131, being always excluded from a route. The electronic device1100may include the destination in an order complete state in the route when the destination does not have a visited history. The electronic device1100may output information guiding a customer to a serving tray (e.g., a second serving tray1102) accommodating a basic item at a destination having no visited history using at least one of a display module1109, a sound output module, and a lighting module. When there is no visited history, basic tableware needed for having a meal may not be set. As another example, the electronic device1100may visit a destination in an order complete state in response to a customer's request. The electronic device1100, in response to receiving a request for an additional item (e.g., water and glasses) from a customer, may guide the customer to a serving tray (e.g., a third serving tray1103) accommodating the additional item by visiting a destination where the customer is located.

InFIG.11, a first destination1121may be in a serving incomplete state and auxiliary and additional items related to an ordered item (e.g., pizza) may have been delivered already. The electronic device1100, in response to a plurality of visits to the first destination1121in a serving incomplete state, when reaching the first destination1121, may provide a guide1122to a serving tray (e.g., the second serving tray1102) accommodating a basic item. A second destination1141may be in a serving complete state, and the electronic device1100may provide a guide1142to a serving tray (e.g., a first serving tray1101) accommodating an auxiliary item.

FIG.12is a diagram illustrating an example of skipping some destinations when inventory is insufficient during a circular drive by an electronic device according to various example embodiments.

An electronic device1200, in response to insufficient inventory while driving a route, may continue a drive to the remaining first destination of the first destination and a second destination of the route while skipping the second destination for which an inventory item is insufficient for a needed item.

The same example of order information of each destination as the example provided inFIG.11is illustrated inFIG.12. The electronic device1200may not visit third and fourth destinations1231and1211respectively in operations1232and1212. The electronic device1200may provide a guide1222to a second serving tray accommodating a basic item, similar to the description provided with reference toFIG.11. In the example illustrated inFIG.12, the electronic device1200may sequentially visit first and second destinations1221and1241. The electronic device1200may detect, from a first serving tray1201, insufficient inventory of an auxiliary item (e.g., pickles) needed for the second destination1241on the way to the second destination1241. The electronic device1200, while driving itself along a route1290, may skip a visit to the second destination1241and visit the remaining destination.

As another example, the electronic device1200, while driving itself along the route1290, when a customer at one destination takes a greater quantity of an item than a quantity estimated to be needed, may have inventory of which the quantity is less than a quantity needed for a destination to be visited next. The electronic device1200may skip a visit to the destination scheduled to be visited next. In other words, the electronic device1200may monitor inventory in real time during a circular drive and may dynamically determine whether to visit each destination when the monitored inventory is insufficient. The electronic device1200, when determining to skip a visit to a destination during the circular drive, may skip the destination while maintaining a route or modify the route by excluding the destination.

FIG.13is a diagram illustrating an example operation of reporting insufficient inventory to a manager by an electronic device according to various example embodiments.

An electronic device1300may monitor inventory of each serving tray during a drive along a route1391. When detecting insufficient inventory during the drive, the electronic device1300may skip a visit to a destination needing an item of which inventory is insufficient. The electronic device1300may form a new route1392by excluding some destinations from the route1391. For example, in the example illustrated inFIG.13, the electronic device1300, which drove along the route1391, in the middle of the route1391, may detect that an auxiliary item (e.g., a side dish) and an additional item (e.g., water and glasses) are insufficient. In other words, the electronic device1300may detect insufficient inventory from first and third serving trays1301and1303. As described above, the electronic device1300, through a camera sensor1310, may monitor inventory of the first serving tray1301, a second serving tray1302, and the third serving tray1303.

For example, the electronic device1300, in response to detecting insufficient inventory, may update an insufficient inventory situation in a database having recorded a customer's request. As another example, the electronic device1300may notify a user1380(e.g., an employee) of insufficient inventory. The electronic device1300may transmit a message including information1350(e.g., a type of insufficient item on the first and third serving trays1301and1303) notifying the user1380of the insufficient inventory on a terminal (e.g., a wearable device and a device for executing an application for a manager) of the user1380. Yet another example, the electronic device1300may move to a location near the user1380and directly request the user1380to replenish inventory by outputting, to the user1380, the information1350notifying the user1380of the insufficient inventory through speech sound or on a display module.

In addition, other than notifying of the insufficient inventory, the electronic device1300, when completing serving items by visiting each destination, may report serving completion to a POS device and a terminal (e.g., a wearable device) of the user1380.

The electronic device1300may automatically determine a destination to be visited, based on each destination's service state determined based on order information, while autonomously, circular driving in a service space (e.g., a restaurant). The electronic device1300may guide a customer to a serving tray accommodating an item needed for each destination in each service state while driving itself along a route including the automatically determined destination.

While the disclosure has been illustrated and described with reference to various example embodiments, it will be understood that the various example embodiments are intended to be illustrative, not limiting. It will be further understood by those skilled in the art that various changes in form and detail may be made without departing from the true spirit and full scope of the disclosure, including the appended claims and their equivalents. It will also be understood that any of the embodiment(s) described herein may be used in conjunction with any other embodiment(s) described herein.