Abstract:
An interactive child&#39;s doll may include: an electronic circuit housed in a body, the electronic circuit including a microcontroller, a motion/position/orientation determining module coupled to the microcontroller, a sensor module coupled to the microcontroller for providing data related to the environment in which the body is located, a sound generating module coupled to the microcontroller for generating audio signals for interacting with the child, a memory module coupled to the microcontroller for storing instructions and data received from the wireless device and for storing preprogrammed instructions and data for controlling interactivity with the wireless device, and a power supply for providing power to the electronic circuit. A wireless remote control device that commands and interacts with the doll and may receive wirelessly instructions for commanding the interactive doll is also described.

Description:
CROSS-REFERENCE TO RELATED APPLICATION 
       [0001]    The present non-provisional patent application claims the benefit of priority from U.S. Provisional Patent Application No. 62/043,099, filed Aug. 28, 2014, the entire contents of which are incorporated herein by reference. 
     
    
     BACKGROUND 
       [0002]    1. Field of the Disclosure 
         [0003]    The present invention relates to the field of interactive smart dolls and to smartphones with applications and remote controllers that interact therewith. 
         [0004]    1. Related Art 
         [0005]    Children have been playing with dolls for a very long time. Interactive toys, remote controlled dolls and the like are well known. A toy or other plaything may stimulate a child&#39;s imagination and an interactive toy can enhance the child&#39;s experience. A doll that interacts with a child and can initiate interaction, and can be controlled through a smartphone or other remote control device would provide a more engaging experience for the child or user. 
       SUMMARY OF THE INVENTION 
       [0006]    The present disclosure describes an interactive smart doll that can interact with a child or adult via a wireless device such as a smartphone or remote control device and that includes an on-board microprocessor controller that receives wireless commands that enable the doll to interact with the child and/or adult. The interactive doll may be shaped and have the appearance of a toy or stuffed animal that includes a control module with an integrated chip that can communicate via Bluetooth, including BLE (Bluetooth Low Energy), Wi-Fi or the like, and can interact with children or adults using speakers and sensors that are on board or that are communicatively linked so as to be attractive to children and adults. 
         [0007]    The doll includes sensors and controls for determining its position/orientation and temperature and peripheral interactive devices such as audio transducers and servo/motor devices to enable interaction with the child/adult. 
         [0008]    Disclosed are an interactive doll, a non-transitory computer or processor-readable medium that controls the doll, a system that may include the doll and a wireless remote control device, a method and means for performing the method that provide the features described herein. Such an interactive child&#39;s doll may include: 
         [0009]    a body; 
         [0010]    an electronic circuit housed in the body, the electronic circuit comprising: 
         [0011]    a microcontroller; 
         [0012]    a motion/position/orientation determining module coupled to the microcontroller; 
         [0013]    a wireless receiving and transmitting module coupled to the microcontroller for providing data and instructions to the microcontroller received from a remote wireless device and for transmitting data and instructions to the remote wireless device; 
         [0014]    a sensor module coupled to the microcontroller for providing data related to the environment in which the body is located; 
         [0015]    a sound generating module coupled to the microcontroller for generating audio signals for interacting with the child; 
         [0016]    a memory module coupled to the microcontroller for storing instructions and data received from the wireless device and for storing preprogrammed instructions and data for controlling interactivity with the wireless device; and 
         [0017]    a power supply for providing power to the electronic circuit. 
         [0018]    A wireless remote control device is also contemplated in combination with the interactive doll. Such a wireless remote control device may be a mobile device that includes a memory incorporating instructions for commanding the interactive doll. 
         [0019]    Also contemplated is a system that includes the interactive doll and a mobile device that receives wirelessly instructions for commanding the interactive doll. 
         [0020]    In such an interactive doll, the sensor module may include a temperature sensor for sensing the temperature of the doll&#39;s environment. 
         [0021]    In such an interactive doll, the sound generating module may include one or more speakers positioned in or at the body of the doll. 
         [0022]    Such an interactive doll may also include motor controls and servos for moving parts of the doll body. 
     
    
     
       BRIEF DESCRIPTION OF THE DRAWINGS 
         [0023]    The invention will be described in greater detail in the following detailed description with reference to the drawings, in which: 
           [0024]      FIG. 1  shows an example of an on-board controller in the doll; 
           [0025]      FIG. 2  shows an example of an operating environment; 
           [0026]      FIG. 3A  shows an example of an on-board microcontroller circuit, including the U16A; 
           [0027]      FIG. 3B  shows an example of an on-board microcontroller circuit, including the U16B; 
           [0028]      FIG. 4  shows an example of a wireless component, specifically a Bluetooth controller; 
           [0029]      FIG. 5  shows an example of a memory card and connection, specifically an SD card; 
           [0030]      FIG. 6  shows an example of a power supply circuit for the on-board controller; 
           [0031]      FIG. 7  shows an example of a motion processing unit circuit; 
           [0032]      FIG. 8  shows an example of a temperature sensing circuit; and 
           [0033]      FIG. 9  shows an example of an audio circuit. 
       
    
    
       [0034]    Other features and advantages of the present invention will become apparent from the following description of the invention that refers to the accompanying drawings. 
       DETAILED DESCRIPTION OF THE EMBODIMENTS 
       [0035]    As illustrated in  FIG. 2 , doll  21  can interact with a child if the child uses a wireless mobile device  23 , which may be a smartphone, mobile or cordless phone or other handheld device, a tablet, a desktop, laptop computer or via other types of processor-based device or other types of electronic communication device or system. Instead or in addition, a user can use a dedicated wireless remote control device  24  (which may also be a universal remote control device). An application (App) for controlling interactive doll  21  may be downloaded by user to mobile device  23 . 
         [0036]    For example, the proximity of the child holding the mobile device  23  or remote control device  24  may be detected and when the mobile device  23  or remote controller  24  is within range of Bluetooth communication of doll  21 , or is within a pre-specified distance of interactive doll  21 , the doll can greet the child. The greeting may specify the child&#39;s name, using previously provided programming identifying the user of mobile device  23  or remote controller  24 , and can include a greeting suitable for the time of day, such as “good morning,” “good evening” or the like or for the time of year, such as “Merry Christmas” or the like, since the application in mobile device  23  or microcontroller inside interactive doll  21  can know the time of day and the dates on the calendar. A Bluetooth low energy module can be in mobile device  23  and in the doll to allow wireless sharing of information. A controller card inside interactive doll  21  can generate signals to produce sound waves provided to a speaker. One or more speakers can be provided inside interactive doll  21 , and/or one or more speakers can be used inside of mobile device  23 . As an alternative, speakers in the vicinity around the house may also be controlled, or some combination of speakers as described in the foregoing may be controlled and provided with signals to generate the desired speech, music, alarm or other sounds. 
         [0037]    When a certain time of the day is reached, interactive doll  21  can announce to the child that it is time to go to sleep. For example, the child can be told “Let&#39;s go to sleep” and this and similar messages can be repeated until a sensor detects that interactive doll  21  is in, or substantially in, a horizontal position. Similarly, interactive doll  21  can prod the child to get up with pleasant pre-recorded messages, music, chime, or the like, and such messages can be repeated until the sensor detects that doll  21  is in the vertical position or in a position close to the vertical position. 
         [0038]    Mobile device  23  can also communicate with interactive doll  21  via wireless router  26  connected via modem  27  and the cloud to and on premises or off premises server  31 . Also, mobile device  23  can communicate with doll  21  using a cellular telephone link via cell tower  35  connected via cell network internet gateway  36  to the cloud and to server  31 . 
         [0039]    Optionally, server  31  may store information about each user, and each interactive doll, such as last known position of doll, last known orientation of doll, user preferences for greetings, names of child and parents, parental controls for emergency alarms, user programming and settings for the doll, payment and subscription information for app downloads and for doll use, last time user communicated with doll, last time app was downloaded, and so forth. 
         [0040]    As discussed, remote control  24  may communicate directly with interactive doll  21  via Bluetooth or other radiofrequencies or via an infrared link. A microcontroller may be included in doll  21  and may be connected to a speaker either on board doll  21  or wirelessly in the surrounding environment. Sound data can be processed from files written on SD cards positioned in interactive doll  21  or in mobile device  23 . As a child or the person holding remote control  24  or holding mobile device  23  configured with the application approaches the doll, the doll can greet with “Good Morning” or some other greeting, and can customize the greeting to the child&#39;s name if the doll is programmed. For example, the BLE module in mobile device  23  and inside interactive doll  21  can allow passing of information about who is coming near interactive doll  21 , and how far the person is from interactive doll  21 . 
         [0041]    At a certain time of the day, the doll can remind the child of a task to be performed, such as brushing teeth or going to sleep with an appropriate greeting, that may include the child&#39;s name. For example, a motion processing unit module 9DOF-IMU 34 available from InvenSense, Inc. that includes a 3 axis gyroscope, 3 axis accelerometer, 3 axis magnetometer and digital motion processor may be used. As shown in  FIG. 1 , the accelerometer can detect motion and directional orientation of the doll, and thus can know whether the doll is standing up or sitting down. Via the magnetometer, the doll can recognize spatial orientation, such as north, south, east or west, as well as latitude and longitude. A GPS device may also be included in interactive doll  21  or in mobile device  23  or in a device in communication with the foregoing. This may provide a tracking feature for interactive doll  21  and/or mobile device  23  and/or remote control  24  to enhance safety and to support other features. 
         [0042]    Interactive doll  21  may include a temperature sensor. A temperature sensor may be included in interactive doll  21 , or such information may be received by interactive doll  21  or by mobile device  23  with suitable application. When it is hot or cold, the doll may be able to announce a warning to the child, including the temperature information, and advice about putting on or taking off clothing. For example, a temperature sensor inside doll  21  or inside mobile device  23  may transmit using BLE such temperature information, and the doll can receive data by the current temperature and what text to say at the various temperatures. Alternatively, such information may be transmitted via WIFI  26  and modem  27  through cloud to server  31 . Server  31  may store user preferences for various temperatures, e.g. prompt child to put on long sleeve shirt when temperature dips below 68 degrees Fahrenheit, and prompt child to put on sweater when temperature reaches below 60 degrees Fahrenheit, such settings being default or being set by parents in advance via mobile device  23 . 
         [0043]    Using mobile device  23 , parents can send a text message if they want the child to be advised of something, such as “You did a great job today” or “Peter, you were awesome today.” An application on mobile device  23  can have an area for text to be transmitted. The text can be typed by the parent into mobile device  23  and sent as an audio file with for example extension “.way.” This file can be created by text-to-speech program, such as IVONA, and then can be sent via BLE (or any other radio-link) to the SD card in interactive doll  21 . When the transmission is received, interactive doll  21  can retrieve the sound file. Alternatively, the text can be sent as text to interactive doll  21  for decoding into sound files by interactive doll  21 . The latter may be a faster transmission but require more processing by microcontroller in interactive doll  21 . 
         [0044]    At certain times of the day, interactive doll  21  can generate reminders about activities or can announce a previously provided text. For example, on child&#39;s birthday, the interactive doll  21  can say “Happy Birthday, Liliana!” or before bedtime can inquire of the child whether the child brushed her teeth. With a real-time clock module, interactive doll  21  may replace certain sounds stored as sound files in interactive doll  21 . Actual time may be synchronized with mobile device  23 . For example, messages can be programmed using mobile device  23 , and sent as a sound file or in some other way to interactive doll  21 , where they can be stored for later use. Many of the settings of interactive doll  21  can be programmed using the application provided on mobile device  23 . 
         [0045]    Instead of or in addition to mobile device  23 , remote control  24 , necklace or band worn on a body may include a BLE module or other microcontroller. For example, a child may wear as an accessory such a band to allow interactive doll  21  to recognize when the child is nearby, for example, within a previously set distance, or within range of Bluetooth. In such an arrangement, mobile device  23  used by the parents or other people in the household can be used to program interactive doll  21 , and to provide texts to be announced by interactive doll  21 . In such a scenario, the child may not know where the text is coming from, i.e., the parents, family members, teachers, friends, etc. Accordingly, birthday wishes, other information, prompts or directions can be sent by caregivers to interactive doll  21  for the child. A remote controller or band can have its own power source, such as a small battery. 
         [0046]    Limbs, eyes, ears and mouth and the like of interactive doll  21  may also be controlled to move, extend, open, close and the like using servo-motor controls. Such motions can simulate or augment emotional responses as appropriate for various things interactive doll  21  is heard to “say” or as dictated by other circumstances, such as birthdays and the like. 
         [0047]    By way of illustrative example, particular implementations will be described with respect to electronic devices inside interactive doll  21 . However, it will be understood that many other implementations are also contemplated, and some of the features recited may be provided in mobile device  23  or in other devices with which mobile device  23  and/or interactive doll  21  is in communication. 
         [0048]      FIG. 1  shows a microcontroller that may be provided inside interactive doll  21 .  FIGS. 3A and 3B  illustrate an example of a microcontroller solution, which may comprise an STM32F405XX or STM32F407XX type controller with an ARM 32 bit cortex, a memory, an LCD parallel interface, a clock, 140 ports, fifty or more communication interfaces and other components, available from ST Microelectronics. 
         [0049]      FIG. 4  illustrates a Bluetooth low-energy (BLE) circuit, which, for example, may be a BLE 112 product available from Bluegiga, and may use Bluetooth version 4.0 or other versions. Ultra low current consumption may be implemented to prolong battery life, and a programmable 8051 processor may be used. 
         [0050]      FIG. 5  illustrates a Micro SD card interface. 
         [0051]      FIG. 6  illustrates an example of a power supply circuit for the on board circuit. The power supply is illustratively four AA cells. An on-off switch SW2A is provided. The on-off switch controls the channels of two FETs T 3  and T 6 . When on, FET T 6  provides battery power to line V BAT . Two regulators are illustratively shown, one (U4) providing 3.3V DC and one (U4) providing 5V for the various on board circuits. A control line +5V ON is provided to turn on the +5V regulator via transistors T 7  and T 8 . Transistor T 5  and zener diode D 1  provide over voltage protection. Illustratively, if V BAT  exceeds 6.8V, transistor T 6  is turned off via transistor T 5 . The regulators U2 and U4 may be type AP 1117 E50/AP1117 E33, 5V and 3.3V respectively. 
         [0052]      FIG. 7  illustrates a motion sensor, which may be an MPU-9150-type product, available from InvenSense, Inc., which can include a gyroscope, an accelerometer, a magnetometer, motion processing, a clock and additional features. 
         [0053]      FIG. 8  illustrates an example of a temperature sensor employing two digital thermometers that may be used. The digital thermometer may be type DS18B20 available from Maxim Integrated. One or more temperature sensors may be used, for example, at different parts of the body of interactive doll  21  for more accurate readings. For example, one side of interactive doll  21  may be exposed to direct sunlight and thus give an inaccurate reading. Such readings can be discounted or ignored. 
         [0054]      FIG. 9  illustrates an audio circuit using a type TPA301D audio amplifier IC available from Texas Instruments. It will be understood that other combinations and other implementations are also contemplated. 
         [0055]    Disclosed is a device, a non-transitory computer or processor readable medium that stores instructions that provide the functionality described, a system and method that provide such functionality, and means for implementing such functionality. The present methods for controlling the interactive doll and its functions may be implemented using hardware, software, firmware or a combination of the foregoing, and may be implemented by one or more microcontroller and chips. The functions for the interactive doll could be performed entirely automatically through automated operations, but need not be entirely performed by machines. 
         [0056]    A computing device or chip as described herein for the interactive doll, the mobile device, and/or the remote control may include one or more processors located in one or more units for performing the system according to the present disclosure. One or more of these processors may be located away from the interactive doll and the mobile device, or may be off premises and communicate with the interactive doll and/or the mobile device via a radio or other wireless connection. Similarly, information stored, such as greeting information, name of the child, and the like, may be stored in a cloud or may be stored locally or remotely. 
         [0057]    The application downloaded to the mobile device for controlling or for interacting with the interactive doll may include a GUI (Graphical User Interface), or may include graphics, text and other types of information. The interactive doll may also receive software and software updates for adding or improving functions, for example, from the mobile device or from a wireless router or the like. The mobile device and the interactive doll may include a memory, preferably a random access memory, and may include a secondary memory, and may be implemented using any appropriate storage medium. Examples of a memory or a computer-readable storage medium product include a removable memory chip, such as an erasable programmable read-only memory (EPROM), a programmable read-only memory (PROM), removable storage unit or the like. 
         [0058]    The communication interface may include a wired or wireless interface communicating over TCP/IP paradigm or other types of protocols, and may communicate via a wire, cable, fiber optics, a telephone line, a cellular link, an infrared link, a radio frequency link, such as WI-FI or Bluetooth, a LAN, a WAN, VPN, the world wide web or other such communication channels and networks, or via a combination of the foregoing. 
         [0000]    While the preferred embodiments of the invention have been illustrated and described, modifications and adaptations, and other combinations or arrangements of the structures and steps described come within the spirit and scope of the application and the claim scope.