Patent Description:
Electronic devices integrated with microphones have been widely used to collect voice inputs from users and implement different voice-activated functions according to the voice inputs. These electronic devices, when made at a low cost and with relatively simple structures, are disposed at different locations in a smart home environment, so that they can be used as user interface devices to listen to the ambient environment and follow a user constantly without disturbing regular activities of the user. The electronic devices disposed at different locations in a smart home environment could be subject to restricted footprints, especially in areas such as a cluttered kitchen countertop or bedroom nightstand. As such, it would be beneficial to pack a number of mechanical and electronic parts into a small package in order to accommodate a smaller footprint. This, however, can potentially cause unintended consequences such as muffled sound due to the speaker being obscured underneath other components, such as a display screen. Further, it would be beneficial in designing a smaller footprint for the overall design to be substantially vertical. However, the more vertical the design, the greater the potential for falling over during physical user interactions due to a higher center of mass. It would be beneficial to incorporate one or more space saving designs that do not negatively affect sound quality, and further allow for a vertically oriented device to maintain a lower center of mass.

<CIT> discloses a display device with improved sound clearness in a mid-frequency range or a low-frequency range, and with a reduced opening area on the front surface side of the display device. The display device has a speaker device having a downwardly oriented sound emitting surface and mounted inside a cabinet, and is mounted on a mounting base. The display device is provided with: a bottom member which is disposed at the bottom of the cabinet facing the sound emitting surface, and which has a bottom opening allowing sound from the speaker device to be output toward the mounting base; and a front opening which is disposed at the front of the cabinet facing the front surface of the display device, and which allows the sound from the speaker device to be output toward the front surface of the display device. The bottom member is formed to allow the sound from the speaker device to be reflected toward the front opening.

<CIT> discloses a liquid crystal display including speakers within a stand and having a display unit, a display angle of which can be adjusted by a cam in order that a user can conveniently see it. The stand supports the display unit through a support and has an inclined part between a front part and a rear part. In addition, a speaker for outputting a high-pitched sound is installed within the front part of the stand and speakers for outputting a middle-low pitched sound are installed within the both sides of the stand. The support is rotatably connected to the display unit and the stand by a driving of the cam and contacted with the cam provided to toe inclined part of the stand and the angle of the support is adjusted by a rotation of the cam and so an angle of the display unit is adjusted.

<CIT> discloses a speaker mounting structure that includes a speaker including a sound output surface, a front casing containing a display panel, a rear casing which is installed on a rear of the front casing and houses the speaker such that the sound output surface faces a direction opposite to the direction that the front casing faces, and a sound-reflecting member which is mounted on the rear casing so as to face the sound output surface of the speaker and which reflects the sound that is output from the sound output surface toward the front of the front casing.

<CIT> discloses a low profile speaker system that can be mounted to the back of a flat panel display. The speaker system can be supported using a stand, wherein the stand is integral to the speaker system support architecture and supports both the speaker system and flat panel display.

In one aspect of the present disclosure, an electronic device that is applied in a smart home environment to provide an eyes-free and hands-free voice interface that can activate voice-activated functions for media devices or smart home devices in the smart home environment is disclosed. The electronic device is configured to sit at a fixed location in the smart home environment, and at least includes a display screen in addition to a microphone and a speaker. The electronic device does not include a complicated operating system, but provides a low cost user interface solution dedicated to constantly listening to its surroundings, collecting audio inputs, and presenting both audio and video information in response to the audio inputs. Further, in some implementations, the audio inputs are collected from the surroundings to initiate voice-activated functions on other media play devices or smart home devices coupled within the smart home environment.

In one aspect of the present disclosure, a display assistant device includes a speaker mounted in a waveguide structure which is at least partially disposed beneath a display screen. The waveguide structure is mounted in an exterior housing which includes speaker grills distributed on a plurality of surfaces of the exterior housing, permitting sound waves from the speaker to be projected outside the exterior housing. A cover structure is disposed on top of the waveguide structure to conceal the waveguide structure and speaker within the exterior housing. The cover structure has a tilted bottom surface configured to be suspended above the waveguide structure and to be separated by a first space. Sound waves projected from an upper portion of the speaker are reflected by the tilted bottom surface and are guided through the first space to exit the device from a speaker grill portion located on a rear side of the exterior housing.

In accordance with various implementations, the display assistant device has a substantially small footprint that allows the display assistant device to be conveniently disposed at many different locations (e.g., a kitchen, living room and bedroom) in the smart home environment. Despite the substantially small footprint, the speaker has a relatively heavy weight and is configured to pull a center of mass of the display assistant device close to the surface on which the display assistant device sits. A low center of mass allows the display assistant device to maintain stability at time of being touched or hit. In addition, the display assistant device further includes many mechanical features configured to protect the screen of the display assistant from falling apart from the base and being damaged when the display assistant device hits a floor. By these means, this application provides a low-cost, mechanically robust, and voice-activated user interface solution that has visual display capabilities and supports various voice-activated functions.

For a better understanding of the various described implementations, reference should be made to the Description of Implementations below, in conjunction with the following drawings in which like reference numerals refer to corresponding parts throughout the figures.

While digital revolution has provided many benefits ranging from openly sharing information to a sense of global community, emerging new technology often induces confusion, skepticism and fear among consumers, preventing consumers from benefitting from the technology. Electronic devices are conveniently used as voice interfaces to receive voice inputs from users and initiate voice-activated functions, and thereby offer eyes-free and hands-free solutions to approach both existing and emerging technology. Specifically, the voice inputs received at an electronic device can carry instructions and information even if a user's line of sight is obscured and his hands are full. To enable hands-free and eyes-free experience, the voice-activated electronic device listens to the ambient (i.e., processes audio signals collected from the ambient) constantly or only when triggered. On the other hand, user identities are linked with a user's voice and a language used by the user. To protect the user identities, voice-activated electronic devices are normally used in non-public places that are protected, controlled and intimate spaces (e.g., home and car).

In accordance with some implementations of the invention, a voice-activated electronic device includes a screen configured to provide additional visual information in addition to audio information that can be broadcast via a speaker of the voice-activated electronic device. The voice-activated electronic device, when integrated with its own display screen, constitutes a display assistant device. The display assistant device thereby includes a base and a speaker in addition to the screen. The base is configured for sitting on a surface. The screen has a rear surface and is supported by the base at the rear surface. A bottom edge of the screen is configured to be held above the surface by a predefined height, and the base is substantially hidden behind the screen from a front view of the display assistant device (i.e., the screen appears to float in air from the front view). The speaker is concealed inside the base and configured to project sound substantially towards the front view of the display assistant device. The display assistant device has a substantially small footprint, and however, a center of mass of the display assistant device is configured to be close to a surface on which the display assistant device sits, thereby allowing the display assistant device to maintain stability at time of being touched or hit. The display assistant device further includes a plurality of mechanical features configured to protect the screen from falling apart from the base and being damaged when the display assistant device hits a floor. That said, the display assistant device provides a low-cost, mechanically robust, and voice-activated user interface solution that has visual display capabilities and supports various voice-activated functions.

Reference will now be made in detail to implementations, examples of which are illustrated in the accompanying drawings. In the following detailed description, numerous specific details are set forth in order to provide a thorough understanding of the various described implementations. However, it will be apparent to one of ordinary skill in the art that the various described implementations may be practiced without these specific details. In other instances, well-known methods, procedures, components, circuits, and networks have not been described in detail so as not to unnecessarily obscure aspects of the implementations.

<FIG> is an example smart home environment <NUM> in accordance with some implementations. The smart home environment <NUM> includes a structure <NUM> (e.g., a house, office building, garage, or mobile home) with various integrated devices. It will be appreciated that devices may also be integrated into a smart home environment <NUM> that does not include an entire structure <NUM>, such as an apartment, condominium, or office space. The depicted structure <NUM> includes a plurality of rooms <NUM>, separated at least partly from each other via walls <NUM>. The walls <NUM> may include interior walls or exterior walls. Each room may further include a floor <NUM> and a ceiling <NUM>.

One or more media devices are disposed in the smart home environment <NUM> to provide media content that is stored at a local content source or streamed from a remote content source (e.g., content host(s) <NUM>). The media devices can be classified to two categories: media output devices <NUM> that directly output the media content to audience, and cast devices <NUM> that are networked to stream media content to the media output devices <NUM>. Examples of the media output devices <NUM> include, but are not limited to television (TV) display devices and music players. Examples of the cast devices <NUM> include, but are not limited to, set-top boxes (STBs), DVD players and TV boxes. In the example smart home environment <NUM>, the media output devices <NUM> are disposed in more than one location, and each media output device <NUM> is coupled to a respective cast device <NUM> or includes an embedded casting unit. The media output device <NUM>-<NUM> includes a TV display that is hard wired to a DVD player or a set top box <NUM>-<NUM>. The media output device <NUM>-<NUM> includes a smart TV device that integrates an embedded casting unit to stream media content for display to its audience. The media output device <NUM>-<NUM> includes a regular TV display that is coupled to a TV box <NUM>-<NUM> (e.g., Google TV or Apple TV products), and such a TV box <NUM>-<NUM> streams media content received from a media content host server <NUM> and provides an access to the Internet for displaying Internet-based content on the media output device <NUM>-<NUM>.

In addition to the media devices <NUM> and <NUM>, one or more electronic devices <NUM> are disposed in the smart home environment <NUM> to collect audio inputs for initiating various media play functions of the media devices. In some implementations, these voice-activated electronic devices <NUM> (e.g., devices <NUM>-<NUM>, <NUM>-<NUM> and <NUM>-<NUM>) are disposed in proximity to a media device, for example, in the same room with the cast devices <NUM> and the media output devices <NUM>. Alternatively, in some implementations, a voice-activated electronic device <NUM>-<NUM> is disposed in a room having one or more smart home devices but not any media device. Alternatively, in some implementations, a voice-activated electronic device <NUM> is disposed in a location having no networked electronic device.

The electronic device <NUM> includes at least one or more microphones, a speaker, a processor and memory storing at least one program for execution by the processor. The speaker is configured to allow the electronic device <NUM> to deliver voice messages to a location where the electronic device <NUM> is located in the smart home environment <NUM>, thereby broadcasting music, reporting a state of audio input processing, having a conversation with or giving instructions to a user of the electronic device <NUM>. As an alternative to the voice messages, visual signals could also be used to provide feedback to the user of the electronic device <NUM> concerning the state of audio input processing. When the electronic device <NUM> is a conventional mobile device (e.g., a mobile phone or a tablet computer) or has its own display screen, its display screen is configured to display a notification concerning the state of audio input processing.

In accordance with some implementations, the electronic device <NUM> is a voice interface device that is network-connected to provide voice recognition functions with the aid of a cloud cast service server <NUM> and/or a voice/display assistance server <NUM>. For example, the electronic device <NUM> includes a smart speaker that provides music to a user and allows eyes-free and hands-free access to voice assistant service (e.g., Google Assistant). Optionally, the electronic device <NUM> is one of a desktop or laptop computer, a tablet and a mobile phone that includes a microphone. Optionally, the electronic device <NUM> is a simple and low cost voice interface device, e.g., a speaker device and a display assistant device (including a display screen having no touch detection capability).

In some implementations, the voice-activated electronic devices <NUM> includes a display assistant device (e.g., <NUM>-<NUM> and <NUM>-<NUM>) that incorporates a display screen in addition to the microphones, speaker, processor and memory. The display screen is configured to provide visual information in addition to audio information that can be broadcast via the speaker of the voice-activated electronic device <NUM>. When a user is nearby and his or her line of sight is not obscured, the user may review the visual information directly on the display screen of the display assistant device. Optionally, the visual information provides feedback to the user of the electronic device <NUM> concerning the state of audio input processing. Optionally, the visual information is provided in response to the user's previous voice inputs, and may be related to the audio information broadcast by the speaker. In some implementations, the display screen of the voice-activated electronic devices <NUM> includes a touch display screen configured to detect touch inputs on its surface. Alternatively, in some implementations, the display screen of the voice-activated electronic devices <NUM> is not a touch display screen, which is relatively expensive and can compromise the goal of offering the display assistant device <NUM> as a low cost user interface solution.

When voice inputs from the electronic device <NUM> are used to control the media output devices <NUM> via the cast devices <NUM>, the electronic device <NUM> effectively enables a new level of control of cast-enabled media devices independently of whether the electronic device <NUM> has its own display. In a specific example, the electronic device <NUM> includes a casual enjoyment speaker with far-field voice access and functions as a voice interface device for Google Assistant. The electronic device <NUM> could be disposed in any room in the smart home environment <NUM>. When multiple electronic devices <NUM> are distributed in multiple rooms, they become audio receivers that are synchronized to provide voice inputs from all these rooms.

Specifically, in some implementations, the electronic device <NUM> includes a WiFi speaker with a microphone that is connected to a voice-activated personal assistant service (e.g., Google Assistant). A user could issue a media play request via the microphone of electronic device <NUM>, and ask the personal assistant service to play media content on the electronic device <NUM> itself or on another connected media output device <NUM>. For example, the user could issue a media play request by saying to the WiFi speaker "OK Google, Play cat videos on my Living room TV. " The personal assistant service then fulfils the media play request by playing the requested media content on the requested device using a default or designated media application.

A user could also make a voice request via the microphone of the electronic device <NUM> concerning the media content that has already been played on a display device. In some implementations, closed captions of the currently displayed media content are initiated or deactivated on the display device by voice when there is no remote control or a second screen device is available to the user. Thus, the user can turn on the closed captions on a display device via an eyes-free and hands-free voice-activated electronic device <NUM> without involving any other device having a physical user interface, and such a voice-activated electronic device <NUM> satisfies federal accessibility requirements for users having hearing disability. In some implementations, a user may want to take a current media session with them as they move through the house. This requires the personal assistant service to transfer the current media session from a first cast device to a second cast device that is not directly connected to the first cast device or has no knowledge of the existence of the first cast device. Subsequent to the media content transfer, a second output device <NUM> coupled to the second cast device <NUM> continues to play the media content previously a first output device <NUM> coupled to the first cast device <NUM> from the exact point within a music track or a video clip where play of the media content was forgone on the first output device <NUM>.

In some implementations, in addition to the media devices (e.g., the output devices <NUM> and the cast devices <NUM>) and the voice-activated electronic devices <NUM>, smart home devices could also be mounted on, integrated with and/or supported by a wall <NUM>, floor <NUM> or ceiling <NUM> of the smart home environment <NUM> (which is also broadly called as a smart home environment in view of the existence of the smart home devices). The integrated smart home devices include intelligent, multi-sensing, network-connected devices that integrate seamlessly with each other in a smart home network and/or with a central server or a cloud-computing system to provide a variety of useful smart home functions. In some implementations, a smart home device is disposed at the same location of the smart home environment <NUM> as a cast device <NUM> and/or an output device <NUM>, and therefore, is located in proximity to or with a known distance with respect to the cast device <NUM> and the output device <NUM>.

The smart home devices in the smart home environment <NUM> may include, but are not limited to, one or more intelligent, multi-sensing, network-connected thermostats <NUM>, one or more intelligent, network-connected, multi-sensing hazard detectors <NUM>, one or more intelligent, multi-sensing, network-connected entry way interface devices <NUM> and <NUM> (hereinafter referred to as "smart doorbells <NUM>" and "smart door locks <NUM>"), one or more intelligent, multi-sensing, network-connected alarm systems <NUM>, one or more intelligent, multi-sensing, network-connected camera systems <NUM>, and one or more intelligent, multi-sensing, network-connected wall switches <NUM>. In some implementations, the smart home devices in the smart home environment <NUM> of <FIG> includes a plurality of intelligent, multi-sensing, network-connected appliances <NUM> (hereinafter referred to as "smart appliances <NUM>"), such as refrigerators, stoves, ovens, televisions, washers, dryers, lights, stereos, intercom systems, garage-door openers, floor fans, ceiling fans, wall air conditioners, pool heaters, irrigation systems, security systems, space heaters, window AC units, motorized duct vents, and so forth.

The smart home devices in the smart home environment <NUM> may additionally or alternatively include one or more other occupancy sensors (e.g., touch screens, IR sensors, ambient light sensors and motion detectors). In some implementations, the smart home devices in the smart home environment <NUM> include radio-frequency identification (RFID) readers (e.g., in each room <NUM> or a portion thereof) that determine occupancy based on RFID tags located on or embedded in occupants. For example, RFID readers may be integrated into the smart hazard detectors <NUM>.

In some implementations, in addition to containing sensing capabilities, devices <NUM>, <NUM>, <NUM>, <NUM>, <NUM>, <NUM>, <NUM> and <NUM> (which are collectively referred to as "the smart home devices" or "the smart home devices <NUM>") are capable of data communications and information sharing with other smart home devices, a central server or cloud-computing system, and/or other devices (e.g., the client device <NUM>, the cast devices <NUM> and the voice-activated electronic devices <NUM>) that are network-connected. Similarly, each of the cast devices <NUM> and the voice-activated electronic devices <NUM> is also capable of data communications and information sharing with other cast devices <NUM>, voice-activated electronic devices <NUM>, smart home devices, a central server or cloud-computing system <NUM>, and/or other devices (e.g., the client device <NUM>) that are network-connected. Data communications may be carried out using any of a variety of custom or standard wireless protocols (e.g., IEEE <NUM>. <NUM>, Wi-Fi, ZigBee, 6LoWPAN, Thread, Z-Wave, Bluetooth Smart, ISA100. <NUM>1a, WirelessHART, MiWi, etc.) and/or any of a variety of custom or standard wired protocols (e.g., Ethernet, HomePlug, etc.), or any other suitable communication protocol, including communication protocols not yet developed as of the filing date of this document.

In some implementations, the cast devices <NUM>, the electronic devices <NUM> and the smart home devices <NUM> serve as wireless or wired repeaters. In some implementations, a first one of and the cast devices <NUM> communicates with a second one of the cast devices <NUM> and the smart home devices <NUM> via a wireless router. The cast devices <NUM>, the electronic devices <NUM> and the smart home devices <NUM> may further communicate with each other via a connection (e.g., network interface <NUM>) to a network, such as the Internet <NUM>. Through the Internet <NUM>, the cast devices <NUM>, the electronic devices <NUM> and the smart home devices <NUM> may communicate with a smart server system <NUM> (also called a central server system and/or a cloud-computing system herein). Optionally, the smart server system <NUM> may be associated with a manufacturer, support entity, or service provider associated with the cast devices <NUM> and the media content displayed to the user.

Accordingly, the smart server system <NUM> may include a voice/display assistance server <NUM> that processes audio inputs collected by voice-activated electronic devices <NUM>, one or more content hosts <NUM> that provide the displayed media content, a cloud cast service server <NUM> creating a virtual user domain based on distributed device terminals, and a device registry <NUM> that keeps a record of the distributed device terminals in the virtual user environment. Examples of the distributed device terminals include, but are not limited to the voice-activated electronic devices <NUM>, cast devices <NUM>, media output devices <NUM> and smart home devices <NUM>-<NUM>. In some implementations, these distributed device terminals are linked to a user account (e.g., a Google user account) in the virtual user domain.

In some implementations, the network interface <NUM> includes a conventional network device (e.g., a router). The smart home environment <NUM> of <FIG> further includes a hub device <NUM> that is communicatively coupled to the network(s) <NUM> directly or via the network interface <NUM>. The hub device <NUM> is further communicatively coupled to one or more of the above intelligent, multi-sensing, network-connected devices (e.g., the cast devices <NUM>, the electronic devices <NUM>, the smart home devices and the client device <NUM>). Each of these network-connected devices optionally communicates with the hub device <NUM> using one or more radio communication networks available at least in the smart home environment <NUM> (e.g., ZigBee, Z-Wave, Insteon, Bluetooth, Wi-Fi and other radio communication networks). In some implementations, the hub device <NUM> and devices coupled with/to the hub device can be controlled and/or interacted with via an application running on a smart phone, household controller, laptop, tablet computer, game console or similar electronic device. In some implementations, a user of such controller application can view status of the hub device or coupled network-connected devices, configure the hub device to interoperate with devices newly introduced to the home network, commission new devices, and adjust or view settings of connected devices, etc..

When the voice-activated electronic devices <NUM> are used as user interface devices applied in a user's daily life, they are placed at different locations in the smart home environment <NUM>, and merge into the smart home environment <NUM>. The locations where the voice-activated electronic devices <NUM> are placed could be drastically different, so the electronic devices <NUM> are configured to have small footprints that can fit into different locations. An electronic device <NUM>, when placed at different locations, faces different situations of blunt forces that may hit the electronic device <NUM> and push it off to the ground. Therefore, the center of mass, an orientation of the screen, an orientation and the base of the voice-activated electronic devices <NUM> are configured so that the voice-activated electronic devices <NUM> (particularly, a display assistant device) can sustain a blunt force up to a threshold level without being tipped over. Retention elements are also integrated to prevent edges of a display panel from falling apart from edges of a back cover in the voice-activated electronic device <NUM>.

<FIG> are a perspective view and a side view of a display assistant device <NUM> (an example of the voice-activated electronic device <NUM> having a display screen) in accordance with some implementations, respectively. The display assistant device <NUM> includes a base <NUM> and a screen <NUM>. The base <NUM> is configured for sitting on a surface. The screen <NUM> has a rear surface <NUM> at which the screen <NUM> is supported by the base <NUM>. A bottom edge <NUM> of the screen <NUM> is configured to be held above the surface by a predefined height h. The base <NUM> is substantially hidden behind the screen <NUM> from the front view of the display assistant device <NUM>. That said, the predefined height h is less than a predetermined threshold (e.g., <NUM>), such that the screen <NUM> appears to float in air and the base <NUM> can be substantially hidden behind the screen <NUM> from the front view of the display assistant device <NUM>. In an example, the predetermined threshold is <NUM>% of a width w of the screen <NUM>. If the screen <NUM> is a seven-inch screen having a width of <NUM> inches, the bottom edge <NUM> of the screen <NUM> is held above the surface by a height of <NUM> inches (<NUM>) or below.

Referring to <FIG>, in some implementations, the base <NUM> extends along a central axis <NUM>, and the central axis <NUM> of the base <NUM> is not perpendicular to the surface when the base <NUM> sits on the surface. The base <NUM> has a front surface 202A and a rear surface 202B. Optionally, at least one of the front surface 202A and the rear surface 202B is parallel with the central axis <NUM>. The central axis <NUM>, front surface 202A and rear surface 202B of the base <NUM> lean forward by a base angle a when the base sits on the surface. It is noted that the front surface 202A of the base is shorter than the rear surface 202B of the base, e.g., a height of the front surface 202A is only <NUM>% of that of the rear surface <NUM>. When the screen <NUM> is supported by the base <NUM> at its rear surface <NUM>, the screen <NUM> is not perpendicular to the surface, but faces substantially forward and leans slightly backward by a screen angle β for the purposes of providing a desirable viewing angle for an average user. In an example, both the base angle α and the screen angle β are equal to <NUM> degrees, except that the base leans forward by the base angle α of <NUM> degrees and the screen leans backward by the screen angle β of <NUM> degrees. By these means, the display assistant device <NUM> does not easily tip over (forward or backward) when a blunt force F hits a top edge of the display assistant device <NUM> or a user interaction (e.g., touch input) occurs to the screen <NUM> of the display assistant device <NUM>.

The base <NUM> acts as a speaker box. A speaker is concealed inside the base and configured to project sound substantially towards the front view of the display assistant device, i.e., through a space of the predefined height h separating the bottom edge <NUM> of the screen <NUM> and the surface on which the display assistant device <NUM> is configured to sit.

The display assistant device <NUM> has a substantially narrow bezel area surrounding an active display area of the screen <NUM>. In some implementations, the bezel area includes one or more microphone holes <NUM>. One or more microphones are placed behind the microphone holes <NUM> and configured to collect sound from the environment of the display assistant device <NUM>. In some implements, the display assistant device <NUM> further includes a sensor opening <NUM> configured to access an ambient light sensor and/or an RGB color sensor. The ambient light sensor or RGB color sensor is configured to detect a light condition in the smart home environment <NUM> where the display assistant device <NUM> sits. In some implementations, the display assistant device <NUM> is configure to adjust a brightness level of its screen <NUM> according to the light condition. The ambient light sensor and the RGB color sensor are disposed behind the bezel area and exposed to light via transparent part of the bezel area, e.g., the sensor opening <NUM>.

A bottom surface of the base <NUM> constitutes a footprint of the display assistant device <NUM>. A length of the bottom surface of the base <NUM> is smaller than (e.g., <NUM>% or less of) a length of the screen <NUM>, and a width of the bottom surface of the base <NUM> is significant smaller than (e.g., < <NUM>% or less of) a width w of the screen <NUM>. As a result, the footprint of the display assistant device <NUM> is substantially small, and the display assistant device <NUM> can therefore fit into different physical settings (e.g., a kitchen, living room, and bedroom) in the smart home environment <NUM>.

<FIG> is a front view of a display assistant device <NUM> in accordance with some implementations. The display assistant device <NUM> includes a base <NUM> and a screen <NUM>. The display assistant device also includes a speaker <NUM>. The speaker <NUM> is mounted in a speaker assembly (which will be described in more detail below) located inside the display assistant device <NUM>, such that a front portion of the speaker <NUM>, sometimes referred to herein as a speaker opening, is disposed behind both (i) a front surface of the base <NUM>, and (ii) the screen <NUM>. The portion of the front of the speaker which is disposed behind the front surface of the base <NUM> is referred to herein as lower portion 304A, and the portion of the front of the speaker which is disposed behind the screen <NUM> is referred to herein as upper portion 304B. In some implementations, the size of the speaker <NUM> is desired to be as big as possible, compared to other components of the display assistant device <NUM>. First, the bigger the speaker, the higher the potential sound quality. Second, the heavier the speaker, the lower center of mass will be, thus making the display assistant device <NUM> more stable. As the speaker <NUM> grows in size, however, more of the sound is blocked by the screen <NUM>, due to the area of portion 304B growing larger compared to area 304A. While the front surface of base <NUM> is designed to facilitate projection of sound waves, through, e.g., a front-facing speaker grill (see <FIG>, <NUM>), the screen <NUM> cannot so easily accommodate the passage of sound waves since speaker grill cutouts would get in the way of valuable display real estate. Thus, various alternative channels for redirecting sound waves will be described below with respect to <FIG>.

In some implementations, the entire speaker <NUM>, or substantially the entire speaker <NUM>, is disposed behind the screen <NUM>. In these implementations, portion 304A describes the area of the speaker <NUM> that produces sound waves that are directed toward openings in the front surface of the base <NUM>, while portion 304B describes the area of the front of the speaker <NUM> that produces sound waves that are mostly directed toward the screen <NUM> and reflected back into the deice <NUM> as a result.

<FIG> is an exploded view of a display assistant device <NUM> in accordance with some implementations. The screen <NUM> of the display assistant device <NUM> includes a cover glass <NUM>, a display panel <NUM>, a middle frame <NUM>, and a back cover <NUM> in accordance with some implementations. In some implementations, the cover glass <NUM> and the display panel <NUM> are integrated in a display front, which is optionally obtained as an off-the-shelf module. In some implementations, the cover glass <NUM>, the display panel <NUM>, and the middle frame <NUM> are integrated in a display panel assembly that is further assembled with the back cover <NUM> to form the screen <NUM>. In some implementations, when the display panel assembly <NUM> is assembled with the back cover <NUM>, an edge of the back cover <NUM> rises above a corresponding edge of the display panel assembly so that when the screen <NUM> hits the ground, the edge of the back cover <NUM> can protect the edge of the display panel assembly (specifically, an edge of the cover glass <NUM>) from hitting the ground and being shattering. Further, in some situations, the edge of the back cover <NUM> not only rises above, but also slightly wraps around the edge of the display panel assembly. In some implementations, the edge of the back cover <NUM> rises above a corresponding edge of the display panel assembly by a substantially small height (e.g., < <NUM>) that is unnoticeable to a user.

The display panel <NUM> is configured to display graphics content. Optionally, the display panel <NUM> is substantially flat. Optionally, the display pane <NUM> is curved, and covered by a curved cover glass layer <NUM>. In some implementations, a display panel assembly does not have a cover glass <NUM> covering the curved display panel <NUM>; rather, the display panel <NUM> includes a protective layer on its top surface.

Edge areas of a rear surface of the cover glass <NUM> are covered with paint to define a bezel area surrounding an active display area of the screen <NUM>. In some implementations, the bezel area includes one or more microphone holes <NUM>. One or more microphones are placed behind the microphone holes <NUM> and configured to collect sound from the ambient of the display assistant device <NUM>. Optionally, the cover glass <NUM> is coupled to the display panel <NUM> using an adhesive. The display panel <NUM> has a rear surface made of thermally and/or electrically conductive material (e.g., a metal plate). When a thermal spreader is attached to a portion of the rear surface of the display panel <NUM>, the thermal spreader redistributes heat evenly across itself and the portion of the rear surface of the display panel <NUM>, thereby avoiding formation of hot spots on the display panel <NUM>.

The middle frame <NUM> is disposed between the display front (i.e., a combination of the cover glass <NUM> and the display panel <NUM>) and the back cover <NUM>. The middle frame <NUM> is mechanically coupled to the display front using an adhesive that is applied adjacent to edges of the display front and middle frame <NUM>. Further, the middle frame <NUM> is mechanically coupled to the back cover <NUM> using an adhesive or mechanical structures.

In some implementations, the display assistant device <NUM> further includes a main logic board <NUM> mounted on a rear surface of the middle frame <NUM> (see <FIG>). The main logic board <NUM> includes a plurality of electronic components that generate heat. A heat sink <NUM> (or a protrusion structure including a heat sink) is attached to the main logic board <NUM> to absorb the heat generated thereon. Optionally, the heat sink <NUM> is solid. Optionally, the heat sink <NUM> is hollow and contains an insert. The main logic board <NUM> and the heat sink <NUM> are attached to the rear surface of the middle frame <NUM>, which is further assembled with the display front and the back cover <NUM>. The back cover <NUM> includes a first opening at a central portion of the screen <NUM>. When the back cover <NUM> is assembled onto the screen <NUM>, the main logic board <NUM> and the heat sink <NUM> attached to the middle frame <NUM> are aligned with the first opening of the back cover <NUM> and protrude out of the first opening.

During an example assembly process, the display front, the middle frame <NUM> and the base <NUM> are provided separately. A speaker assembly <NUM> is disposed in the housing <NUM>, which is further covered by a base mount plate to form the base <NUM>. The back cover <NUM> is assembled to the base <NUM>, optionally by fastening top and bottom edges of the first opening of the back cover <NUM> to an interior rear surface and a front surface of the housing <NUM>, respectively. After the back cover <NUM> is assembled to the base <NUM>, the middle frame <NUM> is coupled to the back cover <NUM> via a plurality of first retention elements on the rear surface of the middle frame <NUM> and a plurality of second retention elements on a front surface of the back cover <NUM>. The display front is coupled to the middle frame <NUM> via an adhesive either before or after the middle frame <NUM> is coupled to the back cover <NUM> and the base <NUM>.

The base <NUM> of the display assistant device <NUM> includes an external housing <NUM>, a waveguide/speaker mount structure <NUM>, and a speaker <NUM>. These components, as well as their physical relationships with the various components of the display <NUM> described above, are described in more detail with reference to <FIG> below.

<FIG> is a cross sectional view of a display assistant device <NUM> in accordance with some implementations. The display assistant device <NUM> includes a speaker assembly <NUM>, and the speaker assembly <NUM> further includes a speaker <NUM> mounted within a speaker waveguide <NUM>. <FIG> is a front perspective of the speaker waveguide <NUM> in accordance with some implementations. The following discussion refers to common items in both <FIG>.

The speaker <NUM> is concealed inside the base <NUM> and has a speaker opening disposed at a front portion of the speaker. The speaker opening has a dimension substantially greater than a predefined height h of the space separating a bottom edge of the screen <NUM> and a surface on which the display assistant device <NUM> is configured to sit. The speaker opening faces forward (in <FIG>, forward is towards the left; in <FIG>, forward is away from the page toward the reader of this application). In some implementations, the speaker opening is tilted downward with a tilting angle <NUM>.

The speaker <NUM> is configured to project sound waves <NUM> substantially towards a front view of the display assistant device <NUM>, i.e., project a substantial portion (e.g., in some implementations, <NUM>% or more) of sound generated by the speaker <NUM> towards the space between the bottom edge of the screen <NUM> and the surface on which the base <NUM> sits. A housing <NUM> of the base <NUM> includes a plurality of speaker grill portions disposed on one or more of (i) a front surface 202A (see <FIG>, <NUM>), (ii) a rear surface 202B (see <FIG>, <NUM>), and (iii) a left side and/or a right side of the base <NUM> (see <FIG>, <NUM>). In some implementations, a substantial portion of the sound generated by the speaker <NUM> (e.g., sound component A in <FIG>) exits the base <NUM> via speaker grill portions on the front surface 202A of the base <NUM> (<FIG>, <NUM>). Remaining portions of the sound generated by the speaker <NUM> (e.g., sound components B, C, and D) are guided inside the housing <NUM> to exit the base <NUM> via a subset of speaker grill portions that are disposed on one or more of the rear surface 202B (<FIG>, <NUM>), and the left and/or right sides of the base <NUM> (<FIG>, <NUM>). Portions of the sound generated by the speaker <NUM> that are guided inside the housing <NUM> to exit the base via the left and/or right sides of the base <NUM> (e.g., sound components B), are directed through waveguides <NUM> (sometimes referred to herein as "shoulders") on each side of the speaker <NUM>. In some implementations, the waveguides <NUM> are integrated into the waveguide structure <NUM>. In some implementations, the waveguide structure is formed from a single piece of material (e.g., an integrated unit molded from a moldable material with desirable acoustic and physical properties (e.g., density, heat transmissivity, acoustic resonance/damping, etc.) or 3D-printed from a 3D-printable material with similar properties). In some implementations, the waveguide structure <NUM> consists of separate structures that interact to provide the desired functionality. For example, in some implementations, the waveguides <NUM> can be separate components that are adjacent to the waveguide structure <NUM> that are configured to guide sound produced by the speaker <NUM> to one or more of the grills <NUM>, <NUM> as described herein. An inner portion of the base <NUM> is configured to mate/seal to a back portion of the waveguide structure <NUM> to provide a sealed enclosure for the speaker <NUM>.

The speaker assembly <NUM> is disposed in a lower portion of a base <NUM> to lower down a center of mass of the entire display assistant device <NUM>. In some implementations, for the purpose of lowering down the center of mass, a speaker assembly having a larger weight is selected over a speaker assembly having a smaller weight when their costs or speaker box volumes are comparable. For example, a speaker has a volume of 120cc, and a Neodymium based speaker is selected over a Ferrite based speaker because of its weight advantage. Given its center of mass, weight and angles (α and β), the display assistant device <NUM> does not tip over (forward or backward) easily when a blunt force F hits a top edge of the display assistant device <NUM> or a user touch occurs to the screen <NUM> of the display assistant device <NUM>. For example, the center of weight is configured so that the display assistant device <NUM> can sustain an impact force of <NUM> Newton without tipping over. In some implementations, airflow associated with sound generated by the speaker <NUM> (e.g., sound that is guided along the sound propagation paths C and D shown in <FIG>) assists in heat dissipation by carrying to the outside of the device <NUM> heat absorbed by the heat sink <NUM> and/or heat generated by other electronic and/or display components of the device <NUM>.

As explained above, the upper extent of the front surface 202A of the housing <NUM> is lower than the upper extent of the rear surface 202B of the housing <NUM>, such that the housing <NUM> has a tilted opening configured to receive the screen <NUM>. That said, the screen <NUM> and the base <NUM> are interconnected to form an interior space. In this interior space, a main logic board <NUM> is arranged in parallel with a display panel of the screen, and a heat sink <NUM> comes into contact with the main logic board <NUM> to absorb heat generated by the main logic board <NUM>. The heat sink <NUM> is thereby disposed in the upper portion of the base <NUM>. Optionally, the heat sink <NUM> at least partially sits on the speaker waveguide <NUM>. Optionally, the heat sink <NUM> is mechanically attached to the main board <NUM> that is further included in the screen <NUM>. The heat sink <NUM> is suspended above the speaker waveguide <NUM> and separated therefrom by a gap, and sound generated by the speaker <NUM> is partially guided towards the rear surface of the base <NUM> via the gap in accordance with a sound propagation path C.

<FIG> are more detailed perspective views of a housing <NUM> and a waveguide structure <NUM>, respectively, and <FIG> is a perspective view of the waveguide structure <NUM> mounted inside of the housing <NUM> in an assembled state in accordance with some implementations.

Referring to <FIG>, the exterior housing <NUM> is asymmetric from a perspective view, having a front surface 202A with a height which is substantially lower than a height of a rear surface 202B. In some implementations, the rear surface 202B has a height that is at least three times that of the front surface 202A. In other implementations, the rear surface 202B has a height that is less than three times that of the front surface 202A, but is still taller than that of the front surface 202A.

Referring to <FIG> and <FIG>, speaker grill portion <NUM> is disposed at the front surface of the housing <NUM>, speaker grill portions <NUM> are disposed at the left and/or right sides of the housing <NUM>, and speaker grill portion <NUM> is disposed at a rear surface of the housing <NUM>. As assembled, the waveguide structure <NUM> is mounted inside of the housing <NUM> such that the waveguide channels <NUM> (see <FIG>) begin at the speaker <NUM> and terminate at the speaker grill portions <NUM>, allowing sound waves to exit the sides of the display assistant device <NUM>. The front speaker grill portion <NUM> is disposed along the front surface of the housing <NUM> enabling sound waves to exit the front of the display assistant device <NUM> while they are traveling through path(s) B toward the side speaker grill portion(s) <NUM>.

Referring to <FIG>, the speaker <NUM> is mounted in the waveguide structure <NUM>, such that the waveguide structure <NUM> exposes a front portion of the speaker <NUM> (alternatively referred to as a speaker opening of the speaker through which vibrations of a speaker membrane project sound waves) and provides a sealed enclosure for a rear portion of the speaker <NUM>. In some implementations, the waveguide structure <NUM> includes two waveguides <NUM>, sometimes referred to herein as shoulders, each of which is recessed and separated from the exterior housing <NUM> forming left and right shoulder spaces, such that sound waves projected from the front portion of the speaker <NUM> are (i) reflected by the tilted bottom surface of the cover structure (e.g., <FIG>, items <NUM> and/or <NUM>) and by portions of the front surface of the housing <NUM>, and (ii) guided through the shoulder spaces to exit the display assistant device <NUM> from the side grill portions <NUM>. In some implementations, the shoulder waveguides <NUM> form parabolic shapes with horizontal and/or vertical axes of symmetry (e.g., parallel or perpendicular, respectively, to the surface on which the display assistant device <NUM> sits). In some implementations, one waveguide <NUM> surface (e.g., <NUM>) is parabolic with a first axis of symmetry, and an opposite waveguide <NUM> surface (e.g., <NUM>) is parabolic with a second axis of symmetry perpendicular to the first. In some implementations, the first and second axes of symmetry are offset with respect to each other according to any degree that does not result in the axes being parallel to each other. In some implementations, a lower waveguide <NUM> surface (e.g., <NUM> and/or <NUM>) adjacent to the speaker <NUM> is parabolic with a first axis of symmetry, and an upper waveguide <NUM> surface (e.g., <NUM>) adjacent to the speaker <NUM> is parabolic with a second axis of symmetry perpendicular to the first, or offset compared to the first with any degree of offset that does not result in parallel axes of symmetry. Offsetting the axes of symmetry prevents standing waves from resonating in the various portions of the waveguides, thus preventing low quality audio characteristics that may occur as a result. On that note, some implementations of the waveguides <NUM> are similar to those described above; however, instead of the waveguide <NUM> surfaces being parabolic, the surfaces have any other shape that facilitates movement of sound waves from one point (e.g., the speaker <NUM>) to another (e.g., one of the speaker grill portions <NUM>, <NUM>, or <NUM>).

In some implementations, two shoulders <NUM> of the speaker waveguide <NUM> have different shapes, e.g., have a hyperbolic shape and a parabolic shape, respectively. In some implementations, spaces are created to eliminate air disturbance associated with the sound that exits the base <NUM> via a front side of the housing <NUM> and thereby reduce noise in the sound broadcasted from the speaker <NUM>.

<FIG> are perspective views of various states of assembly of a display assistant device <NUM> in accordance with some implementations. Referring to <FIG>, a back cover <NUM> is disposed on top of the waveguide structure <NUM>, thereby concealing the waveguide structure and the speaker <NUM> within the exterior housing <NUM>. Referring to <FIG> and <FIG>, a frame <NUM> includes a heat sink <NUM> (described in more detail above and alternatively referred to herein as a protrusion structure), and is assembled onto the back cover <NUM>. Upon assembly of the frame <NUM> and cover <NUM> onto the housing <NUM> and waveguide <NUM> assembly (as depicted in <FIG>), the frame <NUM> or a combination of the frame <NUM> and cover <NUM> is alternatively referred to herein as a cover structure <NUM>'. The cover structure <NUM>' has a tilted bottom surface configured to be suspended above the waveguide structure <NUM>.

Also, upon assembly of the cover structure <NUM>' to the housing <NUM> and waveguide <NUM> assembly, two spaces separate the frame and the heat sink from the waveguide structure <NUM>. These spaces are depicted as paths C and D in <FIG>. Sound waves projected from the speaker <NUM> (e.g., upper portion 304B) are reflected by the tilted bottom surface of the back cover <NUM> and/or frame <NUM> and are guided through path C (and in some implementations, through path D) to exit the display assistance device <NUM> from the back speaker grill portion <NUM>. In some implementations, these spaces have respective depths that are smaller than respective heights. For example, one or both of paths C and D are disposed in spaces with a depth being less than <NUM>, less than <NUM>, less than <NUM>, or less than <NUM>.

In some implementations, the housing <NUM> includes a plurality of crush ribs <NUM> (<FIG>, <FIG> and <FIG>) disposed on an interior surface underneath the rear speaker grill portion <NUM>. The crush ribs are configured to guide sound waves projected through path C (<FIG>) toward the openings in the speaker grill portion <NUM>. It is noted that when the heat sink <NUM> protrudes into the base <NUM>, it is substantially close to an interior rear surface of the housing <NUM>, e.g., a first gap between the heat sink <NUM> and the interior rear side of the housing <NUM> has a width of <NUM> or less. The plurality of crush ribs <NUM> extend along a direction of the sound propagation path C. The plurality of crush ribs <NUM> are configured to guide the sound projected from the upper portion of the speaker <NUM> through the first space to exit the speaker assembly <NUM> via the speaker grill portion <NUM>. In some implementations, each of the plurality of crush ribs <NUM> tapers when it extends from a lower position on the interior rear surface of the housing <NUM> to the speaker grill portion <NUM>. That said, when each crush rib <NUM> has a semicircular cross section, a radius of the cross section is configured to shrink gradually when the crush rib <NUM> extends to the speaker grill portion <NUM>. In some implementations, when the heat sink <NUM> is disposed into the base <NUM>, it comes into contact with and is pushed onto the plurality of crush ribs <NUM>.

The frame <NUM>, or alternatively the display panel <NUM> or any other mechanical component of the screen <NUM>, includes a logic board <NUM> (described in more detail above). In some implementations, the heat sink <NUM> comes in contact, or is disposed in close proximity to, the logic board <NUM>, thereby absorbing heat generated from the logic board. In some implementations, the heat sink is hollow. Alternatively, the heat sink is filled with a plastic insert. For example, the heat sink is metal and is filled with an insert. Optionally, the insert is made of plastic or silicone. The heat sink creates an acoustic effect in which acoustic harmonics (e.g., standing waves) are suppressed. Additionally, when sound waves are generated by the front portion of the speaker, the sound waves are guided through the space(s) surrounding the heat sink <NUM> (<FIG>, paths C and D), thereby dissipating heat from the heat sink and carrying it away through a flow of air via the path(s) C and/or D toward the rear speaker grill portion <NUM> (<FIG>).

The terminology used in the description of the various described implementations herein is for the purpose of describing particular implementations only and is not intended to be limiting. As used in the description of the various described implementations and the appended claims, the singular forms "a", "an" and "the" are intended to include the plural forms as well, unless the context clearly indicates otherwise. It will also be understood that the term "and/or" as used herein refers to and encompasses any and all possible combinations of one or more of the associated listed items. It will be further understood that the terms "includes," "including," "comprises," and/or "comprising," when used in this specification, specify the presence of stated features, integers, steps, operations, elements, and/or components, but do not preclude the presence or addition of one or more other features, integers, steps, operations, elements, components, and/or groups thereof.

As used herein, the term "if' is, optionally, construed to mean "when" or "upon" or "in response to determining" or "in response to detecting" or "in accordance with a determination that," depending on the context.

It is to be appreciated that "smart home environments" may refer to smart environments for homes such as a single-family house, but the scope of the present teachings is not so limited. The present teachings are also applicable, without limitation, to duplexes, townhomes, multi-unit apartment buildings, hotels, retail stores, office buildings, industrial buildings, and more generally any living space or work space.

Although various drawings illustrate a number of logical stages in a particular order, stages that are not order dependent may be reordered and other stages may be combined or broken out. While some reordering or other groupings are specifically mentioned, others will be obvious to those of ordinary skill in the art, so the ordering and groupings presented herein are not an exhaustive list of alternatives. Moreover, it should be recognized that the stages can be implemented in hardware, firmware, software or any combination thereof.

Claim 1:
A speaker assembly (<NUM>), comprising:
a speaker (<NUM>) including a front portion (304A, 304B) at which a speaker opening is disposed and a rear portion;
a waveguide structure (<NUM>) in which the speaker (<NUM>) is mounted, the waveguide structure (<NUM>) exposing the front portion (304A, 304B) of the speaker (<NUM>) and providing a sealed enclosure for the rear portion of the speaker (<NUM>);
an exterior housing (<NUM>) in which the waveguide structure (<NUM>) is mounted, wherein the exterior housing (<NUM>) is asymmetric, and a front side (202A) of the exterior housing (<NUM>) is shorter than a rear side (202B) of the exterior housing, wherein the exterior housing (<NUM>) further includes a plurality of speaker grill portions (<NUM>, <NUM>, <NUM>) distributed on a plurality of sides of the exterior housing (<NUM>), wherein the plurality of speaker grill portions (<NUM>, <NUM>, <NUM>) permit sound waves (<NUM>) from the front portion (304A, 304B) of the speaker (<NUM>) to be projected outside the exterior housing (<NUM>); and
a cover structure (<NUM>') that is disposed on top of the waveguide structure (<NUM>) to conceal the waveguide structure (<NUM>) and speaker (<NUM>) within the exterior housing (<NUM>), wherein the cover structure (<NUM>') is assembled onto the exterior housing (<NUM>) and the waveguide structure (<NUM>), wherein the cover structure (<NUM>') has a tilted bottom surface suspended above the waveguide structure (<NUM>) and separated therefrom by a first space;
wherein the front portion (304A, 304B) of the speaker (<NUM>) includes an upper portion (304B) and a lower portion (304A), the upper portion (304B) facing the tilted bottom surface of the cover structure (<NUM>') and the lower portion (304A) facing the front side (202A) of the exterior housing (<NUM>), such that (i) sound waves (<NUM>) projected from the lower portion (304A) of the speaker (<NUM>) exit the speaker assembly (<NUM>) from a first speaker grill portion (<NUM>) located on the front side (202A) of the exterior housing (<NUM>), and (ii) sound waves (<NUM>) projected from the upper portion (304B) of the speaker (<NUM>) are reflected by the tilted bottom surface of the cover structure (<NUM>') and are guided through the first space to exit the speaker assembly (<NUM>) from a second speaker grill portion (<NUM>) located on the rear side (202B) of the exterior housing (<NUM>).