Patent Description:
A smart speaker is typically a wireless speaker that connects to a wireless access point (WAP) and offers interactive actions to control playback of audio and to control home automation devices. Smart speakers typically need to be within a range of the WAP. In the event the WAP does not provide sufficient range, such as in large homes, smart speakers in rooms outside of the range of the WAP will not have connection.

Even smart speakers that are within range of the WAP depend upon a controller application that controls, by way of a smart device such as a mobile phone or tablet, the smart speaker and its connection to the WAP. Smart speakers with a controller application do not communicate directly with the Internet through the WAP. Further, because the smart speakers are routed through the controller application any tuning of the speaker is manually performed by way of the controller application.

There is a need for a smart speaker that has the capability to extend connection to a WAP providing broadband connection capability, such as an Internet connection, in areas that would otherwise be inaccessible to the Internet while, at the same time, preserving the fidelity and performance of wireless audio streaming at the smart speaker. <CIT> discloses a method to collect and organize data from a local playback network. <CIT> discloses a multi-room wireless audio and communication system based on fixed wireless audio devices. <CIT> discloses a system and a method for sonically customizing an audio reproduction device.

The invention proposes a cloud-based equalizer system as in claim <NUM> and a method for cloud-based equalizer settings as in claim <NUM>.

Each smart speaker in a plurality of smart speakers has a wireless range extender and the ability to send data to and receive data directly from a cloud-based processor, hereinafter the cloud, which may be applied to enriching a listener's listening experience through analytics and tools that are customized by cloud-based computing based on the cloud. Although the smart speakers described in the present disclosure have the ability to route Internet protocol traffic, the smart speaker's main purpose is to play audio, therefore, IP packets may be routed with a best effort traffic management in which priority is given to audio packets.

For audio playback of a song that has a particular genre identified as a tag in the digital audio file, the tag is communicated directly by the smart speaker to a cloud-based processor. The cloud-based processor then responds to the smart speaker by sending equalizer settings that are optimal for the particular genre directly to the smart speaker. The equalizer settings may then be implemented directly at the smart speaker.

For audio playback of a song that does not have a particular genre identified, the speaker directly communicates a title of the song and a portion of the audio (i.e., a few seconds of the song) to the cloud. A search for the acoustic fingerprint is performed in the cloud. When a genre for the song is identified from the song title and portion of the audio, equalizer settings may be communicated back to the smart speaker from the cloud. In the event the song is not identified, the portion of the audio signal may be analyzed to determine suggested equalizer settings which are then communicated directly to the smart speaker.

The direct connection of the smart speakers allows data to be sent to the cloud for collection and analysis. The data that may be sent includes, but is not limited to, a genre of music, an artist, the day and time a particular song is being played. Analysis of the collected data determines listener suggestions that are then communicated directly to and implemented at the smart speaker.

While various aspects of the present disclosure are described with reference to a particular illustrative embodiment, the present disclosure is not limited to such embodiments, and additional modifications, applications, and embodiments may be implemented without departing from the present disclosure. In the figures, like reference numbers will be used to illustrate the same components. Those skilled in the art will recognize that the various components set forth herein may be altered without varying from the scope of the present disclosure.

Any one or more of the servers, receivers, or devices described herein include computer executable instructions that may be compiled or interpreted from computer programs created using a variety of programming languages and/or technologies. In general, a processor (such as a microprocessor) receives instructions, for example from a memory, a computer-readable medium, or the like, and executes the instructions. A processing unit includes a non-transitory computer-readable storage medium capable of executing instructions of a software program. The computer readable storage medium may be, but is not limited to, an electronic storage device, a magnetic storage device, an optical storage device, an electromagnetic storage device, a semiconductor storage device, or any suitable combination thereof. Any one or more the devices herein may rely on firmware, which may require updates from time to time to ensure compatibility with operating systems, improvements and additional functionality, security updates or the like. Connecting and networking servers, receivers or devices may include, but are not limited to, SATA, Wi-Fi, lightning, Ethernet, UFS, <NUM>, etc.. One or more servers, receivers, or devices may operate using a dedicated operating system, multiple software programs and/or platforms for interfaces such as graphics, audio, wireless networking, enabling applications, integrating hardware of vehicle components, systems, and external devices such as smart phones, tablets, and other systems to name just a few.

<FIG> is a system diagram <NUM> for a plurality of smart speakers <NUM>(<NUM>)-(n), each having a wireless range extender <NUM>(<NUM>)-(n) and each being connected to a wireless access point <NUM> and broadband connectivity, such as an Internet connection. The wireless access point <NUM> is a hardware device and may also be a smart device, such as a tablet or mobile phone with tethering capability. The connection to the Internet provides access to cloud-based storage and processing, referred to herein as a cloud <NUM>. A smart device <NUM>, such as a mobile phone, tablet, or personal computer, is equipped with a controller application <NUM> may also be in communication with at least one of the smart speakers in the plurality of smart speakers <NUM>(<NUM>)-(n). The wireless range extender <NUM>(<NUM>)-(n) may be capable of transmitting and receiving data using, for example, a wireless protocol such as WiFi (IEEE <NUM>). Each smart speaker <NUM>(<NUM>)-(n) has the capability to communicate with the cloud <NUM> directly instead of having to be routed through the controller application <NUM> on the smart device <NUM>. At the same time, each smart speaker <NUM>(<NUM>)-(n) extends the range of the wireless access point <NUM>.

Each smart speaker <NUM>(<NUM>)-(n) has the ability to send data to and receive data directly from the cloud which may be applied to enriching a listener's listening experience through analytics and tools customized based on the data. For example, in a scenario where the smart device <NUM> is a laptop connected for the smart speaker <NUM>(<NUM>), the listener may be sending and receiving audio data <NUM> as well as accessing Internet URL's <NUM>. Although the smart speakers <NUM>(<NUM>)-(n) have the ability to route Internet protocol traffic, the smart speaker's main purpose is to play audio, therefore, IP packets are routed in a best effort traffic management in which priority is given to audio packets.

Wireless Media Extensions (WME) is a Wi-Fi Alliance interoperability certification based on IEEE <NUM>(e) and may be used to assign priority to audio packets. This protocol defines access categories that are used by WME defined stations. Access categories are: <NUM>) Voice (AC_VO), <NUM>) Video (AC_VI), <NUM>) Best Effort (AC_BE), and <NUM>) Background (AC_BG). The audio being played on the speakers is transmitted using AC_VO and IP packets are transmitted as AC_BE category traffic in order to give audio packets higher priority and necessary bandwidth. With this transmission strategy the IP traffic won't degrade the quality of audio streaming. When there are no audio packets to stream, the IP packets may be assigned higher priority.

As discussed above, each smart speaker <NUM>(<NUM>)-(n) has the direct ability to send and receive data from the cloud. The computational power available via cloud processing capability may be applied to collecting and analyzing data that is being sent from the speaker to the cloud. For example, transmitting metadata from digital audio, analyzing the audio being played at a particular smart speaker and applying a customized equalizer setting to enhance a listener's listening experience.

When the smart speakers <NUM>(<NUM>)-(n) are generally subject to a setup process. The setup process enables playback of digital audio at the smart speakers <NUM>(<NUM>)-(n). During the setup process, the listener may select an option for automatic equalization which will allow the cloud-based equalizer settings to be applied to a smart speaker without intervention by the listener. Audio may also be played from a source that is connected to the smart speaker by way of the controller application <NUM>. Alternatively, connection to the speaker may be by Bluetooth <NUM> connection, or a direct hard wire Line-In <NUM> from a source to a smart speaker <NUM>(<NUM>)-(n).

Digital audio typically has an acoustic fingerprint, which is a condensed digital summary that is part of the audio signal. The acoustic fingerprint may be used to identify the genre of the song, which then determines the equalizer settings most appropriate for playback. For example, a song having a rock genre will sound best with equalizer settings that enhance rock music. A song having a country genre will sound best with equalizer settings that enhance country music, which equalizer settings are different than the equalizer settings for rock music.

Referring now to <FIG>, a method <NUM> for cloud-based equalizer settings for audio is shown for audio playback of a song that has a particular genre identified as a tag in the digital audio file. When the genre is known, the tag is communicated <NUM> directly by the smart speaker to a cloud-based processor. The cloud-based processor then responds to the smart speaker by sending <NUM> equalizer settings that are optimal for the particular genre directly to the smart speaker. The equalizer settings may then be implemented <NUM> at the smart speaker.

Referring now to <FIG>, a method <NUM> for cloud-based equalizer settings for audio is shown for audio playback of a song that does not have a particular genre identified. This method is also applicable in instances where music files are being played at the smart speaker from a source other than the controller application, such as Bluetooth or Line-in. The speaker is connected directly to the cloud and communicates <NUM> a title of the song and a portion of the audio (i.e., a few seconds of the song) to the cloud. A search <NUM>, in the cloud, for the acoustic fingerprint is performed. A match occurs when a genre for the song is identified <NUM> and equalizer settings may be communicated <NUM> back to the smart speaker from the cloud. In the event a match does not occur <NUM>, the audio signal may be analyzed <NUM> and suggested equalizer settings may be determined <NUM>.

The suggested equalizer settings may be communicated <NUM> from the cloud to the smart speaker. The suggested equalizer settings may be implemented <NUM> at the smart speaker. However, due to the time that it may take to perform analysis of the song, the suggested equalizer settings may be saved <NUM> for future reference when the song is played at a later time and in this scenario, the saved equalizer settings will result in a match <NUM> when the cloud-based search is performed at the later time.

The communication of data from the speaker to the cloud and from the cloud back to the speaker may extend beyond genre related data. For example, data and information about listener preferences may be sent to the cloud. If it is known that a particular listener prefers more bass or more treble, based on settings and adjustments made to equalizer settings for songs being played, the smart speaker may incorporate those preferences into the suggested equalizer settings. Referring to <FIG>, samples of audio are played for the listener, listener preferences for each sample of audio are stored. At the step of implementing equalizer settings <NUM>, equalizer settings sent from the cloud may be compared with the stored listener preferences and the stored listener preferences may be used to modify the equalizer settings that were received from the cloud for each genre.

The speakers directly interact with the cloud. Because of this direct interaction, the speakers are capable of bypassing the controller application <NUM> and send data directly to the cloud. Referring to <FIG> a flowchart for a method <NUM> for data collection and mining is described. According to the method <NUM>, the speakers send data <NUM> to the cloud. Some examples of useful data that may be collected and sent includes, but is not limited to, a genre of music, an artist, the day and time a particular song is being played. The sent data is stored and analyzed <NUM> in the cloud.

Analysis of the collected data determines <NUM> listener suggestions that are communicated <NUM> to the smart speaker and equalizer settings are implemented <NUM>.

The collected data is analyzed and the suggestions may be used by a listener to personalize their experience, such as through equalization settings. In another example, the suggestions may include, but are not limited to, a notification when a new track is released by a favorite artist, songs in a listener's favorite genre, songs according to a time of day that are based on historical data sent by the speakers and stored in the cloud, or suggested playlists.

Claim 1:
A cloud-based equalizer system (<NUM>) for a plurality of smart speakers, the system comprising:
a plurality of smart speakers (<NUM>(<NUM>)-(n)), each smart speaker having a wireless range extender (<NUM>(<NUM>)-(n) adapted to connect to a wireless access point (<NUM>) to send data to and receive data directly from a cloud (<NUM>), wherein the data is associated with a digital audio file to be played by at least one smart speaker in the plurality of smart speakers;
at least one equalizer setting is retrieved from a cloud-based search to be communicated (<NUM>) to and implemented (<NUM>) by at least one smart speaker of the plurality of smart speakers, wherein
a song title and a predetermined portion of the digital audio file are included in the data sent to the cloud for analysis; and
the at least one equalizer setting retrieved from the cloud is associated with the analysis of the song title and the predetermined portion of the digital audio file.