Systems and methods for modifying playback of a media asset in response to a verbal command unrelated to playback of the media asset

Systems and methods are described for translating a non-playback command into a playback modification to encourage a recipient of the command to execute on the command. A media guidance application may determine a command from a first user to a second user. The media guidance application may compare the command to a set of playback operation commands for a media asset that is currently being played back. The media guidance application may determine that the command is not contained within the set of playback operation commands. In response to determining that the command is not contained within the set of commands, the media guidance application may determine whether the second user executes a desired outcome of the command. And in response to determining that the second user does not execute the desired outcome of the command, the media guidance application may determine whether to modify playback of the media asset.

BACKGROUND

Modifying playback of a media asset in response to a verbal command or a detected sound is a technique used to help encourage a recipient of the command to perform an action based on the command. The related art describes various ways of modifying playback based on a verbal command related to playback. For example, the related art describes systems that detect verbal commands related to playback (e.g., the user saying “Alexa, please pause the movie”), and then modifies playback based on the detected command. Typical media applications look for commands that relate to guidance operations, but fail to consider how to operate when non-guidance commands are received. The related art also can pick up ambient sounds and perform a playback operation in response to the detected sound. However, the related art does not describe different modes of operation based on whether the user is or is not authorized to perform an action that meets a goal of the sound.

SUMMARY

Systems and methods are provided herein for translating a command unrelated to playback into a pertinent playback modification to encourage a recipient of the command to execute on the command. For example, if a first user is watching a movie, and a second user calls out to the first user “Dinner's ready!”, playback of the movie may be paused to encourage the first user to stop watching the movie and go eat dinner.

To this end and others, in some aspects of the disclosure, a media guidance application may detect a command from a first user to a second user. The first user may be a user not currently watching playback of a media asset, and may be in an environment outside of the viewing environment of the media asset. The second user may be a user currently viewing playback of a media asset within the viewing environment of the media asset. For example, the media guidance application may detect a verbal command (e.g., “Come to the table for dinner!”) from the first user to the second user using an intelligent personal assistant device (e.g., an Amazon Echo).

In some embodiments, when the media guidance application detects the command from the first user to the second user, the media guidance application may detect verbal input from the first user. For example, the media guidance application may detect, using an audio detection sensor, a verbal input (e.g., the user saying “Dinner's ready!”) from the first user.

The media guidance application may compare the verbal input to a database of commands, where the database contains commands corresponding to each verbal input. For example, the media guidance application may compare the verbal input (e.g., the user saying “Dinner's ready!”) to a database containing commands (e.g., eat dinner, answer the door, clean, vacuum, etc.).

The media guidance application may determine, from the comparison, a command corresponding to the verbal input from the first user. For example, the media guidance application may determine, from the user profile, that the verbal input (e.g., “Dinner's ready!”) corresponds to the command (e.g., eat dinner) using pattern recognition between the input and the command.

In some embodiments, when the media guidance application determines from the comparison a command corresponding to the verbal input from the first user, the media guidance application may determine a match between the verbal input and the database of commands. For example, the media guidance application may determine that the verbal input (e.g., “Dinner's ready!”) corresponds to the command (e.g., eat dinner) because the verbal input matches keywords contained in the command (e.g., “dinner”). The media guidance application may determine that the command corresponding to the match (e.g., eat dinner) is the command corresponding to the verbal input from the first user.

The media guidance application may compare the command to a set of playback operation commands for a media asset that is currently being played back by the second user. For example, the media guidance application may compare the command (e.g., eat dinner) to a set of playback operation commands (e.g., pause, fast-forward, mute, etc.) for a media asset (e.g., a movie) that is currently being played back by the second user.

In response to the comparison, the media guidance application may determine that the command is not contained within the set of playback operation commands. For example, the media guidance application may determine that the command (e.g., eat dinner) is not contained within the set of playback operation commands (e.g., pause, fastforward, mute, etc.).

The media guidance application may determine, based on a user profile of the first user and a user profile of the second user, a desired outcome of the command from a plurality of outcomes of the command. For example, the media guidance application may determine a desired outcome of the command (e.g., the second user stops watching the movie and eats dinner) based on a user profile of the first user (e.g., the profile may state that the first user is a mom) and a user profile of the second user (e.g., the second profile may state that the second user is the mom's son who obeys the mom's commands).

In some embodiments, when the media guidance application is determining, based on the user profile of the first user and the user profile of the second user, the desired outcome of the command from the plurality of outcomes of the command, the media guidance application may determine attributes of the command. For example, the media guidance application may determine attributes of the command (e.g., the speaker of the command, the tone of the command, seriousness of the command, etc.) based on comparing the command to entries of a database of attributes.

The media guidance application may compare the attributes of the command to attributes of the plurality of outcomes of the command. For example, the media guidance application may compare the attributes of the command (e.g., the speaker of the command, the tone of the command, seriousness of the command, purpose of the command, etc.) to attributes of the plurality of outcomes of the command (e.g., a result if the command is followed, a result if the command is ignored, a consequence of following the command, a consequence of not following the command, etc.).

The media guidance application may determine, from the comparison, an outcome in the plurality of outcomes that contains attributes of the command to be the desired outcome. For example, the media guidance application may determine, from the comparison, an outcome (e.g., the user pauses the movie to go eat dinner) that contains attributes of the command (e.g., an intended consequence of the command) to be the desired outcome.

The media guidance application may detect an action executed by the second user. For example, the media guidance application may detect via a camera that the user has left the viewing environment where playback of the movie is occurring and has entered the dining room.

In some embodiments, when the media guidance application is detecting an action executed by the second user, the media guidance application may detect, using a sensor, the second user leaving a viewing environment of a media equipment device that is presenting the media asset. For example, the media guidance application may detect via a motion detection sensor that the second user is leaving the viewing environment of the television the user is watching a movie on.

In some embodiments, when the media guidance application is detecting an action executed by the second user, the media guidance application may detect the second user executing a command to modify playback of the media asset. For example, the media guidance application may detect the user pressing an input command on a remote control device, for example, “pause,” to pause playback of the film the user is watching.

In some embodiments, when the media guidance application is detecting an action executed by the second user, the media guidance application may detect, using a sensor, that the second user stays in the viewing environment of a media asset device. For example, the media guidance application may detect, using a heat-mapping sensor, that the second user has not left the couch where the user is watching playback of the movie.

The media guidance application may compare the action of the second user to the desired outcome of the command. For example, the media guidance application may compare the action (e.g., the second user continuing to watch the movie) to the desired outcome of the command (e.g., the second user going to eat dinner).

In some embodiments, when comparing a characteristic from the retrieved characteristics of the second user to the command, the media guidance application may select the characteristic from a group of characteristics consisting of age, rank within the household, relationship to other users, and time of day, and the media guidance application may select the command from a group of commands consisting of eating, cleaning, studying, cooking, and sleeping.

The media guidance application may determine, from the comparison, whether the command shares a characteristic of the second user. For example, the media guidance application may determine, from the comparison, whether the command (e.g., eating) shares a characteristic of the second user (e.g., time of day).

In response to determining that the command shares the characteristic, the media guidance application may modify playback of the media asset. For example, in response to determining that the command shares the characteristic, the media guidance application may pause playback of the media asset.

In response to determining that the action of the second user does not correspond to the desired outcome of the command, the media guidance application may retrieve characteristics of the second user from the user profile of the second user. For example, the media guidance application may retrieve characteristics (e.g., age, relationship to the first user, user rank within household, etc.) from the user profile of the second user.

The media guidance application may determine whether to modify playback of the media asset based on the command detected from the first user and the retrieved characteristics of the second user. For example, the media guidance application may determine whether to modify playback (e.g., pause, mute, rewind, fast-forward, turn off, etc.) based on the command detected from the first user (e.g., eat dinner) and the characteristics of the second user (e.g., the second user must always obey commands from the first user).

In some embodiments, when the media guidance application is determining whether to modify playback of the media asset based on the command detected from the first user and the retrieved characteristics of the second user, the media guidance application may retrieve a rank of the first user and a rank of the second user. For example, the media guidance application may retrieve a rank of the first user (e.g., the first user is ranked first out of five users) and a rank of the second user (e.g., the second user is ranked forth out of five users).

The media guidance application may determine, from the rank, whether the first user is ranked higher than the second user. For example, the media guidance application may determine that the first user (e.g., ranked first) is ranked higher than the second user (e.g., ranked second).

In response to determining that the first user is ranked higher than the second user, the media guidance application may modify playback of the media asset. For example, in response to determining that the first user is ranked higher than the second user the media guidance application may modify playback of the media asset (e.g., pause the movie currently playing back).

In response to determining that the second user is ranked higher than the first user, the media guidance application may continue to play back the media asset. For example, in response to determining that the second user is ranked higher than the first user, the media guidance application may continue playback of the media asset (e.g., the movie the second user is watching).

In some embodiments, the media guidance application may detect a command from the first user to the second user and a third user. For example, the media guidance application may detect a command (e.g, eat dinner) from the first user to the second user and a third user.

The media guidance application may determine, based on a user profile of the first user, the user profile of the second user and a user profile of the third user, a desired outcome of the command from a plurality of outcomes of the command.

The media guidance application may detect a first action executed by the second user and a second action executed by the third user. For example, the media guidance application may detect a first action by the second user (e.g., the second user turns up the volume of the movie) and a second action executed by the third user (e.g., a motion sensor detecting that the third user leaves the viewing environment to go eat dinner).

The media guidance application may compare the action of the second user and the action of the third user to the desired outcome of the command. For example, the media guidance application may compare the action of the second user (e.g., turning up the volume of the movie via a remote) and the action of the third user (e.g., a motion sensor detecting the third user leaving the viewing environment) to the desired outcome of the command (e.g., the second and third users going to eat dinner).

In response to determining that the action of the second user and the action of the third user do not correspond to the desired outcome of the command, the media guidance application may retrieve characteristics of the second user from the user profile of the second user and characteristics of the third user from a user profile of the third user.

The media guidance application may determine whether to modify playback of the media asset based on the command detected from the first user and the retrieved characteristics of the second user and the retrieved characteristics of the third user. For example, the media guidance application may determine to modify playback of the media asset based on the command detected from the first user (e.g., eat dinner) and the retrieved characteristics of the first user (e.g., rank, etc.) and the retrieved characteristics of the third user (e.g., rank, etc.) because the first user outranks the ranks of the second and third user. As another example, the media guidance application may determine not to modify playback of the media asset based on the command detected from the first user (e.g., eat dinner) and the retrieved characteristics of the first user (e.g., rank, etc.) and the retrieved characteristics of the second and third user (e.g., rank, etc.) because ranks of the third user outrank the rank of the command and first user.

In some aspects of the disclosure, systems and methods are provided herein for determining whether a user is authorized to perform an action that meets a goal of a sound. For example, in response to detecting the doorbell ringing, the user may or may not be allowed to pause playback of a movie that the user is watching. If the user is a child and home alone, the user may not be allowed to pause playback of the movie, to encourage the user not to answer the door when home alone. If the user is a child and his/her parents are home, the user may be allowed to pause playback of the movie to answer the door.

To this end and others, in some aspects of the disclosure, a media guidance application may detect a sound generated by a first device external to a media equipment device. For example, the media guidance application may detect, using a sensor, a sound (e.g., a doorbell ringing) by a first device (e.g., a doorbell) external to a media equipment device (e.g., a television).

The media guidance application may store a database that associates a goal in a plurality of goals with a set of actions in a plurality of actions and a sound in a plurality of sounds. For example, the media guidance application may store a database that associates a goal (e.g., answer the door) in a plurality of goals (e.g., answer the door, answer the phone, leave the house, etc.) with a set of actions (e.g., continue watching playback of a media asset and ignore the doorbell) in a plurality of actions (e.g., pause playback of a media asset to answer the door, continue watching playback of a media asset and ignore the doorbell, etc.) and a sound (e.g., a doorbell ringing) in a plurality of sounds (e.g., doorbell ringing, phone ringing, smoke detector beeping, etc.).

The media guidance application may compare the sound generated by the first device with the database to determine a goal associated with the sound and a corresponding set of actions associated with the goal. For example, the media guidance application may compare the sound generated by the first device (e.g., a doorbell ringing) with the database to determine a goal associated with the sound (e.g., answer the door) and a corresponding set of actions associated with the goal (e.g., pause playback of the media asset, leave the viewing environment to answer the door, etc.).

In some embodiments, when comparing the sound generated by the first device with the database to determine a goal associated with the sound and a corresponding set of actions associated with the goal, the media guidance application may determine a match between the sound and an entry in the database based on characteristics of the sound. For example, the media guidance application may use characteristics of the sound (e.g., tone, loudness, frequency, etc.) to match the sound with its corresponding entry in the database.

The media guidance application may retrieve, from the entry, the goal associated with the sound. For example, the media guidance application may retrieve, from the entry, the goal (e.g., answer the door) associated with the sound (e.g., a doorbell ringing).

The media guidance application may retrieve, from the entry, the corresponding set of actions associated with the goal. For example, the media guidance application may retrieve, from the entry, the corresponding set of actions (e.g., pause playback of the media asset, mute the volume of playback of the media asset, etc.) associated with the goal (e.g., answer the door).

The media guidance application may detect a user in a viewing environment of the media equipment device. For example, the media guidance application may use a sensor (e.g., a camera) to detect the user in the viewing environment of the media equipment device (e.g., television).

In some embodiments, when detecting the user in the viewing environment of the media device, the media guidance application may detect, using a sensor, a presence of the user in the viewing environment. For example, the media guidance application may use an infrared sensor to detect the user in the viewing environment of the media equipment device (e.g., television).

The media guidance application may determine, from a user profile of the user, whether the user is authorized to perform an action in the determined set of actions associated with the goal. For example, the media guidance application may determine, from an authorization database in the user's profile, whether the user is authorized to leave the viewing environment associated with the goal (e.g., answer the door).

In some embodiments, when determining, from a user profile of the user, whether the user is authorized to perform an action in the determined set of actions associated with the goal, the media guidance application may retrieve, from the user profile, a rank for the user. For example, the media guidance application may retrieve a rank for the user (e.g., 8 out of 10).

The media guidance application may retrieve, from a database, a rank for an action. For example, the media guidance application may retrieve, from a database, a rank (e.g., 5 out of 10) for an action (e.g., leave the viewing environment).

The media guidance application may determine whether the rank for the user exceeds the rank for the action. For example, the media guidance application may determine that the rank for the user (e.g., 8 out of 10) exceeds the rank for the action (e.g., 5 out of 10).

In response to determining that the rank for the user exceeds the rank for the action, the media guidance application may determine that the user is authorized to perform the action. For example, the media guidance application may determine that the user is authorized to leave the viewing environment.

In response to determining that the user is authorized to perform the action, the media guidance application may generate a notification for the user indicating the detected sound. For example, the media guidance application may generate a sound notification (e.g., a doorbell sound) to play over playback of the media asset for the user indicating the detected sound.

In some embodiments, when generating a notification for the user indicating the detected sound, the media guidance application may generate an overlay to be displayed on the media equipment device, wherein the overlay contains a notification for the user about the sound. For example, the media guidance application may generate an overlay (e.g., an overlay stating, “The doorbell is ringing!”) to be displayed on the media equipment device.

The media guidance application may modify playback of a media asset to allow the user to perform the action associated with the goal. For example, the media guidance application may modify playback of the media asset (e.g., pause a movie the user is watching) to allow the user to perform the action (e.g., leave the viewing environment) associated with the goal (e.g., answer the door).

In some embodiments, when modifying playback of a media asset to allow the user to perform the action associated with the goal, the media guidance application may retrieve, from the database, a set of playback modifications associated with the goal. For example, the media guidance application may retrieve, from the database, a set of playback modifications (e.g., pause, play, fast-forward, rewind, mute, turn on/off, etc.) associated with the goal.

The media guidance application may select a playback modification from the set of playback modifications based on preferences for the user. For example, the media guidance application may select a playback modification (e.g., pause) from the set of playback modifications based on preferences for the user (e.g., the user does not want to miss any content while answering the door).

The media guidance application may modify playback of the media asset based on the selected playback modification. For example, the media guidance application may modify playback of the media asset based on the selected playback modification (e.g., pause playback of the media asset).

In response to determining that the user is not authorized to perform the action, the media guidance application may generate a notification for a second user to perform the action. For example, the media guidance application may generate a notification (e.g., send an SMS message to the second user) to perform the action (e.g., answer the door).

In some embodiments, the media guidance application may determine that the sound is within an audible range of the viewing environment. For example, the media guidance application may detect the sound using a sensor (e.g., a microphone) contained within the viewing environment.

In response to determining that the user is not authorized to perform the action, the media guidance application may prevent the user from modifying playback of the media asset. For example, the media guidance application may prevent the user from modifying playback of the media guidance application (e.g., not allow the user to pause playback of the media asset).

The media guidance application may modify playback of the media asset to prevent the user from performing the action associated with the goal. For example, the media guidance application may increase the volume of playback of the media asset to drown out the sound within the user's audible range.

In some embodiments, when modifying playback of the media asset, the media guidance application may determine a volume that dampens the sound that is within the audible range. For example, the media guidance to application may determine a volume that is equivalent or higher than the determined volume of the sound within the audible range.

The media guidance application may adjust a volume corresponding to playback of the media asset to be the volume that dampens the sound. For example, the media guidance application may adjust the playback volume of the media asset to be a volume that is higher than the detected volume of the sound in the audible range.

DETAILED DESCRIPTION

Systems and methods are provided herein for translating a command unrelated to playback into a pertinent playback modification to encourage a recipient of the command to execute on the command. A media guidance application may determine a command from a first user to a second user. The media guidance application may compare the command to a set of playback operation commands for a media asset that is currently being played back. In response to the comparison, the media guidance application may determine that the command is not contained within the set of playback operation commands. In response to determining that the command is not contained within the set of playback operation commands, the media guidance application may determine whether the second user executes a desired outcome of the command. And in response to determining that the second user does not execute the desired outcome of the command, the media guidance application may determine whether to modify playback of the media asset.

FIG. 1shows an illustrative embodiment of translating an irrelevant command into a pertinent playback modification to encourage a recipient of the command to execute on the command, in accordance with some embodiments of the disclosure.FIG. 1depicts illustrative display100, which may be presented by control circuitry that executes a media guidance application on any user equipment. The functionality of user equipment, control circuitry, and the media guidance application is described in further detail with respects toFIGS. 2-5.

The media guidance application may detect that first user102has issued command104. Command104may be a verbal input of a word or phrase. The media guidance application may detect that command104is directed towards second user106(e.g., first user102may say “Time for dinner!” to second user106). The media guidance application may be playing back media asset108. The media guidance application may generate for display trick play bar110over media asset108; trick play bar110may contain all trick play functionalities (e.g., play, pause, stop, rewind, fast-forward, etc.). The media guidance application may, within trick play bar110, generate for display indicator112, which may correspond to the current location of playback of media asset108. The media guidance application may determine that command114corresponds to a trick play bar command (e.g., play, pause, stop, rewind, fast-forward, volume up, volume down, on/off, etc.) applied to the media asset (e.g., the media asset is paused). The media guidance application may determine that volume116may correspond to the current volume of playback of media asset108. The media guidance application may modify volume116in response to command114.

In some embodiments, a media guidance application may detect a command from a first user to a second user. The first user may be a user not currently watching playback of a media asset, and may be in an environment outside of the viewing environment of the media asset. The second user may be a user currently viewing playback of media asset108within the viewing environment of the media asset. For example, the media guidance application may detect a verbal command (e.g., “Come to the table for dinner!”) from the first user to the second user using a home entertainment system (e.g., an Amazon Echo).

In some embodiments, when the media guidance application detects the command from the first user to the second user, the media guidance application may detect a verbal input from the first user. The verbal input may be a spoken word or phrase from the first user that corresponds to a command. For example, the media guidance application may detect, using an audio detection sensor (e.g., a microphone), a verbal input (e.g., the user saying, “Dinner's ready!”) from the first user. The media guidance application may compare an audio signal detected by the sensor (e.g., the microphone) to known audio samples from the first user, retrieved from a profile of the first user, to determine that the audio signal is verbal input from the first user.

As another example, the media guidance application may detect a verbal input from the first user using an intelligent personal assistant (IPA) (e.g., an Amazon Echo, Siri, etc.), where the IPA constantly listens for audio inputs in an environment around the IPA to detect verbal input from the user.

The media guidance application may compare the verbal input to a database of commands, where the database contains commands corresponding to each verbal input. The media guidance application may retrieve the database of commands from the profile of the first user. For example, the media guidance application may retrieve the database of commands from the profile for the first user and compare the verbal input (e.g., the user saying, “Dinner's ready!”) to a database containing commands (e.g., eat dinner, answer the door, clean, vacuum, etc.).

The media guidance application may determine, from the comparison, a command corresponding to the verbal input from the first user. For example, the media guidance application may determine, from the user profile, that the verbal input (e.g., “Dinner's ready!”) corresponds to the command (e.g., eat dinner) using pattern recognition between the input and the command.

In some embodiments, when the media guidance application determines from the comparison a command corresponding to the verbal input from the first user, the media guidance application may determine a match between the verbal input and the database of commands. The media guidance application may determine potential matches between the verbal input and the database of commands through keyword matching. For example, the media guidance application may detect keywords in the verbal input (e.g., “dinner” and “ready”) and may compare these keywords to the database of commands. Each command in the database of commands may have a plurality of keywords associated with it (e.g., the command “eat dinner” may have the keywords “dinner,” “food,” “hungry,” “eat,” “eating,” etc. associated with it). The media guidance application may determine that the verbal input matches a command when a single or multiple keywords from the verbal input match a single or multiple keywords associated with a command in the database of commands.

For example, the media guidance application may determine that the verbal input (e.g., “Dinner's ready!”) corresponds to the command (e.g., eat dinner) because the verbal input matches keywords contained in the command (e.g., “dinner”). The media guidance application may determine that the command corresponding to the match (e.g., eat dinner) is the command corresponding to the verbal input from the first user.

In some embodiments, when the media guidance application determines multiple potential matches between the verbal input and the database of commands (e.g., the verbal input may match multiple different commands), the media guidance application may determine that a command corresponding to a match within the potential matches that contains the most keyword matches is the command corresponding to the verbal input from the first user. For example, when the media guidance application determines that the verbal input (e.g., “Time to eat dinner!”) matches multiple commands (e.g., eat dinner, eat lunch, set timer etc.), the media guidance application may determine that the match (e.g., eat dinner) contains the most keyword matches and thus is the command corresponding to the verbal input.

After determining the command given by the first user, the media guidance application may determine the context of the command and how it relates to a playback operation. The media guidance application may compare the command to a set of playback operation commands for a media asset that is currently being played back by the second user. The media guidance application may retrieve the set of playback operation commands from a database in the profile. For example, the media guidance application may compare the command (e.g., eat dinner) to a set of playback operation commands (e.g., pause, fast-forward, mute, etc.), retrieved from the profile, for a media asset (e.g., a movie) that is currently being played back by the second user.

In response to the comparison, the media guidance application may determine that the command is not contained within the set of playback operation commands. For example, the media guidance application may determine that the command (e.g., eat dinner) is not contained within the set of playback operation commands (e.g., pause, fast-forward, mute, etc.).

The media guidance application may determine, based on a user profile of the first user and a user profile of the second user, a desired outcome of the command from a plurality of outcomes of the command. The media guidance application may use attributes to determine the desired outcome, as described in detail below. For example, the media guidance application may determine a desired outcome of the command (e.g., the second user stops watching the movie and eats dinner) based on a user profile of the first user (e.g., the profile may state that the first user is a mom) and a user profile of the second user (e.g., the second profile may state that the second user is the mom's son who obeys the mom's commands), using the methods described below.

In some embodiments, the media guidance application may determine the desired outcome of the command by determining attributes of the command. In some embodiments, when the media guidance application is determining, based on the user profile of the first user and the user profile of the second user, the desired outcome of the command from the plurality of outcomes of the command, the media guidance application may determine attributes of the command. The media guidance application may analyze the command to determine distinct attributes (e.g., the prosody (e.g., using the tune and rhythm of speech to determine the meaning) of the command).

In some embodiments, the media guidance application may analyze the audio characteristics of the command to determine distinct attributes. In some embodiments, to determine distinct attributes, the media guidance application may compare the command with an audio sample in a plurality of audio samples, where each audio sample is associated with a distinct user, to determine the user speaking the command. The media guidance application may determine, using speech processing, the following attributes, including the form of the utterance (e.g., statement, question, or command), the presence of sarcasm or irony, emphasis, contrast, focus, and presence of infant-directed speech (e.g., baby talk) using speech processing variables such as the pitch of the voice (e.g., varying between low and high), the length of sounds (e.g., varying between short and long), the loudness (e.g., varying between soft and loud), and the timbre of the sound. For example, the media guidance application may determine attributes of the command (e.g., the speaker of the command, the tone of the command, seriousness of the command, etc.) using speech processing with pitch, length of sounds, loudness, and timbre speech processing variables corresponding to the command. In response to determining distinct attributes of the command, the media guidance application may compare the attributes of the command to attributes of the plurality of outcomes of the command to determine a desired outcome.

The media guidance application may compare the attributes of the command to attributes of the plurality of outcomes of the command. For example, the media guidance application may compare the attributes of the command (e.g., form of utterance, presence of sarcasm or irony, emphasis, contrast, focus, infant-direct speech, etc.) to attributes of the plurality of outcomes of the command (e.g., a result if the command is followed, a result if the command is ignored, a consequence of following the command, a consequence of not following the command, etc.). The media guidance application may retrieve the plurality of outcomes from a database in the profile.

In some embodiments, the media guidance application may retrieve a plurality of outcomes of the command from the profile. The media guidance application may determine that each command in the database of commands is linked to a set of corresponding outcomes to said command. For example, the media guidance application may use a pointer from the command entry in the database to the set of corresponding outcomes. The corresponding outcomes to the said command may be predetermined by an editor, and may also be updated and added to by the media guidance application based on learned behaviors of the users.

In some embodiments, the media guidance application may add an outcome to be linked to a command based on learned behavior. The media guidance application may determine that a new outcome that occurred between the first and second user after a command was issued was not included in the set of corresponding outcomes to said command by comparing the new outcome to the set of corresponding outcomes, and determining that there is no overlap between the two pieces of data. For example, the media guidance application may determine from the comparison that a new outcome (e.g., the second user answers his/her phone in response to the command) does not overlap the current set of corresponding outcomes (e.g., eat, pause the movie, do nothing).

The media guidance application may retrieve attributes of an outcome in the plurality of outcomes from an attribute database in the profile.

In some embodiments, the media guidance application may retrieve attributes of an outcome from an attribute database that contains preset attributes, determined by an editor, that correspond to an outcome. The media guidance application may update the attribute database in response to determining a new attribute that corresponds to an outcome, or to remove an attribute that corresponds to an outcome (e.g., no longer is an accurate attribute of the outcome), as described in detail below. Each attribute may have a pointer in the database that is directed to the corresponding outcome. For example, the media guidance application may retrieve attributes (e.g., user goes to dinner, user goes to the dining room, user eats food from plate on dinner table, user pauses playback and leaves room to go to the dining room, etc.) corresponding to the outcome (e.g., eat dinner).

The media guidance application may determine that a new attribute corresponds to an outcome by determining that the outcome has occurred (e.g., detecting it using a sensor), and analyzing the occurred outcome to determine attributes of the outcome. The media guidance application may determine attributes of the outcome based on the physical and auditory components of the outcome. The media guidance application may determine the attributes based on the auditory components of the occurred outcome using methods similar to those described above in relation to determining attributes of the command (e.g., by determining the prosody of the command).

In some embodiments, the media guidance application may determine attributes of the outcome based on physical components of the occurred outcome. The media guidance application may detect a physical response corresponding to the outcome using a sensor. For example, the media guidance application may use a camera to detect the second user physically leaving the viewing environment of the playback of the media asset. As another example, the media guidance application may use an infrared sensor to determine a heat map of the viewing environment, to detect that the second user has not moved from his/her position in the viewing environment in response to hearing the command from the first user. The media guidance application may determine that the detected physical response is an attribute of the occurred outcome. The media guidance application may compare the determined attributes of the occurred outcome to the attributes in the database corresponding to the outcome, and may add any attributes from the occurred outcome that were not in the attributes corresponding to the outcome.

For example, the media guidance application may determine, from detecting via a camera, that an outcome (e.g., the second user leaving the viewing environment of the media asset) has occurred. The media guidance application may analyze the occurred outcome (e.g., the second user yelled out to the first user “I'm not hungry!”) to determine attributes of the outcome (e.g., based on the auditory and physical components of the occurred outcome). The media guidance application may determine that the user's negative response (e.g., based on the user yelling and the context of the user's response) and the user's failure to leave the viewing area are attributes of the occurred outcome (e.g., the user does not follow the command).

In some embodiments, the media guidance application may remove an attribute that corresponds to an outcome in response to determining that the attribute has not been present in a corresponding outcome after the same outcome has occurred at least a threshold amount of times. The media guidance application may keep a counter in a plurality of counters, where each counter is associated with an attribute for a specific outcome. The media guidance application may update the counter (e.g., add a value to the counter) for an attribute for a specific outcome after the specific outcome has occurred and contained the attribute. The media guidance application may retrieve the threshold amount of times from the profile, and the threshold value may be preset by an editor, and may be updated based on user input. The media guidance application may compare the counter for the specific outcome to the threshold value, and in response to determining that the counter is greater than the threshold value, the media guidance application may remove the attribute as an attribute that corresponds to the outcome.

For example, the media guidance application may remove an attribute (e.g., the second user yells “No” in response to the command) that corresponds to an outcome (e.g., the second user does not eat dinner). The media guidance application may determine that the attribute has not been present in a corresponding outcome after the same outcome has occurred at least a threshold amount of time (e.g., 10 times). The media guidance application may retrieve an editor-defined threshold amount of times from the profile (e.g., 10 times). The media guidance application may compare the editor-defined threshold amount of times with a counter associated with the outcome, and in response to determining that the counter (e.g., 11 times) is greater than the threshold amount (e.g., 10 times), the media guidance application may remove the attribute (e.g., the second user yells “No” in response to the command) that corresponds to an outcome (e.g., the second user does not eat dinner).

The media guidance application may determine, from the comparison, an outcome in the plurality of outcomes that contains attributes of the command to be the desired outcome. The media guidance application may use a ranking system to determine, from the comparison, the desired outcome. For example, the media guidance application may determine, from the comparison, an outcome (e.g., the user pauses the movie to go eat dinner) that contains attributes of the command (e.g., an intended consequence of the command) to be the desired outcome.

In some embodiments, the media guidance application may determine the outcome in the plurality of outcomes that contains attributes of the command to be the desired outcome based on a rank of the outcome in the plurality of outcomes. The media guidance application may determine a rank of an outcome of a plurality of outcomes based on the amount of attributes that the outcome has in common with the attributes of the command (e.g., a percentage of attributes in common). The media guidance application may determine that rank directly corresponds with the percentage of attributes in common (e.g., the rank is higher when the percentage is higher).

For example, the media guidance application may determine a rank of an outcome in a plurality of outcomes by determining that the outcome has a percentage of attributes (e.g., 18 out of 20 attributes, or 90%) in common with the attributes of the command (e.g., by comparing the attributes of the outcome with the attributes of the command). The media guidance application may determine that the rank of the outcome directly corresponds with the percentage (e.g., ranked 90 out of 100).

In some embodiments, the media guidance application may retrieve, from the preferences of the first user (e.g., the first user has a preferred outcome for a specific command), an outcome corresponding to the first user's preferred outcome. The preferred outcome for the specific command may cause the outcome in the plurality of outcomes corresponding to the preferred outcome to be the highest ranked outcome. For example, the media guidance application may retrieve an outcome (e.g., the second user gets up to go eat dinner) corresponding to the first user's preferred outcome from the preferences of the first user. The media guidance application may determine that the preferred outcome ranks the highest out of all the plurality of outcomes (e.g., ranks 100 out of 100).

After determining the desired outcome of the command, the media guidance application may determine the second user's reaction to the command to determine whether it meets the desired outcome. The media guidance application may detect an action executed by the second user. For example, the media guidance application may detect via a camera that the user has left the viewing environment where playback of the movie is occurring and has entered the dining room.

In some embodiments, when the media guidance application is detecting an action executed by the second user, the media guidance application may detect using a sensor, the second user leaving a viewing environment of a media equipment device that is presenting the media asset. For example, the media guidance application may detect via a motion detection sensor that the second user is leaving the viewing environment of the television the user is watching a movie on.

In some embodiments, when the media guidance application is detecting an action executed by the second user, the media guidance application may detect, the second user executing a command to modify playback of the media asset. For example, the media guidance application may detect the user pressing an input command on a remote control device to “pause” playback of the film the user is watching.

In some embodiments, when the media guidance application is detecting an action executed by the second user, the media guidance application may detect, using a sensor, that the second user stays in the viewing environment of a media asset device. For example, the media guidance application may detect using a heat-mapping sensor that the second user has not left the couch where the user is watching playback of the movie.

The media guidance application may compare the action of the second user to the desired outcome of the command. For example, the media guidance application may compare the action (e.g., the second user continuing to watch the movie) to the desired outcome of the command (e.g., the second user going to eat dinner).

In response to determining that the action of the second user does not correspond to the desired outcome of the command, the media guidance application may retrieve characteristics of the second user from the user profile of the second user. The media guidance application may retrieve characteristics of the second user from a characteristics database in the user profile. The characteristics values stored in the database may be determined based on user input (e.g., the user inputting information via a user input device, such as a remote controller). For example, the media guidance application may retrieve characteristics (e.g., age, relationship to the first user, user rank within household, etc.) from the user profile of the second user.

In some embodiments, the media guidance application may compare a characteristic from the retrieved characteristics of the second user to the command, where the characteristic is selected from a group of characteristics consisting of age, rank, relationship to other users, and time of day, and the command is selected from a group of commands consisting of, eating, cleaning, studying, cooking, and sleeping.

The media guidance application may determine, from the comparison, whether the command shares a characteristic of the second user. For example, the media guidance application may determine, from the comparison, whether the command (e.g., eating) shares a characteristic of the second user (e.g., time of day).

In some embodiments, the media guidance application may determine whether the command shares the “age” characteristic of the second user. The media guidance application may retrieve, from the profile, the age characteristics of the command. For example, the media guidance application may retrieve the age characteristics of the command (e.g., this command must be obeyed by any users under the age of 15, and may be ignored by any users over the age of 15). The media guidance application may compare the age (e.g., the second user is 10 years old) of the second user to the age characteristics of the command, and may determine that the command shares the age characteristic of the second user (e.g., the second user's age is within the age range (15and under) of users that must obey the command).

In some embodiments, the media guidance application may determine whether the command shares the “relationship to other users” characteristic of the second user. The media guidance application may retrieve the second user's relationship to the other users (e.g., the second user is the son of the first user) from the profile. The media guidance application may retrieve the relationship characteristic of the command (e.g., a hierarchy of who must obey commands based on the relationship of the user giving the command to the user receiving the command). The media guidance application may determine, based on the hierarchy, whether the second user has to obey the first user's commands. In response to determining that “yes,” the second user has to obey the first user's commands, the media guidance application may determine that the command shares the “relationship to other users” characteristic with the second user.

In some embodiments, the media guidance application may determine whether the command shares the “time of day” characteristic of the second user. The media guidance application may retrieve the “time of day” characteristic (e.g., the user obeys commands from the first user between 5:00 pm-8:00 pm every day) from the profile of the second user. The time of day characteristic may be a predetermined value created from an input from the first user into the profile of the second user. The media guidance application may determine the time of day that the command was issued by the first user (e.g., 7:02 pm). The media guidance application may compare this time to the time of day characteristic, and determine that the command shares the time of day characteristic with the second user because the time the command was issued falls within the timeframe from the time of day characteristic.

In some embodiments, when the media guidance application is determining whether to modify playback of the media asset based on the command detected from the first user and the retrieved characteristics of the second user, the media guidance application may retrieve a rank of the first user and a rank of the second user. The media guidance application may retrieve the ranks of the first user and second user from the profiles, where the ranks are preset values based on user input (e.g., the first user selects the ranking order of all the users with user accounts). For example, the media guidance application may retrieve a rank of the first user (e.g., the first user is ranked first out of five users) and a rank of the second user (e.g., the second user is ranked fourth out of five users).

The media guidance application may determine, from the rank, whether the first user is ranked higher than the second user. For example, the media guidance application may determine that the first user (e.g., ranked first) is ranked higher than the second user (e.g., ranked second).

In response to determining that the first user is ranked higher than the second user, the media guidance application may modify playback of the media asset. For example, in response to determining that the first user is ranked higher than the second user, the media guidance application may modify playback of the media asset (e.g., pause the movie currently playing back).

In response to determining that the second user is ranked higher than the first user, the media guidance application may continue to play back the media asset. For example, in response to determining that the second user is ranked higher than the first user, the media guidance application may continue playback of the media asset (e.g., the movie the second user is watching).

In response to determining that the command shares the characteristic, the media guidance application may modify playback of the media asset. For example, in response to determining that the command shares the characteristic, the media guidance application may modify playback of the media asset (e.g., pause playback of the media asset).

The media guidance application may determine the specific type of playback modification (e.g., pause, mute, rewind, fast-forward, turn off, etc.) based on preferences for the first user. The media guidance application may retrieve the first user's preferences from a playback modification database in the profile the first user. The media guidance application may retrieve a playback modification from the database that corresponds to the command. The playback modifications corresponding to each command may be preset by an editor, or by input from the first user.

For example, the media guidance application may determine the specific type of playback modification based on preferences of the first user. The media guidance application may retrieve the first user's preferences from a playback modification database in the profile of the first user. The media guidance application may retrieve a playback modification (e.g., turn off playback of the media asset) from the database that corresponds to the command (e.g., eat dinner).

In some embodiments, the media guidance application may detect a command from the first user to the second user and a third user. For example, the media guidance application may detect a command (e.g., eat dinner) from the first user to the second user and a third user. The media guidance application may detect a command using similar methods as described above.

The media guidance application may determine, based on the user profile of the first user, the user profile of the second user and a user profile of the third user, a desired outcome of the command from a plurality of outcomes of the command. The media guidance application may determine the desired outcome of the command using similar methods as described above.

The media guidance application may detect a first action executed by the second user and a second action executed by the third user. For example, the media guidance application may detect a first action by the second user (e.g., the second user turns up the volume of the movie) and a second action executed by the third user (e.g., a motion sensor may detect that the third user leaves the viewing environment to go eat dinner). The media guidance application may detect the first action executed by the second user and the second action executed by the third user using similar methods to detect actions as described above.

The media guidance application may compare the action of the second user and the action of the third user to determine the desired outcome of the command. For example, the media guidance application may compare the action of the second user (e.g., turning up the volume of the movie via a remote) and the action of the third user (e.g., a motion sensor detecting the third user leaving the viewing environment) to the desired outcome of the command (e.g., the second and third users going to eat dinner).

In response to determining that the action of the second user and the action of the third user do not correspond to the desired outcome of the command, the media guidance application may retrieve characteristics of the second user from the user profile of the second user and characteristics of the third user from a user profile of the third user.

The media guidance application may determine whether to modify playback of the media asset based on the command detected from the first user and the retrieved characteristics of the second user and the retrieved characteristics of the third user. For example, the media guidance application may determine to modify playback of the media asset based on the command detected from the first user (e.g., eat dinner) and the retrieved characteristics of the first user (e.g., rank, etc.) and the retrieved characteristics of the third user (e.g., rank, etc.) because the command outranks the ranks of the second and third user. As another example, the media guidance application may determine not to modify playback of the media asset based on the command detected from the first user (e.g., eat dinner) and the retrieved characteristics of the first user (e.g., rank, etc.) and the retrieved characteristics of the third user (e.g., rank, etc.) because the ranks of the second and third user outrank the rank of the command and first user.

As yet another example, the media guidance application may determine to partially modify play back (e.g., mute the audio of the playback, but playback the audio via Bluetooth headphones for user three) of the media asset based on the command detected from the first user (e.g., eat dinner) and the retrieved characteristics of the first user (e.g., rank, etc.) and the retrieved characteristics of the third user (e.g., rank, etc.) because the rank of only the third user outranks the rank of the command and first user.

FIG. 2shows illustrative grid of a program listings display200arranged by time and channel that also enables access to different types of content in a single display. Display200may include grid202with: (1) a column of channel/content type identifiers204, where each channel/content type identifier (which is a cell in the column) identifies a different channel or content type available; and (2) a row of time identifiers206, where each time identifier (which is a cell in the row) identifies a time block of programming. Grid202also includes cells of program listings, such as program listing208, where each listing provides the title of the program provided on the listing's associated channel and time. With a user input device, a user can select program listings by moving highlight region210. Information relating to the program listing selected by highlight region210may be provided in program information region212. Region212may include, for example, the program title, the program description, the time the program is provided (if applicable), the channel the program is on (if applicable), the program's rating, and other desired information.

Grid202may provide media guidance data for non-linear programming including on-demand listing214, recorded content listing216, and Internet content listing218. A display combining media guidance data for content from different types of content sources is sometimes referred to as a “mixed-media” display. Various permutations of the types of media guidance data that may be displayed that are different than display200may be based on user selection or guidance application definition (e.g., a display of only recorded and broadcast listings, only on-demand and broadcast listings, etc.). As illustrated, listings214,216, and218are shown as spanning the entire time block displayed in grid202to indicate that selection of these listings may provide access to a display dedicated to on-demand listings, recorded listings, or Internet listings, respectively. In some embodiments, listings for these content types may be included directly in grid202. Additional media guidance data may be displayed in response to the user selecting one of the navigational icons220. (Pressing an arrow key on a user input device may affect the display in a similar manner as selecting navigational icons220.)

Display200may also include video region222, and options region226. Video region222may allow the user to view and/or preview programs that are currently available, will be available, or were available to the user. The content of video region222may correspond to, or be independent from, one of the listings displayed in grid202. Grid displays including a video region are sometimes referred to as picture-in-guide (PIG) displays. PIG displays and their functionalities are described in greater detail in Satterfield et al. U.S. Pat. No. 6,564,378, issued May 13, 2003 and Yuen et al. U.S. Pat. No. 6,239,794, issued May 29, 2001, which are hereby incorporated by reference herein in their entireties. PIG displays may be included in other media guidance application display screens of the embodiments described herein.

Options region226may allow the user to access different types of content, media guidance application displays, and/or media guidance application features. Options region226may be part of display200(and other display screens described herein), or may be invoked by a user by selecting an on-screen option or pressing a dedicated or assignable button on a user input device. The selectable options within options region226may concern features related to program listings in grid202or may include options available from a main menu display. Features related to program listings may include searching for other air times or ways of receiving a program, recording a program, enabling series recording of a program, setting program and/or channel as a favorite, purchasing a program, or other features. Options available from a main menu display may include search options, VOD options, parental control options, Internet options, cloud-based options, device synchronization options, second screen device options, options to access various types of media guidance data displays, options to subscribe to a premium service, options to edit a user's profile, options to access a browse overlay, or other options.

Another display arrangement for providing media guidance is shown inFIG. 3. Video mosaic display300includes selectable options302for content information organized based on content type, genre, and/or other organization criteria. In display300, television listings option304is selected, thus providing listings306,308,310, and312as broadcast program listings. In display300the listings may provide graphical images including cover art, still images from the content, video clip previews, live video from the content, or other types of content that indicate to a user the content being described by the media guidance data in the listing. Each of the graphical listings may also be accompanied by text to provide further information about the content associated with the listing. For example, listing308may include more than one portion, including media portion314and text portion316. Media portion314and/or text portion316may be selectable to view content in full-screen or to view information related to the content displayed in media portion314(e.g., to view listings for the channel that the video is displayed on).

The listings in display300are of different sizes (i.e., listing306is larger than listings308,310, and312), but if desired, all the listings may be the same size. Listings may be of different sizes or graphically accentuated to indicate degrees of interest to the user or to emphasize certain content, as desired by the content provider or based on user preferences. Various systems and methods for graphically accentuating content listings are discussed in, for example, Yates, U.S. Patent Application Publication No. 2010/0153885, filed Nov. 12, 2009, which is hereby incorporated by reference herein in its entirety.

Users may access content and the media guidance application (and its display screens described above and below) from one or more of their user equipment devices.FIG. 4shows a generalized embodiment of illustrative user equipment device400. More specific implementations of user equipment devices are discussed below in connection withFIG. 5. User equipment device400may receive content and data via input/output (hereinafter “I/O”) path402. I/O path402may provide content (e.g., broadcast programming, on-demand programming, Internet content, content available over a local area network (LAN) or wide area network (WAN), and/or other content) and data to control circuitry404, which includes processing circuitry406and storage408. Control circuitry404may be used to send and receive commands, requests, and other suitable data using I/O path402. I/O path402may connect control circuitry404(and specifically processing circuitry406) to one or more communications paths (described below). I/O functions may be provided by one or more of these communications paths, but are shown as a single path inFIG. 4to avoid overcomplicating the drawing.

A user may send instructions to control circuitry404using user input interface410. User input interface410may be any suitable user interface, such as a remote control, mouse, trackball, keypad, keyboard, touch screen, touchpad, stylus input, joystick, voice recognition interface, or other user input interfaces. Display412may be provided as a stand-alone device or integrated with other elements of user equipment device400. For example, display412may be a touchscreen or touch-sensitive display. In such circumstances, user input interface410may be integrated with or combined with display412. Display412may be one or more of a monitor, a television, a liquid crystal display (LCD) for a mobile device, amorphous silicon display, low temperature poly silicon display, electronic ink display, electrophoretic display, active matrix display, electro-wetting display, electrofluidic display, cathode ray tube display, light-emitting diode display, electroluminescent display, plasma display panel, high-performance addressing display, thin-film transistor display, organic light-emitting diode display, surface-conduction electron-emitter display (SED), laser television, carbon nanotubes, quantum dot display, interferometric modulator display, or any other suitable equipment for displaying visual images. In some embodiments, display412may be HDTV-capable. In some embodiments, display412may be a 3D display, and the interactive media guidance application and any suitable content may be displayed in 3D. A video card or graphics card may generate the output to the display412. The video card may offer various functions such as accelerated rendering of 3D scenes and 2D graphics, MPEG-2/MPEG-4 decoding, TV output, or the ability to connect multiple monitors. The video card may be any processing circuitry described above in relation to control circuitry404. The video card may be integrated with the control circuitry404. Speakers414may be provided as integrated with other elements of user equipment device400or may be stand-alone units. The audio component of videos and other content displayed on display412may be played through speakers414. In some embodiments, the audio may be distributed to a receiver (not shown), which processes and outputs the audio via speakers414.

The guidance application may be implemented using any suitable architecture. For example, it may be a stand-alone application wholly-implemented on user equipment device400. In such an approach, instructions of the application are stored locally (e.g., in storage408), and data for use by the application is downloaded on a periodic basis (e.g., from an out-of-band feed, from an Internet resource, or using another suitable approach). Control circuitry404may retrieve instructions of the application from storage408and process the instructions to generate any of the displays discussed herein. Based on the processed instructions, control circuitry404may determine what action to perform when input is received from input interface410. For example, movement of a cursor on a display up/down may be indicated by the processed instructions when input interface410indicates that an up/down button was selected.

User equipment device400ofFIG. 4can be implemented in system500ofFIG. 5as user television equipment502, user computer equipment504, wireless user communications device506, or any other type of user equipment suitable for accessing content, such as a non-portable gaming machine. For simplicity, these devices may be referred to herein collectively as user equipment or user equipment devices, and may be substantially similar to user equipment devices described above. User equipment devices, on which a media guidance application may be implemented, may function as a standalone device or may be part of a network of devices. Various network configurations of devices may be implemented and are discussed in more detail below.

A user equipment device utilizing at least some of the system features described above in connection withFIG. 4may not be classified solely as user television equipment502, user computer equipment504, or a wireless user communications device506. For example, user television equipment502may, like some user computer equipment504, be Internet-enabled allowing for access to Internet content, while user computer equipment504may, like some television equipment502, include a tuner allowing for access to television programming. The media guidance application may have the same layout on various different types of user equipment or may be tailored to the display capabilities of the user equipment. For example, on user computer equipment504, the guidance application may be provided as a web site accessed by a web browser. In another example, the guidance application may be scaled down for wireless user communications devices506.

In system500, there is typically more than one of each type of user equipment device but only one of each is shown inFIG. 5to avoid overcomplicating the drawing. In addition, each user may utilize more than one type of user equipment device and also more than one of each type of user equipment device.

The user equipment devices may be coupled to communications network514. Namely, user television equipment502, user computer equipment504, and wireless user communications device506are coupled to communications network514via communications paths508,510, and512, respectively. Communications network514may be one or more networks including the Internet, a mobile phone network, mobile voice or data network (e.g., a 4G or LTE network), cable network, public switched telephone network, or other types of communications network or combinations of communications networks. Paths508,510, and512may separately or together include one or more communications paths, such as, a satellite path, a fiber-optic path, a cable path, a path that supports Internet communications (e.g., IPTV), free-space connections (e.g., for broadcast or other wireless signals), or any other suitable wired or wireless communications path or combination of such paths. Path512is drawn with dotted lines to indicate that in the exemplary embodiment shown inFIG. 5it is a wireless path and paths508and510are drawn as solid lines to indicate they are wired paths (although these paths may be wireless paths, if desired). Communications with the user equipment devices may be provided by one or more of these communications paths, but are shown as a single path inFIG. 5to avoid overcomplicating the drawing.

System500includes content source516and media guidance data source518coupled to communications network514via communication paths520and522, respectively. Paths520and522may include any of the communication paths described above in connection with paths508,510, and512. Communications with the content source516and media guidance data source518may be exchanged over one or more communications paths, but are shown as a single path inFIG. 5to avoid overcomplicating the drawing. In addition, there may be more than one of each of content source516and media guidance data source518, but only one of each is shown inFIG. 5to avoid overcomplicating the drawing. (The different types of each of these sources are discussed below.) If desired, content source516and media guidance data source518may be integrated as one source device. Although communications between sources516and518with user equipment devices502,504, and506are shown as through communications network514, in some embodiments, sources516and518may communicate directly with user equipment devices502,504, and506via communication paths (not shown) such as those described above in connection with paths508,510, and512.

In a third approach, users of user equipment devices inside and outside a home can use their media guidance application to communicate directly with content source516to access content. Specifically, within a home, users of user television equipment502and user computer equipment504may access the media guidance application to navigate among and locate desirable content. Users may also access the media guidance application outside of the home using wireless user communications devices506to navigate among and locate desirable content.

In a fourth approach, user equipment devices may operate in a cloud computing environment to access cloud services. In a cloud computing environment, various types of computing services for content sharing, storage or distribution (e.g., video sharing sites or social networking sites) are provided by a collection of network-accessible computing and storage resources, referred to as “the cloud.” For example, the cloud can include a collection of server computing devices, which may be located centrally or at distributed locations, that provide cloud-based services to various types of users and devices connected via a network such as the Internet via communications network514. These cloud resources may include one or more content sources516and one or more media guidance data sources518. In addition or in the alternative, the remote computing sites may include other user equipment devices, such as user television equipment502, user computer equipment504, and wireless user communications device506. For example, the other user equipment devices may provide access to a stored copy of a video or a streamed video. In such embodiments, user equipment devices may operate in a peer-to-peer manner without communicating with a central server.

FIG. 6depicts an illustrative flowchart of a process for translating a non-playback command into a pertinent playback modification to encourage a recipient of the command to execute on the command, in accordance with some embodiments of the disclosure. Process600, and any of the following processes, may be executed by control circuitry404(e.g., in a manner instructed to control circuitry404by the media guidance application). Control circuitry404may be part of user equipment (e.g., user equipment100, which may have any or all of the functionality of user television equipment502, user computer equipment504, and/or wireless communications device506), or of a remote server separated from the user equipment by way of communication network514, or distributed over a combination of both.

Process600begins at602, where control circuitry404determines a command from first user102to second user106. Control circuitry404determines the command from first user102to second user106by detecting audio output104from first user102using a sensor, user television equipment502, user computer equipment504, and/or wireless user communications device512. For example, control circuitry404may determine a command (e.g., eat dinner) from first user102to second user104by detecting a verbal output (e.g., “Time for dinner!”) from first user102using an audio sensor.

At604, control circuitry404compares the command to a set of playback operation commands for a media asset that is currently being played back. Control circuitry404retrieves a set of playback operation commands for the media asset from storage408or over communications network514. Control circuitry404compares the command to the retrieved set of playback operations using processing circuitry406. For example, control circuitry404compares the command (e.g., “eat dinner”) to a set of playback operation commands (e.g., pause, play, rewind, fast-forward, stop, mute, etc.) for the media asset currently being played back.

At606, control circuitry404determines whether the command is contained within the set of playback operations. If, at606, control circuitry404determines that “Yes,” the command is contained within the set of playback operations, then process606reverts to process602.

If, at606, control circuitry404determines that “No,” the command is not contained within the set of playback operations, then process606continues to process608. At608, control circuitry404determines whether second user106executes a desired outcome of the command. Control circuitry404determines whether second user106executes a command using similar methods as described above. For example, control circuitry404may use wireless user communications device506to detect an action that second user106executes (e.g., tracking the user's phone to determine whether the user leaves the viewing environment).

At610, in response to determining that the second user does not execute the desired outcome of the command, control circuitry404determines whether to modify playback of the media asset. For example, control circuitry404may retrieve a rank of each of the users stored in storage408or retrieved via communications network514. Control circuitry404may determine whether first user102ranks higher than second user106, and in response to determining that first user102ranks higher than second user106, control circuitry404may modify playback of the media asset. For example, the media guidance application may mute volume of playback of the media asset116through speakers414. As another example, the media guidance application may turn off display412.

FIG. 7depicts an illustrative flowchart of a process for translating a non-playback command into a pertinent playback modification to encourage a recipient of the command to execute on the command, in accordance with some embodiments of the disclosure. Process700begins at702, where control circuitry404detects a command from first user104to second user106. Control circuitry404detects the command from first user104to second user106by detecting audio output104from first user104using a sensor, user television equipment502, user computer equipment504, and/or wireless user communications device512. For example, control circuitry404may detect a command from a first user to a second user by detecting a verbal output from the first user using an audio sensor.

At704, control circuitry404compares the command to a set of playback operation commands for a media asset that is currently being played back by second user106. Control circuitry404retrieves a set of playback operation commands for media asset108from storage408or media guidance data source518, or via communications network514. Control circuitry404compares the command to the retrieved set of playback operations using processing circuitry406. For example, control circuitry404may retrieve a set of playback operation commands (e.g., pause, play, rewind, fast-forward, stop, etc.) from a database in storage408. Control circuitry404may compare the command to the set of retrieved playback operation commands.

At706, control circuitry404determines whether the command is contained within the set of playback operations. If, at706, control circuitry404determines that “Yes,” the command is contained within the set of playback operations, process706reverts to process702.

If, at706, control circuitry404determines that “No,” the command is not contained within the set of playback operations, process706proceeds to process708. At708, control circuitry404determines that the command is not contained within the set of playback operation commands. For example, control circuitry404may determine, using processing circuitry406, that the command (e.g., eat dinner) is not contained within the set of playback operation commands (e.g., pause, play, stop, rewind, fast-forward, etc.).

At710, control circuitry404determines, based on a user profile of first user102and a user profile of second user106, a desired outcome of the command from a plurality of outcomes of the command. Control circuitry404retrieves the user profile of first user102and the user profile of second user106from storage408or media guidance data source518, or via communications network514. Control circuitry404determines the desired outcome of the command using similar methods as described above.

At712, control circuitry404detects an action executed by second user106. Control circuitry404determines the action second user106executes using similar methods as described above. For example, control circuitry404may use wireless user communications device506(e.g., a camera) to detect an action that the second user executes (e.g., tracking the user's movements to determine whether the user leaves the viewing environment). At714, control circuitry404compares the action of second user106to the desired outcome of the command. Control circuitry404compares the action of the second user to the desired outcome of the command using similar methods as described above. For example, control circuitry404may compare the action (e.g., the user not moving from the couch) to the desired outcome (e.g., the user going to eat dinner).

At716, in response to determining that the action of second user106does not correspond to the desired outcome of the command, control circuitry404retrieves characteristics of second user106from the user profile of second user106. Control circuitry404retrieves characteristics of the second user from a database in storage408corresponding to the user profile or via communications network514. For example, control circuitry404retrieves characteristics of the second user (e.g., the second user is 10 years old) from a database in storage408corresponding to the second user's profile. At718, control circuitry404determines whether to modify playback of the media asset based on the command detected from first user102and the retrieved characteristics of second user106. Control circuitry404may determine whether to modify playback of the media asset based on the command and the retrieved characteristics using similar methods as described above. For example, control circuitry404may determine whether to modify playback of the media asset based on the ranking between the two users, as retrieved from a database corresponding to the user profiles in storage408.

FIG. 8depicts an illustrative flowchart of a process for determining a command based on a characteristic of second user106, in accordance with some embodiments of the disclosure. Process800begins at802, where control circuitry404compares a characteristic from the retrieved characteristics of the second user to the command, where the characteristic is selected from a group of characteristics consisting of age, rank, relationship to other users, and time of day, and where the command is selected from a group of commands consisting of, eating, cleaning, studying, cooking, and sleeping. Control circuitry404retrieves the characteristics from a database in storage408. Control circuitry404compares the characteristic to the command using similar methods as described above. For example, control circuitry404may compare a characteristic (e.g., age) from the retrieved characteristics to the command (e.g., eating).

At804, control circuitry404determines, from the comparison, whether the command shares a characteristic of second user106. Control circuitry404retrieves characteristics of the command from a database in storage408to use in the comparison. For example, control circuitry404may determine, using processing circuitry406, that the command (e.g., eating) shares a characteristic (e.g., the time of day corresponds to dinner time) of second user106. At806, in response to determining that the command shares the characteristic, control circuitry404modifies playback of the media asset. For example, control circuitry404may pause playback of the media asset on user television equipment502. As another example, the control circuitry404may mute the sound of the playback of the media asset (e.g., volume116) through speakers414. As yet another example, control circuitry404may power off display412that was displaying playback of the media asset.

FIG. 9depicts an illustrative flowchart of a process for translating a non-playback command into a pertinent playback modification to encourage a recipient of the command to execute on the command, in accordance with some embodiments of the disclosure. Process900begins at902, where control circuitry404detects a command from first user102to second user106and a third user. For example, control circuitry404may detect a command from a first user to the second user and a third user by detecting a verbal output from the first user using an audio sensor.

At904, control circuitry404determines, based on a user profile of first user102, the user profile of second user106and a user profile of the third user, a desired outcome of the command from a plurality of outcomes of the command. For example, control circuitry404may determine a desired outcome of the command based on retrieving attributes of the command from a database in storage408or media guidance data source518, or via communications network514.

At906, control circuitry404detects a first action executed by the second user and a second action executed by the third user. Control circuitry404determines the action that the second user executes and the action that the third user executes using similar methods as described above. For example, control circuitry404may use wireless user communications device506(e.g., a camera) to detect the actions that the second user and third user execute (e.g., tracking the user's movements to determine whether the user leaves the viewing environment).

At908, control circuitry404compares the action of second user106and the action of the third user to the desired outcome of the command. For example, control circuitry404may compare the action of second user106(e.g., still watching the media asset) and the action of the third user (e.g., still watching the media asset) to the desired outcome of the command (e.g., walking to the dinner table).

At910, in response to determining that the action of the second user and the action of the third user do not correspond to the desired outcome of the command, control circuitry404retrieves characteristics of second user106from the user profile of second user106and characteristics of the third user from a user profile of the third user. For example, control circuitry404may retrieve characteristics of the second user from a database in storage408corresponding to the second user's profile, and may retrieve characteristics of the third user from a profile of the third user stored on a remote server via communications network514.

At912, control circuitry404determines whether to modify playback of the media asset based on the command detected from first user102and the retrieved characteristics of second user106and the retrieved characteristics of the third user. For example, control circuitry404determines whether to modify playback of the media asset based on a rank associated with each user.

FIG. 10depicts an illustrative flowchart of a process for determining a command based on verbal input104of first user102, in accordance with some embodiments of the disclosure. Process1000begins at1002, where control circuitry404detects a verbal input104from first user102. For example, control circuitry404may use an audio sensor to detect verbal input104from first user102. In some instances, the audio sensor may be contained within user television equipment502, user computer equipment504, and/or wireless user communications device506.

At1004, control circuitry404compares verbal input104to a database of verbal commands, where the database contains commands corresponding to each verbal command. Control circuitry404retrieves the database of verbal commands from storage408or over communications network514. For example, control circuitry404compares the verbal input (e.g., “Dinner's ready!”) to the database of verbal commands received from storage408. At1006, control circuitry404determines, from a profile of the user, a command corresponding to the verbal input from first user102. Control circuitry404determines the command corresponding to the verbal input using similar methods as described above. For example, control circuitry404may use processing circuitry406to compare the verbal input to the database of verbal commands based on keyword matching.

FIG. 11depicts an illustrative flowchart of a process for determining an outcome based on attributes of the command, in accordance with some embodiments of the disclosure. Process1100begins at1102, where control circuitry404determines attributes of the command. For example, control circuitry404may determine attributes of the command based on analyzing the audio associated with the command, as described above. At1104, control circuitry404compares the attributes of the command to attributes of the plurality of outcomes of the command. For example, control circuitry404may compare the attributes of the command to attributes of the plurality of outcomes of the command, which may be retrieved from storage408.

At1106, control circuitry404determines, from the comparison, an outcome in the plurality of outcomes that contains attributes of the command to be the desired outcome. For example, control circuitry404may determine an outcome in the plurality of outcomes with the highest rank to be the desired outcome.

FIG. 12depicts an illustrative flowchart of a process for detecting whether second user106leaves the viewing area of the media equipment device that is presenting the media asset, in accordance with some embodiments of the disclosure. Process1200begins at1202, where control circuitry404detects the second user executing a command to modify playback of the media asset. For example, control circuitry404may receive a user input command (e.g., a “pause” command) from user input interface410that modifies playback (e.g., pauses the media asset) of the media asset.

At1204, control circuitry404determines whether the user leaves a viewing environment of the media equipment device that is presenting the media asset. If, at1204, control circuitry404determines that “Yes,” second user106leaves a viewing environment of the media equipment device that is presenting the media asset, process1204proceeds to process1206. At1206, control circuitry404detects, using a sensor, the second user leaving a viewing environment of a media equipment device that is presenting the media asset. For example, control circuitry404may use wireless user communications device506(e.g., a camera) to track the second user's movements to detect when the second user leaves the viewing environment of the media equipment device that is presenting the media asset.

If, at1204, control circuitry404determines that “No,” the user does not leave a viewing environment of the media equipment device that is presenting the media asset, process1204proceeds to1208. At1208, control circuitry404detects, using a sensor, that the second user stays in the viewing environment of a media asset device. For example, control circuitry404may use wireless user communications device506(e.g., the second user's cell phone) to track the second user's movements, through GPS, to detect that the second has not left the viewing environment of the media equipment device that is presenting the media asset.

FIG. 13depicts an illustrative flowchart of a process for modifying playback of the media asset based on the rank of the users, in accordance with some embodiments of the disclosure. Process1300begins at1302, where control circuitry404retrieves a rank of the first user and a rank of the second user. Control circuitry404retrieves the rank of the first user and the rank of the second user from a database corresponding to the profiles for the users in storage408. In some instances, control circuitry404retrieves the ranks from communications network514. For example, control circuitry404may retrieve the rank of the first user (e.g., rank of 1 out of 4) and the rank of the second user (e.g., rank of 3 out of 4).

At1304, control circuitry404determines whether the rank of first user102is higher than the rank of second user106. Control circuitry404uses processing circuitry406to compare the rank of the first user to the rank of the second user. If, at1304, control circuitry404determines that “Yes,” the rank of the first user is higher than the rank of the second user, then process1304proceeds to process1306. At1306, control circuitry404modifies playback of the media asset. For example, control circuitry404may pause playback of the media asset on user television equipment502. As another example, the control circuitry404may mute the sound of the playback of the media asset through speakers414. As yet another example, control circuitry404may power off display412that was displaying playback of the media asset.

If, at1304, control circuitry404determines that “No,” the rank of the first user is not higher than the rank of the second user, then process1304proceeds to process1308. At1308, control circuitry404continues to play back the media asset.

Systems and methods are also provided herein for determining whether a user is authorized to perform an action that meets a goal of a sound. A media guidance application may detect a sound generated by a first device external to a media equipment device. The media guidance application may retrieve, from a lookup table, a known goal that is associated with the sound. The media guidance application may detect a user in a viewing environment. The media guidance application may determine an identity of the user. And the media guidance application may modify playback to encourage or discourage the user from achieving the known goal based on the identity of the user.

FIG. 14. shows an illustrative embodiment of determining whether a user is authorized to perform an action that meets a goal of a sound, in accordance with some embodiments of the disclosure.FIG. 14depicts illustrative display1400, which may be presented by control circuitry that executes a media guidance application on any user equipment. The functionality of user equipment, control circuitry, and the media guidance application is described in further detail with respects toFIGS. 2-5.

The media guidance application may output sound1406from first device1402, in response to detecting action1404. For example, the media guidance application may output sound1406(e.g., a doorbell ringing, smoke alarm, ringtone, etc.), from first device1402(e.g., a doorbell, smoke alarm, cell phone, etc.), in response to detecting action1404(e.g., a user pressing the doorbell, a smoke alarm detecting smoke, a cell phone ringing). The media guidance application may determine that first user1408and second user1410are watching playback of media asset1412, which may include playback audio1414. The media guidance application may determine that first user1408and second user1410are watching media asset1412in first physical environment1416. The media guidance application may detect that sound1406originates in second physical environment1418, which may be a separate environment from first environment1416.

In some embodiments, a media guidance application may detect a sound generated by a first device external to a media equipment device. For example, the media guidance application may detect, using a sensor, a sound (e.g., a doorbell ringing) by a first device (e.g., a doorbell) external to a media equipment device (e.g., a television). The media guidance application may detect a sound generated by the first device using similar methods as detecting a verbal input, as described above.

For example, the media guidance application may detect a sound generated by a first device external to a media equipment device using an intelligent personal assistant (IPA) (e.g., an Amazon Echo, Google Home, Siri, etc.), where the IPA constantly listens for audio inputs in first physical environment1416and second physical environment1418.

In some embodiments, the media guidance application may determine that a network of connected IPAs exist, where each connected IPA exists in its own environment and communicates with other IPAs over a wireless network. For example, the media guidance application may determine that a network of connected IPAs exists (e.g., an Amazon Echo in the living room, a Ring doorbell camera at the front door, etc.) and communicate with one another over a wireless network. In some instances, the network IPAs may be configured in a slave/master setup.

The media guidance application may use a goal associated with the sound (e.g., for a doorbell ringing, the associated goal may be for a user to answer the door) and a potential user action (e.g., pausing playback of media asset1412to get up and open the door) to help determine whether the user is authorized to perform the action that meets the goal of the sound. As referred to herein, a “goal associated with the sound” is defined to be a preferred action taken by the user as a result of being informed of the sound. For example, the media guidance application may determine that a goal associated with a doorbell ringing may be for the user to answer the door. As another example, the media guidance application may determine that a goal associated with a smoke alarm beeping may be for the user to exit the house and/or environment containing the smoke alarm. As yet another example, the media guidance application may determine that another goal associated with a smoke alarm beeping may be for the user to change the batteries in the smoke alarm.

The media guidance application may store a database that associates a goal in a plurality of goals with a set of actions in a plurality of actions and a sound in a plurality of sounds. The media guidance application may store the database in a user profile. The values stored in the database (e.g., goals, actions, sounds) may be preset by an editor, and may be edited by user input.

For example, the media guidance application may store a database that associates a goal (e.g., answer the door) in a plurality of goals (e.g., answer the door, do not answer the door, etc.) with a set of actions (e.g., continue watching playback of a media asset and ignore the doorbell) in a plurality of actions (e.g., pause playback of a media asset to answer the door, continue watching playback of a media asset and ignore the doorbell, etc.) and a sound (e.g., a doorbell ringing) in a plurality of sounds (e.g., doorbell ringing, phone ringing, smoke detector beeping, etc.).

The media guidance application may compare attributes of the sound generated by first device1402with entries of the database to determine a goal associated with the sound and a corresponding set of actions associated with the goal. For example, the media guidance application may compare sound1406generated by first device1402(e.g., a doorbell ringing) with entries of the database to determine a goal associated with sound1406(e.g., answer the door) and a corresponding set of actions associated with the goal (e.g., pause playback of the media asset, leave viewing environment1516to answer the door, etc.).

In some embodiments, when comparing sound1406generated by first device1402with the database to determine a goal associated with the sound and a corresponding set of actions associated with the goal, the media guidance application may determine a match between sound1406and an entry in the database based on characteristics of sound1406. For example, the media guidance application may use characteristics of sound1406(e.g., tone, loudness, frequency, etc.) to match the sound with its corresponding entry in the database.

For example, the media guidance application may determine the characteristics (e.g., attributes) of sound1406using sound processing techniques, as described in more detail above. The media guidance application may determine whether there is a match between a sound and an entry by determining if the sound and an entry in a plurality of entries has a threshold amount of characteristics in common. The media guidance application may retrieve the threshold amount from the profile, and the threshold amount may be preset by an editor that may be updated based on user input. For example, the media guidance application may determine that sound1406(e.g., doorbell ringing) has a threshold amount of characteristics (e.g., may be three or more characteristics) in common with the entry (e.g., doorbell sound) in a plurality of entries (e.g., doorbell sound, fire alarm sound, phone ringing, etc.).

In some embodiments, when comparing the sound generated by the first device with the database to determine a goal associated with sound1406and a corresponding set of actions associated with the goal, the media guidance application may determine a match between sound1406and an entry in the database based on a fingerprint of sound1406. As referred to herein, a “fingerprint” of the sound is a condensed digital summary, deterministically generated from an audio signal, that can be used to identify an audio sample. The media guidance application may compare the fingerprint of the sound with fingerprints of audio associated with each entry in the database. The media guidance application may determine a match between the fingerprints when the fingerprints are the same within a tolerance range, where the tolerance range is stored in the profile and preset by an editor.

The media guidance application may retrieve, from the entry, the goal associated with the sound. For example, the media guidance application may retrieve, from the entry, the goal (e.g., answer the door) associated with the sound (e.g., a doorbell ringing).

The media guidance application may retrieve, from the entry, the corresponding set of actions associated with the goal. For example, the media guidance application may retrieve, from the entry, the corresponding set of actions (e.g., watch playback of the media asset, turn up the volume of playback of the media asset, etc.) associated with the goal (e.g., answer the door).

The media guidance application may detect a user in viewing environment1416of the media equipment device. For example, the media guidance application may use a sensor (e.g., a camera) to detect the user in first viewing environment1416of the media equipment device (e.g., a television).

In some embodiments, when detecting the user in first viewing environment1416of the media device, the media guidance application may detect, using a sensor, a presence of first user1408in first viewing environment1416. For example, the media guidance application may use an infrared sensor to determine a thermal map of first viewing environment1416, and detect that first user1408is in first viewing environment1416of the media equipment device (e.g., a television) based on detecting the user's heat signature in the thermal map.

In some embodiments, when detecting first user1408in first viewing environment1416of the media device, the media guidance application may detect, using a camera, a presence of the user in the viewing environment. For example, the media guidance application may use a camera to detect the user in the viewing environment of the media equipment device (e.g., a television). Systems and methods for detecting a user in a viewing environment of the media equipment device are described in greater detail in Panchaksharaiah et al. U.S. application Ser. No. 15/200,194, filed Jul. 1, 2016, Panchaksharaiah et al. U.S. application Ser. No. 15/200,216, filed Jul. 1, 2016, and Blake et al. U.S. application Ser. No. 15/200,638, filed Jul. 1, 2016, which are hereby incorporated by reference herein in their entireties.

In some embodiments, when detecting first user1408in first viewing environment1416of the media device, the media guidance application may detect, using Global Positioning System (GPS), a presence of first user1408in first viewing environment1416. For example, the media guidance application may detect, via GPS associated with a user device associated with the user (e.g., the user's cell phone, wearable technology (e.g., an Apple Watch), etc.) the user's location. The media guidance application may determine from the user's location (e.g., GPS coordinates) whether the user is in the viewing environment of the media device, based on the known location of the viewing environment.

The media guidance application may determine, from a user profile of first user1408, whether the user is authorized to perform an action in the determined set of actions associated with the goal. For example, the media guidance application may retrieve, from an authorization database in the user's profile, whether the user is authorized to perform an action (e.g., leave the viewing environment) associated with the goal (e.g., answer the door). The media guidance application may store the user's authorization status (e.g., either the user is or is not authorized to perform an action) in the authorization database in the user profile, where the authorization status is determined using the methods described below.

In some embodiments, when determining, from a user profile of the user, whether the user is authorized to perform an action in the determined set of actions associated with the goal, the media guidance application may retrieve, from the user profile, a rank for the user. For example, the media guidance application may retrieve a rank for the user (e.g., 8 out of 10).

In some embodiments, the media guidance application may determine that that user's rank is dynamic and may be updated frequently in the user profile. The media guidance application may determine that the user's rank is determined based on multiple factors, including the presence of other users in the viewing environment/house, the age of the user, etc. The media guidance application may determine that a value is assigned dynamically to each factor (e.g., the values may be assigned by comparing the factor to a lookup table of values, where the lookup table values were determined by an editor and may be updated based on user input). For example, the media guidance application may determine that the user's rank is higher when more users are present in the viewing environment and as the user's age increases.

The media guidance application may calculate the user's rank from the multiple factors by retrieving a weight assigned to each factor (e.g., between 0% to 100%). The media guidance application may determine that the weight assigned to each factor is predetermined and assigned by an editor, and it may be updated based on user input. The media guidance application may then calculate, using the weight for each factor and the value for each factor (e.g., by summing for the several factors the products of the weight and value for each factor), a rank (e.g., between 0 and 100) for the user. For example, the media guidance application may calculate, using the weight of each factor (e.g., the user's age weight=50%, the presence of other users in the viewing environment weight=50%) and the value for each factor (e.g., the user's age value=15, the presence of other users in the viewing environment=50) a rank (e.g., 0.5*15+0.5*50=32.5 out of 100) for the user.

The media guidance application may retrieve, from a database, a rank for an action. The media guidance application may determine that the rank for the action is preset by an editor, and may be updated from a user input. For example, the media guidance application may retrieve, from a database, a rank (e.g., 50 out of 100) for an action (e.g., leave the viewing environment).

In some embodiments, the media guidance application may dynamically determine the rank of an action. The media guidance application may use factors such as the users present in the viewing environment/house, the user's age, the risk, etc. to determine the rank. For example, the media guidance application may use sensors to determine whether any other users are present in the viewing environment or house after detecting the sound. In response to determining that no other users are present, the media guidance application may rank the action higher, as it may indicate a situation where the user should not complete the action (e.g., the user is a child home alone, and thus should not answer the door to a stranger). The media guidance application may determine the rank of the action based on factors using similar methods as when determining the rank of the user based on factors, as described above.

As another example, the media guidance application may rank the action according to the risk the action presents. The media guidance application may determine the risk by analyzing the potential outcome of the action. For example, the media guidance application may, using a camera, determine the identity of the person using the user device (e.g., doorbell) to generate the sound. If the media guidance application determines that the person is a stranger (e.g., by using the images generated by the camera to compare the face of the person with faces associated with known users from the user profiles, and determining there is not a match between the person's face and a known user's face), the media guidance application may highly rank the action because it has a higher risk. If the media guidance application determines that the person is not a stranger (e.g., by using the camera to identify the user based on comparing the user to a plurality of users who have user profiles), the media guidance application may rank the action lower because it is a lower risk.

The media guidance application may determine whether the rank for the user exceeds the rank for the action. For example, the media guidance application may determine that the rank for the user (e.g., 8 out of 10) exceeds the rank for the action (e.g., 5 out of 10).

In response to determining that the rank for the user exceeds the rank for the action, the media guidance application may determine that the user is authorized to perform the action. For example, the media guidance application may determine that the user is authorized to perform the action (e.g., leave the viewing environment).

In response to determining that the user is authorized to perform the action, the media guidance application may generate a notification for the user indicating the detected sound. For example, the media guidance application may generate a sound notification for the user (e.g., a doorbell sound) to play over playback of the media asset indicating the detected sound. The media guidance application may play over playback a sound notification that is a clip of the detected sound (e.g., the doorbell ringing, fire alarm, phone call) to alert the user audibly of the source of the detected sound.

In some embodiments, the media guidance application may play back the sound notification for a set amount of time (e.g., 5 seconds) that corresponds to a preset amount of time as determined by an editor, or input by the user. For example, the media guidance application may play over playback of the media asset the doorbell ringing sound for a set amount of time (e.g., 3 seconds) as determined by an editor.

In some embodiments, the media guidance application may play back the sound notification over playback of the media asset until the media guidance application detects an action from the user (e.g., the user pauses playback, the user leaves the viewing environment, etc.). For example, the media guidance application may play back the sound notification (e.g., doorbell ringing) over playback of the media asset until the media guidance application detects action from the user (e.g., the media guidance application detects, via a camera, the user leaving the viewing environment to answer the door).

In some embodiments, when generating a notification for the user indicating the detected sound, the media guidance application may generate an overlay to be displayed on the media equipment device, where the overlay contains a notification for the user about the sound. For example, the media guidance application may generate for display an overlay (e.g., an overlay stating, “The doorbell is ringing!”) to be displayed on the media equipment device.

The media guidance application may modify playback of a media asset to allow the user to perform the action associated with the goal. For example, the media guidance application may modify playback of the media asset (e.g., pause a movie the user is watching) to allow the user to perform the action (e.g., leave the viewing environment) associated with the goal (e.g., answer the door).

In some embodiments, the media guidance application may determine to modify playback of the media asset after determining that the user has not performed the action associated with the goal after a threshold amount of time. The media guidance application may retrieve the threshold amount of time from a database in the profile, where the threshold amount of time is preset by an editor for each specific goal. The media guidance application may edit the threshold amount of time for each specific goal based on user input. For example, the media guidance application may determine to modify playback of the media asset after determining that the user has not performed the action (e.g., leaving the viewing environment to answer the door) associated with the goal after a threshold amount of time (e.g., 30 seconds), retrieved from a database in the profile.

In some embodiments, when modifying playback of a media asset to allow the user to perform the action associated with the goal, the media guidance application may retrieve, from the database, a set of playback modifications associated with the goal. For example, the media guidance application may retrieve, from the database, a set of playback modifications (e.g., pause, play, fast-forward, rewind, mute, turn on/off, etc.) associated with the goal.

The media guidance application may select a playback modification from the set of playback modifications based on preferences for the user. The media guidance application may retrieve preferences for the user from the user profile. The preferences for the user may be preset based on user input, or may be determined based on user behavior, or a combination of both. For example, the media guidance application may track the user's command history to determine the user's favorite playback command in response to the user hearing the sound (e.g., a doorbell ringing). The media guidance application may determine the commands performed after the user hears the sound based on comparing the timestamps of the commands with the timestamps of the detected sound. For example, the media guidance application may select a playback modification (e.g., pause) from the set of playback modifications based on preferences for the user (e.g., the user always pauses content before getting up to answer the door).

The media guidance application may modify playback of the media asset based on the selected playback modification. For example, the media guidance application may modify playback of the media asset based on the selected playback modification (e.g., pause playback of the media asset). As another example, the media guidance application may modify playback of the media asset based on the selected playback modification by muting playback of the media asset, stopping playback of the media asset, turning off playback of the media asset, or any other similar playback modification.

In response to determining that the user is not authorized to perform the action, the media guidance application may generate a notification for a second user to perform the action. For example, the media guidance application may generate a notification (e.g., send an SMS message to second user1410, send an audio alert to second user1410's personal device, or generate an overlay with instructions for second user1410to be displayed over the media asset) to perform the action (e.g., answer the door).

In some embodiments, the media guidance application may determine whether the user can hear the sound and therefore be tempted to perform the action in response to the sound.

In some embodiments, the media guidance application may determine that the sound is within an audible range of the viewing environment. For example, the media guidance application may detect the sound using a sensor (e.g., a microphone) contained within the viewing environment. The media guidance application may compare the detected sound's loudness with the minimum loudness value (retrieved from the profile) the sound can have and still be in the audible range.

In response to determining that the user is not authorized to perform the action, the media guidance application may prevent the user from modifying playback of the media asset. For example, the media guidance application may prevent the user from modifying playback of the media guidance application (e.g., not allowing the user to pause playback of the media asset).

The media guidance application may modify playback of the media asset to prevent the user from performing the action associated with the goal. For example, the media guidance application may increase the volume of playback of the media asset to drown out the sound from the user's audible range.

In some embodiments, when modifying playback of the media asset, the media guidance application may determine a volume that dampens the sound that is within the audible range. For example, the media guidance application may determine a volume that is equivalent to or higher than the determined volume of the sound within the audible range.

The media guidance application may adjust a volume corresponding to playback of the media asset to be the volume that dampens the sound. For example, the media guidance application may adjust the playback volume of the media asset to be a volume that is higher than the detected volume of the sound in the audible range.

FIG. 15depicts an illustrative flowchart of a process for determining whether a user is authorized to perform an action that meets a goal of a sound, in accordance with some embodiments of the disclosure. Process1500begins at1502, where control circuitry404detects sound106generated by first device102external to a media equipment device. For example, control circuitry404may detect sound106(e.g., a doorbell ringing) generated by first device102(e.g., a doorbell), or speakers414, external to a media equipment device (e.g., a television).

At1504, control circuitry404retrieves, from a lookup table, a known goal that is associated with the sound. Control circuitry404may retrieve the known goal from a lookup table stored in storage408or media guidance data source518. Control circuitry404may also retrieve the known goal from a lookup table from communications network514. For example, control circuitry404may retrieve a known goal (e.g., answer the door) that is associated with sound1406(e.g., a doorbell ringing). At1506, control circuitry404detects a user in a viewing environment. For example, control circuitry404may detect a user in a viewing environment using a sensor. At1508, control circuitry404determines an identity of first user1408. Control circuitry404may determine the identity of the user using the methods described above. At1510, control circuitry404modifies playback to encourage or discourage first user1408from achieving the known goal based on the identity of first user1408. For example, control circuitry404may modify playback (e.g., pause playback) to encourage first user1408to achieve the known goal (e.g., answer the door) based on the identity of first user1408(e.g., the homeowner).

FIG. 16depicts an illustrative flowchart of a process for determining whether a user is authorized to perform an action that meets a goal of sound1406, in accordance with some embodiments of the disclosure. At1602, control circuitry404detects sound1406generated by a first device external to a media equipment device. For example, control circuitry404may detect sound1406(e.g., a doorbell ringing) generated by first device1402(e.g., doorbell) external to a media equipment device.

At1604, control circuitry404stores a database that associates each goal in a plurality of goals with a set of actions in a plurality of actions and a sound in a plurality of sounds. Control circuitry404stores the database in storage408or media guidance data source518, or retrieves the database via communications network514.

At1606, control circuitry404compares sound1406generated by the first device with the database to determine a goal associated with sound1406and a corresponding set of actions associated with the goal. At1608, control circuitry detects a user in a viewing environment of the media equipment device. For example, control circuitry404may use an infrared sensor to detect a user in a viewing environment of the media equipment device. At1610, control circuitry404determines, from a user profile of user1408, whether user1408is authorized to perform an action in the determined set of actions associated with the goal. Control circuitry404determines whether the user is authorized to perform an action using similar methods as described above.

At1612, control circuitry404determines whether user1408is authorized to perform an action in the determined set of actions associated with the goal. If, at1612, control circuitry404determines that “Yes,” user1408is authorized to perform an action in the determined set of actions associated with the goal, then process1612proceeds to process1614. At1614, control404generates a notification for the user indicating detected sound1406. For example, control circuitry may generate an overlay on display412for the user indicating the detected sound. At1616, control circuitry404modifies playback of a media asset to allow user1408to perform the action associated with the goal. For example, control circuitry404may mute playback of media asset1412to allow the user to perform the action (e.g., leave the viewing environment) associated with the goal (e.g., answer the door).

If, at1612, control circuitry404determines that “No,” user1408is not authorized to perform an action in the determined set of actions associated with the goal, then process1612proceeds to process1618. At1618, control circuitry404generates a notification for second user1410to perform the action. For example, control circuitry404may generate an SMS message to wireless communication device506for a second user (e.g., an adult in the household) to perform the action (e.g., answer the door). At1620, control circuitry404determines that the sound is within an audible range of the viewing environment. For example, control circuitry404may use a microphone to detect whether the sound is within an audible range of the viewing environment, as described above. At1622, control circuitry404may prevent user1408from modifying playback of the media asset. For example, control circuitry404may not be responsive to user1408commands entered by the user via user input interface410.

At1624, control circuitry404modifies playback of the media asset to prevent user1408from performing the action associated with the goal. At1626, control circuitry404determines a volume that dampens sound1406that is within the audible range. Control circuitry404determines the volume that dampens the sound using similar methods as described above.

At1628, control circuitry404adjusts a volume corresponding to playback of the media asset (e.g., audio playback1414) to be the volume that dampens user1408.

FIG. 17depicts an illustrative flowchart of a process for determining the goal associated with sound1406, in accordance with some embodiments of the disclosure. Process1700begins at1702, where control circuitry404determines a match between sound1406and an entry in the database based on characteristics of the sound. For example, control circuitry404may determine a match between sound1406(e.g., a doorbell ringing) and an entry in the database based on characteristics of the sound (e.g., tone, loudness, etc.). At1704, control circuitry404retrieves, from the entry, the goal associated with sound1406. For example, control circuitry404may retrieve, from the entry, the goal (e.g., answer the door) associated with the sound (e.g., doorbell ringing). At1706, control circuitry404retrieves, from the entry, the corresponding set of actions associated with the goal. For example, control circuitry404may retrieve, from the entry, the corresponding set of actions (e.g., pause playback, answer the door, etc.) associated with the goal (e.g., answer the door).

FIG. 18depicts an illustrative flowchart of a process for detecting the presence of the user in the viewing environment, in accordance with some embodiments of the disclosure. Process1800begins at1802, where control circuitry404detects, using a sensor, a presence of user1408in the viewing environment. Control circuitry404may connect to a sensor via communications network514. For example, control circuitry404may detect, using an infrared sensor, the presence of the user in the viewing environment.

FIG. 19depicts an illustrative flowchart of a process for generating an overlay containing a notification, in accordance with some embodiments of the disclosure. Process1900begins at1902, where control circuitry404generates an overlay to be displayed on the media equipment device, where the overlay contains a notification for user1408about sound1406. Control circuitry404may generate an overlay to be displayed on display412. For example, control circuitry404may generate an overlay to be displayed on the media equipment device (e.g., a television), where the overlay contains a notification for the user about the sound (e.g., an overlay with text that reads “The doorbell is ringing.”).

FIG. 20depicts an illustrative flowchart of a process for modifying playback of the media asset, in accordance with some embodiments of the disclosure. Process2000begins at2002, where control circuitry404retrieves, from the database, a set of playback modifications associated with the goal. Control circuitry404may retrieve the set of playback modifications from the database stored in storage408or media guidance data source518, or via communications network514. For example, control circuitry404may retrieve, from the database, a set of playback modifications (e.g., pause playback, mute playback, etc.) associated with the goal (e.g., answer the door).

At2004, control circuitry404selects a playback modification from the set of playback modifications based on preferences for user1408. For example, control circuitry404may select a playback modification (e.g., pause playback) based on preferences for user1408(e.g., the user prefers not to miss content when answering the door). At2006, control circuitry404modifies playback of the media asset based on the selected playback modification. For example, control circuitry404may pause playback of the media asset based on the selected playback modification (e.g., to pause playback).

FIG. 21depicts an illustrative flowchart of a process for determining whether user1408is authorized to perform the action, in accordance with some embodiments of the disclosure. Process2100begins at2102, where control circuitry404retrieves, from the user profile, a rank for user1408. Control circuitry404retrieves the rank for user1408from the user profile stored in storage408or media guidance data source518, or via communications network514. For example, the media guidance application may retrieve the rank (e.g., 8 out of 10) for user1408from the user profile in storage408. At2104, control circuitry404retrieves, from a database, a rank for an action. For example, control circuitry404may retrieve, from a database in storage408, a rank for an action (e.g., 5 out of 10).

At2106, control circuitry404determines whether the rank of user1408exceeds the rank for the action. If, at2106, control circuitry404determines that “Yes,” the rank of the user exceeds the rank of the action, process2106proceeds to2108. At2108, control circuitry404determines that user1408is authorized to perform the action. If, at2106, control circuitry404determines that “No,” the rank of user1408does not exceed the rank of the action, process2106proceeds to2110. At2110, control circuitry404determines that user1408is not authorized to perform the action.

It should be noted that processes600-1300and1400-2100or any step thereof could be performed on, or provided by, any of the devices shown inFIGS. 1 and 4-5. For example, any of processes600-1300and1400-2100may be executed by control circuitry404(FIG. 4) as instructed by control circuitry implemented on user equipment502,504,506(FIG. 5), and/or a user equipment device for selecting a recommendation. In addition, one or more steps of processes600-1300and1400-2100may be incorporated into or combined with one or more steps of any other process or embodiment.

It will be apparent to those of ordinary skill in the art that methods involved in the present invention may be embodied in a computer program product that includes a computer-usable and/or readable medium. For example, such a computer-usable medium may consist of a read-only memory device, such as a CD-ROM disk or conventional ROM device, or a random access memory, such as a hard drive device or a computer diskette, having a computer-readable program code stored thereon. It should also be understood that methods, techniques, and processes involved in the present disclosure may be executed using processing circuitry. For instance, determining a position of a user may be performed, e.g., by processing circuitry406ofFIG. 4. The processing circuitry, for instance, may be a general purpose processor, a customized integrated circuit (e.g., an ASIC), or a field-programmable gate array (FPGA) within user equipment400, media content source516, or media guidance data source518. For example, a profile, as described herein, may be stored in, and retrieved from, storage408ofFIG. 4, or media guidance data source518ofFIG. 5. Furthermore, processing circuitry, or a computer program, may update settings of user equipment100stored within storage408ofFIG. 4or media guidance data source518ofFIG. 5.

While some portions of this disclosure may make reference to “related art” or “convention,” any such reference is merely for the purpose of providing context to the invention(s) of the instant disclosure, and does not form any admission as to what constitutes the state of the art.