Measuring sleep state of a user using wearables and deciding on the playback option for the content consumed

Systems and methods are provided for responding to a sleep-state event. One example method includes receiving and generating, at a computing device, media content for output and receiving a sleep-state event. A type of the content being generated for output is identified and, based on the type of content, an action to perform in response to receiving the sleep-state event is identified. The action to perform is generated.

BACKGROUND

The present disclosure is directed towards systems and methods for responding to a sleep-state event. In particular, systems and methods are provided herein that enable the generation of an action to perform, based on a type of media content being received at a computing device, in response to receiving a sleep-state event.

SUMMARY

The proliferation of over-the-top (OTT) media providers, such as Netflix, Amazon Prime Video, Hulu and Disney+, has enabled media content, such as episodic media content, to be delivered in ways that differ from traditional broadcasters. Whereas a traditional broadcaster may broadcast a new episode of a series on a weekly basis, during a regular timeslot, an OTT media provider may make all the episodes of a series available to stream at the same time. This, in turn, has led to a change in how viewers consume media content. For example, a viewer who has access to the series “Line of Duty” on an OTT platform may consume multiple episodes of the series one after the other. An OTT platform may aid a user with this viewing habit by the automatically streaming the next episode in a series, without input from a viewer. However, some viewers may tend to nap and/or fall asleep if they start watching an episode of a series later in the evening. For example, a viewer may watch two episodes of the series “Line of Duty” but fall asleep during the third episode. An OTT platform may continue to stream the episode and automatically stream one or more subsequent episodes, even though the viewer is no longer viewing the media content since they have fallen asleep. Some OTT platforms may automatically stop streaming media content after no input has been detected from a viewer for an extended period of time, for example, if three episodes are streamed without any input from a user. An OTT platform may associate a “resume” point (i.e., the point at which the OTT platform starts streaming the media content when a user returns to watch the series at a later time) based on the point at which the media content was automatically stopped. However, the “resume” point may not be of use to the user as they may have missed a substantial part of the series due to it being streamed while they were asleep, and it may be time-consuming for a viewer to establish the point at which they should resume the series in order to view the part of the media content that was streaming when they were asleep. A viewer streaming a film may suffer from a similar issue if they fall asleep halfway through the film and the OTT platform streams the rest of the film while they are sleeping.

In view of the foregoing, it would be beneficial to have system that is capable of responding to a sleep-state event. More specifically, systems and methods are provided herein that enable the generation of an action to perform, based on a type of media content being received at a computing device, in response to receiving a sleep-state event.

Systems and methods are described herein for responding to a sleep-state event. In accordance with a first aspect of the disclosure, a method is provided for responding to a sleep-state event. The method includes receiving media content and generating the media content for output at a computing device. A sleep-state event is received. A type of the content being generated for output is identified. An action to perform in response to receiving the sleep-state event is identified based on the type of media content, and the action to perform is generated. The type of content may be, for example, content that a user has indicated is favorite content. The user may indicate this by selecting, for example, a star icon associated with the content via, for example, a remote control of a smart television. In an example system, a viewer may open an application associated with an OTT platform on their smart television. The viewer may select an episode of Line of Duty to stream. The selected episode of Line of Duty may be streamed to the smart television via the internet from, for example, a server. The smart television may generate the received episode of Line of Duty for display. As the user is watching the selected episode of Line of Duty, they may fall asleep, which may cause a smartwatch that they are wearing to generate a sleep-state event. This sleep-state event may be transmitted from the smartwatch to the smart television via, for example, a home Wi-Fi network. On receiving the sleep-state event, an application running on the smart television may identify the type of content being consumed and identify an action to perform. An application running on the smart television may generate the identified action to perform.

A bookmark may be generated in response to receiving the sleep-state event. For example, an OTT system may generate a bookmark indicating a current episode and a time stamp indicating a progress through a current episode on receiving a sleep-state event. A user profile may be identified, and a viewing history associated with the identified user profile may be updated to indicate a resume point based on the generated bookmark. For example, an OTT system may store the generated bookmark with a user profile. When a user logs on with the same user profile and accesses the series for which a bookmark was stored, the user may be presented with an option to resume viewing an episode of the series, wherein the point at which the episode is resumed is based on the previously generated bookmark. In this way, if a user falls asleep while viewing an episode, they may easily resume watching the episode at a later time at the point at which they fell asleep. The media content may comprise metadata indicating a priority segment, and the action to perform may further comprise identifying whether the generated bookmark occurs at or before the priority segment, wherein the resume point is further based on a time stamp of the priority segment. For example, an episode of a series may comprise one or more events that are key to understanding future episodes, such as the death of a key character. Metadata indicating a start time and an end time of a segment corresponding to a key event may be transmitted to the computing devices with the episode. On receiving the sleep-state event, an application running on the computing device may identify whether the sleep-state event corresponds with the priority segment. If the sleep-state event is generated during the priority segment, then the resume point may, for example, be based on a start time of the priority segment. In this way, the user is able to recap an important part of the episode when they resume watching the episode at a later time.

The media content may be an episode of a series of episodes, and the action to perform may comprise disabling the automatic playing of a subsequent episode of the series of episodes. For example, if a sleep-state event is received at a computing device, then the application associated with the OTT platform may stop streaming any subsequent episodes of the series.

The sleep-state event may comprise data indicating a sleep stage of a user, and the action to perform may be based on the sleep stage of the user. For example, the sleep-state event may indicate if a user is in a sleep stage comprising light sleep or a deep sleep. In another example, the sleep-state event may indicate whether a user is in a sleep stage comprising rapid eye movement (REM) sleep or non-REM sleep. The sleep-state event may indicate what sleep stage of non-REM sleep a user is in, for example stage 1, stage 2 or stage 3. In another example, the sleep-state event may indicate whether a user is in sleep stage corresponding with N1, N2, N3 or slow-wave sleep, delta sleep and/or deep sleep. Different actions to perform may be generated based on whether a sleep-event indicates that a user is in a light sleep or a deep sleep. For example, if a user is in a light sleep, the media content may be changed to music that aids sleep. In another example, if the user is in a deep sleep, the computing device may be turned off or switched to a standby mode.

The media content may be first media content, and it may be determined whether the first media content comprises one or more advertisements. It may be determined whether a sleep period that starts with the received sleep-state event coincides with one or more of the advertisements. The action to perform may comprise transmitting data to an advertisement server indicating that the sleep period coincided with one or more of the advertisements. Second media content and one or more of the advertisements that coincided with the sleep period may be received at the computing device. The second media content and the one or more advertisements may be generated for output. For example, if ads are shown during an episode and a sleep-event indicates that a user has fallen asleep and hence misses the ads, this may be communicated to an advertising server via, for example, the internet. When a user watches media content at a subsequent time, the ads that the user did not watch because they were asleep may be displayed to the user during the subsequent watching of media content.

Receiving the sleep-event may comprise receiving a first sleep-event or receiving a second sleep-event, wherein the first sleep-event is associated with a first user and the second sleep-event is associated with a second user. Based on whether the sleep-event was received from the first user or the second user, a user profile associated with the first user or the second user may be identified. The action to perform may comprise generating a bookmark in response to receiving the sleep-state event and updating a viewing history associated with the identified user profile to indicate a resume point based on the generated bookmark. In an example, two users may be viewing an episode on a smart television. One of the users (for example, the second user) may fall asleep, and the second user's smartwatch may generate a sleep-event that is transmitted to the smart television. The sleep-event may indicate that the second user is associated with the sleep-event. On receiving the sleep-event, an application running on the smart television may access a profile associated with the second user and may store a bookmark with a user profile associated with the second user. When the profile associated with the second user is accessed at a later time and the series for which a bookmark was stored is accessed, the user may be presented with an option to resume viewing an episode of the series, wherein the point at which the episode is resumed is based on the previously generated bookmark. However, a different resume point may be stored with a user profile associated with the first user, for example if they did not fall asleep and finished the episode that both users were watching. In this way, if a first user does not fall asleep and a second user falls asleep while viewing an episode then each user may easily resume watching the episode at a later time at a point that is relevant to them.

The media content may be live media content that is received in, at least substantially, real time. The action to perform may comprise generating a bookmark in response to receiving the sleep-state event. A user profile may be identified, and a bookmark may be associated with the user profile. It may be identified that the live media content subsequently becomes available to stream in a video-on-demand format. An indication that the media content is available to stream in a video-on-demand format may be generated for output, wherein the indication may comprise a start point of the video-on-demand media content based on the bookmark. For example, a user may fall asleep and generate a sleep-event during a live soccer match, and a bookmark may be generated based on when the sleep-event is received and stored in a user profile. If the live soccer match is subsequently made available on demand, then a notification may be displayed when the user profile is next accessed. The notification may indicate that the previously live content is now available on demand, and a user may be able to select an option that enables them to access the content. In addition, the point at which the on-demand content plays may be based on a bookmark that was generated when the sleep-event was received during the previously live event. For example, if a sleep-event was generated at a halftime point of the live soccer match, then the on-demand content may resume at the halftime point.

DETAILED DESCRIPTION

Systems and methods are described herein for responding to a sleep-state event. A sleep-state event can comprise any data that is generated at a computing device that can be used to detecting whether a user has fallen asleep, is dozing and/or has entered a state of reduced consciousness or awareness. In some examples, the sleep-state event explicitly indicates that a user is dozing and/or has fallen asleep, for example by setting a flag. In other examples, the sleep-state event may comprise biometric data, for example, heart rate data, that can be processed by another computing device to infer that a user has started dozing and/or sleeping. In an example, an application running on a smartwatch may detect that a user has fallen asleep and, in response to detecting this, may send data indicating that the user has fallen asleep to a smart television. In a second example, a smart television may comprise a monitoring device, such as a camera, which is used to detect whether a user has fallen asleep. An application running on the smart television may generate a sleep-state event in response to detecting that the user has fallen asleep and may send a sleep-state event to another memory location on the smart television and/or another application running on the smart television.

Media content includes audio, video and/or any other media content. Audio includes audio-only content, such as podcasts, stories and music. Video includes audiovisual content such as movies and/or television programs. An over-the-top content platform may be accessed via a website and/or an app running on a computing device and may receive any type of media content, including live media content and/or on-demand media content. Although the embodiments below may discuss receiving media content from a server, via a network such as the internet, media content may also be received via cable, satellite and/or a terrestrial broadcasting network.

Identifying a type of content may comprise identifying whether the content has been favorited, in which case the type would be “favorited.” In another example, identifying a type of content may be identifying whether the content is audiovisual or audio-only content. It may also comprise identifying whether audio-only content is a podcast, an audiobook or music. Identifying a content type may comprise identifying whether the content type is suitable for a user to listen to while dozing and/or sleeping. In one example, identifying a content type may comprise identifying whether it comprises loud audio sections and/or sections of strobing or flashing lights. It may also comprise identifying a genre of the content, such as action, comedy, romance and/or sports.

An action to perform is a broad term that encompasses any action that a computing device may be programmed to take in response to receiving a sleep-state event. For example, it may comprise turning down the volume of a computing device, turning off the screen of a computing device and/or turning on or off a smart device that is communicably coupled to the computing device. In another example, it may comprise generating a bookmark to indicate a resume point of media content, or it may comprise turning off an automatic play function of an OTT application. In some examples, different actions may be performed based on the sleep stage of a user. For example, if it is identified that a user is dozing, gentle music may be played, or if it is identified that a user is asleep, a connected smart bulb may be turned off.

Data indicating a sleep stage may indicate that a user is in a light sleep or a deep sleep. In another example, the sleep stage may indicate whether a user is in rapid eye movement (REM) sleep or non-REM sleep and/or what sleep stage of non-REM sleep a user is in, for example, stage 1, stage 2 or stage 3. In another example, the sleep stage may indicate whether a user is in N1, N2, N3 or slow-wave sleep, delta sleep and/or deep sleep.

An application is any type of computer program that can run on a computing device. Where multiple applications are referred to in an embodiment, a single application may perform the task of two or more of the applications. Although many tasks described may be shown as taking place on a local computing device, such as a smart television, it is also contemplated that one or more of the tasks described herein may be performed on a server remote from the smart television. Tasks include receiving a sleep-state event, identifying a type of media, identifying an action to perform and generating the action to perform.

The disclosed methods and systems may be implemented on one or more computing devices. As referred to herein, the computing device can be any device comprising a processor and memory, for example, a television, a smart television, a set-top box, an integrated receiver decoder (IRD) for handling satellite television, a digital storage device, a digital media receiver (DMR), a digital media adapter (DMA), a streaming media device, a DVD player, a DVD recorder, a connected DVD, a local media server, a BLU-RAY player, a BLU-RAY recorder, a personal computer (PC), a laptop computer, a tablet computer, a WebTV box, a personal computer television (PC/TV), a PC media server, a PC media center, a handheld computer, a stationary telephone, a personal digital assistant (PDA), a mobile telephone, a portable video player, a portable music player, a portable gaming machine, a smartphone, a smartwatch, an augmented reality device, a mixed reality device, a virtual reality device, or any other television equipment, computing equipment, or wireless device, and/or combination of the same.

FIG. 1shows an example environment in which a sleep-state event is received and responded to, in accordance with some embodiments of the disclosure. The environment comprises a computing device, in this example a smart television100, that receives media content102via a network104from a server106. The network104may be the internet and may comprise wired and/or wireless means for transmitting the media content102from the server106to the smart television100. In some examples, the server106is an edge server. In some examples, the smart television100runs an application of an OTT provider in order to generate the media content102for output and to display the media content102. If the computing device is, for example, a smart speaker and the media content is audio-only media content, then generating the media content for output may comprise generating a signal that causes a speaker to output the audio content. At least one user will typically consume the media content102. In this example, the user is wearing a smartwatch108that, if the user falls asleep, generates a sleep-state event109. In other examples, the user may have a smartphone that monitors whether a user is dozing and/or sleeping, and the smartphone may generate a sleep-state event if the user dozes and/or sleeps. In another example, the smart television may comprise one or more monitoring devices, such as a camera that uses image recognition to determine whether the user is awake or asleep. Any computing device that can recognize whether a user has started dozing and/or sleeping and that can transmit data indicating that the user has started dozing and/or sleeping may be used. The sleep-state event109is transmitted from the smartwatch108via wireless means, for example, via Wi-Fi and/or Bluetooth. In some examples, the sleep-state event may be transmitted via wired means. The sleep-state event109may comprise biometric data that the smart television100may analyze in order determine whether a user is dozing and/or asleep. An application running on the smart television100identifies a type of the media content110being streamed from the server106. On receiving the sleep-state event109, an application running on the smart television identifies an action to perform112based on the type of the media content. Once the action to perform has been identified, the smart television generates the action to perform114and may perform the action.

FIG. 2shows another example environment of which a sleep-state event is received and responded to, in accordance with some embodiments of the disclosure. In a similar manner to the environment shown inFIG. 1, the environment comprises a computing device, in this example a smart television200, that receives media content202via a network204from a server206. At least one user will typically consume the media content202. In this example, the user is wearing a smartwatch208that monitors a user's biometric data; in this example the biometric data is heart rate data. The biometric data is transmitted from the smartwatch208, via the network204, to the server206. As the heart rate data can be used to infer whether a user is sleeping, it is a sleep-state event209. On receiving the heart rate data, an application running on the server206analyses the heart rate data to determine whether a user is dozing and/or sleeping. Although a single server206is shown, a first server may store and deliver the media content202to the smart television and a second server may receive and analyze the biometric data. On analyzing the heart rate data, if the application running on the server206identifies that a user has started dozing and/or sleeping, a sleep-state event209is sent from the server206to the smart television200. As before, an application running on the smart television200identifies a type of the media content210being streamed from the server206. On receiving the sleep-state event209from the server206, an application running on the smart television identifies an action to perform212based on the type of the media content. Once the action to perform has been identified, an application running on the smart television generates the action to perform214and may perform the action. In some examples, the smartwatch208may analyze biometric data and/or user movement and generate a sleep-state event indicating that a user has fallen asleep and/or is dozing. This generated sleep-state event may be sent from the smartwatch208, via the network204to the server206. Based on the received sleep-state event, the server206may transmit a sleep-state event, via the network204, to the smart television200. In some examples, the identification of a type of media210, the identification of an action to perform212and/or the generation of the action to perform214may also be performed at the server206and instructions may be transmitted from the server206to an application running on the smart television200, via the network204. For example, the server may send a command to an OTT platform to prevent auto play of the next episode in a series of episodes.

FIG. 3shows another example environment in which a sleep-state event is received and responded to, in accordance with some embodiments of the disclosure. In a similar manner to the previously discussed environments, the environment comprises a computing device, in this example a smart television300, that receives media content302via a network304from a server306. At least one user will typically consume the media content302. In this example, the user is wearing a smartwatch308that, if the user falls asleep, generates a sleep-state event309. The sleep-state event309is transmitted from the smartwatch308, via wireless means, to the smart television300. On receiving a sleep-state event309, an application running on the smart television300may transmit this sleep-state event to the server306via the network304. Although a single server306is shown, a first server may store and deliver the media content302to the smart television and a second server may receive and analyze the sleep-state event. On receiving the sleep-state event309, an application running on the server may identify a type of the media content310being streamed from the server306. An application running on the server also identifies an action to perform312based on the type of the media content. The identified action to perform is transmitted from the server306, via the network304, to the smart television300. Once the action to perform has been received at the smart television300, an application running on the smart television generates the action to perform314and may perform the action.

FIG. 4shows another example environment in which a sleep-state event is received and responded to, in accordance with some embodiments of the disclosure. In a similar manner to the previously discussed environments, the environment comprises a computing device, in this example a smart television400, that receives media content402via a network404from a server406. At least one user will typically consume the media content402. In this example, the user is wearing a smartwatch408that, if the user falls asleep, generates a sleep-state event409. The sleep-state event409is transmitted from the smartwatch408, via wireless means, to the smart television400. An application running on the smart television400identifies a type of the media content410being streamed from the server406. On receiving the sleep-state event409, an application running on the smart television identifies an action to perform412based on the type of the media content. The identified action to perform may be transmitted from the smart television400, via the network404, to the server406. An application running on the server may generate the action to perform414. The generated action may be performed at the server406, for example a user profile that is stored on the server may be updated, or the action may comprise transmitting instructions to the smart television400, for example to turn down the volume of the smart television400.

FIG. 5shows another example environment in which a sleep-state event is received and responded to, in accordance with some embodiments of the disclosure. In a similar manner to the previously discussed environments, the environment comprises a computing device, in this example a smart television500, that receives media content502via a network504from a server506. At least one user will typically consume the media content502. In this example, the user is wearing a smartwatch508that, if the user falls asleep, generates a sleep-state event509. The sleep-state event509is transmitted from the smartwatch508via wireless means, for example, via Wi-Fi and/or Bluetooth. An application running on the smart television500identifies a type of the media content510being streamed from the server506. On receiving the sleep-state event509, an application running on the smart television identifies an action to perform512based on the type of the media content. Once the action to perform has been identified, the smart television generates the action to perform, which in this case is to generate a bookmark514, wherein the bookmark indicates a time stamp of the media content502based on the time that the sleep-state event509was received. An application running on the smart television500may perform the generated action. Alternatively, the generated action may be transmitted to a server via the network504and performed remote from the smart television500.

FIG. 6shows another example environment in which a sleep-state event is received and responded to, in accordance with some embodiments of the disclosure. In a similar manner to the previously discussed environments, the environment comprises a computing device, in this example a smart television600, that receives media content602via a network604from a server606. At least one user will typically consume the media content602. In this example, the user is wearing a smartwatch608that, if the user falls asleep, generates a sleep-state event609. The sleep-state event609is transmitted from the smartwatch608via wireless means, for example, via Wi-Fi and/or Bluetooth. An application running on the smart television600identifies a type of the media content610being streamed from the server606. On receiving the sleep-state event609, an application running on the smart television identifies an action to perform612based on the type of the media content. Once the action to perform has been identified, the smart television generates the action to perform. A first part of the generated action is to generate a bookmark614a, wherein the bookmark indicates a time stamp of the media content602based on the time that the sleep-state event609was received. A user profile is identified616; this may, for example, be the user profile that is used to log onto an OTT application running on the smart television600. The second part of the generated action is to update a viewing history associated with the user profile to indicate a resume point614bbased on the generated bookmark614a. An application running on the smart television600may perform the first and/or second parts of the generated action. Alternatively, the first and/or second parts of the generated action may be transmitted to a server via the network604and performed remote from the smart television600.

FIG. 7shows another example environment in which a sleep-state event is received and responded to, in accordance with some embodiments of the disclosure. In a similar manner to the previously discussed environments, the environment comprises a computing device, in this example a smart television700, that receives media content702via a network704from a server706. Metadata indicating a priority segment718is also stored at the server706and is transmitted to the smart television700via the network704. The metadata may be transmitted concurrently with the media content702. In another example, the metadata may be transmitted to the smart television on receiving a request from the smart television700. In some examples, the metadata may be stored at a server that is different from the server706which stores and transmits the media content702. At least one user will typically consume the media content702. In this example, the user is wearing a smartwatch708that, if the user falls asleep, generates a sleep-state event709. The sleep-state event709is transmitted from the smartwatch708via wireless means, for example, via Wi-Fi and/or Bluetooth. An application running on the smart television700identifies a type of the media content710being streamed from the server706. On receiving the sleep-state event709, an application running on the smart television identifies an action to perform712based on the type of the media content. Once the action to perform has been identified, the smart television generates the action to perform. The first part of the generated action is to generate a bookmark714a, wherein the bookmark indicates a time stamp of the media content702based on the time that the sleep-state event709was received. A second part of the generated action is to identify whether the bookmark occurs at or before the priority segment714b. This identification may comprise comparing a time stamp associated with when the bookmark event was generated and time stamps (i.e., a start time stamp and an end time stamp, defining a period) associated with when the priority segment is being output at the smart television700. If the time stamp of the bookmark coincides with the priority period, then this condition is met. In another example, if the bookmark was generated before the priority period, then the condition may also be met as the generation of the bookmark infers that the user is asleep during the priority period. A user profile is identified716; this may, for example, be the user profile that is used to log onto an OTT application running on the smart television700. The third part of the generated action is to update a viewing history associated with the user profile to indicate a resume point714cbased on the generated bookmark714aand the priority segment. For example, if the bookmark is generated during a priority segment, then the resume point may be the start of the priority segment. An application running on the smart television700may perform the first and/or second parts of the generated action. Alternatively, the first and/or second parts of the generated action may be transmitted to a server via the network704and performed remote from the smart television700.

FIG. 8shows another example environment in which a sleep-state event is received and responded to, in accordance with some embodiments of the disclosure. In a similar manner to the previously discussed environments, the environment comprises a computing device, in this example a smart television800, that receives media content802via a network804from a server806. In this example, the media content802is an episode of a series of episodes. The smart television800may indicate that the media content802is an episode of a series of episodes by indicating a series and an episode number818. At least one user will typically consume the media content802, and typically once a user has finished an episode in a series of episodes, the subsequent episode will be generated for output. In this example, the user is wearing a smartwatch808that, if the user falls asleep, generates a sleep-state event809. The sleep-state event809is transmitted from the smartwatch808via wireless means, for example, via Wi-Fi and/or Bluetooth. An application running on the smart television800identifies a type of the media content810being streamed from the server806. On receiving the sleep-state event809, an application running on the smart television identifies an action to perform812based on the type of the media content. Once the action to perform has been identified, the smart television generates the action, which in this case is to disable autoplay of the next episode814. The smart television800may output an indication that the next episode will not be played by, for example, displaying a message “Do not play next”820. A settings menu of an OTT application may enable a user to enable and/or disable this behavior.

FIG. 9shows another example environment in which a sleep-state event is received and responded to, in accordance with some embodiments of the disclosure. In a similar manner to the previously discussed environments, the environment comprises a computing device, in this example a smart television900, that receives media content902via a network904from a server906. At least one user will typically consume the media content902. In this example, the user is wearing a smartwatch908that, if the user falls asleep, generates a sleep-state event909that indicates a sleep stage of the user. The sleep-state event may indicate if a user is in a sleep stage comprising light sleep or a deep sleep. In another example, the sleep-state event may indicate whether a user is in a sleep stage comprising rapid eye movement (REM) sleep or non-REM sleep. The sleep-state event may indicate what sleep stage of non-REM sleep a user is in, for example stage 1, stage 2 or stage 3. In another example, the sleep-state event may indicate whether a user is in a sleep stage corresponding with N1, N2, N3 or slow-wave sleep, delta sleep and/or deep sleep. The sleep-state event909is transmitted from the smartwatch908via wireless means, for example, via Wi-Fi and/or Bluetooth. An application running on the smart television900identifies a type of the media content910being streamed from the server906. On receiving the sleep-state event909, an application running on the smart television identifies an action to perform912based on the type of the media content and the indicated sleep stage. For example, if the sleep-state event indicates that the user is in a light sleep, the media content may be changed to music that aids sleep. In another example, if the sleep-state event indicates that a user is in a deep sleep, the computing device may be turned off or switched to a standby mode. Once the action to perform914has been identified, the smart television generates the action to perform based on the indicated sleep stage.

FIG. 10shows another example environment in which a sleep-state event is received and responded to, in accordance with some embodiments of the disclosure. In a similar manner to the previously discussed environments, the environment comprises a computing device, in this example a smart television1000, that receives media content via a network1004from a server1006. In this example, the media content comprises one or more advertisements1022. The advertisements in this example are generated for display and output during the output of the media content. At least one user will typically consume the media content and advertisements. In this example, the user is wearing a smartwatch1008that, if the user falls asleep, generates a sleep-state event1009. The sleep-state event1009is transmitted from the smartwatch1008via wireless means, for example, via Wi-Fi and/or Bluetooth. An application running on the smart television1000identifies a type of the media content1010being streamed from the server1006. In addition to identifying the type of media1010, it is determined whether the media content comprises one or more advertisements1024. On receiving the sleep-state event1009, an application running on the smart television identifies an action to perform1012based on the type of the media content. Once the action to perform has been identified, the smart television generates the action to perform, which in this case is to determine whether the sleep-state event coincides1026with the output of one or more advertisements1022. For example, a time stamp associated with the sleep-state event may be compared to a time stamp associated with the output of one or more advertisements. If the time stamp of the sleep-state event is before or during the output of one or more advertisements, then this condition is met (i.e., that the user is asleep during the advertisements). If the sleep-state event coincides with the output of one or more advertisements1022then data indicating this is transmitted from the smart television1000, via the network1004, to an advertising server1028. At the advertising server, it is determined whether the advertisement that the user missed due to sleeping should be output at the smart television1000at a later time. This may comprise re-transmitting the advertisement to the smart television1000or sending instructions to the smart television1000to temporarily store the advertisement in a cache. When a user accesses media content at the smart television1000at a later time, then one or more of the missed advertisements may be generated for output during (or at the beginning or the end of) the media content.

FIG. 11shows another example environment in which a sleep-state event is received and responded to, in accordance with some embodiments of the disclosure. In a similar manner to the previously discussed environments, the environment comprises a computing device, in this example a smart television1100, that receives media content1102via a network1104from a server1106. In this example, two users consume the media content1102. Each of the users is wearing a smartwatch1108a,1108bthat, if the user falls asleep, generates a sleep-state event1109. In this example, the user wearing smartwatch1108bfalls asleep and the smartwatch1108bgenerates a sleep-state event1109that is transmitted from the smartwatch1108bvia wireless means, for example, via Wi-Fi and/or Bluetooth. The smartwatch also transmits data that indicates the user to whom the sleep-state pertains. An application running on the smart television1100identifies a type of the media content1110being streamed from the server1106. On receiving the sleep-state event1109, an application running on the smart television identifies an action to perform1112based on the type of the media content. Once the action to perform has been identified, the smart television identifies which user the sleep-state event is associated with1130. This may be performed via data transmitted from the smartwatch1108b. In another example, the user may be identified via a camera communicably connected to the smart television1100and an application running on the smart television1100may perform image recognition in order to identify which user is asleep. A user profile associated with the user that generated the sleep-state event1109is identified1116. The smart television1100generates the action to perform. The first part of the generated action is to generate a bookmark1114a, wherein the bookmark indicates a time stamp of the media content1102based on the time that the sleep-state event1109was received. The second part of the generated action is to update a viewing history associated with the identified user profile to indicate a resume point1114bbased on the generated bookmark1114a.

FIG. 12shows another example environment in which a sleep-state event is received and responded to, in accordance with some embodiments of the disclosure. In a similar manner to the previously discussed environments, the environment comprises a computing device, in this example a smart television1200, that receives live media content1202via a network1204from a server1206. The live content may be captured by a broadcaster with a video camera1232. The capture is be transmitted from the video camera1232to the server1206, where it is transmitted to the smart television1200. At least one user will typically consume the media content1202. In this example, the user is wearing a smartwatch1208that, if the user falls asleep, generates a sleep-state event1209. The sleep-state event1209is transmitted from the smartwatch1208via wireless means, for example, via Wi-Fi and/or Bluetooth. An application running on the smart television1200identifies a type of the media content1210being streamed from the server1206. On receiving the sleep-state event1209, an application running on the smart television identifies an action to perform1212based on the type of the media content. Once the action to perform has been identified, the smart television generates the action to perform. The first part of the generated action is to generate a bookmark1214a, wherein the bookmark indicates a time stamp of the media content1202based on the time that the sleep-state event1209was received. A user profile is identified1216; this may, for example, be the user profile that is used to log on to an OTT application running on the smart television1200. A second part of the generated action is to associate the bookmark with the identified user profile1214b. A third part of the generated action is to identify that the live content is available to stream in a video-on-demand format1234. Typically, this last step1234takes place when the user accesses the OTT platform at a later time. On identifying that the live content is available to stream in a video-on-demand format, an indicator1236is displayed to the user on the smart television1200indicating that the content is “available.” For example, when the user next accesses the OTT platform, the OTT platform may already have an on demand format that is available for streaming. In this example, the indicator would be displayed to the when they access the OTT platform, or shortly after the user accesses the OTT platform. In another example, the on demand format may not be available for streaming when the user next accesses the OTT platform; however, it may be available at a subsequent time. For example, the on demand format may be available, for example, a period of time, such as a week or five months, after the user viewed the live media content. In this case, the indicator is displayed to the user when (or shortly after) they access the OTT platform and the on demand content is available. The indicator that is displayed to the user may be in the form of a recommendation, such as “would you like to watch this on demand content?” The indicator may also indicate a point at which the on demand content can be accessed, based on the bookmark that was generated when the sleep-state event was received. In some examples, the indicator may also enable a user to start watching the on demand content at the start. In other examples, a user may have a profile that is common to a plurality of OTT platforms. In this case, a user may watch live media content on a first platform and a bookmark based on a received sleep-state event may be generated and associated with their profile. On a second OTT platform, an indicator that indicates that an on demand format of the media content is available may be displayed to the user, based on the bookmark that is associated with their profile. A user may select this indicator to start streaming the media content. In addition, the media content may start streaming from a point based on the generated bookmark1214a. For example, if the user fell asleep halfway though the live media content1202, the video-on-demand content may start streaming at the halfway point.

FIG. 13shows another example environment in which a sleep-state event is received and responded to, in accordance with some embodiments of the disclosure. In a similar manner to the previously discussed environments, the environment comprises a computing device, in this example a smart television1300, that receives media content1302via a network1304from a server1306. At least one user will typically consume the media content1302. The user may indicate that the media content is favorite media content by selecting an icon via a remote control of the smart television1300. In this example, the user has selected a star icon1311to indicate that the media content1302is a favorite media content item. In this example, the user is wearing a smartwatch1308that, if the user falls asleep, generates a sleep-state event1309. The sleep-state event1309is transmitted from the smartwatch1308via wireless means, for example, via Wi-Fi and/or Bluetooth. An application running on the smart television1300identifies a type of the media content1310being streamed from the server1306. In this example, the type of media content is favorited media content. On receiving the sleep-state event1309, an application running on the smart television identifies an action to perform1312based on the type of the media content. Once the action to perform has been identified, the smart television generates the action to perform1314and may perform the action.

FIG. 14shows pseudocode indicating the types of data that may be included in a sleep-state event, in accordance with some embodiments of the disclosure. A pseudo-function1400represents data that can be included in a sleep-state event that is transmitted from a first computing device, such as a smartwatch, to a second computing device, such as a smart television. The sleep-state event may indicate if a user has entered a sleep-state, or left a sleep-state (i.e., woken up)1402. The sleep-state event may also comprise data that can be used to identify a user1404. A time1406at which the user enters a sleep-state may be identified, as may a duration1408of the sleep-state. The sleep-state event may indicate a sleep stage1410of the user. The sleep-state event may also indicate a location1412of the user. This may comprise a room of a building, for example via a smart home network. In other examples, this may comprise co-ordinates, such as those used in conjunction with a global positioning satellite service, such as GPS. In any embodiment, multiple sleep-state events may be sent from the first computing device, such as a smartwatch, to a second computing device, such as a smart television, in order to update any of the aforementioned fields1402,1404,1406,1408,1410,1412.

FIG. 15shows a block diagram representing components of a computing device and data flow therebetween for responding to a sleep-state event, in accordance with some embodiments of the disclosure. Computing device1500(e.g., a smart television100,200,300,400,500,600,700,800,900,1000,1100,1200) as discussed above comprises input circuitry1504, control circuitry1508and an output module1530. Control circuitry1508may be based on any suitable processing circuitry (not shown) and comprises control circuits and memory circuits, which may be disposed on a single integrated circuit or may be discrete components and processing circuitry. As referred to herein, processing circuitry should be understood to mean circuitry based on one or more microprocessors, microcontrollers, digital signal processors, programmable logic devices, field-programmable gate arrays (FPGAs), application-specific integrated circuits (ASICs), etc., and may include a multi-core processor (e.g., dual-core, quad-core, hexa-core, or any suitable number of cores). In some embodiments, processing circuitry may be distributed across multiple separate processors or processing units, for example, multiple of the same type of processing units (e.g., two Intel Core i9 processors) or multiple different processors (e.g., an Intel Core i5 processor and an Intel Core i7 processor) and/or a system on a chip (e.g., a Qualcomm Snapdragon 888). Some control circuits may be implemented in hardware, firmware, or software.

A user provides an input1502that is received by the input circuitry1504. The input circuitry1504is configured to receive a user input related to a computing device. For example, this may be via a touchscreen, keyboard, mouse, microphone and/or infra-red controller of the computing device1500. The input circuitry1504transmits1506the user input to the control circuitry1508.

The control circuitry1508comprises a media content receiving module1510, a media content generation module1514, a sleep-state receiving module1518, a content type identification module1522, an action identification module1526and an output module1530. The user input is transmitted1506to the media content receiving module1510. At the media content receiving module1510, media content is received. On receiving the media content, the media content is transmitted1512to the media content generation module1514, where it is generated for output. A signal indicating that media content is being generated for output is transmitted1516to the sleep-state receiving module1518, which receives a sleep-state event. On receiving a sleep-state event at the sleep-state receiving module1518, the sleep-state event is transmitted1520to the content type identification module1522, where the media content type is identified. The sleep-state event and an indication of the media content type is transmitted1524to the action identification module1526, where an action to perform is identified. The action to perform is transmitted1528to the output module1530, where the action to perform is generated1532.

FIG. 16shows a flowchart of illustrative steps involved in responding to a sleep-state event, in accordance with some embodiments of the disclosure. Process1600may be implemented on any of the aforementioned computing devices (e.g., smart television100,200,300,400,500,600,700,800,900,1000,1100,1200). In addition, one or more actions of the process1600may be incorporated into or combined with one or more actions of any other process or embodiments described herein.

At1602media content is received, for example at a smart television, via a network, from a server. At1604, the media content is generated for output, for example displayed at a smart television. At1606, a sleep-state event is received, for example from a smartwatch, indicating that a user has fallen asleep. At1608, a type of content being generated for output is identified. At1610, an action to perform is identified. At1612, the action to perform is generated.