Patent Description:
The invention further relates to a method of adjusting a delay setting based on user input.

Philips' Hue Entertainment and Hue Sync have become very popular among owners of Philips Hue lights. Philips Hue Sync enables the rendering of light effects based on the content that is played on a computer. Initially, Hue Sync was only available as an application for PCs. An HDMI module called the Hue Play HDMI Sync Box was later added to the Hue entertainment portfolio. This device addresses one of the main limitations of Hue Sync and aims at streaming and gaming devices connected to the TV. It makes use of the same principle of an entertainment area and the same mechanisms to transport information. This device is in principle a HDMI splitter which is placed between any HDMI device and a TV.

A dynamic lighting system can dramatically influence the experience and impression of audio-visual material, e.g. when the colors sent to the lights match what would be seen in the composed environment around the screen. However, a dynamic lighting system cannot only be used to enhance screen content, but also to enhance the experience of listening to music, e.g. by using a software algorithm to analyze an audio stream in real-time and create light effects based on certain audio characteristics such as intensity and frequency bands.

An alternative approach is to preprocess music and extract relevant meta data and translate this to a light script specifying light effects. Some of the streaming services offer such metadata. For example, Spotify has a meta data for each song, that includes different audio properties and can be accessed via the Spotify API. The advantage of using metadata for light effects creation is that it does not require access to the audio stream and allows analysis of the data of the complete song instead of relying on the real-time data.

When light effects are used to enhance audio on connected luminaires, it is important that the light effects are in sync with the audio. Especially when e.g. Bluetooth speakers are used, latencies larger than <NUM> may be introduced. Unfortunately, a difference of <NUM> can be enough to be noticeable and may negatively impact the experience. For example, light effects may be intended to be rendered at the same time as auditory effects in an audio segment and depending on the overall latency of the audio segment, it becomes ambiguous whether an auditory effect 'belongs' to a first or a second light effect.

<CIT> describes a device and method that improve the light experience when a variation in delay of the audio segment would affect the light experience. The device and method achieve this by selecting light effects based on information indicating or affecting a variation in delay. This makes it possible to skip light effects that are sensitive to variations in delay. If the delay between the playback moment of the audio segment and the rendering moments of the light effects can be measured with sufficient accuracy, a buffer may be used to ensure that the light effects are in sync with the audio. However, it is not always possible to measure this delay or to measure this delay with sufficient accuracy.

<CIT> discloses a rotary knob which connects to a light switch wirelessly. A spoken description of each control position is played back as the knob is turned to that position, to help blind persons.

It is a first object of the invention to provide a system, which can be used to synchronize audio and light effects without requiring a delay to be measured.

It is a second object of the invention to provide a method, which can be used to synchronize audio and light effects without requiring a delay to be measured.

In a first aspect of the invention, a system for adjusting a delay setting based on user input comprises at least one input interface, at least one control interface, and at least one processor configured to control, via said at least one control interface, playback of an audio segment, said audio segment comprising a spoken description of a light effect, said audio segment being played back at a playback moment, control, via said at least one control interface, a light source to render said light effect, said light effect being rendered at a rendering moment, a difference between said playback moment and said rendering moment depending on a value of said delay setting, said delay setting causing said rendering of said light effect or said playback of said audio segment to be delayed, receive, via said at least one input interface, said user input in response to said playback of said audio segment and said rendering of said light effect, and adjust said delay setting based on said user input.

This system allows the user to quickly and straightforwardly sync light effects to a (possibly delayed) audio segment without requiring a delay to be measured. By using a spoken description of the light effect, it becomes possible to render multiple (different) light effects without a substantial pause (e.g. ><NUM>) in between. This makes the syncing quicker and more user-friendly. If the spoken description consists of a color-word, such as blue or red, the accompanying light effect is then similarly color coded, making it readily apparent whether the light effects should be delayed or advanced to be in sync with the audio segment.

For example, the system may start playback of an audio segment comprising color-names or other sounds associated with light effects (e.g. red, blue, green, yellow), control rendering of corresponding light effects (e.g. red, blue, green and yellow flashes, subsequently), and allow the user to advance or delay the light effects to get in sync with the audio signal. The audio segment may be especially created for the delay synchronization or may be an existing song that lists colors, for example. The user input may be received via a user interface displayed on a display or via speech input, for example. The adjusted delay setting is typically stored as configuration setting, e.g. for the current combination of lighting system and audio system.

Said user input may be indicative of a new value for said delay setting or of an increase or decrease of a current value of said delay setting, for example. Said spoken description may describe a color of said light effect, an intensity of said light effect, a quantity of flashes of said light effect, a location of said light source, and/or a quantity of light sources on which said light effect is rendered at said rendering moment, for example.

Said audio segment may further comprise an audio signal associated with said spoken description, said audio signal following said spoken description in said audio segment. This may be especially beneficial if the spoken description is somewhat long. Alternatively, the start of the corresponding light effect may be synchronized with the start of the spoken description and the end of the corresponding light effect may be synchronized with the end of the spoken description. However, some users may find it clearer if an audio signal is used to indicate which moment of the audio segment should be in sync with a corresponding light effect. Said audio signal may be a beep, for example.

Said audio signal may immediately follow said spoken description in said audio segment. Said spoken description and said audio signal may be part of the same audio sample, for example. In this case, the system may know that playback of the audio sample (e.g. "red <beep>") has started and that <NUM> seconds after the start of the playback of the audio, the beep occurs and the light effect should be rendered.

Said at least one processor may be configured to determine an estimation of said playback moment and control said light source to render said light effect a specified time after said estimation of said playback moment, said difference between said playback moment and said rendering moment further depending on said specified time. Alternatively, playback of the audio segment may be started in dependence on a light script start time.

Said audio segment may comprise a further spoken description of a further light effect and said at least one processor may be configured to control, via said at least one control interface, said light source and/or a further light source to render said further light effect at a further rendering moment, a difference between said playback moment and said further rendering moment depending on said value of said delay setting. The system is especially beneficial if multiple light effects are rendered and multiple spoken descriptions of these light effects are played back, as the use of a spoken description of a light effect makes it possible to render multiple (different) light effects without a substantial pause in between.

Said audio segment may further comprise an audio signal associated with said spoken description and an audio signal associated with said further spoken description, wherein said audio signal associated with said spoken description and said audio signal associated with said further spoken description follow said spoken description and said further spoken description in said audio segment. For example, the audio segment may comprise "red blue <beep> <beep>". This is an alternative to having the audio signal immediately follow the spoken description in the audio segment.

Said at least one processor may be configured to determine an estimation of said playback moment and control said light source and/or said further light source to render said further light effect a further specified time after said estimation of said playback moment, said difference between said playback moment and said further rendering moment further depending on said further specified time. Alternatively, playback of the audio segment may be started in dependence on a light script start time.

Said at least one processor may be configured to control, via said at least one control interface, a second playback of said audio segment, and control, via said at least one control interface, said light source to render said light effect a second time, said light effect being rendered at a second rendering moment said second time, a difference between said playback moment and said second rendering moment depending on a second value of said delay setting.

As a first example, said at least one processor may be configured to adjust said delay setting to said second value based on said user input, receive further user input in response to said second playback of said audio segment and said rendering of said light effect at said second rendering moment, and further adjust said delay setting based on said further user input. By looping the audio segment and corresponding light effects, the user may be allowed to adjust the delay in real-time and then exit the method when he is satisfied with the current delay setting.

As a second example, said user input may be indicative of a selection of one of multiple options, a first option of said multiple options corresponding to said playback of said audio segment and said rendering of said light effect at said rendering moment and a second option of said multiple options corresponding to said second playback of said audio segment and said rendering of said light effect at said second rendering moment and said at least one processor may be configured to adjust said delay setting based on said value of said delay setting if said user input is indicative of said first option and based on said second value of said delay setting if said user input is indicative of said second option. Choosing an option with the best delay setting may be easier for the user than indicating a new value for the delay setting or indicating an increase or decrease of a current value of the delay setting.

Said at least one processor may be configured to determine a type of an audio system used to output said audio segment and determine said value and said second value of said delay setting based on said type of said audio system. This may reduce the number of times the audio segment needs to be played and the corresponding light effects need to be rendered before the user can select an option with an acceptable delay setting.

In a second aspect of the invention, a method of adjusting a delay setting based on user input comprises controlling playback of an audio segment, said audio segment comprising a spoken description of a light effect, said audio segment being played back at a playback moment, controlling a light source to render said light effect, said light effect being rendered at a rendering moment, a difference between said playback moment and said rendering moment depending on a value of said delay setting, said delay setting causing said rendering of said light effect or said playback of said audio segment to be delayed, receiving said user input in response to said playback of said audio segment and said rendering of said light effect, and adjusting said delay setting based on said user input. Said method may be performed by software running on a programmable device. This software may be provided as a computer program product.

A non-transitory computer-readable storage medium stores at least one software code portion, the software code portion, when executed or processed by a computer, being configured to perform executable operations for adjusting a delay setting based on user input.

The executable operations comprise controlling playback of an audio segment, said audio segment comprising a spoken description of a light effect, said audio segment being played back at a playback moment, controlling a light source to render said light effect, said light effect being rendered at a rendering moment, a difference between said playback moment and said rendering moment depending on a value of said delay setting, said delay setting causing said rendering of said light effect or said playback of said audio segment to be delayed, receiving said user input in response to said playback of said audio segment and said rendering of said light effect, and adjusting said delay setting based on said user input.

<FIG> shows a first embodiment of the system for adjusting a delay setting based on user input. In this first embodiment, the system is a mobile device <NUM>. Mobile device <NUM> is able to control lighting devices <NUM>-<NUM> via a wireless LAN access point <NUM> and a bridge <NUM>, and optionally via an Internet server <NUM>, e.g. of the manufacturer of the lighting devices <NUM>-<NUM>. Lighting devices <NUM>-<NUM> may be Philips Hue lamps, for example. The lighting devices <NUM>-<NUM> communicate with the bridge <NUM>, e.g. using Zigbee technology. The bridge <NUM> may be a Philips Hue bridge, for example. The bridge <NUM> is connected to the wireless LAN access point <NUM>, e.g. via Wi-Fi or Ethernet.

Mobile device <NUM> is able to control playback of audio segments, e.g. songs, via an Internet server <NUM>, e.g. of a music streaming service such as Spotify. Mobile device <NUM> is able to start and stop playback of audio segments available in the music library of the music streaming service and able to determine a current playback moment in the audio segment currently being played back. In the example of <FIG>, music is streamed to an audio system <NUM>, e.g. a smart and/or Wi-Fi speaker system or an A/V receiver. The music system <NUM> is connected to the wireless LAN access point <NUM> and streams music directly from the Internet server <NUM> via Wi-Fi. Alternatively, music may be streamed from a music app running on the mobile device <NUM> to the music system <NUM> via Bluetooth. The wireless LAN access point <NUM> is connected to the Internet <NUM>. The Internet servers <NUM> and <NUM> are also connected to the Internet <NUM>. Instead of single Internet servers, clusters of Internet servers may be used. These clusters may be part of one or more clouds.

The mobile device <NUM> comprises a transceiver <NUM>, a transmitter <NUM>, a processor <NUM>, memory <NUM>, and a touchscreen display <NUM>. The processor <NUM> is configured to control, via the transmitter <NUM>, playback of an audio segment, e.g. via an API of the Internet server <NUM>. The audio segment comprises a spoken description of a light effect and is played back at a playback moment. The audio segment may be a dedicated audio segment that has been uploaded to the music streaming service, e.g. with agreement of the service provider, or may be an already existing audio segment with appropriate content, e.g. with spoken descriptions of colors (like the song "Sing A Rainbow" by Peggy Lee).

The processor <NUM> is further configured to control, via the transmitter <NUM>, the lighting device <NUM> to render a light effect. The light effect is rendered at a rendering moment. A difference between the playback moment and the rendering moment depends on a value of the delay setting. The delay setting causes the rendering of the light effect or the playback of the audio segment to be delayed. Further spoken descriptions and corresponding light effects may also be rendered, e.g. on only lighting device <NUM>, on a different lighting device, or on multiple lighting devices.

The processor <NUM> is further configured to receive, via the touchscreen display <NUM> or via a microphone (not shown), user input in response to the playback of the audio segment and the rendering of the light effect(s) and adjust the delay setting based on the user input. The delay setting may be a delay setting of the audio system <NUM>, bridge <NUM>, the lighting device <NUM> or the mobile device <NUM> itself, for example. A single delay setting may be adjusted, or multiple delay settings may be adjusted.

The adjustment of the delay setting is performed to improve the synchronization between audio and corresponding light effects, which may for example be determined based on metadata obtained from the Internet server <NUM>. A typical use case would be a user connecting to smart speakers at home, where connection to the smart speakers introduces a noticeable delay. A typical delay might be e.g. <NUM>-<NUM> seconds.

When the user is satisfied with the delay setting, the delay setting may be stored for later use, e.g. in memory <NUM> or on the Internet server <NUM>, and/or it may be stored as configuration setting in the audio system <NUM>, bridge <NUM>, or the lighting device <NUM>, for example. If the delay setting is stored for later use, it may be stored in relation to the current combination of lighting system and audio system, for example.

The audio segment comprises a spoken description of a light effect. The spoken description describes a color of the light effect, an intensity of the light effect, a quantity of flashes of the light effect, a location of the lighting device <NUM>, and/or a quantity of light sources on which the light effect is rendered (one in this example). For example, the spoken description could be "red", "two green", "dining lamp blue", "left lamp", or "red on the left". If the utterance is somewhat long, a follow up short beep could be used for alignment purposes.

In the embodiment of the mobile device <NUM> shown in <FIG>, the mobile device <NUM> comprises one processor <NUM>. In an alternative embodiment, the mobile device <NUM> comprises multiple processors. The processor <NUM> of the mobile device <NUM> may be a general-purpose processor, e.g. from ARM or Qualcomm or an application-specific processor. The processor <NUM> of the mobile device <NUM> may run an Android or iOS operating system for example. The display <NUM> may comprise an LCD or OLED display panel, for example. The processor <NUM> may use touch screen display <NUM> to provide a user interface, for example. The memory <NUM> may comprise one or more memory units. The memory <NUM> may comprise solid state memory, for example.

The receiver <NUM> and the transmitter <NUM> may use one or more wireless communication technologies, e.g. Wi-Fi (IEEE <NUM>) for communicating with the wireless LAN access point <NUM>, for example. In an alternative embodiment, multiple receivers and/or multiple transmitters are used instead of a single receiver and a single transmitter. In the embodiment shown in <FIG>, a separate receiver and a separate transmitter are used. In an alternative embodiment, the receiver <NUM> and the transmitter <NUM> are combined into a transceiver. The mobile device <NUM> may comprise other components typical for a mobile device such as a battery and a power connector. The invention may be implemented using a computer program running on one or more processors.

In the embodiment of <FIG>, the lighting devices <NUM>-<NUM> are controlled by the mobile device <NUM> via the bridge <NUM>. In an alternative embodiment, one or more of the lighting devices <NUM>-<NUM> are controlled by the mobile device <NUM> without a bridge, e.g. directly via Bluetooth or via the wireless LAN access point <NUM>. Optionally, the lighting devices <NUM>-<NUM> are controlled via the cloud, e.g. via Internet server <NUM>. The lighting devices <NUM>-<NUM> may be capable of receiving and transmitting Wi-Fi signals, for example.

<FIG> shows a second embodiment of the system for adjusting a delay setting based on user input. In this second embodiment, the system is a computer <NUM>. The computer <NUM> is connected to the Internet <NUM> and acts as a server. The computer <NUM> may be operated by a lighting company, for example. In the embodiment of <FIG>, the computer <NUM> is able to control the lighting devices <NUM>-<NUM> via the wireless LAN access point <NUM> and the bridge <NUM> and able to communicate with the Internet server <NUM> of a music streaming service.

The computer <NUM> comprises a receiver <NUM>, a transmitter <NUM>, a processor <NUM>, and storage means <NUM>. The processor <NUM> is configured to control, via the transmitter <NUM>, playback of an audio segment, e.g. via an API of the Internet server <NUM>. The audio segment comprises a spoken description of a light effect and is played back at a playback moment.

The processor <NUM> is further configured to control, via the transmitter <NUM>, the lighting device <NUM> to render a light effect. The light effect is rendered at a rendering moment. A difference between the playback moment and the rendering moment depends on a value of the delay setting. The delay setting causes the rendering of the light effect or the playback of the audio segment to be delayed.

The processor <NUM> is further configured to receive, e.g. from a mobile device <NUM> or from audio system <NUM>, user input in response to the playback of the audio segment and the rendering of the light effect and adjust the delay setting based on the user input. The delay setting may be a delay setting of the audio system <NUM>, bridge <NUM>, the lighting device <NUM> or the computer <NUM> itself, for example.

In the embodiment of the computer <NUM> shown in <FIG>, the computer <NUM> comprises one processor <NUM>. In an alternative embodiment, the computer <NUM> comprises multiple processors. The processor <NUM> of the computer <NUM> may be a general-purpose processor, e.g. from Intel or AMD, or an application-specific processor. The processor <NUM> of the computer <NUM> may run a Windows or Unix-based operating system for example. The storage means <NUM> may comprise one or more memory units. The storage means <NUM> may comprise one or more hard disks and/or solid-state memory, for example. The storage means <NUM> may be used to store an operating system, applications and application data, for example.

The receiver <NUM> and the transmitter <NUM> may use one or more wired and/or wireless communication technologies such as Ethernet and/or Wi-Fi (IEEE <NUM>) to communicate with the wireless LAN access point <NUM>, for example. In an alternative embodiment, multiple receivers and/or multiple transmitters are used instead of a single receiver and a single transmitter. In the embodiment shown in <FIG>, a separate receiver and a separate transmitter are used. In an alternative embodiment, the receiver <NUM> and the transmitter <NUM> are combined into a transceiver. The computer <NUM> may comprise other components typical for a computer such as a power connector. The invention may be implemented using a computer program running on one or more processors.

In the embodiment of <FIG>, the computer <NUM> receives data from and transmits data to the lighting devices <NUM>-<NUM> via the bridge <NUM>. In an alternative embodiment, the computer <NUM> receives data from and transmits data to one or more of the lighting devices <NUM>-<NUM> without a bridge.

A first embodiment of the method of adjusting a delay setting based on user input is shown in <FIG>. A step <NUM> comprises controlling playback of an audio segment. The audio segment is played back at a playback moment. The audio segment comprising a spoken description of a light effect and a further spoken description of a further light effect. The spoken descriptions describe a color of the light effects, an intensity of the light effects, a quantity of flashes of the light effects, a location of the light source(s) on which the light effects are rendered in steps <NUM> and <NUM>, and/or a quantity of light sources on which the light effects are rendered in steps <NUM> and <NUM>.

For example, the spoken descriptions may consist of color-names, preferably names of colors that many people recognize, e.g. the four primary colors (red, green, blue and yellow) and not a color like "Egyptian". Bursts may be used for e.g. the color blind, where the spoken descriptions may comprise e.g. the utterances "one", "two" and "three", accompanied by e.g. the corresponding number of white flashes on the light source. The spoken descriptions may comprise objects names that describe the light effects if the light effects are rendered on pixelated light sources like a matrix LED panel, where the object, e.g. a character, can be visualized. Examples of such spoken descriptions are "A", "B", "C" or "Cross", "Plus", and "Minus".

Step <NUM> comprises controlling a light source to render the light effect. The light effect is rendered at a rendering moment. A difference between the playback moment and the rendering moment depends on a value of the delay setting. The delay setting causes the rendering of the light effect or the playback of the audio segment to be delayed.

Step <NUM> comprises controlling the light source and/or a further light source to render the further light effect at a further rendering moment. The lights effects may comprise the above-mentioned colors, flashes, or objects, for example. A difference between the playback moment and the further rendering moment depends on the value of the delay setting. In the embodiment of <FIG>, two light effects are rendered. In an alternative embodiment, more or less than two light effects are rendered.

A step <NUM> comprises receiving the user input in response to the playback of the audio segment and the rendering of the light effects. The user input may be indicative of a new value for the delay setting or of an increase or decrease of a current value of the delay setting, for example. A step <NUM> comprises adjusting the delay setting based on the user input. Thus, steps <NUM> and <NUM> allow the user to advance or delay the light effects to be in sync with the audio or to advance or delay the audio to be in sync with the light effects.

<FIG> shows a first example of an audio segment and corresponding light effects. The audio segments <NUM> comprises a spoken description <NUM> and a further spoken description <NUM>. A sequence of light effects <NUM> is rendered in parallel. The spoken description <NUM> describes the color of the light effect <NUM>: blue. The further spoken description <NUM> describes the color of the further light effect <NUM>: red. The light effect <NUM> is started at the start of the spoken description <NUM> and terminated at the end of the spoken description <NUM>. The further light effect <NUM> is started at the start of the further spoken description <NUM> and terminated at the end of the further spoken description <NUM>.

<FIG> shows a second example of an audio segment and corresponding light effects. In this second example, the audio segment <NUM> further comprises an audio signal <NUM> associated with the spoken description <NUM> and an audio signal <NUM> associated with the further spoken description <NUM>. The audio signals <NUM> and <NUM> may be short beeps, for example. The audio signal <NUM> immediately follows the spoken description <NUM> in the audio segment <NUM>. The audio signal <NUM> immediately follows the further spoken description <NUM> in the audio segment <NUM>. The user may be asked to synchronize the light effects to the beeps following the color-names, for example.

The audio signals <NUM> and <NUM> are relatively short compared to the spoken descriptions <NUM> and <NUM>. The light effect <NUM> and the further light effect <NUM> are also relatively short and shorter than the light effects <NUM> and <NUM> of <FIG>. The light effect <NUM> and the further light effect <NUM> are intended to be rendered at the same time as the spoken description <NUM> and further spoken description <NUM>, respectively, and have the same duration as these spoken descriptions.

<FIG> shows a third example of an audio segment and corresponding light effects. Compared to the example of <FIG>, the audio signal <NUM> associated with the spoken description <NUM> and the audio signal <NUM> associated with the further spoken description <NUM> now both follow the spoken description <NUM> and the further spoken description <NUM> in the audio segment <NUM>.

A second embodiment of the method of adjusting a delay setting based on user input is shown in <FIG>. Step <NUM> comprises controlling playback of an audio segment, e.g. via a music service API. The audio segment is played back at a playback moment. The audio segment comprises a spoken description of a light effect and a further spoken description of a further light effect.

A step <NUM> comprises determining an estimation of the playback moment, e.g. based on information received via the music service API. A step <NUM> comprises determining a first timer which lapses a specified time after the estimation of the playback moment and a second timer which lapses a further specified time after the estimation of the playback moment. The first timer lapses before the second timer. A step <NUM> comprises determining whether the first timer has lapsed. If not, step <NUM> is repeated until the first timer lapses. When it is determined in step <NUM> that the first timer has lapsed, step <NUM> is performed.

Step <NUM> comprises controlling a light source to render the light effect. The light effect is rendered at a rendering moment. A difference between the playback moment and the rendering moment depends on a value of the delay setting and the specified time. The delay setting causes the rendering of the light effect or the playback of the audio segment to be delayed.

A step <NUM> comprises determining whether the second timer has lapsed. If not, step <NUM> is repeated until the second timer lapses. When it is determined in step <NUM> that the second timer has lapsed, step <NUM> is performed. Step <NUM> comprises controlling the light source and/or a further light source to render the further light effect at a further rendering moment. A difference between the playback moment and the further rendering moment depends on the value of the delay setting and the further specified time.

Next, step <NUM> comprises receiving the user input in response to the playback of the audio segment and the rendering of the light effects. The user input may be indicative of a new value for the delay setting or of an increase or decrease of a current value of the delay setting, for example. Step <NUM> comprises adjusting the delay setting based on the user input. In the embodiment of <FIG>, two light effects are rendered. In an alternative embodiment, more or less than two light effects are rendered.

A third embodiment of the method of adjusting a delay setting based on user input is shown in <FIG>. This third embodiment is an extension of the first embodiment of <FIG>. In the embodiment of <FIG>, the user input received in step <NUM> is indicative of whether the user is satisfied with the current delay setting. If the user input indicates that the user is not satisfied with the current delay setting, the user input may further indicate a new value for the delay setting or of an increase or decrease of a current value of the delay setting.

A step <NUM> is performed after step <NUM>. Step <NUM> comprises determining whether the user has indicated that he is satisfied with the current delay setting based on the user input received in step <NUM>. If it is determined in step <NUM> that the user has indicated that he is satisfied with the current delay setting, the method terminates. If it is determined in step <NUM> that the user has indicated that he is not satisfied with the current delay setting, step <NUM> is performed. Step <NUM> comprises adjusting the delay setting based on the user input. In step <NUM>, the delay setting is adjusted to a new value, e.g. the new value indicated in the user input or a new value obtained by increasing or decreasing the current value of the delay setting. Step <NUM> is repeated after step <NUM> and the method then proceeds as shown in <FIG>.

In the next iteration of step <NUM>, the next light effect is rendered at a next rendering moment. In the next iteration of step <NUM>, the next further light effect is rendered at a next further rendering moment. A difference between the playback moment and the next rendering moment and a difference between the playback moment and the next further rendering moment depend on the new value of the delay setting. In the embodiment of <FIG>, two light effects are rendered. In an alternative embodiment, more or less than two light effects are rendered.

When the user is satisfied with the delay setting, the delay setting may be stored for later use and/or it may be stored as configuration setting, e.g. in the audio system on which the audio segment is rendered or in the lighting system that comprises the light source(s), for example. If the delay setting is stored for later use, it may be stored in relation to the current combination of lighting system and audio system, for example.

<FIG> illustrates the performance of the method of <FIG>. In the example of <FIG>, the audio segment <NUM> and corresponding light effects <NUM> and <NUM> shown in <FIG> are rendered. In a first iteration of steps <NUM> and <NUM> of <FIG>, at a moment <NUM>, the light effects <NUM> and <NUM> are rendered using a first value of the delay setting. A difference <NUM> between the playback moment <NUM> and the rendering moment of the light effect <NUM> depends on the first value of the delay setting. This first value of the delay setting results in a delay <NUM> between the rendering of the audio signal <NUM> and the rendering of the light effect <NUM> and between the rendering of the audio signal <NUM> and the rendering of the light effect <NUM>.

Then, in step <NUM>, the user indicates that he is not satisfied with the current delay setting, i.e. with the first value of the delay setting, and that the light is late compared to the audio. In step <NUM>, a second value of the delay setting is obtained by decreasing the current value of the delay setting, e.g. with a fixed value or with a user-indicated value. As a result, the second value of the delay setting is lower than the first value.

In a second iteration of steps <NUM> and <NUM> of <FIG>, at a moment <NUM>, the light effects <NUM> and <NUM> are rendered using the second value of the delay setting. A difference <NUM> between the playback moment <NUM> and the rendering moment of the light effect <NUM> depends on the second value of the delay setting. This second value of the delay setting results in a delay <NUM> between the rendering of the audio signal <NUM> and the rendering of the light effect <NUM> and between the rendering of the audio signal <NUM> and the rendering of the light effect <NUM>.

Difference <NUM> is smaller than difference <NUM> and delay <NUM> is smaller than delay <NUM> due to the user input in step <NUM>. However, in the second iteration of step <NUM>, the user indicates that he is (still) not satisfied with the current delay setting, i.e. with the second value of the delay setting, and that the light is still late compared to the audio. Step <NUM>, <NUM>, <NUM>, <NUM>, <NUM>, and <NUM> are repeated until the user is satisfied with the delay setting.

A fourth embodiment of the method of adjusting a delay setting based on user input is shown in <FIG>. This fourth embodiment is an extension of the second embodiment of <FIG>. A step <NUM> comprises determining a type of an audio system used to output the audio segment. Step <NUM> comprises controlling playback of an audio segment, e.g. via a music service API. The audio segment is played back at a playback moment. The audio segment comprises a spoken description of a light effect and a further spoken description of a further light effect. Step <NUM> comprises determining an estimation of the playback moment, e.g. based on information received via the music service API.

A step <NUM> comprises determining a first timer which lapses a specified time after the estimation of the playback moment and a second timer which lapses a further specified time after the estimation of the playback moment while adding a delay corresponding to a first value of the delay setting. The first value of the delay setting corresponds to a first option and is determined based on the type of the audio system determined in step <NUM>. The first timer lapses before the second timer.

The delay may be added by temporarily adjusting the delay setting or by temporarily adjusting another delay setting, for example. As an example of the latter, a delay setting of an app running on a mobile device, which performs the method, may be temporarily adjusted, even though the method is used to adjust a delay setting applied on a light bridge or lighting device.

Step <NUM> comprises determining whether the first timer has lapsed. If not, step <NUM> is repeated until the first timer lapses. When it is determined in step <NUM> that the first timer has lapsed, step <NUM> is performed. Step <NUM> comprises controlling a light source to render the light effect. The light effect is rendered at a rendering moment. A step <NUM> comprises determining whether the second timer has lapsed. If not, step <NUM> is repeated until the second timer lapses. When it is determined in step <NUM> that the second timer has lapsed, step <NUM> is performed. Step <NUM> comprises controlling the light source and/or a further light source to render the further light effect at a further rendering moment.

After step <NUM> has been performed, steps <NUM>, <NUM>, <NUM>, <NUM>, <NUM> and <NUM> are performed again. However, instead of step <NUM>, a step <NUM> is performed between steps <NUM> and <NUM>. Step <NUM> comprises determining a first timer which lapses a specified time after the estimation of the playback moment and a second timer which lapses a further specified time after the estimation of the playback moment while adding a delay corresponding to a second value of the delay setting. The second value of the delay setting corresponds to a second option and is determined based on the type of the audio system determined in step <NUM>. The first timer lapses before the second timer. In the embodiment of <FIG>, two light effects are rendered. In an alternative embodiment, more or less than two light effects are rendered.

Step <NUM> comprises receiving the user input in response to the playbacks of the audio segment and the rendering of the light effects. In the embodiment of <FIG>, step <NUM> is implemented by a step <NUM>. In step <NUM>, the received user input is indicative of a selection of one of the two options. In the embodiment of <FIG>, the user is only able to select one of two options in step <NUM>. In an alternative embodiment, the user can select from more than two options in step <NUM>.

Step <NUM> comprises adjusting the delay setting based on the user input. In the embodiment of <FIG>, step <NUM> is implemented by a step <NUM>. Step <NUM> comprises adjusting the delay setting based on the first value of the delay setting if the user input is indicative of the first option and based on the second value of the delay setting if the user input is indicative of the second option.

After step <NUM>, step <NUM> may be repeated, and the method then proceeds as shown in <FIG>. At least one of the first and second values of the delay setting used in steps <NUM> and <NUM> are different in this next iteration. These one or two different values are determined based on at least one of the first and second values of the delay setting used in the previous iteration of steps <NUM> and <NUM>.

Thus, a system performing the method of <FIG> might first identify a type of audio system (that often has a known delay), and then present a user with two or more sequences of light effects with different delays and ask a user to pick one where the perceived delay was absent or shorter. This step may be repeated a few times before the user is satisfied with the result.

<FIG> illustrates the performance of the method of <FIG>. In the example of <FIG>, the audio segment <NUM> and corresponding light effects <NUM> and <NUM> shown in <FIG> are rendered. The audio segment <NUM> is rendered twice. The corresponding light effects <NUM> and <NUM> are also rendered twice with different values of the delay setting. This first value of the delay setting results in a delay <NUM> between the rendering of the audio signal <NUM> and the rendering of the light effect <NUM> and between the rendering of the audio signal <NUM> and the rendering of the light effect <NUM>.

The second value of the delay setting results in a delay <NUM> between the rendering of the audio signal <NUM> and the rendering of the light effect <NUM> and between the rendering of the audio signal <NUM> and the rendering of the light effect <NUM>. Then, in step <NUM>, the user indicates which of the two options he prefers, i.e. whether he prefers the first value of the delay setting or the second value of the delay setting. In the example of <FIG>, the user selects option <NUM>. These steps may be repeated one or more times, e.g. until the user is satisfied with the delay setting.

The embodiments of <FIG>, <FIG>, <FIG> and <FIG> differ from each other in multiple aspects, i.e. multiple steps have been added or replaced. In variations on these embodiments, only a subset of these steps is added or replaced and/or one or more steps is omitted. As a first example, step <NUM> may be omitted from the embodiment of <FIG> and steps <NUM>-<NUM> of <FIG> may be added to the embodiment of <FIG>.

<FIG> depicts a block diagram illustrating an exemplary data processing system that may perform the method as described with reference to <FIG>, <FIG>, <FIG> and <FIG>.

The data processing system may be an Internet/cloud server, for example.

Claim 1:
A system (<NUM>,<NUM>) for adjusting a delay setting based on user input, said system (<NUM>,<NUM>) comprising:
at least one input interface (<NUM>,<NUM>);
at least one control interface (<NUM>,<NUM>); and
at least one processor (<NUM>,<NUM>) configured to:
- control, via said at least one control interface (<NUM>,<NUM>), playback of an audio segment (<NUM>), said audio segment (<NUM>) being played back at a playback moment (<NUM>),
- control, via said at least one control interface (<NUM>,<NUM>), a light source (<NUM>) to render a light effect (<NUM>), said light effect (<NUM>) being rendered at a rendering moment, a difference (<NUM>) between said playback moment and said rendering moment depending on a value of said delay setting, said delay setting causing said rendering of said light effect (<NUM>) or said playback of said audio segment (<NUM>) to be delayed, characterised in that said audio segment (<NUM>) comprises a spoken description (<NUM>) of said light effect (<NUM>), and in that:
said at least one processor (<NUM>, <NUM>) is further configured to:
- receive, via said at least one input interface (<NUM>,<NUM>), said user input in response to said playback of said audio segment (<NUM>) and said rendering of said light effect (<NUM>), and
- adjust said delay setting based on said user input.