Patent Description:
<CIT> discloses a display control method, a display control device, and a computer-readable storage medium. The display control method is applied to a terminal including a first display area and a second display area with different pixel densities. The display control method includes: image texture data of the first display area is extracted; a pixel mapping is performed on the image texture data to enable the first display area and the second display area to obtain consistent visual display effects; and the image texture data of the first display area is updated to the pixel-mapped image texture data for displaying. It is thus possible to achieve consistent visual display effects of display areas with inconsistent pixel densities.

This document describes techniques and devices for motion-induced blurring to reduce scintillations and an appearance of a boundary separating regions of a display. Sensors (e.g., cameras, microphones, biometric sensors, ambient light sensors, radar sensors, and so forth) may be placed at least partially underneath regions of a display. Placing a sensor underneath a region of a display, however, often requires the region to have a reduced pixel-density (e.g., a relatively low resolution compared to other regions of the display), which can cause scintillations of the content as it moves on the display. The techniques described herein address some undesirable effects of this lower pixel-density by blurring content moving within regions of low resolution. Furthermore, the techniques can adjust an amount of blurring based on a rate or speed of the moving content. Thus, when the display includes regions of differing resolutions, the techniques described herein can blur the moving content to reduce scintillations and the appearance of a boundary separating these regions of differing resolutions.

The matter for protection is set out in the appended claims. Aspects described below include a method, system, apparatus, and means of motion-induced blurring to reduce scintillations and an appearance of a boundary separating regions of a display. The method includes receiving a first resolution of a first region of a display of a computing device. The first resolution corresponds to a first pixel-density. A second resolution of a second region of the display of the computing device is also received. The second resolution corresponds to a second pixel-density, which is lower than the first pixel-density. The method determines a speed at which content is intended to be moved on the display. This moving content within the second region is blurred based on the speed of the moving content, transforming the moving content into a blurred moving content. The blurred moving content reduces scintillations of the moving content within the second region of the display. An appearance of a boundary separating the first region and the second region of the display of the computing device is also reduced relative to an appearance of the boundary, were the moving content to remain unblurred. The blurred moving content is then displayed within the second region, and the moving content is displayed within the first region.

Apparatuses and techniques for motion-induced blurring to reduce scintillations and an appearance of a boundary separating regions of a display are described with reference to the following diagrams.

The same numbers are used throughout the drawings to reference like features and components:.

Positioning sensors underneath a display of a computing device is becoming a desirable way to increase a size of the display used to view content. Some devices use a lower pixel-density (e.g., have a lower a resolution) in regions of the display that include sensors to enable operations of those sensors. A pixel density is lower in a region, for example, to allow for light to be collected by a camera for a photograph or video. As content moves within the display, scintillations occur within regions of low resolution (e.g., lower pixel-density). These scintillations increase an appearance of a boundary separating regions of low resolution from regions of higher resolution (e.g., that do not include sensors). Scintillations can distract a user, and the appearance of the boundary can diminish the user experience.

In contrast to the techniques described herein, some devices do not display moving content in regions of low resolution, limiting the usable size of the display. Other devices display the moving content at a low resolution without blurring the moving content. These other devices permit the moving content to appear pixelated and result in scintillations that are more apparent as a rate or speed of the moving content increases. Other devices may blur the moving content by a fixed amount of blurring, which is only appropriate for specific speeds (e.g., stationary content, content that moves slow, or content that moves fast). For example, if a mobile phone includes a region with an associated fixed amount of blurring (e.g., configured for stationary content that does not move over time), and the user decides to watch an action movie on their phone, scintillations appear as the speed of content within the action movie increases. The user may become distracted by these scintillations and miss an important scene in the movie or become frustrated and watch the movie on a different device. If, instead, the fixed amount of blurring accommodates content that moves fast (e.g., at a speed of the action movie) but the user would like to read the news (e.g., stationary content), the content could be blurred too much. The user may struggle to read sentences and headlines of the news that appear within the region blurred. In this case, the user would benefit from the pixelated content and a reduced amount of blurring.

To address these challenges, this document describes a method of motion-induced blurring that reduces scintillations and an appearance of a boundary separating regions of a display. Moving content within these regions can be blurred, for example, using a smoothing filter with an adjustable weight. This weight can be adjusted based on the rate or speed of the moving content. Reference may be made herein to a speed of the moving content, which can include a velocity, an acceleration, or a rate of the moving content. The speed of the moving content may also include speeds averaged over a duration of time or instantaneous speeds of the moving content. The techniques of the motion-induced blurring can increase the amount of blurring when a speed of the moving content increases, such as the user watching an action movie. The amount of blurring can also be reduced as the speed of the content decreases, such as a slow scroll of a webpage based on a haptic input from the user.

The techniques, in some cases, refrain from applying the motion-induced blurring within regions containing resolutions lower than a resolution threshold. For example, if the resolution threshold is <NUM> pixels per inch (ppi) and a region of the display (e.g., that includes a sensor) displays the moving content at a resolution of <NUM> ppi, then the motion-induced blurring is applied to moving content within this region to improve the user experience. However, if a region (e.g., that does not include a sensor) displays the moving content at a resolution of <NUM> ppi, then the motion-induced blurring is not applied to moving content within that region.

The techniques may also refrain from applying the motion-induced blurring when the speed of the moving content is beneath a speed threshold (e.g., below a minimum speed required to perform motion-induced blurring). This enables the user to view stationary content without blurring, even within regions of low resolution. As a result, the motion-induced blurring is applied when it benefits the user most and in an amount that is appropriate for the speed of the moving content.

<FIG> illustrates an example implementation of the techniques of motion-induced blurring <NUM> of a moving content <NUM> within a second region <NUM> of a display <NUM> of a computing device <NUM>. The motion-induced blurring <NUM> is applied to the moving content <NUM> to reduce scintillations <NUM> and an appearance of a boundary <NUM>-<NUM> separating a first region <NUM> and the second region <NUM>.

While the example computing device <NUM> described in this publication is a mobile phone, other types of computing devices can also support the techniques described herein. The computing device <NUM> can include one or more processors including, for example, a central processing unit (CPU), a data processing unit (DPU), a graphics processing unit (GPU), and so forth. The computing device <NUM> can also include a computer-readable medium (CRM) that includes instructions for directing a blurring module to apply the motion-induced blurring <NUM> to the moving content <NUM> when executed by the processor(s). The computing device <NUM> can also include one or more sensors positioned at least partially underneath the display <NUM>.

The display <NUM> is configured to at least partially cover a front surface of the computing device <NUM>. In an example environment <NUM>-<NUM>, at least one sensor is positioned at least partially underneath the display <NUM> within the second region <NUM>. In general, each region can contain any number of sensors (e.g., zero, one, two, and so forth), and the computing device <NUM> can include one or more regions. Furthermore, each region can vary in size, shape, and location. For example, a size of the second region <NUM> is depicted as smaller than a size of the first region <NUM> in the example environment <NUM>-<NUM>. The display <NUM> can also include an array of pixels configured to display the moving content <NUM>. Each region can contain a pixel density associated with the array of pixels that is either distinct from or similar to another region of the display <NUM>.

In the example environment <NUM>-<NUM>, the second region <NUM> produces scintillations <NUM> as the moving content <NUM> moves between the first region <NUM> and the second region <NUM>. Scintillations <NUM> are caused by a low resolution of the second region <NUM> (e.g., a lower resolution than a resolution of the first region <NUM>) because the low resolution is configured to enable operations of the sensor. For example, a camera may be positioned at least partially underneath the display <NUM> within the second region <NUM> to increase a usable size of the display <NUM> used to view the moving content <NUM>. The camera, however, may need to collect light through the display <NUM> to produce a photograph or video. Therefore, the low resolution of the second region <NUM> (e.g., corresponding to fewer pixels per area within the second region <NUM> than the first region <NUM>) is required to prevent light from being blocked by pixels. If light is blocked by pixels, then the camera could produce distortions within the photograph or video that can frustrate the user.

These scintillations <NUM> can include distortions, artifacts, and aliasing effects of the moving content <NUM>. While the scintillations <NUM> described herein predominantly refer to content that is moving on the display <NUM>, these distortions, artifacts, and aliasing effects may affect stationary content. This stationary content may also be blurred using some of the techniques described herein (e.g., a smoothing filter with a weight). For example, a stationary image of a landscape may be blurred to reduce aliasing effects. If that stationary image then moves across the display <NUM> due to a haptic input from the user, then the techniques of motion-induced blurring <NUM> can additionally be applied to the landscape image as it moves across the display <NUM>.

To reduce scintillations <NUM> and an appearance of the boundary <NUM>-<NUM> separating the first region <NUM> and the second region <NUM>, the techniques of motion-induced blurring <NUM> are performed within the second region <NUM> on the moving content <NUM> as depicted in an example environment <NUM>-<NUM>. The moving content <NUM> refers to content received or stored on the computing device <NUM> that will move on the display <NUM> over time. For example, the moving content <NUM> can include a plurality of images that are consecutively received from a content source by the computing device <NUM> over time before being displayed consecutively on the display <NUM>. The content of these consecutive images changes over time, resulting in the content moving.

The techniques of motion-induced blurring <NUM> can utilize a bilateral filter, a smoothing technique, a Gaussian blur, nonlinear filters, wavelet transformations, statistical methods, block-matching algorithms, a machine-learned (ML) model, and so forth, where each of these techniques can include one or more weights configured to increase or decrease an amount of motion-induced blurring <NUM> applied to the moving content <NUM>. Implementation of the techniques of motion-induced blurring <NUM> are further described with respect to <FIG>.

<FIG> illustrates an example implementation of the techniques of motion-induced blurring <NUM> as part of the computing device <NUM>. The computing device <NUM> is illustrated with various non-limiting example devices, including a desktop computer <NUM>-<NUM>, a tablet <NUM>-<NUM>, a laptop <NUM>-<NUM>, a television <NUM>-<NUM>, a computing watch <NUM>-<NUM>, computing glasses <NUM>-<NUM>, a gaming system <NUM>-<NUM>, a microwave <NUM>-<NUM>, and a vehicle <NUM>-<NUM>. Other devices can also be used, including a home-service device, a smart speaker, a smart thermostat, a security camera, a baby monitor, a Wi-Fi® router, a drone, a trackpad, a drawing pad, a netbook, an e-reader, a home-automation and control system, a wall display, a virtual-reality headset, and/or another home appliance. The computing device <NUM> can be wearable, non-wearable but mobile, or relatively immobile (e.g., desktops and appliances).

The computing device <NUM> includes one or more processors <NUM> and one or more computer-readable medium (CRM) <NUM>. Applications and/or an operating system (not shown) embodied as computer-readable instructions on the CRM <NUM> are executed by the processor <NUM> and provide some of the functionalities described herein. The CRM <NUM> also includes a haptic-detection module <NUM> and a motion-detection module <NUM>. The haptic-detection module <NUM> and the motion-detection module <NUM> can be implemented using hardware, software, firmware, or a combination thereof. In this example, the processor <NUM> implements the haptic-detection module <NUM> and the motion-detection module <NUM>. Together, the haptic-detection module <NUM> and the motion-detection module <NUM> enable the processor <NUM> to process responses (e.g., input, electrical signals) from, for example, the display <NUM> and a touch sensor <NUM> to blur the moving content <NUM> to reduce scintillation <NUM> and the appearance of the boundary <NUM>-<NUM> separating regions of the display <NUM>.

The user may move or change content on the display <NUM> using a haptic input (e.g., a touch, a swipe, a scroll, a tap). To detect haptic inputs, the computing device <NUM> can include the touch sensor <NUM> that receives input from the user to change a size and/or position of the moving content <NUM>. The touch sensor <NUM> can include a capacitive touch sensor, a resistive touch sensor, surface acoustic wave (SAW) technology, an infrared touch sensor, and so forth. For example, the haptic-detection module <NUM> can detect the haptic input from the user and an associated haptic speed that influences the speed of the moving content <NUM>. The haptic-detection module <NUM> can signal the processor <NUM> to execute the techniques of motion-induced blurring <NUM> based on the haptic speed. Alternatively, the haptic speed can be detected by the operating system, the processor <NUM>, and so forth.

In another example, a speed associated with the moving content <NUM> can be determined by the motion-detection module <NUM> in the absence of the haptic input. The motion-detection module <NUM> detects changes in the moving content <NUM> over time and/or a source speed from a content source to determine a speed of the moving content <NUM>. The motion-detection module <NUM> signals the processor <NUM> to execute the techniques of motion-induced blurring <NUM> based on the speed. Alternatively, the speed can be detected by the operating system, the processor <NUM>, and so forth.

The CRM <NUM> additionally includes a blurring module <NUM> configured to receive inputs from the haptic-detection module <NUM>, the motion-detection module <NUM>, the operating system, the processor <NUM>, the touch sensor <NUM>, and so forth. These inputs can include a speed of the moving content <NUM>, a haptic speed, a source speed, a refresh speed, a minimum speed threshold, a maximum speed threshold, a resolution threshold, a resolution of a region, and so forth. The blurring module <NUM> uses these inputs to determine if motion-induced blurring <NUM> should be applied to the moving content <NUM>, how much blurring is required, and signals the processor <NUM> to apply the motion-induced blurring <NUM> to the moving content <NUM>.

The blurring module <NUM> includes the moving content <NUM> and a blur control <NUM>. In general, the moving content <NUM> can be separate from the blurring module <NUM>. The blur control <NUM> is configured to control an amount of the motion-induced blurring <NUM> applied to the moving content <NUM>. The blur control <NUM> utilizes the speed of the moving content <NUM> to determine a numerical value or function of a weight needed to adjust the amount of motion-induced blurring <NUM> applied to the moving content <NUM>. The blur control <NUM> adjusts the weight to increase or decrease an amount of the motion-induced blurring <NUM>. The motion-induced blurring <NUM> can include smoothing of the moving content <NUM>, reducing an intensity associated with features (e.g., details) of the moving content <NUM>, averaging pixel intensities of the moving content <NUM> based on nearby pixel intensities, and so forth.

The computing device <NUM> includes one or more sensors <NUM> positioned at least partially underneath the display <NUM>. The sensor <NUM> can be positioned in any region, and a resolution (e.g., pixel density) associated with a region containing a sensor <NUM> can have a lower pixel-density to enable operations of the sensor <NUM>. While use of a sensor positioned underneath a display is often why one portion of a display will have a lower resolution than another, the techniques described herein can be used with any display having varying resolutions; an under-display sensor is not required for the techniques to be used. The techniques of motion-induced blurring <NUM> are further described with respect to <FIG>.

<FIG> depicts an example cross-sectional view of the display <NUM> of the computing device <NUM> from <FIG>. The display <NUM> is depicted with a transparent layer <NUM> (e.g., comprising a transparent material such as plastic or glass) positioned above a pixel layer <NUM> (e.g., comprising the array of pixels).

In general, the display <NUM> can include an active area, one or more organic layers (e.g., emitting layer, emissive layer, an array of organic light-emitting diodes), a cathode, an anode, and so forth. The display <NUM> can further include an active-matrix organic light-emitting diode (AMOLED) display, organic light-emitting diode (OLED) display modules, light-emitting diode (LED) display modules, liquid crystal display (LCD) display modules, microLED display modules, display technologies with individually controllable pixels, thin-film technology display modules, and so forth.

In the example environment <NUM>, the first region <NUM> does not include a sensor; the second region <NUM> includes a sensor <NUM> positioned at least partially underneath the display <NUM> and at least partially within the second region <NUM>. The sensor <NUM> can include, for example, a camera, a microphone, a speaker, an ambient light sensor, a biometric sensor, an accelerometer, a gyroscope, a magnetometer, a proximity sensor, a global positioning system (GPS), a touchscreen sensor, a health sensor, a barcode or quick response (QR) code sensor, a barometer, a radar sensor and so forth.

The first region <NUM> includes a first pixel-density <NUM>, and the second region <NUM> includes a second pixel-density <NUM>. To enable operations of the sensor <NUM>, the second pixel-density <NUM> is lower than the first pixel-density <NUM> (e.g., contains fewer pixels per area). The first pixel-density <NUM> is associated with a first resolution, and the second pixel-density <NUM> is associated with a second resolution, where the second resolution is lower than the first resolution. To enable discussions herein, the second resolution comprises a low resolution and the second pixel-density <NUM> comprises a low pixel-density, when compared to the first resolution and the first pixel-density <NUM>, respectively.

The pixel layer <NUM>, including the first pixel-density <NUM> and the second pixel-density <NUM>, includes color pixels (e.g., red, green, blue (RGB) pixels). These color pixels enable the moving content <NUM> to be viewed on the display <NUM> in color. Regions of low resolution include a low density of color pixels (e.g., fewer color pixels per area relative to other, higherresolution regions). In the second region <NUM>, the second resolution includes a low resolution to enable operations of the sensor <NUM>. As the density of color pixels decreases, color defects (e.g., scintillations <NUM>, color distortions) become more apparent to the user. For example, a low resolution of the second region <NUM> can cause color defects in an action movie. Since the user has an expectation of what a moving car or a person's face looks like, color defects associated with the moving car or person's face can be noticed by the user. To reduce these color defects, the blurring module <NUM> applies the motion-induced blurring <NUM> within the second region <NUM> to blur the action movie and improve the user experience.

The computing device <NUM> can refrain from instructing a processor to apply the motion-induced blurring <NUM> to the moving content <NUM> unless a resolution of a region is lower than a resolution threshold. The resolution threshold includes a minimum resolution corresponding to a minimum pixel-density required for the motion-induced blurring <NUM> to be applied to the moving content <NUM>. If a region contains fewer pixels per area than a prescribed amount of pixels per area, corresponding with the minimum resolution, then the blurring module <NUM> signals a processor to apply the motion-induced blurring <NUM>. For example, the first resolution is high (e.g., contains greater pixels per area than the prescribed amount of pixels per area), enabling the moving content <NUM> to be displayed without scintillations <NUM>. In this example, the first region <NUM> does not need the motion-induced blurring <NUM> applied, and the moving content <NUM> is displayed normally.

If, however, the second resolution is lower (e.g., contains fewer pixels per area than the prescribed amount of pixels per area), causing scintillations <NUM> of the moving content <NUM>, then the motion-induced blurring <NUM> would be applied within the second region <NUM>. In an example, if the resolution threshold is <NUM> pixels per inch (ppi) and the second resolution is <NUM> ppi, then the blurring module <NUM> signals a processor to apply the motion-induced blurring <NUM> within the second region <NUM>. If the first resolution is <NUM> ppi, then the blurring module <NUM> refrains from applying the motion-induced blurring <NUM> within the first region <NUM>.

Before the moving content <NUM> is displayed on the computing device <NUM>, the moving content <NUM> may need to be resampled to conform to the first resolution and second resolution. The moving content <NUM> can be supplied to the computing device <NUM> by a content source (e.g., a webpage, a receiver, stored content, an application, and so forth) with a resolution set by the content source (e.g., a source resolution). The blurring module <NUM> receives the source resolution and compares it to the first resolution and the second resolution.

If the first resolution is different from the source resolution, then the moving content <NUM> is resampled to conform to the first resolution within the first region <NUM>. For example, if the source resolution is <NUM> ppi but the first resolution is <NUM> ppi, then the moving content <NUM> is resampled from <NUM> ppi to <NUM> ppi. The resampling can include mathematical calculations or assumptions of how to change the source resolution to conform to the first resolution. Similarly, if the second resolution is different from the source resolution, then the moving content <NUM> is resampled to conform to the second resolution within the second region <NUM>. The moving content <NUM> can be resampled either before or after the motion-induced blurring <NUM> has been applied to the moving content <NUM>.

<FIG> illustrates an example sequence flow diagram of scintillations <NUM> and motion-induced blurring <NUM> of the moving content <NUM> over time <NUM>. The moving content <NUM> is moving from the first region <NUM> to the second region <NUM> and over the boundary <NUM>-<NUM> as time <NUM> progresses from left to right. In example environments <NUM>-<NUM>, <NUM>-<NUM>, and <NUM>-<NUM>, the moving content <NUM> appears pixelated and causes scintillations <NUM> within the second region <NUM> due to the speed of the moving content <NUM> and the second resolution, which is lower than the resolution threshold. To reduce these scintillations <NUM> within the second region <NUM>, the blurring module <NUM> signals a processor to apply the motion-induced blurring <NUM> to the moving content <NUM> before being displayed (e.g., to each consecutive image to be displayed over time <NUM>), as depicted in example environments <NUM>-<NUM>, <NUM>-<NUM>, and <NUM>-<NUM>. In this example, the blurring module <NUM> refrains from signaling a processor to apply the motion-induced blurring <NUM> to the moving content <NUM> within the first region <NUM> because the first resolution is greater than the resolution threshold.

To apply the motion-induced blurring <NUM>, the blurring module <NUM> first detects a speed of the moving content <NUM>. The speed refers to a speed at which the content would change or move when later displayed on the display <NUM> of the computing device <NUM>. For example, the speed in <FIG> correlates with a changing position of the moving content <NUM> over time <NUM> (e.g., <NUM>-<NUM>, <NUM>-<NUM>, and <NUM>-<NUM>). The moving content <NUM> moves upwards on the display <NUM> due to the speed native of the content.

The blurring module <NUM> can refrain from signaling a processor to apply the motion-induced blurring <NUM> unless the speed of the moving content <NUM> exceeds a minimum speed threshold (e.g., a minimum speed required to apply the motion-induced blurring <NUM>). Furthermore, the minimum speed threshold corresponds to a minimum speed required of the moving content <NUM> for scintillations <NUM> to become apparent to the user. For example, scintillations <NUM> are not apparent if the moving content <NUM> is stationary. Reference may be made herein to a minimum speed threshold, which can also include a minimum rate (e.g., change measured over time), minimum velocity, and minimum acceleration required to apply the motion-induced blurring <NUM>. The minimum speed threshold may also include instantaneous speeds, velocities, accelerations, and rates of the moving content and speeds, velocities, accelerations, and rates that are averaged over a duration of time. However, the scintillations <NUM> become apparent as the speed of the moving content <NUM> increases (e.g., for an action movie).

In another example, the minimum speed threshold is based on a rate of <NUM> hertz (Hz), and the moving content <NUM> is changing within the second region <NUM> at a speed of <NUM>. The blurring module <NUM> receives input of this speed of <NUM> and compares it to the minimum speed threshold of <NUM>. Since this speed is lower than the minimum speed threshold, the blurring module <NUM> refrains from signaling a processor to blur the moving content <NUM> and, instead, signals a processor to display the moving content <NUM> normally (e.g., without the motion-induced blurring <NUM> applied). The minimum speed threshold prevents slow-moving content (e.g., content moving at a speed below the minimum speed threshold) and stationary content from being blurred. In these situations, the user may prefer pixelated content over blurred content. If instead, the speed of the moving content <NUM> is <NUM>, then the blurring module <NUM> receives input of this speed of <NUM> and compares it to the minimum speed threshold of <NUM>. Since this speed of <NUM> is greater than the minimum speed threshold, the motion-induced blurring <NUM> is applied to the moving content <NUM> within the second region <NUM>. An amount of motion-induced blurring <NUM> applied to the moving content <NUM> can be adjusted based on the speed using the blur control <NUM> as further described in <FIG>.

<FIG> illustrates two example techniques of motion-induced blurring <NUM> of the moving content <NUM> based on the speed. If the speed is greater than the minimum speed threshold, then the moving content <NUM> can be blurred by an amount associated with the speed using the blur control <NUM>. As the speed of the moving content <NUM> increases, an amount of motion-induced blurring <NUM> applied to the moving content <NUM> can increase to reduce scintillations <NUM> and an appearance of the boundary <NUM>-<NUM> separating the first region <NUM> and the second region <NUM>. Similarly, as the speed of the moving content <NUM> decreases, an amount of motion-induced blurring <NUM> applied to the moving content <NUM> can decrease.

In <FIG>, the moving content <NUM> is moving upwards within the display <NUM> over time <NUM>, from the first region <NUM> to the second region <NUM> and over the boundary <NUM>-<NUM>. Example environments <NUM>-<NUM>, <NUM>-<NUM>, and <NUM>-<NUM> depict a first speed <NUM>, and example environments <NUM>-<NUM>, <NUM>-<NUM>, and <NUM>-<NUM> depict a second speed <NUM>. The first speed <NUM> is depicted slower than the second speed <NUM>. Therefore, the moving content <NUM> in the example environments <NUM>-<NUM>, <NUM>-<NUM>, and <NUM>-<NUM> is blurred less than the moving content <NUM> in the example environments <NUM>-<NUM>, <NUM>-<NUM>, and <NUM>-<NUM>. The amount of motion-induced blurring <NUM> applied to the moving content <NUM> can be linearly or nonlinearly correlated with the speed of the moving content <NUM>. For example, the amount of blurring can relate to the speed proportionally, with an optional offset included. Alternatively, the amount of blurring can relate to the speed using a nonlinear function, operation, or set of operations.

The blur control <NUM> can fix the amount of motion-induced blurring <NUM> at a constant amount (e.g., a static value) if the speed increases above a maximum speed threshold (e.g., a maximum speed permitted by the blurring module <NUM>). If the blurring module <NUM> receives input of the speed of the moving content <NUM> and determines that it is greater than the maximum speed threshold, then a constant amount of the motion-induced blurring <NUM> is applied to the moving content <NUM>. Reference may be made herein to a maximum speed threshold, which can also include a maximum rate (e.g., change measured over time), maximum velocity, and maximum acceleration permitted by the blurring module <NUM>. The maximum speed threshold may also include instantaneous speeds, velocities, accelerations, and rates of the moving content and speeds, velocities, accelerations, and rates that are averaged over a duration of time. For example, if the maximum speed threshold is set based on a rate of <NUM> and the moving content <NUM> includes a speed of <NUM> (e.g., rate to be displayed), the amount of motion-induced blurring <NUM> applied will be held at a constant amount associated with the maximum speed threshold of <NUM>. In this example, if the speed increases above <NUM> or decreases below <NUM> but still above <NUM>, the amount of motion-induced blurring <NUM> applied to the moving content <NUM> will remain constant.

The moving content <NUM> contains a plurality of images that are consecutively received by the computing device <NUM> over time <NUM> before being displayed consecutively on the display <NUM>. For example, environments <NUM>-<NUM>, <NUM>-<NUM>, and <NUM>-<NUM> represent three consecutive images of the moving content <NUM>. The content source can configure the consecutive images to be displayed at a specific speed (e.g., a source speed). Reference may be made herein to a source speed, which can also include a source rate (e.g., change measured over time), source velocity, and source acceleration. The source speed may also include instantaneous speeds, velocities, accelerations, and rates as configured by the content source and speeds, velocities, accelerations, and rates that are averaged over a duration of time.

The speed of the moving content <NUM> can be received by the blurring module <NUM> based on changes that occur between consecutive images received from the content source. These changes include, for example, a change in color, position, or size of the moving content <NUM> based on the source speed. The blur control <NUM> can change the amount of motion-induced blurring <NUM> applied to the moving content <NUM> based on the speed. As the moving content <NUM> changes more often, the amount of blurring can increase. As the moving content <NUM> changes less often, the amount of blurring can decrease.

In an example, if the user is watching a video on the display <NUM> that depicts a landscape changing slowly (e.g., changing less often over time <NUM>), the amount of motion-induced blurring <NUM> applied can decrease to accommodate the slow speed (e.g., reduced changes) associated with the landscape. However, if the video later features a high-speed car chase with fast changes (e.g., occurring more often over time <NUM>), the amount of motion-induced blurring <NUM> applied can increase to accommodate the fast speed (e.g., increased changes) associated with the high-speed car chase.

The speed of the moving content <NUM> can be additionally associated with the source speed as configured by the content source. As the source speed increases, the speed and an amount of motion-induced blurring <NUM> applied to the moving content <NUM> can increase to reduce scintillations <NUM>. As the source speed decreases, the speed can decrease along with an amount of motion-induced blurring <NUM> applied. Additional techniques for determining the speed of the moving content <NUM> are further discussed with respect to <FIG> and <FIG>. Any of the techniques described herein may be used, and in any combination, to determine if the techniques of motion-induced blurring <NUM> are required within a region to improve the user experience.

<FIG> illustrates an example haptic input <NUM> from a user <NUM> that changes a size and/or position of the moving content <NUM>. The haptic input <NUM> is performed by the user <NUM> making a contact <NUM> with the display <NUM>. The contact <NUM> can include a touch, a swipe, a pinch, a flick, a tap, a scroll, and so forth using one or more fingers of the user <NUM>. In example environments <NUM>-<NUM> and <NUM>-<NUM>, the moving content <NUM> is enlarged on the display <NUM> using a contact <NUM> (e.g., a pinch touch) of the user <NUM>. The computing device <NUM> can include a touch sensor <NUM> (e.g., a capacitive touch sensor, a resistive touch sensor, surface acoustic wave (SAW) technology, an infrared touch sensor, and so forth) configured to enable detection of the haptic input <NUM>.

A speed associated with the contact <NUM> (e.g., a haptic speed) of the haptic input <NUM> can be received by the blurring module <NUM>. The haptic speed of the haptic input <NUM> can influence an amount of the motion-induced blurring <NUM> applied to the moving content <NUM> as depicted in <FIG>. As the haptic speed increases, the speed of the moving content <NUM> and the amount of motion-induced blurring <NUM> applied to the moving content <NUM> can increase. As the haptic speed decreases, the speed of the moving content <NUM> and the amount of motion-induced blurring <NUM> applied can decrease. Reference may be made herein to a haptic speed which can also include a haptic rate (e.g., change measured over time due to the haptic input <NUM>), haptic velocity, and haptic acceleration. The haptic speed may also include instantaneous speeds, velocities, accelerations, and rates of the haptic input <NUM> and speeds, velocities, accelerations, and rates that are averaged over a duration of time.

<FIG> illustrates two examples of the blurring module <NUM> signaling a processor to apply the motion-induced blurring <NUM> to the moving content <NUM> based on the haptic speed. In these examples, the user <NUM> is changing a size of the moving content <NUM> (e.g., enlarging the size) at different haptic speeds using a pinch contact. A first haptic speed <NUM> associated with example environments <NUM>-<NUM>, <NUM>-<NUM>, and <NUM>-<NUM> is slower than a second haptic speed <NUM> associated with example environments <NUM>-<NUM>, <NUM>-<NUM>, and <NUM>-<NUM>. A greater amount of the motion-induced blurring <NUM> is applied to example environments <NUM>-<NUM>, <NUM>-<NUM>, and <NUM>-<NUM> than example environments <NUM>-<NUM>, <NUM>-<NUM>, and <NUM>-<NUM>, because the second haptic speed <NUM> is faster than the first haptic speed <NUM>.

The blurring module <NUM> can additionally receive a refresh speed that sets a limit on how fast consecutive images of the moving content <NUM> can be displayed. In this case, the maximum speed threshold can be set at the refresh speed. Reference may be made herein to a refresh speed, which can also include a refresh rate (e.g., change measured over time), refresh velocity, and refresh acceleration. The refresh speed may also include instantaneous speeds, velocities, accelerations, and rates at which content is refreshed and speeds, velocities, accelerations, and rates that are averaged over a duration of time.

For example, if the refresh speed is based on a rate of <NUM>, then the maximum speed threshold is set at <NUM>. If the haptic speed is based on a rate of <NUM> (e.g., due to a fast swipe or fast scroll input), the amount of motion-induced blurring <NUM> applied to the moving content <NUM> can be fixed at a constant amount associated with <NUM> by the blur control <NUM>. If the source speed is based on a rate of <NUM> (e.g., due to a fast video), the amount of motion-induced blurring <NUM> applied to the moving content <NUM> can again be fixed at the constant amount associated with <NUM> by the blur control <NUM>.

The blur control <NUM> can additionally include a smoothing filter. For example, the smoothing filter can include a bilateral filter (e.g., a nonlinear filter) used to smooth a profile of the moving content <NUM>. In this example, the bilateral filter can replace a pixel intensity associated with each distinct pixel of the pixel layer <NUM> with an average of nearby pixel intensities. The smoothing filter can also include a Gaussian blur, nonlinear filters, wavelet transformations, statistical methods, block-matching algorithms, and so forth. The smoothing filter can utilize an ML model, for example, to adjust the blur control <NUM> based on a history of the moving content <NUM> to improve a user experience.

<FIG> illustrates an example plot of how a pixel intensity <NUM> profile of the moving content <NUM> is modified by the smoothing filter. In this example, the pixel intensity <NUM> associated with the moving content <NUM> varies over a distance <NUM> (e.g., across the second region <NUM> of the display <NUM>). The pixel intensity <NUM> of the moving content <NUM> appears more chaotic and less smooth over the distance <NUM> due to scintillations <NUM>.

The smoothing filter can smooth (e.g., average) the pixel intensity <NUM> of the moving content <NUM> using a weight. The weight can represent a numerical value or function that changes depending on the speed of the moving content <NUM>. As the speed increases, the numerical value or function of the weight changes to increase the amount of motion-induced blurring <NUM> applied to the moving content <NUM>. As the speed decreases, the numerical value or function of the weight changes to decrease the amount of motion-induced blurring <NUM>.

In the example plot <NUM>, two distinct smoothing filters <NUM>-<NUM> and <NUM>-<NUM> are applied to the moving content <NUM>. The smoothing filter <NUM>-<NUM> uses a different weight from the smoothing filter <NUM>-<NUM> to increase an amount of the motion-induced blurring <NUM> applied to the moving content <NUM>. The pixel intensity <NUM> associated with the smoothing filter <NUM>-<NUM> is smoother over distance <NUM>, representing an increase in the averaging of nearby pixel intensities (e.g., over a larger distance <NUM>), than the smoothing filter <NUM>-<NUM>. Further variations of the techniques of motion-induced blurring <NUM> are described with respect to <FIG>.

<FIG> illustrates an example computing device <NUM> that includes the first region <NUM>, the second region <NUM>, and a third region <NUM> of the display <NUM>. The third region <NUM> includes a third resolution (e.g., a third pixel-density) that is either different from or similar to another region. The third region <NUM> can also include one or more sensors <NUM> placed at least partially underneath the display <NUM> and within the third region <NUM>. The size, shape, and position of the third region <NUM> can vary within the display <NUM>.

Similar to techniques performed within the second region <NUM>, the blurring module <NUM> can signal a processor to apply the motion-induced blurring <NUM> within the third region <NUM> based on the speed of the moving content <NUM> to reduce scintillations of the moving content <NUM> within the third region <NUM> and the appearance of the boundary <NUM>-<NUM> separating the third region <NUM> from the first region <NUM>, relative to an appearance of the boundary <NUM>-<NUM> when the blurring module <NUM> refrains from signaling a processor to blur the moving content <NUM>. An appearance of the boundary <NUM>-<NUM> separating the third region <NUM> from the second region <NUM> (not depicted) can also be reduced using the blurring module <NUM>. The speed of the moving content <NUM> in third region <NUM> can be different from, or similar to, the speed within the second region <NUM> and first region <NUM>. Furthermore, the amount of blurring in the third region <NUM> can be different from, or similar to, any other region of the display <NUM>.

<FIG> depicts an example method <NUM> for motion-induced blurring to reduce scintillations and an appearance of a boundary separating regions of a display. Method <NUM> is shown as sets of operations (or acts) performed and is not necessarily limited to the order or combinations in which the operations are shown herein. Furthermore, any of one or more of the operations can be repeated, combined, reorganized, or linked to provide a wide array of additional and/or alternative methods. In portions of the following discussion, reference may be made to environments and entities detailed in <FIG>, reference to which is made for example only. The techniques are not limited to performance by one entity or multiple entities operating on one computing device <NUM>.

At <NUM>, a first resolution of a first region of a display of the computing device is received, where the first resolution corresponds to a first pixel-density. For example, the blurring module <NUM> receives the first resolution of the first region <NUM> of the display <NUM>, and the first resolution corresponds to the first pixel-density <NUM>, as shown in <FIG>, <FIG>, and <FIG>. The size, shape, and location of the first region <NUM> can vary.

At <NUM>, a second resolution of a second region of the display of the computing device is received. The second resolution corresponds to a second pixel-density and the second pixel-density is lower than the first pixel-density. For example, the blurring module <NUM> receives the second resolution of the second region <NUM> of the display <NUM>. The second resolution corresponds to the second pixel-density <NUM> and is lower than the first pixel-density <NUM>.

At <NUM>, a speed at which moving content is intended to be moved in the display is determined. For example, a speed at which the moving content <NUM> is intended to be moved in the display <NUM> is received by the blurring module <NUM>, as illustrated in <FIG>.

At <NUM>, the moving content is blurred within the second region based on the speed of the moving content to transform the moving content into a blurred moving content. The blurred moving content is configured to reduce scintillation of the moving content within the second region and an appearance of a boundary separating the first region and the second region of the display of the computing device relative to an appearance of the boundary with the moving content. For example, the moving content <NUM> within the second region <NUM> is blurred using the blurring module <NUM> to transform the moving content <NUM> into a blurred moving content by applying the motion-induced blurring <NUM> to the moving content <NUM> as illustrated in <FIG> and <FIG>. The motion-induced blurring <NUM> is applied to the moving content <NUM> based on the speed to produce the blurred moving content, as illustrated in <FIG> and <FIG>. Scintillations <NUM> of the moving content <NUM> are reduced within the second region <NUM>. An appearance of the boundary <NUM>-<NUM> separating the first region <NUM> and the second region <NUM> of the display <NUM> of the computing device <NUM> is reduced, relative to an appearance of the boundary <NUM>-<NUM> when the blurring module <NUM> refrains from signaling a processor to blur and, instead, signals a processor to display the moving content <NUM> normally.

At <NUM>, the blurred moving content is displayed within the second region. For example, the moving content <NUM>, with the motion-induced blurring <NUM> applied, is displayed within the second region <NUM> as shown in environment <NUM>-<NUM> of <FIG>.

At <NUM>, the moving content is displayed within the first region. For example, the moving content <NUM>, without the motion-induced blurring <NUM> applied, is displayed within the first region <NUM> as shown in environment <NUM>-<NUM> of <FIG>.

<FIG> illustrates an example computing system <NUM> embodying, or in which techniques can be implemented that enable use of, the techniques of motion-induced blurring <NUM> to reduce scintillations <NUM> and the appearance of the boundary <NUM>-<NUM> (or <NUM>-<NUM>) separating regions of the display <NUM>. The example computing system <NUM> can be implemented as any type of client, server, and/or computing device as described with reference to <FIG>.

The computing system <NUM> can include device data <NUM> (e.g., received data, data that is being received, data scheduled for broadcast, or data packets of the data), the blurring module <NUM>, and one or more sensors <NUM>. The device data <NUM> or other device content can include configuration settings of the device, media content stored on the device, and/or information associated with the user <NUM> of the device. Media content stored on the computing system <NUM> can include any type of audio, video, and/or image data. The computing system <NUM> can include one or more data inputs <NUM> by which any type of data, media content, and/or inputs can be received, including contacts <NUM> associated with the haptic input <NUM>, user-selectable inputs (explicit or implicit), messages, music, television media content, recorded video content, and any other type of audio, video, and/or image data received from any content and/or data source.

The computing system <NUM> can also include communication interfaces <NUM>, which can be implemented as any one or more of a serial and/or parallel interface, a wireless interface, any type of network interface, a modem, and any other type of communication interface. The communication interfaces <NUM> provide a connection and/or communication links between the computing system <NUM> and a communication network by which other electronic, computing, and communication devices communicate data with the computing system <NUM>.

The computing system <NUM> can include one or more processors <NUM> (e.g., any of microprocessors, controllers, and the like), which process various computer-executable instructions to control the operation of the computing system <NUM> and to enable techniques for, or in which can be embodied, the motion-induced blurring <NUM>. Alternatively or in addition, the computing system <NUM> can be implemented with any one or combination of hardware, firmware, or fixed logic circuitry that is implemented in connection with processing and control circuits, which are generally identified at <NUM>. Although not shown, the computing system <NUM> can include a system bus or data transfer system that couples the various components within the device. A system bus can include any one or combination of different bus structures, including a memory bus or memory controller, a peripheral bus, a universal serial bus, and/or a processor or local bus that utilizes any of a variety of bus architectures.

The computing system <NUM> can additionally include computer-readable media <NUM>, including one or more memory devices that enable persistent and/or non-transitory data storage (i.e., in contrast to mere signal transmission), examples of which include random access memory (RAM), non-volatile memory (e.g., any one or more of a read-only memory (ROM), flash memory, EPROM, EEPROM, and so forth), and a disk storage device. The disk storage device can be implemented as any type of magnetic or optical storage device, including a hard disk drive, a recordable and/or rewriteable compact disc (CD), any type of a digital versatile disc (DVD), and the like. The computing system <NUM> can also include a mass storage media device (storage media) <NUM>.

Claim 1:
A method (<NUM>) for motion-induced blurring (<NUM>) comprising:
receiving (<NUM>) a first resolution of a first region (<NUM>) of a display (<NUM>) of a computing device (<NUM>), the first resolution corresponding to a first pixel-density (<NUM>);
receiving (<NUM>) a second resolution of a second region (<NUM>) of the display of the computing device, the second resolution corresponding to a second pixel-density (<NUM>), the second pixel-density lower than the first pixel-density;
determining (<NUM>) a speed at which moving content (<NUM>) is intended to be moved in the display;
blurring (<NUM>) a moving content within the second region based on the speed, the blurring configured to transform the moving content into a blurred moving content, the blurred moving content reducing scintillation (<NUM>) of the moving content within the second region and an appearance of a boundary (<NUM>-<NUM>) separating the first region and the second region of the display of the computing device relative to an appearance of the boundary with the moving content;
displaying (<NUM>) the blurred moving content within the second region; and
displaying (<NUM>) the moving content within the first region.