Method, apparatus and system to determine display misalignment

Techniques and mechanisms for determining misalignment of one or more tileable display panels. In an embodiment, a plurality of images are processed to create a super-resolution image of the one or more tileable display panels. The super-resolution image may be processed to recognize one or more features indicating misalignment in a reference image displayed by the one or more tileable display panels. In another embodiment, the one or more features are evaluated based on fiducial data to generate a signal indicating an adjustment to be made to a first tileable display panel.

BACKGROUND

1. Technical Field

This disclosure relates generally to displays, and in particular but not exclusively, relates to tiling displays.

2. Background Art

Large wall displays can be prohibitively expensive as the cost to manufacture display panels rises exponentially with display area. This rise in cost results from the increased complexity of large monolithic displays, the decrease in yields associated with large displays (a greater number of components must be defect free for large displays), and increased shipping, delivery, and setup costs. Tiling smaller display panels to form larger multi-panel displays can help reduce many of the costs associated with large monolithic displays.

While conventional multi-panel displays can reduce costs, visually they tend to have a major drawback. For example, a conventional display panel includes a bezel around its periphery. A bezel is a mechanical structure that houses a pixel region in which the display's pixels are disposed. In recent years, manufactures have reduced the thickness of bezels considerably to less than 2 mm. However, even these thin bezel trims are still very noticeable to the naked eye, distract the viewer, and otherwise detract from the overall visual experience.

Various approaches for obtaining seamless displays are being developed, including display lensing, blended projection, stackable display cubes, and LED tiles, However, as successive generations of display technologies continue to improve the quality of image display at the edge-to-edge interfaces of display devices, there is an increasing need for accuracy in the alignment between assembled display devices. Furthermore, continuing improvements in the size and resolution of display devices are resulting in an increasing need for accuracy in the alignment between components of an individual display device. For at least these reasons, there is expected to be an increasing need to provide efficient solutions for providing and/or maintaining alignment of multi-panel display assemblies.

DETAILED DESCRIPTION

Embodiments discussed herein variously provide for the determining of misalignment for one or more display panels. At some point in time during or after the mounting of an assembly of such display panels, two adjoining displays typically have some misalignment, however slight. For example, misalignment as small as approximately one-quarter (¼) of a pixel size between adjoining displays may cause visible image artifacts such as color banding, jagged lines, etc. Alternatively or in addition, process variation in the fabrication and/or assembly of display components may result in misalignment between adjoining sub-images displayed by a single display panel.

Certain embodiments include performing super-resolution calculations to create a super-resolution image based on a plurality of comparatively low-resolution images of only one single display panel or an assembly of display panels. The super-resolution image may be subsequently evaluated—e.g. based on fiducial information describing a reference image displayed by the assembly during a capturing of the plurality of images. As a result of such evaluation, misalignment information may be provided to quantify a misalignment within a single display panel and/or between different display panels, which in turn may be adjusted to improve display alignment.

Certain embodiments are discussed herein in the context of misalignment of an assembly of tileable display panels which each include mechanisms to project magnified sub-images on respective screen layer structures. However, certain embodiments are not limited in this regard, and such discussion may be extended to additionally or alternatively apply to misalignment for any of a variety of other types of one or more display panels.

FIG. 1is an illustration of a tileable display panel according to an embodiment. In this embodiment, tileable display panel100includes display layer120disposed between screen layer110and illumination layer130, which includes light sources131,132,133,134,135, and136configured in a two-dimensional (2D) array.FIG. 1shows that each light source in illumination layer130illuminates a corresponding array of transmissive pixels (referred to herein as a “pixelet” and described further below) to project a plurality of image sub-portions onto the backside of screen layer110so that the screen layer displays a unified image.

In one embodiment, each of light sources131-136of illumination layer130is a laser. In one embodiment, each light source is a light-emitting-diode (“LED”) that emits light from a relatively small emission aperture. For example, LEDs with an emission aperture of 150-300 microns may be used. The LED may emit display light (e.g., white display light, blue display light, or any laser light). Each of light sources131-136is configured to emit its display light at a limited angular spread so the display light is directed toward a specific pixelet in display layer120(described further below). In one embodiment, additional optics are disposed over the light source in the array of light sources to define the limited angular spread of the display light emitted from the light sources. The additional optics may also increase brightness uniformity of the display light propagating toward the pixelets.

Display layer120is illustrated to include pixelets121,122,123,124,125, and126configured as a matrix (i.e., a 2D array). The pixelets may be liquid-crystal-displays (“LCDs”)—e.g., color LCDs or monochromatic LCDs. Where the pixelets are LCDs, a micro-lens in the pixel may not be needed. In one embodiment, each pixelet measures 20×20 mm.

Pixelets121-126are shown to be configured in a 2×3 matrix in this embodiment. The pitch between each pixelet in the matrix may be the same. In other words, the distance between a center of one pixelet and the center of its adjacent pixelets may be the same distance. In the illustrated embodiment, each light source in illumination layer130has a one-to-one correspondence with a pixelet. For example, light source131corresponds to pixelet121, light source132corresponds to pixelet122, light source133corresponds to pixelet123, and so on. Also in the illustrated embodiment, each light source is centered under its respective corresponding pixelet. Other embodiments may have a different light source-to-pixelet correspondence, or different light source positioning.

Display layer120also includes spacing regions128surrounding pixelets121-126. Pixelet126is illustrated to be adjacent to pixelet123and125. Pixelet126is spaced by dimension162from pixelet125and spaced by dimension164from pixelet123. Dimensions162and164may be considered “internal spacing” and may comprise the same distance in some embodiments. Pixelet126is also spaced by dimensions161and163from edges of display layer120. Dimensions161and163may be considered “external spacing” and are the same distance, in some embodiments. In one embodiment, dimensions161and163are half of the distance as dimensions162and164. In one example, dimensions161and163are both 2 mm and dimensions162and164are both 4 mm.

Spacing region128contains a backplane region that may include pixel logic for driving the pixels in the pixelets. The architecture of tileable display panel100may increase space for additional circuitry in the backplane region. In one embodiment, the backplane region is used for memory-in-pixel logic. This memory may be used to allow each pixel to be refreshed individually instead of refreshing each pixel in a row at every refresh interval (e.g. 60 frames per second). In one embodiment, the backplane region is used for additional image processing.

While tileable display panel100may be used in high-resolution large format displays, the additional image processing capacity may also be useful for image signal processing, for example dividing an image into image sub-portions that are displayed by the pixelets. In another embodiment, the backplane region is used to embed image sensors. In one embodiment, the backplane region includes infrared image sensors for sensing three-dimensional 3D scene data in the display apparatus' environment.

In operation, display light from a light source (e.g. light source131) propagates toward its corresponding pixelet (e.g. pixelet121). Each pixelet drives their pixels to display an image sub-portion (i.e., a portion of a unified image to be displayed by tileable display panel100) on the pixelet so the display light that propagates through the pixelet includes the image sub-portion displayed by the pixelet. Since the light source generates the display light from a small aperture and the display light has an angular spread, the image sub-portion in the display light gets larger as it gets further away from the pixelet. Therefore, when the display light (including the image sub-portion) encounters screen layer110, a magnified version of the image sub-portion is projected onto a backside of screen layer110.

Screen layer110is offset from pixelets121-126by distance166to allow the image sub-portions to become larger as the display light propagates further from the pixelet that drove the image sub-portion. Therefore, distance166may be a fixed distance selected to configure the size of the magnification of the image sub-portions. In one embodiment, fixed distance166is 2 mm. In one embodiment, each image sub-portion generated by pixelets121-126is magnified by 1.5×.

The backside of screen layer110is opposite viewing side112. Screen layer110may be made of a diffusion screen that presents the unified image on viewing side112of screen layer110by scattering the display light (that includes the image sub-portions) from each of the pixelets121-126. Screen layer110may be similar to those used in rear-projection systems. Screen layer110may have local dimming capabilities independent of light sources131-136.

FIG. 2is a transparent illustration of a tileable display panel according to an embodiment.FIG. 2illustrates tileable display panel100looking through screen layer110to display layer120.FIG. 2shows how tileable display panel100can generate a unified image200using the magnified image sub-portions (e.g. image sub-portion214) generated by light sources131-136and their corresponding pixelets121-126. In this illustration, pixelet124generates image sub-portion204that is projected (using the display light from light source134) on screen layer110as magnified image sub-portion214. Although not illustrated, each of pixelets121,122,123,125, and126can also project a magnified image sub-portion onto screen layer110that is the same size as magnified image sub-portion214. Those five magnified image sub-portions combined with magnified image sub-portion214combine to form unified image200. In some embodiments, the geometric alignment of the magnified image sub-portions may leave virtually no gap (if any) such that unified image200is perceived as seamless by a viewer.

InFIG. 2, the magnified image sub-portions are illustrated to be roughly the same size and are similarly square-shaped. In other embodiments, said magnified image sub-portions may comprise any shape, any size, and in any combination. To generate same sized magnified image sub-portions, display layer120and pixelets121-126may be offset from light sources131-136by fixed dimension165(as shown inFIG. 1). In one embodiment, dimension165is 8 mm.

The device architecture of tileable display panel100may further allow for controlling the brightness of light sources131-136—e.g. based on the image/video content of the corresponding image sub-portions. Each pair of pixelets121-126and light sources131-136are independent of each other, and in some embodiments, light from one pair of pixelet and light source (e.g., pixelet125and light source125) does not leak into any of its neighboring pairs (e.g., pixelet and light source pairs124/134,126/136and122/132). Dynamically varying the brightness level of light sources131-136based on the image/video content of the corresponding image sub-portions allows for improved contrast in unified image200and a reduced power consumption for tileable display panel100. Furthermore, embodiments may increase the available bit depth for pixel data, resulting in smoother gradients and improved image quality.

FIG. 3is an illustration of components of a tileable display panel for displaying image sub-portion data according to an embodiment. In this embodiment, a portions of the components of tileable display panel300are illustrated from a cross-sectional view as including an illumination layer330comprising light sources331-333to emit display light at a limited angular spread so the display light is directed toward pixelets321of a display layer320—e.g. according to techniques described herein. When display light (including a corresponding image sub-portion) encounters screen layer310, a magnified version of the image sub-portion is projected onto a backside of the screen layer so that it is viewable to the user, shown as magnified sub-images392fromFIG. 3.

Each light source331-336is configured to emit a divergent projection beam347having a limited angular spread that is directed toward a specific corresponding one of multiple pixelets321in display layer320, as illustrated inFIG. 3. In an embodiment, a distance between two of the pixelets122which are closest to one another is greater than a distance between adjacent pixels in either one of those two pixelets. For example, a distance between adjacent pixelets may be in a range of 7-20 times the size of a single pixel and/or in a range of 40-100 times the distance between pixels of a single pixelet.

In one embodiment, divergent projection beam347may be substantially shaped as a cone (circular aperture) or an inverted pyramid (rectangle/square aperture). Additional optics may be disposed over each light source in the array of light sources to define the limited angular spread (e.g. 20-70 degrees) and/or cross-sectional shape of divergent projection beam347emitted from the light sources. The additional optics (including refractive and/or diffractive optics) may also increase brightness uniformity of the display light so that the intensity of divergent projection beam347incident upon each pixel in a given pixelet is substantially similar.

In some embodiments (not illustrated inFIG. 3), divergent projection beams347from different light sources may overlap upon the spacing region328on the backside of display layer320. In some embodiments, each pixelet is directly illuminated solely by one divergent projection beam from its corresponding light source, which may approximate a point source. In certain embodiments, a very small percentage of light from non-corresponding light sources may become indirectly incident upon a pixelet due to unabsorbed reflections of divergent projection beams347from non-corresponding light sources. Spacing regions328and illumination layer330may be coated with light absorption coatings (known in the art) to decrease reflections from non-corresponding light sources from eventually becoming incident upon a pixelet that does not correspond with the light source. The limited angular spread of the light sources may be designed to ensure that divergent projection beams347only directly illuminates the pixelet that corresponds to a particular light source. In contrast, conventional LCD technology utilizes light sources (e.g. LEDs or cold-cathode-fluorescents) with a generally Lambertian light distribution and diffusive filters in an attempt to generate uniform and diffuse light for backlighting the LCD panel. By implementing each light source (e.g., light sources331-333) as a near point source, each pixel within a given pixelet exclusively projects onto a corresponding region on the backside of screen layer310on a one-to-one basis.

FIG. 4illustrates elements of a system400according to an embodiment for determining misalignment of a multi-panel display assembly. In an illustrative scenario according to one embodiment, system400operates to determine whether an adjustment is needed to improve an alignment of one or more displays in an assembly410. Assembly410may comprise a plurality of tileable display panels—e.g. including panels which each include some or all of the features of display panel100, display panel300or the like. However, certain embodiments are not limited to the particular type of display panels of assembly410.

As shown inFIG. 4, assembly410may include a two-by-two array of displays412,414,416,418, various pairs of which have respective edges adjoining one another along an x-dimension or along a y-dimension. However, assembly410may include any of a variety of additional or alternative configurations of displays, according to different embodiments. Assembly410may be part of system400, although certain embodiments are not limited in this regard. Certain features of various embodiments are discussed herein with respect to alignment of displays412,416with one another along the x-dimension. However, such discussion may be extended to additionally or alternatively apply to alignment of any of various other pairs of displays.

Displays412,414,416,418may be variously mounted into or on a wall, ceiling, floor or other fixed structure (not shown). For example, assembly400may include or couple to mounting hardware and/or structures or mechanisms for connection to such mounting hardware. One or more alignment mechanisms may be included in (or coupled to) such mounting hardware, structures or mechanisms—e.g. where such alignment mechanisms are configured to perform fine position adjustment of one or more display panels. By way of illustration and not limitation, assembly410may include, or couple to, one or both of an alignment mechanism460for adjustment of display416along the x-dimension, and an alignment mechanism465for adjustment of display416along the y-dimension. Alignment mechanisms460,465may include, for example, any of a variety of servomotors, adjustment screws, controller logic and/or other hardware for adjusting the position of display416. However, the particular mechanism(s) for adjusting the position of one or more displays of assembly410are not limiting on certain embodiments, and may be adapted from existing structures and/or techniques.

At some point in time—e.g. during installation of assembly410and/or thereafter—a position of at least one display of assembly410may need to be adjusted relative to a position of another display of assembly410. To determine whether such adjusted is to be performed, certain embodiments evaluate (and in an embodiment, capture) a plurality of images which each include a respective representation of a portion of assembly410. For example, system400may include or couple to an image sensor435which is to capture a plurality of images442a, . . . ,442n—e.g. including frames of a video sequence and/or still digital pictures. Image sensor435may include, or be incorporated into, any of a variety of consumer electronic devices. For example, image sensor435may include (or be a component of) a handheld, wearable or otherwise portable device including, but not limited to, a digital camera, camcorder, cell phone, laptop, game system tracking device, wearable video recording device or the like. Alternatively, image sensor435may be part of a desktop computer, laptop computer, game console or other relatively fixed device.

Image sensor435may participate in an exchange440which provides images442a, . . . ,442nto an image processor450of system400. Image processor450may include any of a variety of combinations of hardware logic (e.g. including a processor and memory) and/or executing software logic to generate misalignment information based on super-resolution analysis of images such as images442a, . . . ,442n. In an embodiment, image sensor435and image processor450may be components of the same device, or are otherwise incorporated into the same device. For example, image processor450may include an application or other software process which executes on a smart phone, tablet, gaming console, or other consumer electronics device which also includes image sensor435. Such a software process may include, for example, a standalone application, any of various applets widgets or other processes which may execute in a host execution environment (e.g. as a mobile app), a software thread, method or the like.

Alternatively, image processor450may include a software process and/or dedicated circuit logic which operates on another device distinct from that including image sensor435—e.g. where exchange440is conducted via any of a variety of wired and/or wireless communications including, but not limited to, WiFi communications, Bluetooth communications, LTE communications, cellular communications, Ethernet communications, or the like. For example, image processor450may be a remote resource which is accessed by other components of system400via a network (not shown). In an embodiment, image processor450is a network service which is provided by one or more remote servers via a local area network (LAN), wide area network (WAN), home network, Internet, cloud or other such network. In still another embodiment, image processor450is incorporated into assembly410and/or alignment hardware coupled to assembly410. For example, image processor450may be incorporated into a display of assembly410, into one of the alignment mechanisms460,465, or the like.

During a period of time when the images442a, . . . ,442nare being captured, some or all displays of assembly410may display one or more reference images, as represented by the illustrative test pattern420. Displays412,416may each display a respective portion of test pattern420at their respective adjoining sides. In an embodiment, image processor450performs super-resolution processing of images442a, . . . ,442nto create a super-resolution image425of a portion of the one or more reference images displayed as test pattern420by assembly410.

For example, as compared to images captured by some existing high-quality hardware, one or more of images442a, . . . ,442nmay be of low resolution or otherwise of poor image quality—e.g. due to the quality of image sensor435, movement of image sensor435by user430during an image capture, movement of image sensor435by user430between image captures and/or the like. As a result, some or all of images442a, . . . ,442nmay, for example, be inconsistent with one another in one or more respects. For example, some or all of a yaw angle, pitch angle, roll angle, x-dimension position, y-dimension position and/or z-dimension position of image sensor435may vary for different ones of images442a, . . . ,442n. Alternatively or in addition, a zoom, focus and/or exposure setting of image sensor435may vary for different ones of images442a, . . . ,442n. In some embodiments, images442a, . . . ,442nmay include various different jitter artifacts and/or blur artifacts.

As discussed herein, super-resolution processing of images442a, . . . ,442nmay be performed according to an embodiment to generate a super-resolution image425of the adjoining displays412,416. Super-resolution image425may include one or more artifacts which are indicative of misalignment—e.g. between displays412,416—where such one or more artifacts are more clearly detectable than they might be in any of the comparatively low resolution images442a, . . . ,442n. The one or more reference images may provide a basis for fiducial information which image processor450(or alternatively, other logic of assembly410) evaluates in conjunction with the super-resolution image425to quantify misalignment between displays of assembly410.

For example, image processor450may receive, send or otherwise determine fiducial information which describes some or all features of the one or more reference images. Feature recognition logic of image processor450may be used to identify portions of super-resolution image425as corresponding to features of the one or more reference images. In an embodiment, image processor450performs one or more calculations to compare regions of super-resolution image425to the one or more reference images. Based on such calculations, image processor450may determine a misalignment value which quantifies or otherwise identifies a misalignment artifact in super-resolution image425.

Based on the determined misalignment value, image processor450may send—e.g. to assembly410and/or one of alignment mechanisms460,465—a signal indicating an adjustment to be made to one or more displays of assembly410. For example, image processor450may signal a direction of adjustment and/or an amount of adjustment to reposition display416along the x-dimension. Such communications between image processor450and assembly410(or an alignment mechanism coupled thereto) may be via any of a variety of wired and/or wireless communications including, but not limited to, WiFi communications, Bluetooth communications, LTE communications, cellular communications, Ethernet communications, or the like. In one embodiment, a sequence such as that discussed herein (e.g. including image capture and communication, super-resolution calculation, misalignment evaluation and display adjustment) is repeated until alignment is detected—e.g. to at least below some maximum misalignment threshold.

FIG. 5illustrates elements of a system500according to an embodiment for determining display misalignment for only a single display panel. In an illustrative scenario according to one embodiment, system500operates to determine whether an adjustment is needed to improve an alignment, with respect to one another, of different portions—e.g. including different pixelets or other pixel groups—of the same display516. In one embodiment, display516includes some or all of the features of display panel100, display panel300or the like.

To determine whether such adjusted is to be performed, certain embodiments evaluate (and in an embodiment, capture) a plurality of images which each include a respective representation of display516. System500may include or couple to an image sensor535which is to capture a plurality of images (not shown)—e.g. in a manner similar to the capturing of images442a, . . . ,442nby image sensor535. Image sensor535may participate in an exchange540which provides such images to an image processor550of system500—e.g. where image sensor535and image processor550include some or all of the respective features of image sensor435and image processor450.

In an embodiment, image processor550performs super-resolution processing of images received via exchange540to create a super-resolution image of a portion of one or more reference images (such as the illustrative test patient520) displayed by display516. Such one or more reference images may provide a basis for fiducial information which image processor550(or alternatively, other logic of display516) evaluates in conjunction with the super-resolution image to quantify misalignment between different portions of display516. Based on the determined misalignment, image processor550may send—e.g. to display516and/or an alignment mechanism coupled thereto—a signal560indicating an adjustment to be made to display516.

In one illustrative embodiment, display516includes an audio-video (AV) processor unit580including any of a variety of hardware logic and/or software logic to process an AV stream562to generate an output564for controlling other hardware (e.g. illumination layer hardware, display layer hardware and/or the like) of display516. AV stream562may include video data which can be represented conceptually with a logical display region570comprising Y logical rows LR(1:Y) and X logical columns LC(1:X). For example, individual frames of AV stream562may each include video data variously specifying respective pixel values for locations within logical display region570. In an embodiment, AV processor unit580may be variously configured to correspond a pixelet (or other component) of display516at different times with different portions of logical display region570.

By way of illustration and not limitation, a first configuration of AV processor unit580may allocate or otherwise correspond to the pixelet those pixel values of AV stream562which are in a sub-region572aof logical display region570. Such correspondence may be specified or otherwise implemented with a mapping table, one or more timing settings and/or other configuration state of mapping logic586. In such a configuration, video data processing logic588of AV processor unit580may receive AV stream562—e.g. via IO circuitry582—and perform video processing which, in part, allocates to the pixelet portions of output564which represent sub-image information for sub-region572a.

Alternatively or in addition, AV processor unit580may receive signal560and, in response, implement a different configuration to mitigate a misalignment of the pixelet—e.g. relative to an adjoining pixelet of display516. For example, a controller584of AV processor unit580may update configuration state of mapping logic586in response to signal560. Such a change to mapping logic586may instead correspond the pixelet to a different sub-region572bof logical display region570. In an illustrative scenario according to one embodiment, a horizontal (x dimension) span HS1 of sub-region572ais to the right of a horizontal span HS2 of sub-region572b—e.g. where sub-region572aspans rows [x1, x2] of LC(1:X) and sub-region572bspans rows [(x1-1), (x2-1)] of LC(1:X). Accordingly, corresponding the pixelet to sub-region572bmay correct a misalignment of the pixelet to the left, relative to one or more other components of display516. The modified configuration state of mapping logic586may change a timing or other operational characteristic of video codes588to instead allocate to the pixelet portions of output564which represent sub-image information for sub-region572b.

FIG. 6illustrates elements of a method600for determining misalignment of one or more display panels according to an embodiment. Method600may be performed, for example, to detect misalignment in a single display and/or in an assembly having some or all of the features of assembly410, for example. In an embodiment, method600is performed by one or more components of system400or system500—e.g. by one or more devices which include some or all of the features of one of image sensors435,535and/or one of image processors450,550.

For example, method600may include operations615which are performed by hardware logic and/or executing software logic which provides the functionality of one of image processors450,550. Method600may further comprise other operations605which are performed by other hardware logic and/or executing software logic than that which performs operation615. For example, operations605may be performed by hardware logic and/or software logic such as that of one of image sensors435,535, display516and/or of assembly410.

Method600may include, at610, sending a plurality of images each including a respective representation of one or more display panels. In an embodiment, the sending the plurality of images at610includes sending one or more of the plurality of images via a network such as an Internet, cloud network or the like. Alternatively, the plurality of images may be captured with image sensor hardware of a first device, wherein the sending the plurality of images at610includes sending the images to a software process which is executing on that same first device.

Method600may further comprise, at620, creating a super-resolution image based on the exchanged plurality of images. The super-resolution image created at620may include some or all of the features of super-resolution image425, for example. In an embodiment, method600further comprises, at630, automatically generating misalignment information based on the super-resolution image and based on fiducial data describing a reference image. The automatic generating at630may include performing automatic feature recognition to identify portions of the super-resolution image as corresponding to features of the reference image. The automatic generating at630may further comprise performing one or more calculations to compare a region of the super-resolution image to a corresponding feature of the reference image. Such comparison may include calculating a misalignment value which quantifies or otherwise identifies a misalignment artifact in the super-resolution image.

Method600may further comprise, at640, sending a signal based on the misalignment information, the signal indicating an adjustment to a first tileable display panel. In an embodiment, the signal sent at640is further generated based on data which describes one of more features describing the one or more display panels. Such data may identify a relative configuration of display panels with respect to one another in an assembly. Alternatively or in addition, such data may identify a correspondence of some or all such displays each with a respective portion of a reference image. For example, the data may identify a first portion of a reference image as being displayed by a first display, and a second portion of the same reference image (e.g. adjoining the first portion) as being displayed by a second display image. Alternatively or in addition, the data may identify one or more dimensions of a display, or otherwise indicate a scale of one or more features of the reference image as it is displayed by the one or more display panels. Based on such data and the misalignment information, a particular display (or displays) to be adjusted, where a direction and/or physical distance of such adjustment may be determined and communicated with the signal sent at640.

Method600may include one or more additional operations (not shown) such as some or all of those discussed herein with respect to system400. For example, method600may further include automatically adjusting a tileable display panel in response to the signal sent at640. In another embodiment, method600may further comprise additional misalignment detection—e.g. including a subsequent sending of a second plurality of images each including a respective representation of the one or more display panels, wherein a second super-resolution image is created based on the sending of the second plurality of images, and wherein second misalignment information is automatically generated based on the second super-resolution image and based on the fiducial data.

FIG. 7illustrates elements of a device700for determining misalignment of one or more tileable displays according to an embodiment. Device700may include some or all of the features of image processor450, for example. In an embodiment, device700includes any of a variety of combinations of hardware logic and/or executing circuit logic to perform some or all of the operations of method500.

In an embodiment, device700includes super-resolution logic710to receive a plurality of images705a, . . . ,705nwhich each include a respective representation of one or more tileable displays. For example, device700may receive the plurality of images705a, . . . ,705nfrom another device—e.g. via an Internet or other network. In an alternate embodiment, device700includes image sensor hardware (not shown) which generates the plurality of images705a, . . . ,705nwhile the one or more panels are displaying one or more reference images and subsequently sends the plurality of images705a, . . . ,705nto super-resolution logic710.

Super-resolution logic710may perform processing of the plurality of images705a, . . . ,705nto generate a super-resolution image715which represents a comparatively high-resolution version of information which is variously represented by some or all of the plurality of images705a, . . . ,705n. Such processing by super-resolution logic710may include one or more operations adapted from known super-resolution techniques, the details of which are not discussed in detail herein.

Super-resolution image creation increases the resolvable detail of information which is variously represented in a plurality of images. Super-resolution techniques may generate a still image of a scene from a collection of similar lower-resolution images of the same scene. For example, several low-resolution still pictures (or alternatively, frames of video) may be averaged together or otherwise combined using super-resolution techniques to produce a single still image whose resolution is significantly higher than that of any single one of the original pictures (or video frames). Because each low-resolution frame is slightly different and contributes some unique information that is absent from the other frames, the reconstructed still image has more information, i.e., higher resolution, than that of any one of the originals alone.

In one illustrative embodiment, one of the low-resolution images705a, . . . ,705nis selected as a reference image (or “primary” image), and the remaining low resolution images are non-reference images (or “secondary” images). Each secondary image is registered with respect to the primary image. This allows transforming the secondary images to motion compensated images. For each motion compensated secondary image, a mask value for each pixel of the secondary image is estimated based on a registration error of the secondary image with respect to the primary image. In one embodiment, the mask value for a pixel in the secondary image indicates a likelihood that the pixel will be included in the super-resolution image. A super-resolution image of the primary image is then generated by combining the mask values and the motion compensated secondary images. However, the particular type of super-resolution algorithm to be adapted for use in processing the plurality of images705a, . . . ,705nmay not be limiting on various embodiments.

The resulting super-resolution image715may be provided to feature identification logic730of device700. In an embodiment, feature resolution logic700may perform processing—e.g. including one or more calculations adapted from known feature recognition techniques—to identify one or more portions of the super-resolution image715each as corresponding to a respective features of one or more reference images which are represented in the plurality of images705a, . . . ,705n. For example, feature identification logic730may access fiducial data720which includes, or otherwise describes, features of a test pattern or other reference image which is displayed by one or more tileable display panels during the capturing of the plurality of images705a, . . . ,705n

Based on fiducial data720, feature identification logic730may identify a first portion of super-resolved image715as corresponding to a first portion of a reference image feature, and identify a second, adjoining portion of super-resolved image715as corresponding to a second portion of that same reference image feature. In an embodiment, feature identification logic730may further detect for indicia of display misalignment in super-resolution image715. For example, feature identification logic730may detect a misalignment of such first and second portions of super-resolution image715—e.g. based on a comparison to a corresponding alignment of the corresponding first and second portions of the reference image. Detection of such misalignment may include determining whether an offset of the first and second portions of super-resolved image715relative to one another is greater than some maximum misalignment threshold value.

In an embodiment fiducial data720specifies or otherwise indicates respective dimensions (e.g. including width, length, etc.) of one or more features of a reference image, between such one or more features, or the like. Some or all such dimensions may be used as a reference by feature identification logic730for determining a direction and/or degree of misalignment—e.g. where feature identification logic730calculates a ratio based on a length of a misalignment indicium and a dimension of a feature of the reference image. Feature identification logic730may generate misalignment information735which describes the misalignment detected in the super-resolution image715. Misalignment information735may specify a magnitude of misalignment and/or a direction of misalignment for example, where misalignment information735merely signals a direction (e.g. right or left). In an embodiment, misalignment information735includes a “unitless” value which may need to be subsequently converted into to a physical distance value specific to the particular one or more display panels.

For example, device700may include or couple to alignment logic750which receives the misalignment information735and which includes or has access to data740which describes one of more features of the one or more display panels. Data740may identify, for example, which displays correspond to which portions of a reference image and/or may identify one or more display dimensions. Based on such data740and the misalignment information735, alignment logic750may determine one or more of a specific display or displays to be repositioned, a direction of such repositioning and a physical distance for such repositioning. As a result, a signal755indicating some or all such determined information may be sent from alignment logic755for adjusting one or more displays panels.