Patent ID: 12238462

DESCRIPTION OF EMBODIMENTS

It is to be understood that other embodiment may be utilized and structural changes may be made without departing from the scope of the present disclosure. Also, it is to be understood that the phraseology and terminology used herein are for the purpose of description and should not be regarded as limiting. The use of “including,” “comprising,” or “having” and variations thereof herein is meant to encompass the items listed thereafter and equivalents thereof as well as additional items. Unless limited otherwise, the terms “connected,” “coupled,” and “mounted,” and variations thereof herein are used broadly and encompass direct and indirect connections, couplings, and mountings.

FIG.1is a schematic view of a projection system according to an embodiment of the present disclosure. Referring toFIG.1, the projection system10of this embodiment includes a projector110, an image capturing device120and a projection target130. The projector110projects the projection content onto the projection target130to generate a projection image, and the image capturing device120captures the projection target130to generate a captured image. The captured image includes at least a part of the projection image. The image capturing device120is coupled to the projector110, and the image capturing device120is configured to provide the captured image to the projector110. The projector110may include a processor (not shown) for performing data processing such as making judgment and adjustment described in the disclosure. The projection target130is, for example, a projection screen or a wall. The image capturing device120is an external device disposed outside the projector110. In the other embodiment, the image capturing device120is a device disposed inside the projector110or disposed on the projector110.

FIG.2is a flowchart illustrating a projection position guiding method according to an embodiment of the present disclosure.FIG.3is a schematic view illustrating a projection image and a captured image according to an embodiment of the present disclosure. Please refer toFIG.2andFIG.3. In step S210, the projection system10projects the projection content onto the projection target130through the projector110to generate the projection image PA. The projection content includes a plurality of positioning grid points arranged at intervals, and the plurality of positioning grid points are multiple circular grid points in the projection image PA. The projection content is the image information that the projector110receives from the external image source or the image information which is stored in the projector110. In the projection content, each positioning grid point of the plurality of positioning grid points has the same size and is arranged at a distance with fixed interval. The plurality of positioning grid points are arranged in an array. TakingFIG.1andFIG.3as an example, the projection content is projected by the projector110onto the projection target130to generate the projection image PA. The positioning grid points are used to define the position of the projection image in the captured image. For example, inFIG.3, the projection image PA is located toward the right side of the captured image TA, and the projection image PB is located toward the right side of the captured image TB. In the other embodiment, each of the plurality of positioning grid points may be a square or a rectangular point in the projection content.

Next, in step S220, the projection system10captures the projection target130through the image capturing device120to generate a captured image, and the captured image includes at least part of the projection image. TakingFIG.3as an example, the captured image TA may include part of the projection image PA.

In step S230, the projection system10determines whether the plurality of positioning grid points satisfy a plurality of recognizable conditions according to the projection image in the captured image. Specifically, when the positioning grid points meet multiple recognizable conditions, such positioning grid points are determined to be recognizable grid points. When the positioning grid points do not meet at least one of the multiple recognizable conditions, such positioning grid points are determined to include at least one unrecognizable grid point. In an embodiment, the plurality of recognizable conditions may include five recognizable conditions. The first recognizable condition is that the resolution of the projection image in the captured image is greater than the minimum resolution. The second recognizable condition is that a spacing of any two adjacent positioning grid points is greater than a minimum spacing of two adjacent positioning grid points. The third recognizable condition is that the difference in the diameters of the largest positioning grid point and the smallest positioning grid point is less than the distortion amount of the largest positioning grid point. The fourth recognizable condition is that the gray-scale contrast is greater than the minimum gray-scale contrast. The fifth recognizable condition is that all the positioning grid points are captured and shown in the captured image.

For example, regarding the first recognizable condition, if the minimum resolution is 300 by 225 pixels, when the resolution of the captured image which includes at least part of the multiple positioning grid points is greater than 300 by 225 pixels, it is determined that the first recognizable condition is satisfied. When the resolution of the captured image is less than 300 by 225 pixels, it is determined that the first recognizable condition is not satisfied. Regarding the second recognizable condition, if the minimum spacing between two adjacent positioning grid points in the captured image is 5 cm, then when the spacing between any two adjacent positioning grid points is greater than 5 cm (the minimum spacing), it is determined that the second recognizable condition is satisfied. When the spacing of the two adjacent positioning grid points is less than 5 cm (the minimum spacing), it is determined that the second recognizable condition is not satisfied. In an embodiment, the minimum spacing of the two adjacent positioning grid points may be equivalent to the radius of each of the two adjacent positioning grid point, but is not limited thereto. Regarding the third recognizable condition, if the distortion amount of the largest positioning grid point is 1.5 cm, then when the difference in the diameters of the largest positioning grid point and the smallest positioning grid point is less than 1.5 cm, it is determined that the third recognizable condition is satisfied. When the difference in the diameters of the largest positioning grid point and the smallest positioning grid point is greater than 1.5 cm, it is determined that the third recognizable condition is not satisfied. For example, the diameter of the largest positioning grid point among the multiple positioning grid points is 10 cm and the diameter of the smallest positioning grid point is 9 cm, then the diameter difference between the largest positioning grid point and the smallest positioning grid point is 1 cm, which is less than the distortion amount of the largest positioning grid point 1.5 cm. That is, the third recognizable condition is satisfied. The diameter of the largest positioning grid point in the multiple positioning grid points is 10 cm and the diameter of the smallest positioning grid point is 8 cm, then the diameter difference between the largest positioning grid point and the smallest positioning grid point is 2 cm, which is greater than the distortion amount of the largest positioning grid point 1.5 cm. That is, the third recognizable condition is not satisfied. In an embodiment, the distortion amount of the largest positioning grid point may be 15% of the diameter of the largest positioning grid point, but is not limited thereto. Regarding the fourth recognizable condition, when the gray-scale contrast between the positioning grid points and the region without the positioning grid points in the captured image is greater than the minimum gray-scale contrast, it is determined that the fourth recognizable condition is satisfied. When the gray-scale contrast between the positioning grid points and the region without positioning grid points in the captured image is less than the minimum gray-scale contrast, it is determined that the fourth recognizable condition is not satisfied. Regarding the fifth recognizable condition, when all the positioning grid points are completely captured based on the comparison between the projection image in the captured image and the projection content, it is determined that the positioning grid points satisfy the fifth recognizable condition. When at least one of the positioning grid points is not captured based on the comparison between the projection image in the captured image and the projection content, it is determined that the fifth recognizable condition is not satisfied. For example, the positioning grid points in the rightmost column of the captured image TA or TB inFIG.3are not completely captured. Then the fifth recognizable condition is not satisfied. When the positioning grid points do not satisfy at least one of the recognizable conditions, such positioning grid points are determined to include at least one unrecognizable grid point. In step S240, when the projection system10determines that the plurality of positioning grid points include at least one unrecognizable grid point, a color of at least one unrecognizable grid point in the projection content is adjusted. The unrecognizable grid point is the positioning grid point that does not satisfy at least one of the multiple recognizable conditions. For example, please refer toFIG.3, since the positioning grid points in the rightmost column of captured image TA are not completely captured, and do not satisfy the fifth recognizable condition, the projection system10determines that the positioning grid points in the rightmost column of the projection image PA are unrecognizable grid points (also referred to as incompletely captured grid points), and the rest of the positioning grid points in the projection image PA are recognizable grid points. The color of the unrecognizable grid points in the projection content is adjusted. The adjusted projection image PB includes the unrecognizable grid points U0and the recognizable grid points R0, and the color of the unrecognizable grid points U0is different from the color of the recognizable grid points R0.

Please refer toFIG.3, the projector110projects the projection content onto the projection target130to generate a projection image PA, and the image capturing device120captures the projection image PA to generate a captured image TA. The captured image TA may include at least part of the projection image PA. In this embodiment, since the positioning grid points in the rightmost column of captured image TA are not completely captured and do not satisfy the fifth recognizable condition and are determined as unrecognizable grid points, the projection system10may adjust the projection content according to the determination, so that the projection image PA becomes the projection image PB. The projection content in the projection image PB includes a plurality of unrecognizable grid points U0and a boundary grid point B0located between the plurality of unrecognizable grid points U0and a plurality of recognizable grid points R0. The color (the third color) of the boundary grid point B0is different from the color (the second color) of the unrecognizable grid point U0and the color (the first color) of the recognizable grid point R0. The projection image PB corresponding to the adjusted projection content is projected to the projection target130and then captured by the image capturing device120as the captured image TB. The colors of the positioning grid points in the captured image TB correspond to the colors of the positioning grid points in the projection image PB. In this embodiment, the captured image TB includes part of the projection image PB. The projection system10may set the color (fourth color) of the border of the projection image PB in the captured image TB for recognizing the border of the projection image PB in the captured image TB. The unrecognizable grid point U0and the boundary grid point B0may be used as a plurality of indicating grid points, so as to provide information for adjusting the position and direction of the projector110or the image capturing device120or adjusting the projection environment. For instance, the direction of the image capturing device120or the projection angle of the projector110relative to the projection target130is correspondingly moved according to the positions of the boundary grid points B0of the projection image PB in the captured image TB, such that the captured image is able to show the entire and complete projection image.

FIG.4Ais a schematic view illustrating a projection position guiding method according to an embodiment of the present disclosure.FIG.4Bis a schematic view of a projection position guiding method corresponding toFIG.4Aaccording to an embodiment of the present disclosure. Referring toFIG.4AandFIG.4B, in step S410, the projection system10determines whether the projection position guiding function is activated, and if so, proceeds to step S420, otherwise step S410is repeated. In step S420, the projector110projects the initial projection content onto the projection target130to generate an initial projection image P1. The initial projection content shown in the projection image P1includes a plurality of initial positioning grid points arranged at intervals. It should be noted thatFIG.4AandFIG.4Bare only examples, and the actual number and arrangement of the initial positioning grid points are determined based on actual design requirements, and are not limited thereto. The image capturing device120captures the projection target130to generate the initial captured image T1, and the initial captured image T1includes at least part of the initial projection image P1.

Next, in step S430, the projection system10determines whether the plurality of initial positioning grid points satisfy a plurality of recognizable conditions according to the initial projection image P1in the initial captured image T1. The recognizable conditions are as described above and will not be repeated here. When the plurality of initial positioning grid points satisfy the plurality of recognizable conditions, the process goes to step S440, and when the plurality of initial positioning grid points do not satisfy at least one of the plurality of recognizable conditions, the process goes to step S480. In step S480, the projection system10stops the projection position guiding function. For example, the projector110stops projecting the initial positioning grid point and the image capturing device120stop capturing images. In step S490, the projection system10provides other adjustment instructions. In this embodiment, text may be displayed on the display screen (projection target) by the projector110to provide an environment adjustment method to satisfy the multiple recognizable conditions, such as suggesting the user to improve the poor environment for the projection target130.

In step S440, the projection system10converts the coordinate system of the projector110and the coordinate system of the image capturing device120to project the projection content onto the projection target130to generate a projection image P2, and the projection content P2includes a plurality of positioning grid points arranged at intervals. Specifically, the projection system10may convert the coordinate system of the projector110and the coordinate system of the image capturing device120according to the positions of the multiple initial positioning grid points in the captured image T1, so as to estimate the positions of the multiple positioning grid points of the projection content P2. It should be noted that the number of positioning grid points in the projection content is greater than the number of initial positioning grid points in the initial projection content, and the number of positioning grid points in the projection image P2is greater than the number of initial positioning grid points in the projection image P1. The actual number and the arrangement of positioning grid points are determined based on the actual design requirements and are not limited thereto. Next, the image capturing device120captures the projection target130to generate a captured image T2, and the captured image T2includes at least part of the projection image P2.

In step S450, the projection system10determines whether the positioning grid points in the captured image P2include at least one unrecognizable grid point. When the projection system10determines that the captured image P2has at least one unrecognizable grid point, the process goes to step S460. When the projection system10determines that the captured image2does not have any unrecognizable grid point, the process returns to step S410. In this embodiment, after comparing the projection content projected by the projector110with the projection image P2in the captured image T2, it may be determined that the multiple positioning grid points in the captured image T2are not completely captured and do not satisfy the fifth recognizable condition, that is, it can be determined that the positioning grid points of the captured image T2includes at least one unrecognizable grid point, so step S460should be performed.

In step S460, the color of the unrecognizable grid points UG in the projection content is correspondingly changed to be the second color by the projector110according to the positions of the unrecognizable grid points in the captured image T2, the color of the boundary grid points BG adjacent to the unrecognizable grid points UG in the projection content is changed to be the third color, and the adjusted projection content is projected onto the projection target130and a projection image P3is generated. The color of the positioning grid points RG excluding the unrecognizable grid points UG and the boundary grid points BG in the projection content is the first color. The first color, the second color, and the third color are different. In this embodiment, the unrecognizable grid points UG are not completely captured in the captured image T3. In this embodiment, the recognizable grid points RG include the boundary grid points BG, and the boundary grid points BG are located adjacent the unrecognizable grid points UG. The indicating grid points are correspondingly generated according to the distribution of the unrecognizable grid points UG and the boundary grid points BG in the projection content. The indicating grid points are information for adjusting the position and direction of the projector110or the image capturing device120or information for adjusting the projection environment. In the other embodiment, the unrecognizable grid points UG and the boundary grid points BG may serve as indicating grid points. Next, the image capturing device120captures the projection target130to generate a captured image T3, and the captured image T3includes at least part of the projection image P3.

In step S470, the projection system10generates an instruction image IF for adjusting the projection environment according to the distribution positions of the unrecognizable grid points UG and the boundary grid points BG in the projection content, and projects the instruction image IF onto the projection target130to generate the projection image P4. Moreover, the image capturing device120captures the projection target130to generate a captured image T4. The instruction image IF includes a plurality of indicating grid points IG, and the color (fifth color) of the plurality of indicating grid points IG is different from the color (first color) of the plurality of positioning grid points. The plurality of indicating grid points IG in the instruction image IF are configured to provide information for adjusting the position and direction of the projector110or the image capturing device120or adjusting the projection environment, and the instruction image IF shows in the projection image P4. Specifically, the instruction image IF may be a direction arrow, such as a direction arrow indicating the right side in the projection content P4, to instruct the image capturing device120to rotate toward the right side or move to the right side, or to instruct the projector110to rotate toward to the left side or move to the left side, or to instruct the projection target130to move to the right side, etc., so as to obtain the captured image including complete projection image. Next, the process returns to step S410.

FIG.5Ais a schematic view illustrating a projection position guiding method according to an embodiment of the present disclosure.FIG.5Bis a schematic view of a projection position guiding method corresponding toFIG.5Aaccording to another embodiment of the present disclosure. Referring toFIG.5AandFIG.5B, in step S510, the projection system10determines whether the projection position guiding function is activated, and if so, proceeds to step S520, otherwise step S510is repeated. In step S520, the projector110projects the initial projection content to the projection target130to generate an initial projection image P5. The initial projection content includes a plurality of initial positioning grid points arranged at intervals. The image capturing device120captures the projection target130to generate an initial captured image T5, and the initial captured image T5includes the initial projection image P5. Next, in step S530, the projection system10determines whether the plurality of initial positioning grid points satisfy a plurality of recognizable conditions according to the initial projection image P5in the initial captured image T5. The recognizable conditions are as described above and will not be repeated here. When the plurality of initial positioning grid points satisfy the plurality of recognizable conditions, go to step S540, and when the plurality of initial positioning grid points do not satisfy at least one of the plurality of recognizable conditions, go back to step S520.

In step S540, the projection system10converts the coordinate system of the projector110and the coordinate system of the image capturing device120to project the projection content to the projection target130to generate a projection image P6. The projection content includes a plurality of positioning grid points arranged at intervals. Specifically, the projection system10may convert the coordinate system of the projector110and the coordinate system of the image capturing device120according to the positions of the initial positioning grid points in the captured image T5, so as to estimate the positions of the plurality of positioning grid points in the projected content. It should be noted that the number of positioning grid points in the projection content is greater than the number of initial positioning grid points in the initial projection content, the number of positioning grid points in the projection image P6is greater than the number of initial positioning grid points in the initial projection image P5, and the actual number and arrangement of positioning grid points are determined based on the actual design requirements and are not limited thereto. Next, the image capturing device120captures the projection target130to generate a captured image T6, and the captured image T6includes the projection image P6.

In step S550, the projection system10determines whether the positioning grid points in the captured image T6includes at least one unrecognizable grid point. When the projection system10determines that the captured image T6has at least one unrecognizable grid point, the process goes to step S560. When the projection system10determines that the captured image T6does not have any unrecognizable grid point, the process returns to step S520. In this embodiment, since the area A1in the captured image T6is illuminated by a searchlight, the gray-scale contrast between the positioning grid points and the region without positioning grid points in the area A1is less than the minimum gray-scale contrast, which does not satisfy the fourth recognizable condition, then it may be determined that the corresponding captured image T6has unrecognizable grid points, so step S560should be performed.

In step S560, changes the color of the unrecognizable grid points UG in the projection content is correspondingly changed to be the second color by the projector110according to the positions of the unrecognizable grid points in the captured image T6, the color of the boundary grid points BG adjacent to the unrecognizable grid points UG is changed to be the third color, and the adjusted projection content is projected by the projector110onto the projection target130and a projection image P7is generated. The color of the recognizable grip points excluding the unrecognizable grid points UG and the boundary grid points BG is the first color, and the first color, the second color and the third color are different. Next, the image capturing device120captures the projection target130to generate a captured image T7, and the captured image T7includes the projection image P7.

In step S570, the projection system10may provide an environment adjustment instruction. For example, the projection system10may provide a text message suggesting the user to turn off the searchlight or reduce the brightness of the searchlight to solve the problem that the gray-scale contrast between the positioning grid points and the region without positioning grid points in the area A1is less than the minimum gray-scale contrast, resulting in failure to satisfy the recognizable conditions. In step S580, the projection system10determines whether to stop the projection position guiding function; if so, go back to step S510, otherwise go back to step S520.

FIG.6A,FIG.6B, andFIG.6Care schematic views illustrating a projection position guiding method according to an embodiment of the present disclosure. A projection system20is configured with a projector610A, a projector610B, a projector610C, an image capturing device620A, an image capturing device620B, an image capturing device620C and a projection target630. The projector610A, the projector610B, and the projector610C respectively project the projection content with the positioning grid points to the projection target630inFIG.6A,FIG.6B, andFIG.6Cto respectively generate projection images. InFIG.6A, the projection image is located toward the right side of the projection target630, so the positioning grid points on the right side are not completely captured, and therefore the unrecognizable grid points and the recognizable boundary grid points are shown in the projection image. In this embodiment, the projection system20adjusts the color of the unrecognizable grid points and the color of the boundary grid points, so that the user knows that the unrecognizable grid points are projected on the right side of the projection target630inFIG.6A, thereby providing the user with adjustment instruction of projection environment. InFIG.6B, the projection image is located in the middle of the projection target630so the positioning grid points are completely captured, and therefore there are no unrecognizable grid point and recognizable boundary grid point shown in the projection image. InFIG.6C, the projection image is located toward the left side of the projection target630, so the positioning grid points on the left side are not completely captured, and therefore the unrecognizable grid points and the recognizable boundary grid points are shown in the projection image. In this embodiment, the projection system20adjusts the color of the unrecognizable grid points and the color of the boundary grid points, so that the user knows that the unrecognizable grid points are projected on the left side of the projection target630inFIG.6C, thereby providing the user with adjustment instruction of projection environment.

FIG.7is a flowchart illustrating a projection position guiding method according to an embodiment of the present disclosure. Referring toFIG.7, in this embodiment, the projection position guiding method is applicable to a projection system. The projection system includes a plurality of projectors, a plurality of image capturing devices and a projection target, and can be applied to the blending of a plurality of projection images. In step S710, each projector projects the projection content to the projection target to generate projection image, and the projection content includes a plurality of positioning grid points arranged at intervals. It should be noted that each of the projectors projects projection content and generates the projection image onto a partial area of the projection target, and the multiple projection images projected by the multiple projectors may be blended into a blending projection image. Next, in step S720, the corresponding image capturing device captures the projection target to generate a captured image, and the captured image includes at least part of the projection image. In step S730, the projection system determines whether the plurality of positioning grid points satisfy a plurality of recognizable conditions according to the projection image in the captured image. Next, in step S740, when the projection system determines that the plurality of positioning grid points include at least one unrecognizable grid point, the projection system adjusts the color of the at least one unrecognizable grid point in the projection content, and the at least one unrecognizable grid point is at least one of the positioning grid points that does not satisfy at least one of the plurality of recognizable conditions. For the details ofFIG.7, please refer to the related description ofFIG.2, and no further description is repeated herein.

To sum up, the embodiments of the present disclosure have at least one of the following advantages or effects. In the embodiments of the present disclosure, when it is determined that at least one of the multiple projected positioning grid points does not meet the recognizable conditions, the color of at least one unrecognizable grid point in the projection content is adjusted, so that the user may obtain the instruction for adjusting the position and direction of the image capturing device or projector from the projection image, so as to adjust the projection environment, thereby satisfying the image capturing requirement required by the projection system for performing automatic adjusting function. Therefore, there is no need to use an external device to see the adjustment instruction. In addition, the position of unrecognizable grid points can be clearly displayed to narrow the range for environment adjustment. Furthermore, before the auto blending is performed, the user may determine whether the positions or directions of the plurality of projectors and the plurality of image capturing devices need to be adjusted respectively to meet the image capturing conditions, so as to make pre-adjustment to improve the user experience.

The foregoing description of the preferred embodiments of the disclosure has been presented for purposes of illustration and description. It is not intended to be exhaustive or to limit the disclosure to the precise form or to exemplary embodiments disclosed. Accordingly, the foregoing description should be regarded as illustrative rather than restrictive. Obviously, many modifications and variations will be apparent to practitioners skilled in this art. The embodiments are chosen and described in order to best explain the principles of the disclosure and its best mode practical application, thereby to enable persons skilled in the art to understand the disclosure for various embodiments and with various modifications as are suited to the particular use or implementation contemplated. It is intended that the scope of the disclosure be defined by the claims appended hereto and their equivalents in which all terms are meant in their broadest reasonable sense unless otherwise indicated. Therefore, the term “the disclosure”, “the present disclosure” or the like does not necessarily limit the claim scope to a specific embodiment, and the reference to particularly preferred exemplary embodiments of the disclosure does not imply a limitation on the disclosure, and no such limitation is to be inferred. The disclosure is limited only by the spirit and scope of the appended claims. Moreover, these claims may refer to use “first”, “second”, etc. following with noun or element. Such terms should be understood as a nomenclature and should not be construed as giving the limitation on the number of the elements modified by such nomenclature unless specific number has been given. The abstract of the disclosure is provided to comply with the rules requiring an abstract, which will allow a searcher to quickly ascertain the subject matter of the technical disclosure of any patent issued from this disclosure. It is submitted with the understanding that it will not be used to interpret or limit the scope or meaning of the claims. Any advantages and benefits described may not apply to all embodiments of the disclosure. It should be appreciated that variations may be made in the embodiments described by persons skilled in the art without departing from the scope of the present disclosure as defined by the following claims. Moreover, no element and component in the present disclosure is intended to be dedicated to the public regardless of whether the element or component is explicitly recited in the following claims.