Patent Description:
A conventional projector can be used with an image capturing device to automatically adjust the projection image during an image adjusting process, such as auto blending or auto focusing. Generally speaking, the user needs to adjust the position and direction of the image capturing device or the projector so that the entire projection image can be captured, and then an external computing device such as a computer is utilized to determine how to adjust the position and direction of the projector and the image capturing device based on the captured image. However, the projector and the image capturing device need to be connected to an additional computer in a wired manner. When the projector or the image capturing device is configured to be disposed at a high position, it is not easy to set up the connection between the projector and the external computing device. In addition, when recognizable conditions for the captured image are insufficient, for example, the pixel resolution of the grid points of the captured image is too low, the accuracy in determining the adjustment would be reduced. <CIT> describes method wherein a projection image is projected, and a part of the projected image is captured and analysed to determine a projection result. <CIT> and <CIT> describe projection methods comprising image capture and extraction of points of a correction pattern or grid wherein extracted feature points are compared to known points. <CIT> discloses a projection method making use of a coloured frame and a test pattern. Further technical background is described in <CIT>; <CIT>; <CIT>; <CIT> and <CIT>.

The information disclosed in this Background section is only for enhancement of understanding of the background of the described technology and therefore it may contain information that does not form the prior art that is already known to a person of ordinary skill in the art. Further, the information disclosed in the Background section does not mean that one or more problems to be resolved by one or more embodiments of the disclosure was acknowledged by a person of ordinary skill in the art.

It is an object of the present disclosure to provide a projection system and an image projection method, which can adjust the projection image on the projection target according to the direction instruction in the captured image, so as to guide the user to adjust the position and direction of the image capturing device or the projector.

Other objects and advantages of the disclosure can be further understood from the technical features disclosed in the present disclosure.

To achieve one or part or all of the above purposes or other purposes, an embodiment of the present disclosure provides a projection position guiding method, which is adaptable for a projection system including a projection target, an image capturing device and a projector. The projection position guiding method includes: projecting projection content to a projection target through a projector to generate a projection image, and the projection content includes a plurality of positioning grid points arranged at intervals. The projection target is captured by the image capturing device to generate a captured image, and the captured image includes at least part of the projection image. It is determined whether the plurality of positioning grid points satisfy a plurality of recognizable conditions according to the projection image in the captured image. When it is determined that the plurality of positioning grid points include at least one unrecognizable grid point that does not satisfy at least one of the plurality of recognizable conditions, the color of the at least one unrecognizable grid point in the projection content is adjusted.

Before projecting the projection image to the projection target through the projector, the projector projects an initial projection content onto the projection target to generate an initial projection image.

The initial projection content comprises a plurality of initial positioning grid points arranged at intervals.

The projection target is captured by the image capturing device to generate an initial captured image.

The initial captured image comprises at least a part of the initial projection image.

It is determined whether the plurality of initial positioning grid points satisfy the plurality of recognizable conditions according to the initial projection image in the initial captured image.

When it is determined that the plurality of initial positioning grid points satisfy the plurality of recognizable conditions, the projection content is projected onto the projection target.

In one or more embodiments, when it is determined that the plurality of initial positioning grid points satisfy the plurality of recognizable conditions, the step of projecting the projection content onto the projection target may comprise converting a coordinate system of the projector and a coordinate system of the image capturing device.

In one or more embodiments, the plurality of recognizable conditions may comprise a resolution of the initial projection image in the initial captured image being greater than a minimum resolution.

In one or more embodiments, a spacing of any two adjacent positioning grid points may be greater than a minimum spacing of two adjacent positioning grid points.

In one or more embodiments, a diameter difference between a largest positioning grid point and a smallest positioning grid point may be less than a maximum distortion amount of the largest positioning grid point.

In one or more embodiments, a gray-scale contrast may be greater than a minimum gray-scale contrast.

In one or more embodiments, it may be determined whether the positioning grid points are completely captured.

In one or more embodiments, the step of determining whether the plurality of initial positioning grid points satisfy the plurality of recognizable conditions according to the initial projection image in the initial captured image may comprise when the plurality of recognizable conditions are all satisfied, it may be determined that the plurality of initial positioning grid points are recognizable.

In one or more embodiments, when at least one of the plurality of recognizable conditions is not satisfied, it may be determined that there is at least one unrecognizable initial grid point among the plurality of initial positioning grid points, and an instruction image may be displayed.

The number of the plurality of initial positioning grid points of the initial projection content is less than the number of the positioning grid points of the projection content.

In one or more embodiments, the plurality of recognizable conditions may comprise a resolution of the projection image in the captured image being greater than a minimum resolution, a spacing between any two adjacent positioning grid points may be greater than a minimum spacing between two adjacent positioning grid points, a diameter difference between a largest positioning grid point and a smallest positioning grid point may be less than a maximum distortion amount of the largest positioning grid point, a gray-scale contrast may be greater than a minimum gray-scale contrast, and whether the positioning grid points may be completely captured, and the step of determining whether the plurality of positioning grid points satisfy the plurality of recognizable conditions according to the projection image in the captured image may comprise when the plurality of recognizable conditions are all satisfied, it may be determined that the plurality of positioning grid points are recognizable, and when at least one of the plurality of recognizable conditions is not satisfied, it may be determined that the plurality of positioning grid points comprise the at least one unrecognizable grid point.

In one or more embodiments, the method may further comprise comparing the projection content with the projection image in the captured image to determine whether the plurality of positioning grid points are completely captured.

In one or more embodiments, when it is determined that the plurality of positioning grid points are not completely captured, the plurality of positioning grid points may comprise at least one incompletely captured positioning grid point, and a color of the at least one incompletely captured positioning grid point in the projection content and a color of a positioning grid point adjacent to the at least one incompletely captured positioning grid point may be adjusted, so as to generate a plurality of indicating grid points for adjusting a projection environment.

In one or more embodiments, the plurality of indicating grid points may be configured to provide information for adjusting a position and a direction of the projector or the image capturing device or adjusting the projection environment.

In one or more embodiments, a color of the plurality of indicating grid points may be different from a first color of the plurality of positioning grid points.

In one or more embodiments, when it is determined that the plurality of positioning grid points are not completely captured, an instruction image may be projected onto the projection target by the projector.

In one or more embodiments, the instruction image may comprise a plurality of indicating grid points.

In one or more embodiments, the instruction image may be configured to provide information for adjusting a position and a direction of the projector or the image capturing device or adjusting the projection environment.

In one or more embodiments, the instruction image may show in the projection image.

In one or more embodiments, the step of adjusting the color of the at least one unrecognizable grid point (UG) in the projection content may comprise adjusting the color the at least one unrecognizable grid point (UG) in the projection content to a second color.

In one or more embodiments, the second color may be different from a first color of the plurality of positioning grid points.

In one or more embodiments, the method may further comprise adjusting a color of at least one boundary grid point adjacent to the at least one unrecognizable grid point in the projection content to a third color.

In one or more embodiments, the third color may be different from the first color and the second color.

In one or more embodiments, the method may further comprise adjusting a color of a border of the projection content to a fourth color.

Another embodiment of the present disclosure provides a projection position guiding method, which is adaptable for a projection system. The projection system includes a projection target, a plurality of image capturing devices, and a plurality of projectors. The projection position guiding method includes: projecting projection content to a projection target through each of a plurality of projectors to generate a projection image, and the projection content includes a plurality of positioning grid points arranged at intervals; capturing the projection target by the corresponding image capturing device to generate a captured image, and the captured image includes at least part of the projection image; determining whether the plurality of positioning grid points satisfy a plurality of recognizable conditions according to the projection image in the captured image; and when it is determined that the plurality of positioning grid points include at least one unrecognizable grid point that does not satisfy at least one of the plurality of recognizable conditions, adjusting the color of the at least one unrecognizable grid point in the projection content.

In one or more embodiments, each of the plurality of projectors may project the projection content and may generate the projection image onto a partial area of the projection target, and the projection images projected by the plurality of projectors may be formed into a blending projection image.

Based on the above, the embodiments of the present disclosure have at least one of the following advantages or effects. In the projection position guiding method described in the embodiments of the present disclosure, when it is determined that at least one of the multiple projected positioning grid points does not meet the recognizable conditions, the color of at least one unrecognizable grid point in the projection content is adjusted to serve as an instruction obtained from the projection image for the user to adjust the position and direction of the image capturing device or projector, and no additional external device is required to provide the instruction for adjustment. In addition, the position of unrecognizable grid points can be clearly displayed to narrow the range of environmental adjustment.

Other objectives, features and advantages of the present disclosure will be further understood from the further technological features disclosed by the embodiments of the present disclosure wherein there are shown and described preferred embodiments of this disclosure, simply by way of illustration of modes best suited to carry out the disclosure.

It is to be understood that other embodiment may be utilized and structural changes may be made without departing from the scope of the present disclosure. Also, it is to be understood that the phraseology and terminology used herein are for the purpose of description and should not be regarded as limiting. The use of "including," "comprising," or "having" and variations thereof herein is meant to encompass the items listed thereafter as well as additional items. Unless limited otherwise, the terms "connected," "coupled," and "mounted," and variations thereof herein are used broadly and encompass direct and indirect connections, couplings, and mountings.

<FIG> is a schematic view of a projection system according to an embodiment of the present disclosure. Referring to <FIG>, the projection system <NUM> of this embodiment includes a projector <NUM>, an image capturing device <NUM> and a projection target <NUM>. The projector <NUM> projects the projection content onto the projection target <NUM> to generate a projection image, and the image capturing device <NUM> captures the projection target <NUM> to generate a captured image. The captured image includes at least a part of the projection image. The image capturing device <NUM> is coupled to the projector <NUM>, and the image capturing device <NUM> is configured to provide the captured image to the projector <NUM>. The projector <NUM> may include a processor (not shown) for performing data processing such as making judgment and adjustment described in the disclosure. The projection target <NUM> is, for example, a projection screen or a wall. The image capturing device <NUM> is an external device disposed outside the projector <NUM>. In the other embodiment, the image capturing device <NUM> is a device disposed inside the projector <NUM> or disposed on the projector <NUM>.

<FIG> is a flowchart illustrating a projection position guiding method according to an embodiment of the present disclosure. <FIG> is a schematic view illustrating a projection image and a captured image according to an embodiment of the present disclosure. Please refer to <FIG> and <FIG>. In step S210, the projection system <NUM> projects the projection content onto the projection target <NUM> through the projector <NUM> to generate the projection image PA. The projection content includes a plurality of positioning grid points arranged at intervals, and the plurality of positioning grid points are multiple circular grid points in the projection image PA. The projection content is the image information that the projector <NUM> receives from the external image source or the image information which is stored in the projector <NUM>. In the projection content, each positioning grid point of the plurality of positioning grid points has the same size and is arranged at a distance with fixed interval. The plurality of positioning grid points are arranged in an array. Taking <FIG> and <FIG> as an example, the projection content is projected by the projector <NUM> onto the projection target <NUM> to generate the projection image PA. The positioning grid points are used to define the position of the projection image in the captured image. For example, in <FIG>, the projection image PA is located toward the right side of the captured image TA, and the projection image PB is located toward the right side of the captured image TB. In the other embodiment, each of the plurality of positioning grid points may be a square or a rectangular point in the projection content.

Next, in step S220, the projection system <NUM> captures the projection target <NUM> through the image capturing device <NUM> to generate a captured image, and the captured image includes at least part of the projection image. Taking <FIG> as an example, the captured image TA may include part of the projection image PA.

In step S230, the projection system <NUM> determines whether the plurality of positioning grid points satisfy a plurality of recognizable conditions according to the projection image in the captured image. Specifically, when the positioning grid points meet multiple recognizable conditions, such positioning grid points are determined to be recognizable grid points. When the positioning grid points do not meet at least one of the multiple recognizable conditions, such positioning grid points are determined to include at least one unrecognizable grid point. In an embodiment, the plurality of recognizable conditions may include five recognizable conditions. The first recognizable condition is that the resolution of the projection image in the captured image is greater than the minimum resolution. The second recognizable condition is that a spacing of any two adjacent positioning grid points is greater than a minimum spacing of two adjacent positioning grid points. The third recognizable condition is that the difference in the diameters of the largest positioning grid point and the smallest positioning grid point is less than the distortion amount of the largest positioning grid point. The fourth recognizable condition is that the gray-scale contrast is greater than the minimum gray-scale contrast. The fifth recognizable condition is that all the positioning grid points are captured and shown in the captured image.

For example, regarding the first recognizable condition, if the minimum resolution is <NUM> by <NUM> pixels, when the resolution of the captured image which includes at least part of the multiple positioning grid points is greater than <NUM> by <NUM> pixels, it is determined that the first recognizable condition is satisfied. When the resolution of the captured image is less than <NUM> by <NUM> pixels, it is determined that the first recognizable condition is not satisfied. Regarding the second recognizable condition, if the minimum spacing between two adjacent positioning grid points in the captured image is <NUM>, then when the spacing between any two adjacent positioning grid points is greater than <NUM> (the minimum spacing), it is determined that the second recognizable condition is satisfied. When the spacing of the two adjacent positioning grid points is less than <NUM> (the minimum spacing), it is determined that the second recognizable condition is not satisfied. In an embodiment, the minimum spacing of the two adjacent positioning grid points may be equivalent to the radius of each of the two adjacent positioning grid point, but is not limited thereto. Regarding the third recognizable condition, if the distortion amount of the largest positioning grid point is <NUM>, then when the difference in the diameters of the largest positioning grid point and the smallest positioning grid point is less than <NUM>, it is determined that the third recognizable condition is satisfied. When the difference in the diameters of the largest positioning grid point and the smallest positioning grid point is greater than <NUM>, it is determined that the third recognizable condition is not satisfied. For example, the diameter of the largest positioning grid point among the multiple positioning grid points is <NUM> and the diameter of the smallest positioning grid point is <NUM>, then the diameter difference between the largest positioning grid point and the smallest positioning grid point is <NUM>, which is less than the distortion amount of the largest positioning grid point <NUM>. That is, the third recognizable condition is satisfied. The diameter of the largest positioning grid point in the multiple positioning grid points is <NUM> and the diameter of the smallest positioning grid point is <NUM>, then the diameter difference between the largest positioning grid point and the smallest positioning grid point is <NUM>, which is greater than the distortion amount of the largest positioning grid point <NUM>. That is, the third recognizable condition is not satisfied. In an embodiment, the distortion amount of the largest positioning grid point may be <NUM>% of the diameter of the largest positioning grid point, but is not limited thereto. Regarding the fourth recognizable condition, when the gray-scale contrast between the positioning grid points and the region without the positioning grid points in the captured image is greater than the minimum gray-scale contrast, it is determined that the fourth recognizable condition is satisfied. When the gray-scale contrast between the positioning grid points and the region without positioning grid points in the captured image is less than the minimum gray-scale contrast, it is determined that the fourth recognizable condition is not satisfied. Regarding the fifth recognizable condition, when all the positioning grid points are completely captured based on the comparison between the projection image in the captured image and the projection content, it is determined that the positioning grid points satisfy the fifth recognizable condition. When at least one of the positioning grid points is not captured based on the comparison between the projection image in the captured image and the projection content, it is determined that the fifth recognizable condition is not satisfied. For example, the positioning grid points in the rightmost column of the captured image TA or TB in <FIG> are not completely captured. Then the fifth recognizable condition is not satisfied.

When the positioning grid points do not satisfy at least one of the recognizable conditions, such positioning grid points are determined to include at least one unrecognizable grid point. In step S240, when the projection system <NUM> determines that the plurality of positioning grid points include at least one unrecognizable grid point, a color of at least one unrecognizable grid point in the projection content is adjusted. The unrecognizable grid point is the positioning grid point that does not satisfy at least one of the multiple recognizable conditions. For example, please refer to <FIG>, since the positioning grid points in the rightmost column of captured image TA are not completely captured, and do not satisfy the fifth recognizable condition, the projection system <NUM> determines that the positioning grid points in the rightmost column of the projection image PA are unrecognizable grid points (also referred to as incompletely captured grid points), and the rest of the positioning grid points in the projection image PA are recognizable grid points. The color of the unrecognizable grid points in the projection content is adjusted. The adjusted projection image PB includes the unrecognizable grid points U0 and the recognizable grid points R0, and the color of the unrecognizable grid points U0 is different from the color of the recognizable grid points R0.

Please refer to <FIG>, the projector <NUM> projects the projection content onto the projection target <NUM> to generate a projection image PA, and the image capturing device <NUM> captures the projection image PA to generate a captured image TA. The captured image TA may include at least part of the projection image PA. In this embodiment, since the positioning grid points in the rightmost column of captured image TA are not completely captured and do not satisfy the fifth recognizable condition and are determined as unrecognizable grid points, the projection system <NUM> may adjust the projection content according to the determination, so that the projection image PA becomes the projection image PB. The projection content in the projection image PB includes a plurality of unrecognizable grid points U0 and a boundary grid point B0 located between the plurality of unrecognizable grid points U0 and a plurality of recognizable grid points R0. The color (the third color) of the boundary grid point B0 is different from the color (the second color) of the unrecognizable grid point U0 and the color (the first color) of the recognizable grid point R0. The projection image PB corresponding to the adjusted projection content is projected to the projection target <NUM> and then captured by the image capturing device <NUM> as the captured image TB. The colors of the positioning grid points in the captured image TB correspond to the colors of the positioning grid points in the projection image PB. In this embodiment, the captured image TB includes part of the projection image PB. The projection system <NUM> may set the color (fourth color) of the border of the projection image PB in the captured image TB for recognizing the border of the projection image PB in the captured image TB. The unrecognizable grid point U0 and the boundary grid point B0 may be used as a plurality of indicating grid points, so as to provide information for adjusting the position and direction of the projector <NUM> or the image capturing device <NUM> or adjusting the projection environment. For instance, the direction of the image capturing device <NUM> or the projection angle of the projector <NUM> relative to the projection target <NUM> is correspondingly moved according to the positions of the boundary grid points B0 of the projection image PB in the captured image TB, such that the captured image is able to show the entire and complete projection image.

<FIG> is a schematic view illustrating a projection position guiding method according to an embodiment of the present disclosure. <FIG> is a schematic view of a projection position guiding method corresponding to <FIG> according to an embodiment of the present disclosure. Referring to <FIG> and <FIG>, in step S410, the projection system <NUM> determines whether the projection position guiding function is activated, and if so, proceeds to step S420, otherwise step S410 is repeated. In step S420, the projector <NUM> projects the initial projection content onto the projection target <NUM> to generate an initial projection image P1. The initial projection content shown in the projection image P1 includes a plurality of initial positioning grid points arranged at intervals. It should be noted that <FIG> and <FIG> are only examples, and the actual number and arrangement of the initial positioning grid points are determined based on actual design requirements, and are not limited thereto. The image capturing device <NUM> captures the projection target <NUM> to generate the initial captured image T1, and the initial captured image T1 includes at least part of the initial projection image P1.

Next, in step S430, the projection system <NUM> determines whether the plurality of initial positioning grid points satisfy a plurality of recognizable conditions according to the initial projection image P1 in the initial captured image T1. The recognizable conditions are as described above and will not be repeated here. When the plurality of initial positioning grid points satisfy the plurality of recognizable conditions, the process goes to step S440, and when the plurality of initial positioning grid points do not satisfy at least one of the plurality of recognizable conditions, the process goes to step S480. In step S480, the projection system <NUM> stops the projection position guiding function. For example, the projector <NUM> stops projecting the initial positioning grid point and the image capturing device <NUM> stop capturing images. In step S490, the projection system <NUM> provides other adjustment instructions. In this embodiment, text may be displayed on the display screen (projection target) by the projector <NUM> to provide an environment adjustment method to satisfy the multiple recognizable conditions, such as suggesting the user to improve the poor environment for the projection target <NUM>.

In step S440, the projection system <NUM> converts the coordinate system of the projector <NUM> and the coordinate system of the image capturing device <NUM> to project the projection content onto the projection target <NUM> to generate a projection image P2, and the projection content P2 includes a plurality of positioning grid points arranged at intervals. Specifically, the projection system <NUM> may convert the coordinate system of the projector <NUM> and the coordinate system of the image capturing device <NUM> according to the positions of the multiple initial positioning grid points in the captured image T1, so as to estimate the positions of the multiple positioning grid points of the projection content P2. It should be noted that the number of positioning grid points in the projection content is greater than the number of initial positioning grid points in the initial projection content, and the number of positioning grid points in the projection image P2 is greater than the number of initial positioning grid points in the projection image P1. The actual number and the arrangement of positioning grid points are determined based on the actual design requirements and are not limited thereto. Next, the image capturing device <NUM> captures the projection target <NUM> to generate a captured image T2, and the captured image T2 includes at least part of the projection image P2.

In step S450, the projection system <NUM> determines whether the positioning grid points in the captured image P2 include at least one unrecognizable grid point. When the projection system <NUM> determines that the captured image P2 has at least one unrecognizable grid point, the process goes to step S460. When the projection system <NUM> determines that the captured image <NUM> does not have any unrecognizable grid point, the process returns to step S410. In this embodiment, after comparing the projection content projected by the projector <NUM> with the projection image P2 in the captured image T2, it may be determined that the multiple positioning grid points in the captured image T2 are not completely captured and do not satisfy the fifth recognizable condition, that is, it can be determined that the positioning grid points of the captured image T2 includes at least one unrecognizable grid point, so step S460 should be performed.

In step S460, the color of the unrecognizable grid points UG in the projection content is correspondingly changed to be the second color by the projector <NUM> according to the positions of the unrecognizable grid points in the captured image T2, the color of the boundary grid points BG adjacent to the unrecognizable grid points UG in the projection content is changed to be the third color, and the adjusted projection content is projected onto the projection target <NUM> and a projection image P3 is generated. The color of the positioning grid points RG excluding the unrecognizable grid points UG and the boundary grid points BG in the projection content is the first color. The first color, the second color, and the third color are different. In this embodiment, the unrecognizable grid points UG are not completely captured in the captured image T3. In this embodiment, the recognizable grid points RG include the boundary grid points BG, and the boundary grid points BG are located adjacent the unrecognizable grid points UG. The indicating grid points are correspondingly generated according to the distribution of the unrecognizable grid points UG and the boundary grid points BG in the projection content. The indicating grid points are information for adjusting the position and direction of the projector <NUM> or the image capturing device <NUM> or information for adjusting the projection environment. In the other embodiment, the unrecognizable grid points UG and the boundary grid points BG may serve as indicating grid points. Next, the image capturing device <NUM> captures the projection target <NUM> to generate a captured image T3, and the captured image T3 includes at least part of the projection image P3.

In step S470, the projection system <NUM> generates an instruction image IF for adjusting the projection environment according to the distribution positions of the unrecognizable grid points UG and the boundary grid points BG in the projection content, and projects the instruction image IF onto the projection target <NUM> to generate the projection image P4. Moreover, the image capturing device <NUM> captures the projection target <NUM> to generate a captured image T4. The instruction image IF includes a plurality of indicating grid points IG, and the color (fifth color) of the plurality of indicating grid points IG is different from the color (first color) of the plurality of positioning grid points. The plurality of indicating grid points IG in the instruction image IF are configured to provide information for adjusting the position and direction of the projector <NUM> or the image capturing device <NUM> or adjusting the projection environment, and the instruction image IF shows in the projection image P4. Specifically, the instruction image IF may be a direction arrow, such as a direction arrow indicating the right side in the projection content P4, to instruct the image capturing device <NUM> to rotate toward the right side or move to the right side, or to instruct the projector <NUM> to rotate toward to the left side or move to the left side, or to instruct the projection target <NUM> to move to the right side, etc., so as to obtain the captured image including complete projection image. Next, the process returns to step S410.

<FIG> is a schematic view illustrating a projection position guiding method according to an embodiment of the present disclosure. <FIG> is a schematic view of a projection position guiding method corresponding to <FIG> according to another embodiment of the present disclosure. Referring to <FIG> and <FIG>, in step S510, the projection system <NUM> determines whether the projection position guiding function is activated, and if so, proceeds to step S520, otherwise step S510 is repeated. In step S520, the projector <NUM> projects the initial projection content to the projection target <NUM> to generate an initial projection image P5. The initial projection content includes a plurality of initial positioning grid points arranged at intervals. The image capturing device <NUM> captures the projection target <NUM> to generate an initial captured image T5, and the initial captured image T5 includes the initial projection image P5. Next, in step S530, the projection system <NUM> determines whether the plurality of initial positioning grid points satisfy a plurality of recognizable conditions according to the initial projection image P5 in the initial captured image T5. The recognizable conditions are as described above and will not be repeated here. When the plurality of initial positioning grid points satisfy the plurality of recognizable conditions, go to step S540, and when the plurality of initial positioning grid points do not satisfy at least one of the plurality of recognizable conditions, go back to step S520.

In step S540, the projection system <NUM> converts the coordinate system of the projector <NUM> and the coordinate system of the image capturing device <NUM> to project the projection content to the projection target <NUM> to generate a projection image P6. The projection content includes a plurality of positioning grid points arranged at intervals. Specifically, the projection system <NUM> may convert the coordinate system of the projector <NUM> and the coordinate system of the image capturing device <NUM> according to the positions of the initial positioning grid points in the captured image T5, so as to estimate the positions of the plurality of positioning grid points in the projected content. It should be noted that the number of positioning grid points in the projection content is greater than the number of initial positioning grid points in the initial projection content, the number of positioning grid points in the projection image P6 is greater than the number of initial positioning grid points in the initial projection image P5, and the actual number and arrangement of positioning grid points are determined based on the actual design requirements and are not limited thereto. Next, the image capturing device <NUM> captures the projection target <NUM> to generate a captured image T6, and the captured image T6 includes the projection image P6.

In step S550, the projection system <NUM> determines whether the positioning grid points in the captured image T6 includes at leas one unrecognizable grid point. When the projection system <NUM> determines that the captured image T6 has at least one unrecognizable grid point, the process goes to step S560. When the projection system <NUM> determines that the captured image T6 does not have any unrecognizable grid point, the process returns to step S520. In this embodiment, since the area A1 in the captured image T6 is illuminated by a searchlight, the gray-scale contrast between the positioning grid points and the region without positioning grid points in the area A1 is less than the minimum gray-scale contrast, which does not satisfy the fourth recognizable condition, then it may be determined that the corresponding captured image T6 has unrecognizable grid points, so step S560 should be performed.

In step S560, changes the color of the unrecognizable grid points UG in the projection content is correspondingly changed to be the second color by the projector <NUM> according to the positions of the unrecognizable grid points in the captured image T6, the color of the boundary grid points BG adjacent to the unrecognizable grid points UG is changed to be the third color, and the adjusted projection content is projected by the projector <NUM> onto the projection target <NUM> and a projection image P7 is generated. The color of the recognizable grip points excluding the unrecognizable grid points UG and the boundary grid points BG is the first color, and the first color, the second color and the third color are different. Next, the image capturing device <NUM> captures the projection target <NUM> to generate a captured image T7, and the captured image T7 includes the projection image P7.

In step S570, the projection system <NUM> may provide an environment adjustment instruction. For example, the projection system <NUM> may provide a text message suggesting the user to turn off the searchlight or reduce the brightness of the searchlight to solve the problem that the gray-scale contrast between the positioning grid points and the region without positioning grid points in the area A1 is less than the minimum gray-scale contrast, resulting in failure to satisfy the recognizable conditions. In step S580, the projection system <NUM> determines whether to stop the projection position guiding function; if so, go back to step S510, otherwise go back to step S520.

<FIG>, and <FIG> are schematic views illustrating a projection position guiding method according to an embodiment of the present disclosure. A projection system <NUM> is configured with a projector 610A, a projector 610B, a projector 610C, an image capturing device 620A, an image capturing device 620B, an image capturing device 620C and a projection target <NUM>. The projector 610A, the projector 610B, and the projector 610C respectively project the projection content with the positioning grid points to the projection target <NUM> in <FIG> , and <FIG> to respectively generate projection images. In <FIG>, the projection image is located toward the right side of the projection target <NUM>, so the positioning grid points on the right side are not completely captured, and therefore the unrecognizable grid points and the recognizable boundary grid points are shown in the projection image. In this embodiment, the projection system <NUM> adjusts the color of the unrecognizable grid points and the color of the boundary grid points, so that the user knows that the unrecognizable grid points are projected on the right side of the projection target <NUM> in <FIG>, thereby providing the user with adjustment instruction of proj ection environment. In <FIG>, the projection image is located in the middle of the projection target <NUM> so the positioning grid points are completely captured, and therefore there are no unrecognizable grid point and recognizable boundary grid point shown in the projection image. In <FIG>, the projection image is located toward the left side of the projection target <NUM>, so the positioning grid points on the left side are not completely captured, and therefore the unrecognizable grid points and the recognizable boundary grid points are shown in the projection image. In this embodiment, the projection system <NUM> adjusts the color of the unrecognizable grid points and the color of the boundary grid points, so that the user knows that the unrecognizable grid points are projected on the left side of the projection target <NUM> in <FIG>, thereby providing the user with adjustment instruction of projection environment.

<FIG> is a flowchart illustrating a projection position guiding method according to an embodiment of the present disclosure. Referring to <FIG>, in this embodiment, the projection position guiding method is applicable to a projection system. The projection system includes a plurality of projectors, a plurality of image capturing devices and a projection target, and can be applied to the blending of a plurality of projection images. In step S710, each projector projects the projection content to the projection target to generate projection image, and the projection content includes a plurality of positioning grid points arranged at intervals. It should be noted that each of the projectors projects projection content and generates the projection image onto a partial area of the projection target, and the multiple projection images projected by the multiple projectors may be blended into a blending projection image. Next, in step S720, the corresponding image capturing device captures the projection target to generate a captured image, and the captured image includes at least part of the projection image. In step S730, the projection system determines whether the plurality of positioning grid points satisfy a plurality of recognizable conditions according to the projection image in the captured image. Next, in step S740, when the projection system determines that the plurality of positioning grid points include at least one unrecognizable grid point, the projection system adjusts the color of the at least one unrecognizable grid point in the projection content, and the at least one unrecognizable grid point is at least one of the positioning grid points that does not satisfy at least one of the plurality of recognizable conditions. For the details of <FIG>, please refer to the related description of <FIG>, and no further description is repeated herein.

To sum up, the embodiments of the present disclosure have at least one of the following advantages or effects. In the embodiments of the present disclosure, when it is determined that at least one of the multiple projected positioning grid points does not meet the recognizable conditions, the color of at least one unrecognizable grid point in the projection content is adjusted, so that the user may obtain the instruction for adjusting the position and direction of the image capturing device or projector from the projection image, so as to adjust the projection environment, thereby satisfying the image capturing requirement required by the projection system for performing automatic adjusting function. Therefore, there is no need to use an external device to see the adjustment instruction. In addition, the position of unrecognizable grid points can be clearly displayed to narrow the range for environment adjustment. Furthermore, before the auto blending is performed, the user may determine whether the positions or directions of the plurality of projectors and the plurality of image capturing devices need to be adjusted respectively to meet the image capturing conditions, so as to make pre-adjustment to improve the user experience.

Claim 1:
A projection position guiding method, adapted to a projection system (<NUM>), the projection system (<NUM>) comprising a projection target (<NUM>), an image capturing device (<NUM>) and a projector (<NUM>), and the projection position guiding method comprising:
projecting a projection content to the projection target (<NUM>) through the projector (<NUM>) to generate a projection image (PA), wherein the projection content comprises a plurality of positioning grid points arranged at intervals;
capturing the projection target (<NUM>) by the image capturing device (<NUM>) to generate a captured image (TA), wherein the captured image (TA) comprises at least a part of the projection image (PA); and
determining whether the plurality of positioning grid points satisfy a plurality of recognizable conditions according to the projection image (PA) in the captured image (TA),
wherein when it is determined that the plurality of positioning grid points comprise at least one unrecognizable grid point (U0) that does not satisfy at least one of the plurality of recognizable conditions, adjusting a color of the at least one unrecognizable grid point (U0) in the projection content;
characterized in that
before projecting the projection image to the projection target (<NUM>) through the projector (<NUM>),
the projector (<NUM>) projects an initial projection content onto the projection target (<NUM>) to generate an initial projection image (P1), wherein the initial projection content comprises a plurality of initial positioning grid points arranged at intervals, and wherein the number of the plurality of initial positioning grid points of the initial projection content is less than the number of the positioning grid points of the projection content;
the projection target (<NUM>) is captured by the image capturing device (<NUM>) to generate an initial captured image (T1), wherein the initial captured image (T1) comprises at least a part of the initial projection image (P1);
it is determined whether the plurality of initial positioning grid points satisfy the plurality of recognizable conditions according to the initial projection image (P1) in the initial captured image (T1); and
when it is determined that the plurality of initial positioning grid points satisfy the plurality of recognizable conditions, performing said step of projecting the projection content onto the projection target (<NUM>).