Source: https://patents.google.com/patent/JP2012208926A/en
Timestamp: 2020-08-09 10:08:31
Document Index: 448000456

Matched Legal Cases: ['art 12', 'art 12', 'art 13', 'art 13', 'art 11', 'art 15', 'art 11', 'art 15', 'art 15', 'art 15', 'art 15']

JP2012208926A - Detection device, input device, projector and electronic apparatus - Google Patents
Detection device, input device, projector and electronic apparatus Download PDF
JP2012208926A
JP2012208926A JP2012046970A JP2012046970A JP2012208926A JP 2012208926 A JP2012208926 A JP 2012208926A JP 2012046970 A JP2012046970 A JP 2012046970A JP 2012046970 A JP2012046970 A JP 2012046970A JP 2012208926 A JP2012208926 A JP 2012208926A
JP2012046970A
2011-03-15 Priority to JP2011056819 priority Critical
2012-03-02 Application filed by Nikon Corp, 株式会社ニコン filed Critical Nikon Corp
2012-10-25 Publication of JP2012208926A publication Critical patent/JP2012208926A/en
238000003384 imaging method Methods 0.000 claims abstract description 94
230000001678 irradiating Effects 0.000 claims abstract description 25
An object of the present invention is to reduce erroneous detection of instructions by a user.
A detection device (10) includes an imaging unit (15) for imaging a wavelength region of infrared light, a first infrared light for detecting a tip of a hand on a detection target surface, and a first An infrared light irradiation unit (11) that irradiates a region farther from the detection target surface than the infrared light with a second infrared light, and a first infrared light and a second infrared light. The image of the tip portion extracted based on the image picked up by detecting the orientation of the hand based on the image picked up by the image pickup unit (15) by irradiation and irradiating the first infrared light And a detection unit (19) for detecting the position of the tip on the detection target surface based on the region and the detected orientation of the hand.
A detection device for detecting an instruction operation by a user and an input device using the detection device are known (see, for example, Patent Document 1).
In the input device described in Patent Document 1, a user directly indicates a projection image, detects an instruction by detecting a movement of a user's finger or a stylus held by the user, and a character or the like is detected by the detected instruction. It is possible to input. At this time, for example, detection is performed using reflection of infrared light. In addition, the pressing operation by the user's finger is detected by, for example, analyzing a difference in infrared images before and after the finger is pressed.
SUMMARY An advantage of some aspects of the invention is that it provides a detection device, an input device, a projector, and an electronic apparatus that can reduce erroneous detection of an instruction by a user.
In order to solve the above problem, an embodiment of the present invention includes an imaging unit that images a wavelength region of infrared light, first infrared light that detects a tip portion of an instruction unit on a detection target surface, An irradiating unit that irradiates a second infrared light that irradiates a region farther from the detection target surface than the first infrared light; the first infrared light; and the second infrared light; The tip extracted based on the image captured by irradiating the first infrared light is detected based on the image captured by the imaging unit by irradiating the first infrared light. And a detection unit that detects the position of the tip on the detection target surface based on the detected image area and the detected orientation of the instruction unit.
Moreover, one Embodiment of this invention is an input device provided with the said detection apparatus.
In addition, an embodiment of the present invention is a projector including the input device and a projection unit that projects an image on the detection target surface.
An embodiment of the present invention is an electronic apparatus including the input device.
ADVANTAGE OF THE INVENTION According to this invention, the misdetection of the instruction | indication by a user can be reduced.
It is a perspective view for describing one embodiment of the present invention. It is a block diagram which shows the internal structure of the projector 30 of FIG. It is a side view which shows the light beam of the perpendicular direction in the 1st infrared light irradiation part 12 of FIG. It is a top view which shows the light beam of the horizontal direction in the 1st infrared light irradiation part 12 of FIG. It is a side view which shows the light beam of the perpendicular direction in the 2nd infrared light irradiation part 13 of FIG. It is a side view which shows the light beam of the perpendicular direction in the modification of the 2nd infrared light irradiation part 13 of FIG. 3 is a timing chart for explaining the operation of the detection device 10 of FIG. 2. It is a figure which shows an example of the image used in order to demonstrate operation | movement of the detection apparatus 10 of FIG. It is a figure which shows an example of the shape of a user's hand used in order to demonstrate operation | movement of the detection apparatus 10 of FIG. It is a 1st figure which shows an example of the shape of a user's hand used for demonstrating operation | movement of the detection apparatus 10 of FIG. 2, and an example of a difference image. It is a 2nd figure which shows an example of the shape of a user's hand used for demonstrating operation | movement of the detection apparatus 10 of FIG. 2, and an example of a difference image. It is a 3rd figure which shows an example of the shape of a user's hand used for demonstrating operation | movement of the detection apparatus 10 of FIG. 2, and an example of a difference image. It is a timing chart for demonstrating the operation | movement in other embodiment of this invention. It is a figure which shows an example of the image used in order to demonstrate the operation | movement in other embodiment of this invention. It is a block diagram which shows an example of an internal structure of the projector 30b of other embodiment of this invention. It is a 1st figure which shows an example of operation | movement of the detection apparatus 10a of FIG. It is a 2nd figure which shows an example of operation | movement of the detection apparatus 10a of FIG. It is a figure which shows an example of operation | movement of the projector 30b of FIG. It is a figure which shows another example of operation | movement of the projector 30b of FIG. It is a 1st figure which shows another example of operation | movement of the detection apparatus 10a of FIG. FIG. 16 is a second diagram illustrating another example of the operation of the detection device 10a of FIG. FIG. 16 is a schematic diagram illustrating an example in which the detection device 10a of FIG. 15 is applied to a tablet terminal 40. It is a block diagram which shows an example of a structure of the tablet terminal 40 of FIG. It is a figure which shows an example of the infrared light irradiation part 11 and the imaging part 15 in the tablet terminal 40 of FIG. It is a figure which shows an example of the infrared light irradiation part 11 and the imaging part 15 in the tablet terminal 40 of FIG. It is a 1st figure which shows another example of the imaging part 15 in the tablet terminal 40 of FIG. It is a 2nd figure which shows another example of the imaging part 15 in the tablet terminal 40 of FIG. It is the 3rd figure which shows another example of the imaging part 15 in the tablet terminal 40 of FIG.
In this embodiment, the detection target surface 2 is assumed to be a table top. However, the detection target surface 2 may be a wall surface, a ceiling surface, a floor surface, a projection screen, a plane body such as a blackboard or a white board, a curved surface body such as a spherical shape, or a moving body such as a belt conveyor. The detection target surface 2 is not limited to the surface on which the projection image 3 is projected, and may be a flat panel such as a liquid crystal display.
The projection unit 31 includes a light source, a liquid crystal panel, a lens, a control circuit for the light source and lens, and a liquid crystal panel. The projection unit 31 enlarges the image input from the projection image generation unit 32 and projects it on the detection target surface 2 to generate the projection image 3.
The system control unit 21 generates control information to be output to the projection image generation unit 32 based on the content of the instruction operation by the user detected by the detection device 10. Further, the system control unit 21 controls the operations of the object extraction unit 17 and the indication point extraction unit 18 in the detection apparatus 10. Further, the system control unit 21 receives the extraction result from the object extraction unit 17 and the indication point extraction unit 18. The system control unit 21 includes a CPU (central processing unit), a main storage device, an auxiliary storage device, and other peripheral devices, and is configured as a device that realizes various functions by executing predetermined programs. Can do. Further, the system control unit 21 may be configured to include a part of the configuration in the detection device 10 (that is, the system control unit 21 and the detection device 10 are integrated).
The imaging unit 15 includes an imaging device such as a CCD (charge coupled device), a lens, an infrared transmission filter, and the like. The imaging unit 15 captures the wavelength region of the infrared light that has been transmitted through the infrared transmission filter and captures the reflected light of the first infrared light and the second infrared light with the imaging device. Thus, the movement of the user's hand or finger on the detection target surface 2 is photographed as a moving image (or a continuous still image). The imaging unit 15 outputs a vertical synchronization signal (vsync) for moving image shooting and an image signal for each frame to the frame image acquisition unit 16. The frame image acquisition unit 16 sequentially acquires the image signal and the vertical synchronization signal of each frame imaged by the imaging unit 15 from the imaging unit 15. The frame image acquisition unit 16 generates a predetermined synchronization signal based on the acquired vertical synchronization signal and outputs it to the infrared light control unit 14.
In the example illustrated in FIG. 1, the imaging unit 15, the projection unit 31, the emission unit of the first infrared light irradiation unit 12, and the emission unit of the second infrared light irradiation unit 13 are provided on the external front surface of the projector 30. It is installed in a straight line up and down. In the following description, the case where the “instruction unit” is the user's “hand” and the “tip” of the instruction unit is the user's “finger” will be described as an example.
Further, as shown in FIG. 4, the irradiation region 121 in the planar direction has a fan shape and is adjusted so as to cover many portions of the projection image 3. The first infrared light is used to detect that the tip of the finger is in contact with the detection target surface 2. For example, the first infrared light irradiation unit 12 is provided with a plurality of parallel light infrared LEDs having relatively narrow directivities on a plane in different directions on the plane, as shown in FIG. It can also be configured by having a wide directivity.
A projector 30a (corresponding to the projector 30) illustrated in FIG. 6 includes a first infrared light irradiation unit 12a having a configuration similar to that of the first infrared light irradiation unit 12 illustrated in FIG. The infrared light irradiation unit 13a is arranged side by side in the vertical direction as an example. In this case, the first infrared light irradiation unit 12a is used to irradiate the first infrared light and irradiates the second infrared light together with the plurality of second infrared light irradiation units 13a. Also used for. That is, in the projector 30a shown in FIG. 6, the irradiation region 131a having a wide irradiation width in the vertical direction is generated using the first infrared light irradiation unit 12a and the plurality of second infrared light irradiation units 13a. .
Next, the operation of the detection apparatus 10 will be described with reference to FIGS.
FIG. 8 shows an image 50 as an example of an image (first image) of the n frame (at the time of first infrared light irradiation) in FIG. 7 and an image (first image of the n + 1 frame (at the time of second infrared light irradiation). 2) is an example of the image 53. In addition, the images 50 and 53 of FIG. 8 have shown the picked-up image when the hand 4 that has gripped as shown in FIG. 9 is placed on the detection target surface 2.
FIG. 9A is a plan view and FIG. 9B is a side view. In this example, as shown in FIG. 9B, the hand 4 is in contact with the detection target surface 2 at the tip 41 of the index finger, and the other fingers are not in contact. In the image 50 of FIG. 8, the portion of the tip 41 of the index finger in FIG. 9 is a high luminance region (ie, a region having a large pixel value; a first infrared light reflection region) 52, and a low luminance region That is, the region 51 has a small pixel value. On the other hand, in the image 53 of FIG. 8, the entire hand 4 of FIG. 9 is a medium luminance region (that is, a region having a medium pixel value; a second infrared light reflection region) 55. This is an area 54.
The frame image acquisition unit 16 in FIG. 2 acquires an image from the imaging unit 15 in units of frames. Then, the acquired image is output to the object extraction unit 17. In this example, an example in which the frame image acquisition unit 16 outputs the image 50 and the image 53 illustrated in FIG. 9 to the object extraction unit 17 will be described.
In the frame acquisition image captured by the imaging unit 15, surrounding objects other than the hand 4 are also reflected by sunlight or infrared light emitted by an indoor lighting environment. Further, the intensity of the second infrared light is made lower than that of the first infrared light, so that the first infrared light irradiation and the display state of the hand 4 are distinguished. Therefore, the object extraction unit 17 can cut out only the hand 4 by taking the difference between the frame images at the time of the first infrared light irradiation and the second infrared light irradiation.
Here, with reference to FIG. 10, the extraction process of the designated point extraction unit 18 when there are a plurality of first infrared light reflection regions will be described.
In the example shown in FIG. 10, as shown in FIG. 10A, the hand 4a is placed on the detection target surface 2 in the direction of the hand indicated by the arrow (that is, the direction entering from the front of the device (= projector 30)). In addition, it is assumed that all the fingers are in contact with the detection target surface 2. In this case, the object extraction unit 17 calculates a difference image 60 as shown in FIG. The difference image 60 includes a low luminance region 61, high luminance regions 62 to 64, and a medium luminance region 65.
As the predetermined image processing, the following can be used. That is, as one method, there is pattern matching based on a comparison between a pattern of a medium luminance region (image region of the instruction unit) and a predetermined reference pattern. As another method, by detecting a position that overlaps the medium luminance region (the image region of the instruction unit) among the boundary lines of the detection range specified in advance within the imaging range of the imaging unit 15, the arm side (root side) of the hand There is something to get directions. As another method, there is a method of calculating the hand insertion direction based on the motion vector of the medium luminance region (image region of the instruction unit) extracted in the past. The direction of the instruction unit can be detected by one or a combination of these.
In this case, it is assumed that the direction of the hand indicated by the arrow in FIG. The indication point extraction unit 18 determines the position of the tip (referred to as the indication point) of the hand (instruction unit) based on the direction of the hand and the position of the high luminance region (that is, the first infrared light reflection region). To extract. For example, when the hand enters from the front of the apparatus, the lowermost area among the areas reflected by the first infrared light is set as the indication point. For example, when the hand enters from the left side of the apparatus, the rightmost region is set as the indication point.
In the example shown in FIG. 10, since the indication point extraction unit 18 recognizes that the hand 4a has entered from the front of the apparatus, the lowest region among the regions reflected by the first infrared light, that is, the high luminance region 63 is determined as the designated point. Then, the indication point extraction unit 18 outputs the position information of the high brightness area 63 to the system control unit 21.
Next, another example of the extraction process of the indication point extraction unit 18 when there are a plurality of first infrared light reflection regions will be described with reference to FIG. In the example shown in FIG. 11, as shown in FIG. 11A, the hand 4 b is placed on the detection target surface 2 in the direction of the hand indicated by the arrow (that is, from the upper right to the direction of the apparatus in FIG. 9), and the index finger 42. And the thumb 43 are in contact with the detection target surface 2. In this case, the object extraction unit 17 calculates a difference image 70 as shown in FIG.
In this case, it is assumed that the direction of the hand indicated by the arrow in FIG. That is, in the example shown in FIG. 10, the indication point extraction unit 18 recognizes that the hand 4b has entered the device slightly obliquely, and therefore the most advanced direction of the hand in the region reflected by the first infrared light. The region (that is, the high luminance region 72) is determined as the designated point. Then, the indication point extraction unit 18 outputs the position information of the high brightness area 72 to the system control unit 21.
In the example shown in FIG. 12, as shown in FIG. 12A, the hand 4 c is placed on the detection target surface 2 in the direction indicated by the arrow, and the index finger 45 is in contact with the detection target surface 2. It is assumed. In this case, the object extraction unit 17 calculates a difference image 80 as shown in FIG. The difference image 80 includes a low luminance area 81, a high luminance area 82, and a medium luminance area 83. Upon receiving the image 80 from the object extraction unit 17, the indication point extraction unit 18 determines the high luminance region 82 as the indication point because there is one high luminance region (that is, the first infrared light reflection region). . Then, the indication point extraction unit 18 outputs the position information of the high brightness area 82 to the system control unit 21.
2 may perform a process of calculating a movement vector based on the position information of the instruction point extracted in the past, in addition to extracting the position of the instruction point. In this case, for example, when it is detected that the index finger 42 and the thumb 43 move so as to close or open as indicated by solid arrows in FIG. The data is output to the system control unit 21. However, in this case, the position information of all the high-intensity areas in the past fixed period is stored in the designated point extraction unit 18 (or in another storage device) together with the movement vector. In this way, the movement of the hand (instruction unit) can be detected. Note that a pattern recognition method or the like may be used to detect the movement of the indication point.
For example, as illustrated in FIG. 11B, the indication point extraction unit 18 determines the hand indicated by the arrow from the direction of the hand indicated by the arrow and the high luminance areas 72 to 74 (finger tip areas 72 to 74). The high luminance region 72 and the high luminance region 74, which are the tip portions close to the direction, are detected as the positions of the tip portions.
In FIG. 12, for example, the indication point extraction unit 18 detects the positions of a plurality of tip portions based on the orientation of the hand and the high luminance region. In this case, all high brightness areas close to the direction of the hand are detected as the positions of the tips. In this example, as shown in FIG. 12B, the high brightness region 82 is the position of the tip, but when the middle finger 45 and the index finger 45 in FIG. The object extraction unit 17 extracts two high luminance areas. Then, the indication point extraction unit 18 detects a high-luminance region corresponding to the middle finger 45 and the index finger 45 that are the tip portions close to the direction of the hand as the position of the tip portion.
11 and 12, the indication point extraction unit 18 extracts the shape of the hand (instruction unit) from the medium luminance region 75 (or 83) using a pattern recognition method or the like, and the hand (instruction unit). Based on the shape, it may be determined whether to detect a plurality of tip portions. For example, the indication point extraction unit 18 determines that the shape of the hand shown in FIG. 12 is a shape when the keyboard is pressed by using the pattern recognition method or the like for the medium luminance region 83, and the positions of the plurality of tip portions are determined. Is detected. Thereby, the detection apparatus 10 in this embodiment can respond to the detection of a plurality of fingers on the keyboard.
In the example described with reference to FIG. 7, the case where the intensity of the first infrared light and the intensity of the second infrared light are different from each other has been described. The purpose of this is to make the pixel value (luminance) of the reflected light from the first infrared light different from the pixel value (luminance) of the reflected light from the second infrared light in the imaging unit 15. It was. Therefore, it is also possible to adopt the following method instead of changing the strength. That is, for example, so that the pixel value by the first infrared light is relatively large and the pixel value by the second infrared light is relatively small in accordance with the frequency characteristics of the image sensor that constitutes the imaging unit 15, The wavelength of the first infrared light and the wavelength of the second infrared light can be made different. Further, in order to obtain the same effect, in addition to changing the wavelength of the first infrared light and the wavelength of the second infrared light, the characteristics of the infrared transmission filter constituting the imaging unit 15 may be changed. Good.
Accordingly, the orientation of the pointing unit is detected using the first infrared light and the second infrared light having different irradiation areas, and the image captured by irradiating the first infrared light is displayed. The position of the tip on the detection target surface is detected based on the image area of the tip that is extracted based on the detected direction of the pointing unit. That is, since the detection device 10 in the present embodiment detects the orientation of the hand, it is possible to reduce erroneous detection of an instruction due to a plurality of tip portions or a difference in the orientation of the hand. In addition, since the detection apparatus 10 in the present embodiment uses infrared light, it is possible to detect the hand without being affected by the color of the human skin, thereby reducing erroneous detection of instructions. it can.
Moreover, it is provided so that the 1st infrared light may detect the front-end | tip part of the instruction | indication part on the detection target surface 2 among 2nd infrared light and 2nd infrared light from which an irradiation area differs. Therefore, the detection apparatus 10 according to the present embodiment can improve the detection accuracy of the position and movement of the tip.
Thereby, a 1st image (image 50) and a 2nd image (image 53) can be acquired easily.
In the present embodiment, the infrared light irradiation unit 11 irradiates the first infrared light and the second infrared light with different light intensities. The detection unit 19 (the object extraction unit 17) is based on a difference image between the first image (image 50) and the second image (image 53) captured by irradiating different light intensities. Image region (hand region 59) and tip image region (finger tip region 58) are extracted, the direction of the pointing unit is detected based on the extracted image region of the pointing unit, and the detected pointing unit Based on the orientation and the image area at the tip, the position of the tip is detected.
Accordingly, in order to perform extraction based on the multi-valued difference image, the detection unit 19 (object extraction unit 17) causes the image area (hand area 59) of the instruction section and the image area (tip area 58 of the tip of the finger) ) Can be easily extracted.
Thereby, the detection apparatus 10 in this embodiment is applicable to the use which detects a some position. For example, the present invention can be applied to a keyboard that uses a plurality of fingers or motion detection that detects hand movement.
FIG. 14 shows an acquired image 90 (third image) of the nth frame (when no infrared light is irradiated), an acquired image 91 (first image) of the (n + 1) th frame (when irradiated with the first infrared light), It is a figure which shows an example of the acquired image 93 (1st image) of the n + 2 frame (at the time of 2nd infrared light irradiation). The state of the instruction unit (hand) is as shown in FIG. In this case, the image 91 includes a high brightness area 92 corresponding to the tip 41 of the index finger in FIG. 9, and the image 93 includes a high brightness area 94 corresponding to the hand 4 in FIG. 9.
Moreover, the detection apparatus 10 in this embodiment does not need to change the light intensity of 1st infrared light and 2nd infrared light. Therefore, the configuration of the infrared light irradiation unit 11 can be simplified.
As shown in FIG. 15, the detection device 10 a in this embodiment is different from the above embodiments in that it includes a spatial position extraction unit 191. The detection apparatus 10a according to the present embodiment includes the spatial position extraction unit 191 so that three-dimensional coordinates when the user's hand is located in space can be acquired. In the present embodiment, in the configuration of the detection apparatus 10a, the object extraction unit 17, the pointing point extraction unit 18, and the spatial position extraction unit 191 correspond to the detection unit 19a. The projector 30b (corresponding to the projector 30) includes an input device 20a (corresponding to the input device 20), and the input device 20a includes a detecting device 10a (corresponding to the detecting device 10).
In addition, the object extraction unit 17 extracts an image region of the hand (instruction unit) (in this case, an image region at the tip of the finger) based on the above-described second image acquired by the frame image acquisition unit 16. For example, the spatial position extraction unit 191 determines the irradiation timing at which the tip of the finger is detected based on the image region of the tip of the finger extracted by the object extraction unit 17. The spatial position extraction unit 191 determines the height direction (vertical direction) finger based on the height of the second infrared light irradiation unit (130a, 130b, 130c) corresponding to the irradiation timing at which the tip of the finger is detected. The position of is detected. As described above, the spatial position extraction unit 191 detects the position in the vertical direction (height direction) of the tip (tip of the finger) based on the plurality of second images described above.
Further, the spatial position extraction unit 191 detects positions in the horizontal direction and the depth direction based on the second image captured by the imaging unit 15. The spatial position extraction unit 191 changes the scale (size) of the tip (tip of the finger) according to the detected height position, for example, in the detection area (imaging range) in the horizontal direction and the depth direction. Absolute position is extracted. That is, the spatial position extraction unit 191 detects the position of the tip in the horizontal direction with respect to the detection target surface 2 based on the position and size of the extracted image area of the instruction unit on the second image.
Further, for example, FIG. 17 illustrates a case where the tip of the finger is in the irradiation range of the second infrared light 131c irradiated by the second infrared light irradiation unit 130b. In this case, the imaging unit 15 captures the image 101a as the second image corresponding to the second infrared light 131c. In the image 101a, a broken line 102a indicates a region where the hand 4 is present, and a region 103a indicates a tip portion (image region 103a at the tip portion) of the finger irradiated with the second infrared light 131c. ing. The spatial position extraction unit 191 detects the three-dimensional position in the space where the instruction unit (hand) moves, as in the case shown in FIG.
As described above, in the detection device 10a according to the present embodiment, the detection unit 19a has the position of the distal end portion in the space where the instruction unit (hand) moves within the imaging range of the imaging unit 15 based on the second image. Is detected. Thereby, since the detection apparatus 10a can detect the position (three-dimensional position) of the front-end | tip part (finger tip) in space, it can perform user interface display according to the position of a finger | toe, for example become.
Here, the displayed video content or the like may be on a server device connected to the network, and the projector 30b can control input while communicating with the server device via the network. There may be.
In addition, for example, the infrared light irradiation unit 11 sequentially irradiates a plurality of second infrared lights whose irradiation ranges in the vertical direction with respect to the detection target surface 2 are different from each other, and the imaging unit 15 includes a plurality of second red lights. A plurality of second images corresponding to each of the external lights are captured. Then, the detection unit 19a detects the vertical position of the tip based on the plurality of second images.
Thereby, the detection apparatus 10a in this embodiment can detect the position of the front-end | tip part of a horizontal direction with a simple means.
Further, in the present embodiment, a case will be described in which detection of the above-described three-dimensional coordinates is applied to the infrared light irradiation unit 11 illustrated in FIG.
For example, FIG. 20 shows a case where the tip of the finger is in the lower region of the irradiation range of the second infrared light 131d irradiated by the second infrared light irradiation unit 13. In this case, the imaging unit 15 captures the image 101c as the second image corresponding to the second infrared light 131d. In the image 101c, a region 102c indicates an image region of the hand irradiated with the second infrared light 131d (an image region of the instruction unit). Based on the image 101c, the detection unit 19a detects the height position corresponding to the irradiation position of the second infrared light 131b as the position of the tip portion in the vertical direction.
Further, for example, FIG. 21 illustrates a case where the tip of the finger is in the upper region of the irradiation range of the second infrared light 131d irradiated by the second infrared light irradiation unit 13. In this case, the imaging unit 15 captures the image 101d as the second image corresponding to the second infrared light 131c. In the image 101d, an area 102d indicates an image area of the hand (image area of the instruction unit) irradiated with the second infrared light 131d. The spatial position extraction unit 191 detects the three-dimensional position in the space where the instruction unit (hand) moves, as in the case shown in FIG.
As described above, in the detection device 10a according to the present embodiment, the detection unit 19a has the position of the distal end portion in the space where the instruction unit (hand) moves within the imaging range of the imaging unit 15 based on the second image. Is detected. Thereby, since the detection apparatus 10a can detect the position (three-dimensional position) of the front-end | tip part (finger tip) in space similarly to 3rd Embodiment, according to the position of a finger | toe, for example The user interface can be displayed.
Thereby, the detection apparatus 10a in this embodiment can detect the position of the front-end | tip part of the orthogonal | vertical direction by a simple means.
For example, as illustrated in FIG. 24, the tablet terminal 40 may be configured such that the detection device 10 a is mounted in a state that is almost flat with the display surface of the display unit 401. In this case, the imaging unit 15 is arranged to look up obliquely upward from the display surface. The imaging unit 15 may be movable and adjustable by the user U1 itself, or may be configured to change the imaging angle in accordance with the tilt of the display unit 401. In addition, the plurality of second infrared light irradiation units (13b, 13c) arranged beside the imaging unit 15 are arranged so as to have different inclinations on the left and right, and the irradiation timing is also the frame frequency of the imaging unit 15. Different forms may be used in synchronism with each other.
In the example shown in FIG. 24, the second infrared light 132b irradiated by the second infrared light irradiation unit 13b is more than the second infrared light 132c irradiated by the second infrared light irradiation unit 13c. Irradiated with an upward tilt. That is, the irradiation range of the second infrared light 132b and the second infrared light 132c is divided into areas. In this case, since the tablet terminal 40 can limit the position of the tip by dividing the area of the second infrared light 132b and the second infrared light 132c, the three-dimensional position can be more accurately determined. Can be extracted.
Moreover, for example, as shown in FIG. 25, the tablet terminal 40 (detection device 10a) includes two or more second infrared light irradiation units (13d to 13g), and has an irradiation range (irradiation area). The form which irradiates different 2nd infrared light (133a-133d) may be sufficient. In this case, the plurality of second infrared light irradiation units (13d to 13g) may divide the winner area by changing only the irradiation direction of the infrared light as described above, or the second infrared light irradiation unit The irradiation area may be divided more finely by changing the arrangement position of (13d to 13g).
Moreover, when the tablet terminal 40 is provided with a touch panel, the form which detects the input by an instruction | indication part (hand) combining the detection apparatus 10a and a touch panel may be sufficient. In this case, the tablet terminal 40 may be configured such that the touch to the detection target surface 2 of the instruction unit (hand) is detected by the touch panel and the first infrared light is not used. By doing so, the tablet terminal 40 can be detected even when the rotational movable range of the imaging unit 15 is small. For example, in general, a camera provided in a tablet terminal cannot detect when a hand is near the screen. Therefore, the tablet terminal 40 may be configured such that only the detection area separated to some extent is detected by the imaging unit 15 and contact is detected by the touch panel.
Further, when the imaging unit 15 as illustrated in FIG. 22 is arranged so as to look up from below, the imaging unit 15 may include a wide-angle lens. Two or more imaging units 15 may be arranged. For example, the imaging unit 15 may be arranged at the four corners (four locations) of the display surface of the display unit 401.
Further, as illustrated in FIG. 28, the detection device 10 a may be configured to use an imaging unit 15 built in the tablet terminal 40. In this case, the detection apparatus 10a may include the mirror 154, and the imaging unit 15 may capture the range (view angle G3) of the display surface of the display unit 401 reflected by the mirror 154.
Irradiating sequentially a plurality of the second infrared lights having different irradiation ranges in the vertical direction with respect to the detection target surface,
JP2012046970A 2011-03-15 2012-03-02 Detection device, input device, projector and electronic apparatus Withdrawn JP2012208926A (en)
JP2012208926A true JP2012208926A (en) 2012-10-25
JP2012046970A Withdrawn JP2012208926A (en) 2011-03-15 2012-03-02 Detection device, input device, projector and electronic apparatus
DE102013008865A1 (en) 2012-09-21 2014-03-27 Hitachi Automotive Systems, Ltd. Electronic control unit
JP2014222385A (en) * 2013-05-13 2014-11-27 富士通株式会社 Detection device and detection program
JP2017126982A (en) * 2015-12-30 2017-07-20 松翰科技股▲ふん▼有限公司 Detection device and optical detection module
KR101811794B1 (en) 2014-01-21 2017-12-22 세이코 엡슨 가부시키가이샤 Position detection device, position detection system, and position detection method
WO2018051886A1 (en) * 2016-09-13 2018-03-22 ソニー株式会社 Display device having detecting function
US10691264B2 (en) 2014-07-29 2020-06-23 Sony Corporation Projection display apparatus
JP5756215B1 (en) * 2014-09-16 2015-07-29 グリッドマーク株式会社 Information processing device
JP2018072495A (en) * 2016-10-27 2018-05-10 セイコーエプソン株式会社 Projector, projection system, and detection light irradiation unit
CN107025454A (en) * 2015-12-30 2017-08-08 松翰科技股份有限公司 Sensing device further and optical sensing module
US10671221B2 (en) 2016-09-13 2020-06-02 Sony Corporation Display apparatus with detection function
WO2012124730A1 (en) 2012-09-20
CN103914152B (en) 2017-06-09 Multi-point touch and the recognition methods and system that catch gesture motion in three dimensions
US20160291801A1 (en) 2016-10-06 Flexible room controls
CN104052950B (en) 2018-07-10 A kind of projecting apparatus
US9787943B2 (en) 2017-10-10 Natural user interface having video conference controls
2015-06-12 A761 Written withdrawal of application