Source: http://www.google.com/patents/US7705737?dq=%223do%22+dna
Timestamp: 2017-05-28 15:47:37
Document Index: 261796472

Matched Legal Cases: ['Application No. 2005', 'art 43', 'art\n43', 'art\n45', 'art\n46', 'Application No. 200610059137', 'Application No. 06111171']

Patent US7705737 - Object identifying device, mobile phone, object identifying method, program ... - Google PatentsSearch Images Maps Play YouTube News Gmail Drive More »Sign inPatentsAn object identifying device includes: an input request unit for requesting an input for starting a shooting operation; an input unit for receiving the input for starting the shooting operation and a control unit for controlling them. The control unit performs a truth and falseness deciding process for...http://www.google.com/patents/US7705737?utm_source=gb-gplus-sharePatent US7705737 - Object identifying device, mobile phone, object identifying method, program executable on computer for operating the object identifying device and computer-readable medium including the programAdvanced Patent SearchTry the new Google Patents, with machine-classified Google Scholar results, and Japanese and South Korean patents.Publication numberUS7705737 B2Publication typeGrantApplication numberUS 11/376,253Publication dateApr 27, 2010Filing dateMar 15, 2006Priority dateMar 15, 2005Fee statusPaidAlso published asCN1834988A, CN100524340C, DE602006005528D1, EP1703442A1, EP1703442B1, US20060210258Publication number11376253, 376253, US 7705737 B2, US 7705737B2, US-B2-7705737, US7705737 B2, US7705737B2InventorsMasahiro SengaOriginal AssigneeOmron CorporationExport CitationBiBTeX, EndNote, RefManPatent Citations (14), Non-Patent Citations (4), Referenced by (15), Classifications (14), Legal Events (2) External Links: USPTO, USPTO Assignment, EspacenetObject identifying device, mobile phone, object identifying method, program executable on computer for operating the object identifying device and computer-readable medium including the program
US 7705737 B2Abstract
1. An object identifying device comprising:
a shooting unit configured to shoot an object to obtain a shot image;
a plurality of buttons comprising operating buttons and a shutter button;
an input request unit configured to request a user to perform an input operation using at least one of the buttons; and
a control unit configured to control the input request unit and the input unit, and is further configured to perform:
an identifying process that identifies the object,
a register process that registers, as a predetermined operation, actuation of at least one of the buttons that causes the shooting unit to shoot the user as the object,
a truth and falseness deciding process that compares the input operation that is received by the input unit in response to the request from the input request unit with the pre-registered operation, and
a matching process performed when the input operation matches the pre-registered operation that compares the shot image with the pre-registered image data of the object;
wherein the identifying process identifies the object as a pre-registered image in the case where the input operation matches the pre-registered operation and the shot image matches the pre-registered image data.
2. The object identifying device according to claim 1, wherein the pre-registered operation includes actuation of one of the operating buttons.
3. The object identifying device according to claim 2, wherein the pre-registered operation includes pressing down the at least one of the buttons for a predetermined time.
4. The object identifying device according to claim 1, wherein the pre-registered operation includes pressing down the at least one of the buttons for a predetermined time.
5. The object identifying device according to claim 1, wherein the control unit is configured to cause to the shooting unit to simulate to shoot the object in the case where the input operation does not match the pre-registered operation.
6. A face identifying device comprising the object identification device according to claim 1, wherein the object to be shot is a face of the user.
7. A mobile phone comprising the object identifying device according to claim 1.
8. An object identifying method comprising:
performing an input request process that requests a user to perform an input operation using at least one of a plurality of buttons of an object identifying device, wherein the plurality of buttons comprise operating buttons and a shutter button;
performing an identifying process that identifies an object;
performing a register process that registers, as a pre-registered operation, actuation of at least one of the buttons that cause a shooting unit to shoot the user as the object;
performing a truth and falseness deciding process that compares the input operation that is received from the user in response to the input request process with the pre-registered operation; and
performing a matching process when the input operation matches the pre-registered operation that compares the shot image with pre-registered image data of the object,
9. The object identifying method according to claim 8, the method further comprising:
causing the shooting unit to simulate to shoot the object in the case where the input operation does not match the pre-registered operation.
10. A computer readable medium comprising instructions, that when executed on a microprocessor, perform the following:
causing an object identifying device to perform the object identifying method according to claim 8. Description
The present application claims foreign priority based on Japanese Patent Application No. 2005-074032, filed Mar. 15, 2005, the content of which is incorporated herein by reference.
As a method for rejecting the impersonation or the wrong recognition, an individual identifying device for matching a plurality of objects is proposed (see JP-A-2003-36442). In the individual identifying device, not only a plurality of matching is matched, but also a matching process is carried out again when there is an indefinite part so as to suppress a wrong recognition rate to a low level.
Further, according to the present invention, a mobile phone having the object identifying device may be provided.
FIG. 10 is a front view of an object identifying device according to a sixth exemplary, non-limiting embodiment of the present invention.
Further, the object identifying device 1 may be constituted such that it can be connected to a communication network, and the program may be supplied thereto through the communication network. The communication network includes, for example, the Internet, the Intranet, an intranet, an extranet, a LAN, an ISDN, a VAN, a CATV communication network, a virtual private network, telephone lines, a mobile communication network, and a satellite communication network. A transmission medium for constituting the communication network includes, for example, wire lines, such as IEEE1394, USB, power lines, cable TV lines, telephone lines, and ADSL lines, infrared rays, such as IrDA or a remote controller, and wireless lines, such as Bluetooth (a registered trademark), 802.11 Wireless, HDR, a mobile communication network, satellite lines, and a terrestrial digital broadcasting network.
When the identifying process is started (step s1:Yes), the controller activates the camera 12 (step s2) to display “Press the shutter button” on the liquid crystal monitor 14, as shown in a front view of FIG. 5A to instruct the user to input for starting the shooting operation (step s3).
In the step s4, when the input operation does not correspond to the normal operation (step s4:No), the controller performs the shooting operation by the camera (step s9). This shooting operation is originally an unnecessary process, however, the shooting operation is performed so that the user does not understand that the input operation is wrong. Accordingly, the shot image may not be actually obtained and a camouflage shooting operation (a dummy shooting operation) may be carried out by lighting by the use of the lighting device 13 and an audio output by the use of the speaker 11 so that the user or the illegal user recognizes that the shooting operation is performed.
The controller waits for a prescribed time (a dummy stand-by) (step s10). The stand-by time is set to substantially the same time as that of the matching of the face and decision of the steps s6 to s7. The stand-by for a prescribed time is necessary for the user or the illegal user not to understand that the matching of the face is not performed and since the input operation does not correspond to the normal operation, the user or the illegal user cannot succeed in identification.
The controller shows on the liquid crystal monitor 14 a display of the failure of an identification (inform of the failure of an identification) “failed in the identification of the face. In case of use, perform again the matching of the face” (step s11), as shown in a front view of FIG. 5B, and finishes processes. Accordingly, the user cannot use a function to be used.
When it is decided that the face of the user is not the registered face in the step s7 (step s7: No), the controller shows on the liquid crystal monitor 14 a display of the failure of an identification of FIG. 5B “failed in the identification” (step s12), and finishes processes. Accordingly, the user cannot use a function to be used.
According to the above-described operations, the user accepts he identification by the input operation and the shot image, so that the user can use the necessary functions of the mobile phone. Then, in the instruction for the input for starting the shooting operation in the step s3, while the shutter button 15 is requested to be pressed down, since a pressing down operation of a button different from the shutter button 15 is actually decided to be true, even when the impersonation by a photograph is attempted, the impersonation can be rejected on the basis of the decision of the input operation.
For instance, when a key of “3” as one of the operating buttons is registered as the normal operation, since another person who does not know it presses down the shutter button 15 by looking at the display of FIG. 5A in the step s3, the decision of No is obtained in the step s4 and the failure of an identification is displayed in the step s11. Thus, another person does not move to a function that he or she tries to use.
Further, since the input operation for deciding a truth or falseness is the input operation during the input for starting the shooting operation, the user may not be requested to perform many operations. Thus, the compatibility of the improvement of convenience with the improvement of an identifying accuracy can be realized.
In the operation performed in accordance with the object identifying program, the controller performs a process for deciding whether or not an input operated pressing down time is near to the registered normal pressing down time in step s4 shown in FIG. 4. Thus, the decision of a truth and falseness is made on the basis of the pressing down time.
When the identifying process is started (step r1:yes), the controller activates the camera 12 (step r2) to show the display of “Press the shutter button” on the liquid crystal monitor 14, as shown in a front view of FIG. 5A and to instruct the user to input for starting the shooting operation (step r3).
When the controller decides that the input operation corresponds the normal operation and is true (step r4:Yes), the controller further decides whether or not the pressing down time during which the shutter button 15 or the operating button 16 button is continuously pressed is near to the registered normal pressing down time (step r5).
When the controller decides that the pressing down time is close to the normal pressing down time and true (step r5:Yes), the controller performs the shooting operation by the camera 12 (step r6). Then, the controller performs the matching of a face by the shot image obtained by the shooting operation and the matching data (step r7). The matching of the face at this time is carried out in the same manner as that of the matching of the face in the step s6 of the first embodiment. In the step r5, when an actual pressing down time is longer than the registered normal pressing down time, that is, when the button is pressed down for the registered normal pressing down time or more, the pressing down time may be decided to be true.
In the step r4, when the input operation does not correspond to the normal operation (step r4:No), the controller performs the shooting operation by the camera 12 (step r10). This shooting operation is originally an unnecessary process, however, the shooting operation is performed so that the user does not understand that the input operation is wrong. Accordingly, the shot image may not be actually obtained and a camouflage shooting operation (a dummy shooting operation) may be carried out by lighting by the use of a lighting device 13 and an audio output by the use of a speaker 11 so that the user or the illegal user recognizes that the shooting operation is performed.
The controller shows on the liquid crystal monitor 14 a display of the failure of an identification of “failed in the identification of the face. In case of use, perform again the matching of the face” (step r12), as shown in a front view of FIG. 5B, and finishes processes. Accordingly, the user cannot use a function to be used.
When it is decided that the face of the user is not the registered face in the step r8 (step r8: No), the controller shows on the liquid crystal monitor 14 a display of the failure of an identification of “failed in the identification” (step r16), and finishes processes. Accordingly, the user cannot use a function to be used.
The controller waits until an identifying process is started (step t1:No). This identifying process is designed to be started at a preset suitable timing, for instance, when the object identifying device 1 is used, when a power is turned on, when a mail is transmitted, when a mail is read, when a WEB is inspected, when a setting is changed, when registered personal information is referred to, when charged contents provided in the WEB are used, or when goods are bought on the WEB.
The succession in this case is not limited to a succession in short time, and may include a case that the failure of an identification arises again with a lapse of a prescribed time after the failure of the identification.
The controller shows a display of “Press the shutter button” on a liquid crystal monitor 14, as shown in a front view of FIG. 5A and to instruct the user to input for starting a shooting operation (step t4).
When the controller decides that the input operation corresponds to the normal operation and is true (step t5:Yes), the controller performs the shooting operation by the camera 12 (step t6). Then, the controller performs the matching of a face by a shot image obtained by the shooting operation and matching data (step t7). The matching of the face at this time is carried out in the same manner as that of the matching of the face in the step s6 of the first embodiment.
The controller decides whether or not the face of the user is a registered face (whether the user is the same person or not) on the basis of the matched result of the matching of the face. When the face is the registered face (step t8:Yes), the controller performs an identification success process (step t9) and finishes processes. In the identification success process, the user may directly shift to a function to be used by the user or after the success of an identification is displayed on the liquid crystal monitor 14, the user may shift to a function to be used by the user. Accordingly, the user can employ functions such as turning on a power, a transmission of a mail, an inspection of a WEB, a change of a setting or a reference to registered personal information.
When the value of the loop counter is lower than the number of times of permissions of an identification (step t10:No), the controller increments the loop counter by one (add 1) (step t11) to return the process to the step t4. At this time, the camouflage shooting operation (a dummy shooting operation) and the stand-by for a prescribed time (a dummy stand-by) may be set to be performed so that the user or the illegal user does not understand that the matching of the face is not performed.
When it is decided that the face of the user is not the registered face in the step t8, the controller shows on the liquid crystal monitor 14 a display of the failure of an identification of “failed in the identification” (step t12), and finishes processes. Accordingly, the user cannot use a function to be used.
Now, an object identifying device 1 of a fifth embodiment will e described. Since the structure of the object identifying device 1 of the fifth embodiment has the same structure as that of the object identifying device 1 of the second embodiment, a detailed description thereof will be omitted.
The controller waits until an identifying process is started (step u1:No). This identifying process is designed to be started at a preset suitable timing, for instance, when the object identifying device 1 is used, when a power is turned on, when a mail is transmitted, when a mail is read, when a WEB is inspected, when a setting is changed, when registered personal information is referred to, when charged contents provided in the WEB are used, or when goods are bought on the WEB.
When the identifying process is started (step u1:Yes), the controller activates a camera 12 (step u2) to show the display of “Press the shutter button” on a liquid crystal monitor 14, as shown in a front view of FIG. 5A and to instruct the user to input for starting a shooting operation (step u3).
The controller receives the input for starting the shooting operation to perform the shooting operation by the camera 12 (step u4). Then, the controller decides whether or not a pressing down time until the user stops the pressing down operation of a shutter button 15 or an operating button 16 button to be released after the user performs the shooting operation is near to a previously registered normal pressing down time, that is, whether or not the difference between the actual pressing down time and the registered normal pressing down time is located within a range of a predetermined threshold value (step u5).
When the controller decides that the pressing down time is close to the normal pressing down time (step u5:Yes), the controller performs the matching of a face by the shot image obtained by the shooting operation in the step u4 and matching data (step u6). The matching of the face at this time is carried out in the same manner as that of the matching of the face in the step s6 of the first embodiment. In the step u5, when the actual pressing down time is longer than the registered normal pressing down time, that is, when the button is pressed down for the registered normal pressing down time or more, the pressing down time may be decided to be true.
The controller shows on the liquid crystal monitor 14 a display of the failure of an identification of “failed in the identification of the face. In case of use, perform again the identification of the face” (step u10), as shown in a front view of FIG. 5B, and finishes processes. Accordingly, the user cannot use a function to be used.
When it is decided that the face of the user is not the registered face in the step u7 (step u7: No), the controller shows on the liquid crystal monitor 14 a display of the failure of an identification of “failed in the identification” (step u11), and finishes processes. Accordingly, the user cannot use a function to be used.
Now, as a sixth embodiment, an installed type object identifying device 1 provided in an entrance and exit of facilities will be described by referring to a front view of FIG. 10 in place of a mobile phone.
In the corresponding relation between the structure of the present invention and the embodiments, the face identifying device and the mobile phone of the present invention correspond to the object identifying device 1 of the embodiment. Similarly, the control unit corresponds the controller of the object identifying device 1. The shooting unit corresponds to the camera 12 and the image part 43. The input request unit corresponds to the liquid crystal monitor 14. The input unit and the push button correspond to the operating button 16 or the shutter button 15 and the operating button 16. The truth and falseness deciding process corresponds to the steps s4, r4, r5, t5 and u5. The matching process corresponds to the steps s6 to s7, r7 to r8, t7 to t8 and u6 to u7. The identifying process corresponds to the steps s4, s7, r4, r8, t5, t8, u5 and u7. The object identifying program corresponds to the object identifying program. The registered data corresponds to the matching data.
[Designation of Document] Drawing
41 . . . input part (button or the like)
42 . . . input deciding part
43 . . . image part (camera)
44 . . . matching part
45 . . . matched result output part
46 . . . timer
47 . . . time deciding part
n1. Activate camera to shoot face.
n2. Register shot image in DB.
n3. Designate button serving as shutter function of camera.
a. start of identifying register process
b. end of identifying register process.
s1. Identifying process is started ?
s2. Activate camera.
s3. Instruct to input for start “press shutter button”.
s4. Input operation is performed by a designated button ?
s5. Shoot face.
s6. Perform face matching.
s7. Registered face ?
s8. Identification success process.
s9. Shoot face.
s10. Wait for prescribed time (dummy standby)
s11. Display failure of identification “failed in identification”.
s12. Display failure of identification “failed in identification”.
b. end [FIG. 5]
a. This is face identifying mode. Press shutter button. (Failed in identification of face.
b. In case of use, perform face matching again to be identified. [FIG. 6]
p1. Activate camera to shoot face.
p2. Register shot image in DB.
p3. Designate button serving as shutter function of camera.
p4. Register pressing down time of button
b. end of identifying register process. [FIG. 7]
r1. Identifying process is started ?
r2. Activate camera.
r3. Instruct to input for start “press shutter button”.
r4. Shutter button is designated button ?
r5. Pressing down time is near to normal pressing down time ?
r6. Shoot face.
r7. Perform face matching.
r8. Registered face ?
r9. Identification success process.
r10. Shoot face.
r11. Wait for prescribed time (dummy stand-by)
r12. Display failure of identification “failed in identification”.
r13. Shoot face.
r14. Wait for prescribed time (dummy stand-by)
r15. Display failure of identification “failed in identification”.
r16. Display failure of identification “failed in identification”.
b. end [FIG. 8]
t1. Identifying process is started ?
t2. Activate camera.
t3. Initialize loop counter.
t4. Instruct to input for start “press shutter button”.
t5. Shutter button is designated button ?
t6. Shoot face.
t7. Perform face matching.
t8. Registered face ?
t9. Identification success process.
t10. Loop counter shows a prescribed value or higher ?
t11. Increment loop counter.
t12. Display failure of identification “failed in identification”.
b. end [FIG. 9]
u1. Identifying process is started ?
u2. Activate camera.
u3. Instruct to input for start “press shutter button”.
u4. Shoot face.
u5. Pressing down time is near to normal pressing down time ?
u6. Perform face matching.
u7. Registered face ?
u8. Identification success process.
u9. Wait for prescribed time (dummy stand-by)
u10. Display failure of identification “failed in identification”.
u11. Display failure of identification “failed in identification”.
Patent CitationsCited PatentFiling datePublication dateApplicantTitleUS4103307 *May 23, 1977Jul 25, 1978Canon Kabushiki KaishaExposure control deviceUS4975969Oct 22, 1987Dec 4, 1990Peter TalMethod and apparatus for uniquely identifying individuals by particular physical characteristics and security system utilizing the sameUS5870723Aug 29, 1996Feb 9, 1999Pare, Jr.; David FerrinTokenless biometric transaction authorization method and systemUS6433818Jul 15, 1999Aug 13, 2002Fotonation, Inc.Digital camera with biometric securityUS6820137 *Nov 21, 2001Nov 16, 2004Minolta Co., Ltd.Computer-readable recording medium storing resolution converting program, resolution converting device and resolution converting methodUS6975755 *Nov 24, 2000Dec 13, 2005Canon Kabushiki KaishaImage processing method and apparatusUS7190814 *Oct 12, 2001Mar 13, 2007Omron CorporationImage comparison apparatus and method for checking an image of an object against a stored registration imageUS7340342 *Aug 5, 2004Mar 4, 2008Research In Motion LimitedMobile device with on-screen optical navigationUS7430307 *Sep 29, 2004Sep 30, 2008Olympus CorporationData processing apparatusUS20040162982Feb 9, 2004Aug 19, 2004Fujitsu LimitedAuthentication information processing methodUS20040218070Apr 1, 2004Nov 4, 2004Nokia CorporationMethod and apparatus for user recognition using CCD camerasCN1299496AAug 21, 1998Jun 13, 2001西门子公司Electronic device and method for the authentication of a user of said deviceJP2003036442A Title not availableJP2004015450A Title not available* Cited by examinerNon-Patent CitationsReference1Abstract of JP2003036442, Data supplied from the esp@cenet database, 1 page, Feb. 7, 2003.2Chinese Office Action for Chinese Application No. 200610059137, mailed on Aug. 10, 2007 (24 pages).3Extended European Search Report; dated Jul. 18, 2006; Application No. 06111171.2 (8 pages).4Patent Abstracts of Japan; Publication No. 2004015450; Publication Date: Jan. 15, 2004 (1 page).Referenced byCiting PatentFiling datePublication dateApplicantTitleUS8943580 *Sep 9, 2008Jan 27, 2015Apple Inc.Embedded authentication systems in an electronic deviceUS9038167Dec 27, 2013May 19, 2015Apple Inc.Embedded authentication systems in an electronic deviceUS9128601Mar 18, 2015Sep 8, 2015Apple Inc.Embedded authentication systems in an electronic deviceUS9134896Dec 27, 2013Sep 15, 2015Apple Inc.Embedded authentication systems in an electronic deviceUS9154744 *Apr 29, 2011Oct 6, 2015March Networks CorporationAutomatic configuration of connection from camera to video management serverUS9250795Dec 27, 2013Feb 2, 2016Apple Inc.Embedded authentication systems in an electronic deviceUS9274647Oct 1, 2015Mar 1, 2016Apple Inc.Embedded authentication systems in an electronic deviceUS9304624Sep 5, 2014Apr 5, 2016Apple Inc.Embedded authentication systems in an electronic deviceUS9329771Jun 20, 2014May 3, 2016Apple IncEmbedded authentication systems in an electronic deviceUS9342674Mar 5, 2015May 17, 2016Apple Inc.Man-machine interface for controlling access to electronic devicesUS9495531Feb 5, 2016Nov 15, 2016Apple Inc.Embedded authentication systems in an electronic deviceUS9519771Dec 27, 2013Dec 13, 2016Apple Inc.Embedded authentication systems in an electronic deviceUS20090083850 *Sep 9, 2008Mar 26, 2009Apple Inc.Embedded authentication systems in an electronic deviceUS20110029904 *Jul 30, 2009Feb 3, 2011Adam Miles SmithBehavior and Appearance of Touch-Optimized User Interface Elements for Controlling Computer FunctionUS20120105629 *Apr 29, 2011May 3, 2012March Networks CorporationAutomatic configuration of connection from camera to video management server* Cited by examinerClassifications U.S. Classification340/573.4, 340/573.1International ClassificationG08B23/00Cooperative ClassificationG07C9/00087, G06K9/00899, G06K9/00885, G07C2009/00095, G06K9/00, G06F21/32European ClassificationG06F21/32, G06K9/00X, G06K9/00X2, G06K9/00, G07C9/00B6D4Legal EventsDateCodeEventDescriptionMar 15, 2006ASAssignmentOwner name: OMRON CORPORATION, JAPANFree format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:SENGA, MASAHIRO;REEL/FRAME:017657/0856Effective date: 20060310Owner name: OMRON CORPORATION,JAPANFree format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:SENGA, MASAHIRO;REEL/FRAME:017657/0856Effective date: 20060310Sep 25, 2013FPAYFee paymentYear of fee payment: 4RotateOriginal ImageGoogle Home - Sitemap - USPTO Bulk Downloads - Privacy Policy - Terms of Service - About Google Patents - Send FeedbackData provided by IFI CLAIMS Patent Services