Abstract:
A Fully Automatic, Head Mounted, Hand and Eye Free Camera System and Photography are disclosed. The Fully Automatic, Head Mounted, Hand and Eye Free Camera System consist of three components: A) a Head Mounted Camera Header, B) a Portable Personal Computer, and C) a Hand Hold Controller. The component A (Head Mounted Camera Header) is composed of two set of Eye Ball Trackers/Range Finder/Digital Camera Headers. The component B (Portable Personal Computer) control Eye Ball Tracker and the Range Finder to determine the direction of eye sight and the distance between the eye and the target, and adjusts the lens of the Digital Camera Header to aim at and focus on target to take pictures or record video and to save the pictures or video to the storage of the Portable Personal Computer. The user control whole system by pressing the buttons at component C (Hand Hold Controller). The aiming, focusing, and the capturing procedure is automatic, continuous, and in the real time, and is a true process of “What you see is what you get (photo or video)”.

Description:
FIELD OF THE INVENTION  
       [0001]     The head mounted commercial digital camera, camcorder and the photography.  
       BACKGROUND OF THE INVENTION  
       [0002]     There are lots of patents involving the head mounted camera, but none of them was really used commercially. The films camera is too big and too heavy to mount on the human&#39;s head. Although CCD and CMOS sensor are widely adopted, almost all of patents relate to head mounted camera are short of automatic aiming and focusing, thereby cannot capture the scenery the user&#39;s eyes are really seeing. The U.S. Pat. No. 6,307,526 proposed the idea of using eye tracker; but the size of lens, the visual field of the lens and the angle of the lens can be turn around are limited. Another weakness of this patent is that at least one eye of the user must gaze at the viewfinder constantly. This patent also not use Portable Personal Computer, lacks powerful compute and control ability to realize automatic aiming and focusing automatically, continuously and in the real time, lacks huge memory to store the pictures and video.  
         [0003]     The current price of color CMOS digital camera header with 300,000 pixels and the range finder chip are few Dollars. The error of Eye gaze Analysis System (LC Technologies, Inc) is 0.45 degree, i.e. about 1.4 inch at 15 feet distance. Gaze direction is determined using the pupil-center-corneal reflection method and the image processing and gaze point calculations are performed in C++ software on a Personal Computer with Windows 2000. The first commercial product using material of artificial muscle (electroactive polymer) was on the market in January 2003, when Japan&#39;s Eamex began selling battery-powered plastic fish that swim around aquariums and look practically indistinguishable from the real thing. All these products have a characteristic that is they are small and light. All these technologies lay down a foundation for my invention.  
       SUMMARY OF THE INVENTION  
       [0004]     This invention integrates new technologies including CCD CMOS digital camera header, Eye Ball Tracker, Range Finder, LCD, and artificial muscle, with the most important technology—Portable Personal computer (including laptop, palm, PDA, small single board computer, even cellular phone and iPads) together to create the Full Automatic, Head Mounted, Hand and Eye Free Camera System and the Photography.  
         [0005]     This System comprises a Head Mounted Camera Header, a Portable Personal Computer and a Hand Hold Controller. The Head Mounted Camera Header comprises two sets of Eye Ball Tracker/Range Finder/Digital Camera Header.  
         [0006]     By using two Eye Ball Trackers to take the pictures of pupils and cornea of two eyes continuously, Portable Personal Computer calculates the direction of the eye sight using these pictures and controls two Digital Camera Headers to turn around such that the direction of optical axial of the Digital Camera Header is always following the direction of eye sight. Portable Personal Computer also controls two Range Finders to transmit and receive infrared ray, measures the distance between the eyes and the target, then controls the lens of Digital Camera Headers to focalize on the target. When users press the shot button on Hand Hold Controller, Portable Personal Computer controls Digital Camera Headers to take pictures and to save them in Portable Personal Computer, or controls Digital Camera Headers to start record video. Because using the powerful Portable Personal Computer, all of the processes are automatic, continuous, and in the real time.  
         [0007]     User do not need hold the camera in hand, no longer worry about the aiming and focusing; at any condition and any moment, just push a button, the scenery in user&#39;s eyes will be captured. This is a true process of “What you see is what you get (photo or video)”. The user will never miss any wonderful or any important scenery. Because all of the processes are automatic, continuous, and in the real time, this is also a very easy and convenient way to take picture or record video, and suit for anybody from child to older, even disabled. 
     
    
     BRIEF DESCRIPTION OF THE DRAWINGS  
       [0008]      FIG. 1  shows a man with the Full Automatic, Head Mounted, Hand and Eye Free Camera System: a Head Mounted Camera Header is attached on his forehead, a Portable Personal computer is hanged at his waist, and the Hand Hold Controller is hold in his hand.  
         [0009]      FIG. 2  shows Head Mounted Camera Header attached on a man&#39;s forehead.  
         [0010]      FIG. 3  shows the side view, front view and top view of an embodiment of Head Mounted Camera Header.  
         [0011]      FIG. 4  shows how the lens is aimed at and focused on a target.  
         [0012]      FIG. 5  shows the positions of Digital Camera Header, Eye Ball Tracker, Range Finder, the forehead and the eyes.  
         [0013]      FIG. 6  shows the details of Head Mounted Display, Eye Ball Tracker and Face Camera.  
         [0014]      FIG. 7  shows how to use Head Mounted Display to help to attach the Head Mounted Camera Header to forehead correctly and how to review the pictures or video stored in Portable Personal computer.  
         [0015]      FIG. 8  shows another embodiment of the invention as claimed in claim  2 . 
     
    
     DETAILED DESCRIPTION OF THE INVENTION  
       [0016]     As showed in  FIG. 1   a , the Full Automatic, Head Mounted, Hand and Eye Free Camera System comprises a Head Mounted Camera Header  100 , a Portable Personal Computer  101 , and a Hand Hold Controller  102 . The Head Mounted Camera Header is attached on the forehead right above the eyes. Controlled by a Portable Personal Computer, Head Mounted Camera Header always automatically aims at and focuses on the target the eyes are seeing; continuously takes pictures and transmits them to the Portable Personal Computer without any assistance of hands and eyes. The only thing user have to do is to press the shoot button on Hand Hold Controller to instruct Portable Personal Computer to take a picture. The Portable Personal Computer save this picture captured by Head Mounted Camera Header to a directory in which the sound is recorded five seconds before and after the moment the button being pressed, so there will be a picture with a corresponding sound. The user can also press a record button on Hand Hold Controller to instruct Portable Personal Computer to start record video with sound. The user does not need aiming at target by using a viewfinder, does not need worry about adjusting focus. Further more, beyond the ability of human&#39;s eye, user can zoom the lens of the Digital Camera Header any time by using Hand Hold Controller, to capture the part of scene which user is specially interested in the whole scenery. Portable Personal Computer can be hanged at the waist, on the should, in the backpack or the pocket. Hand Hold Controller can also be put in the pocket. Because this camera frees hands and eyes, it can take a picture or record a video at any time any condition, no matter the user is talking, walking, working, even when the user is thinking, his head does not moved, only the eyes are turning, this camera can record exactly what the eyes are pointing to. This camera is a natural and reasonable integration of modern technologies and the design is user convenient and comfortable.  
         [0017]      FIG. 1   b  shows the details of Portable Personal Computer  101  where are a LCD, a CPU and/or DSP, a DRAM and/or Flash memory, a Hard Disk and/or DVD/CD-RW Drive, a Battery and a High Speed Serial Port like USB, IEEE1394, Ethernet or Wireless port. Portable Personal Computer can be a laptop PC, a Palm PC, a PDA, a Cell Phone, an iPads or a single board computer. The Portable Personal Computer communicates with Head Mounted Camera Header using High Speed Serial Port  105  and cable  109 , communicates with Hand Hold Controller  102  using a Serial Port  106 .  
         [0018]      FIG. 1   c  shows a Hand Hold Controller. The Hand Hold Controller communicates with Portable Personal Computer using a Serial Port  107 . The communication can be wired or wireless. The function of the buttons on Hand Hold Controller can be defined by software.  
         [0019]      FIG. 2  shows a Head Mounted Camera Header attached to a user&#39;s forehead. The Head Mounted Camera Header comprises two Eye Ball Trackers  4 , two Digital Camera Headers  3  and two Range Finders  5 . Two Eye Ball Trackers and two Digital Camera Headers are fixed on two Slip Blocks  7 , which are mounted on a light and rigid Install Base  1 . The Install Base  1  is located at the forehead above the two eyes and is attached to head using a stretchy Band  2 . The Range Finder  5  comprises an infrared LED and a lens  51  to emit infrared ray, a lens  52  and a range finder chip to receive reflected ray; and locates on the Digital Camera Headers. Controlled by Portable Personal Computer, Eye Ball Trackers take the pictures of the pupils and the cornea of the two eyes automatically, continuously and in real time; Portable Personal Computer calculates the direction of the eye sight using these pictures automatically, continuously and in real time and controls the Digital Camera Headers to turn around such that the direction of optical axial line  302  of Digital Camera Headers is always following the direction of eye sight  203  automatically, continuously and in real time; Portable Personal Computer also controls two Range Finders, to emit and receive infrared ray at the direction of eye sight, measures the distance between the eyes and the target, then controls lens  30  of Digital Camera Header to focus on the target automatically, continuously and in real time. This is the principle of the automatic aiming and automatic focusing without any assistance of user&#39;s hands and eyes, and without requiring any viewfinder.  
         [0020]      FIG. 3   a ,  FIG. 3   b  and  FIG. 3   c  show the side view, front view and top view of an embodiment of the Head Mounted Camera Header respectively. These Figures show the details of the Digital Camera Header  3 . The Digital Camera Header  3  comprises an optical lens  30  with zoom machine, a CMOS or a CCD sensor and corresponding control logic, which is inside of body of the Digital Camera Header and not showed here. The strip  31 , 32 , 33  and  34  make up of the Servo Driver and are made from material of artificial muscle. By applying electric voltage to them, the strips will stretch or contract. Thus, controlled by Portable Personal Computer, the Digital Camera Header can swing up and down, left and right on Slip Block  7 , and the lens  30  will been aimed at direction of eye sight. The optical lens  30  of the Digital Camera Header can move forward and backward, focus on the target of eye, and zoom in or out, which are also controlled by Portable Personal Computer by using the artificial muscle. Using artificial muscle material can remove noise and save power. The  FIG. 3   d  shows another embodiment of the Digital Camera Header&#39;s Servo Driver, it uses strap with teeth, step motor and gear.  FIG. 3   e  and  FIG. 3   f  show other embodiments of Digital Camera Header, Slip Block  7  and Servo Driver. The bottom of the Digital Camera Header  3  is not concave here. By adjusting the location of two Slip Blocks on Install Base  1 , Digital Camera Headers  3  and Eye Ball Trackers  4  are placed right above the two eyes. Two emit lens  51  and receive lens  52  of the Range Finder  5  are mounted on Digital Camera Header  3 . Thus, the infrared ray emitted from the emit lens is in the same direction of the optical axial line of the lens  30  of the Digital Camera Header.  
         [0021]      FIG. 4  shows how the lens are aimed at and focalized on the target. Controlled by Portable Personal Computer, Eye Ball Trackers  4  take the pictures of two eyes continuously. Portable Personal Computer calculates the direction of eye sight  203  using these pictures, measures the distance between the eyes and the target F using the Range Finder, and drives Digital Camera Header  3  to aim at and focalize on target F automatically, continuously and in real time without any assistance of hands and eyes, and does not need any viewfinder.  
         [0022]      FIG. 5  shows the position of Digital Camera Header  3 , Eye Ball Tracker  4 , Range Finder  5  ( 51 , 52 ), the forehead  200  and eyes  201 . When the Install Base  1  is attached on the forehead firmly, the relationship among the point  70  (the rotation center of Digital Camera Header), the point  93  (the center of the eye ball), and the point  92  (the center of CMOS sensor of Eye Ball Tracker) will not change. The solid angle  95  of eye sight  203  can be calculated exactly, so the solid angle  94  of the optical axial of lens of Digital Camera Header can be educed correctly. A Microphone  38  and a Speaker  39  are also showed here, the surrounding sound can be recorded in Portable Personal Computer, and the Speaker can be used to replay the recorded sound or to play various reminders or instructions.  
         [0023]      FIG. 6  shows the details of the Head Mounted Display, the Eye Ball Tracker and the Face Camera. The Head Mounted Display  8  comprises a LCD  81 , a mirror  82 , a semitransparent mirror  83  and a transparent support frame  85 . The LCD shows the scene captured by Digital Camera Header  3 , reflected by two mirrors  82  and  83 , this scene is superposed on the scene at the front of eyes. By comparing the two scenes, the user can adjust the location of Head Mounted Camera Header on the forehead, until the difference of two scenes is very small. Then Head Mounted Display can be taken from the Slip Block  7  of Head Mounted Camera Header.  
         [0024]     The Eye Ball Tracker  4  comprises a support frame  43 , an infrared LED  42  and a CMOS camera  41 ; the infrared ray from the LED  42  irradiates eyes, the camera  41  take the infrared picture of the pupils and corneas of the eyes always and transmits these pictures to Portable Personal Computer, Portable Personal Computer calculates the direction of eye sight automatically, continuously and in real time.  
         [0025]     The Face Camera  9 , which is located at center of two Eye Ball Trackers and fixed at the Install Base  1 , comprises a support frame  92  and a CMOS camera  91 . Face Camera always takes picture of the user&#39;s face. If the picture changed, it means the Head Mounted Camera Header moved, Portable Personal Computer will tell user using Speaker  39  to adjust the location of Head Mounted Camera Header with the help of Head Mounted Display if the movement is too big. The Head Mounted Display can be mounted onto and unmounted from the Slip Blocks  7  easily. In normal usage, Head Mounted Display will be taken off from the Slip Blocks  7 .  
         [0026]     In  FIG. 5 , there is a Microprocessor  35  with High Speed Serial Port  36  in the Install Base. The Microprocessor communicates with Digital Camera Headers, Eye Ball Trackers, Range Finders, Head Mounted Displays, Face Camera, Microphone, Speaker and Servo Drivers via cables. The Microprocessor also communicates with Portable Personal Computer using High Speed Serial Port  36  via cable  109 .  
         [0027]      FIG. 7  shows how to use Head Mounted Display to attach Head Mounted Camera Header correctly and review the picture recorded in Portable Personal Computer. Scene A 1  at the front of eyes is captured by Digital Camera Header, and is displayed at Head Mounted Display. It appears at mirror  83  of Head Mounted Display as scene A 2 . If these two sceneries superpose perfectly, as shown in  FIG. 7   a , the Head Mounted Camera Header is in the correct place. Otherwise, as shown in  FIG. 7   b  or  FIG. 7   c , adjustments are needed. To review the records in Portable Personal Computer, a black Shield Board  86  is hanging behind the mirror  83  as shown in  FIG. 7   d . Because these pictures are take from two Digital Camera Headers and are reviewed using two Head Mounted Displays, the user will see a three dimensional scene. User can review the record by using the LCD monitor on the Portable Personal Computer too, but that will appear as a two dimensional picture.  
         [0028]      FIG. 8  shows another embodiment of the invention. There is only one Digital Camera Header  3  on the Head Mounted Camera Header. Three dimensional picture and video need twice memory space; using one Digital Camera Header can save lots, but will loss three-dimensional visualization.  
         [0029]     Although only a few exemplary embodiments of this invention have been described in details above, it should be understood that the present invention is not limited to those precise embodiments and various changes and modifications there of could be made by one skilled in the art without materially departing from the teachings, spirit or scope of the invention as defined in the appended claims.