Multiple frame photography

A device may determine whether a user input for capturing a view is triggered and automatically frame a plurality of images of the view when the user input is determined to be triggered by repeatedly determining a zoom value for an image, optically zooming the view based on the zoom value, and capturing the zoomed view as the image.

TECHNICAL FIELD OF THE INVENTION

Implementations described herein are related to photography and in particular, pertain to methods and devices for improving picture quality.

DESCRIPTION OF RELATED ART

A process for digitally framing a picture may involve magnifying and cropping the picture, such that the main subject of the picture is resized. For example, if a picture of an apple is 1024 pixels by 512 pixels, and the apple has the diameter of 20 pixels, the picture may be framed (i.e., magnified and cropped) so that the apple occupies a larger area within the picture.

In digital framing, a digital zoom may be used for magnifying the picture. More specifically, a digital zoom may be used to increase the number of pixels by the percentage by which the picture is magnified. Because the digital zoom creates new pixels by interpolating the existing ones, the digital zoom may introduce defects during the magnification.

SUMMARY

According to one aspect, a method may comprise determining whether a user input for capturing a view is triggered, and automatically framing a plurality of images of the view when the user input is determined to be triggered by repeatedly determining a zoom value for an image, optically zooming the view based on the zoom value, and capturing the zoomed view as the image.

Additionally, determining a zoom value for the image may include determining a zoom value that is unique among a plurality of zoom values for the images.

Additionally, determining a zoom value for the image may include accepting a user zoom, and producing a zoom value by determining a magnification of a view relative to the user zoom.

Additionally, determining a zoom value may include accepting a user input that specifies a number of the plurality of images, and accepting user inputs that specify a zoom value for each of the plurality of images.

Additionally, automatically framing may further include obtaining luminance sensor outputs or focus sensor outputs.

Additionally, automatically framing may further include determining a shutter speed or an aperture size based on the zoom value.

Additionally, automatically framing may further include determining a shutter speed, or an aperture size based on the luminance sensor outputs.

Additionally, automatically framing may further include focusing the image based on the focus sensor outputs.

Additionally, automatically framing may further include transferring the captured image from a light sensor to memory.

Additionally, capturing the zoomed view as the image may include exposing a light sensor to the image for a predetermined duration of time.

According to another aspect, a device may comprise a lens assembly and a trigger for a multiple framing shot. Additionally, the device may include a processor for framing each of a plurality of images of a subject when the user activates the trigger by repeatedly establishing magnification information of an image, optically magnifying the subject based on the magnification information, and imaging the magnified subject to produce the image.

Additionally, the device may further comprise a luminance sensor for providing information related to brightness of the subject.

Additionally, the device may further comprise a film for imaging the magnified subject.

Additionally, the device may further comprise a light sensor for imaging the magnified subject.

Additionally, the lens assembly may include a zoom lens assembly for magnifying the subject and a shutter assembly for exposing the light sensor for a predetermined amount of time.

Additionally, the device may further comprise a user interface for accepting user inputs that specify a magnification for each of the plurality of images.

According to yet another aspect, a device may comprise means for storing images, means for optically zooming an image, means for triggering a multiple framing shot, and means for taking multiple images of a view when a multiple framing shot is triggered. Additionally, the means for taking multiple images may include means for determining zoom information of an image, means for driving the means for optically zooming a view based on the zoom information, and means for recording the zoomed view as the image in the means for storing images.

Additionally, the device may further comprise means for providing luminance information and focus information.

Additionally, the means for recording the zoomed view may include means for exposing a sensor to a predetermined amount of light, and means for transferring the image that is captured at the sensor to the means for storing images.

Additionally, the device may further comprise means for adjusting shutter speed when a view changes.

DETAILED DESCRIPTION OF EMBODIMENTS

The following detailed description refers to the accompanying drawings. The same reference numbers in different drawings may identify the same or similar elements. The term “camera,” as used herein, may include a device that may capture and store images and/or video. For example, a digital camera may include an electronic device that may capture and store images and/or video electronically instead of using photographic film as in contemporary cameras. A digital camera may be multifunctional, with some devices capable of recording sound and/or video, as well as images.

A “subject,” as the term is used herein, is to be broadly interpreted to include any person, place, and/or thing capable of being captured as an image. The term “frame” may refer to a closed, often rectangular border of lines or edges (physical or logical) that enclose the picture of a subject. Depending on context, “multiple framing” or “framing” may refer to automatically taking a predetermined number of pictures, one immediately after another, at different zooms to obtain images with different sizes of a subject relative to each image frame. A “multiple framing shot” may refer to a shot for multiple framing.

Exemplary Device

In the following implementations, a device may automatically perform multiple framing. For example, as illustrated inFIG. 1A-1C, when a user takes a shot of a hotel, the device may automatically take three pictures of the hotel. Each picture is at a different zoom level, and thus, the size and the location of the hotel relative to the frame in each picture is different from those in others pictures. In contrast to the digital framing as described above, the hotel is framed differently for each picture without any loss in image resolution.

FIG. 2depicts an exemplary device200in which systems and methods described herein can be implemented. Device200may include any of the following devices that have the ability to function as a camera or adapted to include one ore more digital or analog cameras: a radio telephone; a personal communications system (PCS) terminal that may combine cellular radiotelephone with data processing, facsimile, and data communications capabilities; a mobile telephone; an electronic notepad; a laptop; a personal computer (PC); a personal digital assistant (PDA) that can include a radiotelephone, pager, Internet/intranet access, web browser, organizer, calendar, and/or GPS receiver; or any device with sufficient computing power and memory to support functions described herein.

FIG. 3shows a functional block diagram of exemplary device200. Device200may include memory302, processing unit304, input/output device(s)306, network interface308, viewfinder/display310, lens assembly312, sensors314, film316, flash318, and communication bus320. In another implementation, device200may include more, fewer, or different components. For example, when device200takes the form of a digital image capturing device, device200may not include film316.

Memory302may include static memory, such as read only memory (ROM), and/or dynamic memory, such as random access memory (RAM), or onboard cache, for storing data and machine-readable instructions. Memory302may also include storage devices, such as a floppy disk, CD ROM, CD read/write (R/W) disc, and/or flash memory, as well as other types of storage devices.

Processing unit304may include one or more processors, microprocessors, and/or processing logic capable of controlling device200. Input/output device(s)306may include a keyboard, key pad, button, mouse, speaker, microphone, Digital Video Disk (DVD) writer, DVD reader, USB lines, and/or another type of device for converting physical events or phenomena to and/or from digital signals that pertain to device200.

Network interface308may include any transceiver-like mechanism that enables device200to communicate with other devices and/or systems. For example, network interface308may include mechanisms for communicating via a network, such as the Internet, a terrestrial wireless network, a satellite-based network, etc. Additionally or alternatively, network interface308may include a modem, an Ethernet interface to a LAN, and/or an interface/connection for connecting device200to other devices.

Viewfinder/display310may include a device that can display signals generated by device200as images on a screen and/or that can accept inputs in the form of taps or touches on the screen. Examples of viewfinder/display310include an optical viewfinder (e.g., a reversed telescope), a liquid crystal display (LCD), cathode ray tube (CRT) display, organic light-emitting diode (OLED) display, surface-conduction electron-emitter display (SED), plasma display, field emission display (FED), bistable display, and/or a touch screen. Viewfinder/display310may provide a window through which the user may view and/or focus on a subject, replay previously captured material, and/or provide inputs.

Lens assembly312may include a device for manipulating light rays from a given or a selected range, so that images in the range can be captured in a desired manner. Lens assembly312may be controlled manually and/or electromechanically by processing unit304to obtain the correct focus on a subject and a desired magnification of the subject image and to provide a proper exposure.

Sensors314may include one or more devices for obtaining information related to image, luminance, and focus. Sensors314may provide the information to processing unit304, so that processing unit304may control lens assembly312and flash318. Film316may include an analog medium of recording images of a subject.

Flash318may include any type of flash unit used in cameras. For example, flash unit318may include a flash unit built into device200; a flash unit separate from device200; an electronic xenon flash lamp (e.g., a tube filled with xenon gas, where electricity of high voltage is discharged to generate an electrical arc that emits a short flash of light); or a microflash (e.g., a special, high-voltage flash unit designed to discharge a flash of light with a sub-microsecond duration).

Communication bus320may provide an interface through which components of device200can communicate with one another.

FIG. 4is a functional block diagram of the lens assembly312ofFIG. 3. Lens assembly312may include a zoom lens assembly402, a shutter assembly404, and an iris/diaphragm assembly406. In another implementation, lens assembly312may include more, fewer, or different components.

Zoom lens assembly402may include a collection of lenses. Zoom lens assembly402may provide a magnification and a focus of a given or selected image, by changing relative positions of the lenses. Shutter assembly404may include a device for allowing light to pass for a determined period of time. Shutter assembly404may expose sensors314and/or film316to a determined amount of light to create an image of a view. Iris/diaphragm406may include a device for providing an aperture for light and may control the brightness of light on sensors314and/or film316by regulating the size of the aperture.

Zoom lens assembly402, shutter assembly404, and iris/diaphragm assembly406may operate in conjunction with each other to provide a desired magnification and an exposure. For example, when a magnification is increased by using zoom lens assembly402, shutter assembly404and iris/diaphragm assembly406may be adjusted to compensate for changes in the amount of light, in order to maintain the exposure relatively constant.

FIG. 5is a functional block diagram of the sensors314inFIG. 3. Sensors314may include a light sensor502, a luminance sensor504, and a focus sensor506. In another implementation, sensors314may include more, fewer, or different components.

Light sensor502may include hardware and/or software for sensing light and storing an image. Luminance sensor504may include hardware and/or software for sensing the intensity of light (i.e., luminance) within a view. Luminance sensor504may provide luminance information that may be used for controlling flash318and the exposure of film316and/or light sensor502. An example of luminance sensor514includes a flash sensor. In one implementation, luminance sensor514may include a white point detector. The white point of a view or a view depends on light source and may be used to white balance the view.

Focus sensor506may include hardware and/or software for providing information that may be used for focusing an image. In one implementation, focus sensor506may provide the distance of a subject from device200, so that device200may adjust lens assembly312to obtain a properly focused image of the subject. In another implementation, focus sensor506may detect when lens assembly312outputs an image with the greatest contrast between measured light intensities at adjacent detector elements in sensor314and indicate the focused condition.

FIG. 6is a functional block diagram of exemplary components that are either included in or implemented by device200ofFIG. 3. Device200may include framing control logic602, user interface604, photographing control logic606, and database608.

Framing control logic602may include hardware and/or software for multiple framing. Framing control logic602may be implemented in many different ways, and in one implementation, framing control logic602may derive a value of the zoom for the first image in a multiple framing shot and then repeatedly apply a percent magnification, as specified by a user, to the subsequent shots in the same multiple framing shot. For example, if a multiple framing shot takes three pictures and applies 30% magnification, framing control logic602may determine the zoom of the first picture to be 30% less than the zoom at which the subject is shot; the next zoom may be determined to be the same as the zoom at which the subject is shot; and the last zoom to be 30% greater than the zoom at which the subject is shot. In another implementation, framing control logic602may store user-specified zoom values, measured relative to the zoom at which a user views the subject, for each image. For example, a user may specify 20% less zoom for the first image, 10% less zoom for the second image, 0% zoom for the third image, 10% greater zoom for the fourth image, and so forth.

User interface604may include hardware and/or software for accepting user inputs. In one implementation, user interface604may accept inputs for white balance, zoom, exposure value, shutter speed, and/or a size of the opening of an iris/diaphragm. In addition, for multiple framing, user interface604may accept values for a percentage magnification, a number of frames, a delay between shots, and/or a multiple framing state, which will be described shortly.

A zoom may indicate the desired level of magnification for each shot. An exposure value may convey to device200how much light to which light sensor502and/or film316may be exposed. A shutter speed may specify how quickly shutter assembly404opens and closes for allowing a pulse of light to reach film316and/or light sensor502. A size for the iris/diaphragm opening may affect how large iris/diaphragm may open and how much light may reach film316and/or light sensor502.

A percentage magnification may determine how much zoom to apply for each image or picture that is captured or taken during a multiple framing shot. For example, ifFIGS. 1A-1Cshow three pictures taken during a multiple framing shot and if a user has specified 30% for the percentage magnification, the hotel inFIG. 1Bmay be 30% larger than that inFIG. 1Aand the hotel inFIG. 1Cmay be 30% larger than that inFIG. 1B.

A number of frames may specify how many pictures are to be taken or images are to be captured in a multiple framing shot.

A delay between framing may specify how long device200may wait before taking a picture after taking the previous picture in a multiple framing shot. For example, inFIGS. 1A-1C, if the delay is 0.1 second, the picture inFIG. 1Bmay have been taken 0.1 second after the picture inFIG. 1Aand the picture inFIG. 1Cmay have been taken 0.1 second after the picture inFIG. 1B.

A multiple framing state may indicate whether device200is in a mode for taking multiple framing shots. If the multiple framing state indicates device200is in a mode for taking multiple framing shots, a user input for triggering a shot (e.g., clicking on a camera button) may be interpreted by device200as a request to take a multiple framing shot.

As explained above, in one implementation, the input values that are related to multiple framing may include a percentage magnification, a number of shots, a delay between shots, and a multiple frame state. For different implementations, other types of input parameters may be accepted by user interface604. For example, in one implementation, a user may specify only the number of shots. In such an implementation, other parameters, such as the percentage magnification, may be preset and may not be modified by the user.

In addition to the above described input values, many types of inputs for controlling device200may be accepted by user interface604, depending on implementation of device200. For instance, user interface604may accept inputs that instruct device200to display an image that has been captured and/or to remove an image from memory302and/or database608.

If a user does not provide one or more input values, user interface604may supply default values, such as a default shutter speed or a default opening size of an iris/diaphragm. In addition, user interface604may disallow a user from specifying inputs that conflict with other inputs. For example, interface604may prevent the user from concurrently inputting the size of iris/diaphragm opening, the shutter speed and the exposure value.

Returning to describing other elements inFIG. 6, photographing control logic606may include hardware and/or software for adjusting zoom (i.e., magnification), focus, and exposure of film by controlling lens assembly312based on the outputs from sensors314. In addition, photographing control logic606may control the duration for which flash318is lit based on the outputs from luminance sensor504. In many implementations, photographing control logic606may provide automatic white balancing.

Database608may include records and files and may act as an information repository for framing control logic602, user interface604, and/or photographing logic606. For example, framing control logic602may retrieve user-inputted parameters from database608. User interface604may store and/or retrieve images and/or user-inputted values to and from database608. Photographing control logic606may retrieve user-inputted parameters and/or images from database608.

Exemplary Process for Multiple Framing

FIG. 7Ashows an exemplary process for taking a multiple framing shot. At block702, user inputs are accepted and/or stored in database608through user interface604.

At block704, a new zoom value may be accepted and the view may be optically zoomed based on the value. User interface608may allow a user to change zoom easily, as the user may often change zoom, depending on a view. At block706, outputs from sensors314may be obtained. In one implementation, the outputs of luminance sensor504and focus sensor506may be obtained.

At block708, the zoom value, the outputs of luminance sensor504, and focus sensor506, and the user inputs may be used to obtain a white balance and/or a focus and determine the shutter speed and/or the iris/diaphragm opening size. Any change to a view and/or a zoom may affect the exposure of film316and/or light sensor502, and therefore, the shutter speed and/or the iris/diaphragm opening may be re-determined.

The relationship between the iris/diaphragm opening size and shutter speed (exposure time) may be given by:
N2/t=IS/K,(1)
where N measures the ratio of the focal distance of the lens to iris/diaphragm opening (i.e., relative aperture), t is the shutter speed, I is the average luminance, S is the sensitivity of film to light, and K is a calibration constant.

When a zoom and/or a view changes, the shutter speed and the aperture size may be adjusted in accordance with expression (1). Depending on the specific implementation of zoom lens assembly402, adjusting the magnification may affect its focal distance, which in turn may affect N in expression (1). In addition, changing a view may affect the luminance, I.

At block710, whether a trigger for taking a shot is activated may be determined. For example, a user may click on a button to trigger device200to take a shot of a view. In such an instance, the trigger may be deemed as activated.

If the trigger is not deemed as activated, at block712, the view is not captured as an image. Until the trigger is activated, blocks704-712may be repeated.

If the trigger is deemed as activated, then, at block714, either the view may be captured as an image, or image(s) of the view may be framed, depending on whether device200is in the state of multiple framing. If device200is not in the state of multiple framing, photographing control logic606may drive flash318to shine and shutter assembly404to open and close, in order to expose film316and/or light sensor502to the view for an appropriate amount of light. Any image that is captured on light sensor502may be immediately transferred to memory302. In some implementations, the captured image may be white balanced. Once the view is captured as an image, the process may return to block704.

If device200is in the state for multiple framing, image(s) of the view may be framed.FIG. 7Bshows an exemplary process for framing image(s) of a view.

At block716, a total number of images that have been captured during the framing may be compared with the inputted number of frames. If the number of images that have been captured is greater than or equal to the inputted number, the process may return to block704(FIG. 7A). If the number of images that have been captured is less than the inputted number, block718may be performed.

At block718, a zoom value may be obtained and the view may be optically zoomed based on the value. The zoom may be obtained in many ways.

In one implementation, a zoom for a captured image may not be repeated for other images within a single multiple framing shot. For example, if a user has specified 3 shots and 10% magnification for framing, the zoom of the first captured image in the multiple framing shot may be determined as 10% smaller than the zoom set at block704. The zoom of the second image may be determined as being equivalent to the zoom at block704, and the zoom of the third image may be determined as 10% larger than the zoom set at block704.

In another implementation, device200may allow a user to input and set zooms for all of the individual images that are to be captured during a multiple framing shot. Such an implementation may be useful, for instance, if a user wishes to take a multiple framing shot of a fast moving subject of whose view changes rapidly.

At block720, outputs from sensors314may be obtained. In one implementation, the outputs of luminance sensor504and focus sensor506may be obtained. At block722, the zoom value, the outputs of luminance sensor504, and focus sensor506, and the user inputs may be used to obtain a white balance and/or a focus and determine the shutter speed and/or the iris/diaphragm opening size.

At block724, the view may be captured as an image. When the view is being captured, photographing control logic606may drive shutter assembly404to open and close, in order to expose film316and/or light sensor502to the view for an appropriate duration of time. In some implementations, the captured image may be white balanced. Any image that is captured on light sensor502may be immediately transferred to memory302.

Once the view is captured as an image, the process may return to block716. Each time blocks716-724are performed, an image is captured at a zoom level.

Alternative Implementation

FIGS. 8A and 8Bare front and rear views, respectively, of another exemplary device800in which systems and methods described herein may be implemented. As shown inFIGS. 8A and 8B, device800may include a display802, a lens assembly804, a flash806, and sensors808. While not shown, device800may also include components that have been described with references toFIGS. 3-6.

Display802may provide visual information to the user. For example, display806may provide information regarding incoming or outgoing calls, media, games, phone books, the current time, etc. In another example, display802may provide an electronic viewfinder, e.g., a cathode ray tube (CRT), liquid crystal display (LCD), or an organic light-emitting diode (OLED) based display that a user of device800may look through to view and/or focus on a subject and/or to replay previously captured material.

Lens assembly804, flash806, and sensors808may include components similar to the components of lens assembly312, flash318, and sensors314, and may operate in a manner similar to the manner in which lens assembly312, flash318, and sensors314operate.

EXAMPLE

The following example illustrates processes involved in multiple framing. The example is consistent with the exemplary process described above with reference toFIGS. 1,7A and7B.

Assume that Nilsson, who is visiting Lund, Sweden, powers up device200inFIG. 2. In addition, assume that zoom lens assembly402in device200provides a constant amount of light to various sensors at different foci.

Nilsson inputs 12 for the exposure value, 30% for the percentage of magnification, and 3 for the number of shots for multiple framing. In addition, Nilsson inputs a value for the multiple framing state, so that the value indicates device200is in the mode for taking multiple framing shots.

When Nilsson sees a hotel in Lund, Nilsson decides to take pictures and sets the zoom of device200at 2×. Device200obtains luminance sensor outputs and focus sensor outputs. In addition, based on Nilsson's inputs, the sensor outputs and the zoom value, device200obtains the correct focus of the hotel image and set its shutter speed to 1/125. In this example, device200does not change iris/diaphragm opening size.

When Nilsson clicks on a button on device200to take a multiple framing shot, device200determines that a trigger for taking a shot is activated. Because device200is in the multiple framing state, device200frames images of the view.

During the multiple framing shot, device200compares the total number of images, which have been captured after the trigger has been activated, with the number 3. At this point, the total number of images that have been captured is zero. Finding that additional images may be captured, device200obtains a zoom value relative to 2×, which has been set earlier.

In this example, device200determines its zoom based on the inputted percentage of magnification. Because Nilsson has inputted 30% magnification, and because the first image of the multiple framing shot is being captured, the device sets the zoom at the smallest value at which 30% magnification may be sequentially applied. The zoom value is set at 77% of the 2× value set by Nilsson (i.e., 1/1.3=0.769, or 77%). Device200also may obtain sensor outputs, determine its focus, adjust its shutter speed, and capture the first image of the multiple framing shot. The captured image of the hotel is illustrated inFIG. 1A.

During the multiple framing shot, as long as the total number of captured images is less than 3, device200continues to obtain a new zoom value, obtain sensor outputs, determine its focus and the shutter speed, and capture an image. Each time device200captures an image, device200increases its zoom by 30%.

When device200finishes capturing 3 images, the multiple framing shot terminates. Nilsson may decide, after viewing the images shown inFIGS. 1A-1C, that the third image is his favorite and to discard the images inFIGS. 1A and 1B.

CONCLUSION

The foregoing description of embodiments provides illustration, but is not intended to be exhaustive or to limit the embodiments to the precise form disclosed. Modifications and variations are possible in light of the above teachings or may be acquired from practice of the teachings.

For example, while series of blocks have been described with regard to processes illustrated inFIGS. 7A and 7B, the order of the blocks may be modified in other implementations. For example, block704,706, and708may be performed before as well as after block702and/or blocks704-708may be repeatedly performed, as a user sees different subjects through a viewfinder. In addition, non-dependent blocks, such as blocks706,710, and720, may represent acts that can be performed in parallel to other blocks.

Further, certain portions of the invention have been described as “logic” that performs one or more functions. This logic may include hardware, such as a processor, an application specific integrated circuit, or a field programmable gate array, software, or a combination of hardware and software.