Source: http://www.patentgenius.com/patent/7999859.html
Timestamp: 2015-01-27 20:57:25
Document Index: 727956312

Matched Legal Cases: ['application No. 10', 'Application No. 10', 'Application No. 2000', 'Application No. 2000', 'Application No. 2001', 'Application No. 4', 'Application No. 10', 'Application No. 11', 'Application No. 2001', 'Application No. 2001', 'Application No. 11', 'Application No. 2004', 'Application No. 2004', 'Application No. 2005', 'Application No. 10', 'Application No. 2004', 'Application No. 10', 'Application No. 00817749', 'Application No. 2006', 'Application No. 2006', 'Application No. 2006', 'Application No. 10', 'Application No. 2004', 'Application No. 2004', 'Application No. 10']

Digital camera for recording a still image while shooting a moving image - Patent # 7999859 - PatentGenius
7999859
12/076,702
Okada; Shigeyuki (Ogaki, JP)Hanafusa; Hiroshi (Hirakata, JP)Kojima; Noriaki (Ogaki, JP)
Lam; Hung H
348/231.2; 348/273; 348/333.02
348/143; 348/149; 348/224.1; 348/231.1; 348/231.2; 348/240.1; 348/273; 348/333.02
H04N 5/76; H04N 5/222
04-068770; 2922598; H 04-129488; H 4-269936; H 5-236412; 8-275034; 09-284718; 10-108121; 10-191029; 10-276402; 10-276402; 10-308916; H 10-327339; 11-055617; 11-055617; H 11-075148; H 11-308488; 11-341418; 2000-50263; 2000-078486; 2000-78486; 2000-261806; 2001-016490; 2001-245299; 2001-333301; 1997-0031839
Korean Office Action dated May 25, 2009, issued in corresponding Korean patent application No. 10-2008-7008539. cited by other.Korean Office Action dated May 19, 2008, corresponding Korean Patent Application No. 10-2008-7008539. cited by other.International Search Report dated Feb. 27, 2001, Application No. PCT/JP00/08977. cited by other.Japanese Office Action dated Oct. 18, 2002, Application No. 2000-388760. cited by other.Japanese Office Action dated Oct. 18, 2002, Application No. 2000-066074. cited by other.Japanese Office Action dated Dec. 16, 2003, Application No. 2001-066075. cited by other."Written Opposition" submitted by the opponent in the opposition to the patent and the partial English translation herewith. cited by other.Japanese Office Action--Notification for Reasons for Revocation dated Jul. 9, 2004, for Patent No. 3398138, with Japanese Patent No. 3398138. cited by other.Opponent's Exhibit 1--Japanese Laid Open Patent Application No. 4-129488 (relevant portions). cited by other.Opponent's Exhibit 2--Japanese Laid Open Patent Application No. 10-327339 (relevant portions). cited by other.Opponent's Exhibit 3--Japanese Laid Open Patent Application No. 11-75148 (relevant portions). cited by other.Japanese Office Action--Decision of Refusal dated Aug. 3, 2004, Application No. 2001-066075 with Japanese Patent Application No. 2001-66075 with relevant portions of cited Japanese Application No. 11-75148 (paragraphs [0047], [0048], and [0063].cited by other.Japanese Office Action dated Oct. 18, 2005, Application No. 2004-260855, which is a divisional of Japanese patent application JP 2001-066075, claiming priority of JP 2000-071782. cited by other.Notice of Reasons for Refusal dated May 9, 2006, Ref. No. NPC1040142. cited by other.Notice of Reasons for Refusal dated May 9, 2006, Ref. No. NQC1050096. cited by other.Decision of Refusal for Japanese Patent Application No. 2004-276235 dated Aug. 1, 2006. cited by other.Decision of Refusal for Japanese Patent Application No. 2005-187777 dated Aug. 1, 2006. cited by other.Korean Office Action dated Feb. 13, 2007, Application No. 10-2002-7007932. cited by other.Written Amendment dated Nov. 22, 2006, Application No. 2004-035124, which claims priority of JP 2000-071782. cited by other.Korean Office Action dated Sep. 11, 2007, Application No. 10-2007-7016031. cited by other.Chinese Office Action dated Sep. 7, 2007, Application No. 00817749.X. cited by other.Japanese Office Action dated Feb. 17, 2009, issued in corresponding Japanese Patent Application No. 2006-266540. cited by other.Japanese Office Action dated Feb. 17, 2009, issued in corresponding Japanese Patent Application No. 2006-266541. cited by other.Japanese Office Action dated Feb. 17, 2009, issued in corresponding Japanese Patent Application No. 2006-266542. cited by other.Korean Office Action dated Mar. 10, 2008, Application No. 10-2007-7016031. cited by other.Japanese Office Action, Questioning issued on Jun. 24, 2008 for corresponding Japanese Patent Application No. 2004-35124. cited by other.Response to Questioning in corresponding Japanese Application No. 2004-35124, submitted Jul. 9, 2008. cited by other.Korean Office Action dated Nov. 11, 2008, Application No. 10-2008-7008539. cited by other.United States Office Action issued in U.S. Appl. No. 12/076,715 dated Dec. 22, 2010. cited by other.United States Office Action issued in U.S. Appl. No. 12/076,717 dated Nov. 10, 2010. cited by other.United States Notice of Allowance issued in U.S. Appl. No. 12/076,717, mailed Mar. 3, 2011. cited by other.United States Office Action issued in U.S. Appl. No. 12/076,703, mailed Jan. 12, 2011. cited by other.United States Office Action issued in U.S. Appl. No. 12/076,715 dated Jun. 1, 2011. cited by other.
In a digital camera, when snapshot shooting is instructed during recording of a moving image, a shot still image is temporarily pushed aside in a memory area for use in pushing aside (7a) in a frame buffer (7). A currently shooting motion image and a still image are displayed in parallel on a display (9), so that a user can confirm a content of a snapshot. The moving image continues to be recorded even during a push-aside operation. After a moving image processing is completed, the still image is processed by an image correcting circuit (4). The frame buffer (7) comprises a plurality of frame recording areas, and is shared on the occasions of a moving image processing and a still image processing. In a normal moving image processing, these areas are utilized in a cyclic manner, and when the still image is shot, any of areas will be utilized. Thereafter, the rest of areas are utilized in the cyclic manner for the moving images. The recording function for the moving image and still image is improved at low cost, it becomes easy to take a snapshot, and the merchandise size is not increased.
What is claimed is:1. a digital camera comprising: a storage unit which includes a memory area to sequentially and temporarily store moving image data comprising a series of frames; a displaycontrol unit which generates an image signal from the series of frames in the memory area to display a series of images as a moving image on a display; and a control unit which responsive to a still image capture instruction signal to be input when theseries of images is being displayed as the moving image, on the display as a moving image, assigns part of captures a single frame stored in the memory area, the single frame corresponding to one of the series of images on the display when the stillimage capture instruction signal is input, so as to maintain the captured single frame in the memory area to, instructs said display control unit to display on the display a still image from the captured single frame stored in the memory assigned areatogether with the moving image and instructs said display control unit to stop display on the display the still image together with the moving image if still image capture instruction signal is not inputted after a predetermined time, wherein when thesingle frame is captured, the storage unit sequentially and temporarily overwrites previous moving image data with subsequent moving image data in the memory area other than an area where the captured single frame is maintained.2. A digital camera as recited in claim 1, further comprising a unit which inputs the still image capture instruction signal.3. A digital camera as recited in claim 1, wherein said control unit controls said display control unit in a manner such that a still image displayed during display of a moving image is displayed on the display in parallel with the movingimage.4. A digital camera as recited in claim 3, wherein said control unit controls said display control unit in a manner such that the still image is set to a main picture of the display so as to be displayed thereon.5. A digital camera as recited in claim 3, wherein said control unit controls said display control unit in a manner such that the moving image is set to a main picture of the display so as to be displayed thereon.6. A digital camera as recited in claim 1, wherein said control unit controls said display control unit in a manner such that the still image is displayed for a predetermined period of time.7. A digital camera as recited in claim 1, wherein said control unit controls said display control unit in a manner such that either the still image or the moving image is selected in a switchable manner and thus is set to a main picture of thedisplay so as to be displayed thereon.8. A digital camera as recited in claim 1, wherein said control unit sets said display control unit in a manner that permission/denial of display of the still image is switchable.9. A digital camera as recited in claim 1, wherein said control unit controls said display control unit in a manner that the still image is displayed for time duration only according to a user's instruction.10. A digital camera, comprising: a storage unit which includes a memory area to sequentially and temporarily store moving image data comprising a series of frames; a moving image encoder which codes the shot image data read from the storageunit as a moving image comprising a plurality of frames; a display control unit which generates an image signal from the series of frames in the memory area to display a series of images as a moving image on a display; a control unit which, responsiveto a still image capture instruction signal to be input when the series of images is being displayed as the moving image, captures a single frame stored in the memory area, the single frame corresponding to one of the series of images on the display whenthe still image capture instruction signal is input, so as to maintain the captured single frame in the memory area, instructs said display control unit to display on the display a still image from the captured single frame stored in the memory areatogether with the moving image and instructs said display control unit to stop display on the display the still image together with the moving image if still image capture instruction signal is not inputted after a predetermined time; the storage unitsequentially and temporarily overwriting previous moving image data with subsequent moving image data in the memory area other than an area where the captured single frame is maintained when the single frame is captured; a still image encoder whichcodes the captured single frame from the storage unit; a moving image encoder which codes the moving image data read from the storage unit; and an interface for an external memory which records the captured single frame coded by said still imageencoder and the moving image data coded by said moving image encoder.11. A digital camera as recited in claim 10, further comprising a unit which inputs the still image capture instruction signal.12. A digital camera as recited in claim 10, wherein said control unit controls said display control unit in a manner such that a still image displayed during display of a moving image is displayed on the display in parallel with the movingimage.13. A digital camera as recited in claim 12, wherein said control unit controls said display control unit in a manner such that the still image is set to a main picture of the display so as to be displayed thereon.14. A digital camera as recited in claim 12, wherein said control unit controls said display control unit in a manner such that the moving image is set to a main picture of the display so as to be displayed thereon.15. A digital camera as recited in claim 10, wherein said control unit controls said display control unit in a manner such that the still image is displayed for a predetermined period of time.16. A digital camera as recited in claim 10, wherein a coding unit of said still image encoder and that of said moving image encoder are shared in common.17. A digital camera as recited in claim 10, wherein said control unit controls said display control unit in a manner such that either the still image or the moving image is selected in a switchable manner and thus is set to a main picture ofthe display so as to be displayed thereon.18. A digital camera as recited in claim 10, wherein said control unit sets said display control unit in a manner that permission/denial of display of the still image is switchable.19. A digital camera as recited in claim 10, wherein said control unit controls said display control unit in a manner that the still image is displayed for time duration only according to a user's instruction.
TECHNICAL FIELDThe present invention relates to a digital camera such as a memory control device and an electronic still camera. The present invention also relates to an image processing method and an image processing apparatus which can be used therefor. The present invention relates to technology in which to code or decode according to the MPEG (Moving Picture Expert Group) and JPEG (Joint Photographic Coding Expert Group) standards, and relates to apparatuses which utilize the technology.BACKGROUND TECHNOLOGYIn recent years, the demand for electronic still cameras is expanding in the place of cameras using the silver-salt photographing technology developed since 19th century. In the electronic still camera, "JPEG" is used as a data compression andexpansion technique in order to efficiently process image data on the occasions of transmitting and storing the image data. A technical core of the JPEG method lies in the discrete cosine transform (DCT).Since the compression and expansion of moving image data are also possible according to the JPEG method, there is an electronic still camera using this method, which is equipped with a shooting function of the moving image. The technology inwhich the moving image data are compressed and expanded in units of frame by the JPEG method is called M-JPEG (Motion-JPEG).On the other hand, "MPEG" is one of techniques in which to compress and expand multimedia data including moving images. In the MPEG method, the technical core used in the video part lies in motion compensated prediction (MC) and DCT. Thecoding technique combining MC and DCT is called the hybrid coding technique. It can be said that the MPEG method is the technique in which the MC is combined into the JPEG method.In the electronic still camera utilizing the MPEG method, it is desired that a snapshot which corresponds to one frame of the moving image can be recorded during the shooting of the moving image; for example, such a technique is disclosed inJapanese Patent Application Laid-Open No. Hei11-75148. It is known that in this type of electronic still camera there is provided an exclusive-use memory area for use in pushing aside and storing snapshot data. However, in this type of camera, thisexclusive-use memory area is not utilized until the snapshot shooting is instructed, so that the effective usage rate of the memory during the shooting of moving image is not enhanced. Making it compact-size and low-cost plays a crucial role inevaluation of merchandise values, and it is admitted that there is a room for improvement in terms of implementing area and cost performance. This is the first problem which the inventor of the present invention recognized.The second problem which the inventor recognized relates also to the similar room for improvement. Since the photographed snapshot is oftentimes printed on paper medium by using a video printer or the like, high image quality is required. However, when the moving image is recorded with the same high image quality as the snapshot, the memory capacity runs out quickly. Thus, a technique is known in which the still image is recorded at the same pixel density level as that in the shooting ofthe still image, and the moving image whose pixel density is reduced after performing a filtering processing thereon is recorded. In this conventional technique, however, the edge smoothing of the still image or emphasis processing thereof, for example,and so forth can not be performed, thus a filter circuit needs to be newly provided in order to realize these functions.The third problem that the inventor recognized relates to the usability of a user at the time of shooting a snapshot. Conventionally, the outcome of the photographed snapshot is confirmed only after the shooting of the moving image iscompleted, so that there are many occasions where the proper photographing of the snapshot is missed out when the shooting of the snapshot is mistaken. Moreover, provision of two shooting modes for the moving image and snapshot is not likely to become ause-friendly design.DISCLOSURE OF THE INVENTIONTherefore, an objective of the present invention is to provide a technique in which to give merits in terms of implementing area or cost performance thereof in the digital cameras and related technical field thereof. Another objective of thepresent invention is to provide a technique in which to realize further user-friendly merchandise in the digital cameras and the related technical field. These objectives and those related thereto become gradually clearer hereinafter.A certain mode of the present invention relates to an image processing apparatus. This apparatus comprises: a signal processing circuit which, after performing at least gamma correction or white balance adjustment on image data, outputs theimage data, a still image encoder which codes the image data as a still image; a moving image encoder which codes the image data as a series of motion images; an image correcting unit, provided in an input route of the image data leading to the stillimage encoder and the moving image encoder, which performs a filtering processing on the image data; and a control unit which controls a series of these processings.By implementing this structure, both the still image and the motion image can be filtering-processed by the same image correcting unit. Those filtering processings may be set in a manner such that contents thereof are made different. Forexample, the filtering processing performed on the image data for the still image encoder (hereinafter referred to as a "first filtering processing" also) may include a pixel value transform processing, and the filtering processing performed on the imagedata for the moving image encoder (hereinafter referred to as a "second filtering processing" also) may include a pixel density transform processing. A plurality of types of the first filtering processings may be prepared and there may be provided aselector which selects a desirable filtering function from these processings. The filtering processing may be able to be set to an identity transform processing in which an input coincides with an output.This apparatus may further comprise a storage unit which temporarily stores image data for one frame, in response to a still image record instructing signal during a coding processing by the moving image encoder. This image data may be imagedata prior to or after correction by the image correcting unit.Another mode of the present invention relates to an image processing method. In this method, a filtering processing is performed on image data, both generated through at least gamma correction or white balance adjustment, to be coded as a stillimage (hereinafter possibly abbreviated simply as "still image data") and image data to be coded as a moving image (hereinafter possibly abbreviated simply as "moving image data"), by a common image correcting unit. According to this method, an edgeemphasis processing, for example, can be performed on the still image data, and a pixel number reduction processing can be performed on the motion image data.Still another mode of the present invention relates an image processing method. In this method, a processing route of the still image data and that of the moving image data, both data having been processed by a signal processing circuit, areunified, so that they are inputted to a common image correcting unit; and a predetermined processing is performed in a time sharing manner. Namely, at the timing of performing respective processings on the still image data and the moving image data, theimage correcting unit operates as the same or different processor. When the image correcting unit performs the filtering processings and the still image data and moving image data are processed, a filter coefficient may be dynamically changed.Still another mode of the present invention relates to a digital camera. This camera includes: a signal processing circuit which performs a processing, including an A-D conversion, on a shot image signal; a still image encoder which codes imagedata outputted from the signal processing circuit, as a still image; a moving image encoder which codes the image data as a series of moving images; and an image correcting unit, provided in an input route of the image data leading to the still imageencoder and the moving image encoder, which performs a filtering processing on the image data.Still another mode of the present invention relates to a digital camera. This camera is capable of recording a still image during shooting of a moving image, and it comprises: a display control unit which generates an image signal by which shotimage data are displayed on a display; and a control unit which, while the shot image data are being displayed on the display as a moving image, instructs the display control unit to display on the display a still image corresponding to part of themoving image, for example the still image corresponding to one frame. By this structure, when a snapshot is photographed during the recording of the moving image, the contents thereof can be confirmed, so that if the outcome thereof is not satisfactoryone can shoot again another snapshot.Still another mode of the present invention relates to a digital camera. This camera comprises: a still image encoder which codes shot image data as a still image; a moving image encoder which codes the shot image data as a series of movingimages; a recording unit which records image data coded by the still image encoder and the moving image encoder; a display control unit which generates an image signal by which the shot image data are displayed on a display; and a control unit whichcontrols a series of processings, wherein the control unit is structured such that, while the shot image data are being displayed on the display as a moving image, image data shot at a timing responsive to a still image shooting instruction signal isdisplayed on the display. This camera may further comprise a unit, such as an operational button and a switch or the like, which inputs a shooting instruction of the still image.The control unit may control the display control unit in a manner such that the motion image and the still image are displayed in parallel. By operations of the control unit, either one of the still image or the motion image displayed inparallel may be set to a main picture of the display so as to be displayed thereon, and these may be switchable, and, for example, permission or denial of the display of the still image may be able to be set. The still image may be displayed for apredetermined period of time, and the displayed period of time may be determined according to a user's instruction. When the still image is displayed, the user may be able to erase it, for example, by pressing a predetermined button.Still another mode of the present invention relates to a digital camera. This camera is capable of recording a snapshot during shooting of the moving image, and it comprises: a display control unit which generates an image signal by which shotimage data are displayed on a display; and a control unit which, while the shot image data are being displayed on the display as a moving image, instructs the display control unit to display the snapshot on the display.Still another mode of the present invention relates to an image processing method in the digital camera. This method includes: a processing of shooting a moving image; a processing of shooting a snapshot during shooting of the moving image; aprocessing of displaying the shot moving image; and a processing of displaying the shot snapshot, wherein the moving image and the snapshot are displayed in the digital camera in a simultaneously visible manner. In addition to a case in which the motionimage and the snapshot are displayed in parallel on a single display, they may be displayed on different displays and it suffices as long as they are simultaneously visible. Moreover, this simultaneous visible state may be generated for a predeterminedlimited duration of time.Still another mode of the present invention relates to a memory control device. This device comprises: a storage unit which includes a plurality of memory areas which sequentially stores inputted data; and a control unit which controlsinput-output of the storage unit in a manner that the memory areas are used cyclically, wherein input-output of the storage unit is controlled by the control unit in a manner that, when the control unit stores data in arbitrary memory area within aplurality of the memory areas, the remaining memory areas are used cyclically. In each memory area, the data may be stored in predetermined units of block, for example in units of image frame or in units of data's coded group.Still another mode of the present invention relates to a digital camera. This digital camera is equipped with the above-described memory control device and is capable of recording a still image corresponding to part of a moving image duringshooting of the moving image. The storage unit sequentially stores inputted moving image data in a plurality of the memory areas. The control unit controls input-output of the storage unit in a manner that when the data are taken in at astore-the-still-image instructing timing, in a plurality of the memory areas the moving image data are taken into the remaining memory areas excluding the memory area which stored said data.The control unit may control in a manner that when data are again taken in at the store-the-still-image instructing timing, previously stored data are cancelled, namely, overwrite by other data is permitted, and the moving image data are takeninto the rest of the memory areas excluding the memory area which stores newly taken-in data. Alternatively, it may control in a manner that the moving image data are taken into the remaining memory areas excluding the memory areas that store thepreviously stored data and the memory areas that store newly taken-in data.Still another mode of the present invention relates to an image processing apparatus equipped with a memory control device which performs a control by which image data are stored in a memory. This memory includes a put-to-common-use area whichtemporary stores moving image data and still image data so as to be respectively given to predetermined image processings. When storing the still image data, the memory control device utilizes an area, in the put-to-common-use area, having moving imagedata whose processing has been completed, and when storing the moving image data the memory control device sequentially utilizes areas other than those which store unprocessed still image data in the put-to-common-use area.A digital camera equipped with this image processing apparatus may be provided. In that case, when shooting of a still image is instructed for the second time during shooting of a moving image, the memory control device, on the occasion ofstoring still image data for the second time, may utilize an area other than that which stores the still image data shot for the first time. This digital camera may further comprise a control unit which, according to a user's instruction, selects eitherone of the still image data shot for the first time or the still image data shot for the second time, so as to be finally stored. Moreover, on the occasion of storing still image data for the second time, the area which stores the still image data shotfor the first time, may be utilized by overwriting contents thereof.Moreover, arbitrary combinations of the above-described elements and so forth, as well as expressions thereof changed between a method, an apparatus, a recording medium, a computer program, etc. are encompassed by the scope of the presentinvention.BRIEF DESCRIPTION OF THE DRAWINGSThe above described objectives, other objectives, features and advantages are further made clear by the following preferred embodiments and drawings accompanied thereby.FIG. 1 is a block circuit diagram showing an electronic still camera according to an embodiment in which the present invention is embodied.FIG. 2 is a schematic block diagram showing a JPEG core circuit and an MPEG core circuit according to the present embodiment.FIG. 3 is a schematic block diagram showing an image data correcting circuit according to the present embodiment.FIG. 4 is a circuit diagram showing a filter unit of the image data correcting circuit according to the present embodiment.FIG. 5 is a flowchart showing operations of the electronic still camera according to the present embodiment.FIG. 6 is a flowchart showing operations of the electronic still camera according to the present embodiment.FIG. 7 is a flowchart showing operations of the electronic still camera according to the present embodiment.FIG. 8 is a flowchart showing operations of the electronic still camera according to the present embodiment.FIG. 9 shows a display screen obtained at the time of recording a snapshot by the electronic still camera, according to the present embodiment.FIG. 10 is provided for describing a usage mode of a frame buffer, according to the present embodiment.FIG. 11 is provided for describing another example of the usage mode of the frame buffer, according to the present embodiment.THE BEST MODE FOR CARRYING OUT THE INVENTIONFIG. 1 is a block circuit diagram showing an electronic still camera 1 utilizing JPEG and MPEG method according to an embodiment.The electronic still camera 1 comprises an image pickup device 2, a signal processing circuit 3, an image data correcting circuit 4, a JPEG core circuit 5, an MPEG core circuit 6, a frame buffer 7, a display circuit 8, a display 9, a memory card10, input-output circuit 11, data buses 12 and 13, a control core circuit 14 and a group of operational buttons 15.The control core circuit 14 controls each component 2-13 of the electronic still camera 1 in response to an ON-OFF signal of the group of operational buttons 15. The group of buttons 15 includes a still picture recording button 15a, a movingpicture recording button 15b and other selection buttons 15c.The image pickup device 2 comprises a CCD (Charge Coupled Device) and so forth, and shoots a subject image so as to generate an output signal. The signal processing circuit 3, which includes an A-D converting circuit, generates original imagedata, for example, whose pixel number is vertical 1200.times. horizontal 1600, in units of picture, by performing white balance adjustment and gamma correction and so forth after the output signal of the image pickup device 2 is A-D converted. Theoriginal image data generated by the signal processing circuit 3 is transferred to either of the frame buffer 7 or the display circuit 8, or both thereof via the data bus. The display circuit 8 generates an image signal from image data, in a singlepicture unit, transferred via the data bus 12. The display 9 displays the image signal generated by the display circuit 8, as a subject image.The frame buffer 7 comprises a rewritable semiconductor memory such as SDRAM (Synchronous Dynamic RAM), DRAM, Rambus DRAM and the like, stores pictures transferred via the data bus 12, namely, stores the image data in units of frame, and readsout the stored image data picture by picture. In this frame buffer 7, there is provided a memory area 7a (hereinafter referred to also as a memory area for use in pushing aside 7a) which temporarily pushes aside applicable still image data for one frameand stores it in response to an ON signal of the still picture recording button 15a during recording of moving images.The picture-by-picture image data read out from the frame buffer 7 are transferred to the image data correction unit 4 via the data bus 12. The image data correction circuit 4 performs a correction processing, which will be described later, onimage data inputted from the signal processing circuit 3. The picture-by-picture image data, generated from the image data correcting circuit 4, on which the correction processing has been performed, are transferred to the JPEG core circuit 5 or theMPEG core circuit 6 via the data bus 12.The memory card 10 is mounted on the electronic still camera 1 in a detachable manner and includes a flash memory 10a therein. The flash memory 10a stores picture-by-picture compressed image data transferred via the data bus 13, and reads outthe stored compressed image data picture by picture so as to be outputted to the data bus 13.The input-output circuit 11 outputs picture-by-picture image data transferred via the data bus 13 to external apparatuses connected to the electronic still camera 1, for example, an external display, a personal computer, a printer or the like,and outputs image data inputted from these external apparatuses, to the data bus 13. The image data read out from the memory card 10 or the image data inputted via the input-output circuit 11 are transferred to the JPEG core circuit 5 or the MPEG corecircuit 6 via the data bus 13.As shown in FIG. 2, the JPEG core circuit 5 comprises a DCT circuit 16, a quantization circuit 17, a Huffman coding circuit 18, a Huffman decoding circuit 19, an inverse quantization circuit 20, and an inverse DCT (IDCT; Inverse DCT) circuit 21. In the JPEG core circuit 5, image data of one picture are divided into a plurality of macroblocks set by standards of the JPEG method, and then a compression-expansion processing is performed thereon for each block. The DCT circuit 16, the quantizationcircuit 17 and the Huffman coding circuit 18 constitute a JPEG encoder so as to perform the compression-coding processing on still image data, and the Huffman decoding circuit 19, the inverse quantization circuit 20 and the inverse DCT circuit 21constitute a JPEG decoder. The JPEG core circuit 5 or the JPEG encoder serves as an example of "a still image encoder" in the present invention.The DCT circuit 16 takes in image data of one picture in one block unit, against picture-by-picture image data read out from the frame buffer 7, and a two-dimensional discrete cosine transform (DCT: Discrete Cosine Transform) is performed on theimage data so as to generate DCT coefficients. The quantization circuit 17 quantizes the DCT coefficient supplied from the DCT circuit 16, by referring to a quantization threshold value stored in a quantization table stored in a RAM (not shown).The Huffman coding circuit 18 performs variable-length coding on the DCT coefficients quantized by the quantization circuit 17, by referring to Huffman codes stored in a Huffman table stored in a RAM (not shown), so that compressed image dataare generated picture by picture. The compressed image data generated by the Huffman coding circuit 18 are transferred to at least one of the memory card 10 or the input-output circuit 11 via the data bus 13.The MPEG core circuit 6 is constituted by adding first and second MC (motion compensated prediction) circuits 22a and 22b to the Huffman coding circuit 18. Thus, the DCT circuit 16, quantization circuit 17, Huffman coding circuit 18, Huffmandecoding circuit 19, inverse quantization circuit 20, and inverse DCT circuit 21 are shared by the JPEG core circuit 5 and the MPEG core circuit 6, and whether to use the JPEG core circuit 5 or the MPEG core circuit 6 in which the first and second MCcircuits 22a and 22b are added to this circuit 5 is selected by a switch signal from the control core circuit 14. It is presupposed that the JPEG and the MPEG are provided with the above-described quantization table and Huffman table, separately.In the MPEG core circuit 6, image data of one picture are divided into a plurality of macroblocks set by standards of the MPEG method, and then a compression-expansion processing is performed thereon for each block. The DCT circuit 16, thequantization circuit 17, the Huffman coding circuit 18 and the first MC circuit 22a constitute an MPEG encoder so as to perform the compression-coding processing on moving image data, and the Huffman decoding circuit 19, the inverse quantization circuit20 and the inverse DCT circuit 21 and the second MC circuit 22b constitute an MPEG decoder. The MPEG core circuit 6 or the MPEG encoder serves as an example of "a moving image encoder" in the present invention. The compressed image data generated bythe MPEG encoder, too, are transferred to at least one of the memory card 10 or the input-output circuit 11 via the data bus 13.In the JPEG core circuit 5 or the MPEG core circuit 6, the Huffman decoding circuit 19 performs the variable-length decoding on the picture-by-picture compressed image data transferred via the data bus 13 by referring to Huffman codes, so thatexpanded image data are generated picture by picture. The inverse quantization circuit 20 inverse-quantizes the picture-by-picture expanded image data generated by the Huffman decoding circuit 19, by referring to the quantization threshold value, so asto generate DCT coefficients.The inverse DCT circuit 21 performs the two-dimensional inverse discrete cosine transform (IDCT: Inverse DCT) on the DCT coefficients generated by the inverse quantization circuit 20. In the MPEG core circuit 6, the second MC circuit 22bperforms an MC processing on the picture-by-picture expanded image data on which the inverse discrete cosine transform has been performed by the inverse DCT circuit 21.The expanded image data from the JPEG core circuit 5 or the MPEG core circuit 6 are transferred to the frame buffer 7 via the data bus 12. The frame buffer 7 stores the transferred picture-by-picture image data. The display circuit 8 generatesan image signal, from the picture-by-picture image data transferred from the frame buffer 7 via the data bus 12, so that the signal is displayed on the display 9 as a subject image.As shown in FIG. 3, the image data correcting unit 4 comprises a digital filter unit 23, a ROM 24 and a timing control unit 25. The digital filter unit 23 includes a spatial filter which is a non-cyclic type digital filter, for example, an FIR(Finite Impulse Response) filter. The digital filter unit 23 comprises, as shown in FIG. 4, n units of delay elements 26 . . . , which delay n bits of input signal inputted from the signal processing circuit 3 for every sampling cycle, n+1 units ofmultipliers 27 . . . , and an adder 28 which convolutes signals from the multipliers 27 . . . . The respective coefficients a.sub.n, a.sub.n-1 . . . a.sub.2, a.sub.1 of the multipliers 27 . . . are coefficients that determine the characteristics ofthe filter, and coefficients for use with a filtering processing of the moving image data and those for use with a filtering processing of the still image data are written in advance in the ROM 24. These coefficients are in advance set to proper valuesthrough simulation at a manufacturing stage.For example, when the moving image data are filtering-processed, satisfactory low-pixel-density images are achieved by changing the value of each coefficient for every sampling cycle by the use of the concepts of linear interpolation and others. As an example, let us consider the case of reducing the horizontal number of pixels to 2/3. Suppose that there are three pixels p.sub.1 to p.sub.3 placed side by side horizontally in an original image. Now these pixels are converted into two pixelsq.sub.1 and q.sub.2 by the filtering processing for the moving image data. To accomplish this, q.sub.1 and q.sub.2 are each expressed as primary linear sum of p.sub.1, p.sub.2 and p.sub.3. Namely, a filtering processing for reducing a data amount isrealized by determining each coefficient of the linear sums by experiment or like means upon deciding on the ratio by which to express a degree of reduction in the number of pixels. As an example, the number of pixels may be reduced to 480(vertical).times.720 (horizontal).On the other hand, when the filtering processing is performed on the still image data, a high-pass filter may be formed by setting each coefficient so that a high-frequency region is emphasized. Thereby, a sharp image having less deteriorationat edge portions can be obtained while the number of pixels is kept at a constant rate. Though n=8 is set in the present embodiment, this of course may vary according to the freedom of designing.The timing control unit 25 controls the timing at which the coefficient is read out from the ROM 24, the timing of the latch of input-output data, the timing of filter operation and so forth, according to the control of the control core circuit14.Based on the above-described structure, operations for recording the image data will be described with reference to flowcharts shown in FIG. 5 to FIG. 8. In FIG. 5, the still image processing shown in FIG. 6 is performed when the still picturerecording button 15a is switched ON while the moving image processing shown in FIG. 7 is performed when the moving picture recording button 15b is switched ON.(Still Image Recording)Referring to FIG. 6, an original image signal taken in from the image pickup device 2 is inputted to the signal processing circuit 3 at a timing corresponding to the ON signal of the still picture recording button 15a and is then converted todigital original image data of one picture, so as to be taken into the frame buffer 7 (S1). The original image data of one picture are sent out from the frame buffer 7 to the image data correcting circuit 4 and are also sent out to the display circuit8, so that the still image is displayed on the display 9 (S2).The above-described correction processing designed for handling the still image is performed on the data taken in the image data correcting circuit 4 (S3), and the corrected data are inputted to the JPEG core circuit 5. Then, after apredetermined compression-coding processing is performed thereon (S4), they will be recorded in the flash memory 10a (S5).(Moving Image Recording)Referring to FIG. 7, the original image signal taken in from the image pickup device 2 is inputted to the signal processing circuit 3 at a timing corresponding to the ON signal of the moving picture recording button 15b and is then converted topicture-by-picture digital original image data, so as to be successively taken into the frame buffer 7 (S11). The picture-by-picture original image data are sent out from the frame buffer 7 to the image data correcting circuit 4 and are also sent out tothe display circuit 8, so that the moving image is displayed on the display 9 (S12).The above-described correction processing designed for handling the moving image is performed on the data successively taken in the image data correcting circuit 4 (S13), and the corrected data are inputted to the MPEG core circuit 6. Then,after a predetermined compression-coding processing is performed thereon (S14), they will be recorded in the flash memory 10a (S15). This operation continues until the ON signal is again sent out from the moving picture recording button 15b (S16).(Snapshot Recording)Referring to FIG. 7, when the ON signal is sent out from the still picture recording button 15a during the recording of the moving image, the control core circuit 14 judges that snapshot shooting is instructed from an external source and thenexecutes a snapshot processing shown in FIG. 8 (S17). Then, image data for one frame are temporarily pushed aside and stored in the memory area 7a for use in pushing aside in the frame buffer 7 (S21). During this pushing-aside operation, the recordingof the moving image continues. In other words, the original image signal taken in from the image pickup device 2 is inputted to the signal processing circuit 3 and is then converted to picture-by-picture digital original image data, so as to besuccessively taken into the frame buffer 7 (S22). The picture-by-picture original image data are sent out from the frame buffer 7 to the image data correcting circuit 4 and are also sent out to the display circuit 8. The above-described correctionprocessing designed for handling the moving image is performed on the data successively taken in the image data correcting circuit 4 (S23), and the corrected data are inputted to the MPEG core circuit 6. Then, after a predetermined compression-codingprocessing is performed thereon (S24), they will be recorded in the flash memory 10a (S25).In the present embodiment, the picture-by-picture original image data are sent out from the frame buffer 7 to the display circuit and, together with this, the image data for one frame pushed aside in the memory area for use in pushing aside 7aare sent out. The moving image of being presently shot and the still image to be recorded as a snapshot are displayed in parallel (S26) on the display 9. FIG. 9 shows an example of the moving image and the still image being displayed on the display 9in parallel, where a moving image 200 whose size is 1/16 of the picture is displayed in the upper right position of a screen while a still image 100 is displayed as a main picture.The still image is displayed for predetermined time duration, for example, for five seconds and, thereafter, the display is switched to display of the moving image alone (S27) and the operation is returned to the normal display image processingshown in FIG. 7 (S28). During the parallel display of the still image the user can confirm on the display 9 whether or not a desired snapshot was shot. When the ON signal is again sent out from the still picture recording button 15a during the displayof the still image, the processings of S21 to S27 are performed based on the data taken in at a timing corresponding to the ON signal (S29). In this case, the contents of the memory area for use in pushing aside 7a are replaced by new data.FIG. 10 is provided for explaining a usage state of the frame buffer 7 in the moving image processing and snapshot processing. The frame buffer 7 is provided with four normal memory areas A to D, and one picture, that is data for one frame, isstored for each memory area A-D. Of course, the number of the memory areas is changed as appropriate according to specifications of the camera 1.In the normal moving image processing shown in FIG. 7, as shown in FIG. 10(a), the picture-by-picture digital original data from the signal processing circuit 3 are stored in the order of A.fwdarw.B.fwdarw.C.fwdarw.D and are outputted to thedata bus 12 in the order starting from the one inputted first (First-In First-Out). When the data are stored in the last memory area D, the memory area A is again used. Namely, the memory areas A to D are used cyclically. For the cyclic use of theframe buffer 7, an LRU (Least Recently Used) algorithm and others such as a page memory control method may be adopted.When the ON signal for a snapshot is sent out from the still picture recording button 15a during the processing of the moving images, the data taken in at a timing corresponding to the ON signal is stored in a certain memory area and said areais used, as it is, as the memory area 7a for use in pushing aside the still image data. For example, when data taken in at a timing of recording a snapshot are stored in the third memory area C, the memory area C is used as the memory area 7a for use inpushing aside, as shown in FIG. 10(b), and in the moving image processing thereafter the remaining memory areas A, B and D are used cyclically. Thereafter, when another data taken in again at a timing of recording a snapshot are stored in the secondmemory area B this time, the data at the third memory area C are cancelled, that is, the data are removed from a protected subject and the second memory area B is used as the memory area for use in pushing aside 7a, as shown in FIG. 10(c), and in themoving image processing thereafter the memory areas A, C and D other than the second memory area B are used cyclically.As described above, the order in which the four memory areas A to D are used depends on the algorithm to be implemented; the memory areas may be used in the order, for example, ACDBAC . . . or ACDABC . . . or the like. In short, when thereexist a plurality of memory areas which have stored processing-completed moving image data, that are, the moving image data in which overwriting thereof is allowed, any memory area may be utilized for use in pushing aside the data. In these cases too,such usage is called "cyclically used." When only two of the memory areas are prepared at first, the recording data of a snapshot are stored, so that the moving image data thereafter are successively outputted after the moving image data are taken in toa single memory area. In this case too, it is called "cyclically used."When the moving image recording is completed, the control core circuit 14 judges whether or not the pushing-aside operation of the still image is performed during the recording of the moving image (S18) as shown in FIG. 7; if performed, thedata, for one frame, which are being stored in the memory area for use in pushing aside 7a are transferred to the image data correcting circuit 4 via the data bus 12 and the similar processing to the still image recording is performed (S19).The electronic still camera 1 according to the present embodiment provides the following operation and effects.(1) Since the still image can be extracted as a snapshot during shooting of the moving image, the function as an electronic still camera improves.(2) Since the still image is displayed as a snapshot on the display 9, the user can easily confirm a shooting state of the snapshot and he/she can take another snapshot in no time if he/she doesn't like the snapshot. Thereby, frequency ofmis-shooting snapshots can be reduced. Thus, the value of merchandise as an electronic still camera can be raised.(3) In addition to the above (2), the moving image which is presently being shot is displayed in parallel, so that a shooting state of the moving image can also be confirmed in real time.(4) In addition to above (2) and (3), a shooting state of the snapshot can be easily confirmed by displaying the still image to be recorded as a main picture on the display 9 while the moving image is displayed in a small size.(5) In addition to the above (2), since the still image to be recorded as a snapshot is displayed temporarily on the display 9, the operation necessary for confirming the recording of the moving images on the display 9 will not be interfered forlong period of time.(6) As shown in FIG. 10, the memory area for use in pushing aside 7a will not be provided until a still shooting for a snapshot is instructed and all are utilized as normal memory areas, so that use efficiency of the frame buffer 7 is enhanced.(7) The still image data can be corrected to a further optimal image by using the data correcting circuit 4.(8) Since it is so structured that not only the moving image data but also the still image data passes through the data correcting circuit 4, the still image can also be correction-processed by merely storing coefficients in the ROM 24, thusrealizing low cost and function improvement. Since no correcting circuiting for exclusive use with the still image needs to be provided, the tendency of the apparatus to become large-sized as well as the increase in power consumed can be prevented.(9) The DCT circuit 16, the quantization circuit 17, the Huffman coding circuit 18, the Huffman decoding circuit 19, the inverse quantization circuit 20 and the inverse DCT (IDCT; Inverse DCT) circuit 21 are shared in the JPEG core circuit 5 andthe MPEG core circuit 6, so that the structure of the electronic still camera 1, an arithmetic processing algorithm and so forth can be simplified.(10) Provision of the memory area 7a for use in pushing aside for the snapshot facilitates the sorting and search of the still image and the moving image, and makes possible a faster reproduction.(11) When the snapshot shooting is instructed, image data prior to being inputted to the image data correcting circuit 4 are pushed aside; as a result, filtering processing and zooming processing in the vertical direction will be facilitatedwhen thereafter processing the data at the image data correcting circuit 4, and the moving images can be recorded without being interrupted.The present embodiments include the following modified examples.(i) At S26 in FIG. 8, the still image alone is displayed on the display 9.(ii) At S26 in FIG. 8, the size of the still image and that of the moving image displayed on the display 9 in parallel are reversed, so that the moving image becomes the main picture. Moreover, a structure is provided such that permission anddenial of the display of the still image can be instructed by the user using a button or the like.(iii) At S29 in FIG. 8, image data for a newly taken snapshot is stored in parallel with old data which is not replaced thereby. Namely, as shown in FIG. 11, in the normal moving image processing the memory areas A-D of the frame buffer 7 areused cyclically (FIG. 11(a)). Next, when data taken in at a timing the first snapshot is recorded is stored in the third memory area C, the memory area C is used as the memory area for use in pushing aside 7a (FIG. 11(b)), and in the moving imageprocessing thereafter, the remaining three memory areas A, B and D are used cyclically. When data taken in at a timing the second snapshot is recorded is stored in the second memory area B, the second and third memory areas B and C are used as thememory area for use with pushing aside 7a (FIG. 11(c)), and in the moving image processing thereafter, two memory areas A and D are used cyclically, that is, alternately. In this manner, a plurality of snapshots can be recorded. Increasing the numberof snapshots, which can be taken, will reduce the area in which the frame buffer 7 can be used in the moving image processing. Thus, the number of snapshots which can be taken needs to be set to the degree that overflow of the frame buffer 7 does notoccur at the time of processing the moving images.(iv) A magneto-optical disk, optical disk, magnetic disk or the like is used in place of the memory card 10.(v) When the shooting for taking a snapshot is instructed, the image data in which a processing has been completed at the image data correcting circuit 4 are temporarily pushed aside to the memory area for use in pushing aside 7a. By so doing,the data can be easily taken out when a predetermined compression processing is performed in the JPEG core circuit 5 thereafter.(vi) The still image data do not go through the image data correcting circuit 4.(vii) The M-JPEG techniques are used in compression and expansion of the moving image data.(viii) In addition to JPEG used for the compression and expansion of the still image data, compression technology using the difference-processing-based difference YUV, the block-based Hadamard transform, the Slant transform or Haar transformmethod is used for the compression of the still image data.(ix) When the filtering processing is performed on the still image data, a low-pass filter, a band-pass filter or the like may be formed by setting each coefficient value so that a high frequency range is not emphasized. Thereby, the aliasingor jaggy may be suppressed.(x) When the filtering processing is performed on the still image data, a dynamic range of a color signal is extended and each coefficient value is set so as to obtain a vivid image. Besides, arbitrary linear or nonlinear filter can be used inaccordance with use or user's taste.(xi) As shown in FIG. 1, the selection button 15c is provided which selects the correcting functions of the above embodiments and the above (ix) and (x). Thereby, the still image in accordance with the user's taste can be formed, and thefunction as the electronic still camera 1 is further enhanced. The selection button 15c is an example of a "selector" in the present invention.(xii) The filtering processing in the image data correcting circuit 4 may be such that the filtering processing can be set to the identity transform processing. In that case, the still image data inputted are outputted as kept intact. In thisstructure, the filter function can be easily put to effective use when necessary. In order to realize the identity transform, for example, in FIG. 4, coefficient .alpha..sub.1 only is set to 1 and the remaining coefficients .alpha..sub.n-1 . . ..alpha..sub.2, .alpha..sub.1 are all set to 0. The present invention is characterized in the feature that the still image data and the moving image data are made to pass through the image data correcting circuit 4, and the identity transform processing,of course, belongs to the concept of the filtering processing.(xiii) Though described is that either the snapshot or the moving image is displayed in the main picture, which one is to be set to the main picture may be user-selectable. The control core circuit 14 may switch which one is set to the mainpicture, by the operation of the selection button 15c or the like by the user. Moreover, the control core circuit 14 may include a mode by which the display of the snapshot is prohibited according to the user's instruction, or the snapshot may bedisplayed for the time duration specified by the user.INDUSTRIAL USABILITYAs have been described, the present invention can be used for the digital camera or the image processing method, image processing apparatus and the memory control circuit which can be used therefor.* * * * *
Email certificatesTelephone line seizure moduleDevice and method to automatically configure port forwardingBus controller for handling split transactionsAntennas and their coupling characteristics for wireless power transfer via magnetic couplingThree-dimensional holographic display using active shutterShoe
Randomly Featured Patents Recoil shock absorberTraction motor control systemEXAFS spectrometerInfrared sensor, electronic device, and manufacturing method of infrared sensorNon-aqueous electrolyte secondary cell with a spirally wound electrode unitMethod and apparatus for performing routing operations in a communications networkVariable valve lift system for an internal combustion engineTransport apparatus for large network telecommunication equipmentMethod and system for creating an image of a radiation sourceSynthetic sports surface © 2006-2011. PatentGenius.com All Rights Reserved.