Method and Apparatus for forming an abstract image

Abstract: Abstractions of digital images are created and displayed by generating, in accordance with an undersampling routine, pixel identifiers which identify pixels for extraction from the digital image, extracting pixels from the digital image in accordance with the pixel identifiers, and displaying the extracted pixels against a predetermined background, the extracted pixels being displayed in substantially the same relative position as in the digital image. The predetermined background is selected so as to enhance viewability of the abstract image, or the predetermined background may be previous displays of image extractions so as to allow a fill-in effect for single digital images or an abstract motion video effect for digital images that comprise frames in a digital motion video sequence. Since only abstractions are retrieved and displayed, overall time for retrieval, transmission and display of the images is significantly shortened.

Description: The present invention pertains to an apparatus and a method for forming an abstract image such that less than all of the pixels in the image are displayed. More particularly, the invention concerns an apparatus which undersamples the pixels in an image and displays those pixels against a predetermined background, thereby providing a computer operator with a quick abstract view of the image rather than the full image. With recent advances in computer storage media, it has become more common place to store images digitally rather than only in analog form. Thus, for example, optical disk technology such as CD-ROMs has made it possible to store full images digitally so that those images may be retrieved, processed and displayed in a digital computer. Despite advances in storage media technology, it is still difficult to retrieve and display digital images quickly. For example, 307,200 8-bit bytes are required to store a 640 x 480 pixel gray scale or color image if 256 gray levels (or 256 colors, both corresponding to an eight-bit byte) are stored for each pixel. To transmit those 307,200 bytes over an ordinary voice telephone line, such as by a 9600 baud modem, more than four minutes of transmission time is needed. Clearly, such a delay is unacceptable, especially in a situation where a computer operator is browsing through a number of images so as to locate a particular one. Even in situations where it is possible to access, transmit and display images more quickly, the delays caused by those processes can still cause difficulties. Consider, for example, a situation in which images are retrieved locally for local display, such as in a stand-alone computer or in a local area network of computers. In such a system, it is possible to access and display a single image with acceptably short delays. Without specialized hardware, however, it is not possible to access and to display full motion video images. More particularly, accessing and displaying 24-bit color images at 30 frames per second, with each frame containing 640 x 480 pixels, requires 221,000,000 bit operations per second. This exceeds the capability of existing personal computing equipment. In order to access and display digital images without introducing unacceptable delays, conventional systems have employed compression routines such as JPEG for still images and MPEG for motion images. Use of such compression routines however, ordinarily entails a special hardware component for compression and for decompression, and undesirably complicates the system. JP-A-4103257 discloses an image communication system in accordance with the preamble of the claim which continues to sample pixels from an image and displays them in the same relative positions against background pixels whose values are derived by interpolation. The present invention provides an apparatus for forming an abstract image of a digital image comprising pixel data for each of a plurality of pixels, the abstract image and the digital image having substantially the same size and orientation, said apparatus comprising: extracting means for selectively extracting less than all pixels from the digital image; and forming means for forming, for display, the abstract image from the pixel data for the extracted pixels by positioning the extracted pixels in substantially the same positions as in the digital image; characterised in that said forming means is arranged to form said abstract image also from predetermined background pixels having the same pixel data value, by positioning the predetermined background pixels in the same position in the abstract image as unextracted pixels in the digital image. Alternatively the present invention provides an apparatus as claimed in claim 28. By displaying an abstract image of the digital image, the delays normally associated when full images are accessed and displayed are avoided. The abstract image is obtained by undersampling the pixels in the image, such as by selecting only every ninth pixel in each 3x3 cluster of pixels in the image. The undersampled pixels can be displayed against a predetermined background such as a full white or a full black background, and the undersampled pixels are displayed in a proper positional relation with respect to each other so that the abstract image does not enlarge or reduce the original image. In the case of still images or individual frames of motion video, the abstract image may be supplemented by subsequently accessing and displaying as-yet-unsampled pixels to fill in the predetermined background, thereby creating a "sparkle" effect. The fill-in process may be performed automatically, for example when an operator dwells for more than a predetermined length of time on a particular image, or it may be performed in response to operator demand. In the case of motion video, the specific pixels that are undersampled may differ from frame to frame so as to blend pixels from the different frames and to achieve an abstract motion video. A background generator may be provided so as to generate a background that enhances the selected pixels such as a contrasting background or in the case of displaying frames of a digital motion video sequence, the background may comprise pixels from previous frames in the sequence. If desired, further pixels may be selectively extracted from the image and those further pixels displayed so as to fill in the background. The pixels are selected for extraction by omitting rows or columns from the image, or by omitting all but one pixel in clusters of pixels, such as clusters of nxm pixels. Because pixels are simply undersampled and the selected pixels can be displayed in their proper relative position against a predetermined background, the abstract image can be accessed and displayed with acceptable delays. For example, by undersampling one pixel in a 4x4 cluster of 16 pixels (16:1 undersampling), the aforementioned 640x480 pixel grey scale image can be transmitted over a standard 9600 baud modem in about 15 seconds; and the aforementioned four colour motion video can be accessed and displayed with only about 13,000,000 bit operations per second, which is well within the capabilities of today's personal computing equipment. The present invention also provides a method of forming an abstract image of a digital image comprising pixel data for each of a plurality of pixels, the abstract image and the digital image having substantially the same size and orientation, the method comprising the steps of: selectively extracting less than all pixels from the digital image; and forming, for display, the abstract image from the pixel data for the extracted pixels by positioning the extracted pixels in substantially the same positions as in the digital image; characterised in that said forming step forms said abstract image also from predetermined background pixels having the same pixel data value, by positioning the predetermined background pixels in the same position in the abstract image as unextracted pixels in the digital image. This brief summary has been provided so that the nature of the invention may be understood quickly. A more complete understanding of the invention can be obtained by reference to the following detailed description of the preferred embodiment thereof in connection with the attached drawings. BRIEF DESCRIPTION OF THE DRAWINGS Figure 1 is a perspective view showing the outward appearance of an apparatus according to the invention. Figure 2 is a block diagram of the Figure 1 apparatus. Figure 3 is a functional block diagram of a system for displaying abstracted images of originals by undersampling pixels in the original and displaying the selected pixels. Figure 4 is a flow diagram showing how pixels from an image are undersampled and the selected pixels then displayed. Figure 5 is a view for explaining how background pixels are filled in by subsequent undersamplings of an image. Figure 6 is a flow diagram showing how motion video images are undersampled and the sampled pixels displayed. Figure 7 is a view for explaining how frames in a motion video sequences are undersampled. Figure 8 is a view for explaining various undersampling arrangements. Figures 9 and 10 are views showing a representative original image and an abstraction of that image obtained by undersampling according to the invention. Figure 1 is a view showing the outward appearance of a representative embodiment of the invention. Shown in Figure 1 is computing equipment 10 such as an IBM-PC or PC-compatible computer provided with a display screen 11 such as a color monitor. Computing equipment 10 further includes a mass storage device such as computer disk drive 14 for storing data files, such as black-and-white images, gray scale images, color images, and motion video images; and for storing application programs which contain stored program instruction sequences for execution by the computing equipment, such as application programs to access data on disk drive 14 or on an optical disk or other data storage medium, or other information processing programs by which computing equipment 10 accesses and manipulates data files and presents data in those files to a computer operator via display screen 11. A keyboard 15 is connected to computing equipment 10 to permit input of text data and to permit operator selection and manipulation of data displayed on display screen 11. Likewise, pointing device 16 such as a mouse or the like is provided to permit selection and manipulation of objects on the display screen. Scanner 18 scans documents or other images and provides bitmap images of those documents to computing equipment 10. Those images may be used immediately by computing equipment 10, or computing equipment 10 may store the images in disk drive 14 or on an optical disk such as disk 19 via optical disk drive 20. Image data may then be retrieved from optical disk 19 or computer disk drive 14 for subsequent processing by computing equipment 10. Other means for supplying image data (and other data) may also be provided, such as telephone link 21 via an unshown modem, or a network link 22. Likewise, a removable floppy disk drive may be provided, or digital or analog video information may be input via an unshown video interface. Printer 24 is provided for outputting information processed by computing equipment 10. In accordance with computer operator instructions, stored application programs are selectively activated to process and manipulate data. For example, and as described in more detail below, an optical disk access program may be activated to permit an operator to scan in document images on scanner 18 and store them to optical disk 19, and to retrieve scanned-in document images from optical disk 19 in accordance with retrieval parameters. Other application programs such as image editing programs, word processing programs, spreadsheet programs, multimedia message management programs, and similar information processing programs may also be provided for operator selection and use. Figure 2 is a detailed block diagram showing internal construction of computing equipment 10. As shown in Figure 2, computing equipment 10 includes a central processing unit (CPU) 30 such as an 80386 or a reduced instruction set computer (RISC) interfaced to computer bus 31. Also interfaced to computer bus 31 is scanner interface 32 for interfacing to scanner 18, display interface 34 for interfacing to display 11, network interface 35 for interfacing to network line 22, modem and telephone interface 36 for interfacing to telephone line 21, printer interface 37 for interfacing to printer 34, keyboard interface 39 for interfacing to keyboard 15, and pointing interface 40 for interfacing with pointing device 16. Read only memory (ROM) 41 interfaces to computer bus 31 so as to provide CPU 30 with specialized and invariant functions such as start up programs or BIOS programs. Main memory 42 provides CPU 30 with random access memory storage both for data and application programs, as required. In particular, when executing stored program instruction sequences, CPU 30 loads those instruction sequences from disk 14 (or other memory storage medium) into main memory 42 and executes those stored program instruction sequences out of the main memory. As shown in Figure 2, disk drive 14 includes stored program instruction sequences for accessing and displaying pixels from digital images. The digital images accessed and displayed in accordance with those instruction sequences are not necessarily stored on disk drive 14. Rather, as described above, digital images may be obtained from optical disk 19, or they may be transmitted to computing equipment 10 via network interface 22 or telephone interface 21. In situations where digital images are transmitted via telephone interface 21, then the access programs stored locally on disk drive 14 are not normally utilized to access those images. Rather, counterpart computing equipment is provided at a remote location, and that counterpart equipment accesses digital images in accordance with undersampling as described below. Thus, although the present embodiment describes local access and undersampling of digital images and subsequent local display, it is to be understood that access and undersampling may occur remotely from computing equipment 10 and the undersampled pixels transmitted to computing equipment 10 for local display. Figure 3 is a functional representation of stored program instruction sequences which provide the desired access, undersampling and display functions. As shown in Figure 3, designator 50 is provided to allow a computer operator to designate the type of undersampling desired. Designation may be made by way of a computerized menu of undersampling choices from which a computer operator may select the desired type of undersampling. Or, undersampling designation may be made by way of a default type of undersampling with provisions for overriding the default by the operator. As described hereinbelow, designation of undersampling includes designation of undersampling ratio (e.g., 4-to-1 or 9-to-1) as well as designation of undersampling sequence (e.g., row extraction, column extraction, cluster extraction, or the like). Based on the type of undersampling designated by designator 50, generator 51 generates pixel identifiers for undersampling. Thus, in accordance with the type of undersampling designated by designator 50, generator 51 generates the identities of the pixels which are to be selectively extracted from the image. Pixel identities are generated by generator 51 such that pixels are selectively extracted at regular intervals over substantially the entire digital image, in accordance with the designated undersampling ratio and undersampling sequence. Generator 51 provides the pixel identities to storage access means 52. In accordance with the identities generated by generator 51, storage access means 52 accesses the digital image stored on storage medium 54. The pixel value, together with the pixel identity or other identification of the undersampling routine generated by generator 51, are then provided to transmission medium 55 for transmission to display. In the system shown in Figure 3, transmission medium can be any suitable medium, for example, modem or network transmission medium, or in the case of a stand-alone machine, the local computer bus. Likewise, the storage access means 52 and storage medium 54 are any of the above-described interfaces and corresponding storage devices. The pixel values are received by image reconstruction device 56 which positions the pixels for display against a predetermined background. Image reconstructor 56 positions the extracted pixels against the background such that the position of one pixel relative to other pixels is preserved thereby preserving the original size and shape of the image. The background is provided by background determination circuit 57 which provides a suitable background against which the extracted pixels are displayed. Background determination circuit 57 preferably provides a background that enhances the appearance of the extracted pixels. Thus, for example, an all white or all black background, depending on pixel content, may be selected for a gray scale image. Likewise, for a color image, a suitable color may be generated by circuit 57 to enhance the appearance of the selected color pixels. In the case of motion video sequences, where the image accessed from storage medium 54 is one frame of a sequence of digital motion video frames, then image reconstruction device 56 displays the extracted pixels not against a static background determined by background determination circuit 57 but rather displays them against previous displays of the video sequence. More particularly, as described hereinbelow, for motion video sequences and for other sequences of related images, generator 51 generates a sequence of pixel identifiers that differ from one frame to the next frame, in accordance with the designated undersampling sequence, so that over a sequence of N frames the entire pixel field is sampled, although, of course, any one frame will still be undersampled. Thus, for motion video sequences, displaying abstractions built by undersampling each frame will preserve the apparent motion in the sequence, although moving objects will be somewhat blurred because of the abstraction process. Image reconstruction device 56 then provides the reconstructed and abstracted image to output means 58. Figure 4 shows a flow diagram illustrating operation of the Figure 3 embodiment. The process steps shown in Figure 4 are executed by CPU 30 in accordance with stored program instruction sequences, as described above. Steps S401 through S405 are process steps by which an image stored on storage medium 54 is accessed by undersampling the pixels in the image. Thus, in step S401, the type of undersampling desired is selected. As described above, selecting the type of undersampling includes selecting the undersampling ratio as well as the undersampling sequence. Selection may be made by way of a menu generated by CPU 30 and displayed on display 11, or selection may be made in accordance with a default type of undersampling which may be overridden by operator commands. In step S402, the image that is to be abstracted is selected, whereupon flow advances to step S403 where generator 51 identifies pixels to be extracted from the image. Generator 51 identifies the pixels in accordance with the type of undersampling selected in step S401. In step S404, access means 52 extracts pixels identified in step S403 from the image selected in step S402. Preferably, the pixel values are extracted without any additional processing; that is, the pixels are simply extracted from the image without averaging, weighting, cross-correlation or other smoothing techniques. In step S405, the extracted pixels are transmitted to image reconstruction device 56 via transmission medium 55. Also transmitted to image reconstruction device 56 is an identification of the pixels that have been extracted, or an identification of the undersampling technique. Steps S406 through S408 are process steps by which the undersampled image is displayed. Thus, in steps S406 and S407, image reconstruction device 56 displays extracted pixels received from the transmission medium against a predetermined background and in their proper relative position with respect to other pixels. Then, in step S408, CPU 30 determines whether a new image is to be selected for abstraction. If a new image has been selected for abstraction, then flow returns to step S402 so as to select the new image and repeat the abstraction process with the newly-selected image. On the other hand, if a new image has not been selected for abstraction, then flow may, if desired, return to step S403 in which the currently-displayed image is re-abstracted, but with different pixels selected for abstraction. Re-abstraction can occur automatically, such as after an image has been displayed for a predetermined period of time, or manually based on operator interaction. Re-abstraction replaces background pixels with pixels of the image thereby creating a "sparkle" effect. Figure 5 illustrates re-abstraction in a situation where a 4:1 undersampling ratio has been selected. As shown in Figure 5(a), in pass number 1, the pixels 60 from the original image are undersampled, and the extracted pixels 61 are displayed against a predetermined background 62. In pass number 2, as shown in Figure 5(b), the process is repeated, but different pixels 63 are extracted. The process is repeated in passes 3 and 4 as shown in Figures 5(c) and 5(d), respectively, and each time different pixels 64 and 65, respectively are extracted. Thus, after N passes through an N:1 undersampling ratio, the entire original image has been filled in by successive image abstractions. Figure 6 is a flow diagram illustrating operation of the Figure 3 apparatus for displaying abstractions of frames from a motion video sequence. In step S601, the type of undersampling is selected. As described above, the type of undersampling includes undersampling ratio and undersampling sequence. In step S602, the motion video frame sequence is selected, and in step S603, pixels are extracted from the first frame of the motion video sequence using a first undersampling sequence. Each successive frame from the video sequence will be sampled by an undersampling sequence that differs from a previous undersampling sequence until N frames in an N:1 undersampling ratio have been processed. After N frames in an N:1 undersampling sequence have been processed, the undersampling sequence repeats. In step S604, the extracted pixels are transmitted, and in step S605, the extracted pixels are displayed against a background of already-displayed frames of the video sequence. If in step S606, processing of the video sequence has finished, then flow terminates. On the other hand, if processing of the video sequence has not yet finished, then flow returns to step S607 in which pixels from the next frame in the video sequence are extracted using the next undersampling sequence. As mentioned above, the next undersampling sequence differs from previous undersampling sequences so that different pixels are extracted. The undersampling sequence repeats after N frames have been processed in an N:1 undersampling ratio. Figure 7 is a representative diagram showing undersampling of frames of a motion video sequence using a 4:1 undersampling ratio. As shown in Figure 7(a), pixels 70 from the first frame of the video sequence are undersampled yielding extracted pixels 71 which are displayed in proper pixel-to-pixel positional relationship against a background of already-displayed pixels from the motion video sequence. In Figure 7(b), pixels 72 from the second frame of the motion video sequence are undersampled yielding extracted pixels 73 which are displayed against a background of already-displayed abstractions of prior frames. Likewise, in Figures 7(c) and 7(d), original pixels 74 and 75 from third and fourth frames, respectively, are undersampled to yield extracted pixels 76 and 77, respectively, which are displayed against a background of already-displayed frames from the video sequence. In Figure 7(e), the undersampling sequence repeats itself so that extracted pixels 78 from the fifth frame of the motion video sequence replace extracted pixels 71 from the first frame, as shown. Figure 8 shows representative undersampling sequences for various undersampling ratios. As shown in Figure 8, undersampling may be performed by row extraction in which only every Nth row (for an N:1 undersampling ratio) is sampled and other rows are omitted. Likewise, undersampling may be performed by column extraction in which every Nth column (for an N:1 undersampling ratio) is sampled and other columns are omitted. In addition, undersampling may be performed by pixel cluster extraction in which only one pixel in a cluster of N pixels (for an N:1 undersampling ratio) is sampled and other pixels in the cluster are omitted. Preferably, the pixel clusters are staggered so that they overlap with each other either horizontally or vertically so as to reduce the prominence of continuous background areas in abstractions. On the other hand, it is often simpler to implement non-staggered and non-overlapped pixel clusters as shown at 82. In addition, while undersampling has been described above with respect to bit-wise undersampling, it is to be understood that byte-wise undersampling is also contemplated. Figures 9 and 10 show representative gray scale images abstracted and displayed in accordance with the present invention. As shown in Figure 9, a gray scale image represented by 16 different gray levels is accessed using a 4:1 undersampling ratio as shown at 82 in Figure 8. The extracted pixels are displayed against a solid black background yielding the abstracted image shown in Figure 10. As seen in Figure 10, although finer details are lost by the process, the image is clearly recognizable and is well-suited for situations in which many such images must be browsed through at rapid speed.

Claims: An apparatus for forming an abstract image of a digital image comprising pixel data for each of a plurality of pixels, the abstract image and the digital image having substantially the same size and orientation, said apparatus comprising: extracting means (51,52) for selectively extracting less than all pixels from the digital image; and forming means (56,57) for forming, for display, the abstract image from the pixel data for the extracted pixels by positioning the extracted pixels in substantially the same positions as in the digital image; characterised in that said forming means (56,57) is arranged to form said abstract image also from predetermined background pixels having the same pixel data value, by positioning the predetermined background pixels in the same position in the abstract image as unextracted pixels in the digital image. An apparatus according to claim 1, wherein said forming means includes a background generator (57) for generating the predetermined background pixels. An apparatus according to claim 2, wherein said background generator (57) is operable to determine the pixel data value for said predetermined background pixels, so that they have an appearance which contrasts with the appearance of the extracted pixels. An apparatus according to claim 2, wherein said digital image is the first frame of a digital motion video sequence, wherein said forming means is operable to generate abstract images for subsequent frames of the digital motion video sequence and wherein said background generator (57) is operable to generate, for a current abstract image, predetermined background pixels which comprise previously formed abstract images of the digital motion video sequence. An apparatus according to any preceding claim, wherein said extracting means (51,52) is operable to extract other pixels from the digital image for locating in said abstract image. An apparatus according to claim 5, wherein said forming means is arranged to update said abstract image using said other extracted pixels. An apparatus according to any preceding claim, wherein said extracting means (51,52) is operable to selectively extract pixels from clusters of pixels in the digital image. An apparatus according to claim 7, wherein said extracting means (51,52) is operable to selectively extract pixels from clusters of pixels which are staggered so as to overlap. An apparatus according to any of claims 1 to 6, wherein said extracting means (51,52) is operable to selectively extract pixels in rows. An apparatus according to any of claims 1 to 6, wherein said extracting means (51,52) is operable to selectively extract pixels in columns. An apparatus according to any of claims 1 to 6, wherein said extracting means (51,52) is operable to selectively extract pixels using byte-wise extraction. An apparatus according to claim 1, wherein said extracting means (51,52) comprises: an undersampling generator (51) for generating identifiers for pixels to be extracted from the digital image in accordance with a type of undersampling designated by a designating means (50); and access means (52) for extracting pixels from the digital image based on the pixel identifiers generated by said undersampling generator (51). An apparatus according to claim 12, wherein the digital image is the first frame of a digital motion video sequence, and wherein said undersampling generator (51) is operable to generate pixel identifiers for subsequent digital images in accordance with an undersampling sequence of a designated type of undersampling. An apparatus according to claim 13, wherein said forming means is operable to form abstract images for subsequent frames of the digital motion video sequence and wherein said forming means is arranged to form a current abstract image using predetermined background pixels which comprise a previously formed abstract image, formed in accordance with previous undersampling sequences. An apparatus according to claim 14, wherein said access means (52) is operable to extract further pixels from the digital image in accordance with the undersampling sequence of the designated type of undersampling. An apparatus according to any of claims 11 to 15, wherein said undersampling generator (51) is operable to generate pixel identifiers such that one pixel in clusters of pixels is identified and the other pixels in the clusters of pixels are omitted. An apparatus according to claim 16, wherein said undersampling generator (51) is operable to generate pixel identifiers such that one pixel in clusters of pixels which are staggered so as to overlap is identified. An apparatus according to any of claims 11 to 15, wherein said undersampling generator (51) is operable to generate pixel identifiers such that pixels in rows are selected and pixels in other rows are omitted. An apparatus according to any claims 11 to 15, wherein said undersampling generator (51) is operable to generate pixel identifiers such that pixels in columns are selected and pixels in other columns are omitted. An apparatus according to any of claims 11 to 15, wherein said undersampling generator (51) is operable to generate pixel identifiers in bytes using byte-wise identification. An apparatus according to any preceding claim, further comprising designating means (50) for designating one of a plurality of types of undersampling for the abstract image. An apparatus according to claim 21, wherein said designating means is operable to designate the undersampling ratio and undersampling sequence. An apparatus according to any preceding claim, wherein said extracting means (51,52) is located remotely from said forming means (56) and further comprising a transmission medium (55) for transmitting the pixels extracted by said extracting means (51,52) to said forming means (56). An apparatus according to any preceding claim, further comprising display means (11) for displaying the formed abstract image. An apparatus according to any preceding claim, further comprising an image memory (54) for storing the digital image. An apparatus according to claim 1, arranged so that the extracted pixel data for the abstract image have substantially the same values as the corresponding pixel data for the digital image. An apparatus according to claim 26, wherein said extracting means is arranged to extract pixels from the digital image without performing any additional processing on the pixels being extracted. An apparatus for forming an abstract image from pixels selectively extracted from a digital image, less than all pixels from the digital image being extracted, the abstract image and the digital image having substantially the same size and orientation, the apparatus comprising: means for receiving pixel data for the extracted pixels; and forming means (56,57) for forming, for display, the abstract image from the pixel data for the extracted pixels by positioning the extracted pixels in substantially the same positions as in the digital image; characterised in that said forming means (56,57) is arranged to form said abstract image also from predetermined background pixels having the same pixel data value, by positioning the predetermined background pixels in the same position in the abstract image as unextracted pixels in the digital image. A method of forming an abstract image of a digital image comprising pixel data for each of a plurality of pixels, the abstract image and the digital image having substantially the same size and orientation, the method comprising the steps of: selectively extracting less than all pixels from the digital image; and forming, for display, the abstract image from the pixel data for the extracted pixels by positioning the extracted pixels in substantially the same positions as in the digital image; characterised in that said forming step forms said abstract image also from predetermined background pixels having the same pixel data value, by positioning the predetermined background pixels in the same position in the abstract image as unextracted pixels in the digital image. A method according to claim 29, further comprising the step of generating the predetermined background pixels. A method according to claim 30, wherein the generating step generates predetermined background pixels that have an appearance that contrasts with the appearance of the extracted pixels. A method according to claim 30, wherein said digital image is the first frame of a digital motion video sequence, wherein said forming step generates abstract images for subsequent frames of the digital motion video sequence and wherein said background pixel generating step generates, for a current abstract image, predetermined background pixels which comprise previously formed abstract images of the digital motion video sequence. A method according to any of claims 29 to 32, further comprising the step of extracting further pixels from the digital image for forming said abstract image in said forming step. A method according to claim 33, wherein said forming step updates said abstract image using said other extracted pixels. A method according to any of claims 29 to 34, wherein said extracting step selectively extracts pixels from clusters of pixels in the digital image. A method according to claim 35, wherein the clusters of pixels are staggered so as to overlap. A method according to any of claims 29 to 34, wherein said extracting step selectively extracts pixels in rows. A method according to any of claims 29 to 34, wherein said extracting step selectively extracts pixels in columns. A method according to any of claims 29 to 34, wherein said extracting step selectively extracts pixels using byte-wise extraction. A method according to any of claims 29 to 35, wherein said extracting step comprises the steps of: generating identifiers for pixels in the digital image that are to be extracted, the pixels identifiers being generated in accordance with the type of undersampling designated in the designating step; and extracting pixels from the digital image in accordance with the pixel identifiers generated in said generating step. A method according to claim 40, wherein the digital image is the first frame of a digital motion video sequence, and wherein said generating step generates pixel identifiers for subsequent digital images in accordance with an undersampling sequence of a designated type of undersampling. A method according to claim 41, wherein said forming step forms abstract images for subsequent frames of the digital motion video sequence and wherein said forming step forms a current abstract image using predetermined background pixels which comprise a previously formed abstract image, formed in accordance with previous undersampling sequences. A method according to claim 42, further comprising a second extracting step for extracting further pixels from the digital image in accordance with the undersampling sequence in the designated type of undersampling. A method according to any of claims 40 to 43, wherein said generating step generates pixel identifiers such that one pixel in clusters of pixels is identified and other pixels in the clusters of pixels are omitted. A method according claim 44, wherein the clusters of pixels are staggered so as to overlap. A method according to any of claims 40 to 43, wherein said generating step generates pixel identifiers such that pixels in rows are selected and pixels in other rows are omitted. A method according to any of claims 40 to 43, wherein said generating step generates pixel identifiers such that pixels in columns are selected and pixels in other columns are omitted. A method according to any of claims 40 to 43, wherein said generating step generates pixel identifiers in bytes using byte-wise identification. A method according to any of claims 29 to 48, further comprising the step of designating one of a plurality of types of undersampling for the abstract image. A method according to claim 49, wherein designation of the type of undersampling includes designation of undersampling ratio and undersampling sequence. A method according to any of claims 29 to 50, wherein said extracting step is executed at a first location and said forming step is executed at a second location remote from said first location, and further comprising the step of transmitting pixels extracted in said extracting step from the first location to the second location. A method according to any of claims 29 to 51, further comprising the step of displaying said formed abstract image. A method according to any of claims 29 to 52, further comprising the step of storing the digital image. A method according to claim 29, wherein the extracted pixel data for the abstract image have substantially the same values as the corresponding pixel data for the digital image. A method according to claim 54, wherein said extracting step extracts pixels from the digital image without performing any additional processing on the pixels being extracted. A method for forming an abstract image from pixels selectively extracted from a digital image, less than all pixels from the digital image being extracted, the abstract image and the digital image having substantially the same size and orientation, the method comprising the steps of: receiving pixel data for the extracted pixels; and forming, for display, the abstract image from the pixel data for the extracted pixels by positioning the extracted pixels in substantially the same positions as in the digital image; characterised in that said forming step forms said abstract image also from predetermined background pixels having the same pixel data value, by positioning the predetermined background pixels in the same position in the abstract image as unextracted pixels in the digital image. A storage medium storing processor implementable instructions for controlling a processor to implement the method of any one of claims 29 to 56. Processor implementable instructions for controlling a processor to implement the method of any one of claims 29 to 56.

Inventors: LUTHER WILLIS J, LUTHER, WILLIS J., LUTHER, WILLIS J., C/O CANON INFORMATION SYS. INC.
Applicants: CANON KK, CANON KABUSHIKI KAISHA
Application year: 1995
Main classification: G06T3
IPC codes: G06T3, H04N1, H04N7, G06T13