A METHOD FOR TRANSMITTING HIGH-DEFINITION TELEVISION OVER LOW-BANDWIDTH CHANNELS

Abstract: The present invention describes processes for encoding an information signal that are useful to reduce the bandwidth of, or improve the perceived quality of, that signal as transmitted and displayed. The techniques utilize time-varying sampling schemes and take into account the characteristics of the human visual system. For each information frame, a subset of all possible data points (3) is selected. A further subset of active data points (5) is selected for which data will actually be sampled. The active points are further divided into points for which a value will be transmitted [x-points] (7) and points which will be sampled but for which no separate value will be transmitted [o-points] (8). A mathematical association between the x-points and o-points is made and new values (10) to be transmitted are calculated for the x-points. The parameters of the selection and association processes are varied in a non-trivial manner and the entire cycle repeated for subsequent data frames. In particular, the techniques may be used to transmit a high-definition television signal over a low-bandwidth channel.

Description: A METHOD FOR TRANSMITTING HIGH-DEFINITION TELEVISION OVER LOW-BANDWIDTH CHANNELS TECHNICAL FIELD The instant invention relates to a class of methods for encoding high-defini ion television signals to enable them to be transmit¬ ted over channels intended for low-defini tion signal s, wi th minimal perceivable artifacts. BACKGROUND ART Commercial black & white and. later, color television has been avai lable since the 1940s. Amer ican and Japanese systerns offer 525 l ine frames. 30 times each second, whi le most European systems offer a higher resolution 625 l ine frame but run at a frame rate of 25 per second. Higher resolution mi l itary and laboratory video systems exist and, recently, a commercial high definition television standard [HDTV] has been developed to improve del ivered image qual ity. In the US, motion picture fi lm is projected at 18 frames per second [FPS1 by showing each of 21 pictures twice. -Recently, a system was developed by Douglas Trumble cal led Showscan. I t provides 50 FPS, with SO pictures each shown only once, to improve visual quality. When color was added to US black & white television, it was decided to adopt a "compatible" system, which enables black & white sets to receive color television signals and display them in black E_. wh.te, whi le color sets display the same signals in color. Simi larly, it has been suggested that the HDTV signal be compatably receivable by standard televisions displaying standard resolution pictures, as well as by HDTV receivers. HDTV provides both more video l ines and more pixels [from Picture ELements: visual data points] per l ine. I t has been suggested that the standard television channels may be used to transmit a "compatible" standard resolution signal whi le a second channel [not receivable by a standard television] be used to transmit the "inbetween" higher resolution information. However, HDTV also displays a wider picture when compared with standard television, inclusion of the extra "side strips" in a compatible broadcast system has been one of the main problems. It is establ ished practice to transmit motion picture film, which has a much higher resolution and a different frame rate, over a broadcast television channel by use of a film chain. Essential ly a motion picture projector coupled to a television camera, the fi lm chain synchronizes the two imaging systems. In newer fi lm chain systems the video camera has been replaced by a digital image sensor and digital frame store. In the US. each video frame consists of two interleaved video fields, resulting in 60 fields per second. US film runs af 24 frames per second. This results in a ratio of 2.5 video fields per film frame. Practical ly, this is achieved by alternating 3 repeated video fields and 2 repeated video fields for alternate film frames. The spatial resolution of the image is reduced by the characteristics of the video camera. It is also establ ished practice to generate synthetic television signals [without a camera] by using electronic devices such as character [text] generators, computer graphic systems and special effects generators. Recent developments in home televisions and VCRs include the introduction of digital technology, such as ful l-frame stores and comb f i I ters. There exist many techniques for bandwidth compression of electronic signals, a number of which have been appl ied to tele¬ vision systems. These are particularly useful for transmitting images from space probes or for satel l ite transmission, where resources are l imited. DESCRIPTION OF INVENTION The instant invention relates to a method of signal encoding that is particularly useful for preparing a high-definition television signal for transmission over a channel intended for lower _ i| _ resolution signals. It can also be used to improve the perceived qual ity of television systems. In brief, the invention comprises a system for selecting a subset of information to be transmitted, from ail the information in a frame, and for varying the parameters of selection from frame to frame. This results in the reduction of transmitted information and improved perception on the part of the viewer, when compared to non-varying selection schemes. In order to understand the invention more fully, it is helpful to examine certain aspects of film and video display systems, their shortcomings, and the functioning of the human visual system. Spa ial /Temporal Characteristics of Film and Video Systems: Film and video display systems each have their own characteris ic "signature" scheme for presenting visual information to the viewer over time and space. Each spat iaI /tempera I signature [STS] is recognizable, even if sub 1 imi na I I y, to the viewer and contributes to the identifiable look and "feel" of each medium. Theatrical fi lm presentations consist of 21 different pictures each second. Each picture is shown twice to increase the "flicker rate" above the threshold of major annoyance. However, when objects move quickly, or contrast greatly, a phenomenon known as strobing happens. The viewer is able to perceive that the motion sequence is actual ly made up of individual pictures and motion appears jerky. T is happens because the STS of cinema cameras and projectors is to capture or display an entire picture in an instant, and to miss al l the information that happens between these instants. In cinematography the proportion of time the shutter is open during each 1 /24th second can be adjusted. Keeping the shutter open for a relatively long time wi l l cause moving objects to blur. In stop motion model photography it is now common practice to leave the shutter open whi le the model is moved for each exposure, rather than to take a series of static images [the technique, first popularized at Industrial Light and Magic, is refered to as "go motion" photography]. In both cases each motion picture frame is taken over a "long" instant, whi le objects move. This does cause motion blurring, but does also lessen the perception of strobing; the "stuttering" nature of the fi lm STS has been lessened by temporal smearing. A phenomenon related to strobing, which also is more not icable for contrasty or fast moving si tuations, is cal l doubl ing. As noted, each motion picture frame is shown twice to increase the f I icker rate. Thus, an object shown at posi tion A in projected frame 1. would again be shown at position A in projected frame 2, and would final ly move to position B in projected frame 3. The human eye/brain sytem [sometimes cal led the Retinex, for RETINal- cerbral compleEX] expects the object to be at an intermediate posi tion, between A and B, for the intermediate frame 2. S ince the object is sti l l at position A at frame 2, it is percei 'ed as a second object or ghost lagging behind the first; hence, doubl ing. Again, this is a consequence of the STS of fi lm projection. The overal l resul t is a perceived j i tteriness and muddiness to motion picture fi lm presentations, even i f each individual picture is crisp and sharp. Video, on the other hand, works quite differently. An electron beam travels across the camera or picture tube, tracing out a raster pattern of l ines, left-to-right, top-to-bottom, 60 times each second. The beam is turned off. or blanked, after each l ine, and after each picture, to al low i t to be reposi tioned wi thout be i ng seen. - 8 - Except far the relatively short blanking intervals, television systems gather and display information continuously, although, at any given time, information is being displayed for only one "point" on the screen. This STS is in marked contrast to that of fi lm. The defects of such a system are that the individual l ines [or even dots] of the raster patern may be seen because there is only a l imited number of individual dots or l ines that can be captured or displayed within the time al lotted to one picture. lπ US commercial television systems, each 1/30 second video frame is broken into two 1 /60 second video fields. Al I the even I ines of a picture are sent in the first field, al l the odd l ines in the second. This is simi lar to showing each fi lm frame twice to avoid fl ickering but here it is used to prevent the perception of each video picture being wiped on from top to bottom. However, since each video field [ in fact each l ine or even each dot] is scanned at a different time, there is no sense of doubl ing. The muddiness or opacity of fi lm presenta ions, when compared to video, is related to the repeated presentat ion αf identical information to the human visual system. This can be demonstrated by watching material transferred from fi lm to video using newer equipment. As explained above, each fi lm frame is repeated far either 3 or 2 video fields during transfer. Newer fi lm chains can pan. pul l or ti lt across the visual field during transfer. In doing so, each video field contains unique information. Even i f the same fi lm frame is scanned, it is scanned, from a different position or orientation. During those brief sequences when a camera move is added by the fi lm chain equipment, - -ere is a perceivable increased clarity to the scene. . In summary, fi lm systems deal wi th information everywhere at once, " but for only smal l sl ices of time. Television systems deal with information [almost] al l the time, but for only smal l sl ices of space. Each STS approach leads to characteristic perceivable anomal ies or artifacts. The instant invention employs an STS scheme which has been developed to reduce both types of perceivable anomalies and which can be used to reduce the bandwidth required to transmit a high- definition television signal. Theory of Operation: The basis of the instant invention is that the human visual system is capable of. and sometimes even works better by, reconstructing information that is presented over time. A simple example of this involves a picket fence, if a viewer looks fixedly through a picket fence, about half the scene wi l l be hidden from view and the pickets wi l l be clearly defined. However, if the viewer shifts the head back and forth, or walks briskly by the fence, the perception wil l be of seeing the entire scene, even though half the scene wi l l be missing at any given instant. The pickets wil l also become less noticable. The human eye/brain system is capable of reconstructing the scene from the 'stream of partial views, and of disregarding the sampl ing scheme imposed by the [relatively moving] pickets. In the parlance of this appl ication, both these cases constitute bandwidth compression [hal f the scene is hidden at al I t imes]; but, the f ixed vie is a static STS, and the moving perspect ive view i s a var iabl e STS. Thus, the eye i s capabl e of reconstructing information presented through a varying sample wi ndow. Other aspects of human vision indicate that varying information is preferable to stat i c i nformat ion. As descr i bed above, repeat ing identical information to the eye, as wi th theatrical - B - motion picture fi lm projection, creates the perception of muddiness or opacity. Certain structures in the retiπex, such as edge detectors and motion detectors, only work in differential mode. That is, they do not work when presented with information that is temporal ly or spatial ly uniform. Another [although, longer term] phenomenon is visual fatigue or after- imaging. The receptor elements in the eye become exhausted by looking at a fixed image. The scene wi l l eventual ly become almost invisible [if the view rema ins constant] and a negative of the scene wi l l be perceived upon finally looking away. The human eye vibrates with a continuous tremor of 30 to BO Hz. during its normal function. The retiπex is able to reconstruct a stable detailed image from this vibrating input. It may, in fact. yield a more detai led image than could be constructed from an absolutely stable eye and may help prevent the perception of the structure of, or defects in. the retinex itself. A similar situation results from the way in which motion picture fi lm is manufactured and used. Fi lm images are made up of a random distribution of photosensiti e particles col lectively cal led "fi lm grain". When blown-up on a large screen the grain structure would be more easi ly seen, however, because the distribution changes from frame to frame the grain structure is generally not perceived. There are two ways that still images are added to motion picture presenta ions. With one technique a still scene is fi lmed on a number of fi lm negat ive.frames. Each has a different grain structure and, thus, when the sequence is projected [or viewed on a video monitor] the film grain structure is not noticed. The other technique cal ls for "step printing" the same fi lm negative on many frames of the print to be projected [or to repeatedly scan the same fi lm frame in a fi lm chain]. In this case the same film negative frame, with the same grain structure, is viewed repeatedly and the grain structure becomes more noticable. The frames of the motion picture print also have grain structure, however, since this structure always changes [unless the projector jams or is stopped] the print fi lm grain structure is not noticed. The tremor function provides variation to the STS of human vision. Thus, the ret iπex may be better suited to deal wi th variable STSs than static. The retinex has the abi l ity to reconstruct a scene from bits and pieces spread over space and time. I t is possible to take advantage of this abi l ity by presenting a succession of moderate bandwidth pictures [subsets of ful l definition images], taken through vary ing sampl e w indows, and to have the ret i nex reconstruct a higher resolution scene. Thus, for some embodiments, the compressed transmi tted data paints wi l l be directly displayed on a monitor of resolution that is comparable to the transmission channel. Reconstruct ion, or col lection, wi l l occur in the retinex. Improved perception wi l l result, when compared with standard transmission over the same channel and display. Thus, the technique may be used to improve perception of material transmi tted for standard systems. I t is only the camera and/or transmission parts of the system that would be replaced; standard reception and display elements would be used in this embodiment. This is in marked contrast to most bandwidth compression techniques, which uti l ize complex coding schemes that requi re complex decoding before display. For example, an image compressed by run-length encoding would appear as gibberish if the data were displayed directly, without proper decoding. Other embodiments wi l l present the results on a higher def inition [compared to the channel ] display. The "holes" between the transmi tted po ints may be smoothed over by i π ter pα I a t i ve techn iques, or intermed i ate data may be [approx imate l y] "reconstructed" by computation. Referring to Figure 25, the top configuration depicts a standard encoding/decoding bandwidth reduction scheme. The bandwidth of the source and display image are equal and higher than the bandwidth of the channel. The bottom configura ion depicts one class of embodiments of the instant invention. The bandwidth of the source image is higher than both the channel and the display which are comparable to each other. Decoding occurs after display, as it is viewed, and it is only in the retinex that the image is reconstructed. The goal of most bandwidth compression schemes is to "squeeze" a given information signal into a smal ler channel. A main goal of the instant invention is to "squeeze" a larger picture into a given channel. Al though this may at first sound as a semantic difference only, there is a significant prε-tical difference. Broadcast television in the US is a "given channel" that is unl ikely to change for the fαrseeable future. Bandw idth compression schemes that would al low the use of a smal ler transmission channel and require complex decoding at destination could not be used wi th the many mi l l ions αf existing home receivers. The bottom configuration shown in Figure 25 requires no decoding equipment prior to display; decoding is accompl ished in the human eye/brain. Therefore, it can be .used with existing distribution and reception/display equipment. I t should also be noted that the "channel" shown in the bottom part of Figure 25, can incorporate a standard encode-t ransm i t- decode system, as shown above. In this way. the varying STS scheme wi l l function as a pre-se I ect i on or thinning function, prior to applying some other compression algorithm, such as run- length encoding, delta encoding, etc. Static Sampling Schemes: The visual artifacts of fi lm and video systerns are perceivable because the STS of each system is constant. Many times each second, images are presented to a viewer. Whi le these image streams approach viewing a real scene, they represent only a small subset of the available information. The way in which the subset αf information is selected remains constant, frame after frame after frame, while the content of each frame is different. In this way the "shape" of the STS is re-enforced by being superimposed over many different images. Perceived visual anαma I ies resu1 . In order to select a subset of a relatively high resolution television signal for transmission over a lower bandwidth channel, two stra ightfoward approaches are depicted in Figures 1 and 2. In both cases the reduction is by a factor of four; by half in both the horrizontal and vertical directions. Two-by-two cells of pixels are labled with subscripts representing the raw and column αf the cel l. Within the cel l individual pixels are labled A, B, C and D. In the first figure, the upper left corner element [A] αf each two-by-twα pixel cel l, is transmitted [*) for every cel l, in every frame of the source image. This pixel value is used to reconstruct the entire destination cel l in the destination image. Picture detai ls that fal l in pixels labled B, C or D do not get transmitted or displayed at al l. As a smal l visual detail moves across the screen it would pop on (as is passes A*] and off [as it passes B. C or Dl. In Figure 2, all four picture elements from each two-by-twα cell in the source image are averaged, as by a low-pass digital filter, to derive the pixels of the destination display cell. The average αf A, B. C £_• D is denoted by X. Here individual smal l details are lost as they are averaged with the neighboring three pixeI s . Both approaches exhibit defects. In the first, small details pop on and off. in the second, small detail is lost in the blur. This is because the method of selecting the subset of information - the STS - is constant from frame to frame. The "shape" αf the static STS is re-enforced by viewing changing content upon which the same STS is repeatedly imposed. Varying the STS: Although each is unique, the successive frames of a standard film or video presentation each have much redundant information in common with their neighbors. The STS of the present invention varies from frame to frame. By this scheme, the differences in the STS that is applied to successive frames is comparable to, or wi l l even exceed, the differences in the content of successive frames. Therefore, the shape of the STS wi I I not be re-enforced from frame to frame. Thus, sampl ing artifacts wil l be masked as they change from frame to frame and the perception of visual anomalies, resulting from the overal l vary ing_ samp I i πg scheme, wil l be miπimized. Bi-Linear Interpolation: Before describing a simple implementation of the time varying STS scheme, a technique cal led bi- l inear interpolation wi l l be described. In the two techniques described in Figures 1 and 2, the destination cel ls of two-by-twσ pixels contain identical informa ion in each pixel. This is equivalent to having larger pixels and would resul t in a more "blocky" looking picture. In order to obscure the edges of the large two-by-two pixel cel ls, certain of the individual pixels can be displayed as averages αf the neighboring pixels. For twα-by-two pixel cel ls the scheme is shown in Figure 3. The pixels of a subject cel l are labled W: the cel l to its right, X: the cel l below, Z: the cel l diagonal ly down and right, Y. I t is assumed that the image has been derived by sampl ing as depicted in Figure 1, where the upper left pixel in each cel l is transmi tted. Since that pixel is displayed exactly as i t is in the source image, it wi ' l be unchanged. The pixel to its right and the pixel below it are each intermediate between two sampled [upper left corner of cel l ] pixels and are displayed as the average αf those two pixels; [W+X]/2 and [W+Zl/2 respectively. This process is cal led l inear interpola ion and would be adjusted i f the subject intermediate pixel were not exactly hal f-way between the two sampled pixels. For example, if it were one third of the way toward X from W it could be displayed as [2W+XJ/3. The fourth pixel of each cei l [the one diagonal ly opposi te from the sampled pixel ] is directly between two pairs of l inearly interpolated pixels and. by interpolating between ei ther the horizontal or vertical pair [or taking an average of al l four] would be re-interpolated [ i.e. bi-l inearly interpolated] as CW+X+Y+Z]/1. The principles i l lustrated above can also be appl ied to non- recti l inear situations or si tuat ions where the distribut ion of sampled points is non-uni form over the image. However, the implementation may be more complex than i l lustrated. - 11 - In the instant invention, these mathematical principles wi l l be appl ied both to constructing intermediate display pixels between transmi tted data paints and to apportioning sample values that fal l in between transmitted or displayable points. The appl ication of bi l inear interpolation to the destination display is a past-transmission digital fi l ter that is, in some sense, simi lar to the pre- t ransm i ss i on fi lter described as averaging in Figure 2. Both' pre- and post-transmission fi ltering wil l be described below as components of some embodiments αf the instant invention. Basic principles of digital fi l tering and digital samp l ing are wel l known and, in and αf themse I ves, are not intended as the subject of tre present invention. However, the basic principle of the invention, the time varying STS. may be implemented with one or more of i ts components comprising a known digital samp l ing or fi ltering technique. The examp I es of bi I inear interpolation, averaging or other examp ies of digital fi ltering or sampl ing processes are intended to be i l lustrative and not l imiting in nature. Other digital fi ltering or sampl ing techniques may now. or come to, be in existance. and using the varying STS scheme in conjunction wi th such techniques is intended to be within the scope of the instant invention. However, it should be noted that some of the specifics of the instant invention may fal l under the categories of digital sampl ing or digital fi ltering. The specific schemes and patterns disclosed herein are intended as being within the scope of the present invention. Simple Varying STS Scheme: A simple embodiment of the instant invention, is depicted in Figures 1A through ID. These f igures each depict source and destination images, again organized as cells of two-by-two pixels each. Each of the four represent a point sampl ing scheme, simi lar to Figure 1. But, for each f igure, a di fferent pixel from the two-by-twα cel l is sampled, indicated by a [*]. These four types of sampl ing would be alternated, in a cycle of four, to provide a simple time varying STS. Bi l inear interpolation could be appl ied to the display images. However, the corner pixel that requires no interpolation would be oriented in each αf the four phases to correspond tα the position of the source pixel that is sampled. The scheme i s rather simple and has a short repeat cycle and, thus, is more prone to creating perceivable STS art i facts than other, more complex sampl ing paterns, such as wi l l be described later. However, this simple si tuat ion is a clear i l lustrative example αf the basic principle. Adding Complexity and Variation: The 2x2 cel l of pixels can be general ized to xN. A 1x1 cel l is the degenerate case with no reduction in sampl ing rate from the source image. The 2x2 case has been described above and provides a reduction in bandwidth by a factor of four, and a cycle of four phases. For 3x3, 1x4 and 5x5 cel ls, i f one pixel per cel l is transmitted for each frame, reduction is by a factor of 9, 16 and 25, and repeat cycles are αf 9, 16 & 25 s teps, .respect i ' ve I y. For the general case, an NxN pixel-cel l , i f sampled one pixel per phase, provides a bandwidth reduction factor of N squared and a repeat cycle of N squared steps. The percentage of information sampled for large N CN >* 1] becomes too smal l, and the unsampled "holes" in the images can become apparent. For smal l N, the short repeat cyc l es can cause perce ivable art i facts. Therefore, additional variations wi l l be added tα the STS schemes to improve the perception of "transparency". First, particularly for short repeat cycles, the perception αf a repeat, j iggle or sampl ing rotation may be reduced by repeating the steps of the cycle in random or pseudo-random order. A ps eudα- random [ i.e., determined, but apparently random] sequence of numbers can be easi ly generated, by a computer algori thm, from a smal l amount of "seed" information. The sequence can be easi ly re-generated at the destination by transmitting just the seed [rather than sending the entire sequence], since the algorithm is already known. An algorithm is chosen to generate a sequence that has the statistical ly average properties of "randomness" that are required for the particular appl ication. For example, i f we wished to generate- a pseudo- random sequence for the 2x2 case depicted in Figures 1, it would, in the long run, be required to contain equal numbers of Is, 2s, 3s E> Is, and favor no particular two digit, three digit, or other mul ti le digit sequences. Further, it should not be possible [without knowing the algorithm, or expending an inordinate amount αf computer time to analyze the series and reconstruct the algorithm] to predict the next number in the sequence. Obviously, the 1. 2, 3. 1. 1 , 2, 3. 1, 1 , 2, 3. 1 ' .... sequence, as initial ly described in Figures 1A through ID, does not meet these criteria; it is completely determined and predictable. This could resul t [particularly with such a short repeat cycle] in the perception of an anomal istic visual defect or artifact αf the process. In addition tα randomizing the overal l cycle, the particular phase of the cycle need not be the same for every eel I in the image. For some STS schemes, particularly for large N, there may be more than one sampled pixel per cel l, in some or al l of the cel ls, in some or al l of the frames. The particular variations αf any of these parameters, aver space αr time, may be cycled, determinate or pseudo-random. Additional ly, the cel l shape need not be square, NxN. Pixel-cel ls can be MxN rectangles, or any shape, and need not be continuous. Pixel-cel l size, shape or orientation may be varied, aver an entire frame, or in one area from frame to frame. The concept of distinct multi-pixel cel ls may even be replaced by a random (or pseudo-random) "shotgun" spray of sampled points over the image. A mul t ipl ici ty of "shotgun" or other paterns could be easi ly generated by a [pseudo- ] random number generator algori thm by supplying i t wi th di fferent seed numbers for each frame. This seed number could be transmitted with each frame and the pattern re-generated at the destination, on the fly. Al ternately, to speed operation and reduce the need for calculation power at the destination, data for a mu I i c i I i c i y of different patterns could be pre-ca I cu I ated and stored in same form of memory at the destination display. Simi larly, the coefficients for a bi l inear [or other] interpolation scheme, developed for these more complex sampl ing paterns, could be a I gor i thmi ca I ly generated or, to speed operation at the destination, pre-ca I cu I ated and stored. In this way, a large number of different sampl ing/display schemes could be appl ied to a sequence of frames to generate a complexly varying STS without encountering a short repeat cycle. The added complexity and longer repeat wi l l minimize the possibi l ity that any visual arti fact of the STS wi l l be picked up by the human visual system. I t should be noted that most of the discussion here wi l l concentrate on varying the STS by varying the spatial sampl ing or selection process over uniform time sl ices. This is because both fi lm and video systems currently work wi th only uni form frame rates. However, as variable sampl ing rate [ei ther for enti re frames or for individual pixels] equipment becomes avai lable, it wi l l also be possible and useful to select and sample information with varying time sl ices as wel l as non-unifαrm spatial paterns. - IB - Both the position in time and "thickness" of the sl ices may be varied. Such temporal variations may be implemented for entire frames, individual pixels or multi-pixel cells, or far different image areas [as discussed below in the section "Variable Algorithm Over Image Frame"]. The variations may be implemented based on various criteria including, characteristics of images or image sequences, equipment characteristics, di ferent appl ications or, l imitations on time, processing or bandwidth [again as described below].' Frame Store Techniques: For a single sti l l image, 1:1 bandwidth compression may be achieved by the processes depicted in Figure 1 or in Figure 2 for each transmitted frame. In either case, the same source image wi l l be processed according to the same STS for each frame, resulting in a repeat of an identical destination frame. For the simple case of the instant invention, depicted in Figures 1A through D. 1:1 compression is also achieved but with improved perception on the part of the viewer. Four different destination frames are derived from the same source image, using the varying STS, and presented in sequence. [In any of the above three cases, post-transmission filtering, such as bilinear interpolation, may be used to improve image smoothness]. However, if i t were known that a sti l l -image were tα be transmitted for a number of frame times, the simple varying STS scheme depicted in Figures 1A through ID could be adapted to a variation that will provide further benefits. Assuming that the destination display incorporates some digital frame-store or other memory function, the information from all four frames can be accumulated and used tα completely reconstruct the original high-definition source image. This "accumulation mode" would not provide similar benefits if implemented with either αf the two - 1 0 - static STS schemes depicted in Figures 1 and 2, since the information from successive frames would be identical. With this scheme, once four frames were collected the oldest of the four could be discarded and replaced by the newest as it came in. The same principle could be appl ied to other patterns or distributions of data points and the scheme may be varied [as described below] over the frame or over time. Another technique can be implemented on a relatively high- definition display with a built-in frame store. Normally, a frame store provides data storage for each pixel that can be displayed by the monitor. However, by using the varying STS technique, bandwidth is compressed by transmitting data for only a sub-set of display points. Only some of the memory locations in the frame store would be required to store incoming data for an image frame. [Additional pixels could be used to hold data from previous frames, as in the accumuI at ion mode described above: or, to hold intermediate data points created at the destination display.] By this scheme, the number of pixels [i.e. resolution] in the frame store would not need tα be as high-definition as the display, at any given frame. However, since, over the course αf many frames, data wi l l be sent for al l [or many] of the points that can be displayed on the h i gh- reso I ut i on monitor, data storage points would be required for ai l thase display points. This is because, in standard frame stores, a stored information point can only be displayed at one specific display point. Therefore, the resolution of the frame store would need to be comparable to tha. of the display, to accomαdate the different paints at different positions to be displayed over time. The technique described below wi l l al low a low-resolution frame store to be used with a high-resolution display when implementing a variable STS scheme. The scheme described in Figures 1A through ID wi l l be used as an examp le. Far each 2x2-pixel-cel 1 only one data point is transmitted at each frame and is displayed at the destination position that it occupies in the source image. The other three are derived from repeated data, or intermediate data derived by interpolation or reconstruction. Whi le storage for al l four pixel positions in the display cel l are needed over time, only one of four is needed at each frame. I f the position of the display point associated with the information storage point could be moved, then one storage space per mul ti-pixel cel l would suff i ce. In standard frame store devices, display data is read from digital memory and used to specify the color and/or intensity αf pixels on the screen. The "look" αf the displayed pixel is determined by the data contents of the associated memory location; the position of the displayed pixel is determined by the address of the memory location. In some frame stores several different modes are avai lable that "map" the memory locations to display screen locations in different ways. But for each mode the mapping is constant from frame to frame. A special ized frame store devi ce would fac i l i tate the implementa ion of the varying STS technique. I t is described below. In the special ized frame store the "look" of the pixel is sti l l determined by the contents of the memory location. However, the location αf the displayed pixel on the screen is determined by the address of the memory location plus an offset that can be determined in several ways. One way would be appropriate to the varying STS scheme described in Figures 1A therough ID. In this case the position of the entire raster would be adjusted to coincide with the upper-left pi el of the multi-pixel cel l for Figure 4A. Simi larly, for other frames, shifts would be made to coincide with the upper-right. l ower-r ight and lower- l eft for F igures 4B. 4C and 4D, respect ively. Other patterns may also be used to "wobble" the entire display. These would be synchronized with a corresponding "wobble" in the video camera or transmission system. In another implementation the "wobble" or offset would be appl ied independently to individual pixels, or groups of pixels. Groups of pixels may correspond to smal l geomet ric areas [neighboring pixels or multi-pixel cel ls-, for example]; or a group may consist of a distribution of pixels spread out over a large sect ion of. or an entire, image frame. In this case the complex pattern of offsets for each frame could be pre-determined and synchronized with the camera or image creation system. Alternately, pixel [or pixel group] position offset data could be stored along wi th pixel content data in the frame store. The display location' of a pixel would then be determined by the address of the memory location and an offset that was stored and associated with the individual pixel or pixel group. A specific case for 2x2 multi-pixel cel ls is described next. In standard frame stores pixel content data is stored for each pixel. For example, if eight bi ts each were requi red for Red, Green and Blue display data, each pixel would require 24 bits and the 2x2 cel l would requi re 96 bi ts of data storage' [24 bi ts for each αf four pixels]. In the special ized frame store 24 bi ts would be required for display content data [B each for Red, Green and Blue]. An additional 2 bits would be stored with each 24-bit pixel data. These two bi ts would be used, for example, as fαl lows: EXTRA BIT 1 EXTRA BIT 2 PIXEL DISPLAY LOCATION 0 0 Upper-left pixel of cell. 0 1 Upper-right pixel αf cell. 1 0 Lower-left pixel of cell. 1 1 Lower-right pixel of cell. In this way. for each 2x2-pixel cel l, storage requirements have been reduced from 96 bits to 26 bits. If groups of 2x2 pixel cel ls were to be offset in l ike manner, the 2-bit position specifica ion would only have to be stored once for the entire group. When this type of frame buffer is used with a monitor, the offset may be appl ied to the electron beam deflection mechanism to implement the wobble αf the entire image or individual pixel elements. Beam de-focussing may also be appl ied tα cover the "holes" between transmitted pixel data. Another technique may be used to fi l l the holes, or to other benefit. Besides adjusting the position of displayed pixels the size or shepe αf pixels can also be adjusted. Again, these adjustments to the pixels may be designated by pre-determined pattern or from data stored with the pixel content data, and may be appl ied to individual pixels, pixel groups or tα an entire frame uniformly. For example, one part icular- iπformat ion point may be displayed as a single pixel one time, and as a 2x2 square in another frame. Or, one data point may be displayed as a single pixel in one frame, as a two-by-one pixel block in another frame, and as a one-by-two pixel block in sti l l another frame. Alternately, and particularly wi th h i gher- reso I ut i on monitors, intermediate display data would be created to fi l l the "hales" between transmitted pixel data. This may be done using a digital [or analog] filter tα perform simple interpolation or by a more complex reconstruction algor i thm. The creation of the intermediate data could be done on the fly, by accessing several data points from the frame store and computing intermediate values. But a low-cost frame store may not provide fast enough data access far complex point-oriented display processing. Therefore, several l ines of frame store data may be transfered to a smal ler amount of very high-speed memory. This high speed memory can also be αf higher resolution [then the rest of the frame store] so as to provide a place to temporari ly store the calculated intermediate display data, until they are displayed. Mut t iple frame stores, of ei ther standard or special ized construction, can be contained in a single display. They can be used to advantage if implementing a complex interpolation or reconstruction algorithm. For example, one frame store can be used to compute the incoming frame while another frame store is being scanned out to display the previous frame. Two frame stores can be alternated in this fashion, or more than two can be instal led in a "pipel ine" al lowing several frame times to be used tα process a frame, once it has been received. Several frame stores can also be used to store several sequential incoming frames. These can then be displayed, in interleaved manner, to implement the accumulation mode, which can be applied to the entire image or in l imited areas. This discussion has made specific reference only to the sampl ing pattern described in Figures 4A through 4D. However, any of the patterns, techniques and variations described elsewhere in this disclosure can be used in conjunction with these frame store techn iques. Multiple Applications and Different Embodiments: Numerous variations on the basic time varying STS principle have been descr ibed above, and wi l l be below, includ ing the "accumulation mode". Different embodiments and variations can be fine tuned for different appl ications or for different image [or image sequence] characteris ics. Depending upon the appl ication, different algorithms and systems wi l l be developed, providing various capabi l ities, including: display on high-definition television; display on low-definition television; compat ibl e di spl ay on bath high- and l ow- definition televisions - exposure onto motion picture fi lm; distribution by closed circuit or cable; distribution by NTSC. PAL or SECAM transmission; distribution by HDTV transmission: distribution by videotape or videodisc; - source derived from motion picture film; source derived from videotape; source derived from video cameras; source derived from synthetic imagery; source derived from text or graphics; - recording on analog medium; recording on digital medium. Al gor i thms w i l l al so be f ine-tuned depending upon the characteristics or features of the imageCs] being encoded, for example: fast moving, slow moving or sti l l imagery; imagery with much smal l detai l, or with large undetai led areas; - text, graphics or pictorai imagery; textures or edges; imagery with horizontal, vertical or diagona l ines, edges or details; imagery of high or low contrast; color or black £> white imagery; pastel or saturated colors. Variable Algorithm Over Image Frame: As described above, the varying STS principle may be implemented in numerous embodiments, which may be fine tuned for images or image sequences with different characteristics. For example, the "accmulat ion mode" described above may improve visual qual ity for image sequences that have little or no movement, for a period, αr far images of text or graphics. It is also possible that certain images or image sequences wil l have different characteristics in different areas and that the shape or position of those areas wi ll change, over time, f-αm frame to frame. Many image analysis techniques now exist and other useful techniques may continue to be developed. Simi larly, techniques and algorithms now exist, and may later be developed, that can be used to encode area shapes, edges or boundaries. These algorithms and techniques can be used to'analyze and specify various areas of different image characteristics. The analyses can be made on a single frame basis, αr by comparing progression αr change aver two or more frames. Once a frame is analyzed and separated into multi le areas of different characteristics, different versions of the encoding technique can be used for those several areas. These variations of the encoding technique .an be designed so that the encoded image can be decoded using a unii --m decoding technique over the who I e image. - 28 - Alternately, a multiplicity αf fine tuned decoding algorithms can be used on different areas of the image. The shapes of the decoding areas need not be identical to the encoding areas. The di fferent decoding areas may be determined by analysis at the destination display or, the decoding areas may be derived from area specification information, to be included with the image data in the transmitted signal or transmitted separately. An image can be displayed with several decoding algorithms, even if it were encoded with a single uniform algorithm. For example, although an image stream were encoded uniformly, the accumulation mode algorithm can be appl ied to l imited areas [with l ittle or no movement, or containing text or graphic information], whi le elsewhere, information is discarded as soon as it has been d i splayed. The method of specifying area shape can be varied depending upon: the encod i ng /decαd i ng algori thm, image characteristics, the characteristics of camera, transmission or display equipment, or. constraints imposed by transmission bandwidth, computing power or time. For example, areas can be l imited to groups of rectangles, triangles, polygons, or other shapes, or may be freely specified on any pixel, αr mul ti-pixel cel l, boundary. Limits can also be placed on the number of distinct areas in an image[s], or on the maximum change of area specification from frame to frame. If the constraints αf image complexity, time or computing power aa not al low for real-time analysis and/or separation of images into areas, analys i s can be done off- l ine for certain appl ications. For example, a relatively long time may be spent on the analysis and encoding αf the frames of a motion picture fi lm, prior to transmission. The encoded resul ts, perhaps with area speci fications, would then be stored on videotape [or other medium] for real-time playback, transmission, and display, at a later time. Alternately, frames can be computed, transmitted and recorded off-l ine, for real-time playback at a later time. Practical Appl ica ions: Digi tal technology has become commonplace in home television equipment as we I I as in broadcast equipment. Digital controls, comb f i lters and even whole-frame digital image stores are now avai lable in home televisions and VCRs. Industrial and broadcast equ ipment i s becoming even more sophi st icated. Certa in embodiments of the instant invention wi l l prove useful on even the simplest of standard television equipment. Other variations wi l l be best implemented using the newer digital ly capable equipment. For example, the "accumulat ion mode" would require some sort of frame store. Since HDTV broadcast systems are not in place, standards have not been f inal ized, and home HDTV receivers are not yet avai lable, it would be possible to include new hardware features [to implement the more complex features of the instant invention) in HDTV equipment wi thout having to worry about i ncompa tab i I i ty wi th existing HDTV systems. Regarding compatabi I i ty between HDTV and standard NTSC broadcast television: some var i at ions αf the present invention wi l l provide direct compa tab i I i ty by displaying the encoded low-bandwidth image directly on a standard television, whi le the ful ly decoded, processed and reconstructed [or "accumulated"] image would be displayed on a high def ini tion moni tor. However, the specif ic high def ini t ion system known as HDTV is wider than standard television by approximately 20% and the incorporation of the "side strips" is a problem not directly addressed above. However, there are port ions αf the te l ev i s ion f rame [tota l ing approximately 10% - 15%] during the blanking intervals αf the signal , unused for picture information. I t is already common practice to store and broadcast digital information in some parts of the blanking intervals. Uti l izing the bandwidth reducing capabi l i t ies αf the instant invent ion or other encoding techniques, the "side strips" could be compressed, and then encoded into the blanking intervals [or the blanking intervals αf a previous frame, to al low more time tα decode and reconstruct a more complex and dense coding scheme] and reconstructed, upon reception, by special HDTV " te I evi s i oπs. The qual ity of the "side strips" may suffer sl ightly when compared to the rest αf the image. However, those areas αf the image are peripheral and therefore somewhat less critical to viewing. For those variations of the invention that are not suitable for "compatible" broadcast television, or for HDTV, there are other useful app I i cat i oπs. For example, special ly encoded "premium" channels could be distributed, by cable or direct satel l ite broadcast, for reception by special home televisions. Simi larly, non-standard "premium" channels could be made avai lable for del ivery of special sports or entertainment events to theaters or arenas. Such premium channels may require special television camera or recording equipment tα produce the required signals or tapes. In particular, however, transferring movies using a special fi lm chain would require only a l imited amount of special production equipment. The popularity of pay movie channels may wel l justify the added production costs and even the cost αf special home receivers. The invention can also be used to reduce the bandwidth required to record television signals or tα increase the amount or qual ity αf information that can be recorded on existing VTR systems. Such systems can be incorporated into VCR [or videodisc] units tα improve their recording and/or playback operation, or to provide extra performance when playing tapes [or videodiscs) that have been special ly pre-recorded. Simi larly, special ly recorded tapes can be used in theaters, wi th special playback and/or display equipment, far high qual ity electronic cinema. In particular, the new digi tal tape recorder [DTR] can be adapted tα making recordings for the instant invention. A version of the invention can al so be used for industrial , commercial , broadcast or scient i fic image recording systems. Lastly, the varying STS scheme can be appl ied for bandwidth compression and/or improved perception when recording audio αr other signals, as wel l as for image information. DETAILED DESCRIPTION OF DRAWINGS What fol lows is a detai led description of drawings that wi l l i l lustrate severa l preferred embod iments of the inst.nt i nvent ion . Figure 5A shows what wi l l be cal led the [4+11:1 — four plus one, to one — pattern. As discussed earl ier, a 2x2-pixel cel l pattern yields a rather simple varying STS scheme; and square image cel ls of larger "N" [with a single pixel sampled] wi l l resul t in a large reduction of bandwidth. The [4+1):1 pattern was developed to provide moderate bandwidth reduction, yet with a complex and subt l e select ion pattern capabl e of be ing impl emented systematical ly, but wi th enough f lexibi l i ty to be adaptable to numerous situations. Figure 5A shows that the entire image plane is ti led by an equal number of single black pixels and whi te 2x2-pixel cel l s; an example of each type is shown in the upper lef t by a smal l reverse colored box. Information samples can be taken from any of the pixels, black or white, but are transmitted only at the black pixels. Thus, a reduction of 5:1 is achieved. It wi l l be the cαnvention, throughout the instant appl ication, to refer tα two types of pixels: [o]-pixels and [x)-pixels. For [α]- type, data may be samp led, but no data wi l l be transmi tted. For [x)-type, data wi l l be transmitted. The [χ]-point data wi l l general ly be computed from a combination of its own data and the data αf associated [α)-pαiπts, although [x]-pαints may also be transmitted alone. Together, the [x)-pixels and [α]-pixels are referred tα as active points. Non-active points are those points on a grid that are used tα space out the active points. They are neither sampled nor transmitted. In figure 5A al l points are active. The white pixels are [o]-type; the lack pixels are [χ]-type. Figure 5B shows a single black [x]-point [1], a white 2x2-pixel cel l Of [o]-points [2], how each single black [x]-point is surrounded by four white 2x2-[o]-p i xe I cel ls [3], and how each white 2x2-[o]-pi xel cel l is surrounded by four single black [x]- po i nts CD. Figures 5C through 5F each show one phase of a four phase sampl ing scheme. Referring to Figure 5C, a single black [x)-pixel is labled X. For each of the four white 2x2-[o]- i xe I cel ls surrounding X, a single pixel has been selected for sampl ing. With respect to pixel X, each αf the other pixels has a center tα center distance of, A - 1, B » the square root- of 2 , C - 2 and D - the square root of 5. Simi lar patterns for the other three phases of the four phase cycle are shown in Figures 50, 5E and 5F, and summarized in Figure 5G. where the superscripts refer to phase numbers. Note that, in Figure 5G: - each 2x2-ptxel cell contains one each of A, B, C E D; each 2x2-pixel cel l contains one each of 1, 2, 3 & 1; there are four each of A, B, C & D; there are four each of 1 , 2, 3 & 4 ; each letter is paired with each number exactly once. It has been noted that each white 2x2-pixel cel l is surrounded by four black single pixels. The STS sampl ing pattern shown in Figures 5D through 5G has been appl ied to four black single pixels (labled W, X. Y & Z) that surround one white 2x2-pixel cel l , and is depicted in Figure 6. Each of the four white pixels contains four, three-character i tems. The first character, an upper-case letter, refers to the position of the white. pixel with respect to the black pixel it is associated wi th, and is ei ther A, B, C or D. The second, a lower-case letter, refers to the single black pixel that the white pixel is associated with, and is either w, x. y or z. The third character is a number referring to the phase of the cycle, and is ei ther 1 , 2, 3 or 4. Note that for each of the four white pixels: one and only one, three character item, each contains an A. B. C & D one and only one, three character item, each contains a w. x. y & z; - al l the i tems for any one pixel contain the same number, ei ther 1 , 2, 3 or 4; and that: - there is one and only one combination of each upper- case letter with each lower-case letter; there is one and only one combination of each upper¬ case letter with each number; there is one and only one combination of each lower¬ case letter with each number. In practice, this results in a situation where one white pixel of the 2x2-p i xe I cel l is associated with al l four single black pixels at the same time. A different white pixel is associated at each phase, with ai l four pixels αf the 2x2-p i xe I cel l having a turn. Other sampl ing patterns may be used. For a given single black pixel, A. B. C E D may be sampled in the reverse order, or other order, αr randomly. And, as will be shown later, the same pattern or phase need not apply tα ai l single black pixels. Intermediate Transmission Scheme: Bi-l inear interpolation was described, above, as a way to create display information for intermediate pixels, between those pixels far which transmission information exists. By a conceptual ly similar technique, source information that exists, between pixels that wi l l be transmitted, can be a portioned and included with those transmitted points. For example, assume three pixels are on a single scan l ine, labled A, B E» C, and that only A and C wi l l be transmitted, in order to reduce the transmission bandwidth. The information from pixel B may be spl it and transmitted with the other two pixels. Thus, one transmitted pixel would contain A+[B/2) and the other C+[B/2], In order to normalize the content of each pixel from 1.5 information points, back to 1 point, they would each be divided by 1.5. yielding [2A+B]/3 and C2C+B1/3. The above assumes that point B is exactly half way between A and C and that its entire content is equal ly apportioned to the two transmission points. I f B were only 1/4 of the way from A tα C a l inear apportionment scheme would result in A+[3B/1] and C+[B/1], which again might [or might not) be normal ized. In this way. the intermediate point may be "located" or "positioned" between the transmitted points. Other apportionment schemes may also be used and may involve different numbers of transmitted and non- transmitted points. However, the general principle is that the closer the non-transmi tted point is to the transmitted point, the larger the appor ionment or "weighting" factor, shouI d be. However, for certain appl ications, a counter- iπtui t ive scheme, where closer points were weighted less, could be used. Other weighting schemes may prove useful for certain types of images or far certain appl ications. (4+11:1 Digital Weighting Scheme: Returning now to the [4+13:1 pattern, depicted in Figures 5A through 5G and 6, one par icular weighting scheme wi l l be described. Other weighting schemes are possible, and the particular weighting factors, o r the exact, ,pos i t ions of the transmitted or intermediate points, may be adjusted to accσmodate various camera, transmission, storage or display systems, or for other purposes. Specifical ly, the [4+13:1 scheme is square [i.e., points are equal ly spaced in the hor izontal and vert ical directions] and this may be adjusted for certain television systems with non-square l ine and paint spacing, or to adapt the technique to particular screen shapes, information sampl ing rates or, transmission or modulation frequencies. A transmitted point, X, in the [4+13:1 scheme, wi l l be associated with four other paints. A, B, C E> D, in deceπding order of closeness. Therefore, the data at each transmitted point, X, wi ll consist of five pieces αf information. A. B, C. D and X itself. Each wi l l be weighted by a factor. Any point-oriented algorithm, to be implemented in digital hardware, would have to be executed mi l l ions of times each second. Therefore, it is important to develop a weighting algorithm that wi l l not require undue calculation. Integer arithmetic is preferred, and division is a particularly sensitive operation that can take much computing ime. However, division [αr multipl ica ion] by a power of two is easily accompl ished by shifting a digital register to the right [or left], a trivial operation. With this in mind, the fol lowing normal ized weighting factors [K ] have been developed: Of the numbers involved for multipl ication or division, most [1, 2. 1 & 16) are powers of 2 and the others [3 - 2 + 1; 6 - 1 + 2) are sums of two powers of 2. Weighting factors need not be based on powers of two. Other weighting factors may prove to be superior to those above, for certain purposes, in particular, the factor for the transmitted paint Kx can be varied to effect and can even be reduced to zero [as can other weighting factors, for certain purposes). Weighting factors can even be made negative; for example, as a way of incorporating an edge enhancement or other image processing algor i thm into the instant invention. Al ternately, weight ing factors do not have to be constant but can be varied on a pre¬ determined or a pseudo-random basis. Or, they can be determined based on other criteria, such as. image characterist ics. For example: weight most heavi ly the brightest [or dimmest] pixels; weight most heavily the pixels that are most different from [αr most simi lar to) their neighbors; weight most heavi ly the pixels that are most different from [or most simi lar to] the equivelant pixels in adjacent or neighboring frames, both fαward and backward in time; set or adjust a we ight ing factor, based on an additional factor, calculated in any other way, from the image sequence data. Simi larly, when displaying or decoding an image encoded by the instant invention, a set of "weighting factors" may be calculated for use in a bi-l inear [or other] interpolation scheme, or other image reconstruction scheme. These factors can be determined in many ways, as described above. They would then be encoded into the transmi tted s ignal , or der ived i ndependent ly at the destination by predetermined algori thm or by analysis of the image sequence data. Returning to the above speci f ic example, for each transmi tted point, X, the amount of information devoted to itself is roughly 1 /3 [exactly 6/16], with the remainder devoted to intermediate information. For each whi te pixel , a total of 10/16 of an information point is devoted to it; 1/16 + 2/26 + 3/16 + 4/16. as i t i s i n the A. B. C & D pos i t ions, w i th respect to four - 38 - different transmitted [x)-pixels at the same time. In this way, the non-transmitted white pixel is [approx imte I y] properly located between the four black transmitted points. However, each white ixel is apportioned and transmitted only αnce every four frames, so the average, over time, is 2.5/16 αf an information point devoted to each white pixel. Intermediate Point Reconstruction: For many applications, embodiments of the instant invention wil l simply display the transmitted [x]-pixeis. S t ra i ght- f oward i n erpo 1 a t i ve techniques may be used to "f i l l in the holes" between those points, but no extraordinary computational efforts wi l l be made tα "reconstruct" the samp I ed-but-not-transmi tted [o]-poi ' nts. Alternately, armed with knowledge of how data from the [xl- and [o]-poihts have been combined, extra computational effort may be expended to [appro imately] reconstruct the intermediate points at the display. Computational methods exist, from f ields such as Computerized Axial Tomography [CAT scanning), image un-def ocus i ng [i.e., tα digita y sharpen a fuzzy image], Fourier transform processing and auto-cαrrolation process ing, that faci l i tate the reconstruction of individual data points that have been dispersed and/or embedded in larger data structures. These, or other techniques, can be appl ied tα a l imited section, or to the entire image, to compute better values far the intermediate display paints than would be obtained by simple i nterpo I at i ve techniques. [4+13:1 Pattern, In Practice: To this point in the instant appl ication, the [4+13:1 pattern has been depicted in a particular orientation that faci l itates the clear i l lustration of the relationship between the single black pixels and the white 2x2-pixel cel ls [see Figure 5A3. Lines drawn between the nearest neighbors αf the single black [x]-points would be approximately on 28 and 118 degree l ines. However, television imaging systems are usual ly set up on rect i l inear grids of 0 and 90 degrees. Al so, note that the distance between nearest neighbors of the single black [x]-points is the square root of f ive, when compared wi th the uni t of the grid in Figure 5A. By multiplying the entire scale of the pattern by the square root of five, and ti l ting i t approximately 28 degrees, i t may be conveniently depicted on a unit square grid; see Figure 7. In Figure 7, the position of the black pixels are depicted by [x], the position of the white pixels by to), and blank squares indicate inactive pixels that are included for spacing purposes only. The result is that the transmitted pixel positions [x] fal l on a square grid with a uni t side of five, when compared to the unit side of the grid in Figure 5A. This square grid, αf (x)-pixeis, can be conveniently overlaid on a standard recti l inear television raster. Or, it can be stretched or squeezed, either horizontal ly or vertical ly, to accαmαdate the requirements αf picture aspect ratio, scanning or sampl ing rate, modul at ion or transmi ss ion frequency, or other system or operational requirement. For interlaced video systems, with frames consisting of two interleaved fields, each containing only odd αr even l ines, the grid can be overlaid on the whole frame, or on each f ield separatel y . Standard interlaced television cameras only scan hal f of the possible raster l ines for each field. For some embodiments αf the instant invention, it wi l l be necessary to use cameras that scan al l l ines of an interleaved frame in one field time, or can even scan at a rate higher than one ful l frame for each f ield. One "field's worth" αf information wil l then be selected, encoded and transmitted according tα the techniques described herein. For some appl ica ions, e.g., a film chain, it will be possible to use a very high resolution camera that scans slower than real-time. The encoded frames can then be recorded on videotape, or some other medium, for real-time playback and transmission. Most color television systems uti l ize three different color signals. These are often Red, Green and Blue of equal resolution, or one luminance and two chrominance signals [sometimes in the form cal led Y, I & Q] . with the I um inance signal of a higher resolution and the chrominance signals at lower resolutions. For Y, I E> Q, the bandwidth of the three signals are approximately 3.5 MHz, 1.5 MHz and .6 MHz respectively. In some embodiments αf the instant invention, different versions of the varying STS techn ique w i I 1 be util ized to encode different signal components, particularly if the signals are at different resolutions or bandwidths. Similarly, different versions of varying STSs can be applied to the left and right signal components of a stereo pair αf image signals. Further, a varying STS can be applied to a method for combining the various signal components. These techniques will further increase the variation and complexity of the STS and will apply not only to the [1+1):1 pattern but to any pattern used to implement the instant invention. Note that, for th= [4+l):1 patern as depicted in Figure 7, if the [x]- and Col-points only, are considered, a reduction of 5:1 is achieved. But. if all points on the grid are considered as valid data, the reduction is 25:1. Differential Phasing: As described above, the varying STS scheme using the [4+l ): 1 pattern samples only one of the intermediate, white. 2x2-pixel oel I points, for each of the four phases of the cycle. The point is apportioned tα four black, single, transmission points at the same time. This f irmly "locates" the intermediate data point by weighting its apportionment among the four transmission points. However, by including each intermediate point only once every four frames [or f ields) -- 7.5 [or 15) t imes each second -- a visual roughness or texture ' may result. I n order to reduce thi s poss ibi l i ty, the phase of the multipl icity of transmission [x]-points can be varied. An example αf one variation scheme is depicted in Figures 8A through 8D. Figures 8A through 8D each show one phase of a four phase cycle of a [4 + 13:1. pattern, where the phase αf the [x]-pαints has been varied. With a four part cycle. [x)-points may be set to four different phases. These have been denoted by WW, XX, YY & ZZ. The arrangement is such that the four (x)-poiπts that are associated wi th each 2x2-pixel cel l of [o]-pαiπts are each αf a different phase. The [o]-points are denoted by a two letter code. The f irst lower-case letter [w. x. y & z ) refers to the [x)-point wi th which the Cα]-point is associated at that t ime. The upper-case letter CA. B. C & D] refers tα the position relationship between the [x]-poiπt and [o)-point. In each αf the four Figures 8A through 8D, o.ne αf each typs αf Cx)-pαint [WW, XX, YY & ZZ) is printed in bold type, as are the four [o]-points associated with i t. Also, boxes have been drawn tα clearly indicate the (x]-pixel and the four 2x2-(α)-p i xe I - cel ls associated with it. This part icular scheme is wel l distr ibuted both spatial ly and temporal ly, yet is based on direct, simple rules that can easi ly be implemented in a systematic fashion. I t resul ts in several nice features: all [o]-pαints are used in each phase; - each Cα)-poiπt is used with one, and only one, Cx]- point at each phase; each Co]-point is associated with each of the four Cx)- points CWW. XX, YY & ZZ). that surround its 2x2- pixel cel l, during some phase; each Cα)-point is in each type of position relationship [A. B, C 5 Dl. during some phase; - each [χ]-point is associated with al l four types αf positions [A. B, C & 0) at-each phase; each [x]-point is associated once, and only αnce, with al l 16 of the possible [o]-pαints i t can be associated with, at some phase of the cycle. It should be noted that, the above differential phasing scheme is an example and should not be interpreted as limiting in nature; it is extremely regular and systematic. I t is possible to vary the phase or direction of the cycle, αr even use entirely different cycles αr pseudo- random [i.e. non-cycl ic, or non¬ repeating] sequences, for any αf the multipl icity of [x]-points. The number αf ways that various sequences may be constructed and assigned to the [x)-poϊnts over the image plane, is almost l imitless; and, the pattern αf assigning the various sampl ing sequences to the [x)-pαints may itself vary over time. In particular, cycl ing sequences of different lengths may be used over the frame, so that, while the scheme for an individual point is relatively short, the overal l cycl ic repeat for the entire frame may be quite long. Also, in particular, the above examples show cases where [o]-points of the type A, B, C & D are sampled in order, one at a time. Other orders or schemes are possible, for example, A+C al ternated with B+D; or, associating more or fewer [o)-pαints with each [x)-poiπt. Symmetry and Other Variations: Figure 9 shows two variat ions on the [4+1]:1 pattern. The left uni t square is the same as the one used thus far; the right uni t square is a mirror image pattern. The difference is that the square αf [α)-points. within each larger square of [x]-points, is skewed, αr f I ipped, in the opposite direction. The two patterns may. be used, for example, to extend the cycle of phases from 4 to B, e.g.. A, B, C, D, mirror A, mi rror B, mi rror C and mi rror D. I t should be noted that, when comparing the pair of unit squares in Figure 9, if the four [χ)-points remain constant, the (α)- pαints in one configuration are inactive points in the other. In genera l , STS schemes can a l so be var ied by chang ing the assignment of Cx]-points. [o)-pαints and inactive points, over the frame, from frame to frame. In Figure 10, a f ive-way variation on the [4+1):1 pattern is shown. Here, it is required that the 1 /5 subset of the total number of points that are active [i.e.. in Figure 7. ;he union αf the set of [x)-points and [o)-points, but none of the blank points] remains constant. However, it is al lowed that the active points be reassigned as [x]- and [o]-type. Five types of points are shown in. a uni t square, which represents the repeat αf the pattern: X for the [x)-points. and A. B. C & D for the four Col- points [which di ffer from each other only in their relative positions). To generate the f ive variations, the columns or rows of the unit square are shifted, with "wrap-around". In this case the columns are shifted r i ght- to- 1 ef t and then, adjusted up/down so that an active point is in the upper left corner. Alternately, one may consider that, with five types of points, one may start the pattern, at the upper left corner, with any of the five. The points may be interchanged for these purposes because the distance between any two adjacent active points is the same. The fi e al ternatives may be presented in any cycle αr non-cycl ic order. Al though, 1. 3. 5, 2, 4, 1 ... may help disguise the cycl ic horizontal shift. If, instead, we consider the situation where four Cx]-points are out αf phase [and des ignated W, X, Y & Z) the number αf variations is increased to 20. For each of the five variations shown in Figure 10 there are four further variations. The character X, or the upper right .X for number One, may be any one of W, X, Y or Z. The ful I uni t square repeat for a differential phase pattern is thus greater than for the previous situation. I f we remove -the requirement that the 1/5 subset of active points must remain constant, the number of variations increases greatly. In this case the shift [with wrap-around] of rows and the shift of columns are not equivalent. The five column shift, right-tα- left, is shown in Figure 11; and the five row shift, bottom-to- top is shown in Figure 12. They can be used in the order shown, in reverse, or in any order or sequence, al though, the order 1 , 3. 5, 2, 4 wi l l help make the cycle of row/col umn shifting less apparent. The two shifts may be appl ied independently for a total of 25 combina ions. Alternately one may derive the same alternatives by considering that there are 25 points [[x]-, [o]- and blank] in the original unit square and a given reference point may reside at any αf those 25 points. For the di fferential phase CW, X, Y & Z) case, the repeat square is 20 by 20 paints and the number αf variations of th i s type i s, thus, 100. The number of ways those 100 variations can be sequenced is virtual ly l imitless. This last technique wi l l provide a means for varying the overal l pattern in subtle and complex ways. In particular, it may be used as fol lows: Some of the techniques described, in particular the simpler patterns, may produce their own perceivable artifacts. For example, if we consider the first [1+1 ):1 pattern with uniform phase, each of the four [α]-points, in a 2x2-pixel cei l, is selected by al l four [x]-points at the same time, and the other three Col-points are- ignored. And the four Col-points are sampled in a circular order. The entire cycle may run as few as 7.5 times per second, i f each phase were appl ied to a standard video frame. These factors may combine to produce a perceivable circular wobble or texture to the image. A sequence αf subtle adjustments may be sel ected, from the sets of up to 100 variations described above, to mask or counteract a perceived wobble, spin or texture anomaly. Any and al l αf the techniques and variations described herein may be appl ied, in combination, to achieve the overal l desired system operat ion or a visual ly pleasing resul t. The discussions have focused on what has been cal led the [1+11:1 pattern. However, al l of the principles of interpolation, weighting, phasing, spatial and temporal variations, etc., can be appl ied to other basic sampl ing patterns. One other such pattern wi l l be shown below. [2+11:1 Hexagons I -Ce I I Pattern: An additional pattern wi l l be described as providing the basis for alternate embodiments of a varying STS sampl ing scheme. This is intended as an ' i I I us t ra t i on of how the basic concepts and techniques described above may be appl ied to a pattern that is substantial ly different than the [1+1):1 pattern. Therefore, the fol lowing discussion should not be interpreted as l imi ting in nature. Al l of the techniques described both above and below may be appl ied, where appropriate, to both the [1+1):1 and the [2+11:1 Hexagonal patterns, or any other repeating or non¬ repeating, static αr time-varying mathematical distribution pattern of information points, in particular, the STS sampl ing techniques may be appl ied to cases other than a fiat, two- dimensional array of data points. For some mathematical or computational purposes, video image data can be considered a three-dimensional array αf points. Far example, with time as the third dimension [after horizontal and vertical], the various frames of a sequence may be "stacked up" in the third dimension. Or, several different image frames, or components Cfor example the Red. Green and Blue components αf a color image] may be stacked into a 3-D "block" of data.- Also, for appl ication tα audio signals the data structure may be a απe-dimens iαna I array, or several one dimensional streams for multi-channel sound. The [2+11:1 hexagonal pattern has been developed on a rectil inear grid to facil itate easy adaption to raster patterns. From the universe of possible points, the active points CCxl- & [αl-type] are one half, as depicted in Figure 13. In order to make the hexagonal eel Is more regular, the pattern may be spread out, as de icted in Figure 11, so that the ratio of active to total points is 1:1. Of the active paints, the ratio of (o)-points to [x)-poiπts is 2:1 — thus [2+11:1 C Col- type + Cxl- type] : [x]- type. The scheme provides a 3:1 data reduction when considering the active points only, and a 6:1 or 12:1 when considering al l passible data points in Figures 13 and 11 respec i ve I y. ' F i gure 15 shows how two such patterns may be interleaved; one is shown with Cx]s and Cols, the other with C + ls and C-3s, for the [x]-pαiπts and [α]-pαints respectively. Figure 16 shows the basic repeat cel l of the [2+11: 1 Hex. pattern, denoted by the heavy I ine, a hexagon of six [o]-pαints surrounding a single [xl-pαint. This cel l shares each adjacent pair αf Co]-points with another cel l , shown by l ighter l ines. Threrfore, each [o]-point is shared by three cel ls. Figure 17 shows the six possible ways αf combining data from the [ χ ]-point wi th one [o)-poiπt for transmission, indicated by a connect ing l ine. These may be used in a rotat ing cycle as indicated, in any other repeating or ordered manner, or pseudo- randαml y . Figures IB and 19 each shdw six ways that an [x)-point may be combined wi th two [o]-pαints: adjacent points in Figure IB; points seperated by one in Figure 19. Figure 20 shows three ways one (x]-point may be combined with two opposing [ol-points. There are only three rotations because of symmetry. Figure 21 shows the starting positions [without showing the possible rotations] for the ways three [ol-points may be combined with an Cxl-point. There are six. rotations for A, B & C, but only two for D, due to symmetry. Patterns can be developed for 1 or 5 [ol-points, or even for al I six [ol-points so long as weighting factors were varied to provide a varying STS. Figure 22 shows the sampl ing patterns of Figure 20 uni formly distributed over a frame far a three phase cycle. Al l [ol-points are used once in each frame. Combined with the two phase cycle of odd and even video fields, this would result in a combined repeat of six. I t is impossible to order these three patterns in a cycle wi thout creating a spin in one direction. The great regulari ty and short repeat inherent in this pattern may produce a visable "rotation" texture. The phase can be varied over the rame in order to combat this, for example, as shown i~ Figure 23. In other di fferential phase patterns some points might be used mul t iply, and others not at a l l , in some phases. As an alternative, the interleaved pattern from Figure 15 may be used. - 48 - One pattern would be "spun" clockwise, the other counter¬ clockwise. The two would tend to balance each other. Lastly, the patterns can be turned, by 90 degrees, 120 degrees or any convenient amount, tα faci l itate implementation. Also, any four closest neighboring, active points, which form a rhombus, can be skewed to a square configuration. The entire pattern will be equivalently skewed. This configuration can be imposed on a rectlinear grid without any non-active points, it may be used to facil itate adaption to some rectil inear raster scan systems. In Figure 21, the Col-points of one hexagonal cell have been blanked out to make it easier to see how the pattern has been skewed. Details of Implementation: Figure 25 is a flow chart of the general ized process of.the instant invention, as described, for example, on page 30, l ines 2-11, above. Process steps are represented in the figure by boxes, information set inputs to and outputs from the processes are represented by l ines. The initial input tα the process is the maximum definition source Cl] which may be an HDTV signal, an audio signal, a motion picture f i lm, a "real scene" which is to be scanned by a television camera, or a computer database from which a synthetic television signal wil l be generated. A given frame αf source information Ce.g., an HDTV field; a "chunk", say one second, of audio signal; a film frame; or a real or synthetic television frame) may be sampled at an arbitrarily high definition or resolution. The first process step [23 is to select, from all possible samples which might be derived from the source signal, a subset of points which may potential ly be sampled [3], The second process step [4] is to select from the potential sample points [33 a subset αf active points (5) which wi l l actual ly be sampled. The thi rd process step [6] is to select from the act ive points [5] two further subsets: the points for which data wi l l be transmi tted, the x-points [7]; and the points which wi l l be sampled but for which data wi l l not be separately transmitted, the α-pα i π t s [8 ) . The fourth process step [9] i s to create mathemat ica l associations between the x-points and o-points. This results in the encoded values that wi l l be transmi tted for the x-points [denoted here as x'-poiπts -- read x-pr ime-po i π t s ] [10] which wi l l each, in general, be a combination of the sample value of an x-poiπt and the sample values of some subset of the o-points. The last process step [11] is to vary the parameters of the four previous processes in a non-trivial manner -- the variable STS -- as described herein; and then to repeat the cycle wi th the next frame of source information. Figure 27 depicts two main ways that the variable STS scheme may be implemented. In the upper system diagram, high-def ini tion signal [20] is encoded by the variable STS encoder of the instant invention (21 ), transmi tted over a low-def ini t ion channel (22) and then displayed directly on a televsion monitor [23] which may be of either low- or high-def inition. The lower system diagram, is ident ical except that, prior to display on the moni tor, the encoded signal is decoded by a companion variable STS decoder [24] which may, in pract ice, be incorporated into the monitor (23). Figure 28 consists of two system diagrams of a way to implement a companion pair of a variable STS encoder (above) and decoder Cbe I owl . The encoder consists of a standard television camera [30] which is not shown in detai l except for the subsystem [31] which controls the deflection of the scanning beam across the imaging element. The non-standard element which implements the instant invention is the variable STS offset generator [32] which generates a "wobble" signal which in turn modulates the standard repeated raster pattern of the deflection of the scanning beam. Simi larly, the decoder consists of a standard television monitor [401 which is not shown in detai l except for the subsystem [41] which controls the deflection of the scanning beam across the picture tube. The non-standard element which implements the instant invention is the variable STS offset generator [12] which generates a "wobble" signal which in turn modulates the standard repeated raster pattern of the deflection of the scanning beam. The offset may be appl ied uniformly tα an entire image frame αr may vary over the image frame. The wobble of the monitor raster woul d be synchronized wi th the wobble αf the camera by information imbedded in the transmi tted signal and/or pattern information incorporated into the variable STS offset generator. Figure 28A consists of a system diagram of the equivalent encoder employing a newer type standard video camera, with a digital CCD imaging element. The encoder consists of a standard CCD television camera [35] which is not shown in detai l except for the subsystem [37] which controls the generation αf the addressing signals used to access the pixels of the CCD imaging element. The non-standard element which implements the instant invention is the variable STS offset generator [38] which generates a "wobble" signal which in turn modulates the standard repeated raster pattern of the addressing of the imaging element. Figure 29 consists αf two block system diagrams of a more complex way tα implement a companion pai r of a variable STS encoder (above] and decoder [below). The encoder consists of hardware elements that, taken together, constitute a standard type of computer display device known as a Frame Store or Frame Buffer. For example, elements 31 through 31 would const i tute a scannihg or digi tizing frame buffer. I f we extended the l ist to elements 31 through 36, i t would be an "intel l igent" scanning frame buffer. Simi larly, elements 37 through 10, αr 35 through 10, would constitute a display frame buffer or "intel l igent" display frame buffer. Elements 31 through 10 would constitute an "intel l igent" frame buffer capable of both digitizing and displaying, however, in that case elements 33 and 37 might be a combined into a single memory buffer. Simi lar comments can be made about the hardware elements of the decoder 51 through 60. Also note that there are four pai rs of elements [33/31, 37/38, 53/51 & 57/58] each consisting αf memory buffer and an address generator. For each pai r, the two halves are interconnected and an input/output l ine communication wi th one element may be considered to communicate with both. Simi larly the computer and memory elements 35/36 and 55/56 are also interrelated. Refering now to the encoder [above] the high-defini tion s ignal input [30] may consist of an HDTV camera, computer generated graphic αr any other high-definition information source. I f the signal is an analog signal it is converted to digital form by the ana I αg-tα-d i g i ta I converter [ADO element (32] otherwise, if the signal originates in digital form, this element. may be removed. (Simi lar statements about the optional i ty of the other oαπverter elements (39, 52 & 59] are impl ied by this and wi l l not be repeated. ] The digital HD signal is then input tα the input memory buffer [33], The choice of the addresses at which the individual signal samples are stored is made by the input address generator [31] which is synchronized by the sync detector [31] which extracts timing information from the HD signal input (30). Depending upon the complexity αf the particular encoding scheme to be implemented and the computat i απa I speed of the graphics processor CPU C35], the size of the input memory buffer (33) may range from a partial "window" αf an input frame [as is common in the design of digital television TBCs — time base correctors], tα an entire frame store, to storage for several frames as is described elsewhere in the instant appl ication, far example page 23, l ines 13 tα 26. I t may even be reduced to size zero if the CPU (35) is very fast aπd/αr the encoding scheme is very simple. [The same statements may be appl ied to the other memory buffers (37, 53 E 57] where appropriate.] The graphics processor CPU [35] is a special ized, high-speed micro processor of which many now exist (for example, the Texas Instruments T131010] and which may also be cal led a DSP for digital signal processor. It general ly wil l also have an amount of computational or "scratch pad" memory, or registers associated wi th it, as indicated by "£_. MEM" in [351. As is common practice in high speed computing, if additional speed- or computing power is required, several CPUs may be employed to operate in tandom as a composi te CPU (for example. the EPIC made by Broadcast Television Systems]. The graphics processor [35] al so has associated wi th i t addit ional program memory to hold software (361. Working from data input f rom the input memory buffer (33) the graphics processor [35/36] computes the encoded x'-pαint values. according to the variable STS encoding schemes or other tech¬ niques described herein by the accompanying text and diagrams, and places the results in the output memory buffer (37). For some implementat ions ei ther memory buffer [33 or 37 in the encoder. 53 or 57 in the decoder] may be absent, or both functions may be implemented by a common memory buffer. Also, the scheme described on page 23, l ines 2 to 11 , which employs two separate frame stores may also be implemented as shown by buffers 33 and 37, or 53 and 57. The data placed in the output memory buffer [37] by the graphics processor (35/35) may then be scanned out, under control of the output address generator (38), converted by the digital-to-analog converter or DAC (39), and output as a low-def ini tion encoded data signal (11 ). The output signal (11 ] wi l l al so contain synchronization information, generated by the sync geπerater (10) based on timing information from the output address generator (38). The combined, data and synchronization, encoded low-def inition signal output (11 ) is then avai lable for transmission, for recording on videotape, videodisc or other media, or for direct undecoded display in certain instances. The operation of the variable STS decoder (below. 50-61 ] is virtual ly identical to that of the encoder (above. 30-11] except that: the low-def ini tion signal input (50) is now the encoded low-definition output αf the encoder [11] which is avai lable via cable, radio transmi ssion, from a storage medium or any other appropriate means; the graphics processor [55/56] now implements the variable STS decoding and reconstruction schemes or other techniques described here in by the accompany i ng text and diagrams; the output [61] is now a decoded/reconstructed signal which is avai lable for display on a television monitor. Referiπg now to Figure 30. a variable STS decoder is shown in block system form that is largely identical to Figure 29 [below), with the addition of pixel modification information element [65]. This additional information may be derived from the LD signal input (50) and/or created by graphics processor [55/56]; and it may be input to the output address generator [58] from information stored in the input memory buffer (53), information stored in the output memory buffer (57), or information generated or stared in the graphics processor [55/561. The pixel modif ication information [65] wi l l be used tα modify the scanning αf data from output memory buffer [57] as controled by the output address generator [58] and/or tα modify the synchroniza ion signal part generated by the sync generator [60] and which is included in the decoded signal output [611. It wil l be used to modify geometric information about the display of individual pixels such as the position, size or shape αf the pixel as displayed an a television monitor to which the decoded signal output [60] is sent. Figure 30A shows c-ne example of a data structure which could be stored for each pixel of the input memory buffer (531 αr the output memory buffer (571. For each pixel 8 bits of data would be stored representing any of 256 levels αf red intensity [70], 8 bits of data representing one of 256 levels of green intensity [71], 8 bits of data representing one αf 256 levels αf blue intensity [72], and two bits representing, pixel modif ication information [73]. The two bits of pixel mαdificaiton data would al low for a choice among four possibi l ities [00, 01, 10, 11); other numbers of bits in (733 would permit other numbers αf choices. Two bits might be used to pick a position (upper left, lower left, upper right, lower right) for the pixel within a 2- by-2 pixel cel l. I t might be used to determine a shape/size for the pixel Clxl, 1x2, 2x1, 2x23. I t might be used to modify how 1 long a pixel was to be displayed (not at al l, just once, twice. unti l replaced) for the "accumula ion made" as described herein; the "not at al l" option al lowing the RGB locations (70, 71 E> 72] for that pixel in that data frame to be used for other purposes. 5 Or it might be used in other ways, as described herein, to modify the display characterist ics of individual pixels in individual f r ame s . I t wi l l thus be seen that the objects set forth above, among 10 those made apparent from the preceeding descr ipt ion, are eff iciently attained and certain changes may be made in carrying out the above method and i n the construct ion set forth. Accordingly, i t is intended that al l matter contained in the above description or shown in the accompanying f ig-ires shal l be 15 interpreted as i l lustrative and not in a l imiting sense. Now that the invention has been described, what is claimed as new and desired to be secured by Letters Patant is: 20 25 30 "-> 35

Claims: 1. A method for encoding a signal, said encoding having a Spatial Temporal Signature [STS). the parameters of said STS having a variation over time. 2. A method for encoding a signal comprising the steps of: a. designating a selection of a set of usable data points from the set of al l possible spatial data points αf a s igna I ; b. designating a selection of a set of active data points from said set αf data paints; c. designating a selection of a set of to-be-transmitted points from said set of active data points; d. designating a selection of a set of to-be-sampl ed-but- not-transmi tted points from said set of active data po ints; e. designating a selection of at least one set from said to-be-samp I ed-but-πot- to-be- t raπsm i ted points and a selection of at least one set from said to-be- transmitted points and an association between those sets . f. varying at least one αf said designations over time. 3. A process as in claim 2 wherein at least one αf said selected sets is a proper sub-set. 1. A process as in claim 2 wherein said selected set of to-be- samp I ed-but-not-transmi tted points is the nul l set. A method for encoding a signal comprising the steps of: a. designating the separation of the data points of said signal into at least two multi-point cel ls; b. designating at least one to-be-transmitted point for at least one multi-point cel l; c. des ignat i ng at l east one to-be-sampl ed-but-not- transmi tted point for at least one multi-point cel l; d. des ignat ing re l at ionships between sa i d to-be transmi tted points and said to-be-samp I ed-but-πo t' transmitted points; e. var ingat least one of said designations overtime. 6. A process as in claim 5 wherein no to-be-samp I ed-but-πot- transmitted points is designated. 7. A method for encoding a signal whereby the pos i tions of points in a spat ial distribution of paints are offset by perturbations and said perturbations are varied over time. 8. A method for encod i ng a s igna l whereby a spat i a l distribution of data points is selected from at irregularly varying time intervals. - 58 - 9. A method for encoding an information signal, which is to be reconstructed in the human retiπex. by designating a selection of a subset of said information signal and varying said selection over time. 10. A method for encoding a high-definition television signal by the steps of: a. encoding the center section of said high-defini tion television signal into a standard video signal; b. encoding the side sections of said high-defini tion television into the blanking intervals αf said standard television signal. 11. A method as in claim 10 wherein at least some of the information for said side sections is encoded in the blanking intervals αf a frame previous to the information for said center section. 12. A device for displaying a high-def inition television signal that: a. derives the center section αf its display from a standard television signal; b. der ives the s ide sect ions αf i ts di spl ay f rom information encoded in the blanking intervals αf said standard television signal . 13. A device for displaying a high-def inition television signal cons i st i ng of: a. means for displaying a display information signal; b. means for deriving intermediate display informat ion from said information signal; c. means for d i spl ay ing sa id intermed i ate d i splay information. 14. A device as in claim 13 comprising in addition: d. means for retaining said display information; e. means for displaying said retained display information as intermediate display information. 15. A method for displaying a high-definition television signa comprising the steps of: a. displaying said high-definition television signa b. retaining at least some of said signal; c. s imul taneous l y d i spl ay ing sa id, .high-def i n i t ion television signal information and said retained signal in an interleaved fashion. 16. A device for displaying a igh-def inition television signa by the method of claim 15. - 5B - 17. A method for displaying information points wherein at least some geometric parameter αf said points are continuously adjusted and said adjustments are of smal l amounts when compared with the size αf the entire display. 18. A device for storing and displaying information consisting of: a. means for staring data points; b. means far displaying data points as display paints; c. means for cont inuous ly adjust ing the geometr ic parameters of said display points by smal l amounts when compared with the size of the entire display. 19. A device as in claim IS wherein said adjustment to the geometr ic parameters i s based at l east in part on information stored with said data points. 20. A device as in claim IB wherein said display paints are individual ly adjustable. 21. A device as in claim 18 wherein said adjustment to the geometric parameters may be selected from a set αf more than two possible adjustments. 22. A device as in claim 18 wherein said geometric adjustments relate to display paint position. 23. A device as in claim 18 wherein said geometric adjustments relate tα display point size. 24. A device as in claim 18 wherein said geometric adjustments relate to display point shape. 25. A frame store device wherein at, at least some picture elements, data is stored for both display content and d i s I ay pos i t i on. 26. A method as in claim 2 used to compress the bandwidth of an information signal. 27. A method as in claim 2 used to process an information signal for the purpose of improving the perceived qual ity of said information signal. 28. The process of transmitting a signal encoded by the method αf c I a im 2. 29. A device for transmitting a signal by the method claimed in claim 28. 30. The process of receiving a s ignal encoded by the method αf c I a im 2. - 80 - 31. A device for receiving a signal by the method claimed in claim 30. 32. The process of recording a signal encoded by the method of claim 2. 33. A device for recording a signal by the method claimed in claim 32. 34. A medium upon which has been recorded a signal by the method claimed in claim 32. 35. The process of decoding a signal encoded by the method of c I a im 2. 36. A device for decoding a signal by the method claimed in claim 35. 37. The process of displaying a signal encoded by the method of claim 2 on a I αw-def i n i t ion display. 38. A device for displaying a signal by the method claimed in claim 35. 39. The process of displaying a signal encoded by the method of claim 2 on a high-defini ion display. - 81 - 40. A device for displaying a signal by the method claimed in claim 39. 41. A method as in claim 39 cαmprising the addi tional step of creating additional display data intermediate to the encoded data paints. 42. A method as claimed in claim 41 wherein said addi t ional display data is created by interpolation. 43. A method as claimed in claim 41 wherein said addi tional display data is created by reconstruction. 44. A method as in claim 39 comprising the addi t ional step of storing said display data in a frame store. 45. A method as in claim 44 wherein at least some αf said displayed data points are accumulated in said frame store whi le additional data points are stored. 46. A method as in claim 44 wherein at, at least some picture elements, data i s stored far both display content and d i spl ay pos i t i on. 47. The process for creating a synthetic signal by applying the encoding scheme αf claim 2 to a data base. - 82 - 48. A device for synthesizing a signal by the method claimed in claim 47. 49. A medium upon which has been recorded a signal created by the method claimed in claim 47. 50. A camera system for creating an information signal encoded by the process in claim 2. 51. A camera system for creating an information signal encoded by the process in claim 5. 52. A camera system for creating an infαrmation signal encoded by the process in claim 7. 53. A camera system for creating an infαrmation signal encoded by the process in claim 8. 54. A device for encoding a signal by the method of claim 2. 55. A device for compressing the bandwidth of a signal by the method αf claim 2 . 56. A method as in claim 5 appl ied by using a [4 + 13:1 pattern essential ly as described herein. - 83 - 57. The process of decoding a signal encoded by the method of c I a im 56. 58. A method as in claim 5 appl ied by using a rectangluar MxN pattern essential ly as described herein. 59. The process αf decoding a signal encoded by the method of cI a im 5B . 60. A method as in claim 5 appl ied by using a (2+ 13: 1 pattern essential ly as described herein. 61. The process of decoding a signal encoded by the method of claim 60. 62. A method as in claim 1 appl ied to an audio signal 63. A method as in claim 1 appl ied to a video signal. 64. A method as i n c l a im 2 where i n at l east one of sa i d variations aver time is varied from frame to frame. 65. The process of decoding a s ignal encoded by the method αf claim 54. - B4 - 66. A method as in c l a im 2 wherein at least one of sa id variations over time is appl ied at irregular time intervals to a multipl icity of points of a spatial distribution. 57. The process of decoding a signal encoded by the method of cl a im 66. 68. A method as i n cla im 2 where in at l east one of sa id var iat i ons over t ime i s appl ied nαn-uπ i fαrmly to a multipl icity of points in a spatial distribution. 69. The process of decoding a signal encoded by the method of claim 68. 70. A method as in claim 9 appl ied to a mul ti-point cel l pattern. 71. A method as in claim 5 wherein the shape αf at least some of said multi-point cel ls is varied. 72. A method as i n c l a im 2 appl ied to a- random spat ia -Jistributiαn of points. 73. A method as in cl a im 2 wherein at least some of the information points comprising said signal are modulated by weighting factors. - 85 - 74. A method for decoding a signal encoded by the method of claim 2 wherein at lest same of the decoded data points are modulated by weighting factors. 75. A method as in claim 2 wherein the phase αf at least one of said variations is appl ied non-un i forml y to a multipl icity αf points in a spatial distribution. 0 76. A method of receiving a signal encoded by the method of claim 2 wherein at least some of said data points are retained whi le additional data points are received. 5 77. A device for receiving a signal as described in claim 76. 78. A method as in claim 2 wherein said signal is separated into 0 at least two areas and at least one of said variations over time is appl ied differently to at least two signal areas. 79. The process of deciding a signal encoded by the method of * 5 claim 78. 80. A method for encoding and recording an information signal in an off-l ine manner, for later real-time playback, said 0 manner being for the purpose of reducing perceivable artifacts due to the encoding process. 81. A method as in claim 2 wherein at least one to-be-samp I ed- 5 but-not-transmi tted point is associated with more than one - 88 - to-be-transmitted paint. 82. A method as in cl a im 2 where in at l east one to-be- 5 transmi tted point is associated with more than one to-be- samp I ed-but-not-transmi tted po int. 83. A method as claimed In claim 2 wherein said signal is a 10 video s igna l and compr i s ing the addi t iona l step of displaying said video signal on a monitor of a resolution comparable to the resolution of the transmitted data points. 15 84. A method as claimed in claim 2 wherein said signal is a v ideo s igna l and compr i s ing the addi t ional step of displaying said video signal an a monitor of a resolut ion comparable to the resolution of the usable data points. 20 85. A method as in claim 84 wherein said signal is a HDTV signal 86. A method as in claim 85 comprising the additional steps of 25 encoding the middle section of said HDTV signal into a standard video signal and encoding the side sections of said HDTV signal into the blanking intervals of said standard v ideo s igna I . 30 87. A method as claimed in claim 2 wherein said signal is a high-definition video signal and said encoding is of such character as to -.Mow said signal to be compatably displayed on both high-definition and low definition receivers. 35 - 87 - 88. A method for processing information essential ly as described herein. 69. A system for processing information essential ly as described here i n. 90. A medium upon which has been recorded information processed essential ly as described herein.

Inventors: GESHWIND DAVID M, GESHWIND, DAVID, M.
Applicants: GESHWIND DAVID M, GESHWIND, DAVID, M.
Application year: 1988
Main classification: H04N7
IPC codes: H04L29, H04N7