# Patent

## Title
Entropy guided deconvolution of seismic signals

## Abstract

In a video computer system having a RAM chip with a shift register connected to its serial output terminal and actuated by a first clock circuit, a second different clock circuit is included to cause the data bit in the first stage of the register to also appear at the serial output terminal of the chip. Accordingly, signals from the first clock circuit will then sequentially transfer data bits from the shift register, to the output terminal of the RAM chip, without omitting or losing a clock cycle, or a portion thereof.

## Background
This application contains subject matter disclosed in U.S. patent applications Ser. Nos. 567,040, 567,110, 567,111, 567,039, and 567,038, all filed Dec. 30, 1986 and all assigned to Texas Instruments.

This invention relates to improved video computer methods and apparatus, and more particularly relates to an improved circuitry for recovering stored video data bits.

In a video computer system having a RAM chip with a shift register circuit, it is conventional to employ a clock circuit to sequentially transfer data bits in the shift register to the serial output terminal of the RAM ship. A problem arises, however, from the fact that at the beginning of this transfer, the data bit which appears or is stored in the first stage of the shift register appears only at the output of the shift register. More particularly, the effect of the first clock pulse to the shift register is merely to cause the data bit at its first stage to also appear at the serial output terminal of the RAM, and it is not until the second clock pulse appears that data stored in the register begins to be recovered.

The disadvantage in the prior art systems is overcome with the present invention, however, and novel means is provided whereby the first stored data pulse in the shift register is caused to appear at both the output of the shift register andd the serial output terminal, and whereby data in the shift register can be made to appear at the serial output terminal of the RAM chip in an orderly manner.

In a preferred embodiment of the present invention, a second clock circuit is included in the data storage, or memory section of the host computer, and the output of this second clock is employed to cause the data bit in the first stage of the register to also appear at the serial output terminal of the chip. More particularly, a suitable gate or transfer circuit is interconnected between the first stage of the shift register, and the serial output terminal of the RAM chip, and this gate or transfer circuit is adapted to respond to the pulse generated by the second clock circuit.

In the overall system, the microprocessor is adapted or programmed to generate a transfer signal for the purpose of actuating the transfer gates between the shift register and the columns of cells in the selected row of the RAM chip, and it is not until after these transfer gates have been actuated that pulses from the first clock circuit can begin discharging data from the shift register. Accordingly, the second clock circuit is preferably actuated by the address strobe signal, which arrives from the microprocessor just after the transfer signal, whereby the second clock circuit is actuated before the first clock signal is applied to the shift register by the microprocessor. In other words, the microprocessor first generates the transfer signal and, thereafter, generates the address strobe signal. The second clock is thereby caused to actuate the gate or transfer circuit between the serial output terminal of the RAM chip and the shift register, before the occurrence of the first clock signal from the microprocessor which shifts data out of the shift register.

Accordingly, it is an object of the present invention to provide improved means and methods for recovering stored data signals in a video computer circuit and the like.

It is also an object of the present invention to provide improved means and method for sequentially recovering stored data bits, in a video computer system, without omitting or losing a particular time or operating cycle in the system.

It is further a specific object of the present invention to provide an improved data recovery means in a video computer system having means for sequentially generating a plurality of command signals, comprising, data storage means having a serial output terminal and a plurality of memory cells arranged in rows and columns, a shift register having data locations functionally associated with said columns of memory cells and responsive to a first one of said command signals, and transfer means functionally responsive to a second one of said command signals for causing a preselected data bit in said shift register to appear at said serial output terminal of said data storage means.

It is also a specific object to the present invention to provide a memory device having a serial-access port, comprising, an array of memory cells, addressing means for receiving address bits from address input terminals and selecting a plurality of bits from said array for serial access, address-strobe means for receiving an address-strobe signal and activating said address means, serial shift register means coupled to the array by transfer means, and having a serial output coupled to a serial output terminal, first clocking means responsive to said addressstrobe signal to clock a first bit of data to said serial output, and second clocking means activated from a clock input terminal and operative to clock subsequent bits of data serially through said shift register to said serial output.

These and other objects and features of the present invention will become apparent from the following detailed description, wherein reference is made to the figures in the accompanying drawings.

FIG. 1 is a simplified block diagram of a computer system embodying one form of the present invention.

FIG. 2 is a more detailed block diagram of a selected portion of the computer system depicted in FIG. 1.

FIG. 3 is another different block diagram of the apparatus depicted FIG. 2.

FIGS. 4a-4r are simplified time-dependent representations of certain signals generated for operation of the apparatus depicted in FIG. 2.

FIG. 5 is a block diagram of another portion portion of the system depicted in FIG. 1.

FIG. 6 is a block diagram of a further different portion of the system depicted in FIG. 1.

FIG. 7 is a block diagram of another different embodiment of the system depicted in FIG. 1.

FIG. 8 is a block diagram of a further different embodiment of the system depicted in FIG. 7.

FIG. 9 is a simplified depiction of a video screen suitable for the purposes of the present invention and having 1024 by 1024 pixels.

FIG. 10 is a simplified functional diagram of a portion of the system depicted in FIG. 1 according to another embodiment of the invention.

FIG. 11 is a simplified depiction of a video screen suitable for the purposes of the present invention and having 512 by 512 pixels for color presentations.

FIG. 12 is functional diagram of a portion of the system depicted FIG. 1 according to another different embodiment of the invention.

FIG. 13 is a simplified representation of the correspondence between color planes and pixels for the purpose of the structures in FIG. 12.

Referring to FIG. 1, there may be seen a simplified representation of the components of a computer video system which employs a dual-port bit-mapped memory arrangement according to one embodiment of the invention. More particularly, there may be seen a video display section 1 having a conventional raster-scanned CRT tube responsive to a video signal input 2 consisting of serial bits of data arriving at a rate of about 20 MHz or greater.

The standard TV signal normally provides 60 data frames per second, with 512 interlaced lines per frame, and each such line may have several hundred dots or pixel. The product of these numbers indicates that data bits must be supplied to the CRT at frequencies of the order of 20  MHz. For a simple black and white picture, each dot or pixel can be defined by one data bit, but up to four bits may be required for images in a more realistic sixteen shades of gray. A full-color image may require three or four streams or planes of data and usually will require at least one byte (8-bits) per pixel.

The horizontal and vertical scanning and synchronizing circuitry 3 and video signal shaping circuitry 4 may be of a conventional design, and are not a functional part of the present invention. In addition, the circuitry depicted in FIG. 1 may also include a complete TV monitor or receiver as needed. However, the video data on input 2 is preferably received from a bit-mapped video memory 5 as will be described later herein, and this memory 5 will preferably have at least one cell for each corresponding pixel on the video screen 1. The memory 5 may conveniently have a "parallel" or random input/output port 6, or it may have separate parallel input and output ports, in addition to the serial input port 2a and serial output port 2b depicted in FIG. 1. In addition, port 6 is preferably coupled to a multiplexed address/data input/output bus 7 of a suitable microcomputer or microprocessor 8.

Referring again to FIG. 1, it will be noted that the memory 5 receives addresses appearing on the bus 7, to define the address for the serial ports 2a and 2b, and also to define addresses for writing into or reading from the memory 5, by way of the parallel or random port 6. A control bus 9 coupling the microcomputer 8 to the memory 5 provides the basic clock frequency signa .phi. which clocks the serial video data onto the CRT input line 2, and which also provides the memory control signals such as Address Latch, Row Address Strobe (RAS), Column Address Strobe (CAS), Serial Select, Serial Output Enable (SOE), Write Enable, Write (W), Increment (INC), etc., as may be required because of the characteristics of both the memory device 5 and microcomputer 8.

The memory 5 further includes a memory or storage array 10 composed of rows and columns of memory cells partitioned according to the size and type of video display 1 and the type of memory 5 which has been chosen. In addition, the memory 5 further includes a serial shift register 20 having a plurality of taps. In this regard, it will be noted that a standard two-level black and white TV raster conventionally requires about 512 rows of cells (for 512 lines) arranged in 512 columns (for 512 pixels per line), to accomodate a total of 256k-bits of memory per complete data frame. Accordingly, if 64k memory devices are used for these purposes, then four such units will be required to form the memory 5, or else one 256k-bit memory device may be used instead. These four units may alternate in feeding 256-bit blocks of video data serially onto the line 2, or other formats may be employed as appropriate. A black and white image having relatively low resolution may be produced using only one 64k-bit storage array capable of providing 256 lines by 256 pixels per line.

One example of a memory device 5 which may be suitable for use in the system depicted in FIG. 1 and depicted in FIG. 2, is a 64k-bit MOS dynamic read/write memory using one transistor cells, as shown in U.S. Pat. No. 4,239,993, and further including a serial shift register having multiple taps added. For this example, the random access may be one bit wide. Other suitable examples (not shown) may be memory devices as hereinbefore described which have 256k-bits of storage or even larger.

As hereinafter set forth, if the memory is partitioned to provide eight chips, for example, then the individual storage devices may be X1, i.e. one bit wide, and eight of these storages may be connected in parallel for access by a typical 8-bit microcomputer 8. Other partitioning, such as X4 or X8, could also be employed as will hereinafter be apparent.

The memory device 5 depicted in FIG. 2 is typically made by an N-channel, self-aligned, silicon-gate, double-level polysilicon, MOS process, with all of the device being included in one silicon chip of about 1/30 of a square inch in size, which usually would be mounted in a standard dual-in-line package having twenty pins or terminals. For a 256k-bit device this package may be provided with as many as twenty-two pins or terminals. Similarly, the number of the pins would increase for larger volume devices. The device includes in this example an array 10 split into two halves 10a and 10b of 32,768 cells each, in a regular pattern of 256 rows and 256 columns. Of the 256 rows or X lines, there are 128 in the array half 10a and 128 in the half 10b. The 256 columns or Y lines are each split in half with one-half being in each of the halves 10a and 10b. There are 256 sense amplifiers 11 in the center of the array; these are differential type bistable circuits made according to the invention disclosed and claimed in said U.S. Pat. No. 4,239,993, or in U.S. Pat. No. 4,081,701. Each sense amplifier is connected in the center of a column line, so 128 memory cells are connected to each side of each sense amplifier by a column line half. The chip requires only a single 5 V supply Vdd, along with a ground terminal Vss.

A row or X address decoder 12, split into two halves, is connected by sixteen lines 13 to eight address buffers or latches 14. The buffers 14 are made according to the invention disclosed in U.S. Pat. No. 4,288,706. An eight-bit X address is applied to inputs of the address buffers 14 by eight address input terminals 15. The X decoder 12 functions to select one of the 256 row lines as defined by an eight bit address on the input terminals 15 received via bus 7 from the microcomputer 8. For more than 256 row lines, i.e. a 256k-bit memory with 512 row lines, a larger than eight-bit X address and eight-bit latch must be employed.

A column address is also received on the input pins 15 and latched into column address latches 16. For a bit-wide random-access data input/output, all eight column address bits are needed, but for byte-wide access, i.e. eight bits, only five address bits are needed, and the microcomputer may output additional column address bits to select among several cascaded chips; these additional column address bits may be used by chip-select decoders of conventional construction. The outputs of the column address latches 16 are connected by lines 17 to a decoder 18 in the center of the array which selects one-of-256 columns to produce a bit wide input/output on random access input/output line 19; separate input 19a and output 19b lines may be used as shown in FIG. 3, or the lines 19 may be multiplexed as shown in FIG. 2. Rows of dummy cells (not shown) are included on each side of the sense amplifiers as is the usual practice in devices of this type. As for the X-address, for larger colume devices, the number of bits and latches required to identify a column increases.

The memory device is thus similar to a standard dynamic RAM, with bit-wide or other bit-size random access and also having a serial input/output. Continuing to refer to FIG. 2, the serial access is provided by a 256-bit serial shift register 20 split into two identical halves with the halves positioned at opposite sides of the array 10. The same result may be achieved by placing both halves on the same side of the array, but laid out one above the other. However, placing the halves on opposite sides of the array balances the operation of the sense amplifiers.

The shift register 20 may be loaded from the column lines of the array 10 for a read cycle, or loaded into the column lines for a write cycle, by 128 transfer gates 21a on one side of the array and a like number of transfer gates 21b on the other side of the array.

Data input to the device for serial write is by a data-in terminal 22 (2a of FIG. 1) which is connected by a multiplex circuit 23 to inputs 24a and 24b of the shift register halves. Data is read out serially from the register halves via outputs 25a and 25b, a data-out multiplex and buffer circuit 26, and a data-out terminal 27 (2b of FIG. 1). The data-out multiplex and buffer circuit 26 controls whether the data appears at the output terminal 27 in response to a control signal, Serial Output Enable (SOE), on control pin 28.

The shift register 20 is operated by a clock .phi. which is used to shift the bits through the stages of the register, two stages for each clock cycle. For read operations it takes only 128 cycles of the clock .phi. to output 256 bits from the 256 bit positions of the split shift register. However, according to the invention, the bit of data in the first shift register stage (i.e. the first stage to have its data bit shifted to the output) is also present on the output terminal 27 in response to a row address strobe (RAS) signal. A control signal TR 29 applied to the transfer gates 21a and 21b connects each of the 256 bit positions of the shift register to its corresponding column line in the array halves 10a and 10b. This same control signal TR 29 performs the additional function of controlling the availability of selected random data on the random output terminal 19b (See FIG. 3), as discussed later herein. This allows for multiplexing both the data input and output busses with the address bus to reduce interconnecting circuitry in a video computer system and the like, and thereby reduce costs for such a system and improve its reliability.

In a serial write operation, the sense amplifiers 11 are operated by a write command, W, occuring after TR to set the column lines at a full logic level, after which one row line is selected by the address in the latches 14 and the data forced into the memory cells of this row. A serial read cycle starts with an address on the input 15 which is decoded to activate one of the 256 X or row address lines (and a dummy cell on the opposite side). The sense amplifiers 11 are then actuated by a control signal from clock generator and control circuitry 30 to force the column lines to a full logic level, and then the transfer gates 21a and 21b are actuated by control signal TR to move the 256 bits from the selected row into the corresponding shift register 20 halves. The shift clock signal .phi. is then applied and may move the 256 bits onto the output pin 27 in serial format via the multiplex circuit 26 when SOE is low, at two stages or bits per clock cycle, requiring 128 clock cycles for the entire register. Again, the first bit of data is also on the output pin 27 as well as the first stage of the shift register 20. The output pin 27 is connected to the video input 2 of FIG. 1.

The memory device is thus similar to a standard dynamic RAM with a bit-wide or other bit-size random access with a serial input and output; the 256-bit serial shift register 20, which provides the serial input and output, is further organized as four 64-bit shift registers. One, two, three or four 64-bit shift registers may be accessed depending upon which of the four "taps" along the 256-bit shift register is selected. Since the 256-bit shift register is split into two "halves", each 64-bit shift register is also split into halves. As shown in FIG. 2, one 64-bit shift register is top half 20a and bottom half 20b, a second 64-bit shift register is top half 20c and bottom half 20d, a third 64-bit shift register is top half 20e and bottom half 20f, and a fourth 64-bit shift register is top half 20g and bottom half 20h.

The tap selected determines whether one, two, three or all four 64-bit shift registers are accessed. The tap selected is determined by a two bit code applied to the two most significant column address inputs. The depiction in FIG. 2 is thus made of lines 17 from the column address latch 16 also inputting to the shift register 20 to select, via a binary code, the particular tap desired.

Referring now to FIG. 3, the selection of the tap and the operation of the four 64-bit shift registers may be clearly understood. The memory array 10 is there seen to be divided into four 64 column by 256 row arrays. The four sets of 64 columns correspond to the four 64-bit shift registers. It may also be clearly seen that this memory device operates as if it were two devices, i.e., a 256 rows by 256 columns, random access array 10, having an input 19a and output 19b, and an up to 256 by one array (i.e. the shift register 20) having a serial input 22 and serial output 27. It also clearly depicts the control signal SOE is capable of blocking data from serial output 27. This device allows access to the random array while serial data is being clocked into or out of one, two, three or four of the 64-bit shift registers. The register or tap decoder 31 of FIG. 3 may be of conventional construction. Further, once the tap is selected, its corresponding first bit of data is also available at serial output 27, when SOE is low, as described hereinbefore. In this manner any bit of data may be accessed in 64 shifts or less, rather than 256 shifts. This may be of particular importance in other specific video applications.

Again, the tap selected is determined by a binary code, as illustrated in FIG. 3, which is applied to the two most significant column address inputs 15. These inputs feed into the tap or register decoder 31 as shown in FIG. 3, to determine whether one, or two, or three or all four registers are accessed.

For example, if the two bits are both 0, then all 256 bits in the shift register may be shifted out. If the two bits are 01, then 192 bits, starting at bit 64, may be shifted out. If the two bits are 10, then 128 bits, starting at bit 128, may be shifted out. The two bit code 11, selects the last 64 bits starting at bit number 192 and then these last 64 bits may be shifted out. Similarly, the tap address bits may be used for shifting data into the selected portion of the shift register.

In general, the number of bit positions between any two adjacent taps is a power of 2 that is less than and a different power of 2 from that power of 2 which equals the number of bit positions in the shift position. Further, these taps may be used in 512 rows by 512 columns or 1024 rows by 1024 columns, or larger devices having corresponding 512-bit or 1024-bit or larger shift registers in the manner described hereinbefore. Larger numbers of taps than four taps, will correspondingly require a larger decoder and more inputs into the decoder via the most significant column address lines, and conversely for fewer than four taps.

By use of these "taps" along the shift register it is possible to manufacture a 1024 rows by 1024 column (1 M-bit) device that may be used with many different CRT screens, i.e., screens of various sizes (525 lines by 512 pixels per line, or 300 lines by 720 pixels per line), by merely employing the appropriate taps along the shift register of the device. Thus, all 1024 bits do not have to be shifted out of the register to obtain the desired data bits at the "end" of the register. Further, the taps could be located at bit positions of the register corresponding to the number of pixels per line in a "standard" CRT that does not correspond to a power of 2 position as described hereinabove.

Referring now to FIGS. 2 and 4, the X or row address must appear on the inputs 15 when a row address strobe RAS, seen in FIG. 4a, is applied to a control input 28. A column address strobe CAS, as seen in FIG. 4k, and a read/write control W as seen in FIGS. 4b, 4n and 4p are other controls 28 that may be employed during random access to the device.

These external control inputs 28 are applied to clock generator and control circuitry 30 which generates a number of clocks and internal chip control signals to control the operation of various parts of the device. For example, when RAS goes low as seen in FIG. 4a, clocks derived from RAS cause the buffers 14 to accept and latch the eight row address bits then appearing on the input lines 15. The row address must be valid during the time period shown in FIG. 4c, i.e. during the falling edge of RAS. Serial access is one of the functions of the device controlled by a TR command on control input 29. For a serial read operation, TR goes to active-low and the W signal is held high during the period seen in FIG. 4b, and the data output on the serial output terminal 27 will occur during the time period of 128 cycles seen in FIG. 4d, when SOE is held low as seen in FIG. 4i. Further, in accordance with the invention, the data bit in the first stage of the selected register appears on the serial output terminal 27, as seen in FIG. 4d, in response to a RAS signal (FIG. 4a) but before a full cycle or half cycle of the clock .phi. (FIG. 4f) has occurred. This allows serial output 27 to be connected to the serial input 22 of a following device 5. Further, this early appearance of the first data bit on the serial output terminal 27 allows the external circuitry (including the microprocessor 8) a full clock cycle to allow manipulation of the serial data. Conventional devices require the first clock cycle to shift the first data bit from the first stage of the register to the output terminal and thereby prevent any such manipulation of data. This manipulation of data may be advantageous to certain video applications or systems. For a serial write operation, the TR and W signal must both be active-low as also seen in FIG. 4b and the data-in bits must be valid during the preceeding time period of 128 cycles seen in FIG. 4e.

Refresh occurs every time a row address appears on the inputs 15 and RAS goes low, as seen in FIG. 4a and 4c. Thus, during the 128 cycles when all four shift register halves are being read out through serial data-out pin 27, refresh can be occurring by loading a new row address into the chip 5 along with a RAS signal. The shift register is not disturbed so long as TR does not occur in coincidence with a RAS signal as described hereinabove. Serial data can be shifted into the register halves while data is being shifted out, and so a write operation can begin just after a read operation is initiated; although not needed in the system of FIG. 1, this feature is important for some other embodiments.

Parallel or random access occurs as illustrated in the timing diagram of FIGS. 4j-4r; note that these Figures are on an expanded time scale compared to FIGS. 4a-4i. The X or row address must appear on the inputs 15 when a row address strobe signal RAS is applied to an input 28. Likewise, the Y or column address must appear during a column address strobe signal CAS on other input 28. A read/write control W on an input 28 is the other control signal for the parallel or random access. When RAS goes low as seen in FIG. 4j, clocks derived from RAS cause the buffers 14 to accept and latch the eight row address TTL-level bits then appearing on the input lines 15.

When CAS goes low as seen in FIG. 4k then clocks generated in the circuitry 30 cause the buffers 16 to latch the TTL-level column (or Y) address signals on the inputs 15. The row and column addresses must be valid during the time periods shown in FIG. 4m.

For a read cycle, the W signal on input 28 must be high during the period seen in FIG. 4n, and the output on the terminal 19 (see FIG. 4o) in response to the TR signal 29 being low as seen in FIG. 4p. Again, this allows one control signal TR 29 to first select the operation of the device as either serial or random, and second to control the application of the selected data to the random output terminal when the device is in the random mode. This allows one control pin to perform two control functions and thereby minimize the need for addition pins for the device. Minimizing pin count in turn reduces the cost of the device and improves the reliability of the device; reliability decreases and cost increases as the number of pins increase because of the need to make additional connections from the silicon chip to its lead case terminals. Reliability further decreases with increased numbers of pins because as the numbers of pins increase the silicon chip size increases, which increases the probability of manufacturing a defective chip from dust particles on the chip. For a write-only cycle, the W signal must be low as seen in FIG. 4q and the input must be valid on terminal 19 during the time seen in FIG. 4r.

The memory device also may operate in a page-mode format. That is, the row address is kept the same and successive column addresses are strobed onto the chip. By holding the row address the same, the time requried to set up and strobe a new row address for the same page is eliminated and thus the time required for a page-mode operation is less than for a bit-mode format, as described hereinbefore. Typically, for the example device, a bit-mode operation requires about 260 nsec, where as a page-mode operation requires only about 160 nsec.

Further, the shift register 20 may be employed to rapidly read data into the array 10. This may be accomplished by the microcomputer 8 generating the selected data bits and shifting these data bits serially into the shift register 20. These data bits are then written into one of the rows selected by the microcomputer 8 using an eight-bit row address signal and the row address strobe (RAS) control signal as discussed hereinbelow. The data bits are then written into a second row selected by the microcomputer 8. This process of writing the data into rows continues until all of the rows contain the selected data bits.

This sequential writing of data from the shift register into all of the rows of the memory array is a particularly suitable process for initializing the data in the memory array to a known value (generally a "zero"). This process is useful for "powering up" the system to ensure only known data is read out of the array onto the CRT screen.

A modification of this process is for the microcomputer 8 to write the data into the individual cells of a selected row via a page-mode or bit-mode operation, and then transfer this data to the shift register. Once in the shift register it can then be sequentially written into the other rows as described hereinabove.

Either the modified or unmodified process allow for a much faster "clearing" or initialization of the memory array on "power-up", or as otherwise needed. This results from the writing of the data into a whole row of the array instead of the conventional process of writing the data into each individual cell, or each "cluster" of cells if in a byte or other bit-size system. The process is thus much faster than the conventional process for clearing the memory array.

The serial access via terminals 22 azd 27 and shift register 20 is usually sequential in that the row address is incremented by one following each access. The video data is continuous stream of 256-bit serial blocks, one after the other, so the next address for serial access, after the memory to shift register transfer occurs, will generally be the last row address plus one. In the simplest embodiment, the microcomputer 8 sends out the row addresses for serial read, so an address counter in the microcomputer 8 will be incremented after each serial read is commanded. However, this function may also be performed by special circuitry on the chip of FIG. 2. In contrast, the parallel access via terminal 19 is random rather than sequential and specific row and column addresses must be generated in the microcomputer 8.

Thus, the timing of the TR, W, CAS and RAS signals is different for serial reads and writes, and random reads and writes. The voltages and timing of these control signals are seen in FIGS. 4a-4i for serial operations and 4j-4r for random operations. To load the shift register or transfer its contents into the array, TR must be low during the falling edge of RAS. If W is held high during the falling edge of RAS then data in the columns of the selected row will be shifted into the register by the transfer gates 21. The two bit tap address, see FIG. 4h, appearing on the most significant column address lines when CAS goes low, see FIG. 4g, determines which of the four cascaded 64-bit shift registers will be connected to serial output 27.

The serial shift clock .phi., FIG. 4f, then shifts the data out of the shift register at the desired data rate in response to the frequency of the clock .phi., when SOE is low as seen in FIG. 4i. If W is held low during the falling edge of RAS, then data is transferred from the shift register to the array columns and into the row selected by the row address bits. If TR is held high when RAS falls low then the shift register and array operate independent of each other i.e., the shit register may shift data out or in and the array is available for random access. Further, while in the random mode, the TR signal controls the timing of the appearance of the selected data on the random output terminal. This allows for multiplexing of the data and addresses busses to reduce costs and improve reliability of a computer video system.

Thus the timing of W is different in the random access mode and the serial mode of operation of the memory device. More specifically, W is set up and held relative to the falling edge of CAS during a random access operation. However, W is set up and held relative to the falling edge of RAS during a serial access operation.

Referring to FIG. 5, a microcomputer which may be used with the system of the invention may include a single-chip microcomputer device 8 of conventional construction, along with additional off-chip program or data memory 80 (if needed), and various peripheral input/output devices 81, all interconnected by an address/data bus 7, and a control bus 9.

A single bidirectional multiplexed address/data bus 7 is shown, but instead separate address and data busses may be used, and also the program addresses and data or input and output addresses may be separated on the external busses; the microcomputer may be of the Von Neumann architecture, or of the Harvard type or a combination of the two.

The microcomputer 8 could be one of the devices marketed by Texas Instruments under the part number of TMS 7000, for example, or one of the devices commercially available under part numbers Motorola 6805, Zilog Z8 or Intel 8051, or the like. These devices, while varying in details of internal construction, generally include an on-chip ROM or read-only memory 82 for program storage, but also may have program addresses available off-chip, but in any event have off-chip data access for the memory 5.

A typical microcomputer 8, as illustrated in FIG. 5, may contain a RAM or random access read/write memory 83 for data and address storage, an ALU 84 for executing arithmetic or logic operations, and an internal data and program bus arrangement 85 for transferring data and program addresses from one location to another (usually consisting of several separate busses). Instructions stored in the ROM 82 are loaded one at a time into an instruction register 87 from which an instruction is decoded in control circuitry 88 to produce controls 89 to define the microcomputer operation.

The ROM 82 is addressed by a program counter 90, which may be self-incrementing or may be incremented by passing its contents through the ALU 84. A stack 91 is included to store the contents of the program counter upon interrupt or subroutine. The ALU has two inputs 92 and 93, one of which has one or more temporary storage registers 94 loaded from the data bus 85.

An accumulator 95 receives the ALU output, and the accumulator output is connected by the bus 85 to its ultimate destination such as the RAM 83 or a data input/output register and buffer 96. Interrupts are handled by an interrupt control 97 which has one or more off-chip connections via the control bus 9 for interrupt request, interrupt acknowledge, interrupt priority code, and the like, depending upon the complexity of the microcomputer device 8 and the system.

A reset input may also be treated as an interrupt. A status register 98 associated with the ALU 84 and the interrupt control 87 is included for temporarily storing status bits such as zero, carry, overflow, etc., all ALU operations; upon interrupt the status bits are saved in RAM 83 or in a stack for this purpose.

The memory addresses are coupled off-chip through the buffers 96 connected to the external bus 7 depending upon the particular system and its complexity. This path may be employed for addressing off-chip data or program memory 80 and input/output 81 in addition to off-chip video memory 5. These addresses to bus 7 may originate in RAM 83, accumulator 95 or instruction register 87, as well as program counter 90. A memory control circuit 99 generates (in response to control bits 89), or responds to, the commands to or from the control bus 9 for address strobe, memory enable, write enable, hold, chip select, etc., as may be appropriate.

In operation, the microcomputer device 8 executes a program instruction in one or a sequence of machine cycles or state times. A machine cycle may be 200 nsec., for example, by an output from a 5 MHz crystal clock applied to the microcomputer chip. So, in successive machine cycles or states, the program counter 90 is incremented to produce a new address, this address is applied to the ROM 82 to produce an output to the instruction register 87 which is then decoded in the control circuitry 88 to generate a sequence of sets of microde control bits 89 to implement the various steps needed for loading the bus 85 and the various registers 94, 95, 96, 98, etc.

For example, a typical ALU arithmetic or logic operation would include loading addresses (fields of the instruction word) from instruction register 87 via bus 85 to addressing circuitry for the RAM 83 (this may include only source address or both source and destination addresses). Such an operation may also include transferring the addressed data words from the RAM 83 to a temporary register 94 and/or to the input 92 of the ALU. Microcode bits 89 would define the ALU operation as one of the types available in the instruction set, such as add, subtract, compare, and, or, exclusive or, etc. The status register 98 is set dependent upon the data and ALU operation, and the ALU result is loaded into the accumulator 95.

As another example, a data output instruction may include transferring a RAM address from a field in the instruction to the RAM 83 via bus 85, transferring this addressed data from the RAM 83 via bus 85 to the output buffer 96 and thus out onto the external address/data bus 7. Certain control outputs may be produced by memory control 99 on lines of the control bus 9 such as write enable, etc. The address for this data output could be an address on the bus 7 via buffer 96 in a previous cycle where it is latched in the memory 80 or memory 5 by an address strobe output from the memory control 99 to the control bus 9.

An external memory controller device may be used to generate the RAS and CAS strobes. A two-byte address for the memory 5 would be applied to the bus 7 in two machine cycles if the bus 7 is 8-bit, or in one cycle if the bus is 16-bit.

The instruction set of the microcomputer 8 includes instructions for reading from or writing into video memory 5, the additional memory 80 or the input/output ports of peripheral equipment 81, with the internal source or destination being the RAM 83, program counter 90, temporary registers 94, instruction register 87, etc. In a microcoded processor each such operation involves a sequence of states during which addresses and data are transferred on internal bus 85 and external bus 7.

Alternatively, the invention may use a microcomputer 8 of the non-microcoded type in which an instruction is executed in one machine state time. What is necessary in selecting the microcomputer 8 is that the data and addresses, and various memory controls, be available off-chip, and that the data-handling rate be adequate to generate and update the video data within the time constraints of the particular video application.

The video memory arrangement of the invention is described in terms of one bit data paths for the bus 7, although it is understood that the microcomputer system and the memory technique is useful in either 8-bit or 16-bit systems, or other architectures such as 24-bit or 32-bit. One utility is in a small system of the type having 8-bit data paths and 12-bit to 16-bit addressing, in which no external memory 80 is needed and the peripheral circuitry 81 consists of merely a keyboard or like interface, plus perhaps a disc drive. A bus interface chip such as an IEEE 488 type of device could be included in the peripheral circuitry 81, for example.

As illustrated in FIG. 6, the video memory 5 may be configured as eight x1 memory devices, or alternatively as one x8 device. In this embodiment eight semiconductor chip memories 5 are used, all eight being 64Kx1 or perhaps 16Kx1, each having corresponding on-chip multiple shift registers for serial access as in FIG. 2, with one bit wide input and output. For a full color television display 1, using 8-bits per tri-color dot, a memory system consisting of four banks (eight chips per bank) of 64kx1 memory devices would be required. Each line on the screen would use two 256-bit registers, clocked out one following the other, for each of eight video signal input lines 2 (instead of only one video data input 2 as shown).

The microprocessor 8 and bus 7 would access the 8-bit video data in parallel in a "x1" format on each chip by the eight data lines 6, one for each chip, as seen in FIG. 6. The address inputs 15 for all eight chips receive the same addresses from the bus 7, and all eight chips receive the same control inputs from bus 9. The eight serial outputs 27, one from each chip, are connected to respective bit positions of an eight-bit shift register 127.

The serial clock .phi. is divided by eight before application to the eight chips 5; the clock .phi. applied to the serial register 127 thus shifts out eight bits onto the video signal input line 2 and then another eight bits are loaded into register 127 from the shift registers 20 on the individual chips. Alternatively, instead of using the auxiliary shift register 127, the eight outputs 27 can be connected to eight parallel video signal inputs of the color TV.

For some video systems the serial data input 22 of FIG. 2 may be employed. The serial input may be video data from a receiver or a video tape playback mechanism 105 shown in FIG. 7 supplying a continuous serial video feed on line 106 to the input 22 of a chip as in FIG. 2. This incoming video data is written into the cell array 10 from the serial register 20, and while in the RAM array it is processed by the microcomputer 8 using the parallel access port 19, and then supplied to the video signal line 2 via the register 20 and the terminal 27. The invention may be particularly useful in this embodiment as it allows the microprocessor 8 additional time to manipulate the video data, if required.

An example of one use of this arrangement is to add text or graphics via the microcomputer on top of video supplied from the video receiver or tape recorder 105. Another example would be to enhance or correct the video from receiver or tape 105 by writing it serially into the array 10; reading the data out in parallel to store bits temporarily in the RAM 83 of the microcomputer, performing operations via the ALU 84, then writing the corrected data back into the array 10 via bus 7, from whence it is read out serially onto the video signal input 2. For this example the TR signal may be used to block the selected random data from the data bus until the microcomputer 8 is prepared to receive the data; this may become necessary when the microcomputer receives an interrupt signal in the midst of reading the video data.

The system allows for the desired portion of the register 20 to be serially loaded at the same time it is being serially read; that is, data-in and data-out overlap as seen in FIGS. 4d and 4e. During the 128, or fewer, clock cycles used for serial-in and serial-out, the array 10 can also be accessed in parallel by microcomputer 8 for the writeover, update or correction operation.

The semiconductor memory chip containing the array 10 may also include a conventional row address counter which generates an 8-bit 1-of-256 row address for coupling to the input of the row decoders 12 by multiplex circuitry, so the row decoder can accept an address from either the address input terminals 15 via buffers 14 or from the counter. This counter may be self-incrementing so that a count of one is added to the existing count whenever an input signal INC is received.

The counter may function as an on-chip refresh address generator as set forth in U.S. Pat. Nos. 4,207,618 and 4,344,157, or as indicated in U.S. Pat. No. 4,333,167. A column address is not needed for refresh. When a row is addressed for serial-read or serial-write, this also refreshes the data in this row; likewise, a parallel access refreshes a row upon read or write. Thus, if the video data is being sampled via serial read at the usual rates needed for TV scan then each row is not addressed within the 4 msec refresh period (60 frames/second is about 17 msec between successive samplings).

During the time between serial reads, the microcomputer 8 will probably, but not necessarily, access all rows of parallel read or write often enough for refresh. Thus, the microcomputer program in the ROM 82 could include a counter loop to send out an incremented row address and RAS as some fixed rate to assure that the refresh address specifications are met. However, to avoid occupying the microcomputer program execution with refresh overload, the counter on the chip may provide the address on-chip, and the microcomputer 8 need only apply the RAS control. That is, upon receipt of RAS and no CAS, with W and TR high, the multiplex is switched to apply the contents of the counter to the row decoder 12, and W is activated to refresh a row; no serial or parallel data in or out is initiated.

An INC command (not shown) may be produced to increment the counter for the next refresh. Further, an on-chip refresh signal may be generated on-chip from a timer, as in U.S. Pat. No. 4,344,157, for example. The timer produces a refresh command at least once every (4 msec.).times.(1/256)=16 microsec. This refresh command activates the input multiplexer, W and Inc just as the off-chip refresh request previously discussed.

The serial input and output via register 20, in most uses such as video, will require access to sequential rows. Thus, an on-chip 8-bit 1-of-256 counter may be employed to avoid the necessity of applying a row address from the microcomputer 8 for serial access. If the sampling rate is high enough, this may be the same as the refresh counter; i.e., only one counter is needed as no separate provision for refresh is necessary.

In particular, these on-chip counters may be used to allow the microcomputer 8 to conduct other operations than "clearing" the memory array upon "power-up". That is, the microcomputer 8 need only shift the data into the shift register and then strobe the chip 5 with RAS, TR, W and INC signals to allow the on-chip counters to sequentially address each row in the array, to minimize occupying the microcomputer program execution with clearing overload.

Referring now to FIG. 8, a relatively complete video graphics subsystem employing the video memory 5 of the present invention, and a memory and graphics controller 40 is depicted. The memory and graphics controller 40 would replace the conventional separate controllers needed for the video and main system memories and it may also be designed to generate the synchronization and blanking signals that are required by the display circuitry.

Each horizontal display scan is made up of an active display scan, during which data is sent out, and a retrace scan, when no data is required. During the retrace scan the shift registers 20 of the present invention may be reloaded from the memory array 10. The memory and graphics controller 40 could be designed with counters to keep track of the pixel and line position on the screen so that the proper address and reloading information can be sent to the device automatically during the retrace period. This controller could also be designed with enough intelligence to handle interlaced or non-interlaced displays.

The use of a device of this invention with such a graphics controller reduces the amount of external circuitry needed to control the video memory 5 and simplifies the signals the host processor 8 must generate to control the video display. Further, use of larger volume storage devices allows the use of a "standard" package of a graphics controller and video memory of use for CRT screens of varying sizes and resolutions.

The graphics controller 40 could also be designed to "clear" the video memory power upon "power-up" by generating each row address, after receiving the "clearing" data bits from the host processor 8, or could employ on-chip counters as described hereinbefore.

The shift clock .phi. may be generated separate from the microcomputer 8. Note that serial access and parallel access to the array 10 via register 20 and line 19 may be asynchronous; that is, the .phi. generator need not be synchronized with the clock of the microcomputer 8, but instead may be synchronized with the video display 1 of FIG. 1 or the video signal 106 from receiver 105 of FIG. 7.

A system that advantageously utilizes these features is the embodiment of FIG. 7, with serial input is an interactive home TV adapted for games, education use or catalog ordering, as examples. That is, a video background is fed into serial input 22 from cable or VCR, and the user superimposes his input via microcomputer 8 (employing a keyboard, joystick, or the like coupled via input/output 81), and the resulting composite video is applied to the screen 1 via line 2. This same video data, or alternatively only the variable added data, may be retransmitted via cable or rf to the originator for applications such as catalog ordering, bank-by-cable, educational test scoring, etc.

In typical video applications, the transfer of data from the array into the shift register occurs during the blanked (no data) retrace period. For a high resolution non-interlaced 1024 lines by 1024 pixels per line, simple black and white CRT screen, as depicted in FIG. 9, this will require sixteen of the 64K devices in parallel, as depicted in FIG. 10. For most applications the devices' shift registers 20 will feed their output in parallel into a main video shift register 127 which clocks the data out at the dot or pixel clock speed, i.e. cursor sweep speed.

For the CRT of FIG. 9 the noninterlaced pixel sweep speed or dot clock rate is 12 nsec. However, the video memories of FIG. 10 transfer their outputs to the main shift register 127 once every 16 dot clock cycles and the video memories therefore shift their data every 192 nsec, which is much slower than shift register speed of the device, which is about 40 nsec. Sixteen devices are selected to be used so that a standard 16 line address and memory bus, as well as 16 bit microcompressor may be employed. However, this arrangement simplifies the controller circuitry and reduces the display memory to only sixteen parts while ensuring compatability with a 16-bit processor. Further, by employing TR to control the release of random output data the data 6 and address 15 busses may be multiplexed to reduce circuitry and costs. Although for data storage requirements, only 4 of these 64k devices in a by 4 mode could be used, or larger volume devices in various modes could also be used.

For a 512 lines by 512 pixels per line, four plane color system, the CRT is depicted in FIG. 11, and the arrangement of the memory devices in FIG. 12 and the correspondance of planes to pixels in FIG. 13. FIGS. 11, 12 and 13 depict a bit-mapped raster scan color graphics medium resolution system for a 512 lines by 512 pixels per line which requires 4 bits per pixel to obtain 16 color choices. The sixteen video memory devices 5 are organized as four banks or planes of four cascaded chips, with each bank or plane linked to an external 4-bit shift register 127.

On every shift out operation, the registers 127 supply one bit of the 4-bit combination necessary to describe the color of the corresponding pixel. These 4-bit words are then sent to a color look up table or other video circuitry. To do the proper pixel mappings the host processor's data bus, which sends information to the storage devices, must be reorganized to make sure that the 4-bits, coming out of the external 4-bit shift registers, correspond to the same pixel. Also note that the cycle times of the devices on-chip shift registers increases by a factor of four, since the 4-bit external shift registers must be reloaded every 4 pixel clock intervals, rather than the 16 pixel clock intervals of FIGS. 9 and 10. However, this speed is still within the speed limitations of the on-chip shift register.

The concepts of the invention are useful in communications systems other than video. For example, multiplexed voice (telephone) or digital data is transmitted serially at very high bit rates via microwave or fiber optic transmission channels. This data is similar in format to the serial video data in line 2 or line 106 in FIG. 7. Accordingly, the memory device 5 as described above is very useful in processing this type of data. The data is written into the memory 5 from the communications link by the serial, sequentially-addressed (auto increment) port, and/or read from the memory 5 to the communications link by this port. That is, the memory 5 and microcomputer 8 can be part of a receiver, a transmitter, a relay station, or a transceiver. Once in the array 10 of the memory 5, the data is accessed in parallel or random fashion by the microcomputer 8 for utilization by D-to-A or A-to-D converters for telephone systems, by error detection and correction algorithms, demultiplexing or multiplexing various channels, station-select, encrypting or decoding, conversation to formats for local area networks, and the like. Again, employing a device with this early serial data output may allow the microcomputer 8 additional time to manipulate serial data in such systems.

Another use of the concepts of the invention is in a microcomputer system employing a magnetic disc for bulk storage. For example, the so-called Winchester disc provides several megabytes of storage which is accessed serially at bit rates of many megabits/second, similar to the video data rates of FIG. 7. Programs can be downloaded from disc to memory 5 in large blocks of 64k-bytes or 128k-bytes, then the microcomputer executes from the memory until a given task is completed or interrupted. The contents of memory 5 can be read out and sent to the disc storage via line 2 while another block is being written into memory 5 via input 22. The concepts of the invention also allow for manipulation of early serial data in these systems.

While this invention has been described with reference to illustrative embodiments, this description is not intended to be construed in a limiting sense. Various modifications of the illustrative embodiments, as well as other embodiments of the invention, will be apparent to persons skilled in the art upon reference to this description. It is therefore contemplated that the appended claims will cover any such modifications or embodiments as fall within the true scope of the invention.

## Claims

1. A dual-port memory device, comprising: for addressing a memory cell in said array; the memory cell addressed by said addressing means; addressed by said addressing means to said data output terminal; contents of a plurality of memory cells in said array into memory cells in said register, said transfer occurring responsive to a transfer signal received by said transfer control terminal; said serial output terminal, for communicating to said serial output terminal the contents of said memory cell in said register connected thereto; and for shifting the contents of another memory cell in said register to said serial output means so that, responsive to a series of said shift signals received by said serial clock terminal, the contents of a series of memory cells in said register are communicated to said serial output terminal; plurality of memory cells in said array are transferred into said register, so that said random input means and said random output means may write and present, respectively, the contents of memory cells in said array addressed by said addressing means independently from said serial output means communicating the contents of a series of said memory cells in said register to said serial output terminal; memory cell in said register connected thereto to said serial output means after a transfer by said transfer means and prior to the first shift signal received by said serial clock means after said transfer by said transfer means.

2. The memory device of claim 1, wherein said array of memory cells is arranged in rows and columns; address terminals, for addressing a row of said array; said address terminals, for addressing a column of said array.

3. The memory device of claim 2, wherein said transferring means, responsive to the addressing of a row by said row addressing means, transfers the contents of a plurality of memory cells in said addressed row to said memory cells in said register.

4. The memory device of claim 3, further comprising a clock terminal; said clock terminal so that the signals present on said address terminals at the time said clock signal is received by said clock terminal constitute said row address signal; received by said clock terminal, so that the contents of said memory cell connected to said serial output means are presented to said serial output terminal responsive to said clock signal being received by said clock terminal subsequent to said transfer signal being received by said transfer control terminal, and prior to the first shift signal being received by said serial clock terminal after said transfer by said transfer means.

5. The memory device of claim 1, wherein said serial output means is connected to a selected memory cell in said register; terminals, for selecting the memory cell in said register to be connected to said serial output means.

6. The memory device of claim 1, further comprising: said serial input terminal, for writing data received by said serial input terminal into the contents of the memory cell in said register connected thereto; of the memory cells in said register into a plurality of memory cells in said array.

7. The memory device of claim 1, wherein the memory cells in said register are serially connected to one another; in said register, and shifts the contents of another memory cell to said serial output means by shifting the contents from each memory cell in said register to the memory cell connected next in series thereto.

8. The memory device of claim 7, further comprising: said serial input terminal, for writing data received by said serial input terminal into the contents of the memory cell in said register connected thereto; of the memory cells in said register into a plurality of memory cells in said array.

9. A data processing system, comprising: control signals, and address signals; said microprocessor; and means comprising: said bus means, for addressing a memory cell in said array; on said bus means to the memory cell addressed by said addressing means; cell addressed by said addressing means; contents of a plurality of memory cells in said array into memory cells in said register, said transfer occurring responsive to a transfer control signal presented by said microprocessor on said bus means; said serial input of said utilization means, for communicating to said utilization means the contents of said memory cell in said register connected thereto; and the contents of another memory cell in said register to said serial output means so that, responsive to a series of said shift control signals, the contents of a series of memory cells in said register are communicated to said utilization means; plurality of memory cells in said array are transferred into said register, so that said microprocessor may write and read the contents of memory cells in said array corresponding to addresses it presents to said bus means, independently from said serial output means communicating the contents of a series of said memory cells in said register to said utilization means; memory cell in said register connected thereto to said utilization means after a transfer by said transfer means and prior to said shifting means receiving said shift control signal on said bus means.

10. The system of claim 9, wherein said microprocessor generates said shift control signal on said bus means.

11. The system of claim 9, further comprising: generator means coupled to said memory means and to said utilization means; responsive to said shift control signals.

12. The system of claim 9, wherein said array of memory cells is arranged in rows and columns; microprocessor on said bus means, for addressing a row of said array; said microprocessor on said bus means, for addressing a column of said array.

13. The system of claim 12, wherein said transferring means, responsive to the addressing of a row by said row addressing means, transfers the contents of a plurality of memory cells in said addressed row to said memory cells in said register.

14. The system of claim 13, wherein said microprocessor presents a strobe control signal on said bus means during such time as said microprocessor is presenting said row address signal on said bus means, said row addressing means of said memory means addressing a row responsive to said strobe control signal; strobe control signal, so that the contents of said memory cell connected to said serial output are presented to said utilization means responsive to said strobe control signal being presented by said microprocessor on said bus means subsequent to said transfer signal being presented by said microprocessor on said bus means, and prior to said shift control signal being received by said shifting means.

15. The system of claim 9, further comprising: processing by said microprocessor and for utilization by said utilization means; storage means and a memory cell in said register, for writing data received by said serial input terminal into the contents of the memory cell in said register connected thereto; transferring the contents of the memory cells in said register into a plurality of memory cells in said array.