Source: https://patents.google.com/patent/US20080168296A1/en
Timestamp: 2019-04-19 12:44:11+00:00

Document:
2008-07-08 Assigned to MOSAID TECHNOLOGIES INCORPORATED reassignment MOSAID TECHNOLOGIES INCORPORATED ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: KIM, JIN-KI, MR.
A system controller communicates with devices in a serial interconnection. The system controller sends a read command, a device address identifying a target device in the serial interconnection and a memory location. The target device responds to the read command to read data in the location identified by the memory location. Read data is provided as an output signal that is transmitted from a last device in the serial interconnection to a data receiver of the controller. The data receiver establishes acquisition instants relating to clocks in consideration of a total flow-through latency in the serial interconnection. Where each device has a clock synchronizer, a propagated clock signal through the serial interconnection is used for establishing the acquisition instants. The read data is latched in response to the established acquisition instants in consideration of the flow-through latency, valid data is latched in the data receiver.
This application claims the benefit of prior U.S. Provisional Patent Application No. 60/868,773 filed Dec. 6, 2006; and U.S. Provisional Patent Application No. 60/894,246, filed Mar. 12, 2007, the disclosures of which are expressly incorporated herein by reference in their entirety.
The present invention relates generally to a system including semiconductor devices and particularly to apparatus and method for communicating with a serial interconnection of a plurality of semiconductor devices.
Computer-based systems typically contain semiconductor devices, such as memory devices. The semiconductor devices are controlled by a controller, which may form part of the central processing unit (CPU) of the computer or may be separate therefrom. The controller has a data receiving apparatus as well as an interface for communicating information with the semiconductor devices. Known interfaces include parallel interfaces and serial interfaces.
Parallel interfaces use a large number of pins to read and write information. As the number of pins and wires increases, so do a number of undesired effects, including inter-symbol interference, signal skew and cross talk. These effects are exacerbated at high operating frequencies. When semiconductor devices are connected to one another via their interfaces in a point-to-point fashion, a serial interconnection of semiconductor devices may be formed.
According to a first broad aspect, the present invention provides a method for communicating with a serial interconnection including a plurality of series-connected semiconductor devices, the serial interconnection including a first device and a last device. The method comprises: supplying a clock signal for operation of the devices in the serial interconnection; sending first instruction information for identifying a target device in the serial interconnection; sending second instruction information for identifying operation of an identified target device to perform, the target device operating in accordance with the second instruction information to provide response data, the response data appearing in an output signal from the last device of the serial interconnection; providing an acquisition instant in relation to the clock signal; and receiving the output signal from the last device to capture the response data in response to the acquisition instant.
For example, in the method, the target device is identified by the first instruction information and is enabled. The enabled target device provides the response data that is to be contained in the output signal.
Advantageously, third instruction information may be sent. For example, the first instruction information is a device address, the second instruction information is an access command, and the third instruction information is a memory location. Advantageously, upon completion of the device address recognition, an identified device as a target device is enabled to read data in an identified location in the memory, so that read data is provided.
For example, an enable signal is sent to the serial interconnection to trigger release of the read data to a succeeding device and thus, the read data is propagated through the succeeding devices in the serial interconnection and provided from the last device in the serial interconnection.
Advantageously, in response to the clock signal, an acquisition instant is established. In response to the established acquisition instant, the read data from the last device in the serial interconnection is latched. For example, the establishing of the acquisition instant is performed in consideration of the flow-through latency of the serial interconnection. Thus, valid data is latched.
According to a second broad aspect, the present invention provides an apparatus for communicating with a serial interconnection including a plurality of series-connected semiconductor devices, the serial interconnection including a first device and a last device. The apparatus comprises: a controller for providing a clock signal for operation of the devices in the serial interconnection and for sending first and second instruction information to the serial interconnection, the first instruction information identifying a target device in the serial interconnection, the second information identifying operation of the target device to perform, the target device operating in accordance with the second instruction information to provide response data, the response data appearing in an output signal from the last device; and a receiver for receiving the output signal from the last device. The receiver includes: acquisition establishing circuitry for establishing an acquisition instant relating to the clock signal; and signal latching circuitry for latching the output signal at the acquisition instant to capture the response data.
According to a third broad aspect, the present invention provides an apparatus for use in processing signals received from a serial interconnection including a plurality of series-connected semiconductor devices, the serial interconnection including a fast device and a last device, wherein a given device in the serial interconnection is responsive to receipt of a command destined therefor to provide response data that appears in an output signal provided from the last device. The apparatus comprises: circuitry for establishing an acquisition instant in response to the command; and circuitry for latching the output signal at the acquisition instant to capture of the response data.
According to a fourth broad aspect, the present invention provides a method for use in processing signals received from a serial interconnection including a plurality of series-connected semiconductor devices, the serial interconnection including a first device and a last device, wherein a given device in the serial interconnection is responsive to receipt of a command destined therefor to provide response data that appears in an output signal provided from the last device. The method comprises: establishing an acquisition instant in response to the command; and latching the output signal in response to the acquisition instant to capture of the response data.
According to a fifth broad aspect, the present invention provides a system comprising: a serial interconnection including a plurality of series-connected semiconductor devices having a first device and a last device, each of the devices being responsive to receipt of a command destined therefor to provide response data that appears in an output signal provided from the last device; a controller configured to effect issuance of a command to the serial interconnection, the command being destined for a target device in the serial interconnection, the target device providing response data that appears in an output signal provided from the last device; and a receiver configured to establish an acquisition instant in response to the command and to latch the output signal in response to the acquisition instant to capture of the response data.
Advantageously, in the system, each of the devices includes a memory and the controller is capable of sending third instruction information to the serial interconnection, the third instruction information identifying a memory location in the memory. The target device reads data from a memory location in the memory identified by the third instruction information and provides the read data as the response data.
In accordance with an embodiment of the present invention, there is provided a system including a master device that communicates with a plurality of salve devices in a serial interconnection. Each of the devices has a slave controller and a memory. The master device includes an instruction transmitter and a data receiver. The instruction transmitter sends a read command, a device address identifying a target device in the serial interconnection and a memory location. An identified target device responds to the read command to read data in the location of the memory identified by the memory location. Read data is provided as an output signal that is transmitted from a last device in the serial interconnection to the data receiver of the master device. The data receiver establishes acquisition instants relating to clocks in consideration of a total flow-through latency in the serial interconnection. In the case where each of the devices has a clock synchronizer, a propagated clock signal through the devices of the serial interconnection is used for establishing the acquisition instants. The acquisition instants are established in consideration of the flow-through latency, valid read data is latched in the data receiver.
In accordance with an embodiment of the present invention, there is provided a system comprising: a serial interconnection wherein a plurality of semiconductor devices is series-connected. The semiconductor devices may be memory devices of one type or more of non-volatile and volatile memories, for example, NAND Flash EEPROM, NOR Flash EEPROM, AND Flash EEPROM, DiNOR Flash EEPROM, Serial Flash EEPROM, DRAM, SRAM, ROM, EPROM, FRAM, MRAM and PCM.
FIGS. 17A and 17B are timing diagrams illustrating the behaviour of various signals exchanged among the master device and the slave devices in the system of FIG. 15.
In the following detailed description of embodiments of the present invention, reference is made to the accompanying drawings which form a part hereof, and in which is shown by way of illustration of embodiments in which the present invention may be practiced. These embodiments are described in sufficient detail to enable those of ordinary skill in the art to practice the present invention, and it is to be understood that other embodiments may be utilized and that logical, electrical, and other changes may be made without departing from the scope of the present invention. The following detailed description is, therefore, not to be taken in a limiting sense, and the scope of the present invention is defined by the appended claims.
Generally, the present invention relates to a system including semiconductor devices and to apparatus and method for communicating with the devices. A plurality of semiconductor devices is connected in series to be configured in a serial interconnection. For example, two neighboring devices in the serial interconnection are interconnected by serial output of one device and serial input of the other device.
Examples of semiconductor devices contemplated herein include devices which perform actions in response to signals received at one or more input ports and wherein input data is captured at “acquisition instants” that depend on the behavior of a clock signal. For example, the semiconductor devices are semiconductor integrated circuit (IC) devices such as memory devices (including volatile and/or non-volatile memory devices), central processing units, graphics processing units, display controller ICs, disk drive ICs, solid state drives. As far as memory devices are concerned, these may be of a type such as NAND Flash EEPROM, NOR Flash EEPROM, AND Flash EEPROM, DiNOR Flash EEPROM, Serial Flash EEPROM, dynamic random access memory (DRAM), static random access memory (SRAM), ROM, EPROM, FRAM, magnetoresistive random access memory (MRAM) and Phase Change Memory (PCM) (or Phase Change RAM (PCRAM)), to name a few non-limiting possibilities.
Ser. No. 11/606,407, filed Nov. 29, 2006.
Ser. No. 11/771,241 filed Jun. 29, 2007.
In a serial interconnection of semiconductor devices, one of the devices (e.g., a “target” device) responds to a given instruction and provides response data that is expected to be received by a data receiver connected to a last device in the serial interconnection. Each of the devices has an input-to-output latency and it causes the response data to undergo a delay before being received by the data receiver. This delay is based on a function of various factors, including, among others, the number of devices remaining in the serial interconnection after the target device, the type of devices, and their operating properties (e.g., temperature). As a result, in some implementations, the delay may be unknown and even time-varying.
Without knowledge of the delay undergone by response data through the serial interconnection, it may become impossible for the data receiver to distinguish whether the signal ultimately received from the last device in the serial interconnection contains valid data sent by the target device or invalid data. Data errors, such as resulting from an incorrect data read operation from memory, may therefore occur. The incidence of such errors rises, as the number of series-connected devices becomes greater and their operating frequency becomes higher.
Embodiments of the present invention including a plurality of semiconductor devices will now be described, each of the devices having a memory to which a data access can be performed.
FIG. 1A shows a system according to an embodiment of the present invention, the system including a system controller and a serial interconnection of a plurality of devices in communication with the system controller. In the illustrated example, a system controller 102 communicates with a serial interconnection of N devices that are series-connected. The serial interconnection includes a “first” semiconductor device 104-0, - - - , a j−1th semiconductor device 104-j−1, a jth semiconductor device 104-j, a j+1th semiconductor device 104-j+1, - - - and a “last” (Nth) semiconductor device 104-N-1, N being an integer, where 0≦j≦N-1. The semiconductor devices 104-0 - - - N-1 can be semiconductor devices, for example, such as memory devices. In the case where the semiconductor devices 104-0 - - - N-1 are memory devices, the system controller 102 is implemented as a memory controller. It should be understood that the system controller 102 can itself be a semiconductor device.
In the system shown in FIG. 1A, during an initialization procedure, the devices of the serial interconnection are assigned by device addresses or device identifiers by the system controller 102. For example, devices addresses of consecutive numbers from low to high are generated and assigned to the devices 104-0 - - - 104-N-1. Each of the devices 104-0 - - - 104-N-1 has its own address register (not shown) and the address register holds the assigned device address. After the device addresses are assigned to the devices 104-0 - - - 104-N-1, the system controller 102 sends an access command and other information to control operations of the devices of the serial interconnection to the first device 104-0 thereof, the operation including, for example, device address recognition and data processing. One of the data processing is to access a memory (not shown) included in each of the devices. For example, in the case of an access command being a write command, provided data is written into the memory of the target (or destined) device in accordance with the device address. In the case of an access command being a read command, the data of the memory is read in accordance with the memory address and the read data is transmitted to another device and forwarded to the system controller 102. Examples of the device address assignment, the device address recognition and the data accessing are provided in U.S. Provisional Patent Application No. 60/787,710, filed Mar. 28, 2006; U.S. Provisional Patent Application No. 60/802,645, filed May 23, 2006; and U.S. Provisional Patent Application No. 60/868,773 filed Dec. 6, 2006, the contents of which are entirely incorporated herein by reference.
In the system of FIG. 1A, the system controller 102 is hereinafter referred to as a “master device”, while the devices 104-0 - - - N-1 are hereinafter referred to as “slave devices”. In the particular example, the devices 104-0 - - - N-1 have the same configuration. The operations of the serially interconnected devices are synchronized with clocks (not shown) provided thereto by the master device 102. For example, the clocks provided by either a common clock fashion or a clock transfer fashion, as described later.
FIG. 1B shows details of one of the devices of FIG. 1A. Referring to FIGS. 1A and 1B, the master device 102 is in communication with the slave device 104-j, which is also in communication with a succeeding device. Where j<N-1, the succeeding device is next slave device 104-j+1. Where j=N-1, the succeeding device is the master device 102. Where j=0, the slave device is the first device 104-0 and the master device 102 directly communicate with the first device 104-0. Where j≠0, the master device 102 communicates indirectly with the slave device.
The present device 104-j includes a slave controller 106, a memory array 108, and an interface comprising a plurality of input ports and output ports. The slave controller 106 is responsive to signals received from the master device 102 via the input ports of the interface of slave device 104-j. In the illustrated example, the slave controller 106 performs various control and processing functions with access to the memory array 108 in response to signals arriving via the input ports, and provides signals to the succeeding device via the output ports of the slave device 104-j. As mentioned above, the succeeding device can be another slave device or the master device 102, for example, depending on the relative position of slave device 104-j within the serial interconnection.
To be more specific, the interface of slave device 104-j includes a serial input port (hereinafter, the “SIP-j port”) and a serial output port (hereinafter, the “SOP-j port”). The SIP-j port is used to transfer information (e.g., address, command and data information), among others, carried by an input information signal SSIP-j into slave device 104-j, some of this information being destined for the slave controller 106 and some being destined for the memory array 108. The SOP-j port provides an output information signal SSOP-j that carries information (e.g., address, command and data information) out of slave device 104-j, with some of this information possibly having originated from the memory array 108.
In addition, the interface of slave device 104-j includes an input port enable input port (hereinafter, the “IPE-j port”) and an input port enable echo output port (hereinafter, the “IPEQ-j port”). The IPE-j port receives an input port enable signal SIPE-j. The input port enable signal SIPE-j is used by slave device 104-j to enable the SIP-j port such that when the input port enable signal SIPE-j is activated, this allows the serial input of data to slave device 104-j via the SIP-j port for processing by the slave controller 106. The input port enable signal SIPE-j is also propagated through the slave controller 106 to the IPEQ-j port of slave device 104-j from which an echo signal SIPEQ-j is provided to the succeeding device.
In addition, the interface of slave device 104-j includes an output port enable input port (hereinafter, the “OPE-j port”) and an output port enable echo output port (hereinafter, the “OPEQ-j port”). The OPE-j port receives an output port enable signal SOPE-j. The output port enable signal SOPE-j is used by slave device 104-j to enable the SOP-j port such that when the output port enable signal SOPE-j is activated, this allows the serial output of data expected to be sent out by slave device 104-j via the SOP-j port. The output port enable signal SOPE-j is also propagated through the slave controller 106 to the OPEQ-j port of slave device 104-j from which an echo signal SOPEQ-j is provided to the succeeding device.
In addition, the interface of slave device 104-j includes a clock input port (hereinafter, the “RCK-j port”). The RCK-j port receives an input clock signal SRCK-j from the master device 102, which is used to control latching of the signals present at the SIP-j port into registers (not shown) internal to slave device 104-j, as well as latching of signals onto the SOP-j port from registers internal to slave device 104-j. The input clock signal SRCK-j is also used to control latching of the signals present at the IPE-j and OPE-j ports into registers internal to slave device 104-j and subsequently onto the IPEQ-j and OPEQ-j ports, respectively.
In addition, the interface of slave device 104-j includes a chip select port (not shown), which receives a chip select signal from the master device 102 that enables operation of slave device 104-j and possibly other slave devices concurrently. A reset port (not shown) may also be provided, for the purposes of carrying a reset signal from the master device 102 for resetting one or more functions of the slave device 104-j.
Those skilled in the art will also appreciate that other components may be provided in slave device 104-j without departing from the scope of the invention, such as buffers, phase shifters, other logic sub-circuits, etc., depending on the clock rate type (e.g., single data rate versus double data rate), the clock response type (e.g., edge-aligned versus center-aligned) and various other aspects of the functionality of slave device 104-j. For example, in the illustrated embodiment, slave device 104-j includes a plurality of input buffers 120 connected to the RCK-j, SIP-j, OPE-j and IPE-j ports and a plurality of output buffers 122 connected to the SOP-j, OPEQ-j and IPEQ-j ports.
As mentioned above, the echo signals SIPEQ-j and SOPEQ-j are propagated versions of the input port enable signal SIPE-j and the output port enable signal SOPE-j, respectively, and, as such, will have undergone a delay, referred to herein as an input-to-output latency (or “flow-through” latency) and denoted TIOL-j. TIOL-j, which in this embodiment can be expressed in terms of a number of clock cycles, characterizes the design of slave device 104-j and, more particularly, the slave controller 106. TIOL-j may be different for devices of different types and specifications. In an embodiment, TIOL-j is designed to be as low as possible for a nominal clock rate, while guaranteeing that the slave controller 106 has sufficient time to process information and data carried by the input information signal SSIP-j at the SIP-j port and complete any requisite interactions with the memory array 108.
Upon activation of the input port enable signal SIPE-j, the data carried by the input information signal SSIP-j is processed by slave device 104-j after a delay of TIOL-j clock cycles. Thus, one can view the state of the input port enable signal SIPE-j as establishing a time window during which the input information signal SSIP-j carries data to be processed by slave device 104-j. Meanwhile, the current states of the input port enable signal SIPE-j, the output port enable signal SOPE-j and the input information signal SSIP-j are transferred out onto the echo signal SIPEQ-j, the echo signal SOPEQ-j and the output information signal SSOP-j, respectively, so that they appear thereon after the aforesaid delay of TIOL-j clock cycles. Any relationship in terms of synchronization that may have existed among the input information signal SSIP-j, the input port enable signal SIPE-j and the output port enable signal SOPE-j is, therefore, maintained for the benefit of the succeeding device.
The impact of activation of the output port enable signal SOPE-j is slightly different. On the one hand, slave device 104-j may expect to send out data based on a previously received instruction (e.g., a “read” command as will be described below). Here, activation of the output port enable signal SOPE-j causes such data to begin to appear in the output information signal SSOP-j after a delay of TIOL-j clock cycles. Meanwhile, the current states of the input port enable signal SIPE-j and the output port enable signal SOPE-j are transferred out onto the echo signals SIPEQ-j and SOPEQ-j, respectively, so that they appear thereon after the aforesaid delay of TIOL-j clock cycles. Thus, where slave device 104-j expects to send out information, one can view the state of the echo signal SOPEQ-j as establishing a time window during which the output information signal SSOP-j validly carries data output by slave device 104-j.
On the other hand, where slave device 104-j does not expect to send out information based on a previously received instruction (or in the absence of such instruction altogether), activation of the output port enable signal SOPE-j is meaningless for slave device 104-j. In such cases, the current states of the input port enable signal SIPE-j, the output port enable signal SOPE-j and the input information signal SSIP-j are simply transferred out onto the echo signal SIPEQ-j, the echo signal SOPEQ-j and the output information signal SSOP-j, respectively, so that they appear thereon after the aforesaid delay of TIOL-j clock cycles. Any relationship in terms of synchronization that may have existed among the input information signal SSIP-j, the input port enable signal SIPE-j and the output port enable signal SOPE-j is, therefore, maintained for the benefit of the succeeding device.
Some of the data carried by the input information signal SSIP-j during the above-mentioned time window, i.e., while the input port enable signal SIPE-j remains activated, may digitally encode a command from the master device 102. Such commands are interpreted by the slave controller 106 and translated into control signals fed to various elements of the memory array 108 and other circuitry (not shown) of slave device 104-j. Examples of a command include a “write” command and a read command, among other possibilities. In an embodiment of the present invention, commands are in the form of packets which form a higher layer protocol of communication between the master device 102 and slave device 104-j.
In a data access procedure, the master device 102 provides an instruction to the serial interconnection. Thus, the master device 102 sends a master serial output information signal SSOP to the first device in the serial interconnection. The master serial output information signal SSOP contains instruction information to perform the device address recognition and data processing (e.g., read, write). For example, the instruction information is contained in a command string that has an encoded format as shown in Table I. In this particular example, the command string includes first, second and third information of an instruction. Other formats are possible, including a variety of other encoding schemes, arrangements of bits, etc.
In Table I, the first byte of the command string (the first information of the instruction) represents a hexadecimal or other value that is information identifying a device address of slave device 104-j or of another device (i.e., the device address of a target device). Slave device 104-j becomes aware of its device address (if “targeted”) during an address recognition procedure, based on the device address contained in the first byte of the received command string. If the slave controller 106 of that device recognizes the address of slave device 104-j in the first byte of the command string, the slave controller 106 will enter a state where it becomes attentive to receipt of a further part of the command string requiring processing. Meanwhile, the slave controller 106 serially transfers the first byte of the command string out onto the SOP-j port thereof after TIOL-j clock cycles. This is done regardless of whether the command is, or is not, destined for slave device 104-j.
In Table I, the second byte of the command string (the second information of the instruction) represents a hexadecimal or other value (in this example, “B1h”) that indicates that the present access command is a read command and not some other command. The precise value associated with the read command is a design parameter and does not have any significance in this example other than to serve an illustrative purpose. In the slave device 104-j wherein the slave controller 106 has determined from the first byte of the command string that the command is destined therefore, the slave controller 106 recognizes the present command of the second byte as a read command by processing the second byte of the command string. The slave controller 106, therefore, enters a state where it becomes attentive to receipt of yet a further part of the command string requiring processing. Meanwhile, the slave controller 106 serially transfers the second byte of the command string out onto the SOP-j port after TIOL-j clock cycles. This is done regardless of whether the command is, or is not, destined for slave device 104-j.
In Table I, the third byte of the command string (the third information of the instruction) represents, in the case of a read command, a hexadecimal or other value that specifies one or more memory locations in the memory array 108, so that the contents of the specified memory locations (or memory addresses designated by, for example, banks, columns and rows) are read to provide response data. The response data is subsequently output onto the SOP-j port. Accordingly, the slave controller 106 accesses the contents of the one or more specified memory locations. The accessed data is, then, expected to be placed onto the SOP-j port, but this will be done later, in dependence upon the state of the output port enable signal SOPE-j. If the slave controller 106 detects the activation of the output port enable signal SOPE-j, the slave controller 106 will place the accessed data onto the SOP-j port after a further TIOL-j clock cycles. However, if the output port enable signal SOPE-j is not activated, the slave controller 106 will not place any data onto the SOP-j port. Meanwhile, the slave controller 106 serially transfers the third byte of the command out onto the SOP-j port after TIOL-j clock cycles, regardless of whether the command string is or is not destined for slave device 104-j.
Based on the foregoing, it will be observed that the read command elicits a response from slave device 104-j, which response includes placing data onto the SOP-j port during a time window of validity that is signaled by activation of the output port enable signal SOPE-j. The amount of time during which the output port enable signal SOPE-j remains activated is related to the amount of data to be read from the memory array 108. In the embodiment system shown in FIGS. 1A and 1B, the target device, that is to respond to the read command, read (or release) data from the memory array 108 to provide response data. The response data is placed onto the SOP-j port. The slave device 104-j transmits the response data to the succeeding device.
FIGS. 2, 3 and 4 show basic timing diagrams for the read command and the response it elicits from slave device 104-j illustrated in FIG. 1B for several possible clock signal response types (single data rate vs. double data rate) and clock signal alignment types (edge-aligned vs. center-aligned) as shown in Table II.
FIG. 5 shows a system according to an embodiment of the present invention. In this particular example, the system includes a controller and a serial interconnection of a plurality of devices wherein clocks are provided in a common clock fashion. The controller and the devices correspond to the master device 102 and the slave devices 104-0 - - - 104-N-1 of FIG. 1A, respectively.
Referring to FIG. 5, a system 502 includes a master device 202 and a plurality of series-connected semiconductor devices 204-0 - - - 3, hereinafter referred to as a “serial interconnection”. In the illustrated example, the system 502 includes four slave devices 204-0 - - - 3, each similar in structure to slave device 104-j as shown in FIG. 1B. It would be apparent to those of ordinary skill in the art that the system 502 may include any number of slave devices. By way of example, the master device 202 and the slave devices 204-0 - - - 3 may be implemented in a single multi-chip package (MCP) or as discrete units.
Each of the slave devices 204-0 - - - 3 is similar in structure to slave device 104-j described earlier with reference to FIG. 1B. That is, each of the slave devices 204-0 - - - 3 has an interface compatible with the interface of slave device 104-j described earlier. Accordingly, each of the slave devices 204-0 - - - 3 has an interface including a serial input port (SIP-0 - - - 3), a serial output port (SOP-0 - - - 3), an input port enable input port (IPE-0 - - - 3), an output port enable input port (OPE-0 - - - 3), an input port enable echo output port (IPEQ-0 - - - 3), an output port enable echo output port (OPEQ-0 - - - 3) and a clock input port (RCK-0 - - - 3). In addition, the interface of each of the slave devices 204-0 - - - 3 may include a chip select port (not shown) and a reset port (not shown).
It should be appreciated that different types of slave devices can be utilized as long as they have compatible serial interfaces. For example, where the slave devices 204-0 - - - 3 are memory devices, such memory devices may be of the same type (e.g., all having NAND Flash memory core), or they may be of different types (e.g., some having NAND Flash memory core and others having NOR Flash memory core). Other combinations of memory types and device types occurring to those of skill in the art are within the scope of the present invention.
The master device 202 has an interface including a plurality of output ports for providing a group of signals to a first slave device 204-0 of the serial interconnection. In the illustrated example, the interface of the master device 202 includes a master clock output port (hereinafter, the “TCK port”) over which is output a master output clock signal STCK, a master serial output port (hereinafter, the “SOP port”) over which is provided a master serial output information signal SSOP, a master serial input port enable output port (hereinafter, the “IPE port”) over which is provided a master serial input port enable signal SIPE, and a master serial output port enable output port (hereinafter, the “OPE port”) over which is provided a master serial output port enable signal SOPE.
The interface of the master device 202 may further include various other output ports over which can be provided the chip select signal, the reset signal and various other control and data information destined for the slave devices 204-0 - - - 3.
The interface of the master device 202 further includes a master serial input port (hereinafter, the “SIP port”) over which is received a master serial input information signal SSIP from the last slave device 204-3 of the serial interconnection.
The system 502 of FIG. 5 forms a feedforward ring type interconnection. That is to say, the output ports of the master device 202 (i.e., the SOP, IPE and OPE ports) are connected to the input ports of the first slave device 204-0 (i.e., the SIP-0, IPE-0 and OPE-0 ports, respectively), whose output ports (i.e., the SOP-0, IPEQ-0 and OPEQ-0 ports) are connected to the input ports of the second slave device 204-1 (i.e., the SIP-1, IPE-1 and OPE-1 ports, respectively). Next, the output ports of slave device 204-1 (i.e., the SOP-1, IPEQ-1 and OPEQ-1 ports) are connected to the input ports of the third slave device 204-2 (i.e., the SIP-2, IPE-2 and OPE-2 ports, respectively), whose output ports (i.e., the SOP-2, IPEQ-2 and OPEQ-2 ports) are connected to the input ports of the fourth slave device 204-3 (i.e., the SIP-3, IPE-3 and OPE-3 ports, respectively). Finally, the SOP-3 port of the fourth (i.e., the last) slave device 204-3 is connected to the SIP port of the master device 202, allowing delivery of the master serial input information signal SSIP (i.e., SSIP-3) to the master device 202. In the feedforward ring type interconnection, the other output ports of slave device 204-3 (i.e., the IPEQ-3 and OPEQ-3 ports) do not need to be connected to the master device 202.
It should also be noted that in the system 502 of FIG. 5 the clocks to the devices are provided in the common clock fashion. Therefore, the TCK port of the master device 202 is commonly connected to the RCK-0, RCK-1, RCK-2 and RCK-3 ports of the devices 204-0, 204-1, 204-2 and 204-3. In other words, the master output clock signal STCK is split into the various input clock signals SRCK-0, SRCK-1, SRCK-2 and SRCK-3. Embodiments where a different configuration for distribution of the master output clock signal STCK are also contemplated, and some examples are described later on in greater detail.
For the purposes of simplifying the description, the system 502 shows (and the remainder of the description focuses on) single-bit-wide (x1) input and output signals. It would, however, be apparent that the input and output signals can be wider than x1 without departing from the scope of the invention.
The master device 202 includes a clock generator 608, a master controller 610 and a data receiver 612. The clock generator 608 generates the master output clock signal STCK, which is provided commonly to the slave devices 204-0 - - - 3, as well as to the master controller 610 and the data receiver 612. The master controller 610 issues command strings including access commands by controlling the master serial output information signal SSOP, and by activating and deactivating the master input port enable signal SIPE and the master output port enable signal SOPE at the appropriate instants. In the embodiment, the signals (i.e., SSIP, SSOP, SOPE) output by the master controller 610 are synchronized with generated clocks, so that the intended acquisition instants are aligned with the rising edges of the master output clock signal STCK. For its part, the data receiver 612 accepts responses generated by the slave devices 204-0 - - - 3 in the serial interconnection. Details of the data receiver 612 are shown in FIG. 6.
Again, referring to FIG. 5, the master controller 610 is operative to issue an access command to a “target” device. For example, the target device is the first slave device 204-0 or any other of the slave devices 204-1, 204-2, 204-3 in the serial interconnection. For notational convenience, the target device is denoted 204-t, where 0≦t≦3. The master controller 610 also ensures that the master serial output information signal SSOP is aligned with the master serial input port enable signal SIPE. The command is, thus, received by the first slave device 204-0 at its SIP-0 port, the command being contained in the serial input information signal SSIP-0. The master input port enable signal is received by the first slave device 204-0 at its IPE-0 port in the form of the input port enable signal SIPE-0.
Where the command is a read command, the master output port enable signal SOPE is also activated after the issuance of the command string including the first, second and third bytes as described above. The master output port enable signal SOPE is kept activated for a suitable length of time commensurate with the amount of read data expected from the target device 204-t. The master serial output port enable signal SOPE is, thus, received by the first slave device 204-0 at its OPE-0 port in the form of the output port enable signal SOPE-0.
Upon receipt of the command string by the first slave device 204-0 at its SIP-0 port, the slave controller 106 in the first slave device 204-0 determines whether the first slave device 204-0 is the target device 204-t. This can be done by verifying the device address specified in the command string (the first byte). If the first slave device 204-0 is the target device 204-t, the slave controller 106 will interpret the remainder of the command string and takes action. In the specific case of a read command, the slave controller 106 in the first slave device 204-0 produces read data by accessing the contents of one or more specified locations in the memory array 108. The slave controller 106, then, waits for the output port enable signal SOPE-0 to be activated before placing the read data onto the SOP-0 port after another TIOL-0 clock cycles. Additionally, as already described, the slave controller 106 transfers the signals appearing at the IPE-0 and OPE-0 ports onto the IPEQ-0 and OPEQ-0 ports, respectively, after TIOL-0 clock cycles.
If the first slave device 204-0 is not the target device 204-t, the slave controller 106 in the first slave device 204-0 simply re-transmits the received serial information towards the next slave device 204-1. That is, the slave controller 106 transfers the serial information received via the SIP-0 port onto the SOP-0 port after TIOL clock cycles. Additionally, as already described, the slave controller 106 transfers the signals appearing at the IPE-0 and OPE-0 ports onto the IPEQ-0 and OPEQ-0 ports, respectively, after TIOL-0 clock cycles.
The same basic operations are performed at the next slave device 204-1, and so on. It should be noted that at some point, the information appearing on the SOP-t port (i.e., the SOP-j port of the given one of the slave devices 204-0 - - - 3, that is, the target device 204-t) contains the read data that is destined for the master device 202. The read data continues to be propagated until it is transmitted in the form of the serial output information signal SSOP-3 by the last slave device 204-3 via its SOP-3 port. The serial output information signal SSOP-3 containing the read data is received at the SIP port of the master device 202 in the form of the master serial input information signal SSIP.
As can be appreciated from the above description, the master device 202 issues a read command to control the behavior of the target device 204-t in the serial interconnection by using the SIP, IPE and OPE ports. The target device 204-t, then, responds to the instructions in accordance with the command string from the master device 202 and transmits response data further along the serial interconnection. The providing of the response data by the target device 204-t follows detection by the target device that the output port enable signal received by the target device 204-t (i.e., SOPE-t) has been activated. This signal SOPE-t is a version of the master output port enable signal SOPE delayed by TIOL-j at each preceding slave device in the serial interconnection (i.e., for j<t). The providing of the response data by the target device 204-t is delayed relative to activation of the master output port enable signal SOPE by the sum (or total) of the flow-through latencies TIOL-j of all devices up to and including the target device 204-t. Thereafter, the response data undergoes a further delay of TIOL-j at each succeeding device in the serial interconnection (i.e., for j>t). Thus, the response data appearing in the master serial input information signal SSIP is delayed relative to activation of the master output port enable signal SOPE by a total flow-through latency of the serial interconnection, denoted TIOL-TOTAL, where TIOL-TOTAL=ΣjTIOL-j.
Ultimately, therefore, the master device 202 begins to receive the response data via its SIP port at a time instant. The reception of the response data is delayed relative to activation of the master output port enable signal SOPE by TIOL-TOTAL. This time instant is not, however, apparent from the content of the master serial input information signal SSIP itself. Rather, the appropriate time instant for beginning to consider the data on the master serial input information signal SSIP as valid data needs to be determined and taken into consideration.
To this end, in the present embodiment of a feedforward ring type interconnection, and with reference to FIG. 6, the data receiver 612 includes an input buffer 620, a D-type flip-flop (D-FF) 630 and a clock processor 640. The D-FF 630 functions as latching circuitry for latching input data.
The input buffer 620 receives the master serial input information signal SSIP arriving at the SIP port of the master device 202. The input buffer 620 outputs an intermediate signal SSIP — INT, which is fed to a data input of the D-FF 630. The intermediate signal SSIP — INT is, thus, a slightly delayed version of the master serial input information signal SSIP by the input buffer 620. The D-FF 630 operates to transfer the signal at its data input (D) (i.e., the intermediate signal SSIP — INT) onto a data output (Q) in dependence upon a latch clock signal SCLK — LAT. The latch clock signal SCLK — LAT is supplied by the clock processor 640, which is now described.
The clock processor 640 receives a version of the master output clock signal STCK that is output by the master controller 610 via the TCK port of the master device 202. The version of the master output clock signal STCK supplied to the clock processor 640 can be obtained by tapping the master output clock signal STCK at the output of the master controller 610 or via a mechanism (not shown) internal to the master device 202. The clock processor 640 also receives a latency control signal TLAT — CTRL that is triggered by the master device 202 when the master output port enable signal SOPE is activated. In another embodiment, the master output port enable signal SOPE is provided directly to the clock processor 640 instead of the latency control signal TLAT — CTRL. The clock processor 640 also receives the total flow-through latency TIOL-TOTAL, which in the present embodiment can be predicted based on knowledge of the device type(s) and number of slave devices in the serial interconnection. By way of example, in the illustrated embodiment, the total flow-through latency TIOL-TOTAL is predicted to be four clock cycles. In another embodiment, rather than being received as an external signal or variable, the total flow-through latency TIOL-TOTAL may be pre-programmed in the clock processor 640.
An example of the clock processor 640 includes a counter (not shown) that starts counting incoming pulses of the master output clock signal STCK after the master output port enable signal SOPE is activated. When the count reaches the value (or number) of the total flow-through latency TIOL-TOTAL, the counter starts outputting pulses in the latch clock signal SCLK — LAT. While the master output clock signal STCK is deactivated, the counter continues outputting pulses. When the count reaches the value of the total flow-through latency TIOL-TOTAL after the deactivation, the counter ceases outputting pulses in the latch clock signal SCLK — LAT. Thus, the start and end of the producing of clocks of the latch clock signal SCLK — LAT are delayed by the total flow-through latency TIOL-TOTAL after the activation and the deactivation of the master output port enable signal SOPE.
In the example shown in FIG. 5, it is assumed that the devices 204-0 - - - 204-3 of the serial interconnection are the same type device, e.g., NAND flash devices, and each of the input-to-output (or the flow-through) latencies TIOL-0 - - - TIOL-3 is the same value, namely one clock cycle. Therefore, the total flow-through latency TIOL-TOTAL is four cycles. The value of four cycles as the predicted total flow-through latency TIOL-TOTAL is provided to the clock processor 640 of the data receiver 612 by an appropriate manner. Devices of other types may have different flow-through latencies. In the illustrated example, while the flow-through latencies of the devices are different, the total flow-through latency TIOL-TOTAL is predicted.
In order to generate the latch clock signal SCLK — LAT, the clock processor 640 is operable to monitor activation of the latency control signal TLAT — CTRL (or the master output port enable signal SOPE), following which it begins counting clock cycles of the master output clock signal STCK. During this time, the latch clock signal SCLK — LAT is inactive, and the D-FF 630 is not transferring the signal at its data input to its data output. When the number of clock cycles of the master output clock signal STCK reaches the number of clock cycles specified by the total flow-through latency TIOL-TOTAL, the latch clock signal SCLK — LAT is, then, set to begin replicating the master output clock signal STCK. This establishes acquisition time instants of the D-FF 630, allowing its data input to be transferred to its data output. The transferred data is processed by other circuitry (not shown) in the master device 202. Prior to this moment (i.e., for the past TIOL-TOTAL clock cycles), the contents of the master serial input information signal SSIP are ignored. When the latency control signal TLAT — CTRL (or the master output port enable signal SOPE) is no longer activated, the clock processor 640 continues to allow the latch clock signal SCLK — LAT to replicate the master output clock signal STCK for another TIOL-TOTAL clock cycle, and then finally the latch clock signal SCLK — LAT is deactivated.
Thus, the latch clock signal SCLK — LAT takes into account the flow-through latency TIOL-TOTAL, which in the present example corresponds to four clock cycles. The activation of the latch clock signal SCLK — LAT corresponds to the onset of a time window during which the master serial input information signal SSIP (or the slightly delayed intermediate signal SSIP — INT) is known to validly carry data. The data is output by the target device via the last slave device 204-3 in the serial interconnection (or just the target device if it is itself the last slave device in the serial interconnection). It will, thus, be appreciated that the contents of the intermediate signal SSIP — INT latched by the master device 202 (the D-FF 630) allow timely capture of the response data actually sent by the target device.
The latched data “Data_Latched” is provided to the master controller 610 of the master device 202.
FIG. 7 shows a timing diagram that depicts the various signals in FIGS. 5 and 6. Referring to FIGS. 5, 6 and 7, there are the master output clock signal STCK, the master output port enable signal SOPE (equivalent to the output port enable signal SOPE-0), the echo signals SOPEQ-0, SOPEQ-1, SOPEQ-2 and SOPEQ-3 (equivalent to the master echo signal SOPEQ), the output information signals SSOP-0, SSOP-1, SSOP-2 and SSOP-3 (equivalent to the master serial input information signal SSIP), the intermediate signal SSIP — INT, the latch clock signal SCLK — LAT, and the latched data “Data_Latched” at the data output of the D-FF 630. In this case, it is seen that the target device 204-t is slave device 204-1, as evidenced by the first appearance of response data on the output information signal SSOP-1 following time T02, which is TIOL-0=1 clock cycle following the activation of the master output port enable signal SOPE at time T01.
As shown in the example timing diagram of FIG. 7, the master controller 610 activates the master output port enable signal SOPE in response to the rising edge of the master output clock signal STCK at time T00. This is illustrated for the master output port enable signal SOPEQ by an arrow 710 between times T00 and T01. Thus, the master output port enable signal SOPE has stabilized by the time the master output clock signal STCK presents a subsequent rising edge at time T01. Assuming that slave device 204-1 is the target device 204-t (based on a previous selection made by virtue of a read command issued by the master device 202), it is the only device to be responsive to a received output port enable signal. Thus, only the device 204-1 recognizes the device address. The first slave device 204-0 does not respond to activation of the output port enable signal SOPE-0 and just forwards both it and the input information signal SSIP-0 to the OPEQ-0 and SOP-0 ports, respectively, with TIOL-0=1 clock cycle of latency.
Slave device 204-1 detects activation of the output port enable signal SOPE-1 (which is equivalent to SOPEQ-0) at time T02 and is responsive thereto. The slave device 204-1, then, starts producing response data through its SOP-1 port. The response data is stabilized by the time the input clock signal SRCK-1 (which is equivalent to STCK) presents a next rising edge at time T03. Therefore, the slave device 204-1 responds to the master device 202 and outputs the response data, From this point, valid response data from slave device 204-1 flows through the SIP-j and SOP-j ports of the remaining slave devices synchronized with the input clock signals, which are equivalent to the master output clock signal STCK, as shown in FIG. 7.
The data receiver 612 of the master device 202, then, receives the master serial input information signal SSIP (which corresponds to the serial output information signal SSOP-3) from the last slave device 204-3 in the serial interconnection. SSIP will contain the valid response data if sampled starting at time T05, i.e., after a total of TIOL-TOTAL=4 clock cycles in this example. Thus, in the particular example, the total flow-through latency TIOL-TOTAL is four clock cycles. The first to last valid response data, as the master serial input information signal SSIP (or the serial output information signal SSOP-3), is transmitted to the data receiver 612 in response to the clock signal.
Meanwhile, the data receiver 612 produces the latch clock signal SCLK — LAT (whose rising edges establish the acquisition instants for the D-FF 630) as described above, based on activation of the latency control signal TLAT — CTRL (or the master output port enable signal SOPE) after time T00. The latch clock signal SCLK — LAT is synchronized with the master output clock signal STCK. In accordance with the value (i.e., four cycles) of the total flow-through latency TIOL-TOTAL, the first four clock pulses of the master output clock signal STCK are suppressed by the clock processor 640 at times T01, T02, T03, T04 following activation of the latency control signal TLAT — CTRL (or the master output port enable signal SOPE) after time T00. Therefore, after the suppression of four clock pulses, a sequence of pulses occurs in the latch clock signal SCLK — LAT from the clock processor 640. In FIG. 7, a dashed extension of the latch clock signal SCLK — LAT shows these four suppressed pulses. The four pulses shown by the dashed extension are not generated because of total latency of four cycles.
As the result, the occurrence of clock pulses of the latch clock signal SCLK — LAT is delayed relative to the master output port enable signal SOPE by the same total flow-through latency TIOL-TOTAL. So is the response data contained in the master serial input information signal SSIP. The acquisition instants established by the rising edge of the first clock pulse in the latch clock signal SCLK — LAT correctly signals the onset of valid data in the intermediate signal SSIP — INT. Thus, the D-FF 630 begins to correctly latch valid response data in the intermediate signal SSIP — INT, which, as can be seen, is a slightly delayed version of the master serial input information signal SSIP. SSIP is equivalent to the serial output information signal SSOP-3 provided by the last slave device 204-3 in the serial interconnection. The first to last valid response data contained in SSIP — INT is sequentially latched by the D-FF 630 and the latched data is sequentially output as the “Data_Latched” from its output (Q) in response to the generated latch clock signal SCLK — LAT during a latch period TLATCH1, as shown in FIG. 7.
The first clock pulse of the latch clock signal SCLK — LAT is generated after the suppression period of the four clock cycles following the activation of the latency control signal TLAT — CTRL (or the master output port enable signal SOPE). Upon receipt of the first clock pulse of the latch clock signal SCLK — LAT, the D-FF 630 starts the data latching. Thus, the data latching by the D-FF 630 is delayed based on the total flow-through latency TIOL-TOTAL. Such data latching continues in response to the succeeding clock pulses of the latch clock signal SCLK — LAT until the deactivation of the echo signal SOPEQ-3. Thus, the latch period TLATCH1 is determined by the activation and deactivation of the echo signal SOPEQ-3. The last clock pulse of the latch clock signal SCLK — LAT is generated after the same period of four clock cycles after the deactivation of the latency control signal TLAT — CTRL (or the master output port enable signal SOPE).
The circuit of FIG. 6 is just an example. Any modifications and variations of the circuit of FIG. 6 to achieve the desired functionality are considered to be within the scope of the present invention. The D-FF 630 is one example of latching circuitry. Also, the clock processor 640 is one example of clock signal circuitry in response to clock pulse production activation (e.g., the master output port enable signal SOPE) and an input control (e.g., the total flow-through latency TIOL-TOTAL). In the clock signal circuitry, clock pulses are continuously produced in response to the pulse production activation, but the start and end of the pulse production are delayed by the control value of the input control. It would be apparent to those skilled in the art that both or either of the data latching function and the latch clock producing function can be achieved by numerous other circuits and devices.
It should be appreciated that in some cases, it may not be possible to know, in advance, the total flow-through latency TIOL-TOTAL. For example, the master device 202 may not know the flow-through latency of each individual slave device. Alternatively, a master device may know the nominal flow-through latency of the various slave devices for a given frequency but changes to the total flow-through latency due to operation of the system at a different frequency may not be known. In such cases, it may be advantageous to use a feedback ring type interconnection, as is now described with reference to FIG. 8.
FIG. 8 shows a system according to another embodiment of the present invention, the system including a controller and a serial interconnection of a plurality of devices wherein clocks are provided in a common clock fashion.
Referring to FIG. 8, a system 802 includes a master device 882 and a serial interconnection of semiconductor devices. In the illustrated example, the serial interconnection includes four semiconductor devices 304-0 - - - 3. It would be apparent to those of ordinary skill in the art that the system 802 may include any number of slave devices. The semiconductor devices 304-0 - - - 3 are similar to the devices 204-0 - - - 204-3 of FIG. 5. For the purposes of the present example, consider that each memory device in the serial interconnection configuration has variable flow-through latency. For example, the flow-through latencies of the devices 304-0, 304-1, 304-2 and 304-3 are TIOL-0=3 clock cycles, TIOL-1=1 clock cycle, TIOL-2=1 clock cycle and TIOL-3=2 clock cycles, respectively. Therefore, in this particular example, the total flow-through latency TIOL-TOTAL is seven clock cycles. It will be appreciated that a given device's flow-through latency TIOL-j may be variable depending upon the variation of power supply level and/or temperature inside the given device. Moreover, the variable flow-through latency TIOL-j may be controlled by the master device 882, or can be adjusted by the given device itself using a built-in temperature sensor (not shown). In this situation, the master device 882 is unable to know the total flow-through latency TIOL-TOTAL.
The master device 882 is similar to the master device 202 of FIG. 5. The master device 882 of FIG. 8 has an interface comprising a plurality of output ports for providing a group of signals to a first slave device 304-0 of the serial interconnection. The interface of the master device 882 includes a master clock output port (hereinafter, the “TCK port”) over which is output a master output clock signal STCK, a master serial output port (hereinafter, the “SOP port”) over which is provided a master serial output information signal SSOP, a master serial input port enable output port (hereinafter, the “IPE port”) over which is provided a master serial input port enable signal SIPE, and a master serial output port enable output port (hereinafter, the “OPE port”) over which is provided a master serial output port enable signal SOPE.
The interface of the master device 882 may further comprise various other output ports over which can be provided the chip select signal, the reset signal and various other control and data information destined for the slave devices 304-0 - - - 3.
The interface of the master device 882 includes a master serial input port (hereinafter, the “SIP port”) over which is received a master serial input information signal SSIP from the last slave device 304-3 of the serial interconnection.
In addition, the interface of the master device 882 further includes a master output port enable echo input port (hereinafter, the “OPEQ” port) over which is received a master echo signal SOPEQ from the last slave device 304-3 of the serial interconnection.
As with the system 502 of FIG. 5, the output ports of the master device 882 in the system 802 (i.e., the SOP, IPE and OPE ports) are connected to the input ports of the first slave device 304-0 (i.e., the SIP-0, IPE-0 and OPE-0 ports, respectively), whose output ports (i.e., the SOP-0, IPEQ-0 and OPEQ-0 ports) are connected to the input ports of the second slave device 304-1 (i.e., the SIP-1, IPE-1 and OPE-1 ports, respectively). Similarly, the output ports of slave device 304-1 (i.e., the SOP-1, IPEQ-1 and OPEQ-1 ports) are connected to the input ports of the third slave device 304-2 (i.e., the SIP-2, IPE-2 and OPE-2 ports, respectively), whose output ports (i.e., the SOP-2, IPEQ-2 and OPEQ-2 ports) are connected to the input ports of the fourth (i.e., the last) slave device 304-3 (i.e., the SIP-3, IPE-3 and OPE-3 ports, respectively).
In the feedback ring type interconnection of FIG. 8, the SOP-3 port and the OPEQ-3 port of the last slave device 304-3 are connected to the SIP port and the OPEQ port of the master device 882, respectively. The feed back connection of the SOP-3 and SIP ports allows delivery of the master serial input information signal SSIP to the master device 882. The feedback connection of the OPEQ-3 and OPEQ ports allows delivery of the master echo signal SOPEQ to the master device 882. However, the IPEQ-3 port of slave device 304-3 does not need to be connected to the master device 882.
It should also be noted that in this embodiment, the TCK port is commonly connected to the RCK-0, RCK-1, RCK-2 and RCK-3 ports of the devices 304-0, 304-1, 304-2 and 304-3 of the serial interconnection.
With continued reference to FIG. 8, the master device 882 is now described in greater detail. The master device 882 includes a clock generator 908, a master controller 910 and a data receiver 912. The clock generator 908 and the master controller 910 can be identical to the clock generator 608 and the master controller 610 of FIG. 5, respectively. The clock generator 908 generates the master output clock signal STCK, which is distributed to the slave devices 304-0 - - - 3, as well as to the master controller 910 and the data receiver 912. The master controller 910 issues commands, activates the master input port enable signal SIPE and the master output port enable signal SOPE at the appropriate instants. In the present embodiment, the signals output by the master controller 910 are timed, so that the intended acquisition instants are aligned with the falling edges of the master output clock signal STCK. For its part, the data receiver 912 accepts responses generated by the slave devices 304-0 - - - 3 in the serial interconnection. The date receiver 912 is different from the data receiver 612 of FIG. 6. A detail of the data receiver 912 is shown in FIG. 9.
Again referring to FIG. 8, the master controller 910 is operative to issue a command (e.g., in a form of a command string) to a “target” device in the serial interconnection. For example, the target device is the first slave device 304-0 or any other of the slave devices 304-1, 304-2, 304-3. For notational convenience, the target device is denoted 304-t, where 0≦t≦3. The master controller 910 also ensures that the master serial output information signal SSOP is aligned with the master serial input port enable signal SIPE. The command is, thus, received by the first slave device 304-0 at its SIP-0 port, the command being contained in the serial input information signal SSIP-0. The master input port enable signal SIPE is received by the first slave device 304-0 at its IPE-0 port in the form of the input port enable signal SIPE-0.
Where the command is a read command (see above Table I), the master output port enable signal SOPE is, also, activated after the first, second and third bytes of the command string is issued as described above. The master output port enable signal SOPE is kept activated for a suitable length of time commensurate with the amount of data expected from the target device 304-t. The master serial output port enable signal SOPE is, thus, received by the first slave device 304-0 at the its OPE-0 port in the form of the output port enable signal SOPE-0. The behavior of the slave devices 304-0 - - - 3 is the same as has already been described referring to the slave devices 204-0 - - - 3 shown in FIG. 5.
Referring to FIG. 8, the master device 882 issues a command string including a read command to control the behavior of the target device 304-t in the serial interconnection by using the SIP, IPE and OPE ports. The target device 304-t, then, responds to the instructions from the master device 882, the instructions being in accordance with the command string. The target device 304-t transmits read data further along the serial interconnection. The release of the response data by the target device 304-t follows detection by the target device that the output port enable signal received by the target device 304-t (i.e., SOPE-t) is activated. This signal SOPE-t is a version of the master output port enable signal SOPE that is delayed by TIOL-j at each preceding slave device in the serial interconnection. The release of the response data by the target device 304-t is delayed relative to activation of the master output port enable signal SOPE by the sum (or total) of the flow-through latencies TIOL-j of all devices up to and including the target device 304-t. Thereafter, the response data undergoes a further delay of TIOL-j at each succeeding device in the serial interconnection. Thus, the response data appearing in the master serial input information signal SSIP is delayed relative to activation of the master output port enable signal SOPE by a total flow-through latency of the serial interconnection, denoted TIOL-TOTAL, where TIOL-TOTAL =ΣjTIOL-j.
The master device 882 begins to receive the response data via its SIP port at a time instant. The reception of the response data is delayed relative to activation of the master output port enable signal SOPE by TIOL-TOTAL. Although this time instant is not apparent from the content of the master serial input information signal SSIP itself, it is apparent from the master echo signal SOPEQ. Specifically, the master echo signal SOPEQ is a propagated version of the master output port enable signal SOPE, it has undergone the same delay as the master serial input information signal SSIP, corresponding to the total flow-through latency TIOL-TOTAL. Thus, processing of the master echo signal SOPEQ can permit the master device 882 to extract valid data from the master serial input information signal SSIP.
FIG. 9 shows details of the data receiver 912 of FIG. 8. Referring to FIGS. 8 and 9, in the present embodiment of a feedback ring type interconnection, the data receiver 912 includes a first input buffer 920, a second input buffer 922, a D-FF 930 and an AND gate 940. The D-FF 930 functions as latching circuitry. The first input buffer 920 receives the master serial input information signal SSIP arriving at the SIP port of the master device 882 from the last device 304-3. The first input buffer 920 outputs an intermediate signal SSIP — INT, which is fed to a data input of the D-FF 930. The intermediate signal SSIP — INT is, thus, a slightly delayed version of the master serial input information signal SSIP. The second input buffer 922 receives the master echo signal SOPEQ arriving at the OPEQ port of the master device 882 from the last device 304-3. The second input buffer 922 outputs an intermediate echo signal SOPEQ — INT, which is a slightly delayed version of the master echo signal SOPEQ.
The D-FF 930 operates to transfer the signal at its data input (D) (i.e., the intermediate signal SSIP — INT) onto a data output (Q) in dependence upon a latch clock signal SCLK — LAT. This latch clock signal SCLK — LAT is supplied by the AND gate 940, which applies a logical AND operation on the signals present at its two inputs. The signal at one of the inputs of the AND gate 940 is a version of the master output clock signal STCK The version of the master output clock signal STCK supplied to the clock processor 640 can be obtained by tapping the master output clock signal STCK at the output of the master controller 910 or via a mechanism internal to the master device 882. The signal at the other one of the inputs of the AND gate 940 is the intermediate echo signal SOPEQ — INT, received from the second input buffer 922.
The latch clock signal SCLK — LAT is the result of logical ANDING of the master output clock signal STCK and the intermediate echo signal SOPEQ — INT. The master echo signal (and hence the intermediate echo signal SOPEQ — INT) is delayed relative to the master output port enable signal SOPE by the total flow-through latency TIOL-TOTAL. Therefore, the D-FF 930 only begins transferring the data at its data input (i.e., the data carried by the intermediate signal SSIP-INT) to its data output after a delay of TIOL-TOTAL clock cycles following activation of the master output port enable signal SOPE. This is the same delay experienced by the response data present in the master serial input information signal SSIP (or the slightly delayed intermediate signal SSIP — INT) relative to activation of the master output port enable signal SOPE. The activation of the latch clock signal SCLK — LAT corresponds to the onset of a time window during which the master serial input information signal SSIP (or the slightly delayed intermediate signal SSIP — INT) is known to validly carry data. The data is output by the target device via the last slave device 304-3 or just the target device if it is itself the last slave device, in the serial interconnection. Thus, the contents of the intermediate signal SSIP — INT latched by the circuitry of the master device 882 allow timely capture of the response data actually sent by the target device.
FIG. 10 shows various signals in FIGS. 8 and 9, the signals including the master output clock signal STCK, the master output port enable signal SOPE (equivalent to the output port enable signal SOPE-0 from the last device 304-3), the echo signals SOPEQ-0, SOPEQ-1, SOPEQ-2 and SOPEQ-3 (equivalent to the master echo signal SOPEQ), the output information signals SSOP-0, SSOP-1, SSOP-2 and SSOP-3 (equivalent to the master serial input information signal SSIP), the intermediate signal SSIP — INT, the intermediate echo signal SOPEQ — INT, the latch clock signal SCLK — LAT, and the latched data at the data output of the D-FF 930. In this case, it is seen that the target device 304-t is slave device 304-1, as evidenced by the first appearance of response data on the output information signal SSOP-1 following time T04, which is TIOL-0=3 clock cycles following the activation of the master output port enable signal SOPE at time T01.
Referring to FIGS. 8, 9 and 10, the master controller 910 issues the master output port enable signal SOPE in response to the falling edge of the master output clock signal STCK following time T00. This is illustrated for the master output port enable signal SOPEQ by an arrow 1010 between times T00 and T01. Thus, the master output port enable signal SOPE has stabilized by the time the master output clock signal STCK presents a subsequent falling edge following time T01. Assuming that slave device 304-1 is the target device (based on a previous selection made by virtue of a read command received from the master device 882), it is the only device to be responsive to a received output port enable signal. Therefore, slave device 304-0 does not respond to the output port enable signal SOPE-0 and just forwards both it and the input information signal SSIP-0 to the OPEQ-0 and SOP-0 ports, respectively, with TIOL-0=3 clock cycles of latency.
Slave device 304-1 detects activation of the output port enable signal SOPE-1 following time T04 and is responsive thereto. It, then, starts producing response data through its SOP-1 port. The response data is stabilized by the time the input clock signal SRCK-1 presents a next falling edge following time T05. From this point, valid response data from slave device 304-1 flows through the SIP-j and SOP-j ports of the remaining slave devices synchronized with the master output clock signal STCK and the output port enable and echo signals (SOPE-j and SOPEQ-j) as shown in FIG. 10.
The data receiver 912, then, receives the master serial input information signal SSIP (which corresponds to the serial output information signal SSOP-3) from the last slave device 304-3 in the serial interconnection. The signal SSIP contains valid response data if sampled starting at time T08, i.e., after a total of TIOL-TOTAL=7 clock cycles in this example. In parallel, the data receiver 912 receives the master echo signal SOPEQ from the last slave device 304-3, which is the same as the master output port enable signal SOPE but is delayed by seven clock cycles in this example.
The master echo signal (and hence the intermediate echo signal SOPEQ — INT) is delayed relative to the master output port enable signal SOPE by the same total flow-through latency TIOL-TOTAL. Also, the response data contained in the master serial input information signal SSIP is delayed. Thus, the acquisition instant established by the first falling edge in the latch clock signal SCLK — LAT at the output of the logical AND gate 940 correctly signals the onset of valid data in the intermediate signal SSIP — INT (which is a slightly delayed version of the master serial input information signal SSIP). Moreover, any changes in total flow-through latency TIOL-TOTAL due to changes in the operating properties of the individual slave devices 304-0 - - - 3 are transparent to the system 802 due to the master echo signal SOPEQ being fed back from the last slave device 304-3 in the serial interconnection.
The activation and deactivation of the propagated master echo signal SOPEQ are delayed from those of the master serial output port enable signal SOPE by the total flow-through latency TIOL-TOTAL. In response to the activation and deactivation of the master echo signal SOPEQ, the AND gate 940 outputs clock pulses in the latch clock signal SCLK — LAT during a latch period TLATCH2, as SSIP — INT is sequentially latched by the D-FF 930.
The circuit of FIG. 9 is just an example. Any modifications and variations of the circuit of FIG. 9 to achieve the desired functionality are considered to be within the scope of the present invention and modifications are possible. For example, the AND gate 940 introduces a delay which, although negligible at some operating frequencies, may require compensation at other operating frequencies in order to ensure accuracy at each acquisition instant. To this end, a compensation buffer (not shown) may be inserted in the path of the intermediate signal SSIP — INT in order to cause the signal at the data input of the D-FF 930 to be properly aligned relative to the acquisition instants established by the latch clock signal SCLK — LAT. Still other modifications and variations are possible.
If, for example, the master output port enable signal SOPE references the rising edge of the master output clock signal STCK instead of its falling edge, the maximum operating frequency of the system 802 will be increased. However, as a design consideration, one needs to ensure that this does not result in an initial overlap situation between detected activation of the master echo signal SOPEQ and the falling edge of the previous pulse in the master output clock signal STCK. Such overlap situation may generate an unexpected internal short pulse on the latch clock signal SCLK — LAT, possibly resulting in a malfunction. Still other modifications and variations of the system 802 are possible.
The D-FF 930 is one example of latching circuitry. It would be apparent to those skilled in the art that there are numerous alternatives to achieve such a latching function.
In the above embodiment systems, the clocks are provided to the devices in the serial interconnection by a common clock fashion. Thus, the master output clock signal STCK is to split into the various input clock signals SRCK-0, SRCK-1, SRCK-2 and SRCK-3 to commonly supply it to the series-connected devices. It is, however, possible of providing serially transferred clocks. In such a case, the master clock output signal STCK is supplied to the first device in the serial interconnection, then is passed from one device to another until it reaches the last device in the serial interconnection. The use of the serially transferred clocks can be useful when designing to overcome power limitations due to fanout that are inherent to the common clock fashion.
FIG. 11 shows another example of one of the slave devices in FIG. 1A. The device is used in the serial interconnection wherein clocks are provided by a transfer clock fashion. Referring to FIG. 11, a slave device 1104-j operates with clocks provided by a clock transfer fashion. The slave device 1104-j is similar to slave device 104-j of FIG. 1B. The device 1104-j includes the RCK-j port for receiving the input clock signal SRCK-j from the master device 1102 (either directly or via another slave device in the serial interconnection). Additionally, the device 1104-j includes a clock output port (hereinafter the “TCK-j port”) for supplying a processed version of the input clock signal (hereinafter the output clock signal STCK-j) to a succeeding slave device in the serial interconnection (or to the master device 1102). Furthermore, the device 1104-j includes a clock synchronizer 1150 that receives an output of one of the input buffers 120.
The output clock signal STCK-j originates from the clock synchronizer 1150 that processes the input clock signal SRCK-j passed through a corresponding one of the input buffers 120. The clock synchronizer 1150 includes, for example, a phase-locked loop (PLL), a delay-locked loop (DLL) or a variant thereof. An additional output buffer 1122 analogous to output buffers 122 is shown connected to the TCK-j port for receiving an output of the clock synchronizer 1150. Examples of the clock synchronizer 1150 are described in U.S. Provisional Patent Application No. 60/894,246, filed Mar. 12, 2007.
Also slave device 1104-j comprises a memory array 208 and a slave controller 1106, which is similar to the slave controller 106 (see FIG. 1B) previously described. The slave controller 1106 receives the input clock signal SRCK-j through the input buffer 120 and the signals input to the slave controller 1106 are synchronized with the input clock signal SRCK-j. Also, the slave controller 1106 receives the output clock signal STCK-j from the clock synchronizer 1150 through one of the output buffers 1122. The signals output by the slave controller 1106 are synchronized with the output clock signal STCK-j. Therefore, the transfer of the signals from slave device 1104-j to the succeeding device in the serial interconnection is synchronized with the output clock signal STCK-j.
It should be appreciated that when the master output clock signal STCK is provided by a clock transfer fashion, the flow-through latency of a particular slave device (such as slave device 1104-j) is no longer measured in units of clock cycles, but acquires a range of possible values, depending on the design of the particular slave device. For notational convenience, the flow-through latency of slave device 1104-j is expressed as TIOL-j+TPAR-j, where TIOL-j is as before (in terms of clock cycles of latency) and TPAR-j is the parasitic delay expressed either in units of time (e.g., picoseconds). In these instances, the flow-through latency of slave device 1104-j is very difficult to predict due to the parasitic delay TPAR-j, and therefore when it is of interest to ascertain when the output information signal SSOP-3 carries valid data, then it is advantageous to use a modified version of the feedback ring type interconnection shown in FIGS. 8-10. Such an advantageous modified version of a feedback ring type interconnection will be described below.
FIG. 12 shows a system according to another embodiment of the present invention, the system including a controller and a serial interconnection of a plurality of devices wherein clocks are provided in a clock transfer fashion. Referring to FIG. 12, a system 1202 includes a master device 1102 and a serial interconnection of slave devices 1104-0 - - - 3. While in the present example there are four slave devices 1104-0 - - - 3, it would be apparent to those of ordinary skill in the art that the system 1202 may include any number of slave devices.
The configuration of the master device 1102 is similar to that of the master device 882 of FIG. 8. Each of the slave devices 1104-0 - - - 3 is configured as shown in FIG. 11.
The master device 1102 has an interface comprising a plurality of output ports for providing a group of signals to a first slave device 1104-0 of the serial interconnection. The interface of the master device 1102 includes a master clock output port (hereinafter, the “TCK port”) over which is output a master output clock signal STCK, a master serial output port (hereinafter, the “SOP port”) over which is provided a master serial output information signal SSOP, a master serial input port enable output port (hereinafter, the “IPE port”) over which is provided a master serial input port enable signal SIPE, and a master serial output port enable output port (hereinafter, the “OPE port”) over which is provided a master serial output port enable signal SOPE.
The interface of the master device 1102 may further includes various other output ports over which can be provided the chip select signal, the reset signal and various other control and data information destined for the slave devices 1104-0 - - - 3.
The master device 1102 further includes a master serial input port (hereinafter, the “SIP port”) over which is received a master serial input information signal SSIP from the last slave device 1104-3 of the serial interconnection.
The interface of the master device 1102 further includes a master output port enable echo input port (hereinafter, the “OPEQ” port) over which is received a master echo signal SOPEQ from the last slave device 1104-3 of the serial interconnection.
In addition, the interface of the master device 1102 further includes a master clock input port (hereinafter, the “RCK port”) over which is received a master input clock signal SRCK from the last slave device 1104-3 of the serial interconnection.
The output ports of the master device 1102 in the system 1202 (i.e., the SOP, IPE and OPE ports) are connected to the input ports of the first slave device 1104-0 (i.e., the SIP-0, IPE-0 and OPE-0 ports, respectively), whose output ports (i.e., the SOP-0, IPEQ-0 and OPEQ-0 ports) are connected to the input ports of the second slave device 1104-1 (i.e., the SIP-1, IPE-1 and OPE-1 ports, respectively). Similarly, the output ports of slave device 1104-1 (i.e., the SOP-1, IPEQ-1 and OPEQ-1 ports) are connected to the input ports of the third slave device 1104-2 (i.e., the SIP-2, IPE-2 and OPE-2 ports, respectively), whose output ports (i.e., the SOP-2, IPEQ-2 and OPEQ-2 ports) are connected to the input ports of the fourth and last slave device 1104-3 (i.e., the SIP-3, IPE-3 and OPE-3 ports, respectively).
The SOP-3 and OPEQ-3 ports of slave device 1104-3 are connected to the SIP and OPEQ ports of the master device 1102. The SOP-3 to SIP connection allows delivery of the master serial input information signal SSIP to the master device 1102. The OPEQ-3 to OPEQ connection allows delivery of the master echo signal SOPEQ to the master device 1102. Here again, the IPEQ-3 port of slave device 1104-3 does not need to be connected to the master device 1102.
In the system 1202 utilizing the clock transfer fashion shown in FIG. 12, the TCK port of the master device 1102 is connected to the RCK-0 port of the first slave device 1104-0, whose TCK-0 port is connected to the RCK-1 port of the second slave device 1104-1. Similarly, the TCK-1 port of slave device 1104-1 is connected to the RCK-2 port of the third slave device 1104-2, whose TCK-2 port is connected to the RCK-3 port of the fourth (the last) slave device 1104-3. The TCK-3 port of the fourth slave device 1104-3 is connected to the RCK port of the master device 1102.
Referring to FIGS. 11 and 12, the master device 1102 generates the master output clock signal STCK, which is sent out to the first slave device 1104-0 over the TCK port. The signal STCK reaches the RCK-0 port of the slave device 1104-0, in the form of the input clock signal SRCK-0 and provided to the slave controller 1106 and the clock synchronizer 1150. The input clock signal SRCK-0 is processed by the clock synchronizer 1150 and the output clock signal STCK-0 is provided via the TCK-0 port of the device 1104-0. This clock distribution by the clock transfer fashion continues until the output clock signal STCK-3 is output by the fourth (i.e., last) slave device 1104-3 to the master device 1102. The signal STCK-3 is output over the TCK-3 port thereof and is received as the master input clock signal SRCK by the RCK port of the master device 1102. Thus, the master input clock signal SRCK is a propagated version of the master output clock signal STCK re-synchronized by the clock synchronizer 1150 in each of the slave devices 1104-0 - - - 3.
The master device 1102 is now described in greater detail. In the particular example, the master device 1102 includes a clock generator 1108, a master controller 1110 and a data receiver 1112. The clock generator 1108, which is identical to the clock generator 908 of FIG. 8, generates the master output clock signal STCK, which is supplied to slave device 1104-0. The master controller 1110, which can be identical to the master controller 910 of FIG. 8, issues commands, activates the master input port enable signal SIPE and the master output port enable signal SOPE at the appropriate instants. The signals output by the master controller 1110 are timed, so that the intended acquisition instants are aligned with the rising edges of clock pulses of the master output clock signal STCK. The data receiver 1112 accepts responses provided by the slave devices 1104-0 - - - 3 in the serial interconnection.
The function of the master controller 1110 is similar to that of the master controllers 610 and 910 of FIGS. 5 and 8. The master controller 1110 is operative to issue an access command for a “target” device. The target device may be the first slave device 1104-0 or any other of the slave devices 1104-1, 1104-2, 1104-3 in the serial interconnection. For notational convenience, the target device is denoted 1104-t, where 0≦t≦3. The master controller 1110 also ensures that the master serial output information signal SSOP is aligned with the master serial input port enable signal SIPE. Thus, the first slave device 1104-0 receives the serial input information signal SSIP-0 containing the command string including an access command at its SIP-0 port. The master input port enable signal is received by the first slave device 1104-0 at its IPE-0 port in the form of the input port enable signal SIPE-0.
Where the access command is a read command, the master output port enable signal SOPE is also activated after the issuance of the first, second and third bytes of the command string. The master output port enable signal SOPE is kept activated for a suitable length of time commensurate with the amount of response data expected from the target device 1104-t. The master serial output port enable signal SOPE is, thus, received by the first slave device 1104-0 at the its OPE-0 port in the form of the output port enable signal SOPE-0.
Upon receipt of the command by the first slave device 1104-0 at its SIP-0 port, the slave controller 1106 in the first slave device 1104-0 determines whether the first slave device 1104-0 is the target device 1104-t. This can be done by verifying the device address specified in the first byte of the command string. In the case where the first slave device 1104-0 is the target device 1104-t, the slave controller 1106 interprets the remaining second and third bytes of the command string. Then, the first slave device 1104-0 (i.e., the target device 1104-t) operates in accordance with the instructions identified by the second and third bytes of the command string. In the specific case of the read command, the slave controller 1106 in the first slave device 1104-0 produces read data by accessing the contents of one or more specified locations reads in the memory array 208. The slave controller 1106, then, waits for the output port enable signal SOPE-0 to be activated before placing the read data onto the SOP-0 port after another TIOL-0 clock cycles+TPAR-0 picoseconds.
Additionally, the slave controller 1106 transfers the signals appearing at the IPE-0 and OPE-0 ports onto the IPEQ-0 and OPEQ-0 ports, respectively, after TIOL-0 clock cycles+TPAR-0 picoseconds.
If the first slave device 1104-0 is not the target device 1104-t, the slave controller 1106 in the first slave device 1104-0 simply re-transmits the received serial information towards the next slave device 1104-1. That is, the slave controller 1106 transfers the serial information received via the SIP-0 port onto the SOP-0 port after TIOL clock cycles. Additionally, as already described, the slave controller 1106 transfers the signals appearing at the IPE-0 and OPE-0 ports onto the IPEQ-0 and OPEQ-0 ports, respectively, after TIOL-0 clock cycles+TPAR-0 picoseconds.
It should be noted that the operations of the slave controller 1106 are driven by rising and/or falling edges in the input clock signal SRCK-0. The input clock signal SRCK-0 is output by the master device 1102 as the master output clock signal STCK and received via the RCK-0 port of slave device 1104-0. The input clock signal SRCK-0 is used to control operation of the clock synchronizer 1150, which strives to produce the output clock signal STCK-0 synchronized with the input clock signal SRCK-0 Thus, the output clock signal STCK-0 is provided to the second slave device 1104-1, the operations of which are synchronized with the echo signals SIPEQ-0, SOPEQ-0 and the output information signal SSOP-0. The output clock signal STCK-0 is a propagated version of the master output clock signal STCK.
The same basic operations are performed at each of the succeeding slave devices 1104-1, 1104-2 and 1104-3. It should be noted that at some point, the information appearing on the SOP-t port (i.e., the SOP-j port of the given one of the slave devices 1104-0 - - - 3 that is the target device 1104-t) contains response data that is destined for the master device 1102. The response data continues to be propagated until it is transmitted in the form of the serial output information signal SSOP-3 by the last slave device 1104-3 via its SOP-3 port. The serial output information signal SSOP-3 containing the response data is received at the SIP port of the master device 1102 in the form of the master serial input information signal SSIP. Similarly, the master output clock signal continues to be propagated until it is transmitted in the form of the output clock signal STCK-3 by the last slave device 1104-3 via its TCK-3 port. The output clock signal STCK-3 is received at the RCK port of the master device 1102 in the form of the master input clock signal SRCK.
As can be appreciated from the above description, the master device 1102 issues a read command to control the behavior of the target device 1104-t in the serial interconnection by using the SIP, IPE and OPE ports. The target device 1104-t, then, responds to the instructions from the master device 1102 and transmits read data further along the serial interconnection. The read data (i.e., the response data) is released by the target device 1104-t, after the target device 1104-t detects activation of the output port enable signal (i.e., SOPE-t). The signal SOPE-t is a version of the master output port enable signal SOPE that is delayed by TIOL-j clock cycles+TPAR-j picoseconds at each preceding slave device in the serial interconnection (i.e., for j<t). The release of the response data by the target device 1104-t is delayed relative to activation of the master output port enable signal SOPE by the sum (or total) of the flow-through latencies of all device up to and including the target device 1104-t. Thereafter, the response data undergoes a further delay of TIOL-j clock cycles+TPAR-j picoseconds at each succeeding device in the serial interconnection (i.e., for j>t). Thus, the response data appearing in the master serial input information signal SSIP is delayed relative to activation of the master output port enable signal SOPE by a total flow-through latency of the serial interconnection, denoted TIOL-TOTAL, where TIOL-TOTAL=ΣjTIOL-j clock cycles+ΣjTPAR-j picoseconds.
Meanwhile, the master input clock signal SRCK is a version of the master output clock signal STCK that is re-synchronized at, and propagated by, each of the devices in the serial interconnection. Because of the periodicity of the clock signal being propagated, the mis-alignment between the master input clock signal SRCK and the master output clock signal STCK manifests itself only as the total parasitic delay of ΣjTPAR-j picoseconds.
The master device 1102 begins to receive the response data via its SIP port at a time instant that is delayed relative to activation of the master output port enable signal SOPE by TIOL-TOTAL. As described above with reference to FIGS. 8-10, this time instant may not apparent from the content of the master serial input information signal SSIP itself, but is apparent from the master echo signal SOPEQ. In the particular example, the master echo signal SOPEQ is a propagated version of the master output port enable signal SOPE. It has undergone the same delay as the master serial input information signal SSIP, corresponding to the total flow-through latency TIOL-TOTAL. Thus, processing of the master echo signal SOPEQ can permit the master device 1102 to extract valid data from the master serial input information signal SSIP. The total flow-through latency TIOL-TOTAL includes a cumulative parasitic delay ΣjTPAR-j picoseconds induced by the slave devices 1104-0 - - - 3. The TIOL-TOTAL is not a whole number of clock cycles. It is, therefore, advantageous to use the master input clock signal SRCK for the purposes of establishing acquisition instants, because it takes into account this parasitic delay.
FIG. 13 shows details of the data receiver of FIG. 12. Referring to FIG. 13, the data receiver 1112 includes a first input buffer 1220, a second input buffer 1222, a third input buffer 1224, a first D-FF 1230, a second D-FF 1232, a third D-FF 1234, an AND gate 1240 and a delay element 1250.
The first input buffer 1220 receives the master serial input information signal SSIP arriving at the SIP port of the master device 1102. The first input buffer 1220 outputs an intermediate signal SSIP — INT, which is fed to a data input (D) of the first D-FF 1230. The intermediate signal SSIP — INT is, thus, a slightly delayed version of the master serial input information signal SSIP.
The second input buffer 1222 receives the master echo signal SOPEQ arriving at the OPEQ port of the master device 1102. The second input buffer 1222 outputs an intermediate echo signal SOPEQ — INT, which is fed to a data input (D) of the second D-FF 1232. The intermediate echo signal SOPEQ — INT is, thus, a slightly delayed version of the master echo signal SOPEQ.
The third input buffer 1224 receives the master input clock signal SRCK arriving at the RCK port of the master device 1102. The third input buffer 1224 outputs an intermediate clock signal SCLK — INT, which is fed to the clock inputs CK of the first and second D-FFs 1230 and 1232 and the delay element 1250. The intermediate clock signal SCLK — INT is a slightly delayed version of the master input clock signal SRCK.
The first D-FF 1230 operates to transfer the signal at its data input (i.e., the intermediate signal SSIP — INT) onto a data output (Q) in dependence upon the intermediate clock signal SCLK — INT. A latched output signal SSIP — LAT is provided from the data output of the D-FF 1230. Similarly, the second D-FF 1232 operates to transfer the signal at its data input (i.e., the intermediate echo signal SOPEQ — INT) onto a data output (Q) in dependence upon the intermediate clock signal SCLK — INT. The D-FF 1232 provides a latched echo signal SOPEQ — LAT of the echo signal SOPEQ-j to the succeeding device.
The delay element 1250 delays the intermediate clock signal SCLK — INT with a predetermined time and provides a delayed clock signal SCLK — DLY. The AND gate 1240 performs a logical AND operation on the latched echo signal SOPEQ — LAT and the delayed clock signal SCLK — DLY. An AND logic output signal is provided as a latch clock signal SCLK — LAT to the clock input CK of the third D-FF 1234.
The latched output signal SSIP — LAT from the first D-FF 1230 is fed to a data input (D) of the third D-FF 1234. The third D-FF 1234 operates to transfer the signal at its data input (D) onto a data output (Q) in dependence upon the latch clock signal SCLK — LAT.
The latch clock signal SCLK — LAT is the result of the AND logic operation of a suitably delayed version of the master input clock signal SRCK and the intermediate echo signal SOPEQ — INT. The delay element 1250 can apply a delay that is adjustable depending on variations in process, temperature and/or power supply level. The delay element 1250 serves to avoid timing glitches on the signal at the latch clock signal SCLK — LAT. In one example, the delay element 1250 is designed to apply approximately the same delay as the set-up and hold time of the second D-FF, so that the signals at the two inputs of the AND gate 1240 are aligned with one another (i.e., the latched echo signal SOPEQ — LAT and the delayed clock signal SCLK — DLY).
The master echo signal SOPEQ (and hence the intermediate echo signal SOPEQ — INT) is delayed relative to the master output port enable signal SOPE by the total flow-through latency TIOL-TOTAL including the total parasitic delay of ΣjTPAR-j. It means that the third D-FF 1234 only begins transferring the data at its data input (i.e., the data carried by the intermediate signal SSIP — INT) to its data output after a delay of TIOL-TOTAL clock cycles following activation of the master output port enable signal SOPE. Recalling that this is the same delay experienced by the response data present in the master serial input information signal SSIP (or the slightly delayed intermediate signal SSIP — INT) relative to activation of the master output port enable signal SOPE, it will become apparent that activation of the latch clock signal SCLK — LAT will correspond to the onset of a time window during which the master serial input information signal SSIP (or the slightly delayed intermediate signal SSIP — INT) is known to validly carry data output by the target device via the last slave device 1104-3 or just the target device if it is itself the last slave device in the serial interconnection. Moreover, the fact that the master received clock signal SRCK (or the delayed intermediate clock signal SCLK — INT) takes into account the parasitic delay ΣjTPAR-j introduced by the slave devices 1104-0 - - - 3 allows the acquisition instants established by the latch clock signal SCLK — LAT to be properly aligned, without sacrificing set-up or hold time margins. Thus, the contents of the intermediate signal SSIP — INT latched by the circuitry of the master device 1102 allow timely capture of the response data that is actually sent by the target device.
The activation and deactivation of the latched echo signal SOPEQ — LAT are delayed from those of the master serial output port enable signal SOPE. An amount of the delay includes the total flow-through latency TIOL-TOTAL and the total parasitic delay of ΣjTPAR-j. In response to the latch clock signal SCLK — LAT, the D-FF 1234 latches the first to last valid response data contained in the latched output signal SSIP — LAT sequentially during a latch period TLATCH3, as shown in FIG. 14B. The latched data “Data_Latched”, the latched echo signal SOPEQ — LAT and the delayed clock signal SCLK — DLY are provided to the master controller 1110 of the master device 1102.
Thus, the clock distribution by a clock transfer fashion is used to overcome fanout limitations and while the parasitic delays, that may be incurred, can be neutralized.
FIGS. 14A and 14B show the behaviour of various signals in FIGS. 12 and 13, the signals including the input clock signals SRCK-0 (equivalent to the master output clock signal STCK), SRCK-1, SRCK-2, SRCK-3, the output clock signals STCK-0, STCK-1, STCK-2, STCK-3 (equivalent to the master input clock signal SRCK), the master output port enable signal SOPE (equivalent to the output port enable signal SOPE-0), the echo signals SOPEQ-0, SOPEQ-1, SOPEQ-2 and SOPEQ-3 (equivalent to the master echo signal SOPEQ), the output information signals SSOP-0, SSOP-1, SSOP-2 and SSOP-3 (equivalent to the master serial input information signal SSIP), the intermediate signal SSIP — INT, the intermediate echo signal SOPEQ — INT, the intermediate clock signal SCLK — INT, the clock signal SCLK — LAT, the output of the delay element 1250 and the latched data at the latch data outputs of the first, second and third D-FF 1230, 1232, 1234. In this case, it is seen that the target device 1104-t is slave device 1104-1, as evidenced by the first appearance of response data on the output information signal SSOP-1 following time T04, namely TIOL-0=3 clock cycles+TPAR-0 picoseconds following the activation of the master output port enable signal SOPE at time T01.
Referring to FIGS. 12, 13, 14A and 14B, the master controller 1110 issues the master output port enable signal SOPE in response to the rising edge of the master input clock signal SRCK at time T01. This is illustrated for the master output port enable signal SOPEQ by an arrow 1410 between acquisition instants T00 and T01. Thus, the master output port enable signal SOPE has stabilized by the time the master input clock signal SRCK presents a subsequent rising edge at time T01. Assuming that slave device 1104-1 is the target device (based on a previous selection made by virtue of a read command received from the master device 1102), it is the only device to be responsive to a received output port enable signal. Therefore, slave device 1104-0 does not respond to the output port enable signal SOPE-0 and just forwards both it and the input information signal SSIP-0 to the OPEQ-0 and SOP-0 ports, respectively, with TIOL-0=3 clock cycles+TPAR-0 picoseconds of latency, synchronized with the output clock signal STCK-0.
Slave device 1104-1 detects activation of the output port enable signal SOPE-1 at time T04+TPAR-0 picoseconds and is responsive thereto. It, then, starts producing response data through its SOP-1 port. The response data is stabilized by the time the output clock signal STCK-1 presents a next rising edge at time T05+TPAR-0+TPAR-1 picoseconds. From this point, valid response data from slave device 1104-1 flows through the SIP-j and SOP-j ports of the remaining slave devices synchronized with the respective output clock signal STCK-j at each slave device, as shown in FIGS. 14A and 14B.
The data receiver 1112, then, receives the master serial input information signal SSIP (which corresponds to the serial output information signal SSOP-3) from the last slave device 1104-3 in the serial interconnection, which signal will contain valid response if sampled starting at time T08+TPAR-0+TPAR-1+TPAR-2+TPAR-3 picoseconds, i.e., after a total of TIOL-TOTAL=7 clock cycles+ΣjTPAR-j picoseconds in this example. In parallel, the data receiver 1112 receives the master echo signal SOPEQ from the last slave device 1104-3, which is the same as the master output port enable signal SOPE but is delayed by 7 clock cycles+ΣjTPAR-j picoseconds in this example.
The master echo signal (and hence the intermediate echo signal SOPEQ — INT) is delayed relative to the master output port enable signal SOPE by the same total flow-through latency TIOL-TOTAL as the response data contained in the master serial input information signal SSIP. The acquisition instant established by the first rising edge in the latch clock signal SCLK — LAT at the output of the logical AND gate 1240 will correctly signal the onset of valid data in the intermediate signal SSIP — INT (which is a slightly delayed version of the master serial input information signal SSIP). Meanwhile, any parasitic delays in the master serial input information signal SSIP are neutralized by the fact that they are also present in the master input clock signal SRCK from which are established the acquisition instants used to latch the response data in the master serial input information signal SSIP. Moreover, any changes in total flow-through latency TIOL-TOTAL due to changes in the operating properties of the individual slave devices 1104-0 - - - 3 are transparent to the system 1202 due to the master echo signal SOPEQ being fed back from the last slave device 1104-3 in the serial interconnection.
The circuit of FIG. 13 is just an example. Any modifications and variations of the circuit of FIG. 13 to achieve the desired functionality are considered to be within the scope of the present invention and modifications are possible. For example, the AND gate 1240 introduces a delay which, although negligible at some operating frequencies, may require compensation at other operating frequencies in order to ensure accuracy at each acquisition instant. To this end, a compensation buffer 1260 (shown in dashed outline) may be inserted in the path of the intermediate signal SSIP — INT in order to cause the signal at the data input of the first D-FF 1230 to be properly aligned relative to the acquisition instants established by the latch clock signal SCLK — LAT. Still other modifications and variations are possible.
For example, one can simplify the system 1202 by eliminating the delay element 1250. When this is done at sufficiently low operating frequencies of the system 1202, this will not risk resulting in an initial overlap situation between detected activation of the master echo signal SOPEQ and the falling edge of the previous pulse in the master input clock signal SRCK due to spurious pulses on the latch clock signal SCLK — LAT. Another alternative that allows elimination of the delay element is to design the system 1202 to reference the falling edge of the master input clock signal SRCK rather than its rising edge.
The above embodiments have considered circuitry designed such that the acquisition instant established by the rising and/or falling edges of a clock signal are aligned with the data to be captured. That is to say, in the embodiments above, the rising and/or falling edges of the master output clock signal STCK or the master input clock signal SRCK appear at instants in time when the signal being latched is stable and contains the desired data to be captured. This is known as “center-aligned” clock signal alignment technique. However, it should be understood that the present invention applies without limitation to other clock signal alignment techniques, including “edge-aligned” (or “source-synchronous”) clock signal alignment. One example of a system that uses edge-aligned clock signals is now described with reference to FIG. 15, which shows a system 1502 including a master device 1582 and a serial interconnection of slave devices 1504-0 - - - 3. While in the present example there are four slave devices 1504-0 - - - 3, it would be apparent to those of ordinary skill in the art that the system 1502 may include any number of slave devices.
The slave devices 1504-0 - - - 3 are virtually identical to the slave devices 1104-0 - - - 3 described earlier with reference to FIG. 12, except that they are adapted to operate using edge-aligned clock signals. They will not be described in detail here, as the modifications to their structure and operation will be understood to those skilled in the art. For its part, the master device 1582 is virtually identical to the master device 1102 previously described in terms of the way in which it interfaces with the slave devices 1504-0 - - - 3. The only difference in the master device 1582 is in a data receiver 1512, which accepts responses generated by the slave devices 1504-0 - - - 3 in the serial interconnection. The master device 1582 also includes a clock generator 1508 and a master controller 1510 that are similar to the clock generator 1108 and the master controller 1110 of the master device 1102 shown in FIG. 12.
FIG. 16 shows details of the data receiver 1512 of FIG. 15. Referring to FIG. 16, the data receiver 1512 comprises a first input buffer 1520, a second input buffer 1522, a third input buffer 1524, a first delay element 1530, a second delay element 1532, a phase shifter 1540, a first D-FF 1550, a second D-FF 1552 and an AND gate 1560.
The first input buffer 1520 receives the master serial input information signal SSIP arriving at the SIP port of the master device 1582. The first input buffer 1520 outputs an intermediate signal SSIP — INT, which is fed to an input of the first delay element 1530. The intermediate signal SSIP — INT is, thus, a slightly delayed version of the master serial input information signal SSIP. The first delay element 1530 can apply a delay (tD2) that is adjustable depending on variations in process, temperature and/or power supply level. In one example, the first delay element 1530 is designed to apply a delay that compensates for the AND gate 1560 in order to provide adequate setup/hold time margins.
The second input buffer 1522 receives the master echo signal SOPEQ arriving at the OPEQ port of the master device 1582. The second input buffer 1522 outputs an intermediate echo signal SOPEQ — INT, which is fed to an input of the second delay element 1532. The intermediate echo signal SOPEQ — INT is, thus, a slightly delayed version of the master echo signal SOPEQ. The second delay element 1532 delays the intermediate echo signal SOPEQ — INT in order to avoid unexpected timing glitches on a latch clock signal SCLK — LAT. The second delay element 1532 can apply a delay (tD1) that is adjustable depending on variations in process, temperature and/or power supply level.
The third input buffer 1524 receives the master input clock signal SRCK arriving at the RCK port of the master device 1582. The third input buffer 1524 outputs an intermediate clock signal SCLK — INT, which is fed to an input of the phase shifter 1540. The intermediate clock signal SCLK — INT is, thus, a slightly delayed version of the master input clock signal SRCK. The phase shifter 1540 provides a phase shifted clock signal SCLK — SHT. Thus, the shifted clock signal SCLK — SHT is a phase shifted version of the master input clock signal SRCK. By way of example, for a single-ended clock with single-data-rate operation, the phase shifter 1540 may apply a phase shift of 180 degrees (half a clock cycle), or 90 degrees (one-quarter of a clock cycle) for a single-ended clock with double-data-rate operation. This is to ensure that the center of the data eye of the input data signals (e.g., the master serial input information signal SSIP and the master echo signal SOPEQ) are well aligned with the rising edge of the (shifted) intermediate clock signal SCLK — INT. The phase shifted clock signal SCLK — SHT is fed to the clock input CK of the D-FF 1552.
The output of the first delay element 1530, (SSIP — DLY), is fed to a data input (D) of the first D-FF 1550, which operates to transfer the signal at its data input (i.e., a delayed intermediate signal SSIP — DLY or a delayed version of the intermediate signal SSIP — INT) onto a data output (Q) in dependence upon the latch clock signal SCLK — LAT. This latch clock signal SCLK — LAT is supplied by the AND gate 1560, which applies a logical AND operation on the signals present at its two inputs. The signal at one of the inputs of the AND gate 1560 is the output of the second delay element 1532, SOPEQ — DLY The signal at the other one of the inputs of the AND gate 1560 is the signal at the output of the phase shifter 1540, SCLK — SHT. The latch clock signal SCLK — LAT is fed to the clock input CK of the D-FF 1550.
Meanwhile, the output of the second delay element 1532 (i.e., a delayed echo signal SOPEQ — DLY or a delayed version of the intermediate echo signal SOPEQ — INT) is fed to a data input (D) of the second D-FF 1552, which operates to transfer the signal SOPEQ — DLY onto a data output (Q) in dependence upon the phase shifted clock signal SCLK — SHT. In one example, the first delay element 1530 is designed to apply approximately the same delay as the second delay element 1532, so that the signals at the data inputs of the first D-FF 1550 and the second D-FF 1552 are aligned with one another when they are latched by the respective D-FFs.
With reference to FIGS. 17A and 17B, there is shown a timing diagram that depicts the various signals in FIGS. 15 and 16, including the input clock signals SRCK-0 (equivalent to the master output clock signal STCK), SRCK-1, SRCK-2, SRCK-3, the output clock signals STCK-0, STCK-1, STCK-2, STCK-3 (equivalent to the master input clock signal SRCK), the master output port enable signal SOPE (equivalent to the output port enable signal SOPE-0), the echo signals SOPEQ-0, SOPEQ-1, SOPEQ-2 and SOPEQ-3 (equivalent to the master echo signal SOPEQ), the output information signals SSOP-0, SSOP-1, SSOP-2 and SSOP-3 (equivalent to the master serial input information signal SSIP), the intermediate signal SSIP — INT, the intermediate echo signal SOPEQ — INT, the intermediate clock signal SCLK — INT, the latch clock signal SCLK — LAT, the output of the phase shifter 1540, the output of the second delay element 1532, the output of the first delay element 1530 and the latched data at the data output of the first D-FF 1550. In this case, it is seen that the target device 1104-t is slave device 1104-1, as evidenced by the first appearance of response data on the output information signal SSOP-1 following time T04 and in alignment with the rising edge of the output clock signal STCK-1.
The activation and deactivation of the delayed echo signal SOPEQ — DLY are delayed from those of the master serial output port enable signal SOPE. An amount of the delay includes the total flow-through latency TIOL-TOTAL and the total parasitic delay of ΣjTPAR-j. Also, the latch clock signal SCLK — LAT is phase-shifted from the master input clock signal SRCK. In response to the latch clock signal SCLK — LAT, the D-FF 1550 latches the first to last valid response data contained in the delayed intermediate signal SSIP — DLY sequentially and in relevant phase during a latch period TLATCH4, as shown in FIG. 17B. The latched data “Data_Latched”, the latched echo signal SOPEQ — LAT and the shifted clock signal SCLK — SHT are provided to the master controller 1510 of the master device 1582.
The circuit of FIG. 16 is just an example. Any modifications and variations of the circuit of FIG. 16 to achieve the desired functionality are considered to be within the scope of the present invention and modifications are possible.
Each of the D-FF 1230, 1232, 1234, 1550 and 1552 is an example of latching circuitry. It would be apparent to those skilled in the art that there are numerous other alternatives to achieve such a latching function.
It will, therefore, be appreciated that in some embodiments of the present invention, a system is provided in which a plurality of semiconductor devices are joined to a master device in a feedforward ring type interconnection, whereby the master device pre-determines the total flow-through latency in order to result in accurate establishment of acquisition instants for capture of response data received from a target device.
It will, therefore, be appreciated that in other embodiments of the present invention, a system is provided in which a plurality of semiconductor devices are joined to a master device in a feedback ring type interconnection, whereby the master device relies on propagated signals (e.g., an output port enable signal and, in some cases, a cascaded clock signal) to accurately establish acquisition instants for capture of response data received from a target device.
Thus, systems in accordance with embodiments of the present invention can be operated at higher frequency with minimized and cost effective data receivers in memory controllers.
In the system, the format of the data transferred by the serial output information signal and the serial input information signal may be serial bit or parallel bit.
The embodiments described above are examples and it would be apparent to those of ordinary skill in the art that there would be many variants to the present invention. These variants are, for example, changes in clock rate (e.g., single data rate (SDR), double data rate (DDR), quad data rate (QDR), octal data rate (ODR), graphics double data rate (GDDR)), clock synchronization (e.g., source-synchronous, center-aligned), signal level (e.g., single-ended, differential), the number of slave devices in the serial interconnection, voltage supply levels, whether a signal is considered active when high or when low, and various other functional characteristics. There is also no limitation on the types of slave devices that may be interconnected or on the number of different types of devices connected in the same serial interconnection.
Moreover, where components and circuitry of the various devices of the system have been illustrated as being directly connected to one another, one should appreciate that this has been done for the sake of simplicity and that other components and circuitry may be placed therebetween or coupled thereto without detracting from the spirit of the invention. As a result, what appear to be direct connections in the drawings may in fact be implemented as indirect connections in an actual realization.
Furthermore, although the various signals traveling among slave devices, or between slave devices and the master device, have been described and illustrated as having a single bit-width, it will be within the purview of a skilled technician to modify the various components of the systems 502, 802, 1202, 1502 and their interfaces to allow for the communication of one or more signals having a multi-bit width. Also, it is within the scope of the present invention to provide multiple sets of signals each having a single bit-width. Thus, for example, where a two-bit wide clock is desired, one can implement this feature by using multiple single-bit-width clock sub-signals or by using a single clock signal that is two bits in width. For a signal requiring a greater bit width, a combination of sub-signals, each with a particular bit-width, can be used.
It would also be apparent to those of ordinary skill in the art that the operations and functions of certain ones of the above-described controllers, processors and other elements may be achieved by hardware or software.
receiving the output signal from the last device to capture the response data in response to the acquisition instant.
enabling the target device identified by the first instruction information, so that the enabled target device provides the response data.
issuing an access command as the second instruction information destined for the target device, so that the target device performs the operation in accordance with the access command.
the step of receiving comprises starting the capturing of the response data in the output signal in response to the first acquisition instant.
the step of receiving comprises capturing of the response data in the output signal in response to the acquisition instant.
in response to the read command as the second instruction information contained in the command string, the target device reading data from a memory location in the memory, the memory location being identified by the third instruction information, the read data being provided as the response data.
signal latching circuitry for latching the output signal at the acquisition instant to capture the response data.
9. The apparatus of claim 8, wherein the controller is capable of sending an enable signal to enable the target device to provide the response data.
10. The apparatus of claim 9, wherein the controller is further capable of issuing an access command as the second instruction information destined for the target device, the target device performing an access operation in accordance with the access command and providing the response data.
the signal latching circuitry comprises data latching circuitry for latching the output signal containing the response data in response to the latch clock signal to capture the response data.
the clock producer comprises logic circuitry for performing a logic operation on the clock signal from the controller and the propagated enable signal to produce the latch clocks.
logic circuitry for performing a logic operation on the delayed or non-delayed propagated clock signal and the delayed or non-delayed propagated enable signal to produce the latch clocks.
the logic circuitry comprises AND logic circuitry for performing an AND operation on the delayed propagated clock signal and the delayed propagated enable signal to produce the latch clocks.
18. The apparatus of claim 15, wherein the signal latching circuitry further comprises data delay circuitry for delaying the output signal containing the response data, the delayed output signal being provided to the data latching circuitry to capture the response data.
logic circuitry for performing a logic operation on the delayed propagated enable signal and the phase-shifted propagated clock signal to produce the latch clocks.
the logic circuitry comprises AND logic circuitry for performing an AND logic operation on the delayed propagated enable signal and the phase-shifted propagated clock signal to provide the latch clock signal, the latching circuitry capturing the response data in response to the latch clock signal.
the target device reads data from the memory location in the memory in accordance with the third instruction information in response to the read command and provides the read data as the response data.
circuitry for latching the output signal at the acquisition instant to capture of the response data.
latching the output signal in response to the acquisition instant to capture of the response data.
a receiver configured to establish an acquisition instant in response to the command and to latch the output signal in response to the acquisition instant to capture of the response data.
the target device reads data from a memory location in the memory identified by the third instruction information and provides the read data as the response data.

References: Application No. 60
 Application No. 60
 Application No. 60
 Application No. 60
 Application No. 60
 Application No. 60