Caching error checking data for memory having inline storage configurations

Various embodiments provide for caching of error checking data for memory having inline storage configurations for primary data and error checking data for the primary data. In particular, various embodiments described herein provide for error checking data caching and cancellation of error checking data read commands for memory having inline storage configurations for primary data and associated error checking data. Additionally, various embodiments described herein provide for combining/canceling of error checking data write commands for memory having inline storage configurations for primary data and associated error checking data.

TECHNICAL FIELD

Embodiments described herein relate to memory and, more particularly, to systems, methods, devices, and instructions for caching error checking data for memory having inline storage configurations.

BACKGROUND

Memory controllers are generally circuits dedicated to controlling and managing the flow of data written to and read from one or more memory devices. They may be suitably formed as separate devices or integrated with a central processing unit or other main controller, and serve the memory storage and access needs of various software application operations. Memory controllers implement the logic to read from and write to various types of memory devices, examples of which include dynamic random access memory (DRAM), as well as electrically programmable types of non-volatile memory such as flash memory, and the like.

To minimize the consequences of data corruption due to random sources of error, various error checking measures for detection and/or correction are employed in the art for the storage and retrieval of data from memory devices. One example of the various known measures is the use of an Error Correcting Code (ECC) feature for detection or correction of error in data words read from one or more memory devices. An ECC feature is usually used in memory controllers for computing devices that are particularly vulnerable to data corruption, or for computing devices involved in high data rate or other applications where substantial immunity to data corruption is particularly important. ECC features generally involve adding redundant ECC bits to a transmitted data segment (e.g., transmitted to a memory device) according to a predetermined code (of a selected ECC format). These ECC bits are of parity-type, and permit the data segment to be properly recovered at the receiving end (by a receiving/recovery method suitably configured for the given ECC format), even if certain correctable errors were introduced in the transmission or storage of that data segment. The degree to which the errors are correctable would depend on the relevant properties of the particular code being used.

Memory controllers generally transmit, receive, and store data words, and a data word format may be defined by a multiple number of bytes. The multiple data bytes of each data word may be stored in a memory device formed by a plurality of integrated circuit chips, and each data byte may be stored in a different selectable chip of the memory device at the same relative address within each selectable chip.

Some memory controllers are configured for storage of such ECC-protected data according to a sideband ECC storage scheme (or format). A sideband scheme for storing ECC and data bits usually provides for an additional chip (e.g., an ECC chip) in which the ECC byte associated with a given data word's data bytes is exclusively stored. The data word's ECC byte is then stored much like its data bytes—at the same intra-chip address as those data bytes, but in its dedicated sideband ECC chip. For example, in some ECC-protected memory controller applications, a data word may be defined by 72 total bits, segmented into eight 8-bit data bytes and one 8-bit ECC byte (one ECC bit for each of the eight 8-bit data bytes). For such an example (a 72-bit data word formed by 8 data bytes plus 1 ECC byte), the data word is stored across nine selectable chips—eight selectable chips for the data bytes and one selectable chip for the associated ECC byte. Under the sideband ECC storage scheme, memory transactions for reading and writing data to and from memory devices contemplate and support sideband storage of ECC bytes with their associated data bytes (e.g., data words).

Other memory controllers may use a non-sideband ECC memory storage scheme, such as an ECC storage scheme (or format) where ECC-protected bytes are stored inline (along) with their ECC bytes in one or more of chips available on a given memory device. For example, under an inline ECC storage scheme, a portion of the memory storage locations available on a chip of a memory device may be allocated for primary data bytes and the remainder allocated for ECC bytes so that the ECC bytes are stored inline with the primary data bytes. Additionally, a memory controller implementing an inline ECC storage scheme may adapt a memory transaction for inline storage configurations, where different portions of given data words are stored at different intra-chip addresses. In this way, available memory device chips may be shared for data and ECC bit storage according to a wide range of memory space configurations depending on such factors as data word size, the number and layout of available storage cells, and the like. An inline ECC storage scheme may be utilized when ECC protection for memory transactions exists but a memory device is not adequately equipped or configured to support sideband storage of ECC bytes. For example, an inline ECC storage scheme (or feature) can provide ECC protection similar to a sideband ECC memory storage scheme without the sideband ECC memory storage scheme's need to widen the memory data path between a memory controller and a memory device to communicate ECC on dedicated pins alongside memory data (e.g., a 9-byte wide memory interface where 8 bytes of the memory are data and 1 byte is the ECC for the 8 bytes of data).

DETAILED DESCRIPTION

Various embodiments provide for caching of error checking data for memory having inline storage configurations for primary data and error checking data for the primary data. In particular, various embodiments described herein provide for error checking data caching and cancellation of error checking data read commands for memory having inline storage configurations for primary data and associated error checking data. Additionally, various embodiments described herein provide for combining/canceling of error checking data write commands for memory having inline storage configurations for primary data and associated error checking data.

As used herein, “primary data” may refer to data that is stored or to be stored on a memory and that is intended to be checked or protected by error checking data. Error checking data for primary data can include ECC data. A memory burst command/operation (or burst mode memory command/operation) may refer to a command/operation that results in repetitious transmission of data a predetermined number of times to result in a memory data path width (DP) times burst length (BL) worth of data, without need to transmit each piece of data in a separate transaction (e.g., a single memory burst read command for a typical central processing unit (CPU) fetches a cache line worth of data). For example, where memory burst command/operation has a burst length of 16 (BL=16) and a 16-bit data path width (DP=16), a single burst command will result in transmission of 256-bits (32 bytes) of data by a single memory transaction, rather than multiple separate memory transactions (e.g., 16 separate 16-bit memory transactions). Accordingly, a memory burst read command/operation performed with respect to a memory can result in the reading (e.g., fetching) of a predetermined number of data words stored on the memory, and a memory burst write command/operation performed with respect to a memory can result in the writing of a predetermined number of data words to the memory. A data word can include a predetermined number of bytes (e.g., 8 bytes for a 64-bit data word).

As used herein, inline primary data addresses refer to memory addresses of a memory that correspond to those segments of the memory that store primary data on the memory. Inline error checking data addresses refer to memory addresses of a memory that correspond to those segments of the memory that store error checking data on the memory.

As used herein, an error checking data address range (e.g., ECC address range) may include all inline error checking data addresses associated with (e.g., that map to) a primary data memory transaction with respect to a range of inline primary data addresses on a memory. For example, an ECC address range with respect to a memory may include all inline error checking data addresses that correspond to error checking data, on the memory, associated with a plurality of primary data memory burst transactions. For instance, with a primary data-to-ECC ratio of 8 to 1, an ECC address range may be associated with a single memory burst worth of ECC data on a memory that covers 8 memory bursts worth of primary data on the memory.

As used herein, an error checking data address range boundary determines when one error checking data address range ends and another error checking data address range begins.

As used herein, an error checking data buffer (e.g., ECC data buffer) may comprise a single storage element that will store a single memory burst reading of error checking data (e.g., ECC data) stored on a memory. For example, the data size of an electronic checking data buffer would be 32 bytes where a single memory burst reading of error checking data results in 32 bytes of electronic checking data being read from the memory. Some embodiments use a plurality of error checking data buffers, where each error checking data buffer may be managed independently.

According to some embodiments, a memory stores primary data inline with error checking data for that primary data at predetermined primary data-to-error checking data ratio (e.g., primary data-to-ECC ratio). As noted herein, using an inline storage scheme for error checking data (e.g., ECC data) can provide error checking data (e.g., ECC) protection similar to a sideband memory storage scheme for error checking data without the sideband memory storage scheme's need to widen the memory data path between a memory controller and a memory to communicate error checking data on dedicated pins alongside memory data. For instance, using an inline storage scheme for error checking data, available memory space of each chip of a memory may be sectioned according to a predetermined primary data-to-error checking data ratio of 8 to 1, such that ⅞th of each chip's available memory space is dedicated for primary data bits, while ⅛th of the memory space is dedicated for error checking data bits (e.g., ECC bits). This can facilitate error checking data protection similar to a sideband memory storage scheme for error checking data that uses a 9-byte wide memory interface between a memory controller and a memory and where 8 bytes of the memory are primary data and 1 byte is the error checking data for the 8 bytes of primary data.

Additionally, for some embodiments, each bit of error checking data (e.g., ECC data) may be associated with error checking/protecting multiple bits of primary data. For instance, 1 bit of error checking data (e.g., ECC data) may error check/protect 1 byte of primary data and, accordingly, 1 byte of error checking data (e.g., ECC data) may error check/protect 8 bytes of primary data, which corresponds to an 8 to 1 primary data-to-error checking data ratio (e.g., primary data-to-ECC ratio). Certain embodiments may have a different primary data-to-error checking data ratio than those discussed herein.

For some embodiments, each read command to the memory is performed as a memory burst commands/operation and, as such, a read command to error checking data (e.g., ECC read command) is performed as a single memory burst command/operation resulting in an amount of error checking data equal to a data path times burst length of the single memory burst command/operation (e.g., 32 bytes of ECC data for DP=16 and BL=16). Accordingly, based on the primary data-to-error checking data ratio used by a memory to store primary data inline with associated error checking data, a single memory burst read of the error checking data from the memory results in error checking data corresponding to multiple continuous memory burst reads of the primary data from the memory. For example, for a memory using a primary data-to-ECC ratio of 8 to 1 for inline storage of primary data with ECC data, a single memory burst read of ECC data stored on the memory can fetch ECC data that corresponds to (e.g., error checks or protects)8aligned, memory burst reads of the primary data.

With respect to a memory using a primary data-to-error checking data ratio to store primary data inline with error checking data, some embodiments cache error checking data (e.g., a single memory burst read worth of error checking data) read/fetched in connection with a first memory burst read of primary data. In doing so, some such embodiments enable a subsequent (e.g., second) memory burst read of primary data, associated with the same error checking data address range as the cached error checking data, to use the cached error checking data and avoid or cancel an additional reading/fetching of error checking data from the memory for the subsequent (e.g., second) memory burst read of primary data. In this way, various embodiments obviate the need for an additional reading/fetching of error checking data from the memory by using cached error checking data, which in turn increases efficiency of read and write data traffic with respect to the memory. Such efficiency, for example, may be achieved with respect to applications where reading and writing of primary data is localized to a region of the memory. For instance, an embodiment may increase memory data traffic efficiency where a CPU is operating on a video frame that is multiple times (e.g., four times) the size of a single memory burst command/operation (e.g., read operation) and there are multiple read commands (e.g., four memory burst read commands) executed with respect to the same primary data address range on the memory. In particular, by caching error checking data (e.g., ECC data) as described herein, an embodiment may preserve the error checking data from an initial primary memory burst read. If subsequent primary memory burst reads (e.g., next three memory burst reads of primary data) may hit the same error caching data (e.g., ECC data) fetched during the initial primary memory burst read and cached, the cached error checking data can be utilized and one or more subsequent error checking data memory burst read commands can be avoided/canceled. Such a performance benefit of error checking data caching can depend on the locality of the read and write primary data traffic on the memory.

Some embodiments use error checking data caching and cancellation (or combining of) write memory commands for error checking data in a command queue (CQ). Herein, this is interchangeably referred to as write canceling for error checking data or write combining for error checking data. According to some embodiments, a primary data write command is followed by an error checking data write command for the primary data write command unless one or more subsequent error checking data write commands in the command queue hit the same error checking data buffer (e.g., ECC data buffer) as the error checking data write command. Where the one or more subsequent error checking data write commands in the command queue hit the same error checking data buffer as an error checking data write command currently selected for execution from the command queue, the error checking data write command may be canceled and an error checking data buffer may be allocated for the one or more subsequent error checking data write commands still in the command queue. By canceling the error checking data write command, the one or more subsequent error checking data write commands in the command queue hitting the same error checking data buffer can be postponed until the very last of the subsequent error checking data write commands in the command queue is selected for execution. This effectively combines several error checking data write commands in the command queue hitting the same error checking data buffer. Accordingly, write canceling/combining for error checking data can reduce the number of error checking data write commands executed, which can improve performance of a memory.

According to some embodiments, a memory read transaction for reading primary data from a memory that stores primary data inline with error checking data may have one or more of the following attributes. The memory read transaction is split into multiple primary data read commands and multiple error checking data read commands when the memory read transaction crosses one or more error checking data address range boundaries (e.g., ECC address range boundaries). The memory read transaction results in an error checking data read command for the memory read transaction unless there is a hit to an error checking data buffer (e.g., ECC data already read and stored in an ECC data buffer). If there is no hit to an error checking data buffer, an error checking data buffer (e.g., ECC data buffer) is allocated for the error checking data read command for the memory read transaction, the error checking data read command is eventually executed, and the error checking data fetched as a result of the error checking read command is stored into the allocated error checking data buffer. If there is a hit to an error checking data buffer (e.g., ECC read command hits an ECC data buffer) the error checking data read command for the memory read transaction is canceled and the error checking data stored in the error checking data buffer is used instead. The data read commands and error checking data read commands generated based on the memory read transaction may be placed consecutively in the command queues and may be executed atomically.

According to some embodiments, a memory write transaction for writing primary data from a memory that stores primary data inline with error checking data may have one or more of the following attributes. A memory write transaction not preceded by an error checking data read command (e.g., ECC read) may comprise a partial write that will result in a masked write operation, or a block write operation that spans an entire error checking data block. The memory write transaction is split into multiple primary data write commands and multiple error checking data write commands when the memory write transaction crosses one or more error checking data address range boundaries (e.g., ECC address range boundaries). The memory read transaction results in an error checking data write command for the memory read transaction unless the error checking data write command is canceled (thereby postponed) due to one or more subsequent error checking data write commands in the command queue hitting the same error checking data buffer. If an error checking data write command hits an allocated error checking data buffer (e.g., ECC data buffer) when the error checking data write command is selected for execution from the command queue, the memory write transaction can use the allocated error checking data buffer; otherwise an error checking data buffer can be allocated when the error checking data write command is selected for execution. The data write commands and error checking data write commands generated based on the memory write transaction may be placed consecutively in the command queues and may be executed atomically.

If an error checking data buffer (e.g., ECC data buffer) is hit by a subsequent error checking data write command and the error checking data buffer is allocated for the subsequent error checking data write command, the error checking data buffer may not be written back to a memory and the error checking data buffer may be allocated for the subsequent error checking data write command. The error checking data buffer may be written back to a memory before the error checking data buffer is released.

If an error checking data buffer (e.g., ECC data buffer) is in a partially modified state, a hit may only occur to a subsequent error checking write command in the command queue if that subsequent error checking write command is the next command in the command queue to the same error checking data address range. If an error checking data buffer is in the modified state, a hit can occur to an error checking data read command, but the error checking data may be written back and the error checking data buffer state transitioned to the shared state.

An error checking data buffer (e.g., ECC data buffer) may maintain “valid” or “masks” for each byte of error checking data (e.g., ECC data) stored by the error checking data buffer so that the stored error checking data can be written back to a memory as a masked write operation or so that it can be determined whether data in the error checking data buffer has been updated. The error checking data buffer may contain error checking data from multiple non-contiguous write commands.

Various embodiments relate to electronic design automation (EDA), and to systems, methods, devices, and instructions for generation of circuit design files that comprises a memory controller that supports primary data stored inline with error checking data as described herein, and to integrate the memory controller with a larger integrated circuit comprising different design blocks.

Reference will now be made in detail to embodiments of the present disclosure, examples of which are illustrated in the appended drawings. The present disclosure may, however, be embodied in many different forms and should not be construed as being limited to the embodiments set forth herein.

FIG. 1is a block diagram illustrating an example electronic device100that includes a memory controller106with error checking data caching, in accordance with various embodiments. The electronic device100may comprise any electronic device that uses a memory and a processor, such as a central processor unit (CPU) or a graphics processing unit (GPU). For instance, the electronic device100may comprise, without limitation, a computer (e.g., a server computer, a client computer, a personal computer (PC), a tablet computer, a laptop computer, a netbook), a set-top box (STB), a personal digital assistant (PDA), an entertainment media system, a cellular telephone, a smart phone, a mobile device, a wearable device (e.g., a smart watch), a smart home device (e.g., a smart appliance), other smart devices, a web appliance, a network router, a network switch, a network bridge, or any electronic device capable of executing instructions with respect to a memory.

As shown, the electronic device100includes a memory102, a memory datapath104, and the memory controller106, which performs error checking data caching operations in accordance with various embodiments. Any one or more of the components described may be implemented using hardware (e.g., one or more circuits) alone or a combination of hardware and software. Moreover, any two or more components of the electronic device100may be combined into a single component, and the functions described herein for a single component may be subdivided among multiple components.

To avoid obscuring illustrated embodiments with unnecessary detail, various functional components (e.g., components) that are not germane to conveying an understanding of the illustrated embodiments have been omitted fromFIG. 1. Various additional functional components may be supported by the electronic device100to facilitate additional functionality that is not specifically described herein.

The memory102comprises one or more memory cells or memory devices, each of which may comprise some form of random access memory (RAM), such as Dynamic Random-Access Memory (DRAM) or Static Random-Access Memory (SRAM). The memory102may be packaged as a single in-line memory module (SIMM) or a dual in-line memory module (DIMM) that can be plugged into an electronic device including an appropriate socket. For some embodiments, the memory102comprises Double Data Rate (DDR) Synchronous Dynamic Random-Access Memory (SDRAM), such as Double Data Rate 3 (DDR3), Double Data Rate 4 (DDR4), Low Power Double Data Rate 3 (LPDDR3), or Low Power Double Data Rate 4 (LPDDR4).

The memory datapath104comprises one or more electronic signal paths coupling together the memory102and the memory controller106(e.g., individual lines between pins of the memory102and the memory controller106) such that data, address, command, control, clock, and other information can be carried between the memory102and the memory controller106. For example, the memory datapath104may comprise an interconnect, such as a link or a bus. Accordingly, the memory datapath104may carry one or more electronic signals between the memory102and the memory controller106. Among the electronic signals carried, the memory datapath104may carry one or more data signals for data to be written to, or read from, the memory102(e.g., a memory device of the memory102). Additionally, the memory datapath104may carry one or more control signals, which can facilitate writing data to, or reading data from, the memory102(e.g., a memory device of the memory102).

The memory controller106manages exchange of data to and from the memory102via the memory datapath104. To facilitate this, the memory controller106may exchange data, address, command, control, clock, and other information with the memory102over the memory datapath104.

As shown, the memory controller106includes a command queue component110and one or more error checking data buffers112. The command queue component110may provide a command queue for storing a plurality of memory commands, generated by the memory controller106, for timely execution by the memory controller106. Each of the error checking data buffer112may comprise a register or static random-access memory (SRAM). Each of the error checking data buffers112may have an error checking data buffer identifier (ID), and may be managed independently of each other.

The memory controller106uses split addressing to generate memory commands for memory transactions with respect to the memory102, and causes primary data to be stored inline with error checking data generated for the primary data on the memory102. For some embodiments, the primary data is stored on the memory102at a range of inline data addresses, and the error checking data is stored on the memory102at a range of inline error checking data addresses. For various embodiments, the range of inline primary data addresses does not overlap with (is disjointed with respect to) the range of inline error checking data addresses.

According to various embodiments, the memory controller106facilitates error checking data caching and cancellation of error checking data read command in the command queue of the command queue component110as described herein. For instance, based on a first memory transaction for reading particular primary data stored on the memory, the memory controller106may generate a first read command for reading the particular primary data from the memory and a second read command for reading particular error checking data from the memory. The memory controller106may add the first read command and the second read command to the command queue of the command queue component110. When the memory controller106executes one or more commands from the command queue of the command queue component110, the memory controller106may select for execution, from the command queue of the command queue component110, the second read command for reading the particular error checking data. The memory controller106may determine whether the second read command for reading the particular error checking data hits existing error checking data currently stored in one of the error checking data buffers112. In response to determining that the second read command for reading the particular error checking data does not hit existing error checking data currently stored in one of the error checking data buffers112, the memory controller106may execute the second read command to read the particular error checking data from the memory102. The memory controller106may store, in one of the error checking data buffers112, the particular error checking data read from the memory102. In response to determining that the second read command for reading the particular error checking data does hit existing error checking data currently stored in one of the error checking data buffers112, the memory controller106may cancel the second read command and use the existing error checking data currently stored in one of the error checking data buffers112.

According to various embodiments, the memory controller106facilitates canceling/combining write commands for error checking data error in the command queue of the command queue component110as described herein. For instance, the memory controller106may generate, based on a memory transaction for writing specific primary data to the memory, a first write command for writing the specific primary data to the memory at a subrange of inline primary data addresses and a second write command for writing specific error checking data to the memory at a subrange of inline error checking data addresses. The memory controller106may add, to the command queue of the command queue component110, the first read command and the second read command. When the memory controller106executes one or more commands from the command queue of the command queue component110, the memory controller106may select for execution, from the command queue of the command queue component110, the second write command for writing the specific error checking data. The memory controller106may determine whether another write command, for writing other error checking data to the memory, exists in the command queue of the command queue component110, where the other write command is writing to a same subrange of error checking data addresses as the second write command. In response to determining that the other write command exists in the command queue of the command queue component110, the memory controller106may cancel the second write command for writing the specific error checking data, thereby postponing an error checking data write until at least the other write command (if not a subsequent write command that is writing to the same subrange of error checking data addresses). Additionally, in response to determining that the other write command exists in the command queue, the memory controller106may allocate one of the error checking data buffers112for future use by at least the other write command in the command queue component110.

FIGS. 2A and 2Billustrate one example of the numerous ways in which primary data (referenced as “Data” inFIG. 2A) is stored inline with error checking data (referenced as “ECC” inFIG. 2A), in accordance with some embodiments. In this example, a 72-bit data word is employed, but with a memory having just the eight chips CS0-CS7 available to provide the memory space (i.e., lacks benefit of a ninth dedicated sideband chip for ECC data). In the interests of brevity and clarity, the storage of Data and ECC bytes with reference to one bank, namely bank Bo, of the chips CS0-CS7, is schematically illustrated. As shown, the available memory space of each chip is sectioned according to a predetermined data-to-ECC ratio. In the illustrated case, a data-to-ECC ratio of 8 to 1 is employed with DRAM chips CS0-CS7, such that ⅞thof each chip's available memory space is dedicated for data bits, while ⅛thof the memory space is dedicated for ECC bits. In this sense, the available memory space is logically ‘partitioned’ to store ECC bits in that part of memory not accessible for storage of Data bits. These dedicated partitions, or sections/regions, of memory storage cells may be selectively defined at mutually offset locations in terms of pages and/or banks within a shared chip select.

Although other ratios may be employed depending on the requirements of the particularly intended application, the 8-to-1 ratio illustrated can provide for convenient mutual offsetting of addresses between data and ECC bits stored on the same chip. Adding three digital high values (111) and shifting a row address by 3 bits, for instance, can provide a binary divide-by-8 effect for mapping ECC bits to a consistently offset storage address relative to their corresponding Data bytes.

FIG. 2Billustrates a physical storage scheme for Data and ECC bytes making up a set of data words. Memory data may be transmitted for various applications in bursts containing numerous data words, and this set of data words may, for instance, constitute the data words of the same burst. In the case of Data bytes, the eight Data bytes of each data word in this example may be physically stored in a suitable manner across matching cells of the available chips for convenient logical addressing. When the eight chips CS0-CS7 are available in the illustrated example, the 8-bit Data bytes making up each data word are stored beginning at parallel/matching bank, row, and column locations across the chips CS0-CS7. InFIG. 2B, the set of data words shown—data words A (formed by constituent data bytes A7, A6, A5, A4, A4, A2, A1, A0, in most significant to least significant byte sequence), B, H (formed by data bytes H7-H0)—may be stored in this way within the data section of the given bank.

For example, Data bytes A7-A0of data word A may each be stored in the respective chips CS7, CS6, CS5, CS4, CS3, CS2, CS1, CS0 at the same matching bank Bo, row, and column locations on the memory. The Data bytes of the next data word B likewise may be stored in the respective chips CS7-CS0 at the same matching bank Bo, row, and column locations of the memory, but one column location over from the Data bytes of the preceding word A. The Data bytes of the other sample data words C-H are similarly stored at matching bank, row, and column locations on the memory, successively located one column over from the preceding data word's Data bytes.

For the 8-bit ECC bytes AECC, BECC, CECC, DECC, EECC, FECC, GECC, HECCgenerated by a memory controller of an embodiment for the eight data words A-H, may be physically stored starting preferably from the same chip, bank, and column location aligned with the first stored data byte of the data word A (of the given burst), but offset in row location from that Data byte so as to be disposed in the adaptively established ECC section of the given bank. The ECC byte of the next data word B may then be stored in the same bank of the next chip over, at the first available column location (which matches the column location aligned with the Data byte of the first data word), but offset in row location so as to be disposed in the ECC section of the given bank of the given chip. The ECC bytes of the remaining data words C-H may be similarly stored at corresponding locations in successive ones of the other chips as shown. In certain applications, the bank location within the same chip may be offset as well, so as to optimize performance, since rows/pages of a given bank in many applications may be opened only one at a time.

FIG. 2Aillustrates an example logical storage scheme reflecting the physical storage scheme shown inFIG. 2B. In this example, no bank offset is employed between the inline-stored Data bytes and their associated ECC bytes. When the distributed contents of bank Bo across the chips CS0-CS7 ofFIG. 2Bare combined in the collective bank Bo as shown, the data words A-H are effectively stored in successive 64-bit cells within a row of the data section defined in the collective bank Bo. The eight 8-bit ECC bytes AECC-HECCassociated with those data words A-H may be stored in the 64-bit cell mutually offset from the data word A, so as to be disposed in the ECC section defined in that collective bank Bo. Inline storage may progress in this manner with the Data and ECC bytes of the next set of data words.

FIG. 3is a schematic diagram illustrating an example memory system300that includes an example memory controller302, in accordance with some embodiments. The memory system300also includes a physical interface (PHY)304and a memory306coupled to the memory controller302by way of the PHY304. The memory306may comprise one or more memory devices of any suitable type and configuration known in the art, and the PHY304may be configured with a suitable interface standard known in the art for the memory306. As illustrated, the memory306stores primary data320inline with error checking data322associated with the primary data320. The primary data320and error checking data (e.g., ECC data)322store the memory306for a single memory transaction in two different locations in the memory306, each of which may be accessed by independent memory commands.

FIG. 4is a schematic diagram illustrating an example memory system400that includes an example memory controller404with caching of error checking data, in accordance with some embodiments. As shown, the memory controller404can serve to provide control of a memory408(formed by one or more memory devices of any suitable type and configuration known in the art), which can support processing of a master control operation by a master controller (not shown). The memory controller404may communicate with a master controller through one or more user interface ports402, and with the memory device(s) of the memory408through a physical interface (PHY)406, which may be configured with a suitable interface standard known in the art for the memory408.

The memory system400illustrated inFIG. 4may be implemented in any known form, depending on the particular requirements of an intended application. For instance, the memory system400may be realized by discretely interconnected subsystems, or sufficiently integrated in the form of a system-on-chip (SOC) or the like, depending on the particular requirements of the intended application. As the user interface ports402, the PHY406, and the memory408may be of any suitable type and configuration known in the art, subject to the particular requirements of a given application, no further description is needed for description of features relating to the memory system400.

InFIG. 4, the memory system400includes a command control portion420, an error control portion422, and a data control portion424. In some embodiments, the data control portion424includes one or more digital circuits that implement functional logic to carry out a plurality of primary data access operations/commands on the memory408. Such primary data access operations/commands may include, without limitation, read, write, masked write, and read-modify-write (RMW) operations/commands conducted on selectively addressed storage locations defined in the memory408. The primary data access operations may include control of additional functions for proper interface with the particular type of memory device(s) employed in the memory408.

For some embodiments, the error control portion422includes one or more digital circuits that implement functional logic for detecting and correcting errors in data segments as stored in memory408. The error control portion422can include execution of error checking data processing, such as ECC processing of predetermined code format (e.g., a format of SECDED type), to detect error in a corrupted primary data segment read from the memory408. The error control portion422is configured to correct the primary data segment read from the memory408having an error that is correctable with the given error checking data (e.g., ECC), and report (e.g., for the master control operation) those primary data segment errors which are detected but are not correctable with the given error checking data. The error control portion422can also provide intermediate storage of error checking data (e.g., ECC) bytes generated or read in association with primary data bytes during the execution of various primary data access operations, for cooperative transmission with their primary data bytes either to the PHY406(for writing operations) or error-checking of retrieved primary data for return to the user interface ports402(for reading operations).

The command control portion420may be coupled to both the error control and data control portions422,424. For some embodiments, the command control portion420includes one or more digital circuits that implement functional logic for generating commands to actuate various primary data access operations of the data control portion424. The command control portion420may include one or more suitable units for carrying out memory access operations responsive to memory transactions of user applications involving error checking data-protected data words. These can include address translation and command translation functions involved in adaptively splitting the memory addressing of error checking data (e.g., ECC data) and primary data, which facilitates inline storage of primary data with associated error checking data.

According to some embodiments, the command control portion420implements caching error checking data operations described herein with respect to error checking data reads, error checking data writes (write combining for error checking data), or both.

FIG. 5is a diagram illustrating an example command control portion504and an example error control portion506of an example memory controller, in accordance with some embodiments.FIG. 5is described with respect to ECC data merely for illustrative purposes. Other parts of the command control portion504, as well as of the error control portions506, which are not shown or specifically described, may be of any suitable type known in the art configured to suit the particularly intended application. The command control portion504may comprise conventional capabilities such as use of control and execution logic for ECC, address shifting between user and memory-specific addresses, and address/command generation for data words.

InFIG. 5, the master control operation may issue memory transactions in the form of memory commands for certain data words to be operated on and the addresses for those data words. The command control portion504may receive these addresses and commands (in the master control operation's formatting) through the user interface ports502. When such addresses and commands are received, the command control portion504may execute to determine the proper memory access addresses respectively for the primary data and ECC data portions (upon generation or upon retrieval from memory) of the data words in question. Based on the resulting data and ECC access addresses, the received commands are split (by a command split unit520) to generate a sequence of multiple memory commands, at least one for the primary data portion, and at least one for the ECC data portion. The data address is suitably translated (by an address translation unit530) to generate separate, mutually offset data and ECC access addresses, which correspond to separate memory commands for the primary data and ECC data portions of the data words in question. The translated addresses are compatible with the particular inline storage configuration employed, with the primary data and ECC data portions sharing the memory space available on the chips of a memory device (e.g., of the memory408).

The data words of memory transactions in questions are passed to the error control portion506. The error control portion506includes an ECC unit540that implements a suitable error detection and correction technique employing an ECC of predetermined format. The error control portion506also includes one or more ECC data buffers542. During write operations of the memory transactions, associated ECC data portions may be generated for the data words received from the master control operation through the user interface ports502by the error control portion506. The ECC data portions of the data words may be stored in the ECC data buffers542until accumulated for all data portions of the given write operation. When drawn from the ECC data buffer310thereafter, the associated ECC data portions and the primary data portions emerging from the error control portion506at that point may be addressed separately and subjected to separate write commands for mutually offset inline storage on a memory. They may be passed to one or more suitable memory access interface508(e.g., of the data control portion424) for passage to the PHY (e.g.,406).

During read operations of the memory transactions, the separately addressed data and ECC data portions of the data words may be read through separate read commands from their mutually offset inline stored locations on a memory, responsive to the translated data and ECC addresses and memory commands received for execution from the command control portion504. The primary data portions read from the memory may be passed through the memory access interface508to the error control portion506, and the associated ECC data portions read from the memory may be passed through the memory access interface508and stored in the ECC data buffers542until the primary data portions of the given read operation are read and ready for error check. The ECC data portions then may be passed from the ECC data buffers542to the error control portion506for error checking of the associated primary data portions. The checked (and possibly corrected) data words may be returned to the master control operation through the user interface ports502.

As shown, the command control portion504includes a command queue522that receives memory commands generated by the command split unit520, and from which a strategy execution unit524draws memory commands for timely execution. The command queue522may receive and register memory commands from not only the master control operation (through the user interface ports502and the command split unit520), but also from other functional units not shown. Depending on the embodiment, these include for example a built-in-self-test (BIST) unit, a scrubbing engine, and the like. The command queue522may receive and queue up respective primary data and ECC memory commands translated by the command split unit520from the command received from the master control operation.

The command split unit520may implement functional logic for restructuring and modifying the memory commands and associated addresses it receives. The command split unit520may provide the necessary translation of incoming addresses/commands for data words to adaptively suit inline storage of associated ECC (i.e., error checking data) and primary data portions on an available memory. Accordingly, the command split unit520may include an address translation unit530and a command translation unit532. The address translation unit530may execute to apply a predefined mapping scheme to the data address received in user addressable space, and map to separate addresses in memory addressable space for the primary data portion and for the ECC data portion of each data word. The address translation unit530may obtain separate primary data and ECC data access addresses by carrying out address shifting measures to generate addresses in terms of device-specific address parameters of a given memory (e.g., to reflect the row, column, page, or other such storage cell arrangement/organization thereof).

As noted herein, for various embodiments, communication traffic includes memory commands and data that are transmitted in burst mode to facilitate higher data throughput. The command split unit520may enforce a predefined burst limit (set to a burst limit) for each memory command entered in the command queue522. The command split unit520may also confirm acceptance of each command entry to the command queue522that satisfies the burst limit condition.

The command translation unit532may evaluate incoming commands to determine if they include a read, write, or read-modify-write data access operation based on address, length, and availability of data masking. The command translation unit532may further evaluate received memory commands to determine if the associated ECC access of the command includes a read, write, or read-modify-write operation based on similar criteria applicable to the ECC access. Based on such determinations, the command split unit520can split, or decompose, the received commands into corresponding memory command sequences that are placed in the command queue522. For inline ECC data (i.e., error checking data) storage, the sequences include additional ECC read and/or write commands that are suitably generated as required from the received commands. The command translation unit532may implement suitable logic to split incoming memory commands accordingly into the appropriate set of primary data commands and generate their associated ECC data commands—such as reads, writes, and read-modify-writes. The command queue522may implement suitable command placement measures to ensure that memory command sequences containing matched primary data and ECC data commands are executed as in-order sequences that are not interrupted by other memory commands.

The command control portion504includes a strategy execution unit524coupled to the command queue522. The strategy execution unit524may implement functional logic to select execution memory commands, from memory command entries accepted into the command queue522, and direct selected memory commands to corresponding parts of the error control portion506and a data control portion (e.g.,424) for timely execution. In this way, the strategy execution unit524can issue accepted memory command entries of the command queue522burst by burst. Additionally, the strategy execution unit524can serve to hold a memory command entry under execution.

According to some embodiments, the strategy execution unit524implements logic for error checking data caching using the ECC data buffers542and cancellation of error checking data read commands from the command queue522as described herein. Additionally, for some embodiments, the strategy execution unit524implements logic for combining/canceling of error checking data write commands in the command queue522as described herein.

In order to provide a contiguous address space, the ECC data storage in the memory (e.g.,408) may be mapped out of the primary data address space. With the memory space available in the memory logically partitioned, the ECC data bits may be stored in the upper or lower ⅛thregion of the memory space within each chip select of the memory. As the ECC data storage space in this dedicated region fills, the addressing may be configured to roll-over from one chip select to the next on a non-power-of-2 boundary. Suitable measures may be used in certain applications to reconcile non-power-of-2 memory to the address granularity needed to support inline ECC storage (e.g., decoding of the upper 3-bits in the address within each chip select). ECC data storage may be performed on a per chip select (CS) basis, such that when the upper 3-bits of the address within a chip select are set to 3′b111 (that is, the 3 binary MSB's are set to the values: 1 1 1), the address points to a location within the partitioned ECC region of the memory space. All other addresses may point to a location within the primary data region of the memory space outside this partitioned ECC region. The primary memory decode may roll over to the next chip select when the ⅞thboundary is crossed, and for systems with more than two chip selects, the boundary may use similar decoding at each boundary— 14/8thboundary, 21/8thboundary, etc. Inline ECC data storage may involve translation of the primary data address to memory device address, which may go beyond just masking, splitting, and/or concatenation of user address bits, as the user address for a specific CS may start at a non-power-of-two page address to avoid gaps in the user address space.

Inline ECC storage may also involve one or more ECC data accesses for each user-initiated command. The address and length of the ECC data accesses may be suitably computed from the user address and length. This can entail translation of the row address, column address, datapath address, and chip level CID (for stacked 3DS devices). The bank address may not be changed, unless a suitable bank offset is selectively enabled for optimized performance.

Command Translation

Read and write commands (representing read and write primary data memory transactions) received at the user interface ports502may be from one byte in length to a certain other maximum command length supported by a particular embodiment. Commands may be sub-divided in the command split unit520based on factors such as page boundary crossings, wrap commands, read-modify-write commands, etc. For some embodiments, commands are split on ECC address range boundaries (e.g., an 8 primary data memory burst aligned boundary). For instance, the command split unit520may split primary data commands such that the ECC data required for the entire command in the command queue522is contained in a single memory burst.

The commands involving read and write received through the user interface ports502may be translated into a combination of read, write, and read-modify-write operations for both the primary data and ECC data portions of the error-protected data words to be operated on.

FIG. 6is a diagram illustrating an example memory command placement and selection in a command queue610for inline ECC data storage, in accordance with some embodiments. The illustrated command queue610at the instant in time shown contains a plurality of memory command sequences, such as Read, Split Read, Write, RMW, and Write command sequences queued up in order. The memory commands translated by the command split unit520are provided as a new memory command sequence by an initial memory command600-1and a second memory command600-2. This new memory command sequence may be placed in front of the already queued command sequences' initial memory commands only, as indicated by the arrows pointing to the possible insertion points. Placement in between memory commands within the existing sequences may be precluded. So the initial memory command600-1in the new memory command sequence may be placed, subject to the placement rules, at any of the possible insertion points denoted. The second memory command600-2of the new memory command sequence may be placed at the entry point immediately following the initial memory command600-1.

Command selection defines a window of memory commands in the top entries in the command queue610that may be evaluated as possible candidates for the next memory command issued to the strategy execution unit524from the command queue610. Command selection may apply predefined rules to determine which memory command to choose.

For inline ECC data storage, the command selection process may be thereby applicable only to selecting between initial memory commands of candidate sequences, with no extraneous consideration needed for subsequent memory commands in the sequence regarding their readiness for execution. Since the selection window may be small (e.g., selection size=4), selection may be often limited to consideration of one or two memory commands.

Command Queue

As noted herein, for some embodiments, a memory burst read of error checking data, stored inline with primary data on a memory and associated with an error checking data address range (e.g., a particular ECC address range), is performed in connection with an initial memory burst read of primary data stored on the memory. The error checking data fetched may be stored (e.g., cached) to an error checking data buffer. Subsequently, the error checking data stored in the error checking data buffer may be shared by a subsequent memory burst read of primary data that shares the same error checking data address range. For some embodiments, memory commands to the same error checking data address range are executed in order. An address conflict logic of a command queue (CQ) may use an error checking data address range to determine an address conflict that enforces an existing order of commands in the CQ to the error checking data address range.

For some embodiments, the address compare logic compares addresses associated with one or more error checking data buffers (e.g., all ECC data buffers) to addresses of one or more command queue (CQ) entries (e.g., all CQ entries) on every clock.

In another embodiment, the address compare logic compares addresses associated with one or more error checking data buffers (e.g., all ECC data buffers) to addresses of one or more command queue (CQ) entries when certain events are detected (e.g., events that justify a comparison). Example events triggering address comparison by the address compare logic may include, without limitation: new command enters CQ; execution of command from CQ; execution of read command from CQ; and execution of write command from CQ. For a new command entering the CQ, the address compare logic may compare the new entry with all valid error checking data buffers. For a command execution event, the address compare logic may compare a current command selected with all error checking data buffers. For a read command execution event, the address compare logic may compare the read command with all CQ entries. For a write command execution event, the address compare logic may compare the write command with all CQ entries. For some embodiments, an address compare logic implements event-driven comparisons using four address comparators: 2×1:ECC_BUFFER_DEPTH, 2×1:CQ_DEPTH. Since the events are not mutually exclusive, an address compare logic may use a separate comparison logic for each event.

The following Table 1 describes example comparisons of error checking data buffers to CO entries based on events.

TABLE 1EventComparisonAction if valid address matchNew commandCompare new CQAny match, transition theplacement in aentry addressError Checking Data bufferCQ entryagainst all Errorstate to the hit stateChecking Databuffer addressesCommandCompare commandRead - cancel error checkingexecution -address against alldata read, execute the dataread, write orError Checkingread, allocate the ErrorRMWData bufferChecking Data buffer to theaddressesreadWrite - allocate the ErrorChecking Data buffer to thewriteRMW-Read - cancel errorchecking data read, executethe data read, allocate theError Checking Data bufferto the RMWRMW-Write - always a hit.RMW-Read (error checkingdata only) - cancel errorchecking data read (notransaction), allocate theError Checking Data bufferto the RMWRead/RMW-Compare readAny match, transition the Errorread commandcommand addressChecking Data buffer state toexecutionagainst all validthe hit stateCQ entries(RMW-read always followedby RMW-write - compare notreally necessary)Write/RMW-Compare writeAny match, transition the Errorwritecommand addressChecking Data buffer state tocommandagainst all validthe hit stateexecutionCQ entriesWrite command ErrorChecking Data buffer stateModified:First match is a read - executethe error checking data writeand transition Error CheckingData buffer state to sharedFirst match is a write - cancelthe error checking data write,Error Checking Data bufferremains in the modified statePartially Modified:First match is a read - executethe error checking data writeand transition Error CheckingData buffer state to invalidFirst match is a write - cancelthe error checking data write,the Error Checking Data bufferremains in the partially-modified state

According to some embodiments, each error checking data buffer (e.g., ECC data buffer) used has two comparators, where the inputs to the comparators come from placement, selection, and the error checking buffer. For some embodiments, each entry in the CQ has an address comparator, where the inputs to the comparator come from selection or strategy logic. Additionally, for some embodiments, all comparator outputs are bit-wise OR'd to determine a single match response.

FIG. 7is a schematic diagram illustrating example address compare logic700for comparing addresses of memory commands in a command queue (CQ) to addresses associated with one or more error checking data buffers (e.g., ECC data buffers) to determine if there is a hit to an error checking data buffer (e.g., in a plurality of error checking data buffers), in accordance with some embodiments. As shown, address compare logic700includes a command queue702, an address conversion unit704, and one or more ECC data buffers706.

Depending on the embodiment, a compare address (error checking data address) may include one or more of the following: CS (for addressing a selectable chip of the memory device), BG (for addressing the bank group in the selectable chip), bank (for addressing the bank of the bank group), row (for addressing the row of the bank), and column (for addressing the column of the row). As disclosed herein, a primary data address and an error checking data address for a command sequence may be different. For instance, the CS may be the same for the primary data address and error checking data address, but the bank may be rotated, and the row and column addresses may be shifted. The lowest column address bit and BG0, if applicable, may be masked off for the compare such that the comparison is limited to the burst aligned address range (e.g., 8 burst aligned address range).

For various embodiments, an atomic sequence of commands in the CQ (e.g., sequence of primary data and error checking data commands generated for a single memory transaction) maps to the same error checking data buffer (e.g., ECC data buffer). Accordingly, for comparison purposes, the address associated with the first command in the atomic sequence may be the only address compared against the address associated with an error checking data buffer to determine whether a hit exists with respect to the error checking data and the atomic sequence of commands.

For some embodiments, address comparisons are performed on the error checking data address (inline error checking data address). Memory command sequences in the CQ may include both primary data addresses (inline primary data addresses) and error checking data addresses (inline error checking data addresses). If data entries in the CQ do not store a copy of the error checking data address, the compare may be performed for error checking data commands only. Compare requests may be made with an error checking data address.

Referring now toFIG. 7, depending on the embodiment, comparison of error checking data addresses (e.g., ECC addresses) may be performed by one of several ways using the address compare logic700. For example, one way comprises converting a source primary data address to an ECC address by an address conversion unit704and comparing the resulting ECC address to all destination ECC addresses at the ECC data buffers706. For the ECC data buffers706, all buffer compare addresses may be ECC addresses. For comparisons at the command queue702, addresses may be compared to ECC data command entries, which each have a corresponding ECC data command. As another example, an ECC address may be stored in each entry in the command queue702, which the address compare logic700will then use for all comparisons.

For some embodiments, a command placement logic (e.g., of the command control portion504) detects when a new memory command enters the command queue702(i.e., command placement occurs) and sends a compare address and a compare signal on a clock. The ECC data buffers706may compare the placement compare address with all ECC addresses at the ECC data buffers706. A match at the ECC data buffers706may occur when the address associated with one of the ECC data buffers706matches the placement compare address and the matching ECC data buffer does not have an “INVALID” state. In the event of a match between the placement compare address and one of the ECC data buffers706, the state of the matching ECC data buffer may transition to a “HIT” state.

For some embodiments, a command selection logic (e.g., of the command control portion504) detects when a new memory command is selected for execution from the command queue702(e.g., when a new memory command reaches the top of the command queue702) and sends a compare address and a compare signal. The new memory command may be a memory command newly placed on the command queue702or the next command to move up the command queue702. The ECC data buffers706may compare the placement compare address with all ECC addresses at the ECC data buffers706. If the selection compare address matches with an address associated with one of the ECC data buffers706, the matching ECC data buffer may be allocated to the command. Additionally, if the selection compare address matches with an address associated with one of the ECC data buffers706, response logic of the ECC data buffers706may provide a hit response to the command selection logic and may provide a buffer identifier for the matching ECC data buffer to the command selection logic. If no match occurs, one of the ECC data buffers706may be allocated based on a buffer assignment algorithm (e.g., round robin algorithm described herein). Additionally, if no match occurs, response logic of the ECC data buffers706may provide a miss response to the command selection logic. Based on a hit response from the ECC data buffers706, the command selection logic may cancel (e.g., invalidate) an ECC read command at the top of the command queue702that is followed in the command queue702by a primary data read command (which happens to be associated with the ECC read command), and the command selection logic may execute the primary data read command from the next entry of the command queue702.

For some embodiments, a command selection logic (e.g., of the command control portion504) detects when a read command or a write command is selected for execution from the command queue702(e.g., when a new memory command reaches the top of the command queue702) and sends a compare address and a compare signal to the command queue702. The command queue702may compare the selection compare address with all valid entries of the command queue702. If a command queue entry match occurs (e.g., with one or more entries), response logic of the command queue702may provide a hit response to the command selection logic and the command type for the first command in the command queue702that matched. The matching command entry (or entries) may remain unchanged. Additionally, based on hit response from the command queue702, the assigned ECC data buffer may transition to a “HIT” state. Additionally, based on hit response from the command queue702, if the first command in the command queue702to match is a write command, the write command may be canceled. For some embodiments, all memory commands, except consecutive read commands, to the same ECC data buffer are placed and executed in order.

For various embodiments described herein, error checking data buffer caching (e.g., ECC data buffer caching) results in error checking data read commands being canceled, and error checking data write combining (e.g., ECC write combining) results in error checking data read write commands being canceled. To avoid delays that may result in memory inefficiencies from error checking data command canceling, various embodiments determine whether an error checking data command (e.g., ECC data command) will be canceled or executed on a clock prior to selecting the next memory command for execution from a command queue. For instance, where memory read and write commands are selected from a command queue for execution on every two clocks, the one idle clock between may be used to compare and cancel error checking data read or write commands as described herein.

Error Checking Data Buffer

For some embodiments, a plurality of error checking data buffers (e.g., 8 to 32 ECC data buffers for a total storage of 256 to 1024 bytes of ECC data) is used to store error checking data after an initial memory burst read command to error checking data stored on a memory. A given error checking data buffer may store error checking data for a particular error checking address range (e.g., ECC address range), and may continue to do so until the given error checking data buffer needs to be released for another memory burst read command to error checking data (stored on a memory) that is associated with a different error checking data address range (e.g., different ECC address range). Depending on the embodiment, the number of error checking data buffers used may be user-defined, and may be defined by a user based on storage area and data performance factors.

For some embodiments, each error checking data buffer used has a data size sufficient to entirely store at least one memory burst read worth of error checking data. For instance, for a data path of 16 bits (DP=16) and a burst length of 16 (BL=16), a particular error checking data buffer (e.g., ECC data buffer) may have a data size of 32 bytes.

For some embodiments, a given error checking data buffer comprises at least one of a register or static random-access memory (SRAM). A given error checking data buffer may be one of a plurality of error checking data buffers, and each error checking data buffer in the plurality of error checking data buffers may have an error checking data buffer identifier (ID).

For storing primary data inline with error checking data, the primary error checking data and its associated error checking data are stored in different locations (e.g., at different intra-chip addresses) within a memory. Accordingly, for various embodiments, error checking data read and write memory burst commands are executed separately from primary data read and write memory burst commands.

Depending on the embodiment, error checking data buffers (e.g., ECC data buffers) may be allocated and de-allocated on a memory-transaction by memory-transaction basis. A single error checking data buffer may be allocated at the time of command execution. Additionally, depending on the embodiment, a certain memory command may have an error checking data buffer pre-allocated by a previous memory command or may hit an existing error checking data buffer. For some embodiments, the maximum number of error checking data buffers (e.g., ECC data buffers) that may be in an “ALLOCATED” state for RMW's and write combining are limited to prevent over-allocation of the error checking data buffers.

Some embodiments use different error checking data buffer states (e.g., ECC data buffer states) to facilitate error checking data caching as described herein. In particular, using different error checking data buffer states may enable an error checking data buffer to be allocated or de-allocated, which enables buffer management for error checking data caching. More regarding error checking data buffer states is discussed herein with respect toFIG. 8.

FIG. 8is a state diagram800illustrating states and state transitions of an error checking data buffer, in accordance with some embodiments. The following Table 2 describes example error checking data buffer states that may be used by some embodiments, and that are included in the state diagram800ofFIG. 8.

TABLE 2ErrorChecking Databuffer stateDescriptionInvalidThis state can represent that an Error Checking Databuffer (e.g., ECC data buffer) is not allocated; currenterror checking data (e.g., ECC data) stored in the ErrorChecking Data buffer is invalid. When an ErrorChecking Data buffer is invalidated, it may be cleared.Allocated - AllThis state can represent that an Error Checking Databuffer is allocated to one or more memory commands,and the error checking data stored in the ErrorChecking Data buffer fills the entire Error CheckingData buffer. In this state, the Error Checking Databuffer may not be released. This state may applyto memory reads, memory read-modify-writes(RMWs), memory writes that span an entire errorchecking data address range, and memory writesthat do not span the entire error checking dataaddress range and hit an already filled ErrorChecking Data buffer. If multiple memorycommands are executed to the Error CheckingData buffer, the Error Checking Data buffer mayremain in the allocated state until all of the memorycommands complete.Allocated -This state can represent that an Error Checking DataPartialbuffer is allocated to a memory command, andthe error checking data stored in the Error CheckingData buffer only partially fills the Error CheckingData buffer. In this state, the Error Checking Databuffer may not be released. This state may apply tomemory writes that do not span an entire errorchecking data address range. If multiple memorycommands are executed to the Error CheckingData buffer, the Error Checking Data buffer mayremain in the allocated state until all of thecommands complete.SharedThis state can represent that an Error Checking Databuffer has error checking data that is identical to theerror checking data stored in memory. The errorchecking data may be used for a memory read,memory write, or memory RMW. The ErrorChecking Data buffer may be released withoutwriting the error checking data stored in theError Checking Data buffer back to memory.ModifiedThis state can represent that an Error Checking Databuffer has error checking data that is more recentthan the error checking data stored in memory.The error checking data may be used for amemory read, memory write, or memory RMW.For some embodiments, the error checking datastored in the Error Checking Data buffer iswritten back to memory before the ErrorChecking Data buffer is released.PartialThis state can represent that an Error Checking DataModifiedbuffer has error checking data that is more recentthan the error checking data stored in memory, andthat some of the data is not valid. The errorchecking data stored in the Error Checking Databuffer may be used for another memory write. Forsome embodiments, the error checking data storedin the Error Checking Data buffer is written backto memory before the Error Checking Data bufferis released.Shared-HitThis state can represent that an Error Checking Databuffer is in the shared state and another memorycommand in the command queue (CQ) is targetingthe same error checking data address rangeassociated with the data stored in the ErrorChecking Data buffer.WritebackThis state can represent that an Error Checking Databuffer is in the modified state, and the errorchecking data stored in the Error CheckingData buffer is being written back to memory.PartialThis state can represent that an Error Checking DataWritebackbuffer is in the partial-modified state, and the errorchecking data stored in the Error Checking Data bufferis being written back to memory.ReleasedThis state can represent that an Error Checking Databuffer is released or scheduled for release.

According to some embodiments, an error checking data buffer (e.g., ECC data buffer) in an “allocated” state is not released until one or more commands that allocated the error checking data buffer have been executed or completed. Once an error checking data buffer is allocated, one or more additional memory commands may hit the same error checking data buffer (i.e., the one or more additional memory commands hit the error checking data address range associated with error checking data currently stored in the error checking data buffer).

For write and read-modify-write memory commands that require an error checking data read (e.g., ECC read), the error checking data read and data write commands may be separated by several memory commands, which may in turn necessitate proper error checking data buffer allocation to prevent an error checking data buffer resource issue.

For some embodiments, once the initial memory command (e.g., initial memory burst read command) targeting an error checking data buffer is complete, the error checking data buffer is available for reuse by a subsequent memory command (e.g., subsequent memory burst read command) that hits the error checking data address range (e.g., ECC address range). If the error checking data buffer is in a Valid state or a Modified state (as described in Table 2), memory reads, memory writes, or both may reuse the error checking data buffer. If the error checking data buffer is in a Partial Modified state (as described in Table 2), only writes may reuse the error checking data buffer. An error checking data buffer in an Allocated-Partial state or a Partial state may transition to a Modified state if the entire contents of the error checking data buffer are written. An error checking data buffer in a “Hit” state may be given priority by the error checking data buffer release algorithm to be retained. An error checking data buffer in a Modified state or Partial Modified state may be written back to memory prior to releasing the error checking data buffer.

An error checking data buffer that is hit by a subsequent memory command (e.g., subsequent memory burst read command) in the Command Queue (CQ) may be released prior to reuse. Accordingly, memory commands entering the CQ may generate all memory commands in a sequence regardless of whether the error checking data is currently in an error checking data buffer. The memory commands (e.g., memory burst read commands) to error checking data stored on a memory can be canceled when the memory command is selected and the error checking data buffer has been allocated for the memory command. Subsequently, an error checking data buffer may be released according to the release algorithm.

FIG. 9is a state diagram900illustrating an example caching algorithm for an error checking data buffer that enables error checking data to be used for multiple memory transactions that access the same memory burst aligned address range (e.g., 8 memory burst aligned address range), in accordance with some embodiments. According to some embodiments, the states of state diagram900track the states of the state diagram800described above with respect toFIG. 8. Depending on the embodiment, the state information of the state diagram900may be used for error checking data buffer compare responses (e.g., ECC data buffer compare responses), error checking data buffer compare requests (e.g., ECC data buffer compare requests), error checking data memory command execution (e.g., ECC data command execution), and error checking data memory command canceling (e.g., ECC data command canceling).

With respect to the state information of the state diagram900, an “INVALID” state can represent that the error checking data buffer does not have valid error checking data (e.g., ECC data) and is currently available to be allocated to a new transaction. A “SHARED” state can represent that the entire error checking data buffer has valid error checking data that is equivalent to the data stored on the memory. A “MODIFIED” state can represent that the entire error checking data buffer has valid error checking data that is more recent than the data stored on the memory. A “PARTIAL MODIFIED” state can represent that the error checking data buffer has some valid error checking data that is more recent than the data stored on the memory.

A “CQ WR/RMW COMPARE” state can cause issuance of an address compare request between an address associated with the error checking data buffer and the addresses associated with one or more CQ entries. If the first match of the requested compare is a write or RMW memory command, the error checking data write command (e.g., ECC write command) may be canceled and the state diagram900stays in a “MODIFIED” state. If the first match of the requested compare results in no match, the error checking data write command (e.g., ECC write command) may be executed and the state diagram900transitions to either a “RELEASED” state or a “SHARED” state.

A “CQ WR COMPARE” state can cause issuance of an address compare request between an address associated with the error checking data buffer and the addresses associated with one or more CQ entries. If the first match of the requested compare is a write memory command, the error checking data write command (e.g., ECC write command) may be canceled and the state diagram900stays in a “MODIFIED” state. If the first match of the requested compare results in no match, the error checking data write command may be executed and the state diagram900transitions to either a “RELEASED” state or a “SHARED” state.

A “SHARED” state may be entered on an error checking data read command (e.g., ECC read command) or an error checking data write command (e.g., ECC write command) to write back modified data to the memory. Following an error checking data write command from a “MODIFIED” state, the state diagram900can transition to the “SHARED” state. From the “SHARED” state, any command may reuse the error checking data buffer and, if necessary, the state diagram900will transition accordingly. While in the “SHARED” state, if the error checking data buffer is not allocated, the error checking data buffer may be released at any time. While in the “SHARED” state, the hit logic may prioritize the release of buffers targeted by commands in the CQ versus untargeted error checking data buffers.

A “MODIFIED” state may be entered on RMW error checking data read command (e.g., RMW ECC read command), a primary data write command that spans an entire error checking data address range (e.g., ECC address range), or a write to an error checking data buffer in a “SHARED” state.

FIGS. 10A through 10Care state diagrams illustrating example state and state transitions for an error checking data buffer (e.g., ECC data buffer), according to some embodiments. In particular,FIG. 10Ais a state diagram1000illustrating example state and state transitions for allocating an error checking data buffer (e.g., from a plurality of error checking data buffers), for a memory command or a sequence of memory commands, in order to preserve error checking data until the memory command or the sequence of memory commands is canceled or completed. According to some embodiments, an error checking data buffer is not released while allocated. Depending on the embodiment, an error checking data buffer may be allocated under at least one of the following conditions: (a) an error checking data read command (e.g., ECC read command) in connection with a RMW command sequence until the end of the RMW command sequence; (b) write canceling/combining for error checking data (e.g., ECC write combining); or (c) memory command selection from a command queue to memory command completion. An error checking data buffer may be allocated to multiple memory commands (e.g., in a command queue) at the same time. For some embodiments, when an error checking data buffer is allocated to multiple memory commands, the error checking data buffer remains allocated until all memory commands allocated to (e.g., targeting) the error checking buffer are complete.

As illustrated, the state diagram1000transitions to an “ALLOCATED” state when a memory command targets an error checking data buffer (e.g., ECC data buffer). The error checking data buffer may remain in the “ALLOCATED” state until the error checking data buffer is available (e.g., either “SHARED” or “INVALID” state per the state diagram900). For some embodiments, a memory controller includes logic that can track all outstanding memory commands in a command queue to an error checking data buffer and that can generate a last memory command complete signal to transition the state diagram1000from an “ALLOCATED” state back to an “AVAILABLE” state. For some embodiments, multiple memory commands in a command queue to the same error checking data buffer (except for consecutive read commands) are executed in order. Accordingly, a last memory command logic of the memory controller may use an identifier (ID) of the last memory command issued to find the end of the final memory command to the error checking data buffer.

FIG. 10Bis a state diagram1010illustrating example state and state transitions for maintaining a “HIT” state or “MISS” state for an error checking data buffer to prioritize the error checking data buffer's availability for release selection. According to some embodiments, the “HIT” state of an error checking data buffer is evaluated when the error checking data buffer is in a “SHARED” state (e.g., per the state diagram900). The “HIT” state of an error checking data buffer may be evaluated without regard for the current cache state and allocation state of the error checking data buffer (e.g., per the state diagram900). Depending on the embodiment, the “HIT” state of an error checking data buffer may be evaluated in at least one of the following conditions: (a) a new memory command being placed in a command queue is compared with every error checking data buffer; or (b) a memory command from the command queue targeting the error checking data buffer is compared with every entry in the command queue. The “HIT” state may be independent of the memory command type associated with the “HIT” state. A response to the “HIT” state may be used by the error checking data buffer cache state machine (e.g., the state diagram900) to determine some state transitions. Logic of the memory controller may not release an error checking data buffer in the “HIT” state unless none of the other error checking data buffers are in the “INVALID” state or “SHARED” state (e.g., per the state diagram900).

Error Checking Data Writes

Error checking data writes may be executed following a primary data write command or RMW-write command sequence. The state of an error checking data buffer following the write transaction may be either “MODIFIED” or “PARTIALLY MODIFIED.” The error checking write may occur as part of a write command or RMW-write command sequence to the associated primary data address. If the error checking data buffer is in the “MODIFIED” or “PARTIALLY MODIFIED” state and the error checking data buffer is reallocated for a read command, the error checking write may be executed and the error checking data buffer transitioned to the “SHARED” state since an error checking write cannot be generated by the read command.

Error checking data buffers may be allocated for each primary data command. Following the initial transaction or transactions utilizing the error checking data buffer, the error checking data buffer may be in one of several states: (a) “SHARED,” (b) “MODIFIED,” or (c) “PARTIALLY MODIFIED”

A) In the “SHARED” state, the error checking data buffer contents and memory contents may be the same. The error checking data buffer may be released without any further action required; no write back is required.

B) In the “MODIFIED” state, the error checking data buffer contents may be completely valid, replacing the memory contents. The error checking data buffer may be written back to memory before the error checking data buffer may be released.

C) In the “PARTIALLY MODIFIED” state, the error checking data buffer may contain some valid data and some invalid data. The error checking data buffer may be merged with the memory contents using masked write commands before the error checking data buffer may be reallocated.

The following table explains error checking data buffer error checking write scheduling.

As noted herein, some embodiments utilize a plurality of error checking data buffers. Each error checking data buffer in the plurality of error checking data buffers may have an associated error checking data buffer identifier (ID). Depending on the embodiment, each error checking data buffer in the plurality of error checking data buffers may store one or more of the following information:Primary data address range: store the start address for the primary data memory burst aligned address range (e.g., 8 primary data memory burst aligned address range) that corresponds with the stored error checking data. The error checking data address should be easily calculated based on this address;Valid bit per byte: the valid bits are effectively mask bits and can be combined with mask bits. These bits are set based on the write address generated from Strategy, write masks, valid bits set based on reads, etc.;Error checking data (e.g., ECC data): source from ECC reads and data writes;Error checking data buffer state: indicates the current state of the ECC data buffer: invalid, allocated, shared, modified, partially-modified; andError checking data buffer hit status: indicates whether any memory commands in the CQ are currently a hit to the error checking data buffer address range.
Error Checking Data Buffer Release

Error checking data may be stored in one or more error checking data buffers (e.g., 8 to 32 buffers). Each error checking data buffer may be initially allocated for a specific memory command and, in some cases, may service other memory commands that hit the same error checking data address range. Once an error checking data buffer services an initial memory command for which it was allocated, it may either remain in the “SHARED” state, be reallocated for a memory command to the same error checking data address range, or be released. When an error checking data buffer is released, it will go to the “INVALID” state.

Some embodiments use an error checking data buffer release algorithm having one or more of the following attributes. The error checking data buffer release algorithm may not release an error checking data buffer when it is currently allocated to a memory command/transaction. The error checking data buffer release algorithm may not allocate all of the error checking data buffers such that any command cannot be selected for execution and get an error checking data buffer assigned. The error checking data buffer release algorithm may release error checking data buffers early enough that an error checking data buffer is available and does not hinder command flow. The error checking data buffer release algorithm may maintain error checking data buffers in “SHARED” state long enough to maximize reuse. Additionally, the error checking data buffer release algorithm may prioritize error checking data buffer release in order to maximize error checking data buffer hits. The error checking data buffer release algorithm may be a linked list, age-based, a priority-based rotation, or random.

The error checking data buffer release algorithm of an embodiment may operate according to one or more of the following rules.Error checking data buffers in the “ALLOCATED” state may not be released. For a read command, the error checking data buffer is not allocated until the read command is selected for execution. If the read command is a hit to an existing error checking data buffer, the new error checking data buffer allocation and the error checking data read may be canceled at the time of selection. For a write command that does not hit an existing error checking data buffer, the error checking data buffer may not be allocated until the write command is selected for execution. If the write is a hit to an existing error checking data buffer, the new error checking data buffer allocation may be canceled at the time of selection. For an RMW command sequence, the error checking data buffer may be allocated on the RMW-read command sequence and must remain allocated until the RMW-write command sequence.An error checking data buffer that is in the “modified” or “partially modified” state following a write command or RMW command sequence that is hit by subsequent write command or RMW command sequence (therefore, is not written back to memory) may be retained in the “allocated” state until the subsequent write command or RMW-write command sequence.The maximum number of error checking data buffers that may be allocated for RMW command sequences at one time may be programmable and may be limited to a subset of the total number of error checking data buffers, which can prevent the possibility of over-allocating the error checking data buffers.The number of error checking data buffers that may be allocated following a write command or RMW command sequence and hit by a subsequent write command may be limited to prevent over-allocating the error checking data buffers. This may be done in the buffer management logic to determine following a write command or RMW-write command sequence if the error checking data buffer should be written back or allocated to a future write command targeting the same error checking data address range.The sum of the error checking data buffers allocated as part of an RMW command sequence and error checking data buffers allocated as part of a write command or RMW command sequence that is hit by a subsequent command may be less than the total error checking data buffers to prevent over-allocating the available error checking data buffers.The number of error checking data buffers in the “SHARED” state may be released immediately.Error checking data buffers in the “ALLOCATED” state may not be released. Error checking data buffers in the “SHARED-HIT” state may have higher priority over other error checking data buffers for not being released.In the “MODIFIED” or “PARTIALLY MODIFIED” state, error checking data buffers may transition to the “HIT” state if a write command or RMW command sequence in the command queue hits the same error checking data address range. From this state, error checking data buffers may be allocated and cannot be released until de-allocated.Error checking data buffers not in either the “ALLOCATED” or “HIT” state, which are in the “SHARED” state, may be in the pool of error checking data buffers that are free to be released.Error checking data buffers in the “MODIFIED” or “PARTIAL MODIFIED” state and not in the “hit” state may be immediately written back and released following the associated primary data write.Error checking data buffers in the “PARTIAL MODIFIED” state and hit by a read command or RMW command sequence may be released before the error checking data read for the conflicting command.On command execution, if no error checking data buffer is in the “INVALID” state, a “SHARED” or “SHARED-HIT” buffer may be immediately released for assignment to the current memory transaction.

FIG. 10Cis a state diagram1020illustrating example states and state transitions for assignment of an error checking data buffer (e.g., ECC data buffer). According to some embodiments, on every memory command execution, all available error checking data buffers would be in at least one of the following states: INVALID; SHARED; SHARED-HIT; or ALLOCATED (not available). If the current memory command does not hit an existing error checking data buffer, a new error checking data buffer assignment may be performed. The state diagram1020illustrates an example round robin algorithm that may be used to select a next error checking data buffer for assignment. As illustrated by the state diagram1020, the error checking data buffer selection algorithm may comprise: starting from a current state; selecting the next error checking buffer having an “INVALID” state (e.g., per the state diagram900); if no error checking data buffer has an “INVALID” state, selecting the next error checking data buffer having a “SHARED” state; if no error checking data buffer has a “SHARED” state, selecting the next error checking data buffer having a “SHARED-HIT” state; and if no error checking data buffer has a “SHARED-HIT” state, setting an error interrupt.

Error Checking Data Buffer Identifier (Id)

Each error checking data buffer may have an error checking data buffer identifier (ID). As described herein, when a memory command is selected for execution, the selection logic may issue an error checking data buffer compare request. The error checking data buffer logic may respond with an error checking data buffer ID identifying the error checking data buffer assigned to that memory transaction. The error checking data buffer ID may be used by a strategy execution unit (e.g.,524), the error checking data buffer logic and any other logic that needs to know the error checking data buffer assignment to select the location of the error checking data. The error checking data ID may be used for read data steering and used during write commands to store and fetch the corresponding error checking data. For a command sequence, the error checking data buffer ID may be reused for each memory command in the sequence without additional compare requests.

The error checking data buffer ID may be generated by the error checking data buffer logic based on a compare address and a compare request at command execution. The compare request may be generated for the first command in an atomic sequence. The same error checking data buffer may be used throughout the sequence.

Selection logic may drive the error checking data buffer ID with each command in the sequence to a strategy execution unit (e.g.,524). For an error checking data read command (e.g., ECC read command), the error checking data buffer ID may be sent with the error checking data to the error checking data buffer to load the data in the correct buffer (e.g.,542). For a primary data read command, the error checking data buffer ID may be sent with the read data to a plurality of error checking data buffers (e.g.,542) to pop the associated error checking data from the correct error checking data buffer. For an error checking data write command (e.g., ECC write command), the error checking data buffer ID may be sent to a plurality of error checking data buffers (e.g.,542) to source the error checking data from the correct error checking data buffer for the error checking data write command. For a primary data write command, the error checking data buffer ID may be sent with error checking data generated by the write commands to be stored in the correct error checking data buffer.

Error Checking Data Buffer Write Combining Limit

According to some embodiments, following a write command or RMW command sequence, an error checking data buffer may be in the modified or partially modified state. If the error checking data buffer is a hit to a write command on the command queue and the write command is the first command in the command that hits the error checking data buffer, then the error checking data buffer may be allocated to the subsequent write command and the error checking data write command (e.g., ECC write command) may be canceled. To limit the number of error checking data buffers allocated for write combining/canceling, the maximum number of error checking data buffers that can be allocated in Modified or Partially Modified state may be limited by programming register and a counter implemented in the logic of the error checking data buffers that sums the number of error checking data buffers in this state. Accordingly, for each opportunity to use write combining/canceling, an embodiment may cancel the error checking data write only if the total number of error checking data buffers already allocated for this feature is less than the programmed maximum. If the maximum number of error checking data buffers has already been reached, the error checking data write will occur and the error checking data buffer may transition to the shared state.

FIG. 11is a flow diagram illustrating an example method1100for error checking data caching, in accordance with various embodiments. For some embodiments, the method1100is performed by a memory controller of a memory system, such as the memory controller106described above with respect toFIG. 1. Though the steps of method1100may be depicted and described in a certain order, the order in which the steps are performed may vary between embodiments. For example, a step may be performed before, after, or concurrently with another step. Additionally, the components described below with respect to the method1100are merely examples of components that may be used with the method1100, and other components may also be used in some embodiments.

As shown inFIG. 11, the method1100begins at operation1102, with the memory controller106causing primary data to be stored, on a memory, inline with error checking data generated for the primary data using split addressing for memory transactions. The primary data may be stored on the memory at a range of inline primary data addresses, while the error checking data may be stored on the memory at a range of inline error checking data addresses, where the range of inline primary data addresses does not overlap with the range of inline error checking data addresses.

At operation1104, the memory controller106generates, based on a first memory transaction for reading particular primary data stored on the memory, a first read command for reading the particular primary data from the memory and a second read command for reading particular error checking data from the memory. The particular error checking data stored on the memory may be generated for the particular primary data. The first read command and the second read command may comprise memory burst commands.

At operation1106, the memory controller106adds the first read command and the second read command to the command queue of the command queue component110.

At operation1108, the memory controller106selects for execution, from the command queue of the command queue component110, the second read command for reading the particular error checking data from the memory.

At operation1110, the memory controller106determines whether the second read command for reading the particular error checking data hits existing error checking data currently stored in an error checking data buffer (e.g., one of the error checking data buffers112). The memory controller106may determine whether the second read command for reading the particular error checking data hits in existing error checking data stored in the error checking data buffer is based on a comparison of inline error checking data addresses. For instance, the comparison may comprise comparing an inline error checking data address associated with the error checking data buffer with an inline error checking data address associated with the second read command (e.g., in the command queue of the command queue component110). In another instance, the comparison may comprise comparing the inline error checking data addresses in response to detecting a comparison event with respect to the command queue.

In response (decision operation1112) to the memory controller106determining that the second read command for reading the particular error checking data does not hit existing error checking data currently stored in the error checking data buffer, the method1100proceeds to operation1116; otherwise the method1100proceeds to operation1114. At operation1114, the memory controller106cancels the second read command.

At operation1116, the memory controller106executes the second read command to read the particular error checking data from the memory. Then, at operation1118, the memory controller106stores the particular error checking data, read from the memory at operation1116, in the error checking data buffer (e.g., one of the error checking data buffers112).

FIG. 12is a flow diagram illustrating an example method1200for error canceling/combining write commands for error checking data, in accordance with various embodiments. For some embodiments, the method1200is performed by a memory controller of a memory system, such as the memory controller106described above with respect toFIG. 1. Though the steps of method1200may be depicted and described in a certain order, the order in which the steps are performed may vary between embodiments. For example, a step may be performed before, after, or concurrently with another step. Additionally, the components described below with respect to the method1200are merely examples of components that may be used with the method1200, and that other components may also be used in some embodiments.

As shown inFIG. 12, the method1200begins at operation1202, with the memory controller106detecting a first memory transaction for writing particular primary data to a memory that is storing primary data inline with error checking data generated for the primary data. The primary data may be stored on the memory at a range of inline primary data addresses, while the error checking data may be stored on the memory at a range of inline error checking data addresses, where the range of inline primary data addresses does not overlap with the range of inline error checking data addresses. The first write command and the second write command may comprise memory burst commands.

At operation1204, the memory controller106generates, based on the first memory transaction, a first write command for writing the particular primary data to the memory at a subrange of inline primary data addresses and a second write command for writing particular error checking data to the memory at a subrange of inline error checking data addresses. The particular error checking data may be generated for the particular primary data.

At operation1206, the memory controller106adds the first write command and the second write command to the command queue of the command queue component110.

At operation1208, the memory controller106selects for execution, from the command queue of the command queue component110, the second write command for writing the particular error checking data to the memory.

At operation1210, the memory controller106determines whether another write command, for writing other error checking data to the memory, exists in the command queue of the command queue component110, where the other write command writes to a same subrange of inline error checking data addresses as the second write command.

In response (decision operation1212) to determining that the other write command exists in the command queue, the method1200proceeds to operation1214; otherwise the method1200proceeds to operation1216. At operation1214, the memory controller106executes the second write command.

At operation1216, the memory controller106cancels the second write command to write the particular error checking data to the memory. Then, at operation1218, the memory controller106allocates an error checking data buffer (e.g., one of the error checking data buffers112) for at least the other write command writing to the same subrange of inline error checking data addresses. For some embodiments, the error checking data buffer remains allocated until no write commands, to the same subrange of inline error checking data addresses, remain in the command queue of the command queue component110.

FIG. 13is a block diagram illustrating components of a machine1300, according to some example embodiments, able to read instructions from a machine-readable medium (e.g., a machine-readable storage medium) and perform any one or more of the methodologies discussed herein. Specifically,FIG. 13shows a diagrammatic representation of the machine1300in the example form of a system, within which instructions1302(e.g., software, a program, an application, an applet, an app, a driver, or other executable code) for causing the machine1300to perform any one or more of the methodologies discussed herein may be executed. For example, the instructions1302include executable code that causes the machine1300to execute the method300. In this way, these instructions1302transform the general, non-programmed machine1300into a particular machine programmed to carry out the described and illustrated method300in the manner described herein. The machine1300may operate as a standalone device or may be coupled (e.g., networked) to other machines.

By way of non-limiting example, the machine1300may comprise or correspond to a computer (e.g., a server computer, a client computer, a personal computer (PC), a tablet computer, a laptop computer, or a netbook), a mobile device, or any machine capable of executing the instructions1302, sequentially or otherwise, that specify actions to be taken by the machine1300. Further, while only a single machine1300is illustrated, the term “machine” shall also be taken to include a collection of machines1300that individually or jointly execute the instructions1302to perform any one or more of the methodologies discussed herein.

The machine1300may include processors1304, memory1306, a storage unit1308, and I/O components1310, which may be configured to communicate with each other such as via a bus1312. In an example embodiment, the processors1304(e.g., a central processing unit (CPU), a reduced instruction set computing (RISC) processor, a complex instruction set computing (CISC) processor, a graphics processing unit (GPU), a digital signal processor (DSP), an application specific integrated circuit (ASIC), a radio-frequency integrated circuit (RFIC), another processor, or any suitable combination thereof) may include, for example, a processor1314and a processor1316that may execute the instructions1302. The term “processor” is intended to include multi-core processors1304that may comprise two or more independent processors (sometimes referred to as “cores”) that may execute instructions contemporaneously. AlthoughFIG. 13shows multiple processors, the machine1300may include a single processor with a single core, a single processor with multiple cores (e.g., a multi-core processor), multiple processors with a single core, multiple processors with multiple cores, or any combination thereof.

The memory1306(e.g., a main memory or other memory storage) and the storage unit1308are both accessible to the processors1304such as via the bus1312. The memory1306and the storage unit1308store the instructions1302embodying any one or more of the methodologies or functions described herein. The instructions1302may also reside, completely or partially, within the memory1306, within the storage unit1308, within at least one of the processors1304(e.g., within the processor's cache memory), or any suitable combination thereof, during execution thereof by the machine1300. Accordingly, the memory1306, the storage unit1308, and the memory of the processors1304are examples of machine-readable media.

Communication may be implemented using a wide variety of technologies. The I/O components1310may include communication components1322operable to couple the machine1300to a network1324or devices1326via a coupling1328and a coupling1330respectively. For example, the communication components1322may include a network interface component or another suitable device to interface with the network1324. In further examples, the communication components1322may include wired communication components, wireless communication components, cellular communication components, near field communication (NFC) components, Bluetooth® components (e.g., Bluetooth® Low Energy), Wi-Fi® components, and other communication components to provide communication via other modalities. The devices1326may be another machine or any of a wide variety of peripheral devices.

Modules, Components and Logic

Electronic Apparatus and System

Example embodiments may be implemented in digital electronic circuitry, in computer hardware, firmware, or software, or in combinations of them. Example embodiments may be implemented using a computer program product, for example, a computer program tangibly embodied in an information carrier, for example, in a machine-readable medium for execution by, or to control the operation of, data processing apparatus, for example, a programmable processor, a computer, or multiple computers.

FIG. 14is a diagram illustrating one possible design process flow for generating a circuit, including embodiments to implement a memory controller that supports primary data stored inline with error checking data as described herein, and in various embodiments, to integrate the memory controller with a larger integrated circuit comprising different design blocks. As illustrated, the overall design flow1400includes a design phase1410, a device fabrication phase1420, a design verification phase1430, and a device verification phase1440. The design phase1410involves an initial design input operation1401where the basic elements and functionality of a device are determined, as well as revisions based on various analyses and optimization of a circuit design. This design input operation1401is where instances of an EDA circuit design file are used in the design and any additional circuitry is selected. The initial strategy, tactics, and context for the device to be created are also generated in the design input operation1401, depending on the particular design algorithm to be used.

In some embodiments, following an initial selection of design values in the design input operation1401, timing analysis and optimization according to various embodiments occurs in an optimization operation1411, along with any other automated design processes. One such process may be the automated design of a partitioned root search for error locator polynomial functions in RS FEC decoding. As described below, design constraints for blocks of a circuit design generated with design inputs in the design input operation1401may be analyzed using hierarchical timing analysis, according to various embodiments. While the design flow1400shows such optimization occurring prior to a layout instance1412, such hierarchical timing analysis and optimization may be performed at any time to verify operation of a circuit design. For example, in various embodiments, constraints for blocks in a circuit design may be generated prior to routing of connections in the circuit design, after routing, during register transfer level (RTL) operations, or as part of a final signoff optimization or verification prior to a device fabrication operation1422.

After design inputs are used in the design input operation1401to generate a circuit layout, and any optimization operations1411are performed, a layout is generated in the layout instance1412. The layout describes the physical layout dimensions of the device that match the design inputs. This layout may then be used in the device fabrication operation1422to generate a device, or additional testing and design updates may be performed using designer inputs or automated updates based on design simulation1432operations or extraction, 3D modeling and analysis1444operations. Once the device is generated, the device can be tested as part of device test1442operations, and layout modifications generated based on actual device performance.

As described in more detail below, design updates1436from the design simulation1432, design updates1446from the device test1442or the 3D modeling and analysis1444operations, or the design input operation1401may occur after an initial layout instance1412is generated. In various embodiments, whenever design inputs are used to update or change an aspect of a circuit design, a timing analysis and optimization operation1411may be performed.

For example, in various embodiments, a user may provide an input to a computing device indicating placement of elements of a circuit within a first portion of a circuit design, including description of circuitry for a partitioned root search for error locator polynomial functions in RS FEC decoding. An output to a display of the computing device may show details of a circuit design, and may further be used to generate results of the timing analysis, or may show recommended optimizations or automatically performed adjustments to the circuit design based on the timing analysis. Further inputs to the computing device may involve adjustments as user design inputs, with additional timing analysis and optimization initiated via user operation of the computing device. In some embodiments, a computing device may be used to generate circuit design files describing circuitry corresponding to embodiments described herein. Such circuit design files may be used as outputs to generate photolithographic masks or other control files and components used to generate circuits that operate in accordance with various embodiments described herein.

Although an overview of the inventive subject matter has been described with reference to specific example embodiments, various modifications and changes may be made to these embodiments without departing from the broader scope of embodiments of the present disclosure.

As used herein, the term “or” may be construed in either an inclusive or exclusive sense. The terms “a” or “an” should be read as meaning “at least one,” “one or more,” or the like. The use of words and phrases such as “one or more,” “at least,” “but not limited to,” or other like phrases shall not be read to mean that the narrower case is intended or required in instances where such broadening phrases may be absent.