Technologies for providing multiple tier memory media management

Technologies for providing multiple tier memory media management include a memory having a media access circuitry connected to a memory media. The media access circuitry is to receive a request to perform an in-memory compute operation. Additionally, the media access circuitry is to read, in response to the request, data from a memory media region of the memory media, write the read data into a compute media region of the memory, perform, on the data in the compute media region, the in-memory compute operation, write, to the memory media region, resultant data indicative of a result of performance of the in-memory compute operation.

BACKGROUND

Management of a memory media (e.g., the device or material that data is written to and read from) is typically performed by a memory controller of a computer. The memory controller may receive commands from a host (e.g., a processor of a compute device executing an application) to write to and/or read from the memory media, coordinate the performance of the received commands (e.g., performing memory accesses in response to the commands), and track a history of the memory accesses performed over time. By tracking the amount of time that has elapsed since a memory cell (e.g., a unit of the memory media capable of retaining a data value) was written to, the memory controller may adjust a reference voltage usable to determine whether a voltage at that memory cell is representative of a one or a zero (or other value) due to a drift (e.g., a gradual change) in the voltage over time. Similarly, the tracked memory accesses may be usable in performing wear leveling (e.g., distributing memory access operations across the available memory cells of the memory media) to reduce the likelihood that a subset of the available memory cells of the memory media will be used more, and thereby fail sooner, than other memory cells of the memory media. However, if the memory controller is unaware of memory access operations being performed in the memory, the memory controller is unable to effectively manage the memory media and may inadvertently interrupt an ongoing operation that is being performed in the memory.

DETAILED DESCRIPTION OF THE DRAWINGS

Referring now toFIG. 1, a compute device100for providing multiple tiers of memory media management (e.g., management of a storage/memory media region of a memory media and management of a compute media region of the memory media) includes a processor102, memory104, an input/output (I/O) subsystem112, a data storage device114, and communication circuitry122. Of course, in other embodiments, the compute device100may include other or additional components, such as those commonly found in a computer (e.g., a display, peripheral devices, etc.). Additionally, in some embodiments, one or more of the illustrative components may be incorporated in, or otherwise form a portion of, another component. As explained in more detail herein, the media access circuitry108, in the illustrative embodiment, is local to (e.g., on the same die, in the same package, etc.) the memory media110and may perform compute operations on data from the memory media110, thereby eliminating the need for data to be sent (e.g., through a bus) to the processor102or another component of the compute device100for computations to be performed on the data. In the illustrative embodiment, the media access circuitry108reads data to be operated on from a storage/memory media region of the memory media110that is managed by the memory controller106(e.g., by a compute media management logic unit150, which may be embodied as any device or circuitry, such as reconfigurable circuitry, an application specific integrated circuit (ASIC), etc. configured to perform management of the storage/memory media region) and writes the data to another region of the memory media110, referred to herein as the compute media region, which is managed exclusively by the media access circuitry108(e.g., by a media management logic unit152, which may be embodied as any device or circuitry, such as reconfigurable circuitry, an application specific integrated circuit (ASIC), etc. configured to perform management of the compute media region). As such, the memory controller106is unaware of and has no direct control over read/write operations that are performed on data in the compute media region of the memory media110). In performing a compute operation on the data, the media access circuitry108may perform multiple reads and writes to and from the compute media region, and may independently manage the memory access operations, tracking of wear on the memory cells in the compute media region, performing wear leveling, and adjusting reference voltages usable to determine the values of data residing in the compute media region. By offloading such operations from the more generalized memory controller106to the media access circuitry108, the memory controller106may be less complex (e.g., utilize a smaller die size, consume less power, etc.) than it would otherwise be, while still enabling in-memory computations to occur (e.g., rather than requiring the data to be sent to and from the processor102to perform computations on the data, which would consume additional energy and time).

The memory media110, in the illustrative embodiment, has a three-dimensional cross point architecture that has data access characteristics that differ from other memory architectures (e.g., dynamic random access memory (DRAM)), such as enabling access to one bit per tile and incurring time delays between reads or writes to the same partition or other partitions. The media access circuitry108is configured to make efficient use (e.g., in terms of power usage and speed) of the architecture of the memory media110, such as by accessing multiple tiles in parallel within a given partition, utilizing scratch pads (e.g., relatively small, low latency memory) to temporarily retain and operate on data read from the memory media110, and broadcasting data read from one partition to other portions of the memory104to enable matrix calculations (e.g., tensor operations) to be performed in parallel within the memory104. Additionally, in the illustrative embodiment, instead of sending read or write requests to the memory104to access matrix data, the processor102may send a higher-level request (e.g., a type of matrix calculation to perform) and provide the locations and dimensions (e.g., in memory) of the matrices to be utilized in the requested operation (e.g., an input matrix, a weight matrix, and an output matrix). Further, rather than sending back the resulting data to the processor102, the memory104may merely send back an acknowledgement (e.g., “Done”), indicating that the requested operation has been completed. As such, many compute operations, such as artificial intelligence operations (e.g., tensor operations involving matrix calculations) can be performed in memory104, with minimal usage of the bus between the processor102and the memory104. In some embodiments the media access circuitry108is included in the same die as the memory media110. In other embodiments, the media access circuitry108is on a separate die but in the same package as the memory media110. In yet other embodiments, the media access circuitry108is in a separate die and separate package but on the same dual in-line memory module (DIMM) or board as the memory media110.

The processor102may be embodied as any device or circuitry (e.g., a multi-core processor(s), a microcontroller, or other processor or processing/controlling circuit) capable of performing operations described herein, such as executing an application (e.g., an artificial intelligence related application that may utilize a neural network or other machine learning structure to learn and make inferences). In some embodiments, the processor102may be embodied as, include, or be coupled to an FPGA, an application specific integrated circuit (ASIC), reconfigurable hardware or hardware circuitry, or other specialized hardware to facilitate performance of the functions described herein.

The memory104, which may include a non-volatile memory (e.g., a far memory in a two-level memory scheme), includes the memory media110and the media access circuitry108(e.g., a device or circuitry, such as integrated circuitry constructed from complementary metal-oxide-semiconductors (CMOS) or other materials) underneath (e.g., at a lower location) and coupled to the memory media110. The media access circuitry108is also connected to the memory controller106, which may be embodied as any device or circuitry (e.g., a processor, a co-processor, dedicated circuitry, etc.) configured to selectively read from and/or write to the memory media110in response to corresponding requests (e.g., from the processor102which may be executing an artificial intelligence related application that relies on tensor operations to train a neural network and/or to make inferences).

Referring briefly toFIG. 2, the memory media110, in the illustrative embodiment, includes a tile architecture, also referred to herein as a cross point architecture (e.g., an architecture in which memory cells sit at the intersection of word lines and bit lines and are individually addressable and in which bit storage is based on a change in bulk resistance), in which each memory cell (e.g., tile)210,212,214,216,218,220,222,224,226,228,230,232,234,236,238,240is addressable by an x parameter and a y parameter (e.g., a column and a row). The memory media110includes multiple partitions, each of which includes the tile architecture. The partitions may be stacked as layers202,204,206to form a three-dimensional cross point architecture (e.g., Intel 3D XPoint™ memory). Unlike typical memory devices, in which only fixed-size multiple-bit data structures (e.g., byte, words, etc.) are addressable, the media access circuitry108is configured to read individual bits, or other units of data, from the memory media110at the request of the memory controller106, which may produce the request in response to receiving a corresponding request from the processor102.

Referring back toFIG. 1, the media access circuitry108, in the illustrative embodiment, includes a tensor logic unit130, which may be embodied as any device or circuitry (e.g., CMOS circuitry) configured to offload the performance of tensor operations from other portions of the media access circuitry108. The tensor logic unit130, in the illustrative embodiment, includes multiple memory scratch pads132, each of which may be embodied as any device or circuitry (e.g., static random access memories (SRAMs), register files, etc.) usable to provide relatively fast (e.g., low latency) access to data (e.g., matrix data) that has been read from the memory media110. In the illustrative embodiment, the scratch pads132provide faster read and write access times than the memory media110which has comparatively slower access times and a larger capacity. The tensor logic unit130may also include an error correction code (ECC) logic unit134, which may be embodied as any device or circuitry (e.g., reconfigurable circuitry, an ASIC, etc.) configured to perform an error correction algorithm (e.g., a Reed-Solomon algorithm, a Bose-Chaudhuri-Hocquenghem (BCH) algorithm, Low Density Parity Check Coding (LDPC), etc.) on data written to and read from the memory media110to detect and correct any errors (e.g., due to corruption). Additionally, in the illustrative embodiment, the tensor logic unit130includes multiple compute logic units136each of which may be embodied as any device or circuitry (e.g., reconfigurable circuitry, ASICs, etc.) configured to perform compute operations on data read from the memory media110(e.g., after the ECC logic unit134has performed an error correction process on the data).

Referring briefly toFIG. 3, in the illustrative embodiment, components of the memory104are divided into clusters310,320,330(e.g., groupings of components). The cluster310includes multiple partitions311of the memory media110, a set of scratch pads312,314,316, each similar to the scratch pads132ofFIG. 1, and a corresponding compute logic unit318, similar to the compute logic unit136ofFIG. 1. Similarly, the cluster320includes another set of partitions321of the memory media110, a corresponding set of scratch pads322,324,326, and a corresponding compute logic unit328. The cluster330also includes a set of partitions331of the memory media110, a corresponding set of scratch pads332,334,336, and a compute logic unit338. In the illustrative embodiment, in operation, the compute logic unit318reads a subset of matrix data (e.g., one value of an input matrix A from the set of partitions (e.g., partitions311)) and provides the read data to the ECC logic unit134to perform an error correction process to correct any errors in the data. The compute logic unit318may additionally write the data (e.g., after the error correction process has been performed) into the corresponding scratch pad312and may broadcast that same subset of the matrix data to the corresponding scratch pads of the other clusters (e.g., to the scratch pads322,332). Similarly, the compute logic unit328may read, from the corresponding set of partitions321another subset of the matrix data (e.g., another value of the input matrix A) into the corresponding scratch pad322, utilizing the ECC logic unit134to correct any errors, and broadcast that subset of the matrix data to the other scratch pads that are to store data for that matrix (e.g., to the scratch pads312,332). The compute logic unit338may perform similar operations.

By broadcasting, to the other scratch pads, matrix data that has been read from a corresponding set of partitions of the memory media110, the media access circuitry108reduces the number of times that a given section (e.g., set of partitions) of the memory media110must be accessed to obtain the same matrix data (e.g., the read matrix data may be broadcast to multiple scratch pads after being read from the memory media110once, rather than reading the same matrix data from the memory media110multiple times). Further, by utilizing multiple compute logic units318,328,338that are each associated with corresponding scratch pads312,314,316,322,224,226,232,234,236, the media access circuitry108may perform the portions of a tensor operation (e.g., matrix multiply and accumulate) concurrently (e.g., in parallel). It should be understood that while three clusters310,320,330are shown inFIG. 3for simplicity, the actual number of clusters and corresponding partitions, scratch pads, and compute logic units may differ depending on the particular embodiment.

Referring briefly toFIG. 4, an example of a matrix multiplication (e.g., matrix multiply and accumulate) operation400that may be performed by the memory104is shown. As illustrated, matrix data in an input matrix A is multiplied by matrix data in another matrix B (e.g., weight data for a layer of a convolutional neural network) and the resultant data is written to the output matrix C. Each matrix represented inFIG. 4is temporarily stored as matrix data in the scratch pads132of the media access circuitry108. In some embodiments, the output matrix C may be utilized as an input matrix for a subsequent tensor operation (e.g., as an input matrix for a subsequent layer of a convolutional neural network).

Referring now toFIG. 5, a diagram500of different media regions502,504of the memory media110is shown. As indicated, tensor logic unit130may utilize the compute media management logic unit150to manage writes to and reads from a compute media region504(e.g., a designated subset of the memory cells) of the memory media110when performing in-memory compute operations, such as matrix operations (e.g., tensor operations), artificial intelligence related operations (e.g., training a neural network, determining an inference with a trained neural network, etc.), and/or other operations. The memory controller106does not have direct control over memory accesses to the compute media region504. Rather, the memory controller106manages a different region, the storage/memory media region502(e.g., a designated subset of the memory cells) of the memory media110. In operation, and as described herein, the memory controller106may provide a request to the media access circuitry108(e.g., to the tensor logic unit130) to perform an in-memory compute operation on a set of data, and provide, with the request, location data indicative of a location of the data in the storage/memory media region502on which the in-memory compute operation is to be performed. In response, the tensor logic unit130reads the data from the location in the storage/media region502, writes the data to the compute media region504, and performs in-memory compute operations on the data in the compute media region504. In doing so, the tensor logic unit130may read and write to and from the compute media region504multiple times (e.g., reading and/or writing intermediate results) until resultant data indicative of a result of the in-memory compute operation is produced. The tensor logic unit130may then write the resultant data back to the storage/memory media region502. The memory controller106may send a read command to the storage/memory media region502, receive the data, ECC correct the data using a storage ECC unit, write the corrected data to the tensor logic unit130, which will ECC protect the data using a tensor ECC unit, and subsequently write the data to the compute media region504. Conversely, the tensor logic unit150may read data from the compute media region504, perform ECC correction on the read data using the tensor ECC unit, and provide the data to the memory controller106, which may perform further ECC correction on the data using the storage ECC unit. In the illustrative embodiment, the tensor logic unit130(e.g., the tensor ECC unit of the tensor logic unit130) and the memory controller106(e.g., the storage ECC unit of the memory controller106) may perform different ECC algorithms and the strength of the algorithms may differ (e.g., the memory controller106may perform a stronger ECC algorithm (e.g., to correct more errors) than the tensor logic unit130).

Referring back toFIG. 1, the memory104may include non-volatile memory and volatile memory. The non-volatile memory may be embodied as any type of data storage capable of storing data in a persistent manner (even if power is interrupted to the non-volatile memory). For example, the non-volatile memory may be embodied as one or more non-volatile memory devices. The non-volatile memory devices may include one or more memory devices configured in a cross point architecture that enables bit-level addressability (e.g., the ability to read from and/or write to individual bits of data, rather than bytes or other larger units of data), and are illustratively embodied as three-dimensional (3D) cross point memory. In some embodiments, the non-volatile memory may additionally include other types of memory, including any combination of memory devices that use chalcogenide phase change material (e.g., chalcogenide glass), ferroelectric transistor random-access memory (FeTRAM), nanowire-based non-volatile memory, phase change memory (PCM), memory that incorporates memristor technology, Magnetoresistive random-access memory (MRAM) or Spin Transfer Torque (STT)-MRAM. The volatile memory may be embodied as any type of data storage capable of storing data while power is supplied volatile memory. For example, the volatile memory may be embodied as one or more volatile memory devices, and is periodically referred to hereinafter as volatile memory with the understanding that the volatile memory may be embodied as other types of non-persistent data storage in other embodiments. The volatile memory may have an architecture that enables bit-level addressability, similar to the architecture described above.

The processor102and the memory104are communicatively coupled to other components of the compute device100via the I/O subsystem112, which may be embodied as circuitry and/or components to facilitate input/output operations with the processor102and/or the main memory104and other components of the compute device100. For example, the I/O subsystem112may be embodied as, or otherwise include, memory controller hubs, input/output control hubs, integrated sensor hubs, firmware devices, communication links (e.g., point-to-point links, bus links, wires, cables, light guides, printed circuit board traces, etc.), and/or other components and subsystems to facilitate the input/output operations. In some embodiments, the I/O subsystem112may form a portion of a system-on-a-chip (SoC) and be incorporated, along with one or more of the processor102, the main memory104, and other components of the compute device100, in a single chip.

The data storage device114may be embodied as any type of device configured for short-term or long-term storage of data such as, for example, memory devices and circuits, memory cards, hard disk drives, solid-state drives, or other data storage device. In the illustrative embodiment, the data storage device114includes a memory controller116, similar to the memory controller106, a media management logic unit162, similar to the media management logic unit152, storage media120, similar to the memory media110, and media access circuitry118, similar to the media access circuitry108, including a tensor logic unit140, similar to the tensor logic unit130, scratch pads142, similar to the scratch pads132, an ECC logic unit144, similar to the ECC logic unit134, compute logic units146, similar to the compute logic units136, and a compute media management logic unit160, similar to the compute media management logic unit150. The data storage device114may include a system partition that stores data and firmware code for the data storage device114and one or more operating system partitions that store data files and executables for operating systems.

The communication circuitry122may be embodied as any communication circuit, device, or collection thereof, capable of enabling communications over a network between the compute device100and another device. The communication circuitry122may be configured to use any one or more communication technology (e.g., wired or wireless communications) and associated protocols (e.g., Ethernet, Bluetooth®, Wi-Fi®, WiMAX, etc.) to effect such communication.

The illustrative communication circuitry122includes a network interface controller (NIC)124, which may also be referred to as a host fabric interface (HFI). The NIC124may be embodied as one or more add-in-boards, daughter cards, network interface cards, controller chips, chipsets, or other devices that may be used by the compute device100to connect with another compute device. In some embodiments, the NIC124may be embodied as part of a system-on-a-chip (SoC) that includes one or more processors, or included on a multichip package that also contains one or more processors. In some embodiments, the NIC124may include a local processor (not shown) and/or a local memory (not shown) that are both local to the NIC124. In such embodiments, the local processor of the NIC124may be capable of performing one or more of the functions of the processor102. Additionally or alternatively, in such embodiments, the local memory of the NIC124may be integrated into one or more components of the compute device100at the board level, socket level, chip level, and/or other levels.

Referring now toFIG. 6, the compute device100, in operation, may execute a method600for providing multiple tier memory media (e.g., two different regions502,504of the memory media110) management. The method600is described with reference to the memory104. However, it should be understood that the method600could be additionally or alternatively performed using the memory of the data storage device114. The method600begins with block602in which the compute device100(e.g., the memory104) determines whether to enable multiple tier memory media management. The compute device100may enable multiple tier memory media management in response to a determination that a configuration setting (e.g., in a configuration file) indicates to enable multiple tier memory media management, in response to a determination that compute media management logic unit150and the media management logic unit152are present, and/or based on other factors. Regardless, in response to a determination to enable multiple tier memory media management, the method600advances to block604, in which the compute device100(e.g., the memory104) may receive a request to perform one or more memory access operations (e.g., from the processor102executing an application). As indicated in block606, the memory104may receive a request to be managed by a workload aware media access circuitry (e.g., the media access circuitry108) connected to the memory media110. The media access circuitry108is workload aware because it is integral to (e.g., coordinates and utilizes components of the media access circuitry108(e.g., the tensor logic unit130and more specifically, the compute media management logic unit150) to perform) in-memory compute operations that may be performed in association with a workload (e.g., the application executed by the processor102). As indicated in block608, the request may be a request to be managed by a tensor logic unit (e.g., the tensor logic unit130in the media access circuitry108). Further, and as indicated in block610, the request may be a request that is to be managed by a compute media management logic unit (e.g., the compute media management logic unit150). As indicated in block612, the request may be a request to be managed by a complementary metal-oxide semiconductor (CMOS) connected to the memory media110(e.g., to be managed by the media access circuitry108, which may be formed from a CMOS). The request may be a request to be managed by a media access circuitry located in the same die (e.g., semiconductor die) or package (e.g., semiconductor package) as the memory media110(e.g., to be managed by the media access circuitry108, which may be integrated into the same die or the same package as the memory media110), as indicated in block614.

In some embodiments, the request is a request to perform multiple memory access operations (e.g., multiple writes, multiple reads, etc.), as indicated in block616. As indicated in block618, the request may be a request to perform one or more in-memory compute operations. For example, and as indicated in block620, the request may be to perform one or more matrix operations (e.g., a matrix multiplication operation similar to the operation400ofFIG. 4). As indicated in block622, the request may be to perform one or more artificial intelligence operations (e.g., operations relating to training a neural network, producing an inference with a neural network, etc.). Alternatively, the request may be a request that is to be managed by the memory controller106, as indicated in block624(e.g., the request does not require an awareness of multiple read and/or write operations performed within the memory104). For example, and as indicated in block626, the request may be to perform a single memory access operation (e.g., to write data or to read data). In the illustrative embodiment, and as indicated in block628, the request is a request to perform one or more memory access operations on a memory media having a cross point architecture (e.g., an architecture in which memory cells sit at the intersection of word lines and bit lines and are individually addressable and in which bit storage is based on a change in bulk resistance). Further, and as indicated in block630, the request may be a request to perform one or more media access operations on a memory media having a three dimensional cross point architecture (e.g., an architecture in which sets of tiles are stacked as layers, as described with reference toFIG. 2). In other embodiments, the request may be to perform the memory access operations on a memory media having a different architecture.

Referring now toFIG. 7, in block632, the compute device100(e.g., the memory104) determines the subsequent course of action based on whether a request to perform one or more memory operations was received. If not, the method600loops back to block604ofFIG. 6to potentially receive a request to perform one or more memory access operations. Otherwise (e.g., if a request was received), the method600advances to block634, in which the compute device100(e.g., the memory104) determines the subsequent course of action based on whether the received request is to be managed by a workload aware media access circuitry (e.g., the media access circuitry108) or not. If the request is not to be managed by the workload aware media access circuitry (e.g., the media access circuitry108), the method600advances to block636, in which the compute device100manages the requested memory access operation with the memory controller106. In doing so, and as indicated in block638, the compute device100(e.g., the memory controller106) may read from the storage/memory media region502of the memory media110. Alternatively, the compute device100may write to the storage/memory media region502of the memory media110, as indicated in block640. In performing a read or write operation, the memory controller106may perform an error correction code algorithm on the data (e.g., to correct errors in read data or to protect data that is being written). Further, if an error correction code algorithm is unable to correct one or more errors in accessed (e.g., read) data, the memory controller106may report the inability to correct the error(s) (e.g., an “ECC fatal” status) to the host (e.g., to the processor102), as indicated in block642. As indicated in block643, the compute device100(e.g., the memory controller106) may update memory media usage data, which may be embodied as any data indicative of access operations that have been performed on the memory media110(e.g., the storage/memory media region502) over time. In doing so, the memory controller106may write, to the memory media usage data, a record of the memory access operation that was just performed, including the memory cell(s) that were accessed, a timestamp of when the memory access operation occurred, and the type of access operation that was performed (e.g., read or write).

Referring back to block634, if the request is instead to be managed by workload aware media access circuitry, the method600advances to block644, in which the compute device100(e.g., the media access circuitry108) manages the requested memory access operation(s). In doing so, and as indicated in block646, the media access circuitry108(e.g., the tensor logic unit130, and more specifically the compute media management logic unit150) receives, from the memory controller106, location data indicative of one or more locations of data to be read from the storage/memory media region502and operated on. Further, and as indicated in block648, the media access circuitry108reads the data from the storage/memory media region502using the location data (e.g., from block646). Additionally, in the illustrative embodiment, the media access circuitry108may write the read data to the compute media region504of the memory media110, as indicated in block650. The media access circuitry108may also write at least a portion of the read data to one or more of the scratch pads132(e.g., to enable relatively quick access to that data), as indicated in block652. In accessing data, the media access circuitry108(e.g., using the ECC logic unit(s)134) may perform an error correction algorithm to correct one or more errors in read data and/or to protect data that is being written to the memory media110(e.g., to the compute media region504), as indicated in block653. In some embodiments, if one or more errors in accessed data cannot be corrected, the media access circuitry108may report an error to the host (e.g., the processor102) indicating that the data could not be corrected, as indicated in block654. As a result, the compute device100may end the operation and may report a corresponding error to a user of the compute device100. In some embodiments, rather than immediately sending an ECC fatal status to the host, the media access circuitry108may first send the data to the memory controller106to perform a stronger ECC algorithm on the data to potentially correct error(s) that the media access circuitry108was unable to correct. As indicated in block655, the media access circuitry108, in the illustrative embodiment, receives, from the memory controller106, an identification of one or more in-memory compute operations to be performed on the data that was read from the storage/memory media region502(e.g., a request identifying an in-memory compute operation that was sent from the processor102and passed through the memory controller106to the media access circuitry108). For example, and as indicated in block656, the media access circuitry108may receive an identification of one or more matrix operations to be performed on the read data.

Referring now toFIG. 8, the media access circuitry108, in the illustrative embodiment, performs the requested memory access operation(s) on data from the storage/memory media region502, as indicated in block658. In doing so, and as indicated in block660, the media access circuitry108performs requested in-memory compute operation(s) on the data that was read from the storage/memory media region502. As indicated in block662, the media access circuitry108performs the operation(s) with the tensor logic unit130(e.g., using the compute media management logic unit150in the tensor logic unit130). In performing in-memory compute operation(s), the media access circuitry108performs memory accesses to facilitate the in-memory compute operation(s), as indicated in block664. As indicated in block666, the media access circuitry108(e.g., the tensor logic unit130using the compute media management logic unit150) may perform memory accesses to facilitate one or more matrix operations, such as the matrix multiplication operation400ofFIG. 4, such as reading matrix elements, multiplying them, and writing a result back to the memory media110one or more times. As indicated in block668, the media access circuitry108may perform the memory access operations during the performance of an artificial intelligence related operation (e.g., training a neural network, producing an inference with a neural network, etc.). As indicated in block670, the media access circuitry108may perform multiple writes to the compute media region504of the memory media110. Additionally or alternatively, and as indicated in block672, the media access circuitry108may perform multiple reads from the compute media region504of the memory media110. Further, in performing the memory access operations, the media access circuitry108may distribute memory accesses (e.g., writes and reads) across the compute media region504of the memory media110to level the wear on the memory cells (e.g., to avoid using the same memory cells repeatedly, causing those memory cells to fail faster than other memory cells in the compute media region504of the memory media110), as indicated in block674. As indicated in block676, the media access circuitry108, in the illustrative embodiment, tracks the memory access operation(s) (e.g., updates memory media usage data using a process similar to that described with reference to block643ofFIG. 7).

Subsequently, in block678, the media access circuitry108writes resultant data indicative of a result of the requested operation(s) (e.g., a matrix multiplication operation) to the storage/memory media region502, as indicated in block678. After the media access circuitry108has performed block678or after the memory controller106has performed block636, the method600may proceed to block680, in which the memory104updates, as a function of the memory media usage data, reference voltage data usable to determine data values present in the memory media (e.g., by accounting for the amount of time that has elapsed since a value was written to a given memory cell and the rate at which the voltage drifts from its initial voltage). Subsequently, the method600loops back to block602ofFIG. 6in which the compute device100may receive another request to perform one or more operations.

EXAMPLES

Example 1 includes a memory comprising media access circuitry connected to a memory media, wherein the media access circuitry is to receive a request to perform an in-memory compute operation; read, in response to the request, data from a memory media region of the memory media, wherein the memory media region is to be managed by a memory controller; write the read data into a compute media region of the memory, wherein the compute media region is to be managed by the media access circuitry; perform, on the data in the compute media region, the in-memory compute operation; and write, to the memory media region, resultant data indicative of a result of performance of the in-memory compute operation.

Example 2 includes the subject matter of Example 1, and wherein the media access circuitry is further to receive, from the memory controller, location data indicative of a one or more locations of the data to be read from the memory media region of the memory media.

Example 3 includes the subject matter of any of Examples 1 and 2, and wherein the media access circuitry is further to write at least a portion of the read data to one or more scratch pads.

Example 4 includes the subject matter of any of Examples 1-3, and wherein the media access circuitry is further to receive, from a memory controller, an identification of the in-memory compute operation to perform on the read data.

Example 5 includes the subject matter of any of Examples 1-4, and wherein to perform the requested in-memory compute operation comprises to perform a tensor operation.

Example 6 includes the subject matter of any of Examples 1-5, and wherein the media access circuitry is further to perform multiple writes to the compute media region in the performance of the in-memory compute operation.

Example 7 includes the subject matter of any of Examples 1-6, and wherein the media access circuitry is further to perform multiple reads from the compute media region in the performance of the in-memory compute operation.

Example 8 includes the subject matter of any of Examples 1-7, and wherein the media access circuitry is further to distribute memory accesses across the compute media region in the performance of the in-memory compute operation.

Example 9 includes the subject matter of any of Examples 1-8, and wherein the media access circuitry is further to track, with memory media usage data, the memory accesses.

Example 10 includes the subject matter of any of Examples 1-9, and wherein the media access circuitry is further to update, as a function of the memory media usage data, reference voltage data usable to determine data values present in the memory media.

Example 11 includes the subject matter of any of Examples 1-10, and wherein to receive a request to perform an in-memory compute operation comprises to receive a request to perform a matrix operation.

Example 12 includes the subject matter of any of Examples 1-11, and wherein to receive a request to perform an in-memory compute operation comprises to receive a request to perform an artificial intelligence operation.

Example 13 includes the subject matter of any of Examples 1-12, and wherein the media access circuitry is formed from a complementary metal-oxide-semiconductor.

Example 14 includes the subject matter of any of Examples 1-13, and wherein the memory media has a cross point architecture.

Example 15 includes the subject matter of any of Examples 1-14, and wherein the memory media has a three dimensional cross point architecture.

Example 16 includes the subject matter of any of Examples 1-15, and wherein the media access circuitry is further to perform a first error correction algorithm and the memory controller is to perform a second error correction algorithm that is different from the first error correction algorithm.

Example 17 includes a method comprising receiving, by media access circuitry connected to a memory media, a request to perform an in-memory compute operation; reading, by the media access circuitry and in response to the request, data from a memory media region of the memory media, wherein the memory media region is to be managed by a memory controller; writing, by the media access circuitry, the read data into a compute media region of the memory, wherein the compute media region is to be managed by the media access circuitry; performing, by the media access circuitry and on the data in the compute media region, the in-memory compute operation; and writing, by the media access circuitry and to the memory media region, resultant data indicative of a result of performance of the in-memory compute operation.

Example 18 includes the subject matter of Example 17, and further including receiving, by the media access circuitry and from the memory controller, location data indicative of a one or more locations of the data to be read from the memory media region of the memory media.

Example 19 includes the subject matter of any of Examples 17 and 18, and wherein performing the requested in-memory compute operation comprises performing a tensor operation.

Example 20 includes one or more machine-readable storage media comprising a plurality of instructions stored thereon that, in response to being executed, cause media access circuitry connected to a memory media to receive a request to perform an in-memory compute operation; read, in response to the request, data from a memory media region of the memory media, wherein the memory media region is to be managed by a memory controller; write the read data into a compute media region of the memory, wherein the compute media region is to be managed by the media access circuitry; perform, on the data in the compute media region, the in-memory compute operation; and write, to the memory media region, resultant data indicative of a result of performance of the in-memory compute operation.