Direct memory access - wikipedia Direct memory access AMD DirectGMA is a form of DMA. It enables low - latency peer - to - peer data transfers between devices on the PCIe bus and AMD FirePro - branded products. Serial digital interface ( SDI ) devices supporting DirectGMA can write directly into the graphics memory of the GPU and vice versa the GPU can directly access the memory of a peer device. Direct memory access ( DMA ) is a feature of computer systems that allows certain hardware subsystems to access main system memory ( Random - access memory ), independent of the central processing unit ( CPU ). Without DMA, when the CPU is using programmed input / output, it is typically fully occupied for the entire duration of the read or write operation, and is thus unavailable to perform other work. With DMA, the CPU first initiates the transfer, then it does other operations while the transfer is in progress, and it finally receives an interrupt from the DMA controller when the operation is done. This feature is useful at any time that the CPU can not keep up with the rate of data transfer, or when the CPU needs to perform work while waiting for a relatively slow I / O data transfer. Many hardware systems use DMA, including disk drive controllers, graphics cards, network cards and sound cards. DMA is also used for intra-chip data transfer in multi-core processors. Computers that have DMA channels can transfer data to and from devices with much less CPU overhead than computers without DMA channels. Similarly, a processing element inside a multi-core processor can transfer data to and from its local memory without occupying its processor time, allowing computation and data transfer to proceed in parallel. DMA can also be used for `` memory to memory '' copying or moving of data within memory. DMA can offload expensive memory operations, such as large copies or scatter - gather operations, from the CPU to a dedicated DMA engine. An implementation example is the I / O Acceleration Technology. Contents 1 Principles 1.1 Third - party DMA 1.2 Bus mastering 1.3 Transfer types 2 Modes of operation 2.1 Burst mode 2.2 Cycle stealing mode 2.3 Transparent mode 3 Cache coherency 4 Examples 4.1 ISA 4.2 PCI 4.3 I / OAT 4.4 DDIO 4.5 AHB 4.6 Cell 5 Pipelining 6 See also 7 Notes 8 References 9 External links Principles Third - party DMA Standard DMA, also called third - party DMA, uses a DMA controller. A DMA controller can generate memory addresses and initiate memory read or write cycles. It contains several hardware registers that can be written and read by the CPU. These include a memory address register, a byte count register, and one or more control registers. Depending on what features the DMA controller provides, these control registers might specify some combination of the source, the destination, the direction of the transfer ( reading from the I / O device or writing to the I / O device ), the size of the transfer unit, and / or the number of bytes to transfer in one burst. To carry out an input, output or memory - to - memory operation, the host processor initializes the DMA controller with a count of the number of words to transfer, and the memory address to use. The CPU then commands peripheral device to initiate data transfer. The DMA controller then provides addresses and read / write control lines to the system memory. Each time a byte of data is ready to be transferred between the peripheral device and memory, the DMA controller increments its internal address register until the full block of data is transferred. Bus mastering In a bus mastering system, also known as a first - party DMA system, the CPU and peripherals can each be granted control of the memory bus. Where a peripheral can become bus master, it can directly write to system memory without involvement of the CPU, providing memory address and control signals as required. Some measure must be provided to put the processor into a hold condition so that bus contention does not occur. Transfer types DMA transfers can either transfer one byte at a time or all at once in burst mode. If they transfer a byte at a time, this can allow the CPU to access memory on alternate bus cycles -- this is called cycle stealing since the CPU and either the DMA controller or the bus master contend for memory access. In burst mode DMA, the CPU can be put on hold while the DMA transfer occurs and a full block of possibly hundreds or thousands of bytes can be moved. When memory cycles are much faster than processor cycles, an interleaved DMA cycle is possible, where the DMA controller uses memory while the CPU can not. Modes of operation Burst mode An entire block of data is transferred in one contiguous sequence. Once the DMA controller is granted access to the system bus by the CPU, it transfers all bytes of data in the data block before releasing control of the system buses back to the CPU, but renders the CPU inactive for relatively long periods of time. The mode is also called `` Block Transfer Mode ''. Cycle stealing mode The cycle stealing mode is used in systems in which the CPU should not be disabled for the length of time needed for burst transfer modes. In the cycle stealing mode, the DMA controller obtains access to the system bus the same way as in burst mode, using BR ( Bus Request ) and BG ( Bus Grant ) signals, which are the two signals controlling the interface between the CPU and the DMA controller. However, in cycle stealing mode, after one byte of data transfer, the control of the system bus is deasserted to the CPU via BG. It is then continually requested again via BR, transferring one byte of data per request, until the entire block of data has been transferred. By continually obtaining and releasing the control of the system bus, the DMA controller essentially interleaves instruction and data transfers. The CPU processes an instruction, then the DMA controller transfers one data value, and so on. On the one hand, the data block is not transferred as quickly in cycle stealing mode as in burst mode, but on the other hand the CPU is not idled for as long as in burst mode. Cycle stealing mode is useful for controllers that monitor data in real time. Transparent mode Transparent mode takes the most time to transfer a block of data, yet it is also the most efficient mode in terms of overall system performance. In transparent mode, the DMA controller transfers data only when the CPU is performing operations that do not use the system buses. The primary advantage of transparent mode is that the CPU never stops executing its programs and the DMA transfer is free in terms of time, while the disadvantage is that the hardware needs to determine when the CPU is not using the system buses, which can be complex. Cache coherency Cache incoherence due to DMA DMA can lead to cache coherency problems. Imagine a CPU equipped with a cache and an external memory that can be accessed directly by devices using DMA. When the CPU accesses location X in the memory, the current value will be stored in the cache. Subsequent operations on X will update the cached copy of X, but not the external memory version of X, assuming a write - back cache. If the cache is not flushed to the memory before the next time a device tries to access X, the device will receive a stale value of X. Similarly, if the cached copy of X is not invalidated when a device writes a new value to the memory, then the CPU will operate on a stale value of X. This issue can be addressed in one of two ways in system design : Cache - coherent systems implement a method in hardware whereby external writes are signaled to the cache controller which then performs a cache invalidation for DMA writes or cache flush for DMA reads. Non-coherent systems leave this to software, where the OS must then ensure that the cache lines are flushed before an outgoing DMA transfer is started and invalidated before a memory range affected by an incoming DMA transfer is accessed. The OS must make sure that the memory range is not accessed by any running threads in the meantime. The latter approach introduces some overhead to the DMA operation, as most hardware requires a loop to invalidate each cache line individually. Hybrids also exist, where the secondary L2 cache is coherent while the L1 cache ( typically on - CPU ) is managed by software. Examples ISA In the original IBM PC, there was only one Intel 8237 DMA controller capable of providing four DMA channels ( numbered 0 -- 3 ), as part of the so - called Industry Standard Architecture, or ISA. These DMA channels performed 8 - bit transfers and could only address the first megabyte of RAM. With the IBM PC / AT, a second 8237 DMA controller was added ( channels 5 -- 7 ; channel 4 is dedicated as a cascade channel for the first 8237 controller ), and the page register was rewired to address the full 16 MB memory address space of the 80286 CPU. This second controller performed 16 - bit transfers. Due to their lagging performance ( 2.5 Mbit / s ), these devices have been largely obsolete since the advent of the 80386 processor in 1985 and its capacity for 32 - bit transfers. They are still supported to the extent they are required to support built - in legacy PC hardware on modern machines. The only pieces of legacy hardware that use ISA DMA and are still fairly common are Super I / O devices on motherboards that often integrate a built - in floppy disk controller, an IrDA infrared controller when FIR ( fast infrared ) mode is selected, and a IEEE 1284 parallel port controller when ECP mode is selected. Each DMA channel has a 16 - bit address register and a 16 - bit count register associated with it. To initiate a data transfer the device driver sets up the DMA channel 's address and count registers together with the direction of the data transfer, read or write. It then instructs the DMA hardware to begin the transfer. When the transfer is complete, the device interrupts the CPU. Scatter - gather or vectored I / O DMA allows the transfer of data to and from multiple memory areas in a single DMA transaction. It is equivalent to the chaining together of multiple simple DMA requests. The motivation is to off - load multiple input / output interrupt and data copy tasks from the CPU. DRQ stands for Data request ; DACK for Data acknowledge. These symbols, seen on hardware schematics of computer systems with DMA functionality, represent electronic signaling lines between the CPU and DMA controller. Each DMA channel has one Request and one Acknowledge line. A device that uses DMA must be configured to use both lines of the assigned DMA channel. Standard ISA DMA assignments : DRAM Refresh ( obsolete ), User hardware, usually sound card 8 - bit DMA Floppy disk controller, Hard disk ( obsoleted by PIO modes, and replaced by UDMA modes ), Parallel Port ( ECP capable port ), certain SoundBlaster Clones like the OPTi 928. Cascade from XT DMA controller, Hard Disk ( PS / 2 only ), user hardware for all others, usually sound card 16 - bit DMA User hardware. User hardware. PCI A PCI architecture has no central DMA controller, unlike ISA. Instead, any PCI component can request control of the bus ( `` become the bus master '' ) and request to read from and write to system memory. More precisely, a PCI component requests bus ownership from the PCI bus controller ( usually the southbridge in a modern PC design ), which will arbitrate if several devices request bus ownership simultaneously, since there can only be one bus master at one time. When the component is granted ownership, it will issue normal read and write commands on the PCI bus, which will be claimed by the bus controller and will be forwarded to the memory controller using a scheme which is specific to every chipset. As an example, on a modern AMD Socket AM2 - based PC, the southbridge will forward the transactions to the northbridge ( which is integrated on the CPU die ) using HyperTransport, which will in turn convert them to DDR2 operations and send them out on the DDR2 memory bus. As can be seen, there are quite a number of steps involved in a PCI DMA transfer ; however, that poses little problem, since the PCI device or PCI bus itself are an order of magnitude slower than the rest of the components ( see list of device bandwidths ). A modern x86 CPU may use more than 4 GB of memory, utilizing Physical Address Extension ( PAE ), a 36 - bit addressing mode, or the native 64 - bit mode of x86 - 64 CPUs. In such a case, a device using DMA with a 32 - bit address bus is unable to address memory above the 4 GB line. The new Double Address Cycle ( DAC ) mechanism, if implemented on both the PCI bus and the device itself, enables 64 - bit DMA addressing. Otherwise, the operating system would need to work around the problem by either using costly double buffers ( DOS / Windows nomenclature ) also known as bounce buffers ( FreeBSD / Linux ), or it could use an IOMMU to provide address translation services if one is present. I / OAT As an example of DMA engine incorporated in a general - purpose CPU, newer Intel Xeon chipsets include a DMA engine called I / O Acceleration Technology ( I / OAT ), which can offload memory copying from the main CPU, freeing it to do other work. In 2006, Intel 's Linux kernel developer Andrew Grover performed benchmarks using I / OAT to offload network traffic copies and found no more than 10 % improvement in CPU utilization with receiving workloads, and no improvement when transmitting data. DDIO Further performance - oriented enhancements to the DMA mechanism have been introduced in Intel Xeon E5 processors with their Data Direct I / O ( DDIO ) feature, allowing the DMA `` windows '' to reside within CPU caches instead of system RAM. As a result, CPU caches are used as the primary source and destination for I / O, allowing network interface controllers ( NICs ) to talk directly to the caches of local CPUs and avoid costly fetching of the I / O data from system RAM. As a result, DDIO reduces the overall I / O processing latency, allows processing of the I / O to be performed entirely in - cache, prevents the available RAM bandwidth from becoming a performance bottleneck, and lowers the power consumption by allowing RAM to remain longer in low - powered state. AHB Main article : Advanced Microcontroller Bus Architecture In systems - on - a-chip and embedded systems, typical system bus infrastructure is a complex on - chip bus such as AMBA High - performance Bus. AMBA defines two kinds of AHB components : master and slave. A slave interface is similar to programmed I / O through which the software ( running on embedded CPU, e.g. ARM ) can write / read I / O registers or ( less commonly ) local memory blocks inside the device. A master interface can be used by the device to perform DMA transactions to / from system memory without heavily loading the CPU. Therefore, high bandwidth devices such as network controllers that need to transfer huge amounts of data to / from system memory will have two interface adapters to the AHB : a master and a slave interface. This is because on - chip buses like AHB do not support tri-stating the bus or alternating the direction of any line on the bus. Like PCI, no central DMA controller is required since the DMA is bus - mastering, but an arbiter is required in case of multiple masters present on the system. Internally, a multichannel DMA engine is usually present in the device to perform multiple concurrent scatter - gather operations as programmed by the software. Cell Main article : Cell ( microprocessor ) As an example usage of DMA in a multiprocessor - system - on - chip, IBM / Sony / Toshiba 's Cell processor incorporates a DMA engine for each of its 9 processing elements including one Power processor element ( PPE ) and eight synergistic processor elements ( SPEs ). Since the SPE 's load / store instructions can read / write only its own local memory, an SPE entirely depends on DMAs to transfer data to and from the main memory and local memories of other SPEs. Thus the DMA acts as a primary means of data transfer among cores inside this CPU ( in contrast to cache - coherent CMP architectures such as Intel 's cancelled general - purpose GPU, Larrabee ). DMA in Cell is fully cache coherent ( note however local stores of SPEs operated upon by DMA do not act as globally coherent cache in the standard sense ). In both read ( `` get '' ) and write ( `` put '' ), a DMA command can transfer either a single block area of size up to 16 KB, or a list of 2 to 2048 such blocks. The DMA command is issued by specifying a pair of a local address and a remote address : for example when a SPE program issues a put DMA command, it specifies an address of its own local memory as the source and a virtual memory address ( pointing to either the main memory or the local memory of another SPE ) as the target, together with a block size. According to an experiment, an effective peak performance of DMA in Cell ( 3 GHz, under uniform traffic ) reaches 200 GB per second. Pipelining Processors with scratchpad memory and DMA ( such as digital signal processors and the Cell processor ) may benefit from software overlapping DMA memory operations with processing, via double buffering or multibuffering. For example, the on - chip memory is split into two buffers ; the processor may be operating on data in one, while the DMA engine is loading and storing data in the other. This allows the system to avoid memory latency and exploit burst transfers, at the expense of needing a predictable memory access pattern. See also Computing portal AT Attachment Blitter Channel I / O DMA attack Polling ( computer science ) Remote direct memory access UDMA Autonomous peripheral operation Notes Jump up ^ Osborne, Adam ( 1980 ). An Introduction to Microcomputers : Volume 1 : Basic Concepts ( 2nd ed. ). Osborne McGraw Hill. pp. 5 -- 64 through 5 -- 93. ISBN 0931988349. Jump up ^ Horowitz, Paul ; Hill, Winfield ( 1989 ). The Art of Electronics ( Second ed. ). Cambridge University Press. p. 702. ISBN 0521370957. Jump up ^ Intel publication 03040, Aug 1989 Jump up ^ `` Physical Address Extension -- PAE Memory and Windows ''. Microsoft Windows Hardware Development Central. 2005. Retrieved 2008 - 04 - 07. Jump up ^ Corbet, Jonathan ( December 8, 2005 ). `` Memory copies in hardware ''. LWN.net. Jump up ^ Grover, Andrew ( 2006 - 06 - 01 ). `` I / OAT on LinuxNet wiki ''. Overview of I / OAT on Linux, with links to several benchmarks. Retrieved 2006 - 12 - 12. Jump up ^ `` Intel Data Direct I / O ( Intel DDIO ) : Frequently Asked Questions '' ( PDF ). Intel. March 2012. Retrieved 2015 - 10 - 11. Jump up ^ Rashid Khan ( 2015 - 09 - 29 ). `` Pushing the Limits of Kernel Networking ''. redhat.com. Retrieved 2015 - 10 - 11. Jump up ^ `` Achieving Lowest Latencies at Highest Message Rates with Intel Xeon Processor E5 - 2600 and Solarflare SFN6122F 10 GbE Server Adapter '' ( PDF ). solarflare.com. 2012 - 06 - 07. Retrieved 2015 - 10 - 11. Jump up ^ Alexander Duyck ( 2015 - 08 - 19 ). `` Pushing the Limits of Kernel Networking '' ( PDF ). linuxfoundation.org. p. 5. Retrieved 2015 - 10 - 11. Jump up ^ Kistler, Michael ( May 2006 ). `` Cell Multiprocessor Communication Network ''. Extensive benchmarks of DMA performance in Cell Broadband Engine. References DMA Fundamentals on Various PC Platforms, from A.F. Harvey and Data Acquisition Division Staff NATIONAL INSTRUMENTS mmap ( ) and DMA, from Linux Device Drivers, 2nd Edition, Alessandro Rubini & Jonathan Corbet Memory Mapping and DMA, from Linux Device Drivers, 3rd Edition, Jonathan Corbet, Alessandro Rubini, Greg Kroah - Hartman DMA and Interrupt Handling DMA Modes & Bus Mastering External links Mastering the DMA and IOMMU APIs, Embedded Linux Conference 2014, San Jose, by Laurent Pinchart Technical and de facto standards for wired computer buses General System bus Front - side bus Back - side bus Daisy chain Control bus Address bus Bus contention Bus mastering Network on a chip Plug and play List of bus bandwidths Standards SS - 50 bus S - 100 bus Multibus Unibus VAXBI MBus STD Bus SMBus Q - Bus Europe Card Bus ISA STEbus Zorro II Zorro III CAMAC FASTBUS LPC HP Precision Bus EISA VME VXI VXS NuBus TURBOchannel MCA SBus VLB PCI PXI HP GSC bus InfiniBand UPA PCI Extended ( PCI - X ) AGP PCI Express ( PCIe ) Direct Media Interface ( DMI ) RapidIO Intel QuickPath Interconnect NVLink HyperTransport Infinity Fabric Intel UltraPath Interconnect Storage ST - 506 ESDI IPI SMD Parallel ATA ( PATA ) SSA DSSI HIPPI Serial ATA ( SATA ) SCSI Parallel SAS Fibre Channel SATAe PCI Express ( via AHCI or NVMe logical device interface ) Peripheral Apple Desktop Bus DCB HP - IL HIL MIDI RS - 232 RS - 422 RS - 423 RS - 485 DMX512 - A IEEE - 488 ( GPIB ) IEEE - 1284 ( parallel port ) UNI / O ACCESS. bus 1 - Wire D2B I2C SPI Parallel SCSI Profibus IEEE 1394 ( FireWire ) USB Camera Link External PCIe Thunderbolt Audio ADAT Lightpipe AES3 Intel HD Audio I2S MADI McASP S / PDIF TOSLINK Portable PC Card ExpressCard Embedded Multidrop bus CoreConnect AMBA Wishbone SLIMbus Interfaces are listed by their speed in the ( roughly ) ascending order, so the interface at the end of each section should be the fastest. Retrieved from `` https://en.wikipedia.org/w/index.php?title=Direct_memory_access&oldid=852142090 '' Categories : Computer memory Motherboard Computer storage buses Hidden categories : All articles with unsourced statements Articles with unsourced statements from June 2016 Talk Contents About Wikipedia Български Bosanski Català Čeština Deutsch Ελληνικά Español فارسی Français Galego 한국어 Hrvatski Italiano עברית Bahasa Melayu Nederlands 日本 語 Norsk Norsk nynorsk Piemontèis Polski Português Русский Shqip Simple English Slovenčina Српски / srpski Suomi Svenska Türkçe Українська Tiếng Việt 中文 24 more Edit links This page was last edited on 26 July 2018, at 22 : 42 ( UTC ). Text is available under the Creative Commons Attribution - ShareAlike License ; additional terms may apply. By using this site, you agree to the Terms of Use and Privacy Policy. Wikipedia ® is a registered trademark of the Wikimedia Foundation, Inc., a non-profit organization. About Wikipedia

Question: for what types of operations is dma useful
Answer: any time that the CPU cannot keep up with the rate of data transfer