Does using `VirtualAlloc` directly in here give any further speedup?  Using the heap is just wasted cycles and space if we never plan to release the memory.