Cleaned up CudaMemoryManager more