Freeing up more memory (not that we need to) and utilize the min GPU mem