gpu: ion: Also shrink memory cached in the deferred free list