Revert "deallocated VF/FFAdjacency to avoid UBSAN error" as the error can still be triggered if FF/VFAdjacency is involved

This reverts commit 45733c7206de0a5a466a61e7fd33cc351cc12615.