Revert "Decoupling the memory with Gfx selection by Juansheng"

This reverts commit 9d4dd8fc42afa59e0a4d1755d8d2a1a5ca0d857a.