Revert "GFX-3D: Hold the BufferReference of GraphicBuffer in BpGraphicBufferAlloc"

This reverts commit 7ecd47df98aac6f0958e693238c35def35316ccc.