Revert "GFX-3D: Hold the BufferReference of GraphicBuffer in BpGraphicBufferAlloc"

This reverts commit c1a372ff73a66b9d65ffb929cab6fb73ea9f7580.