Revert "GFX-3D: Hold the BufferReference of GraphicBuffer in BpGraphicBufferAlloc"

This reverts commit da2a5632a2e72f2f538ea8dad5bb51efc07b5bd9.