Revert "GFX-3D: Hold the BufferReference of GraphicBuffer in BpGraphicBufferAlloc"

This reverts commit cea4067199748b42b243526c2f4e3995db578cff.

Change-Id: I730281c6bbbdee39badc3451a2213a40ee08576a