No, the way it is currently designed is that the last user calls Destroy. Calling Detach when your are the last user is a bug.