Call maybe-release-buffers after most rpc calls