client: Drop direct_backend flag at set_direct_id