remove reference to ids