The scammer might record your “Yes” response to voice-authorize charges to an account. Or they might use it as proof of your opt-in for the call in the first place. Or the con might go even further by engaging you to get a voice sample so they can clone your voice.