If you want to enlarge your repertoire, however, you might try saying, I don't believe I know you, and continue on.
Saying I don't know you can expand your repertoire.