Yes, you can say that you don't remember. This is much better than guessing or making something up, which you should never do.