It’s not so much the type of towel that’s important. As long as it’s soft and doesn’t irritate your skin you’ll be OK.
The most important thing is that it’s clean, it’s only used by you – and you only use it on your face!