Yes, it could be.
We know that bacteria is an underlying cause of acne and breakouts - and damp, dirty towels are a breeding ground for bacteria!
So if you rub your face with a dirty towel, the bacteria can transfer and collect in your pores.
And when bacteria breed in a clogged pore and the oil is unable to escape, a whitehead pimple appears.