If you don't use a face scrub, debris, dust, pollution, and extra oils may accumulate on the surface of your skin. Your pores may eventually become clogged as a result, which can lead to skin problems including acne and a bumpy appearance.