You could have ingrown hairs or your follicles could be clogged with dead skin cells. Either way, a combination of exfoliation and antibacterial cleansers should help.