Loofahs are abrasive, often used to exfoliate body skin.
Common causes include placing too much pressure on the blade, dull blades, harsh soaps, and alcohol-containing products, to name a few. If you're in the habit of shaving this way, it'll take some time to retrain your beard. But after two or three weeks of shaving with the grain, you'll get a closer shave that will also be easier on your skin. Dunk your clean razor into the sinkful of hot water. Make a short sweep down one side of your face with the grain.