Some STDs can cause bumps that look like ingrown hairs. If you have any concerns, you should see a doctor for testing.