Question: can a dryer vent touch drywall?
Answer: Heat in the ducting from the dryer won't be a threat to the drywall behind it. The hottest a properly-functioning dryer will get is around 135F, which isn't hot enough to boil water. If it's not hot enough to boil water, it's definitely not hot enough to ignite anything in contact with the ducting.