No, the drywall dust will not harm the vacuum cleaner. If you have allergies, it is best to clean the vacuum filter after cleaning the drywall dust.