It’s common for houses to get moldy on their north side, but mold doesn’t appear from anywhere. Some of the causes of mold and mildew growth on siding include: Damp or wet surfaces; Accumulated dirt; Tree sap; Moisture somewhere or beneath your house’s surface; A lack of sunlight