On brick walls, try using plain water from a spray nozzle first. If needed, go back over the area with a stiff-bristled scrub brush.