There are a few things that can break stone walls Rust. One is when rain or snow falls on the surface of the wall, which causes the water to seep underneath and damage the wall. Another is when a animal or person steps on the wall, causing it to break.