Compute ambient occlusion for each brick with a simple visibility test straight up, and a blur.
Derive per-vertex ambient occlusion from the adjacent bricks, and pass it through vertex color to the materials