Don't calculate size in add-inner-walls

I know we hate passing size around, but we need it here and it doesn't
make sense to re-calculate when it's already available. This shaves
about 12 milliseconds off the generation and solve time.