Revert "Only close if we are actually placing a block"

This reverts commit ea0b1b2d67d49f26d7ec5b7208e1f367f61cb54f.