Don't remerge everything when removing tiles