Clean up visitors and visitor state