We can assert map->lhs isn't NULL even when not building with VERIFY_MAP