If we initialize the `Set`here already it can be final and doesn't have to be guarded in the methods below.