Add displayPoints as an attribute
Only iterate over vectors that must be added/removed