Improve the pointer abstraction; the dependency to the record and set is
only needed at construction time.