Trim orphaned pubkeys (addresses).