smarter tokenizer to merge common record types