move novoid/dedupe logic to main AR data feed.  cant read it twice!