detect duplicate records
log ignored records

new code to create demo records