insert moved into record processor, now passing user config object in to retreive database connections.
fix a bug with duplicate checks, this is a bit of a hack, left a TODO
remove DS_Store