additional options and checks in insert functions
batch_insert moves processed files