data updating correctly
add col to mark which files already have entries