tentatively rm previously indexed files if previous job got stuck somewhere