changed textProcessor to keep a record of dropped docs.