Update processing data with option to filter out too short tokens