fine tune data processing with check and filter