fixed issue with early filtering of bad data