begin to filter validation set