Ignoring silent samples for the prediction