Only filter out Japanese tilde when contains vocab ids exist.