Please update `tokenizers` version check
Author: lalala-233
Pull request: no
Labels: name: Feature request

### Feature request

Several days before, `tokenizers` released a new version of `0.23.1`, but `transformers` doesn't allow us to use it.

https://github.com/huggingface/transformers/blob/ecc3d0da0f8e9c2c54676345b816db29f842792a/setup.py#L150
https://github.com/huggingface/transformers/blob/ecc3d0da0f8e9c2c54676345b816db29f842792a/src/transformers/dependency_versions_table.py#L77

And if you import `transformers`, you will get an error.

```python
ImportError: tokenizers>=0.22.0,<=0.23.0 is required for a normal functioning of this module, but found tokenizers==0.23.1.
```

`0.23.1` includes some break changes, if you have any plan to remove `<=0.23.0` check?

### Motivation

In Arch Linux, we use the latest version of `tokenizers`, making it impossible to use current version of `transformers`. 

And `0.23.1` have improved performance that will improve `transformers`' performance

### Your contribution

I have made a patch to remove this check, but running `make fix-repo` as it suggested generates a lot of changes. And I missed some of check because of the lack of some python package.

Or, I just need to edit `setup.py` and `src/transformers/dependency_versions_table.py`?

Btw, I have not tested if `0.23.1` breaks something down yet.

Comments:
We'll probably bump that version with the next version of `transformers`! cc @itazap

`0.23.1` includes some breaking changes, e.g., `cls` was renamed to `cls_token` in `BertProcessing` and `RobertaProcessing`.

These following line have been affected

https://github.com/huggingface/transformers/blob/eed95d8c445b8679ba342cffa947a3ed2b8d7fbc/src/transformers/models/herbert/tokenization_herbert.py#L107

https://github.com/huggingface/transformers/blob/eed95d8c445b8679ba342cffa947a3ed2b8d7fbc/src/transformers/models/roberta/tokenization_roberta.py#L172

https://github.com/huggingface/transformers/blob/eed95d8c445b8679ba342cffa947a3ed2b8d7fbc/src/transformers/models/layoutlmv3/tokenization_layoutlmv3.py#L230

https://github.com/huggingface/transformers/blob/eed95d8c445b8679ba342cffa947a3ed2b8d7fbc/src/transformers/models/clip/tokenization_clip.py#L119

https://github.com/huggingface/transformers/blob/eed95d8c445b8679ba342cffa947a3ed2b8d7fbc/src/transformers/convert_slow_tokenizer.py#L485

https://github.com/huggingface/transformers/blob/eed95d8c445b8679ba342cffa947a3ed2b8d7fbc/src/transformers/convert_slow_tokenizer.py#L556

https://github.com/huggingface/transformers/blob/eed95d8c445b8679ba342cffa947a3ed2b8d7fbc/src/transformers/convert_slow_tokenizer.py#L1458

Hello! Is there any news on this?
It's blocking our `hf-xet`/ `huggingface-hub`/`transformers` bump in nixpkgs (https://github.com/NixOS/nixpkgs/pull/517274).

cc @ArthurZucker for the `tokenizers` changes

Sorry @GaetanLepage on it! 

can we get a bump on this?  transformers 5.12.0 is out and still uses tokenizers 0.22.2.  for me personally i'm hoping the latest tokenizers includes this change:

https://github.com/huggingface/transformers/issues/44451

but the current combination of transformers/tokenizers leaves ScandiBert broken, meaning any DA or SV users of Stanza don't get the best models they could get.  (a very niche issue, i'm aware, but it would be nice to have it fixed.)

Sorry about that, did not want to rush but PR is ready will merge this week for next release! 

Just FYI, coqui-tts is also waiting on this fix to be merged. :)