compile error when installing transformers[flax]
Author: bth5032
Pull request: no

## Environment info
Running on windows 10.

- `transformers` version: 
- Platform: Windows 10
- Python version: 3.9.1
- PyTorch version (GPU?): 1.9.1+cu102

### Who can help
@patil-suraj

## Information

I am trying to use `FlaxVisionEncoderDecoderModel` and ran into the same issue as [this dev.](https://github.com/huggingface/transformers/issues/14831) However attempting to run

` pip install transformers[flax]` 

results in an error:

```bash
PS G:\Projects\> pip install transformers[flax] 
Requirement already satisfied: transformers[flax] in c:\python39\lib\site-packages (4.15.0)
Requirement already satisfied: sacremoses in c:\python39\lib\site-packages (from transformers[flax]) (0.0.46)
Requirement already satisfied: packaging>=20.0 in c:\python39\lib\site-packages (from transformers[flax]) (20.9)
Requirement already satisfied: filelock in c:\python39\lib\site-packages (from transformers[flax]) (3.0.12)
Requirement already satisfied: pyyaml>=5.1 in c:\users\bobak\appdata\roaming\python\python39\site-packages (from transformers[flax]) (5.4.1) 
Requirement already satisfied: regex!=2019.12.17 in c:\python39\lib\site-packages (from transformers[flax]) (2021.9.24)
Requirement already satisfied: tokenizers<0.11,>=0.10.1 in c:\python39\lib\site-packages (from transformers[flax]) (0.10.3)
Requirement already satisfied: huggingface-hub<1.0,>=0.1.0 in c:\python39\lib\site-packages (from transformers[flax]) (0.2.1)
Requirement already satisfied: requests in c:\python39\lib\site-packages (from transformers[flax]) (2.25.1)
Requirement already satisfied: numpy>=1.17 in c:\users\bobak\appdata\roaming\python\python39\site-packages (from transformers[flax]) (1.19.5)
Requirement already satisfied: tqdm>=4.27 in c:\python39\lib\site-packages (from transformers[flax]) (4.62.1)
Requirement already satisfied: jax>=0.2.8 in c:\python39\lib\site-packages (from transformers[flax]) (0.2.26)
Collecting optax>=0.0.8
  Using cached optax-0.1.0-py3-none-any.whl (126 kB)
Collecting flax>=0.3.5
  Using cached flax-0.3.6-py3-none-any.whl (207 kB)
Collecting transformers[flax]
  Using cached transformers-4.14.1-py3-none-any.whl (3.4 MB)
  ...
  Using cached transformers-4.9.2-py3-none-any.whl (2.6 MB)
Collecting huggingface-hub==0.0.12
  Using cached huggingface_hub-0.0.12-py3-none-any.whl (37 kB)
Collecting transformers[flax]
  Using cached transformers-4.9.1-py3-none-any.whl (2.6 MB)
 ...
  Using cached transformers-4.7.0-py3-none-any.whl (2.5 MB)
Collecting huggingface-hub==0.0.8
  Using cached huggingface_hub-0.0.8-py3-none-any.whl (34 kB)
Collecting transformers[flax]
  Using cached transformers-4.6.1-py3-none-any.whl (2.2 MB)
 ...
  Using cached transformers-4.2.2-py3-none-any.whl (1.8 MB)
Collecting tokenizers==0.9.4
  Using cached tokenizers-0.9.4-cp39-cp39-win_amd64.whl (1.9 MB)
Collecting transformers[flax]
  Using cached transformers-4.2.1-py3-none-any.whl (1.8 MB)
 ...
  Using cached transformers-3.5.1-py3-none-any.whl (1.3 MB)
Collecting sentencepiece==0.1.91
  Using cached sentencepiece-0.1.91.tar.gz (500 kB)
  Preparing metadata (setup.py) ... done
Collecting tokenizers==0.9.3
  Using cached tokenizers-0.9.3.tar.gz (172 kB)
  Installing build dependencies ... done
  Getting requirements to build wheel ... done
  Preparing metadata (pyproject.toml) ... done
Requirement already satisfied: protobuf in c:\python39\lib\site-packages (from transformers[flax]) (3.18.0)
Collecting transformers[flax]
  Using cached transformers-3.5.0-py3-none-any.whl (1.3 MB)
  Using cached transformers-3.4.0-py3-none-any.whl (1.3 MB)
Collecting sentencepiece!=0.1.92
  Using cached sentencepiece-0.1.96-cp39-cp39-win_amd64.whl (1.1 MB)
Collecting tokenizers==0.9.2
  Using cached tokenizers-0.9.2.tar.gz (170 kB)
  Installing build dependencies ... done
  Getting requirements to build wheel ... done
  Preparing metadata (pyproject.toml) ... done
Collecting transformers[flax]
  Using cached transformers-3.3.1-py3-none-any.whl (1.1 MB)
WARNING: transformers 3.3.1 does not provide the extra 'flax'
Collecting tokenizers==0.8.1.rc2
  Using cached tokenizers-0.8.1rc2.tar.gz (97 kB)
  Installing build dependencies ... done
  Getting requirements to build wheel ... done
  Preparing metadata (pyproject.toml) ... done
Requirement already satisfied: colorama in c:\python39\lib\site-packages (from tqdm>=4.27->transformers[flax]) (0.4.4)
Requirement already satisfied: pyparsing>=2.0.2 in c:\python39\lib\site-packages (from packaging>=20.0->transformers[flax]) (2.4.7)
Requirement already satisfied: idna<3,>=2.5 in c:\python39\lib\site-packages (from requests->transformers[flax]) (2.10)
Requirement already satisfied: chardet<5,>=3.0.2 in c:\python39\lib\site-packages (from requests->transformers[flax]) (4.0.0)
Requirement already satisfied: urllib3<1.27,>=1.21.1 in c:\python39\lib\site-packages (from requests->transformers[flax]) (1.26.3)
Requirement already satisfied: certifi>=2017.4.17 in c:\python39\lib\site-packages (from requests->transformers[flax]) (2020.12.5)
Requirement already satisfied: joblib in c:\python39\lib\site-packages (from sacremoses->transformers[flax]) (1.0.1)
Requirement already satisfied: six in c:\python39\lib\site-packages (from sacremoses->transformers[flax]) (1.15.0)
Requirement already satisfied: click in c:\python39\lib\site-packages (from sacremoses->transformers[flax]) (7.1.2)
Building wheels for collected packages: tokenizers
  Building wheel for tokenizers (pyproject.toml) ... error
  ERROR: Command errored out with exit status 1:
   command: 'c:\python39\python.exe' 'c:\python39\lib\site-packages\pip\_vendor\pep517\in_process\_in_process.py' build_wheel 'C:\Users\Bobak\AppData\Local\Temp\tmpmeoat5a5'
       cwd: C:\Users\Bobak\AppData\Local\Temp\pip-install-h_ao1nbk\tokenizers_631ba1cc987c45708c975abb68e99947
  Complete output (251 lines):
  C:\Users\Bobak\AppData\Local\Temp\pip-build-env-ojm6weqz\overlay\Lib\site-packages\setuptools\dist.py:493: UserWarning: Normalizing '0.8.1.rc2' to '0.8.1rc2'
    warnings.warn(tmpl.format(**locals()))
  running bdist_wheel
  running build
  running build_py
  creating build
  creating build\lib.win-amd64-3.9
 ...
  copying tokenizers\pre_tokenizers\__init__.pyi -> build\lib.win-amd64-3.9\tokenizers\pre_tokenizers
  copying tokenizers\processors\__init__.pyi -> build\lib.win-amd64-3.9\tokenizers\processors
  copying tokenizers\trainers\__init__.pyi -> build\lib.win-amd64-3.9\tokenizers\trainers
  running build_ext
      Updating crates.io index
      Updating git repository `https://github.com/n1t0/rayon-cond`
  cargo rustc --lib --manifest-path Cargo.toml --target x86_64-pc-windows-msvc --release -v --features pyo3/extension-module -- --crate-type cdylib
  warning: unused manifest key: target.x86_64-apple-darwin.rustflags
     Compiling proc-macro2 v1.0.36
     Compiling unicode-xid v0.2.2
     Compiling syn v1.0.85
     Compiling autocfg v1.0.1
     Compiling memchr v2.4.1
     Compiling serde v1.0.133
     Compiling cfg-if v1.0.0
     Compiling serde_derive v1.0.133
       Running `rustc --crate-name build_script_build --edition=2018 C:\Users\Bobak\.cargo\registry\src\github.com-1ecc6299db9ec823\proc-macro2-1.0.36\build.rs --error-format=json --json=diagnostic-rendered-ansi --crate-type bin --emit=dep-info,link -C opt-level=3 -Cembed-bitcode=no --cfg "feature=\"default\"" --cfg "feature=\"proc-macro\"" -C metadata=57eed64b2791e1b0 -C extra-filename=-57eed64b2791e1b0 --out-dir C:\Users\Bobak\AppData\Local\Temp\pip-install-h_ao1nbk\tokenizers_631ba1cc987c45708c975abb68e99947\target\release\build\proc-macro2-57eed64b2791e1b0 -L dependency=C:\Users\Bobak\AppData\Local\Temp\pip-install-h_ao1nbk\tokenizers_631ba1cc987c45708c975abb68e99947\target\release\deps --cap-lints allow`
       Running `rustc --crate-name unicode_xid C:\Users\Bobak\.cargo\registry\src\github.com-1ecc6299db9ec823\unicode-xid-0.2.2\src\lib.rs --error-format=json --json=diagnostic-rendered-ansi,artifacts 
--crate-type lib --emit=dep-info,metadata,link -C opt-level=3 -Cembed-bitcode=no --cfg "feature=\"default\"" -C metadata=6f559fb7bfe8c6bc -C extra-filename=-6f559fb7bfe8c6bc --out-dir C:\Users\Bobak\AppData\Local\Temp\pip-install-h_ao1nbk\tokenizers_631ba1cc987c45708c975abb68e99947\target\release\deps -L dependency=C:\Users\Bobak\AppData\Local\Temp\pip-install-h_ao1nbk\tokenizers_631ba1cc987c45708c975abb68e99947\target\release\deps --cap-lints allow`
       Running `rustc --crate-name build_script_build --edition=2018 C:\Users\Bobak\.cargo\registry\src\github.com-1ecc6299db9ec823\syn-1.0.85\build.rs --error-format=json --json=diagnostic-rendered-ansi --crate-type bin --emit=dep-info,link -C opt-level=3 -Cembed-bitcode=no --cfg "feature=\"clone-impls\"" --cfg "feature=\"default\"" --cfg "feature=\"derive\"" --cfg "feature=\"extra-traits\"" --cfg 
"feature=\"full\"" --cfg "feature=\"parsing\"" --cfg "feature=\"printing\"" --cfg "feature=\"proc-macro\"" --cfg "feature=\"quote\"" -C metadata=1244fbe766a9b584 -C extra-filename=-1244fbe766a9b584 --out-dir C:\Users\Bobak\AppData\Local\Temp\pip-install-h_ao1nbk\tokenizers_631ba1cc987c45708c975abb68e99947\target\release\build\syn-1244fbe766a9b584 -L dependency=C:\Users\Bobak\AppData\Local\Temp\pip-install-h_ao1nbk\tokenizers_631ba1cc987c45708c975abb68e99947\target\release\deps --cap-lints allow`
  ...
     Compiling console v0.15.0
       Running `rustc --crate-name console --edition=2018 C:\Users\Bobak\.cargo\registry\src\github.com-1ecc6299db9ec823\console-0.15.0\src\lib.rs --error-format=json --json=diagnostic-rendered-ansi,artifacts --crate-type lib --emit=dep-info,metadata,link -C opt-level=3 -Cembed-bitcode=no --cfg "feature=\"ansi-parsing\"" --cfg "feature=\"default\"" --cfg "feature=\"regex\"" --cfg "feature=\"unicode-width\"" -C metadata=7f04b326976a8469 -C extra-filename=-7f04b326976a8469 --out-dir C:\Users\Bobak\AppData\Local\Temp\pip-install-h_ao1nbk\tokenizers_631ba1cc987c45708c975abb68e99947\target\x86_64-pc-windows-msvc\release\deps --target x86_64-pc-windows-msvc -L dependency=C:\Users\Bobak\AppData\Local\Temp\pip-install-h_ao1nbk\tokenizers_631ba1cc987c45708c975abb68e99947\target\x86_64-pc-windows-msvc\release\deps -L dependency=C:\Users\Bobak\AppData\Local\Temp\pip-install-h_ao1nbk\tokenizers_631ba1cc987c45708c975abb68e99947\target\release\deps --extern encode_unicode=C:\Users\Bobak\AppData\Local\Temp\pip-install-h_ao1nbk\tokenizers_631ba1cc987c45708c975abb68e99947\target\x86_64-pc-windows-msvc\release\deps\libencode_unicode-f5082f2d76afde34.rmeta --extern libc=C:\Users\Bobak\AppData\Local\Temp\pip-install-h_ao1nbk\tokenizers_631ba1cc987c45708c975abb68e99947\target\x86_64-pc-windows-msvc\release\deps\liblibc-3099232219a69ddb.rmeta --extern once_cell=C:\Users\Bobak\AppData\Local\Temp\pip-install-h_ao1nbk\tokenizers_631ba1cc987c45708c975abb68e99947\target\x86_64-pc-windows-msvc\release\deps\libonce_cell-e26956b93b1a289e.rmeta --extern regex=C:\Users\Bobak\AppData\Local\Temp\pip-install-h_ao1nbk\tokenizers_631ba1cc987c45708c975abb68e99947\target\x86_64-pc-windows-msvc\release\deps\libregex-209ee3cef779bb9d.rmeta --extern terminal_size=C:\Users\Bobak\AppData\Local\Temp\pip-install-h_ao1nbk\tokenizers_631ba1cc987c45708c975abb68e99947\target\x86_64-pc-windows-msvc\release\deps\libterminal_size-caf7104c0642fe58.rmeta --extern unicode_width=C:\Users\Bobak\AppData\Local\Temp\pip-install-h_ao1nbk\tokenizers_631ba1cc987c45708c975abb68e99947\target\x86_64-pc-windows-msvc\release\deps\libunicode_width-ce66de2e14cc3ba9.rmeta --extern winapi=C:\Users\Bobak\AppData\Local\Temp\pip-install-h_ao1nbk\tokenizers_631ba1cc987c45708c975abb68e99947\target\x86_64-pc-windows-msvc\release\deps\libwinapi-3c77d9c468bf0363.rmeta --cap-lints allow`
     Compiling clap v2.34.0
       Running `rustc --crate-name clap --edition=2018 C:\Users\Bobak\.cargo\registry\src\github.com-1ecc6299db9ec823\clap-2.34.0\src\lib.rs --error-format=json --json=diagnostic-rendered-ansi,artifacts --crate-type lib --emit=dep-info,metadata,link -C opt-level=3 -Cembed-bitcode=no --cfg "feature=\"ansi_term\"" --cfg "feature=\"atty\"" --cfg "feature=\"color\"" --cfg "feature=\"default\"" --cfg "feature=\"strsim\"" --cfg "feature=\"suggestions\"" --cfg "feature=\"vec_map\"" -C metadata=7b7912e462d4241a -C extra-filename=-7b7912e462d4241a --out-dir C:\Users\Bobak\AppData\Local\Temp\pip-install-h_ao1nbk\tokenizers_631ba1cc987c45708c975abb68e99947\target\x86_64-pc-windows-msvc\release\deps --target x86_64-pc-windows-msvc -L dependency=C:\Users\Bobak\AppData\Local\Temp\pip-install-h_ao1nbk\tokenizers_631ba1cc987c45708c975abb68e99947\target\x86_64-pc-windows-msvc\release\deps -L dependency=C:\Users\Bobak\AppData\Local\Temp\pip-install-h_ao1nbk\tokenizers_631ba1cc987c45708c975abb68e99947\target\release\deps --extern atty=C:\Users\Bobak\AppData\Local\Temp\pip-install-h_ao1nbk\tokenizers_631ba1cc987c45708c975abb68e99947\target\x86_64-pc-windows-msvc\release\deps\libatty-0152d3558cda1980.rmeta --extern bitflags=C:\Users\Bobak\AppData\Local\Temp\pip-install-h_ao1nbk\tokenizers_631ba1cc987c45708c975abb68e99947\target\x86_64-pc-windows-msvc\release\deps\libbitflags-1d434c93db9ceb5c.rmeta --extern strsim=C:\Users\Bobak\AppData\Local\Temp\pip-install-h_ao1nbk\tokenizers_631ba1cc987c45708c975abb68e99947\target\x86_64-pc-windows-msvc\release\deps\libstrsim-563e93c49ab77cd6.rmeta --extern textwrap=C:\Users\Bobak\AppData\Local\Temp\pip-install-h_ao1nbk\tokenizers_631ba1cc987c45708c975abb68e99947\target\x86_64-pc-windows-msvc\release\deps\libtextwrap-d44db99661ee5bc3.rmeta --extern unicode_width=C:\Users\Bobak\AppData\Local\Temp\pip-install-h_ao1nbk\tokenizers_631ba1cc987c45708c975abb68e99947\target\x86_64-pc-windows-msvc\release\deps\libunicode_width-ce66de2e14cc3ba9.rmeta --extern vec_map=C:\Users\Bobak\AppData\Local\Temp\pip-install-h_ao1nbk\tokenizers_631ba1cc987c45708c975abb68e99947\target\x86_64-pc-windows-msvc\release\deps\libvec_map-f82cb06a00d96a3c.rmeta --cap-lints allow`
     Compiling parking_lot v0.10.2
       Running `rustc --crate-name parking_lot --edition=2018 C:\Users\Bobak\.cargo\registry\src\github.com-1ecc6299db9ec823\parking_lot-0.10.2\src\lib.rs --error-format=json --json=diagnostic-rendered-ansi,artifacts --crate-type lib --emit=dep-info,metadata,link -C opt-level=3 -Cembed-bitcode=no --cfg "feature=\"default\"" --cfg "feature=\"nightly\"" -C metadata=f2e6ca23d2714e74 -C extra-filename=-f2e6ca23d2714e74 --out-dir C:\Users\Bobak\AppData\Local\Temp\pip-install-h_ao1nbk\tokenizers_631ba1cc987c45708c975abb68e99947\target\x86_64-pc-windows-msvc\release\deps --target x86_64-pc-windows-msvc 
-L dependency=C:\Users\Bobak\AppData\Local\Temp\pip-install-h_ao1nbk\tokenizers_631ba1cc987c45708c975abb68e99947\target\x86_64-pc-windows-msvc\release\deps -L dependency=C:\Users\Bobak\AppData\Local\Temp\pip-install-h_ao1nbk\tokenizers_631ba1cc987c45708c975abb68e99947\target\release\deps --extern lock_api=C:\Users\Bobak\AppData\Local\Temp\pip-install-h_ao1nbk\tokenizers_631ba1cc987c45708c975abb68e99947\target\x86_64-pc-windows-msvc\release\deps\liblock_api-feeea9924ab45186.rmeta --extern parking_lot_core=C:\Users\Bobak\AppData\Local\Temp\pip-install-h_ao1nbk\tokenizers_631ba1cc987c45708c975abb68e99947\target\x86_64-pc-windows-msvc\release\deps\libparking_lot_core-85a7641040e9f7f3.rmeta --cap-lints allow`
  error[E0658]: `if` is not allowed in a `const fn`
    --> C:\Users\Bobak\.cargo\registry\src\github.com-1ecc6299db9ec823\clap-2.34.0\src\app\settings.rs:7:1
     |
  7  | / bitflags! {
  8  | |     struct Flags: u64 {
  9  | |         const SC_NEGATE_REQS       = 1;
  10 | |         const SC_REQUIRED          = 1 << 1;
  ...  |
  51 | |     }
  52 | | }
     | |_^
     |
     = note: see issue #49146 <https://github.com/rust-lang/rust/issues/49146> for more information
     = help: add `#![feature(const_if_match)]` to the crate attributes to enable
     = note: this error originates in a macro (in Nightly builds, run with -Z macro-backtrace for more info)

  error[E0658]: `if` is not allowed in a `const fn`
    --> C:\Users\Bobak\.cargo\registry\src\github.com-1ecc6299db9ec823\clap-2.34.0\src\args\settings.rs:6:1
     |
  6  | / bitflags! {
  7  | |     struct Flags: u32 {
  8  | |         const REQUIRED         = 1;
  ...  |
  28 | |     }
  29 | | }
     | |_^
     |
     = note: see issue #49146 <https://github.com/rust-lang/rust/issues/49146> for more information
     = help: add `#![feature(const_if_match)]` to the crate attributes to enable
     = note: this error originates in a macro (in Nightly builds, run with -Z macro-backtrace for more info)
       Running `rustc --crate-name rayon_core --edition=2018 C:\Users\Bobak\.cargo\registry\src\github.com-1ecc6299db9ec823\rayon-core-1.9.1\src\lib.rs --error-format=json --json=diagnostic-rendered-ansi,artifacts --crate-type lib --emit=dep-info,metadata,link -C opt-level=3 -Cembed-bitcode=no -C metadata=7c4c87a2d6db8bd0 -C extra-filename=-7c4c87a2d6db8bd0 --out-dir C:\Users\Bobak\AppData\Local\Temp\pip-install-h_ao1nbk\tokenizers_631ba1cc987c45708c975abb68e99947\target\x86_64-pc-windows-msvc\release\deps --target x86_64-pc-windows-msvc -L dependency=C:\Users\Bobak\AppData\Local\Temp\pip-install-h_ao1nbk\tokenizers_631ba1cc987c45708c975abb68e99947\target\x86_64-pc-windows-msvc\release\deps -L dependency=C:\Users\Bobak\AppData\Local\Temp\pip-install-h_ao1nbk\tokenizers_631ba1cc987c45708c975abb68e99947\target\release\deps --extern crossbeam_channel=C:\Users\Bobak\AppData\Local\Temp\pip-install-h_ao1nbk\tokenizers_631ba1cc987c45708c975abb68e99947\target\x86_64-pc-windows-msvc\release\deps\libcrossbeam_channel-a47a697c8edb26dd.rmeta --extern crossbeam_deque=C:\Users\Bobak\AppData\Local\Temp\pip-install-h_ao1nbk\tokenizers_631ba1cc987c45708c975abb68e99947\target\x86_64-pc-windows-msvc\release\deps\libcrossbeam_deque-f5042eb50925de89.rmeta --extern crossbeam_utils=C:\Users\Bobak\AppData\Local\Temp\pip-install-h_ao1nbk\tokenizers_631ba1cc987c45708c975abb68e99947\target\x86_64-pc-windows-msvc\release\deps\libcrossbeam_utils-01e26c75846d7d46.rmeta --extern lazy_static=C:\Users\Bobak\AppData\Local\Temp\pip-install-h_ao1nbk\tokenizers_631ba1cc987c45708c975abb68e99947\target\x86_64-pc-windows-msvc\release\deps\liblazy_static-38c6c694dbdce5e7.rmeta --extern num_cpus=C:\Users\Bobak\AppData\Local\Temp\pip-install-h_ao1nbk\tokenizers_631ba1cc987c45708c975abb68e99947\target\x86_64-pc-windows-msvc\release\deps\libnum_cpus-3087e410382f51cc.rmeta --cap-lints allow`
  error: aborting due to 2 previous errors

  For more information about this error, try `rustc --explain E0658`.
  error: could not compile `clap`.

  Caused by:
    process didn't exit successfully: `rustc --crate-name clap --edition=2018 C:\Users\Bobak\.cargo\registry\src\github.com-1ecc6299db9ec823\clap-2.34.0\src\lib.rs --error-format=json --json=diagnostic-rendered-ansi,artifacts --crate-type lib --emit=dep-info,metadata,link -C opt-level=3 -Cembed-bitcode=no --cfg "feature=\"ansi_term\"" --cfg "feature=\"atty\"" --cfg "feature=\"color\"" --cfg "feature=\"default\"" --cfg "feature=\"strsim\"" --cfg "feature=\"suggestions\"" --cfg "feature=\"vec_map\"" -C metadata=7b7912e462d4241a -C extra-filename=-7b7912e462d4241a --out-dir C:\Users\Bobak\AppData\Local\Temp\pip-install-h_ao1nbk\tokenizers_631ba1cc987c45708c975abb68e99947\target\x86_64-pc-windows-msvc\release\deps --target x86_64-pc-windows-msvc -L dependency=C:\Users\Bobak\AppData\Local\Temp\pip-install-h_ao1nbk\tokenizers_631ba1cc987c45708c975abb68e99947\target\x86_64-pc-windows-msvc\release\deps -L dependency=C:\Users\Bobak\AppData\Local\Temp\pip-install-h_ao1nbk\tokenizers_631ba1cc987c45708c975abb68e99947\target\release\deps --extern atty=C:\Users\Bobak\AppData\Local\Temp\pip-install-h_ao1nbk\tokenizers_631ba1cc987c45708c975abb68e99947\target\x86_64-pc-windows-msvc\release\deps\libatty-0152d3558cda1980.rmeta --extern bitflags=C:\Users\Bobak\AppData\Local\Temp\pip-install-h_ao1nbk\tokenizers_631ba1cc987c45708c975abb68e99947\target\x86_64-pc-windows-msvc\release\deps\libbitflags-1d434c93db9ceb5c.rmeta --extern strsim=C:\Users\Bobak\AppData\Local\Temp\pip-install-h_ao1nbk\tokenizers_631ba1cc987c45708c975abb68e99947\target\x86_64-pc-windows-msvc\release\deps\libstrsim-563e93c49ab77cd6.rmeta --extern textwrap=C:\Users\Bobak\AppData\Local\Temp\pip-install-h_ao1nbk\tokenizers_631ba1cc987c45708c975abb68e99947\target\x86_64-pc-windows-msvc\release\deps\libtextwrap-d44db99661ee5bc3.rmeta 
--extern unicode_width=C:\Users\Bobak\AppData\Local\Temp\pip-install-h_ao1nbk\tokenizers_631ba1cc987c45708c975abb68e99947\target\x86_64-pc-windows-msvc\release\deps\libunicode_width-ce66de2e14cc3ba9.rmeta --extern vec_map=C:\Users\Bobak\AppData\Local\Temp\pip-install-h_ao1nbk\tokenizers_631ba1cc987c45708c975abb68e99947\target\x86_64-pc-windows-msvc\release\deps\libvec_map-f82cb06a00d96a3c.rmeta --cap-lints allow` (exit code: 1)
  warning: build failed, waiting for other jobs to finish...
  error: build failed
  error: cargo failed with code: 101

  ----------------------------------------
  ERROR: Failed building wheel for tokenizers
Failed to build tokenizers
ERROR: Could not build wheels for tokenizers, which is required to install pyproject.toml-based projects
PS G:\Projects\> tokenizers==0.9.2tokenizers==0.9.2
tokenizers==0.9.2tokenizers==0.9.2 : The term 'tokenizers==0.9.2tokenizers==0.9.2' is not recognized as the name of a cmdlet, function, script file, or operable prsaogram. Check the spelddling of the      
name, or if a path was included, verify that the path is correct and try again.
At line:1 char:1
+ tokenizers==0.9.2tokenizers==0.9.2
+ ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
    + CategoryInfo          : ObjectNotFound: (tokenizers==0.9.2tokenizers==0.9.2:String) [], CommandNotFoundException
    + FullyQualifiedErrorId : CommandNotFoundException
```
There seems to be some deep error in the tokenizers install during Compiling parking_lot v0.10.2 which seems to be part of tokenizers==0.9.2 or 0.8.1.rc2

I have new versions of flax, transformers (without flax), and tokenizers installed, so I'm not sure what's going on with this particular script.


Comments:
This seems to be related to `tokenizers`. Were you able to install the same version of `tokenizers` independently?

Thanks for the response, I have `tokenizers` latest, but get the same error if I force the version.

I see. Could you then open an issue on the `tokenizers` repo, since it's not related to `transformers`? Thank you!

[moved](https://github.com/huggingface/tokenizers/issues/874)

Also, note that the `tokenizers` version is now updated in the master which will be included in the next release.
cf https://github.com/huggingface/transformers/blob/master/setup.py#L152