Issue 1:
🚀 Feature request

Ensure reproducibility when loading pretrained models.

Motivation

In order to distribute results in a transparent manner, it is important to ensure reproducibility.

When loading a pretrained model, I cannot get the same weights, probably due to non-initialized weights.

Even when using set_seed, I cannot get twice the same models.

Your contribution

I created a small example to illustrate the issue.

Issue 2:
System Info

$ transformers-cli env
2022-05-05 11:22:48.908890: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcudart.so.10.1
WARNING:tensorflow:From /home/arnold/bin/anaconda/envs/nlp/lib/python3.8/site-packages/transformers/commands/env.py:50: is_gpu_available (from tensorflow.python.framework.test_util) is deprecated and will be removed in a future version.
Instructions for updating:
Use `tf.config.list_physical_devices('GPU')` instead.
2022-05-05 11:22:50.917777: I tensorflow/core/platform/cpu_feature_guard.cc:142] This TensorFlow binary is optimized with oneAPI Deep Neural Network Library (oneDNN) to use the following CPU instructions in performance-critical operations: SSE4.1 SSE4.2 AVX AVX2 FMA
To enable them in other operations, rebuild TensorFlow with the appropriate compiler flags.
2022-05-05 11:22:50.920262: I tensorflow/compiler/jit/xla_gpu_device.cc:99] Not creating XLA devices, tf_xla_enable_xla_devices not set
2022-05-05 11:22:50.920313: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcuda.so.1
2022-05-05 11:22:50.921473: I tensorflow/stream_executor/cuda/cuda_gpu_executor.cc:941] successful NUMA node read from SysFS had negative value (-1), but there must be at least one NUMA node, so returning NUMA node zero
2022-05-05 11:22:50.921634: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1720] Found device 0 with properties:
pciBusID: 0000:08:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5
coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s
2022-05-05 11:22:50.921654: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcudart.so.10.1
2022-05-05 11:22:50.966290: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcublas.so.10
2022-05-05 11:22:50.966413: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcublasLt.so.10
2022-05-05 11:22:51.048655: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcufft.so.10
2022-05-05 11:22:51.054988: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcurand.so.10
2022-05-05 11:22:51.100060: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcusolver.so.10
2022-05-05 11:22:51.106893: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcusparse.so.10
2022-05-05 11:22:51.187096: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcudnn.so.7
2022-05-05 11:22:51.187319: I tensorflow/stream_executor/cuda/cuda_gpu_executor.cc:941] successful NUMA node read from SysFS had negative value (-1), but there must be at least one NUMA node, so returning NUMA node zero
2022-05-05 11:22:51.187572: I tensorflow/stream_executor/cuda/cuda_gpu_executor.cc:941] successful NUMA node read from SysFS had negative value (-1), but there must be at least one NUMA node, so returning NUMA node zero
2022-05-05 11:22:51.187671: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1862] Adding visible gpu devices: 0
2022-05-05 11:22:51.188275: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcudart.so.10.1
2022-05-05 11:22:52.310987: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1261] Device interconnect StreamExecutor with strength 1 edge matrix:
2022-05-05 11:22:52.311023: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1267] 0
2022-05-05 11:22:52.311030: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1280] 0: N
2022-05-05 11:22:52.311832: I tensorflow/stream_executor/cuda/cuda_gpu_executor.cc:941] successful NUMA node read from SysFS had negative value (-1), but there must be at least one NUMA node, so returning NUMA node zero
2022-05-05 11:22:52.312058: I tensorflow/stream_executor/cuda/cuda_gpu_executor.cc:941] successful NUMA node read from SysFS had negative value (-1), but there must be at least one NUMA node, so returning NUMA node zero
2022-05-05 11:22:52.312219: I tensorflow/stream_executor/cuda/cuda_gpu_executor.cc:941] successful NUMA node read from SysFS had negative value (-1), but there must be at least one NUMA node, so returning NUMA node zero
2022-05-05 11:22:52.312331: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1406] Created TensorFlow device (/device:GPU:0 with 9224 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:08:00.0, compute capability: 7.5)

Copy-and-paste the text below in your GitHub issue and FILL OUT the two last points.

- `transformers` version: 4.14.1
- Platform: Linux-5.13.0-40-lowlatency-x86_64-with-glibc2.17
- Python version: 3.8.13
- PyTorch version (GPU?): 1.11.0+cu102 (True)
- Tensorflow version (GPU?): 2.4.1 (True)
- Flax version (CPU?/GPU?/TPU?): not installed (NA)
- Jax version: not installed
- JaxLib version: not installed
- Using GPU in script?: <fill in>
- Using distributed or parallel set-up in script?: <fill in>

Who can help?

I cannot install transformers and datasets into the same conda environment. When I do that and try to import transformers inti python I get the error: ImportError: cannot import name 'create_repo' from 'huggingface_hub' (/home/arnold/bin/anaconda/envs/test/lib/python3.8/site-packages/huggingface_hub/init.py)

When install these libraries without the other I can import that library.

The problem arises when I try to duplicate the examples of chapter 2, page 33 of the book 'Natural language processing with transformers'. Up untill that page everything was ok.

Information

The official example scripts

My own modified scripts

Tasks

An officially supported task in the examples folder (such as GLUE/SQuAD, ...)

My own task or dataset (give details below)

Reproduction

$ conda create -n test transformers datasets torch
$ python
Python 3.8.13 (default, Mar 28 2022, 11:38:47)
[GCC 7.5.0] :: Anaconda, Inc. on linux
Type "help", "copyright", "credits" or "license" for more information.
>>> import transformers
Traceback (most recent call last):
File "<stdin>", line 1, in <module>
File "/home/arnold/bin/anaconda/envs/test/lib/python3.8/site-packages/transformers/__init__.py", line 43, in <module>
from . import dependency_versions_check
File "/home/arnold/bin/anaconda/envs/test/lib/python3.8/site-packages/transformers/dependency_versions_check.py", line 36, in <module>
from .file_utils import is_tokenizers_available
File "/home/arnold/bin/anaconda/envs/test/lib/python3.8/site-packages/transformers/file_utils.py", line 52, in <module>
from huggingface_hub import HfFolder, Repository, create_repo, list_repo_files, whoami
ImportError: cannot import name 'create_repo' from 'huggingface_hub' (/home/arnold/bin/anaconda/envs/test/lib/python3.8/site-packages/huggingface_hub/__init__.py)
>>>

I did some experiments to try to determine the cause of the error. The output you can find below.

$ conda create -n test transformers
Collecting package metadata (current_repodata.json): done
Solving environment: done

## Package Plan ##

environment location: /home/arnold/bin/anaconda/envs/test

added / updated specs:
- transformers

The following packages will be downloaded:

package | build
---------------------------|-----------------
ca-certificates-2022.4.26 | h06a4308_0 124 KB
ninja-1.10.2 | h06a4308_5 8 KB
ninja-base-1.10.2 | hd09550d_5 109 KB
numpy-1.21.5 | py39he7a7128_2 10 KB
numpy-base-1.21.5 | py39hf524024_2 4.9 MB
pytorch-1.10.2 |cpu_py39hfa7516b_0 44.1 MB
setuptools-61.2.0 | py39h06a4308_0 1011 KB
tokenizers-0.10.3 | py39hb317417_1 2.4 MB
tqdm-4.64.0 | py39h06a4308_0 126 KB
urllib3-1.26.9 | py39h06a4308_0 180 KB
xz-5.2.5 | h7f8727e_1 339 KB
------------------------------------------------------------
Total: 53.2 MB

The following NEW packages will be INSTALLED:

_libgcc_mutex pkgs/main/linux-64::_libgcc_mutex-0.1-main
_openmp_mutex pkgs/main/linux-64::_openmp_mutex-4.5-1_gnu
blas pkgs/main/linux-64::blas-1.0-mkl
brotlipy pkgs/main/linux-64::brotlipy-0.7.0-py39h27cfd23_1003
ca-certificates pkgs/main/linux-64::ca-certificates-2022.4.26-h06a4308_0
certifi pkgs/main/linux-64::certifi-2021.10.8-py39h06a4308_2
cffi pkgs/main/linux-64::cffi-1.15.0-py39hd667e15_1
charset-normalizer pkgs/main/noarch::charset-normalizer-2.0.4-pyhd3eb1b0_0
click pkgs/main/linux-64::click-8.0.4-py39h06a4308_0
cryptography pkgs/main/linux-64::cryptography-36.0.0-py39h9ce1e76_0
dataclasses pkgs/main/noarch::dataclasses-0.8-pyh6d0b6a4_7
filelock pkgs/main/noarch::filelock-3.6.0-pyhd3eb1b0_0
future pkgs/main/linux-64::future-0.18.2-py39h06a4308_1
huggingface_hub pkgs/main/noarch::huggingface_hub-0.2.1-pyhd3eb1b0_0
idna pkgs/main/noarch::idna-3.3-pyhd3eb1b0_0
importlib-metadata pkgs/main/linux-64::importlib-metadata-4.11.3-py39h06a4308_0
importlib_metadata pkgs/main/noarch::importlib_metadata-4.11.3-hd3eb1b0_0
intel-openmp pkgs/main/linux-64::intel-openmp-2021.4.0-h06a4308_3561
joblib pkgs/main/noarch::joblib-1.1.0-pyhd3eb1b0_0
ld_impl_linux-64 pkgs/main/linux-64::ld_impl_linux-64-2.35.1-h7274673_9
libffi pkgs/main/linux-64::libffi-3.3-he6710b0_2
libgcc-ng pkgs/main/linux-64::libgcc-ng-9.3.0-h5101ec6_17
libgomp pkgs/main/linux-64::libgomp-9.3.0-h5101ec6_17
libstdcxx-ng pkgs/main/linux-64::libstdcxx-ng-9.3.0-hd4cf53a_17
mkl pkgs/main/linux-64::mkl-2021.4.0-h06a4308_640
mkl-service pkgs/main/linux-64::mkl-service-2.4.0-py39h7f8727e_0
mkl_fft pkgs/main/linux-64::mkl_fft-1.3.1-py39hd3c417c_0
mkl_random pkgs/main/linux-64::mkl_random-1.2.2-py39h51133e4_0
ncurses pkgs/main/linux-64::ncurses-6.3-h7f8727e_2
ninja pkgs/main/linux-64::ninja-1.10.2-h06a4308_5
ninja-base pkgs/main/linux-64::ninja-base-1.10.2-hd09550d_5
numpy pkgs/main/linux-64::numpy-1.21.5-py39he7a7128_2
numpy-base pkgs/main/linux-64::numpy-base-1.21.5-py39hf524024_2
openssl pkgs/main/linux-64::openssl-1.1.1n-h7f8727e_0
packaging pkgs/main/noarch::packaging-21.3-pyhd3eb1b0_0
pip pkgs/main/linux-64::pip-21.2.4-py39h06a4308_0
pycparser pkgs/main/noarch::pycparser-2.21-pyhd3eb1b0_0
pyopenssl pkgs/main/noarch::pyopenssl-22.0.0-pyhd3eb1b0_0
pyparsing pkgs/main/noarch::pyparsing-3.0.4-pyhd3eb1b0_0
pysocks pkgs/main/linux-64::pysocks-1.7.1-py39h06a4308_0
python pkgs/main/linux-64::python-3.9.12-h12debd9_0
pytorch pkgs/main/linux-64::pytorch-1.10.2-cpu_py39hfa7516b_0
pyyaml pkgs/main/linux-64::pyyaml-6.0-py39h7f8727e_1
readline pkgs/main/linux-64::readline-8.1.2-h7f8727e_1
regex pkgs/main/linux-64::regex-2022.3.15-py39h7f8727e_0
requests pkgs/main/noarch::requests-2.27.1-pyhd3eb1b0_0
sacremoses pkgs/main/noarch::sacremoses-0.0.43-pyhd3eb1b0_0
setuptools pkgs/main/linux-64::setuptools-61.2.0-py39h06a4308_0
six pkgs/main/noarch::six-1.16.0-pyhd3eb1b0_1
sqlite pkgs/main/linux-64::sqlite-3.38.2-hc218d9a_0
tk pkgs/main/linux-64::tk-8.6.11-h1ccaba5_0
tokenizers pkgs/main/linux-64::tokenizers-0.10.3-py39hb317417_1
tqdm pkgs/main/linux-64::tqdm-4.64.0-py39h06a4308_0
transformers pkgs/main/noarch::transformers-4.14.1-pyhd3eb1b0_0
typing-extensions pkgs/main/noarch::typing-extensions-4.1.1-hd3eb1b0_0
typing_extensions pkgs/main/noarch::typing_extensions-4.1.1-pyh06a4308_0
tzdata pkgs/main/noarch::tzdata-2022a-hda174b7_0
urllib3 pkgs/main/linux-64::urllib3-1.26.9-py39h06a4308_0
wheel pkgs/main/noarch::wheel-0.37.1-pyhd3eb1b0_0
xz pkgs/main/linux-64::xz-5.2.5-h7f8727e_1
yaml pkgs/main/linux-64::yaml-0.2.5-h7b6447c_0
zipp pkgs/main/noarch::zipp-3.7.0-pyhd3eb1b0_0
zlib pkgs/main/linux-64::zlib-1.2.12-h7f8727e_2

Proceed ([y]/n)?

Downloading and Extracting Packages
pytorch-1.10.2 | 44.1 MB | ######################################################### | 100%
tqdm-4.64.0 | 126 KB | ######################################################### | 100%
ninja-base-1.10.2 | 109 KB | ######################################################### | 100%
numpy-1.21.5 | 10 KB | ######################################################### | 100%
tokenizers-0.10.3 | 2.4 MB | ######################################################### | 100%
numpy-base-1.21.5 | 4.9 MB | ######################################################### | 100%
ca-certificates-2022 | 124 KB | ######################################################### | 100%
xz-5.2.5 | 339 KB | ######################################################### | 100%
urllib3-1.26.9 | 180 KB | ######################################################### | 100%
ninja-1.10.2 | 8 KB | ######################################################### | 100%
setuptools-61.2.0 | 1011 KB | ######################################################### | 100%
Preparing transaction: done
Verifying transaction: done
Executing transaction: done
#
# To activate this environment, use
#
# $ conda activate test
#
# To deactivate an active environment, use
#
# $ conda deactivate

$ conda activate test
$ conda install datasets
Collecting package metadata (current_repodata.json): done
Solving environment: failed with initial frozen solve. Retrying with flexible solve.
Solving environment: failed with repodata from current_repodata.json, will retry with next repodata source.
Collecting package metadata (repodata.json): done
Solving environment: failed with initial frozen solve. Retrying with flexible solve.
Solving environment: \
Found conflicts! Looking for incompatible packages.
This can take several minutes. Press CTRL-C to abort.
failed

UnsatisfiableError: The following specifications were found to be incompatible with each other:

Output in format: Requested package -> Available versionsThe following specifications were found to be incompatible with your system:

- feature:/linux-64::__glibc==2.34=0
- python=3.9 -> libgcc-ng[version='>=7.5.0'] -> __glibc[version='>=2.17']

Your installed version is: 2.34

$ conda create -n test transformers datasets
Collecting package metadata (current_repodata.json): done
Solving environment: failed with repodata from current_repodata.json, will retry with next repodata source.
Collecting package metadata (repodata.json): done
Solving environment: done

## Package Plan ##

environment location: /home/arnold/bin/anaconda/envs/test

added / updated specs:
- datasets
- transformers

The following packages will be downloaded:

package | build
---------------------------|-----------------
abseil-cpp-20210324.2 | h2531618_0 965 KB
arrow-cpp-3.0.0 | py38h6b21186_4 7.1 MB
boost-cpp-1.73.0 | h27cfd23_11 25 KB
conllu-4.4.1 | pyhd3eb1b0_0 23 KB
datasets-1.12.1 | pyhd3eb1b0_0 193 KB
dill-0.3.4 | pyhd3eb1b0_0 61 KB
double-conversion-3.1.5 | he6710b0_1 235 KB
fsspec-2022.2.0 | pyhd3eb1b0_0 98 KB
gflags-2.2.2 | he6710b0_0 126 KB
glog-0.5.0 | h2531618_0 101 KB
grpc-cpp-1.39.0 | hae934f6_5 2.8 MB
huggingface_hub-0.0.17 | pyhd3eb1b0_0 59 KB
libcurl-7.82.0 | h0b77cf5_0 342 KB
libevent-2.1.12 | h8f2d780_0 425 KB
libprotobuf-3.17.2 | h4ff587b_1 2.0 MB
libssh2-1.10.0 | h8f2d780_0 274 KB
libthrift-0.14.2 | hcc01f38_0 2.8 MB
lxml-4.8.0 | py38h1f438cf_0 1.3 MB
multiprocess-0.70.12.2 | py38h7f8727e_0 226 KB
numpy-1.21.5 | py38he7a7128_2 10 KB
numpy-base-1.21.5 | py38hf524024_2 4.8 MB
orc-1.6.9 | ha97a36c_3 623 KB
pyarrow-3.0.0 | py38he0739d4_3 1.9 MB
python-xxhash-2.0.2 | py38h7f8727e_0 24 KB
re2-2020.11.01 | h2531618_1 315 KB
snappy-1.1.9 | h295c915_0 636 KB
tqdm-4.49.0 | py_0 55 KB
uriparser-0.9.3 | he6710b0_1 48 KB
utf8proc-2.6.1 | h27cfd23_0 308 KB
xxhash-0.8.0 | h7f8727e_3 83 KB
yarl-1.6.3 | py38h27cfd23_0 136 KB
------------------------------------------------------------
Total: 28.0 MB

The following NEW packages will be INSTALLED:

_libgcc_mutex pkgs/main/linux-64::_libgcc_mutex-0.1-main
_openmp_mutex pkgs/main/linux-64::_openmp_mutex-4.5-1_gnu
abseil-cpp pkgs/main/linux-64::abseil-cpp-20210324.2-h2531618_0
aiohttp pkgs/main/linux-64::aiohttp-3.8.1-py38h7f8727e_1
aiosignal pkgs/main/noarch::aiosignal-1.2.0-pyhd3eb1b0_0
arrow-cpp pkgs/main/linux-64::arrow-cpp-3.0.0-py38h6b21186_4
async-timeout pkgs/main/noarch::async-timeout-4.0.1-pyhd3eb1b0_0
attrs pkgs/main/noarch::attrs-21.4.0-pyhd3eb1b0_0
aws-c-common pkgs/main/linux-64::aws-c-common-0.4.57-he6710b0_1
aws-c-event-stream pkgs/main/linux-64::aws-c-event-stream-0.1.6-h2531618_5
aws-checksums pkgs/main/linux-64::aws-checksums-0.1.9-he6710b0_0
aws-sdk-cpp pkgs/main/linux-64::aws-sdk-cpp-1.8.185-hce553d0_0
bcj-cffi pkgs/main/linux-64::bcj-cffi-0.5.1-py38h295c915_0
blas pkgs/main/linux-64::blas-1.0-mkl
boost-cpp pkgs/main/linux-64::boost-cpp-1.73.0-h27cfd23_11
bottleneck pkgs/main/linux-64::bottleneck-1.3.4-py38hce1f21e_0
brotli pkgs/main/linux-64::brotli-1.0.9-he6710b0_2
brotli-python pkgs/main/linux-64::brotli-python-1.0.9-py38heb0550a_2
brotlicffi pkgs/main/linux-64::brotlicffi-1.0.9.2-py38h295c915_0
brotlipy pkgs/main/linux-64::brotlipy-0.7.0-py38h27cfd23_1003
bzip2 pkgs/main/linux-64::bzip2-1.0.8-h7b6447c_0
c-ares pkgs/main/linux-64::c-ares-1.18.1-h7f8727e_0
ca-certificates pkgs/main/linux-64::ca-certificates-2022.4.26-h06a4308_0
certifi pkgs/main/linux-64::certifi-2021.10.8-py38h06a4308_2
cffi pkgs/main/linux-64::cffi-1.15.0-py38hd667e15_1
charset-normalizer pkgs/main/noarch::charset-normalizer-2.0.4-pyhd3eb1b0_0
click pkgs/main/linux-64::click-8.0.4-py38h06a4308_0
conllu pkgs/main/noarch::conllu-4.4.1-pyhd3eb1b0_0
cryptography pkgs/main/linux-64::cryptography-36.0.0-py38h9ce1e76_0
dataclasses pkgs/main/noarch::dataclasses-0.8-pyh6d0b6a4_7
datasets pkgs/main/noarch::datasets-1.12.1-pyhd3eb1b0_0
dill pkgs/main/noarch::dill-0.3.4-pyhd3eb1b0_0
double-conversion pkgs/main/linux-64::double-conversion-3.1.5-he6710b0_1
et_xmlfile pkgs/main/linux-64::et_xmlfile-1.1.0-py38h06a4308_0
filelock pkgs/main/noarch::filelock-3.6.0-pyhd3eb1b0_0
frozenlist pkgs/main/linux-64::frozenlist-1.2.0-py38h7f8727e_0
fsspec pkgs/main/noarch::fsspec-2022.2.0-pyhd3eb1b0_0
future pkgs/main/linux-64::future-0.18.2-py38_1
gflags pkgs/main/linux-64::gflags-2.2.2-he6710b0_0
glog pkgs/main/linux-64::glog-0.5.0-h2531618_0
gmp pkgs/main/linux-64::gmp-6.2.1-h2531618_2
grpc-cpp pkgs/main/linux-64::grpc-cpp-1.39.0-hae934f6_5
huggingface_hub pkgs/main/noarch::huggingface_hub-0.0.17-pyhd3eb1b0_0
icu pkgs/main/linux-64::icu-58.2-he6710b0_3
idna pkgs/main/noarch::idna-3.3-pyhd3eb1b0_0
importlib-metadata pkgs/main/linux-64::importlib-metadata-4.11.3-py38h06a4308_0
importlib_metadata pkgs/main/noarch::importlib_metadata-4.11.3-hd3eb1b0_0
intel-openmp pkgs/main/linux-64::intel-openmp-2021.4.0-h06a4308_3561
joblib pkgs/main/noarch::joblib-1.1.0-pyhd3eb1b0_0
krb5 pkgs/main/linux-64::krb5-1.19.2-hac12032_0
ld_impl_linux-64 pkgs/main/linux-64::ld_impl_linux-64-2.35.1-h7274673_9
libboost pkgs/main/linux-64::libboost-1.73.0-h3ff78a5_11
libcurl pkgs/main/linux-64::libcurl-7.82.0-h0b77cf5_0
libedit pkgs/main/linux-64::libedit-3.1.20210910-h7f8727e_0
libev pkgs/main/linux-64::libev-4.33-h7f8727e_1
libevent pkgs/main/linux-64::libevent-2.1.12-h8f2d780_0
libffi pkgs/main/linux-64::libffi-3.3-he6710b0_2
libgcc-ng pkgs/main/linux-64::libgcc-ng-9.3.0-h5101ec6_17
libgomp pkgs/main/linux-64::libgomp-9.3.0-h5101ec6_17
libnghttp2 pkgs/main/linux-64::libnghttp2-1.46.0-hce63b2e_0
libprotobuf pkgs/main/linux-64::libprotobuf-3.17.2-h4ff587b_1
libssh2 pkgs/main/linux-64::libssh2-1.10.0-h8f2d780_0
libstdcxx-ng pkgs/main/linux-64::libstdcxx-ng-9.3.0-hd4cf53a_17
libthrift pkgs/main/linux-64::libthrift-0.14.2-hcc01f38_0
libxml2 pkgs/main/linux-64::libxml2-2.9.12-h03d6c58_0
libxslt pkgs/main/linux-64::libxslt-1.1.34-hc22bd24_0
lxml pkgs/main/linux-64::lxml-4.8.0-py38h1f438cf_0
lz4-c pkgs/main/linux-64::lz4-c-1.9.3-h295c915_1
mkl pkgs/main/linux-64::mkl-2021.4.0-h06a4308_640
mkl-service pkgs/main/linux-64::mkl-service-2.4.0-py38h7f8727e_0
mkl_fft pkgs/main/linux-64::mkl_fft-1.3.1-py38hd3c417c_0
mkl_random pkgs/main/linux-64::mkl_random-1.2.2-py38h51133e4_0
multidict pkgs/main/linux-64::multidict-5.2.0-py38h7f8727e_2
multiprocess pkgs/main/linux-64::multiprocess-0.70.12.2-py38h7f8727e_0
multivolumefile pkgs/main/noarch::multivolumefile-0.2.3-pyhd3eb1b0_0
ncurses pkgs/main/linux-64::ncurses-6.3-h7f8727e_2
ninja pkgs/main/linux-64::ninja-1.10.2-h06a4308_5
ninja-base pkgs/main/linux-64::ninja-base-1.10.2-hd09550d_5
numexpr pkgs/main/linux-64::numexpr-2.8.1-py38h6abb31d_0
numpy pkgs/main/linux-64::numpy-1.21.5-py38he7a7128_2
numpy-base pkgs/main/linux-64::numpy-base-1.21.5-py38hf524024_2
openpyxl pkgs/main/noarch::openpyxl-3.0.9-pyhd3eb1b0_0
openssl pkgs/main/linux-64::openssl-1.1.1n-h7f8727e_0
orc pkgs/main/linux-64::orc-1.6.9-ha97a36c_3
packaging pkgs/main/noarch::packaging-21.3-pyhd3eb1b0_0
pandas pkgs/main/linux-64::pandas-1.4.2-py38h295c915_0
pip pkgs/main/linux-64::pip-21.2.4-py38h06a4308_0
py7zr pkgs/main/noarch::py7zr-0.16.1-pyhd3eb1b0_1
pyarrow pkgs/main/linux-64::pyarrow-3.0.0-py38he0739d4_3
pycparser pkgs/main/noarch::pycparser-2.21-pyhd3eb1b0_0
pycryptodomex pkgs/main/linux-64::pycryptodomex-3.10.1-py38h27cfd23_1
pyopenssl pkgs/main/noarch::pyopenssl-22.0.0-pyhd3eb1b0_0
pyparsing pkgs/main/noarch::pyparsing-3.0.4-pyhd3eb1b0_0
pyppmd pkgs/main/linux-64::pyppmd-0.16.1-py38h295c915_0
pysocks pkgs/main/linux-64::pysocks-1.7.1-py38h06a4308_0
python pkgs/main/linux-64::python-3.8.13-h12debd9_0
python-dateutil pkgs/main/noarch::python-dateutil-2.8.2-pyhd3eb1b0_0
python-xxhash pkgs/main/linux-64::python-xxhash-2.0.2-py38h7f8727e_0
pytorch pkgs/main/linux-64::pytorch-1.10.2-cpu_py38hfa7516b_0
pytz pkgs/main/noarch::pytz-2021.3-pyhd3eb1b0_0
pyyaml pkgs/main/linux-64::pyyaml-6.0-py38h7f8727e_1
pyzstd pkgs/main/linux-64::pyzstd-0.14.4-py38h7f8727e_3
re2 pkgs/main/linux-64::re2-2020.11.01-h2531618_1
readline pkgs/main/linux-64::readline-8.1.2-h7f8727e_1
regex pkgs/main/linux-64::regex-2022.3.15-py38h7f8727e_0
requests pkgs/main/noarch::requests-2.27.1-pyhd3eb1b0_0
sacremoses pkgs/main/noarch::sacremoses-0.0.43-pyhd3eb1b0_0
setuptools pkgs/main/linux-64::setuptools-61.2.0-py38h06a4308_0
six pkgs/main/noarch::six-1.16.0-pyhd3eb1b0_1
snappy pkgs/main/linux-64::snappy-1.1.9-h295c915_0
sqlite pkgs/main/linux-64::sqlite-3.38.2-hc218d9a_0
texttable pkgs/main/noarch::texttable-1.6.4-pyhd3eb1b0_0
tk pkgs/main/linux-64::tk-8.6.11-h1ccaba5_0
tokenizers pkgs/main/linux-64::tokenizers-0.10.3-py38hb317417_1
tqdm pkgs/main/noarch::tqdm-4.49.0-py_0
transformers pkgs/main/noarch::transformers-4.14.1-pyhd3eb1b0_0
typing-extensions pkgs/main/noarch::typing-extensions-4.1.1-hd3eb1b0_0
typing_extensions pkgs/main/noarch::typing_extensions-4.1.1-pyh06a4308_0
uriparser pkgs/main/linux-64::uriparser-0.9.3-he6710b0_1
urllib3 pkgs/main/linux-64::urllib3-1.26.9-py38h06a4308_0
utf8proc pkgs/main/linux-64::utf8proc-2.6.1-h27cfd23_0
wheel pkgs/main/noarch::wheel-0.37.1-pyhd3eb1b0_0
xxhash pkgs/main/linux-64::xxhash-0.8.0-h7f8727e_3
xz pkgs/main/linux-64::xz-5.2.5-h7f8727e_1
yaml pkgs/main/linux-64::yaml-0.2.5-h7b6447c_0
yarl pkgs/main/linux-64::yarl-1.6.3-py38h27cfd23_0
zipp pkgs/main/noarch::zipp-3.7.0-pyhd3eb1b0_0
zlib pkgs/main/linux-64::zlib-1.2.12-h7f8727e_2
zstd pkgs/main/linux-64::zstd-1.4.9-haebb681_0

Proceed ([y]/n)?

Downloading and Extracting Packages
libprotobuf-3.17.2 | 2.0 MB | ######################################################### | 100%
snappy-1.1.9 | 636 KB | ######################################################### | 100%
grpc-cpp-1.39.0 | 2.8 MB | ######################################################### | 100%
utf8proc-2.6.1 | 308 KB | ######################################################### | 100%
glog-0.5.0 | 101 KB | ######################################################### | 100%
orc-1.6.9 | 623 KB | ######################################################### | 100%
re2-2020.11.01 | 315 KB | ######################################################### | 100%
tqdm-4.49.0 | 55 KB | ######################################################### | 100%
huggingface_hub-0.0. | 59 KB | ######################################################### | 100%
lxml-4.8.0 | 1.3 MB | ######################################################### | 100%
libssh2-1.10.0 | 274 KB | ######################################################### | 100%
multiprocess-0.70.12 | 226 KB | ######################################################### | 100%
datasets-1.12.1 | 193 KB | ######################################################### | 100%
xxhash-0.8.0 | 83 KB | ######################################################### | 100%
conllu-4.4.1 | 23 KB | ######################################################### | 100%
double-conversion-3. | 235 KB | ######################################################### | 100%
python-xxhash-2.0.2 | 24 KB | ######################################################### | 100%
libcurl-7.82.0 | 342 KB | ######################################################### | 100%
numpy-1.21.5 | 10 KB | ######################################################### | 100%
abseil-cpp-20210324. | 965 KB | ######################################################### | 100%
numpy-base-1.21.5 | 4.8 MB | ######################################################### | 100%
libthrift-0.14.2 | 2.8 MB | ######################################################### | 100%
pyarrow-3.0.0 | 1.9 MB | ######################################################### | 100%
dill-0.3.4 | 61 KB | ######################################################### | 100%
gflags-2.2.2 | 126 KB | ######################################################### | 100%
arrow-cpp-3.0.0 | 7.1 MB | ######################################################### | 100%
uriparser-0.9.3 | 48 KB | ######################################################### | 100%
boost-cpp-1.73.0 | 25 KB | ######################################################### | 100%
fsspec-2022.2.0 | 98 KB | ######################################################### | 100%
yarl-1.6.3 | 136 KB | ######################################################### | 100%
libevent-2.1.12 | 425 KB | ######################################################### | 100%
Preparing transaction: done
Verifying transaction: done
Executing transaction: done
#
# To activate this environment, use
#
# $ conda activate test
#
# To deactivate an active environment, use
#
# $ conda deactivate

$ conda activate test
$ python
Python 3.8.13 (default, Mar 28 2022, 11:38:47)
[GCC 7.5.0] :: Anaconda, Inc. on linux
Type "help", "copyright", "credits" or "license" for more information.
>>> import transformers
Traceback (most recent call last):
File "<stdin>", line 1, in <module>
File "/home/arnold/bin/anaconda/envs/test/lib/python3.8/site-packages/transformers/__init__.py", line 43, in <module>
from . import dependency_versions_check
File "/home/arnold/bin/anaconda/envs/test/lib/python3.8/site-packages/transformers/dependency_versions_check.py", line 36, in <module>
from .file_utils import is_tokenizers_available
File "/home/arnold/bin/anaconda/envs/test/lib/python3.8/site-packages/transformers/file_utils.py", line 52, in <module>
from huggingface_hub import HfFolder, Repository, create_repo, list_repo_files, whoami
ImportError: cannot import name 'create_repo' from 'huggingface_hub' (/home/arnold/bin/anaconda/envs/test/lib/python3.8/site-packages/huggingface_hub/__init__.py)
>>>

Expected behavior

$ conda create -n test transformers datasets torch
$ python
Python 3.8.13 (default, Mar 28 2022, 11:38:47)
[GCC 7.5.0] :: Anaconda, Inc. on linux
Type "help", "copyright", "credits" or "license" for more information.
>>> import transformers
>>>