import error: cannot import name
#1
by
FenixInDarkSolo
- opened
[from transformers.models.llama.modeling_llama import apply_rotary_pos_emb, repeat_kv]
(ImportError: cannot import name 'repeat_kv' from 'transformers.models.llama.modeling_llama')
I know something should be installed before using this model.
But I didn't know which library I should install. Here is my pip list:
Package Version
------------------------ ------------------
absl-py 1.4.0
accelerate 0.20.3
addict 2.4.0
aenum 3.1.11
aiofiles 23.1.0
aiohttp 3.8.4
aiosignal 1.3.1
altair 4.2.2
antlr4-python3-runtime 4.9.3
anyio 3.6.2
argilla 1.7.0
async-timeout 4.0.2
attrs 23.1.0
auto-gptq 0.2.2
backoff 2.2.1
basicsr 1.4.2
beautifulsoup4 4.12.2
bitsandbytes 0.38.1
blendmodes 2022
blinker 1.6.2
boltons 23.0.0
brotlipy 0.7.0
cachetools 5.3.0
certifi 2023.5.7
cffi 1.15.1
chardet 5.1.0
charset-normalizer 3.1.0
chinese-converter 1.0.2
chromadb 0.3.22
clean-fid 0.1.35
click 8.1.3
clickhouse-connect 0.5.20
colorama 0.4.6
colorclass 2.2.2
coloredlogs 15.0.1
commonmark 0.9.1
compressed-rtf 1.0.6
contourpy 1.0.7
cpm-kernels 1.0.11
cryptography 39.0.1
cssselect 1.2.0
ctransformers 0.2.2
cycler 0.11.0
dataclasses-json 0.5.9
datasets 2.11.0
defusedxml 0.7.1
Deprecated 1.2.14
deprecation 2.1.0
dill 0.3.6
diskcache 5.6.1
dnspython 2.3.0
docker 6.0.1
duckdb 0.7.1
duckduckgo-search 2.8.5
easygui 0.98.3
ebcdic 1.1.1
einops 0.6.0
entrypoints 0.4
et-xmlfile 1.1.0
extract-msg 0.41.1
facexlib 0.2.5
faiss-cpu 1.7.4
fastapi 0.94.1
ffmpy 0.3.0
filelock 3.9.0
filterpy 1.4.5
Flask 2.3.2
flatbuffers 23.3.3
flit_core 3.6.0
font-roboto 0.0.1
fonts 0.0.3
fonttools 4.39.2
frozenlist 1.3.3
fsspec 2023.3.0
future 0.18.3
gfpgan 1.3.8
gitdb 4.0.10
GitPython 3.1.31
google-api-core 2.11.0
google-api-python-client 2.86.0
google-auth 2.16.2
google-auth-httplib2 0.1.0
google-auth-oauthlib 0.4.6
googleapis-common-protos 1.59.0
gpt-index 0.4.24
gpt4all 0.3.2
gptcache 0.1.14
gradio 3.16.2
greenlet 2.0.2
grpcio 1.51.3
gTTS 2.3.1
h11 0.14.0
hnswlib 0.7.0
httpcore 0.16.3
httplib2 0.22.0
httptools 0.5.0
httpx 0.23.3
huggingface-hub 0.13.4
humanfriendly 10.0
icetk 0.0.6
idna 3.4
imageio 2.26.0
IMAPClient 2.3.1
inflection 0.5.1
InstructorEmbedding 1.0.1
invisible-watermark 0.1.5
itsdangerous 2.1.2
Jinja2 3.1.2
joblib 1.2.0
jsonmerge 1.9.0
jsonschema 4.17.3
jstyleson 0.0.2
kiwisolver 1.4.4
kornia 0.6.10
langchain 0.0.225
langchainplus-sdk 0.0.20
lark 1.1.5
lark-parser 0.12.0
lazy_loader 0.1
linkify-it-py 2.0.0
llama-cpp-python 0.1.62
llvmlite 0.39.1
lmdb 1.4.0
loguru 0.7.0
lxml 4.9.2
lz4 4.3.2
Markdown 3.4.1
markdown-it-py 2.2.0
MarkupSafe 2.1.2
marshmallow 3.19.0
marshmallow-enum 1.5.1
matplotlib 3.7.1
mdit-py-plugins 0.3.5
mdurl 0.1.2
mkl-fft 1.3.1
mkl-random 1.2.2
mkl-service 2.4.0
monotonic 1.6
mpmath 1.3.0
msg-parser 1.2.0
msoffcrypto-tool 5.0.1
multidict 6.0.4
multiprocess 0.70.14
mypy-extensions 1.0.0
mysql 0.0.3
mysql-connector-python 8.1.0
mysqlclient 2.2.0
networkx 2.8.8
nltk 3.8.1
numba 0.56.4
numexpr 2.8.4
numpy 1.25.0
oauthlib 3.2.2
olefile 0.46
oletools 0.60.1
omegaconf 2.3.0
onnx 1.13.1
onnxruntime 1.14.1
openai 0.27.4
openapi-schema-pydantic 1.2.4
opencv-contrib-python 4.7.0.72
opencv-python 4.7.0.72
openpyxl 3.1.2
openvino 2023.0.1
openvino-dev 2023.0.1
openvino-telemetry 2023.1.0
optimum 1.11.0
optimum-intel 1.10.2.dev0
orjson 3.8.7
packaging 23.1
pandas 1.5.3
pandoc 2.3
patsy 0.5.3
pcodedmp 1.2.6
pdfminer.six 20221105
peft 0.2.0
piexif 1.1.3
Pillow 9.4.0
pinecone-client 2.2.1
pip 23.0.1
platformdirs 3.2.0
playsound 1.2.2
plumbum 1.8.1
ply 3.11
posthog 3.0.1
protobuf 3.20.2
psutil 5.9.4
pyarrow 11.0.0
pyasn1 0.4.8
pyasn1-modules 0.2.8
pycparser 2.21
pycryptodome 3.17
pydantic 1.10.11
pyDeprecate 0.3.2
pydub 0.25.1
pygame 2.3.0
Pygments 2.15.1
pygpt4all 1.1.0
pygptj 2.0.3
pylint-venv 2.3.0
pyllamacpp 2.1.3
pymongo 4.4.1
pyopencl 2022.3.1
pyOpenSSL 23.0.0
pypandoc 1.11
pyparsing 2.4.7
PyPDF2 3.0.1
pyreadline3 3.4.1
pyrsistent 0.19.3
PySocks 1.7.1
python-dateutil 2.8.2
python-docx 0.8.11
python-dotenv 1.0.0
python-magic 0.4.27
python-multipart 0.0.6
python-pptx 0.6.21
pytools 2022.1.14
pytorch-lightning 1.7.7
pytz 2022.7.1
pytz-deprecation-shim 0.1.0.post0
PyWavelets 1.4.1
pywin32 306
PyYAML 6.0
readability-lxml 0.8.1
realesrgan 0.3.0
red-black-tree-mod 1.20
redis 4.5.4
regex 2022.7.9
requests 2.31.0
requests-oauthlib 1.3.1
resize-right 0.0.2
response 0.5.0
responses 0.18.0
rfc3986 1.5.0
rich 13.0.1
rouge 1.0.1
rsa 4.9
RTFDE 0.0.2
safetensors 0.3.0
scikit-image 0.20.0
scikit-learn 1.2.2
scipy 1.10.1
sentence-transformers 2.2.2
sentencepiece 0.1.98
setuptools 65.6.3
shapely 2.0.1
six 1.16.0
smmap 5.0.0
sniffio 1.3.0
soupsieve 2.4.1
SQLAlchemy 2.0.18
starlette 0.26.1
statsmodels 0.13.5
sympy 1.11.1
tabulate 0.9.0
tb-nightly 2.13.0a20230316
tenacity 8.2.2
tensorboard 2.12.0
tensorboard-data-server 0.7.0
tensorboard-plugin-wit 1.8.1
termcolor 2.2.0
texttable 1.6.7
threadpoolctl 3.1.0
tifffile 2023.3.15
tiktoken 0.3.3
timm 0.4.12
tokenizers 0.11.4
toolz 0.12.0
torch 1.13.1
torch-directml 0.1.13.1.dev230413
torchdiffeq 0.2.3
torchmetrics 0.11.4
torchsde 0.2.5
torchvision 0.14.1
tqdm 4.65.0
trampoline 0.1.2
transformers 4.29.0.dev0
typer 0.9.0
typing_extensions 4.7.1
typing-inspect 0.9.0
tzdata 2023.3
tzlocal 4.2
uc-micro-py 1.0.1
unstructured 0.6.6
uritemplate 4.1.1
urllib3 2.0.3
uvicorn 0.21.1
watchfiles 0.19.0
websocket-client 1.5.1
websockets 10.4
Werkzeug 2.3.6
wheel 0.38.4
win-inet-pton 1.1.0
win-unicode-console 0.5
win32-setctime 1.1.0
wincertstore 0.2
wrapt 1.14.1
XlsxWriter 3.1.2
xmltodict 0.13.0
xxhash 3.2.0
yapf 0.32.0
yarl 1.9.2
zstandard 0.21.0
Hi
@FenixInDarkSolo
, this is most likely a dependency issue, thanks for sharing the pip freeze! If possible, I recommend creating a new virtual environment and just doing python -m pip install --upgrade pip followed by python -m pip install optimum[openvino, diffusers].
If you want to try with this environment, my first step would be python -m pip install --upgrade transformers diffusers