runtime error

neration modes. You should set `do_sample=True` or unset `temperature`. warnings.warn( /home/user/.local/lib/python3.10/site-packages/transformers/generation/configuration_utils.py:415: UserWarning: `do_sample` is set to `False`. However, `top_p` is set to `0.6` -- this flag is only used in sample-based generation modes. You should set `do_sample=True` or unset `top_p`. warnings.warn( WARNING:root:Some parameters are on the meta device device because they were offloaded to the cpu and disk. Traceback (most recent call last): File "/home/user/app/app.py", line 5, in <module> pipe = pipeline("text-generation", model="NousResearch/Llama-2-13b-chat-hf", torch_dtype=torch.bfloat16, device_map="auto") File "/home/user/.local/lib/python3.10/site-packages/transformers/pipelines/__init__.py", line 1004, in pipeline tokenizer = AutoTokenizer.from_pretrained( File "/home/user/.local/lib/python3.10/site-packages/transformers/models/auto/tokenization_auto.py", line 825, in from_pretrained return tokenizer_class.from_pretrained(pretrained_model_name_or_path, *inputs, **kwargs) File "/home/user/.local/lib/python3.10/site-packages/transformers/tokenization_utils_base.py", line 2048, in from_pretrained return cls._from_pretrained( File "/home/user/.local/lib/python3.10/site-packages/transformers/tokenization_utils_base.py", line 2287, in _from_pretrained tokenizer = cls(*init_inputs, **init_kwargs) File "/home/user/.local/lib/python3.10/site-packages/transformers/models/llama/tokenization_llama_fast.py", line 133, in __init__ super().__init__( File "/home/user/.local/lib/python3.10/site-packages/transformers/tokenization_utils_fast.py", line 120, in __init__ raise ValueError( ValueError: Couldn't instantiate the backend tokenizer from one of: (1) a `tokenizers` library serialization file, (2) a slow tokenizer instance to convert or (3) an equivalent slow tokenizer class to instantiate and convert. You need to have sentencepiece installed to convert a slow tokenizer to a fast one.

Container logs: