YAML Metadata
Warning:
empty or missing yaml metadata in repo card
(https://huggingface.co/docs/hub/model-cards#model-card-metadata)
Linux, CUDA, AVX512.
$ git clone "https://github.com/abetlen/llama-cpp-python" --depth=1
$ cd llama-cpp-python
$ git submodule update --init --recursive
$ CMAKE_ARGS="-DLLAMA_CUBLAS=on" python -m pip install .
Inference Providers
NEW
This model is not currently available via any of the supported Inference Providers.
The model cannot be deployed to the HF Inference API:
The model has no library tag.