Instructions to use James040/llama-cpp-python-wheels with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- llama-cpp-python
How to use James040/llama-cpp-python-wheels with llama-cpp-python:
# !pip install llama-cpp-python from llama_cpp import Llama llm = Llama.from_pretrained( repo_id="James040/llama-cpp-python-wheels", filename="{{GGUF_FILE}}", )output = llm( "Once upon a time,", max_tokens=512, echo=True ) print(output)
- Notebooks
- Google Colab
- Kaggle
- Xet hash:
- c3c39c0b95b0e8308af916b473a2cc82d722d934e4efc5e300f43603f51238e3
- Size of remote file:
- 4.52 MB
- SHA256:
- b31fb70ff1ef1c845af7832d67784fba783e69451ddf1bfb84108d6bcf42479d
·
Xet efficiently stores Large Files inside Git, intelligently splitting files into unique chunks and accelerating uploads and downloads. More info.