Instructions to use webbigdata/C3TR-Adapter_gguf with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- llama-cpp-python
How to use webbigdata/C3TR-Adapter_gguf with llama-cpp-python:
# !pip install llama-cpp-python from llama_cpp import Llama llm = Llama.from_pretrained( repo_id="webbigdata/C3TR-Adapter_gguf", filename="C3TR-Adapter-IQ3_XXS.gguf", )
llm.create_chat_completion( messages = "\"Меня зовут Вольфганг и я живу в Берлине\"" )
- Notebooks
- Google Colab
- Kaggle
- Local Apps
- llama.cpp
How to use webbigdata/C3TR-Adapter_gguf with llama.cpp:
Install from brew
brew install llama.cpp # Start a local OpenAI-compatible server with a web UI: llama-server -hf webbigdata/C3TR-Adapter_gguf:Q4_K_M # Run inference directly in the terminal: llama-cli -hf webbigdata/C3TR-Adapter_gguf:Q4_K_M
Install from WinGet (Windows)
winget install llama.cpp # Start a local OpenAI-compatible server with a web UI: llama-server -hf webbigdata/C3TR-Adapter_gguf:Q4_K_M # Run inference directly in the terminal: llama-cli -hf webbigdata/C3TR-Adapter_gguf:Q4_K_M
Use pre-built binary
# Download pre-built binary from: # https://github.com/ggerganov/llama.cpp/releases # Start a local OpenAI-compatible server with a web UI: ./llama-server -hf webbigdata/C3TR-Adapter_gguf:Q4_K_M # Run inference directly in the terminal: ./llama-cli -hf webbigdata/C3TR-Adapter_gguf:Q4_K_M
Build from source code
git clone https://github.com/ggerganov/llama.cpp.git cd llama.cpp cmake -B build cmake --build build -j --target llama-server llama-cli # Start a local OpenAI-compatible server with a web UI: ./build/bin/llama-server -hf webbigdata/C3TR-Adapter_gguf:Q4_K_M # Run inference directly in the terminal: ./build/bin/llama-cli -hf webbigdata/C3TR-Adapter_gguf:Q4_K_M
Use Docker
docker model run hf.co/webbigdata/C3TR-Adapter_gguf:Q4_K_M
- LM Studio
- Jan
- Ollama
How to use webbigdata/C3TR-Adapter_gguf with Ollama:
ollama run hf.co/webbigdata/C3TR-Adapter_gguf:Q4_K_M
- Unsloth Studio new
How to use webbigdata/C3TR-Adapter_gguf with Unsloth Studio:
Install Unsloth Studio (macOS, Linux, WSL)
curl -fsSL https://unsloth.ai/install.sh | sh # Run unsloth studio unsloth studio -H 0.0.0.0 -p 8888 # Then open http://localhost:8888 in your browser # Search for webbigdata/C3TR-Adapter_gguf to start chatting
Install Unsloth Studio (Windows)
irm https://unsloth.ai/install.ps1 | iex # Run unsloth studio unsloth studio -H 0.0.0.0 -p 8888 # Then open http://localhost:8888 in your browser # Search for webbigdata/C3TR-Adapter_gguf to start chatting
Using HuggingFace Spaces for Unsloth
# No setup required # Open https://huggingface.co/spaces/unsloth/studio in your browser # Search for webbigdata/C3TR-Adapter_gguf to start chatting
- Docker Model Runner
How to use webbigdata/C3TR-Adapter_gguf with Docker Model Runner:
docker model run hf.co/webbigdata/C3TR-Adapter_gguf:Q4_K_M
- Lemonade
How to use webbigdata/C3TR-Adapter_gguf with Lemonade:
Pull the model
# Download Lemonade from https://lemonade-server.ai/ lemonade pull webbigdata/C3TR-Adapter_gguf:Q4_K_M
Run and chat with the model
lemonade run user.C3TR-Adapter_gguf-Q4_K_M
List all available models
lemonade list
Update README.md
Browse files
README.md
CHANGED
|
@@ -235,6 +235,7 @@ Because our countries are at war.
|
|
| 235 |
England.
|
| 236 |
|
| 237 |
It’s an island kingdom,
|
|
|
|
| 238 |
1,000 miles north of Portugal.
|
| 239 |
|
| 240 |
[continues speaking Japanese]
|
|
@@ -266,6 +267,7 @@ And to defend ourselves against anyone who dare stop us.
|
|
| 266 |
I cannot conceive of being an enemy to you, Lord.
|
| 267 |
|
| 268 |
Then I would commend my soul to God.
|
|
|
|
| 269 |
For surely I would die by the hand of a teki like you.
|
| 270 |
|
| 271 |
[guard calls out]
|
|
@@ -439,6 +441,7 @@ No, I protest this treatment!
|
|
| 439 |
私は偏見なく翻訳する。
|
| 440 |
|
| 441 |
君がそんなに正直な人間なら、彼に敵であることを教えてくれるだろう。
|
|
|
|
| 442 |
[アルヴィート] 自分で言ってくれ。
|
| 443 |
|
| 444 |
「敵」は「敵」だ。
|
|
@@ -470,6 +473,7 @@ No, I protest this treatment!
|
|
| 470 |
イングランドはカトリックに屈しない。
|
| 471 |
|
| 472 |
[アルヴィートが翻訳する]
|
|
|
|
| 473 |
[アルヴィート] 君はカトリックではないのか?
|
| 474 |
|
| 475 |
キリスト教には2つの宗教がある。プロテスタントとカトリックだ。
|
|
|
|
| 235 |
England.
|
| 236 |
|
| 237 |
It’s an island kingdom,
|
| 238 |
+
|
| 239 |
1,000 miles north of Portugal.
|
| 240 |
|
| 241 |
[continues speaking Japanese]
|
|
|
|
| 267 |
I cannot conceive of being an enemy to you, Lord.
|
| 268 |
|
| 269 |
Then I would commend my soul to God.
|
| 270 |
+
|
| 271 |
For surely I would die by the hand of a teki like you.
|
| 272 |
|
| 273 |
[guard calls out]
|
|
|
|
| 441 |
私は偏見なく翻訳する。
|
| 442 |
|
| 443 |
君がそんなに正直な人間なら、彼に敵であることを教えてくれるだろう。
|
| 444 |
+
|
| 445 |
[アルヴィート] 自分で言ってくれ。
|
| 446 |
|
| 447 |
「敵」は「敵」だ。
|
|
|
|
| 473 |
イングランドはカトリックに屈しない。
|
| 474 |
|
| 475 |
[アルヴィートが翻訳する]
|
| 476 |
+
|
| 477 |
[アルヴィート] 君はカトリックではないのか?
|
| 478 |
|
| 479 |
キリスト教には2つの宗教がある。プロテスタントとカトリックだ。
|