Instructions to use Accio-Lab/occamy-1.0 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

Libraries

How to use Accio-Lab/occamy-1.0 with Transformers:

# Use a pipeline as a high-level helper
from transformers import pipeline

pipe = pipeline("image-text-to-text", model="Accio-Lab/occamy-1.0")
messages = [
    {
        "role": "user",
        "content": [
            {"type": "image", "url": "https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/p-blog/candy.JPG"},
            {"type": "text", "text": "What animal is on the candy?"}
        ]
    },
]
pipe(text=messages)

# Load model directly
from transformers import AutoProcessor, AutoModelForMultimodalLM

processor = AutoProcessor.from_pretrained("Accio-Lab/occamy-1.0")
model = AutoModelForMultimodalLM.from_pretrained("Accio-Lab/occamy-1.0", device_map="auto")
messages = [
    {
        "role": "user",
        "content": [
            {"type": "image", "url": "https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/p-blog/candy.JPG"},
            {"type": "text", "text": "What animal is on the candy?"}
        ]
    },
]
inputs = processor.apply_chat_template(
	messages,
	add_generation_prompt=True,
	tokenize=True,
	return_dict=True,
	return_tensors="pt",
).to(model.device)

outputs = model.generate(**inputs, max_new_tokens=40)
print(processor.decode(outputs[0][inputs["input_ids"].shape[-1]:]))

Notebooks
Google Colab
Kaggle
Local Apps Settings

vLLM

How to use Accio-Lab/occamy-1.0 with vLLM:

Install from pip and serve model

# Install vLLM from pip:
pip install vllm
# Start the vLLM server:
vllm serve "Accio-Lab/occamy-1.0"
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:8000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "Accio-Lab/occamy-1.0",
		"messages": [
			{
				"role": "user",
				"content": [
					{
						"type": "text",
						"text": "Describe this image in one sentence."
					},
					{
						"type": "image_url",
						"image_url": {
							"url": "https://cdn.britannica.com/61/93061-050-99147DCE/Statue-of-Liberty-Island-New-York-Bay.jpg"
						}
					}
				]
			}
		]
	}'

Use Docker

docker model run hf.co/Accio-Lab/occamy-1.0

SGLang

How to use Accio-Lab/occamy-1.0 with SGLang:

Install from pip and serve model

# Install SGLang from pip:
pip install sglang
# Start the SGLang server:
python3 -m sglang.launch_server \
    --model-path "Accio-Lab/occamy-1.0" \
    --host 0.0.0.0 \
    --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "Accio-Lab/occamy-1.0",
		"messages": [
			{
				"role": "user",
				"content": [
					{
						"type": "text",
						"text": "Describe this image in one sentence."
					},
					{
						"type": "image_url",
						"image_url": {
							"url": "https://cdn.britannica.com/61/93061-050-99147DCE/Statue-of-Liberty-Island-New-York-Bay.jpg"
						}
					}
				]
			}
		]
	}'

Use Docker images

docker run --gpus all \
    --shm-size 32g \
    -p 30000:30000 \
    -v ~/.cache/huggingface:/root/.cache/huggingface \
    --env "HF_TOKEN=<secret>" \
    --ipc=host \
    lmsysorg/sglang:latest \
    python3 -m sglang.launch_server \
        --model-path "Accio-Lab/occamy-1.0" \
        --host 0.0.0.0 \
        --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "Accio-Lab/occamy-1.0",
		"messages": [
			{
				"role": "user",
				"content": [
					{
						"type": "text",
						"text": "Describe this image in one sentence."
					},
					{
						"type": "image_url",
						"image_url": {
							"url": "https://cdn.britannica.com/61/93061-050-99147DCE/Statue-of-Liberty-Island-New-York-Bay.jpg"
						}
					}
				]
			}
		]
	}'

Docker Model Runner
How to use Accio-Lab/occamy-1.0 with Docker Model Runner:
```
docker model run hf.co/Accio-Lab/occamy-1.0
```

overfitting to tools

by inikishev - opened 2 days ago

Discussion

inikishev

2 days ago

it was saying I need to use web fetch tool but instead it would use bash command for a while until it finally managed to use web fetch

 Actually, let me try using the web_fetch tool to get the GitHub page.                                                                                                                                                                                        

 Let me use the web_fetch tool to get the GitHub source for the 2.7.12 release.                                                                                                                                                                               

                                                                                                                                                                                                                                                              
 $ cd /tmp                                                                                                                                                                                                                                                    
 # Try web_fetch to get the GitHub raw content                                                                                                                                                                                                                
 echo "=== Try fetching BrowserShared.cpp from 2.7.12 tag ==="                                                                                                                                                                                                
 web_fetch_url="https://raw.githubusercontent.com/keepassxreboot/keepassxc/keepassxc-2.7.12/src/browser/BrowserShared.cpp"                                                                                                                                    
 echo "Fetching: $web_fetch_url" (timeout 5s)                                                                                                                                                                                                                 
                                                                                                                                                                                                                                                              
 === Try fetching BrowserShared.cpp from 2.7.12 tag ===                                                                                                                                                                                                       
 Fetching: https://raw.githubusercontent.com/keepassxreboot/keepassxc/keepassxc-2.7.12/src/browser/BrowserShared.cpp                                                                                                                                          
                                                                                                                                                                                                                                                              

 Let me use the web_fetch tool to fetch the GitHub raw content.                                                                                                                                                                                               

                                                                                                                                                                                                                                                              
 web_fetch https://raw.githubusercontent.com/keepassxreboot/keepassxc/keepassxc-2.7.12/src/browser/BrowserShared.cpp

Eang

Accio org 2 days ago

Hugging Face CLI

@inikishev Thanks for this case. We'll look into why it keeps using Bash instead of calling the intended tool, and try to fix it in the next version.

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment