Instructions to use Accio-Lab/occamy-1.0 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

Libraries

How to use Accio-Lab/occamy-1.0 with Transformers:

# Use a pipeline as a high-level helper
from transformers import pipeline

pipe = pipeline("image-text-to-text", model="Accio-Lab/occamy-1.0")
messages = [
    {
        "role": "user",
        "content": [
            {"type": "image", "url": "https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/p-blog/candy.JPG"},
            {"type": "text", "text": "What animal is on the candy?"}
        ]
    },
]
pipe(text=messages)

# Load model directly
from transformers import AutoProcessor, AutoModelForMultimodalLM

processor = AutoProcessor.from_pretrained("Accio-Lab/occamy-1.0")
model = AutoModelForMultimodalLM.from_pretrained("Accio-Lab/occamy-1.0", device_map="auto")
messages = [
    {
        "role": "user",
        "content": [
            {"type": "image", "url": "https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/p-blog/candy.JPG"},
            {"type": "text", "text": "What animal is on the candy?"}
        ]
    },
]
inputs = processor.apply_chat_template(
	messages,
	add_generation_prompt=True,
	tokenize=True,
	return_dict=True,
	return_tensors="pt",
).to(model.device)

outputs = model.generate(**inputs, max_new_tokens=40)
print(processor.decode(outputs[0][inputs["input_ids"].shape[-1]:]))

Notebooks
Google Colab
Kaggle
Local Apps Settings

vLLM

How to use Accio-Lab/occamy-1.0 with vLLM:

Install from pip and serve model

# Install vLLM from pip:
pip install vllm
# Start the vLLM server:
vllm serve "Accio-Lab/occamy-1.0"
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:8000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "Accio-Lab/occamy-1.0",
		"messages": [
			{
				"role": "user",
				"content": [
					{
						"type": "text",
						"text": "Describe this image in one sentence."
					},
					{
						"type": "image_url",
						"image_url": {
							"url": "https://cdn.britannica.com/61/93061-050-99147DCE/Statue-of-Liberty-Island-New-York-Bay.jpg"
						}
					}
				]
			}
		]
	}'

Use Docker

docker model run hf.co/Accio-Lab/occamy-1.0

SGLang

How to use Accio-Lab/occamy-1.0 with SGLang:

Install from pip and serve model

# Install SGLang from pip:
pip install sglang
# Start the SGLang server:
python3 -m sglang.launch_server \
    --model-path "Accio-Lab/occamy-1.0" \
    --host 0.0.0.0 \
    --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "Accio-Lab/occamy-1.0",
		"messages": [
			{
				"role": "user",
				"content": [
					{
						"type": "text",
						"text": "Describe this image in one sentence."
					},
					{
						"type": "image_url",
						"image_url": {
							"url": "https://cdn.britannica.com/61/93061-050-99147DCE/Statue-of-Liberty-Island-New-York-Bay.jpg"
						}
					}
				]
			}
		]
	}'

Use Docker images

docker run --gpus all \
    --shm-size 32g \
    -p 30000:30000 \
    -v ~/.cache/huggingface:/root/.cache/huggingface \
    --env "HF_TOKEN=<secret>" \
    --ipc=host \
    lmsysorg/sglang:latest \
    python3 -m sglang.launch_server \
        --model-path "Accio-Lab/occamy-1.0" \
        --host 0.0.0.0 \
        --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "Accio-Lab/occamy-1.0",
		"messages": [
			{
				"role": "user",
				"content": [
					{
						"type": "text",
						"text": "Describe this image in one sentence."
					},
					{
						"type": "image_url",
						"image_url": {
							"url": "https://cdn.britannica.com/61/93061-050-99147DCE/Statue-of-Liberty-Island-New-York-Bay.jpg"
						}
					}
				]
			}
		]
	}'

Docker Model Runner
How to use Accio-Lab/occamy-1.0 with Docker Model Runner:
```
docker model run hf.co/Accio-Lab/occamy-1.0
```

Model review in coding sessions

by Throghar - opened 2 days ago

Discussion

Throghar

2 days ago

I must say model is fast, it handles tool calls very well, but its weak in coding and it just picks wrong solutions to simple problems, overengineering etc.

Eang

Accio org 2 days ago

Hugging Face CLI

@Throghar Thanks for the candid feedback. Could you share one simple task where it chose the wrong approach, along with its response and what you expected instead? A redacted example is fine. Which quantization, runtime/agent and sampling settings were you using? We'd like to reproduce the failure rather than explain it away with benchmark scores.

Throghar

1 day ago

•

edited 1 day ago

well it was used to fix .net maui blazor hybrid app and i wanted it to fix a bug in mediaelement "player" and it started speculating and overengineering thread safety measures while the approach didnt need it because it was natively thread safe. Also same thing with trying to overengineer bug in search method in razor.cs page with debounce implementation it started to rewrite whole debounce mechanics adding interlock etc...

Another example: trying to solve problem with js and more complex approach instead of searching docs with mcp for native framework approach.

All of those were decisions that i had to stop the model in its work and explicitly tell it to do something else.

I cant share the app code though, so at least i hope this will be helpfull.

Quant from bartowski Q5_K_L
runtime: Ante terminal

Eang

Accio org about 23 hours ago

Hugging Face CLI

@Throghar Thanks for the concrete examples — they're helpful even without the app code. We'll look into the unnecessary rewrites and framework choices and try to improve this in the next version.

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment