rf-detr-p150

RF-DETR-base (Roboflow's real-time DETR, COCO-91) running entirely on one Tenstorrent Blackhole p150a via tt-nn: image in, labelled boxes out. Weights: Roboflow/rf-detr-base · Paper: arXiv:2511.09554 · Upstream code: roboflow/rf-detr · Port: changh95/tt-RF-DETR

Runs on p150 (mesh P150).

Packaged and published with tt-model-manager 0.1.0 (manifest schema 5.1).

Quickstart

tt-model pull  changh95/rf-detr-p150 --with-weights
tt-model serve changh95/rf-detr-p150

• Weights Roboflow/rf-detr-base at 7b95b089788e go to your HF cache; the image does not contain them.
• Serves on port 20000 (or the next free port); ready when the log says Application startup complete.

Run with tt-cli

tt serve changh95/rf-detr-p150
printf '{"image":"%s"}' "$(base64 -w0 media/demo_source.png)" > req.json
curl -s localhost:20000/predict -H 'Content-Type: application/json' -d @req.json
tt model stop changh95/rf-detr-p150

• POST /predict: image (base64 PNG/JPEG); optional threshold (0.5), max_detections (100).
• GET /health, GET /info.

Response

{"detections": [
   {"label": "cat",    "label_id": 17, "score": 0.960, "box": [7.5, 54.4, 317.5, 470.6]},
   {"label": "remote", "label_id": 75, "score": 0.903, "box": [40.9, 72.7, 176.6, 117.7]}],
 "num_detections": 5, "image_size": {"width": 640, "height": 480}, "input_size": [560, 560],
 "timing_ms": {"preprocess": 2.7, "inference": 43.4, "postprocess": 0.4, "total": 69.4}}

• box is [x1, y1, x2, y2] in original image pixels; detections are sorted by score.

Demo

Input (media/demo_source.png)	Detections on p150a (media/demo_detections.png)

Accuracy and speed

Metric	Value
Detection-IoU agreement vs fp32 reference (demo image)	98.67 (2 cat + 2 remote, per-object IoU 0.96–0.99)
Backbone feature-map PCC vs torch	0.998–0.9998
Inference, served over HTTP (warm, batch 1, 560×560)	41 ms device · ~50 ms end-to-end (20 FPS)

Caveats

• Every image is squashed to 560×560; one image per request, batch 1.
• bf16 on device: scores differ slightly from the fp32 reference (see the IoU figure above).
• Not an OpenAI-compatible API; GET /v1/models is a stub so the tt-model ready card does not 404.
• Validated on tt-metal v0.78.0-dev20260820 (main 8b98410e730), single p150a only.

Licensing

• Weights: Roboflow/rf-detr-base, Apache-2.0.
• Port and serving code (code/): Apache-2.0, from changh95/tt-RF-DETR.

Provenance

The exact sources the image was built from — code/ in this repo is byte-identical to the model code inside the image:

component	built from
tt-metal	8b98410e730bb504fea43a88609756e34821d91d
code/ digest	7eda8ae5eb35aa1e (sha256, first 16 hex digits)
built	2026-09-12T13:09:10+00:00 by tt-model 0.1.0