Miril-Drone-2B-1-bnb8

8-bit CUDA deployment variant of Miril-Drone-2B-1

Drones can talk, and this is the lower-memory CUDA path.

This repository packages the 8-bit bitsandbytes variant of Miril-Drone-2B-1, a 2B-class aerial VLM for drone-view imagery.

Use the primary model card for behavior, prompting, schemas, examples, WALDO vocabulary, limitations, and safety notes:

https://huggingface.co/MirilAI/Miril-Drone-2B-1

The V1 prompt contract is the same as the main model: caption_v1, simple_answer_v1, and operational_coordinate_v2. V1 operational coordinates are rough representative grid cues for review, not flight-control commands. V2 is coming soon with finer pointing behavior.

Interactive demo:

https://huggingface.co/spaces/MirilAI/Miril-Drone-2B-1-Demo

Use

python eval_generate.py \
  --model_id MirilAI/Miril-Drone-2B-1-bnb8 \
  --processor_id MirilAI/Miril-Drone-2B-1-bnb8 \
  --jsonl eval.jsonl \
  --image_root images \
  --out_jsonl predictions.jsonl \
  --batch_size 1 \
  --max_new_tokens 256

Recommended starting point: CUDA GPU with roughly 10-13 GB free VRAM for single-image inference. Leave extra room for larger images, longer generations, batching, or server overhead.

License

Apache License 2.0. See LICENSE and NOTICE.

Downloads last month
12
Safetensors
Model size
5B params
Tensor type
F32
·
BF16
·
I8
·
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for MirilAI/Miril-Drone-2B-1-bnb8

Quantized
(5)
this model