YAML Metadata Warning:empty or missing yaml metadata in repo card
Check out the documentation for more information.
ours-probe — COCO — Shikra-7B
Probe ours trained on Shikra-7B COCO detection records (10,000 train2014 images, 8,000 train / 2,000 holdout, captions Please describe this image in detail., 256 new tokens). Seeds 0, 42, 1337; checkpoint by validation_pooled_AUROC; threshold = validation best F1 per seed (metadata/thresholds.json).
Holdout test (three-seed mean ± SD, %): {"auroc": {"mean": 95.82, "sd": 0.1}, "auprc": {"mean": 83.51, "sd": 0.23}, "accuracy": {"mean": 91.41, "sd": 0.11}, "f1": {"mean": 77.36, "sd": 0.32}}
Full package, records and results: dataset ToiTenBao/hallucination-evaluation-results, detection/coco/models/shikra_7b/probes/ours/.
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support