YAML Metadata Warning:empty or missing yaml metadata in repo card
Check out the documentation for more information.
haloprobe — COCO — Shikra-7B
Probe halo_paper_v2 trained on Shikra-7B COCO detection records (10,000 train2014 images, 8,000 train / 2,000 holdout, captions Please describe this image in detail., 256 new tokens). Seeds 0, 42, 1337; checkpoint by validation_pooled_AUROC; threshold = validation best F1 per seed (metadata/thresholds.json).
Holdout test (three-seed mean ± SD, %): {"auroc": {"mean": 93.32, "sd": 0.17}, "auprc": {"mean": 75.87, "sd": 0.53}, "accuracy": {"mean": 88.75, "sd": 0.11}, "f1": {"mean": 70.93, "sd": 0.54}}
Full package, records and results: dataset ToiTenBao/hallucination-evaluation-results, detection/coco/models/shikra_7b/probes/halo_paper_v2/.