Benchmark route

Head to head

The five images where Detecture beats every baseline by the widest margin, and the five where it loses by the widest margin, with all five partitions side by side.

Ranking is by Region Covering against the best-performing baseline on each image, not by Detecture's own score. Region Covering is used rather than mIoU because it weights every ground-truth region by area whether or not a counterpart was proposed, so a method that returns one mask cannot place well by covering half the image. Numbers under each panel are that model's Region Covering on that image; the leader is highlighted.

Region colours are per-panel indices. Red in one panel and red in the next need not be the same surface, so read the shape of the division rather than the colour pairing.

Where Detecture wins by the most

The pattern is identical across all five. LISA and Sa2VA return a single mask every time, GLaMM returns one mask or none at all, and GSVA returns five regions where the truth is two. The margin comes from returning a usable partition at all, not from a more precise boundary.

006879 Region Covering vs best baseline +0.5046
inputground truthDetectureLISA-7BGSVA-7BGLaMMSa2VA-4B
CSTD 006879: input, ground truth, and each model's partition
..0.9770.4720.4630.0000.473
001228 Region Covering vs best baseline +0.5018
inputground truthDetectureLISA-7BGSVA-7BGLaMMSa2VA-4B
CSTD 001228: input, ground truth, and each model's partition
..0.8900.3800.3550.3880.286
009471 Region Covering vs best baseline +0.4942
inputground truthDetectureLISA-7BGSVA-7BGLaMMSa2VA-4B
CSTD 009471: input, ground truth, and each model's partition
..0.9670.4730.4570.3590.359
000702 Region Covering vs best baseline +0.4847
inputground truthDetectureLISA-7BGSVA-7BGLaMMSa2VA-4B
CSTD 000702: input, ground truth, and each model's partition
..0.9810.4960.4950.0000.377
007850 Region Covering vs best baseline +0.4796
inputground truthDetectureLISA-7BGSVA-7BGLaMMSa2VA-4B
CSTD 007850: input, ground truth, and each model's partition
..0.9720.4750.4790.0000.492

Where Detecture loses by the most

These are genuine losses, shown unedited. GSVA takes four of them and Sa2VA the fifth. Detecture returns exactly two regions on all ten images on this page, these included, so what fails here is boundary placement rather than region count: it divides the image in the wrong place. The wins split two ways. On 007625 and 004167 the baseline simply gets it right with two regions. On the other three GSVA wins with five, where scattering the image into fragments happens to cover the ground truth better than a confidently misplaced two-region split — the mirror image of the over-segmentation that costs GSVA the aggregate score.

007625 Region Covering vs best baseline -0.5290
inputground truthDetectureLISA-7BGSVA-7BGLaMMSa2VA-4B
CSTD 007625: input, ground truth, and each model's partition
..0.4270.6700.9560.0000.323
007911 Region Covering vs best baseline -0.5117
inputground truthDetectureLISA-7BGSVA-7BGLaMMSa2VA-4B
CSTD 007911: input, ground truth, and each model's partition
..0.4540.5180.9660.4530.475
005014 Region Covering vs best baseline -0.5064
inputground truthDetectureLISA-7BGSVA-7BGLaMMSa2VA-4B
CSTD 005014: input, ground truth, and each model's partition
..0.4790.4750.9860.4960.494
007216 Region Covering vs best baseline -0.4973
inputground truthDetectureLISA-7BGSVA-7BGLaMMSa2VA-4B
CSTD 007216: input, ground truth, and each model's partition
..0.4620.5680.9590.0000.667
004167 Region Covering vs best baseline -0.4793
inputground truthDetectureLISA-7BGSVA-7BGLaMMSa2VA-4B
CSTD 004167: input, ground truth, and each model's partition
..0.4970.5240.4270.5100.977