Benchmark route · under review

Results

Five methods, four routes, one protocol. No method is told how many regions an image contains.

Table 1 — mIoU and ARI

Autonomous texture partitioning across four benchmarks. Every method receives the same instruction and is told nothing about how many regions the image contains. No mask is completed by taking a complement, no proposal set is truncated to a known count, and images for which a method emits no mask are scored as zeros rather than dropped. Since the region count is withheld from every method, these numbers are not comparable to evaluations that supply it.
RouteMetric LISAGSVAGLaMMSa2VA Detecture
RWTDmIoU0.75410.37060.62250.54520.7843
ARI0.44130.43950.44990.45690.5993
RWTD-COCOmIoU0.68370.40990.60140.26170.8460
ARI0.33640.50010.42220.23620.7351
TextureADEmIoU0.57520.20100.38400.30920.7222
ARI0.38690.24020.18510.19700.6863
CSTDmIoU0.83940.65780.75770.75100.8642
ARI0.62080.76560.61770.71550.7742

Table 2 — Region Covering and Boundary‑F

The co-primary partition metrics, same runs. Region Covering weights every ground-truth region by area whether or not a counterpart was proposed. Boundary‑F is computed on the dustbin-filled partition, so a method that emits a single region leaves no internal boundary and scores exactly zero.
RouteMetric LISAGSVAGLaMMSa2VA Detecture
RWTDCov.0.54190.42300.42010.39870.7946
B-F0.00000.11790.00000.10250.4252
RWTD-COCOCov.0.48170.42470.35580.23980.8536
B-F0.00000.15750.00000.10360.4226
TextureADECov.0.31550.20920.16740.17930.7479
B-F0.00000.17950.00000.05160.5038
CSTDCov.0.50940.71450.48440.59580.8835
B-F0.00000.39760.00000.28710.6499

Predicted region count on CSTD

Ground truth is exactly 2 on every image, marked on each bar.

Detecture 2.00
GSVA-7B 4.82
Sa2VA-4B 1.43
LISA-7B 0.99
GLaMM 0.87
05 regions

GSVA is the one baseline that always returns a partition; it simply returns the wrong number of parts. Its high CSTD ARI (0.7656, close to Detecture's 0.7742) is the reward for that, since over-fragmentation still agrees with the ground truth on most pixel pairs.

Two caveats stated plainly

These are 256 hand-verified images, not CSTD as published

CSTD's released region maps are the stitching masks fed into the generator, not annotations of what came out. Where the generator invented a third material or drifted from the mask, the ground truth silently stops being true. All 10,000 images were screened and ranked, 1,296 candidates were reviewed by eye, and 274 passed — an acceptance rate of 21%. The top 256 are what these numbers are computed on. Anyone rerunning CSTD off the shelf will get different numbers.

CSTD is synthetic

It enters only as an exactly-two-region control, not as evidence about real scenes. The real-world evidence is RWTD, RWTD-COCO and TextureADE.

Protocol

One protocol, unchanged across all five methods and all four routes: no ground-truth region count in the prompt, no inverse-mask completion, no truncation of proposals to a known K, and no dropping of images where a method returns nothing. Each baseline runs under its own pinned environment, the same ones that reproduce the RWTD, RWTD-COCO and TextureADE numbers.