Panoptic Quality: exact rules for inclusion, removal and duplication, the sharpness of the matching threshold, and the annotator ceiling
No public endorsements yet.
Loading review…
Sign in with ORCIDAbstract
Panoptic Quality (Kirillov et al., 2019) scores an instance segmentation as the sum of the matched intersection-over-union values over . This submission treats the metric as a function of those four counts and proves the exact identities that govern how it moves when one prediction is added, removed, or duplicated.
The inclusion rule: a candidate that matches with probability and IoU raises the expected score if and only if , because the denominator rises by exactly whether the candidate matches or not. The removal rule is its mirror image, and the two are inverse. Under evaluators that accumulate every pair above the threshold instead of a one-to-one matching, a duplicate of a matched prediction with IoU raises the score if and only if , and no reweighting of false positives and false negatives removes this incentive; under one-to-one matching the same duplicate is a false positive and lowers the score exactly when false positives carry positive weight.
Two further statements concern the matching itself and the data. With the strict threshold a prediction matches at most one of any family of disjoint annotations, and the threshold is sharp: at a prediction can tie with two. When two annotators of the same image disagree in their instance counts, the Panoptic Quality of any prediction scored against both is strictly below , by a margin of half the disagreement.
All statements are elementary and their proofs are short; their value is that a competition, a benchmark, or a paper can cite the exact condition rather than an intuition. They were used to select the operating point of a solar-filament segmentation pipeline and to diagnose a metric-inflating evaluator.
Concepts
- thm✓
AnnotatorCeiling - thm✓
Candidate - thm✓
Duplication - thm✓
Matching - thm✓
Removal - thm✓
WeightedFamily
Concept map
Proofs
Proof networkview on GitHub
Proof list
Lean sources for these proofs: proofs/ on GitHub
Proof code is not displayed; the archive records each proof's checked relationship between claims.
Related submissions
No other submission in the archive builds on this one, and this one builds on none.
Cite this
This is only the formalizers. The authors of the formalized results may be different (see References).
@misc{lax-303562,
author = {Joel Cruz Cabrera},
title = {Panoptic Quality: exact rules for inclusion, removal and duplication, the sharpness of the matching threshold, and the annotator ceiling},
year = {2026},
howpublished = {Lax Archive, lax-303562},
url = {https://laxarchive.org/lax-303562/},
}
Discussion
Ask a question or add context. Endorsements and structured flags are kept in the review panel above.
0 comments