Duplicating a matched prediction under all-pairs accumulation
Lax303562.Duplication · concepts/Lax303562/Duplication.lean · lax-303562
No public endorsements yet.
Loading review…
Sign in with ORCIDNatural Language Statement
Theorem
Some evaluators accumulate every (prediction, annotation) pair whose IoU clears the threshold, rather than a one-to-one matching. Under that rule a second copy of an already matched prediction, with IoU against the same annotation, adds to the numerator and one true positive to the denominator, and creates no false positive.
The first statement says exactly when this raises the score: if and only if exceeds the current Panoptic Quality. The second says that under one-to-one matching the same copy cannot match (its annotation is taken), counts as a false positive, and strictly lowers the score whenever there is anything to lose. The third puts the two together: the same submission moves the metric in opposite directions depending on the counting rule.
Hypotheses: says that there is at least one prediction or annotation, so the quotient is not the empty case.
Concept map
Evidence
Lean source view on GitHub
| 1 | import Lax303562.PanopticQuality |
| 2 | |
| 3 | /-! |
| 4 | --- |
| 5 | title: Duplicating a matched prediction under all-pairs accumulation |
| 6 | type: theorem |
| 7 | --- |
| 8 | Some evaluators accumulate *every* (prediction, annotation) pair whose IoU clears |
| 9 | the threshold, rather than a one-to-one matching. Under that rule a second copy |
| 10 | of an already matched prediction, with IoU `v` against the same annotation, adds |
| 11 | `v` to the numerator and one true positive to the denominator, and creates no |
| 12 | false positive. |
| 13 | |
| 14 | The first statement says exactly when this raises the score: if and only if `v` |
| 15 | exceeds the current Panoptic Quality. The second says that under one-to-one |
| 16 | matching the same copy cannot match (its annotation is taken), counts as a false |
| 17 | positive, and strictly lowers the score whenever there is anything to lose. The |
| 18 | third puts the two together: the same submission moves the metric in opposite |
| 19 | directions depending on the counting rule. |
| 20 | |
| 21 | Hypotheses: `0 < den n fp fn` says that there is at least one prediction or |
| 22 | annotation, so the quotient is not the empty case. |
| 23 | -/ |
| 24 | |
| 25 | namespace Lax303562.Duplication |
| 26 | |
| 27 | open Lax303562.PanopticQuality |
| 28 | |
| 29 | /-- Under all-pairs accumulation, a duplicate with IoU `v` of an already matched |
| 30 | prediction raises the Panoptic Quality exactly when `v` is larger than the |
| 31 | current Panoptic Quality. -/ |
| 32 | axiom dup_iff (s v : ℝ) (n fp fn : ℕ) (hd : 0 < den n fp fn) : |
| 33 | pq s n fp fn < pq (s + v) (n + 1) fp fn ↔ pq s n fp fn < v |
| 34 | |
| 35 | /-- Under one-to-one matching the duplicate is a false positive, and any false |
| 36 | positive strictly lowers a positive score. -/ |
| 37 | axiom falsePositive_lt (s : ℝ) (n fp fn : ℕ) (hs : 0 < s) (hd : 0 < den n fp fn) : |
| 38 | pq s n (fp + 1) fn < pq s n fp fn |
| 39 | |
| 40 | /-- A duplicate better than the current score raises the metric under all-pairs |
| 41 | accumulation and lowers it under one-to-one matching. -/ |
| 42 | axiom opposite_directions (s v : ℝ) (n fp fn : ℕ) (hs : 0 < s) (hd : 0 < den n fp fn) |
| 43 | (hv : pq s n fp fn < v) : |
| 44 | pq s n fp fn < pq (s + v) (n + 1) fp fn ∧ pq s n (fp + 1) fn < pq s n fp fn |
| 45 | |
| 46 | end Lax303562.Duplication |
| 47 |
Discussion
Ask a question or add context. Endorsements and structured flags are kept in the review panel above.
0 comments