Aerial results expose the remaining data gap
Recognition (SAR-only top-1 accuracy). After fused accuracy reached 89.6% in 2023, we introduced geographically disjoint evaluation in 2024. SAR-only accuracy on unseen ground was 37.9%. The split regimes pose different tasks; these rows are not a like-for-like trend.
| Edition | Split | SAR | SAR+EO |
|---|---|---|---|
| PBVS 2022 | random | 36.4 | 51.1 |
| PBVS 2023 | random | 63.2 | 89.6 |
| PBVS 2024 | geographic | 37.9 | — |
0.08
SAR→EO composite error, same collection
0.55
SAR→RGB composite error, cross collection, every top team
Winning methods converged on one architecture family; cross-collection scores clustered within hundredths. Our discrete-token translation method leads both cross-collection directions but cannot escape the band.
More: the four translation directions, input / ground truth / winning entryfigure
