IMC2025

Original

Overall Results

mAA@1: 62.27%
mAA@3: 67.04%
mAA@5: 68.35%
mAA@10: 69.28%
mAA@15: 69.60%
mAA@30: 69.96%
AUC@3: 62.62%
AUC@10: 66.81%
AUC@30: 68.76%

Total pairs: 175767
Correct same scene: 40438
Correct diff scene: 78367
Wrong (merged different scenes): 402
Wrong (split same scene): 35949
Outlier correct (not registered): 11928
Outlier wrong (registered): 8683

New

Overall Results

mAA@1: 62.10%
mAA@3: 66.80%
mAA@5: 68.09%
mAA@10: 69.02%
mAA@15: 69.33%
mAA@30: 69.67%
AUC@3: 62.45%
AUC@10: 66.58%
AUC@30: 68.49%

Total pairs: 175767
Correct same scene: 39579
Correct diff scene: 78367
Wrong (merged different scenes): 402
Wrong (split same scene): 36808
Outlier correct (not registered): 11928
Outlier wrong (registered): 8683

ETH3D

Original

All (25 scenes):

mAA@1: 85.79%
mAA@3: 87.30%
mAA@5: 87.55%
mAA@10: 87.61%
mAA@15: 87.62%
mAA@30: 87.62%
AUC@1: 74.80%
AUC@3: 82.90%
AUC@10: 86.14%
AUC@30: 86.97%
Total pairs: 22569
Total components: 25
Total images: 883/898 (registered/GT)
Same component pairs: 22021
Diff component pairs: 0
Not registered pairs: 548
Large error (>30°) in same cluster: 5372
Avg mean error: 20.93

New

All (25 scenes):

mAA@1: 85.22%
mAA@3: 86.68%
mAA@5: 86.92%
mAA@10: 86.94%
mAA@15: 86.96%
mAA@30: 86.96%
AUC@1: 74.41%
AUC@3: 82.36%
AUC@10: 85.53%
AUC@30: 86.32%
Total pairs: 22569
Total components: 26
Total images: 881/898 (registered/GT)
Same component pairs: 19073
Diff component pairs: 2900
Not registered pairs: 596
Large error (>30°) in same cluster: 2472
Avg mean error: 22.13