VIOVIO Survey BenchmarkGitHub Pages reproducible benchmark

TBD-safe dashboard

Results dashboard

The dashboard is real even before public numbers are validated: every row has a system, dataset, sequence, mode, metric schema, status, and artifact path. Numeric values remain TBD until EPA and resource outputs exist.

50Result rows

System-dataset schema rows

0Numeric rows

Validated public metrics

50TBD rows

Visible but not averaged

10Systems

Final public set only

5Datasets

Benchmark target domains

Public table

Result rows with explicit missing values

The table does not hide missing data or fabricate placeholder numbers. TBD entries are excluded from averages.

Benchmark result table

SystemDatasetSequenceModeATERPEDriftRuntimeCPU / MemoryStatusArtifact
OpenVINSEuRoC MAVV1_01_easymono_imuTBDTBDTBDTBDTBDTBDresults/openvins/euroc_mav/summary.csv
OpenVINSUZH-FPVTBDmono_imuTBDTBDTBDTBDTBDTBDresults/openvins/uzh_fpv/summary.csv
OpenVINSLaMAriaTBDmono_imuTBDTBDTBDTBDTBDTBDresults/openvins/lamaria/summary.csv
OpenVINSGrandTourTBDmono_imuTBDTBDTBDTBDTBDTBDresults/openvins/grandtour/summary.csv
OpenVINSAqualocTBDmono_imuTBDTBDTBDTBDTBDTBDresults/openvins/aqualoc/summary.csv
sqrtVINSEuRoC MAVV1_01_easymono_imuTBDTBDTBDTBDTBDTBDresults/sqrtvins/euroc_mav/summary.csv
sqrtVINSUZH-FPVTBDmono_imuTBDTBDTBDTBDTBDTBDresults/sqrtvins/uzh_fpv/summary.csv
sqrtVINSLaMAriaTBDmono_imuTBDTBDTBDTBDTBDTBDresults/sqrtvins/lamaria/summary.csv
sqrtVINSGrandTourTBDmono_imuTBDTBDTBDTBDTBDTBDresults/sqrtvins/grandtour/summary.csv
sqrtVINSAqualocTBDmono_imuTBDTBDTBDTBDTBDTBDresults/sqrtvins/aqualoc/summary.csv
VINS-FusionEuRoC MAVV1_01_easymono_imuTBDTBDTBDTBDTBDTBDresults/vins_fusion/euroc_mav/summary.csv
VINS-FusionUZH-FPVTBDmono_imuTBDTBDTBDTBDTBDTBDresults/vins_fusion/uzh_fpv/summary.csv
VINS-FusionLaMAriaTBDmono_imuTBDTBDTBDTBDTBDTBDresults/vins_fusion/lamaria/summary.csv
VINS-FusionGrandTourTBDmono_imuTBDTBDTBDTBDTBDTBDresults/vins_fusion/grandtour/summary.csv
VINS-FusionAqualocTBDmono_imuTBDTBDTBDTBDTBDTBDresults/vins_fusion/aqualoc/summary.csv
SVO ProEuRoC MAVV1_01_easymono_imuTBDTBDTBDTBDTBDTBDresults/svo_pro/euroc_mav/summary.csv
SVO ProUZH-FPVTBDmono_imuTBDTBDTBDTBDTBDTBDresults/svo_pro/uzh_fpv/summary.csv
SVO ProLaMAriaTBDmono_imuTBDTBDTBDTBDTBDTBDresults/svo_pro/lamaria/summary.csv
SVO ProGrandTourTBDmono_imuTBDTBDTBDTBDTBDTBDresults/svo_pro/grandtour/summary.csv
SVO ProAqualocTBDmono_imuTBDTBDTBDTBDTBDTBDresults/svo_pro/aqualoc/summary.csv
ROVIOEuRoC MAVV1_01_easymono_imuTBDTBDTBDTBDTBDTBDresults/rovio/euroc_mav/summary.csv
ROVIOUZH-FPVTBDmono_imuTBDTBDTBDTBDTBDTBDresults/rovio/uzh_fpv/summary.csv
ROVIOLaMAriaTBDmono_imuTBDTBDTBDTBDTBDTBDresults/rovio/lamaria/summary.csv
ROVIOGrandTourTBDmono_imuTBDTBDTBDTBDTBDTBDresults/rovio/grandtour/summary.csv
ROVIOAqualocTBDmono_imuTBDTBDTBDTBDTBDTBDresults/rovio/aqualoc/summary.csv
ORB-SLAM3EuRoC MAVV1_01_easymono_imuTBDTBDTBDTBDTBDTBDresults/orb_slam3/euroc_mav/summary.csv
ORB-SLAM3UZH-FPVTBDmono_imuTBDTBDTBDTBDTBDTBDresults/orb_slam3/uzh_fpv/summary.csv
ORB-SLAM3LaMAriaTBDmono_imuTBDTBDTBDTBDTBDTBDresults/orb_slam3/lamaria/summary.csv
ORB-SLAM3GrandTourTBDmono_imuTBDTBDTBDTBDTBDTBDresults/orb_slam3/grandtour/summary.csv
ORB-SLAM3AqualocTBDmono_imuTBDTBDTBDTBDTBDTBDresults/orb_slam3/aqualoc/summary.csv
Kimera-VIOEuRoC MAVV1_01_easystereo_imuTBDTBDTBDTBDTBDTBDresults/kimera_vio/euroc_mav/summary.csv
Kimera-VIOUZH-FPVTBDstereo_imuTBDTBDTBDTBDTBDTBDresults/kimera_vio/uzh_fpv/summary.csv
Kimera-VIOLaMAriaTBDstereo_imuTBDTBDTBDTBDTBDTBDresults/kimera_vio/lamaria/summary.csv
Kimera-VIOGrandTourTBDstereo_imuTBDTBDTBDTBDTBDTBDresults/kimera_vio/grandtour/summary.csv
Kimera-VIOAqualocTBDstereo_imuTBDTBDTBDTBDTBDTBDresults/kimera_vio/aqualoc/summary.csv
BASALTEuRoC MAVV1_01_easystereo_imuTBDTBDTBDTBDTBDTBDresults/basalt/euroc_mav/summary.csv
BASALTUZH-FPVTBDstereo_imuTBDTBDTBDTBDTBDTBDresults/basalt/uzh_fpv/summary.csv
BASALTLaMAriaTBDstereo_imuTBDTBDTBDTBDTBDTBDresults/basalt/lamaria/summary.csv
BASALTGrandTourTBDstereo_imuTBDTBDTBDTBDTBDTBDresults/basalt/grandtour/summary.csv
BASALTAqualocTBDstereo_imuTBDTBDTBDTBDTBDTBDresults/basalt/aqualoc/summary.csv
DM-VIOEuRoC MAVV1_01_easymono_imuTBDTBDTBDTBDTBDTBDresults/dm_vio/euroc_mav/summary.csv
DM-VIOUZH-FPVTBDmono_imuTBDTBDTBDTBDTBDTBDresults/dm_vio/uzh_fpv/summary.csv
DM-VIOLaMAriaTBDmono_imuTBDTBDTBDTBDTBDTBDresults/dm_vio/lamaria/summary.csv
DM-VIOGrandTourTBDmono_imuTBDTBDTBDTBDTBDTBDresults/dm_vio/grandtour/summary.csv
DM-VIOAqualocTBDmono_imuTBDTBDTBDTBDTBDTBDresults/dm_vio/aqualoc/summary.csv
OKVIS2 / OKVIS2-XEuRoC MAVV1_01_easystereo_imuTBDTBDTBDTBDTBDTBDresults/okvis2_x/euroc_mav/summary.csv
OKVIS2 / OKVIS2-XUZH-FPVTBDstereo_imuTBDTBDTBDTBDTBDTBDresults/okvis2_x/uzh_fpv/summary.csv
OKVIS2 / OKVIS2-XLaMAriaTBDstereo_imuTBDTBDTBDTBDTBDTBDresults/okvis2_x/lamaria/summary.csv
OKVIS2 / OKVIS2-XGrandTourTBDstereo_imuTBDTBDTBDTBDTBDTBDresults/okvis2_x/grandtour/summary.csv
OKVIS2 / OKVIS2-XAqualocTBDstereo_imuTBDTBDTBDTBDTBDTBDresults/okvis2_x/aqualoc/summary.csv

Aggregation rule: only validated numeric rows are averaged. TBD, N/A, Partial, and Unresolved rows remain visible but are not counted unless a metric-specific denominator is published.

Metric schema

What the dashboard will report

Metric definitions are part of the public dashboard, so later numeric results can be added without changing interpretation.

ATE

Absolute Trajectory Error

Full trajectory after configured EPA alignment

TBD until metrics.json or summary.csv exists
RPE

Relative Pose Error

Local drift over configured distance, time, or frame pairs

TBD unless pair policy is recorded
Drift

Distance Drift Rate

Translation RPE normalized by path-length segment

TBD when segment policy is not available
Success

Drift-valid Success Rate

Reference-path percentage satisfying the configured criterion

TBD unless EPA drift-valid output is present
Runtime

Runtime

Tracking, estimation, and total per-frame timing

TBD until timing CSV is recorded
Resource

CPU and Memory

Process-level resource monitor logs on a labeled platform

TBD until monitor log is recorded