NAVSIM v2.2 release

Official devkit version for AGC 2025.

• Release of private_test_hard dataset (see splits) for the HuggingFace NAVSIM v2 End-to-End Driving Challenge 2025 Leaderboard.
  • The submission deadline is 2025-05-11 00:00:00 UTC
  • You are limited to one upload per day on the challenge leaderboard, which should take approximately 2 hours to evaluate after a succesful submission.
• Fixed bug in openscene_meta_datas for navhard and warmup
  • ⚠️ IMPORTANT: If you used navhard_two_stage/openscene_meta_datas or warmup_two_stage/openscene_meta_datas to evaluate your model, please re-download and use the new data.

NAVSIM v2.1.2 release

• Release of navhard_two_stage dataset (see splits)
• Updated Extended Predictive Driver Model Score (EPDMS) for the Hugging Face Warmup leaderboard. See see metrics for details regarding the implementation.

NAVSIM v2.1.1 release

• Updated dataset for the warmup leaderboard with minor fixes

NAVSIM v2.1 release

• Added new dataset for the Hugging Face Warmup leaderboard (see submission)
• Introduced support for two-stage reactive traffic agents (see traffic simulation)

NAVSIM v2.0 release

Official devkit version for the 2025 warm-up phase:

• Extends the PDM Score with more metrics and penalties (see metrics)
• Adds a new two-stage pseudo closed-loop simulation (see metrics)
• Adds support for reactive traffic agent policies (see traffic simulation)

NAVSIM v1.1 release

• Leaderboard for navtest on Hugging Face
• Release of baseline checkpoints on Hugging Face
• Updated docs for submission and paper
• Code refactoring, formatting, minor fixes

NAVSIM v1.0 release

• Official devkit version for AGC 2024
• Parallelization of metric caching / evaluation
• Adds Transfuser baseline (see agents)
• Adds standardized training and test filtered splits (see splits)
• Visualization tools (see tutorial_visualization.ipynb)

NAVSIM v0.4 release

• Support for test phase frames of competition
• Download script for trainval
• Egostatus MLP Agent and training pipeline

NAVSIM v0.3 release

• Adds code for Leaderboard submission

NAVSIM v0.2 release

• Easier installation and download
• mini and test data split integration
• Privileged Human agent