NeuroNCAP: Photorealistic Closed-loop Simulation for Evaluating the Safety of Autonomous Driving Models

The core message of this work is that current state-of-the-art end-to-end autonomous driving models exhibit critical flaws when navigating safety-critical scenarios in a closed-loop setting, despite performing well in nominal open-loop driving. This highlights the need for advancements in the safety and real-world usability of these models.