Detecting and Mitigating System-Level Failures of Vision-Based Controllers in Autonomous Systems

A reachability-based framework is used to automatically mine system-level failures of a vision-based controller, which are then used to train an anomaly detector that can identify inputs likely to cause system breakdowns. A fallback controller is designed to preserve system safety when anomalies are detected.