Bayesian Neural Networks exhibit robustness to adversarial attacks due to the vanishing expected orthogonal gradient, providing protection against gradient-based attacks.
