Causal inference with modality-specific uncertainty is essential to accurately capture the nonlinearity and idiosyncratic asymmetry of audiovisual temporal recalibration.