แนวคิดหลัก
Causal inference with modality-specific uncertainty is essential to accurately capture the nonlinearity and idiosyncratic asymmetry of audiovisual temporal recalibration.
บทคัดย่อ
The study examines the mechanism of audiovisual temporal recalibration through the lens of causal inference, considering the brain's capacity to determine whether multimodal signals come from a common source and should be integrated, or else kept separate.
Key highlights:
- In a three-phase recalibration paradigm, the authors manipulated the adapter stimulus-onset asynchrony (SOA) in the exposure phase across nine sessions, introducing asynchronies up to 0.7 s of either auditory or visual lead.
- The results confirmed the nonlinearity as well as idiosyncratic asymmetry of the recalibration effect.
- The authors fitted four models to the data, using either causal inference or a fixed update, combined with either modality-specific or modality-independent uncertainty.
- Model comparison revealed that causal inference combined with modality-specific uncertainty is essential to accurately capture the nonlinearity and idiosyncratic asymmetry of temporal recalibration.
- The findings suggest that cross-modal temporal recalibration, typically considered an early-stage, low-level perceptual process, involves higher cognitive functions in the adjustment of perception.
สถิติ
The amount of audiovisual temporal recalibration first increased but then plateaued with increasing magnitude of the adapter SOA presented during the exposure phase.
All participants showed audiovisual asymmetry in temporal recalibration, with the majority showing larger recalibration effects in response to auditory-than visual-lead asynchrony.
คำพูด
"The classic compensatory view is that recalibration serves to offset the physical and neural latency differences between modalities (Fujisaki et al., 2004), aiming for external accuracy, the agreement between perception and the environment (Zaidel et al., 2011)."
"Notably, the fixed-update model overlooks the causal relationship between multimodal stimuli by implicitly assuming that they originate from a single source. However, that's not always the case in a multimodal environment."