Core Concepts
Consequential robot sounds can be captured, processed, and utilized as a creative material to explore new forms of human-robot interaction.
Abstract
The paper presents a novel approach called "Robotic Blended Sonification" that aims to capture, modify, and utilize the sounds that robots inherently produce through their mechanical configurations, rather than masking or replacing them.
The key contributions are:
A technique for real-time capture and processing of consequential robot sounds using electromagnetic field microphones placed on the robot.
An approach to explore these sounds through direct human-robot interaction, enabled by integrating the robot's positional data with a digital audio workstation.
This allows for the exploration of consequential robot sounds as a creative material, bridging prior research on sound design, movement sonification, and sound responsive to human actions. The authors outline several directions for future research, including:
Investigating ways to use consequential robot sounds as a creative material in explorations of robot sound design.
Exploring different approaches to processing the captured consequential sound material.
Engaging people in reflection on consequential robot sounds through direct interaction.
The proposed approach enables performance with robotic sound, allowing for creative exploration of how those sounds can be utilized to enhance human-robot collaborations.