מושגי ליבה
SIREN is a flexible, extensible, and customizable web-based interface that enables users to create aesthetic sonifications through a wide range of sound synthesis techniques.
תקציר
The paper introduces SIREN, a web-based sonification interface that aims to balance accessibility and customizability. SIREN is designed as a digital audio workstation for sonification, allowing users to create their own synthesizers using JavaScript modules that leverage the Web Audio API.
The key highlights of the paper include:
-
Overview of SIREN's design, architecture, and workflow:
- SIREN's interface is inspired by digital audio workstations, with tracks, regions, and parameter-mapped synthesizers.
- SIREN uses modern web technologies like SvelteKit and TypeScript.
- The workflow involves importing datasets, adding synthesizers, creating tracks and regions, and applying data mappings.
-
SIREN's sound synthesis paradigm:
- SIREN accepts JavaScript modules as input for synthesizers, following a defined structure.
- The structure includes parameters (timbral and temporal), update functions, and start/stop functions.
- Three working examples are provided: Frequency Modulation Synthesis, Formant Synthesis, and Granular Synthesis.
-
Future work and potential improvements:
- Integrating more sound synthesis techniques, such as by compiling the Synthesis ToolKit (STK) to WebAssembly.
- Exploring other web audio standards like WebAssembly Modules and WebAudio Modules.
- Creating an open-source repository for community-contributed synthesizers.
Overall, the paper demonstrates SIREN's capabilities as a flexible and extensible web-based sonification tool, empowering users to create a wide range of aesthetic sonifications.