Evaluating Acoustic Awareness in Speech Language Models: A Comprehensive Benchmark Suite

SALMON, a novel evaluation suite, comprehensively assesses speech language models' ability to capture various acoustic aspects, including background noise, emotion, speaker identity, and room acoustics, going beyond just the spoken content.