Recovering Sensitive Information from Pretrained Speech Models through Noise Masking Attacks

Noise masking attacks can recover sensitive information from the pretraining data of speech models, even when the models were trained on audio-only data without access to transcripts.