KunquDB: A Comprehensive Audio-Visual Dataset for Chinese Opera Research

Główne pojęcia

Promoting Chinese opera research with KunquDB, a large-scale dataset for ASV and role-centric studies.

Streszczenie

1. Introduction:

• Chinese opera recognized as World Intangible Cultural Heritage.
• Unique blend of song, speech, mime, dance, and acrobatics.
• Speech research in opera offers experimental ground for acoustic exploration.

2. Data Limitations:

• Existing opera datasets lack scale and annotation richness.
• Scarcity of detailed annotations hinders research tasks.
• Automated tools absence impedes data collection and cleaning.

3. KunquDB Creation:

• Originates from Kunqu Opera Art Canon.
• Detailed annotations include character names, speaker labels, vocal manner classifications.
• Dataset structure facilitates various research tasks in speech-related studies.

4. Speaker Verification:

• Investigating ASV within Kunqu Opera context.
• Domain adaptation methods mitigate cross-domain challenges induced by vocal manner variations.

5. Related Works:

• Limited open-source datasets for Chinese opera genre classification.
• Lack of automated tools hampers data collection and cleaning processes.

Statystyki

この研究は、128時間のコンテンツと339人のスピーカーからなるKunquDBデータセットを紹介しています。

Cytaty

"Chinese opera is a confluence of song, speech, mime, dance, and acrobatics."
"KunquDB provides a versatile foundation for role-centric acoustic studies."

Kluczowe wnioski z

KunquDB

by Huali Zhou,Y... o arxiv.org 03-21-2024

https://arxiv.org/pdf/2403.13356.pdf

Głębsze pytania

Chinese opera has gained worldwide recognition as an intangible cultural heritage. How does the use of technology like KunquDB impact the preservation and evolution of this art form?

技術の利用は、中国の伝統的な歌劇である中国オペラの保存と進化に重要な影響を与えます。KunquDBのようなデータベースやテクノロジーは、豊富な情報とリソースを提供することで、中国オペラ研究へのアクセスを容易にし、この芸術形式を新たな視点から探求する機会を提供します。データベースが収集した音声や映像データは、演奏者や役割ごとに詳細に注釈付けされており、これらの情報は伝統的な手法だけでは不可能だった多角的な分析や研究を促進します。さらに、自動化されたツールや深層学習アルゴリズムが導入されることで、中国オペラの特徴や複雑性を理解しやすくし、現代技術と芸術形式との間に架け橋を築きます。

How can advancements in ASV within Chinese opera contribute to broader applications beyond the realm of traditional performing arts

How might the reliance on manual data pipelines affect the scalability and accessibility of research in Chinese opera compared to other genres?
Answer 2 here

How can advancements in ASV within Chinese opera contribute to broader applications beyond the realm of traditional performing arts?
Answer 3 here