Target Confusion in End-to-end Speaker Extraction: Analysis and Approaches
| العنوان: | Target Confusion in End-to-end Speaker Extraction: Analysis and Approaches |
|---|---|
| المؤلفون: | Zhao, Zifeng, Yang, Dongchao, Gu, Rongzhi, Zhang, Haoran, Zou, Yuexian |
| المصدر: | Interspeech 2022. |
| بيانات النشر: | ISCA, 2022. |
| سنة النشر: | 2022 |
| مصطلحات موضوعية: | FOS: Computer and information sciences, Sound (cs.SD), Audio and Speech Processing (eess.AS), FOS: Electrical engineering, electronic engineering, information engineering, Computer Science - Sound, Electrical Engineering and Systems Science - Audio and Speech Processing |
| الوصف: | Recently, end-to-end speaker extraction has attracted increasing attention and shown promising results. However, its performance is often inferior to that of a blind source separation (BSS) counterpart with a similar network architecture, due to the auxiliary speaker encoder may sometimes generate ambiguous speaker embeddings. Such ambiguous guidance information may confuse the separation network and hence lead to wrong extraction results, which deteriorates the overall performance. We refer to this as the target confusion problem. In this paper, we conduct an analysis of such an issue and solve it in two stages. In the training phase, we propose to integrate metric learning methods to improve the distinguishability of embeddings produced by the speaker encoder. While for inference, a novel post-filtering strategy is designed to revise the wrong results. Specifically, we first identify these confusion samples by measuring the similarities between output estimates and enrollment utterances, after which the true target sources are recovered by a subtraction operation. Experiments show that performance improvement of more than 1dB SI-SDRi can be brought, which validates the effectiveness of our methods and emphasizes the impact of the target confusion problem. Comment: 5 pages, 1 table, 5 figures. Submitted to INTERSPEECH 2022 |
| الوصول الحر: | https://explore.openaire.eu/search/publication?articleId=doi_dedup___::3357efebe874b8adb3f3283ac7293806Test https://doi.org/10.21437/interspeech.2022-176Test |
| حقوق: | OPEN |
| رقم الانضمام: | edsair.doi.dedup.....3357efebe874b8adb3f3283ac7293806 |
| قاعدة البيانات: | OpenAIRE |
| الوصف غير متاح. |