Szczegóły publikacji

Opis bibliograficzny

End-to-end neural speaker diarization with an iterative refinement of non-autoregressive attention-based attractors / Magdalena RYBICKA, Jesús Villalba, Najim Dehak, Konrad KOWALCZYK // W: INTERSPEECH 2022 [Dokument elektroniczny] : September 18–22, Incheon, Korea. — Wersja do Windows. — Dane tekstowe. — [Seoul : The Acoustical Society of Korea], [2022]. — S. 5090–5094. — Wymagania systemowe: Adobe Reader. — Tryb dostępu: https://isca-speech.org/archive/pdfs/interspeech_2022/rybicka... [2022-09-03]. — Bibliogr. s. 5094, Abstr.

Autorzy (4)

Słowa kluczowe

self attentionattractor mechanismend-to-enditerative refinementclusteringspeaker diarization

Dane bibliometryczne

ID BaDAP141902
Data dodania do BaDAP2022-09-06
DOI10.21437/Interspeech.2022-10169
Rok publikacji2022
Typ publikacjimateriały konferencyjne (aut.)
Otwarty dostęptak
Creative Commons
KonferencjaInterspeech 2022

Abstract

End-to-end neural speaker diarization (EEND) systems are currently of high interest as the approach can easily handle overlapped speech and can be trained to optimize directly the diarization decision. Recently, there have been several investigations that achieve further enhancement of the EEND system, such as proposing various network structures for the encoder module or integration of the EEND with, the well-established in speaker embedding-based diarization, clustering methods. In this paper, we propose an alternative for the EEND backend and replace the LSTM-based attractor estimator with a non-autoregressive approach based on a Transformer decoder. Moreover, we introduce an iterative method that refines the system decision and the attractors in turns. Finally, we present results derived from an additional regularization of the proposed system with the use of Additive Angular Softmax speaker classification loss. We achieve up to 15% relative improvement over baseline on 2-speaker real recordings from CALLHOME dataset and up to 18% on simulated 2-speaker mixtures.

Publikacje, które mogą Cię zainteresować

artykuł
#155335Data dodania: 20.9.2024
End-to-end neural speaker diarization with non-autoregressive attractors / Magdalena RYBICKA, Jesús Villalba, Thomas Thebaud, Najim Dehak, Konrad KOWALCZYK // IEEE/ACM Transactions on Audio, Speech and Language Processing ; ISSN  2329-9290 . — Tytuł poprz.: IEEE Transactions on Audio, Speech, and Language Processing ; ISSN:  1558-7916. — 2024 — vol. 32, s. 3960-3973. — Bibliogr. s. 3972, Abstr. — Publikacja dostępna online od: 2024-08-07. — M. Rybicka - dod. afiliacja: Johns Hopkins University, Baltimor, USA
artykuł
#162376Data dodania: 15.9.2025
Joint diarization and separation using sepformer with non-autoregressive attractors / Magdalena RYBICKA, Konrad KOWALCZYK, Thomas Thebaud, Najim Dehak, Jesús Villalba // IEEE Signal Processing Letters ; ISSN  1070-9908 . — 2025 — vol. 32, s. 2913–2917. — Bibliogr. s. 2917, Abstr. — Publikacja dostępna online od: 2025-07-18. — M. Rybicka - dod. afiliacja: Johns Hopkins University, Baltimore, MD, USA