Accéder directement au contenu Accéder directement à la navigation
Communication dans un congrès

Microphone Array Channel Combination Algorithms for Overlapped Speech Detection

Abstract : Overlapped speech occurs when multiple speakers are simultaneously active. This may lead to severe performance degradation in automatic speech processing systems such as speaker diarization. Overlapped speech detection (OSD) aims at detecting time segments in which several speakers are simultaneously active. Recent deep neural network architectures have shown impressive results in the close-talk scenario. However, performance tends to deteriorate in the context of distant speech. Microphone arrays are often considered under these conditions to record signals including spatial information. This paper investigates the use of the self-attention channel combinator (SACC) system as a feature extractor for OSD. This model is also extended in the complex space (cSACC) to improve the interpretability of the approach. Results show that distant OSD performance with self-attentive models gets closer to the nearfield condition. A detailed analysis of the cSACC combinationweights is also conducted showing that the self-attention module focuses attention on the speakers' direction.
Type de document :
Communication dans un congrès
Liste complète des métadonnées

https://hal-univ-lemans.archives-ouvertes.fr/hal-03713385
Contributeur : Théo Mariotte Connectez-vous pour contacter le contributeur
Soumis le : mardi 5 juillet 2022 - 11:30:47
Dernière modification le : vendredi 8 juillet 2022 - 22:33:07

Fichier

220114_interspeech2022_reviewe...
Fichiers produits par l'(les) auteur(s)

Identifiants

  • HAL Id : hal-03713385, version 1

Collections

Citation

Théo Mariotte, Anthony Larcher, Silvio Montrésor, Jean-Hugh Thomas. Microphone Array Channel Combination Algorithms for Overlapped Speech Detection. Interspeech 2022 Human and Humanizing Speech Technology, Sep 2022, Incheon, South Korea. ⟨hal-03713385⟩

Partager

Métriques

Consultations de la notice

9

Téléchargements de fichiers

1