Artículo
Robust front-end for audio, visual and audio–visual speech classification
Fecha de publicación:
06/2018
Editorial:
Springer
Revista:
International Journal of Speech Technology
ISSN:
1381-2416
Idioma:
Inglés
Tipo de recurso:
Artículo publicado
Clasificación temática:
Resumen
This paper proposes a robust front-end for speech classification which can be employed with acoustic, visual or audio–visual information, indistinctly. Wavelet multiresolution analysis is employed to represent temporal input data associated with speech information. These wavelet-based features are then used as inputs to a Random Forest classifier to perform the speech classification. The performance of the proposed speech classification scheme is evaluated in different scenarios, namely, considering only acoustic information, only visual information (lip-reading), and fused audio–visual information. These evaluations are carried out over three different audio–visual databases, two of them public ones and the remaining one compiled by the authors of this paper. Experimental results show that a good performance is achieved with the proposed system over the three databases and for the different kinds of input information being considered. In addition, the proposed method performs better than other reported methods in the literature over the same two public databases. All the experiments were implemented using the same configuration parameters. These results also indicate that the proposed method performs satisfactorily, neither requiring the tuning of the wavelet decomposition parameters nor of the Random Forests classifier parameters, for each particular database and input modalities.
Palabras clave:
AUDIO–VISUAL SPEECH RECOGNITION
,
RANDOM FORESTS
,
WAVELET DECOMPOSITION
Archivos asociados
Licencia
Identificadores
Colecciones
Articulos(CIFASIS)
Articulos de CENTRO INT.FRANCO ARG.D/CS D/L/INF.Y SISTEM.
Articulos de CENTRO INT.FRANCO ARG.D/CS D/L/INF.Y SISTEM.
Citación
Terissi, Lucas Daniel; Sad, Gonzalo Daniel; Gómez, Juan Carlos; Robust front-end for audio, visual and audio–visual speech classification; Springer; International Journal of Speech Technology; 21; 2; 6-2018; 293-307
Compartir
Altmétricas