Artículo
The audiovisual structure of onomatopoeias: An intrusion of real-world physics in lexical creation
Taitz, Alan
; Assaneo, María Florencia
; Elisei, Natalia Gabriela
; Tripodi, Monica Noemi; Cohen, Laurent; Sitt, Jacobo Diego
; Trevisan, Marcos Alberto
Fecha de publicación:
03/2018
Editorial:
Public Library of Science
Revista:
Plos One
ISSN:
1932-6203
Idioma:
Inglés
Tipo de recurso:
Artículo publicado
Clasificación temática:
Resumen
Sound-symbolic word classes are found in different cultures and languages worldwide. These words are continuously produced to code complex information about events. Here we explore the capacity of creative language to transport complex multisensory information in a controlled experiment, where our participants improvised onomatopoeias from noisy moving objects in audio, visual and audiovisual formats. We found that consonants communicate movement types (slide, hit or ring) mainly through the manner of articulation in the vocal tract. Vowels communicate shapes in visual stimuli (spiky or rounded) and sound frequencies in auditory stimuli through the configuration of the lips and tongue. A machine learning model was trained to classify movement types and used to validate generalizations of our results across formats. We implemented the classifier with a list of cross-linguistic onomatopoeias simple actions were correctly classified, while different aspects were selected to build onomatopoeias of complex actions. These results show how the different aspects of complex sensory information are coded and how they interact in the creation of novel onomatopoeias.
Palabras clave:
ONOMATOPOEIAS
,
LANGUAGE
,
COGNITION
Archivos asociados
Licencia
Identificadores
Colecciones
Articulos(IFIBA)
Articulos de INST.DE FISICA DE BUENOS AIRES
Articulos de INST.DE FISICA DE BUENOS AIRES
Citación
Taitz, Alan; Assaneo, María Florencia; Elisei, Natalia Gabriela; Tripodi, Monica Noemi; Cohen, Laurent; et al.; The audiovisual structure of onomatopoeias: An intrusion of real-world physics in lexical creation; Public Library of Science; Plos One; 13; 3; 3-2018; 1-16
Compartir
Altmétricas