Prediction of three articulatory categories in vocal sound imitations using models for auditory receptive fieldsShow others and affiliations
2018 (English)In: Journal of the Acoustical Society of America, ISSN 0001-4966, E-ISSN 1520-8524, Vol. 144, no 3, p. 1467-1483Article in journal (Refereed) Published
Abstract [en]
Vocal sound imitations provide a new challenge for understanding the coupling between articulatory mechanisms and the resulting audio. In this study, the classification of three articulatory categories, phonation, supraglottal myoelastic vibrations, and turbulence, have been modeled from audio recordings. Two data sets were assembled, consisting of different vocal imitations by four professional imitators and four non-professional speakers in two different experiments. The audio data were manually annotated by two experienced phoneticians using a detailed articulatory description scheme. A separate set of audio features was developed specifically for each category using both time-domain and spectral methods. For all time-frequency transformations, and for some secondary processing, the recently developed Auditory Receptive Fields Toolbox was used. Three different machine learning methods were applied for predicting the final articulatory categories. The result with the best generalization was found using an ensemble of multilayer perceptrons. The cross-validated classification accuracy was 96.8% for phonation, 90.8% for supraglottal myoelastic vibrations, and 89.0% for turbulence using all the 84 developed features. A final feature reduction to 22 features yielded similar results.
Place, publisher, year, edition, pages
2018. Vol. 144, no 3, p. 1467-1483
National Category
Signal Processing
Identifiers
URN: urn:nbn:se:su:diva-221037DOI: 10.1121/1.5052438ISI: 000457802200049PubMedID: 30424637Scopus ID: 2-s2.0-85053873907OAI: oai:DiVA.org:su-221037DiVA, id: diva2:1796899
Funder
EU, FP7, Seventh Framework Programme, 618067Swedish Research Council, 2012-46852023-09-132023-09-132023-09-17Bibliographically approved