Phonetic recognition by recurrent neural networks working on audio and visual information

Author(s): Dugatto, M., Ferrero, F., Caldognetto, E. M., Vagges, K.

Journal/Book: Speech Commun. 1996; 19: PO Box 211, 1000 AE Amsterdam, Netherlands. Elsevier Science BV. 245-252.

Abstract: A phonetic classification scheme based on a feed forward recurrent back-propagation neural network working on audio and visual information is described. The speech signal is processed by an auditory model producing spectral-like parameters, while the visual signal is processed by a specialised hardware, called ELITE, computing lip and jaw kinematics parameters. Some results will be given for various speaker dependent and independent phonetic recognition experiments regarding the Italian plosive consonants.

Note: Article P Cosi, Univ Padua, Ctr Studio Ric Fonet, CNR, Dept Linguist, Via G Anghinoni 10, I-35121 Padua, Italy

Zurück | Weiter