--- title: "Dynamic Speech Discrimination Using an Articulatory Model" authors: - "Shun Ishizaki" doi: "" url: "https://ijcai.org/proceedings/1979/92" pdf: "https://ijcai.org/proceedings/1979/0092.pdf" venue: "Proceedings of the Sixth International Joint Conference on Artificial Intelligence" year: 1979 pages: "" track: "" keywords: --- # Dynamic Speech Discrimination Using an Articulatory Model Shun Ishizaki *Proceedings of the Sixth International Joint Conference on Artificial Intelligence*. ## Abstract The author proposes a dynamic processing method corresponding to the human one. It uses an articulatory model representing the tongue and the lip movements to extract sp ee ch features from speech waveforms. He uses a linear enhancement of the articulatory movements in order to estimate their target articulatory positions. When the targ e t positions are used for vowel discrimination, the correct rate is improved fairly well. For example, ten males' symmetrical vowel V1 V2 V 1 are analyzed and v2 discrimination correct rate is improved from 85\ to 100\. Next, hearing test s show 7hat such dynamic process corresponds well to the human auditory system. ## Full text ## 1. INTRODUCTION In a study on coarticulation using formant frequencies, there are various researches[l-5), including observation of vowel's formant movements, their model and coarticulation normalization using the first and the second formants. On the other hand, coarticulation is considered to be a phenomenon of various changes in articulatory conditions of the phoneme by the preceding and the succeeding phoneme influence. It seems that the changes in articulation will depend directly on the articulatory organ's movements, such as the tongue and the lips, and that a talker allows "movement reduction of articulatory organs" so that he might not spoil the spoken content clearness by hearing his speech through his auditory organs. Such hearing system shares a feedback loop with the speaking system. In an articulatory domain, there are various studies based on X-ray photograph observations [6-8). But very few studies apply them to the actual speech waveform analysis data. The author starts from approximately estimated vocal tract area functions from speech waveforms, and esti­ mate the articulatory parameters expressing the tongue and the lip movements by using an articu­ latory model. Then, he proposes a dynamic processing method of coarticulation and discusses its correspondence with hearing tests of the sound segmented from natural voices. ## 2. ARTICULATORY PARAMETER EXTRACTION[lO) The speech wave analysis is made 3Ccvrding to the procedure shown in Fig. 1. Vocal tract area functions are approximately estimated from the speech waves using an adaptive inverse filtering method of the second and the third order critical damping system[9]. Next, the vocal tract length is obtained by the "an information criterion" based on the maximum likelihood estimation by use o f an autoregressive model[lll. Sizes of speaker's own articulatory organs are quantitatively estimated by using the ~stimated e. Glottis vocal tract length, and individual differences are approximately normalized by uniforming the sizes to a certain constant value [lO] . Fig. 1 Speech analysis system flow chart ![Image](https://ijcai.org/proceedings/1979/fulltext/92/image_000000_a4f9c56603d5d63e0a94401de3958868fecc9c7299ee47e5dbb8e59acb7b3a4c.png) ![Image](https://ijcai.org/proceedings/1979/fulltext/92/image_000001_7daa6559faf2605b9645472492d955d8497b4b8e41a06c6432d150d4e6360fbb.png) Fig. 2 Two-cylinder articulatory model x; area function estimated from speech wave o; area function identified with the model A vocal tract midsagittal cross sectional view is modeled as shown in Fig. 2. The "con­ s triction position" between the upper jaw and a part of \_the tongue, is uniquely determined by this model, and is defined as the length measured from the glottis. By adding the "con­ striction area" and the "lip area" to the "con­ striction position", these three articulatory parameters are defined. The constriction position and the constriction area correspond well to the values measured from X-ray photo­ graphs, while the lip area corresponds well to the value measured from simultaneously recorded video tapes . Linear discriminant functions are calculated from the se three articulatory parameters of isolated vowels, and discriminate them at 100% correct rate. ## 3. DYNAMIC PROCESS OF COARTICULATION Coarticulation appears in almost all the pho­ nemes of a continuous speech, and the phonetic characteristics are changed. These changed characteristics cause large error in speech recognition. When these phonemes are discrimi­ nated by only extracting static characteristics, discrimination algorithm cannot but become exte ns ive. As mentioned later, it is known that hearing confusion phenomena are presented and caused by coarticulation. Namely, the same data can become a different phoneme by influence of the preceding and the succeeding phonemes. Let a vowel sequence be · · · , V 1 , Vl. , v\_, , · · · and s uppose that the influence of coarticulation is expressed by a linear combination of each articulatory parameters and is equal in the forward and backward directions of time. Let the values of articulatory parameters in quasi­ stationary parts of triple continuous vowels V 1 V.a. VJ be P,, Pl. and P\_,, respectively, and the target process linear /\ ,.. value P 1 of P 1 is approximated formulas. based with on the the dynamic following Pl. = P.:~, + Pl.l + PJ.l , P,.a, =-ot'{ P3 - P.l ) · The 0( ( ej.') is a function of both time constant of the lip or the tongue dynamic characteristics and a voicing time. For the articulatory organ which is easy to move because of a small time­ constant, 01. is set to a small value, while fo\_· the articulatory organ not so easy to move, 01. is set to a large value. At the same time, 01. is a function of a voicing time, If there is a sufficient time to voice, the articulatory organs sometimes reach near the target positions and it is, therefore, natural thatOI. should be made small. As there is a strong correlation between the movement distance and the voicing time of each articulatory organ, 01. is made small when the movement distance is beyond a threshold. Examples of dynamic process are shown in Fig. 3. It shows step fucntion approxi­ mation obtained after the articulatory parameter segmentation, and Fig. 3(b) shows the target values after the dynamic process. ## 4. EXPERIMENTAL RESULT Analyse continuous are made on vowel voiced symmetrical triple­ at relatively fast speeds by ten male adults. Fig. 4 shows their articulatory parameters of /aia/. The mark "X" denotes the value before dynamic process. The mark "o" denotes the value after the dynamic process. In Fig. 4, three vowels, /i/, are erroneously discriminated as /e/, with large articulatory areas of the tongue front. However, each articulatory area can be made sufficiently small with the dynamic process mentioned in Section 3. v1 discrimination results in V, V1 V 1 before and after the dynamic process are shown in Table 1. Fig. 3 /aia/'s articulatory parameters and (a) step functions obtained after segmentation (b) enhanced step functions with dynamic process ![Image](https://ijcai.org/proceedings/1979/fulltext/92/image_000002_095f85d6eadb8eeebf1f0f429b4e9ae38616f8e877616a0c34b03b818b55824c.png) Fig. 4 Articulatory parameters of /i/ in /aia/ X; static model, o; dynamic model ![Image](https://ijcai.org/proceedings/1979/fulltext/92/image_000003_03c729ca2a2dccb692838b48d7bf475d9adc204662d0687baafd4506315c321e.png) ![Image](https://ijcai.org/proceedings/1979/fulltext/92/image_000004_8ec05720d88d27a2a58e4fd83da448bd628494a8c9a87a0015dd0cea4118e770.png) ## 5. CORRESPONDENCE WITH HEARING TEST The fourth column from the left in Table 2 shows the hearing test where ~is segmented from V,V1 ~ and presented five times to ten subjects. From the hearing tests, there are several almost complete confusion phenomena, and as compared with the fifth column from the left in the table, the human dynamic function at the per­ ceptual process are found. When the hearing tests are compared with the discrimination results for segmented speech, most of the confusion tendencies agree with each other. In table 2, each /i/ after the dynamic process of /aia/, /uiu/ and /oio/ has common features cor­ responding well to [i I [131. They are separated using a new category Iii and indicated as /i/ in Table 2. ## ACKNOWLEDGEMENT The author would like to thank Dr. Nakajima and Mr. Fuchi for their helpful! advice · ## References 1. Lindblom,B, JASA 35, ll,p.l773(1963) 2. Ohman, S.E.G, JASA 39, pp.l51-168(1966) 3. Sato, Y.and Fujisaki, H, JASJ 34, 3(1978) 4. Kasuya, H,Tohoku Univ.Ooctoral Thesis(l973) 5. Kuwabara, H.and Sakai, H, JASJ 29,2(1973) 6. Ohman, S.E.G, JASA 41, 2, p.310(1967) 7. Lindblom,B. and Sundberg,J,JASA 50,4(1971) 8. Kiritani, T, et al,JASJ 34,~p.l32(1978) 9. Nakajima, T, et al, Bul. Electrotech. Lab, 37, 4, p.462(1973) [101 10. Ishizaki, S, Trans. IECE Japan, J61-A, 10, p.950(1978) [111 11. Ishizaki, S, Trans. IECE Japan, E61,5(1978) [121 12. Ishizaki, S,4-th IJCPR, p.l050(1978) [131 13. Fant G, "Acoustic theory of speech production", Mouton(l960)