Vowel production of Mandarin-speaking hearing aid users with different types of hearing loss

Abstract

In contrast with previous research focusing on cochlear implants, this study examined the speech performance of hearing aid users with conductive (n = 11), mixed (n = 10), and sensorineural hearing loss (n = 7) and compared it with the speech of hearing control. Speech intelligibility was evaluated by computing the vowel space area defined by the Mandarin Chinese corner vowels /a, u, i/. The acoustic differences between the vowels were assessed using the Euclidean distance. The results revealed that both the conductive and mixed hearing loss groups exhibited a reduced vowel working space, but no significant difference was found between the sensorineural hearing loss and normal hearing groups. An analysis using the Euclidean distance further showed that the compression of vowel space area in conductive hearing loss can be attributed to the substantial lowering of the second formant of /i/. The differences in vowel production between groups are discussed in terms of the occlusion effect and the signal transmission media of various hearing devices.

About the Authors:

Yu-Chen Hung

* E-mail: [email protected]

Affiliation: Speech and Hearing Science Research Institute, Children’s Hearing Foundation, Taipei City, Taiwan

ORCID http://orcid.org/0000-0002-6016-5208

Ya-Jung Lee

Affiliation: Speech and Hearing Science Research Institute, Children’s Hearing Foundation, Taipei City, Taiwan

Li-Chiun Tsai

Affiliation: Speech and Hearing Science Research Institute, Children’s Hearing Foundation, Taipei City, Taiwan

Introduction

Hearing loss adversely affects speech perception, leading to specific speech characteristics. Successful communication through spoken language requires mutual understanding of verbal signals. Disabilities in auditory function in people with hearing loss often result in atypical and ultimately less intelligible speech, which lead to substantial difficulties in communicating effectively through spoken words [1]. Especially, as communication is essential to social interactions and healthy relationships, a recent study has pointed out that intelligible speech is a relevant ability for children with hearing loss to maintain their social status and enrollment in hearing and speaking environments [2]. Therefore, understanding the strengths and weaknesses of their speech performance is crucial for developing intervention strategies to improve the intelligibility. Numerous studies have shown that people with hearing loss often nasalise speech sounds [3–5], and exhibit speech flow disruptions, resulting in abnormal speech rhythm. Moreover, their speaking rate is generally reduced as a result of prolonged production of speech segments and slow articulatory transitions [6–10].

Regarding segmental units, people with hearing loss frequently struggle to distinguish sounds with similar phonetic features, such as voiced–voiceless cognate pairs, which have identical places and manners of articulation and only differ from each other in vocal vibration, or fricative and affricate cognates, as the latter begin as plosives and release into fricatives. Consequent common errors include deletions of initial and final consonants [8,11–13], simplifications of consonant clusters [14,15], and substitutions of one consonant for another [12,16–19]. In contrast to consonants that often share articulatory features and are shaped by minimal active movements, vowels are normally formed by positioning the tongue and lips in various ways [20]. As a consequence, vowels are usually produced more accurately because of their unique articulatory position and the acoustic intensity involved in their production [21,22]. Nevertheless, certain errors have still been frequently observed in people with hearing loss, such as vowel substitution [3,15,23], neutralisation [11,15,17], and diphthong misarticulation [3,6,11,15,17].

Additional studies have been conducted to quantitatively investigate the speech intelligibility of people with hearing loss. Speech intelligibility indicates the degree to which a message delivered by a speaker is comprehensible [24]. It can be conventionally measured either by calculating the accuracy of words or phonemes in a written task, wherein the listener writes down what they understood from a speech sample [25], or by using a rating scale to judge speech, wherein the listener estimates the proportion of the presented speech that they understood [26,27]. Because intelligible speech is often considered the ultimate goal for children with hearing loss [25], numerous studies have been conducted to study the possible factors contributing to comprehensible speech. For example, hearing capacity and the length of hearing aid (HA) use have been found to positively correlate with speech intelligibility [15,28–30]. Moreover, Markides [31] observed that children fitted with HAs before the age of 6 months produced more comprehensible speech than children fitted at later ages.

Similarly, with the advent of cochlear implants (CIs), many researchers have shifted their attention towards the questions of whether and how the signals conveyed by electrical stimulation might affect the quality of speech perception and production in CI recipients. These studies have generally concluded that early implantation yields more intelligible verbal expression than later implantation does [32–36]. Speech intelligibility has been found to improve gradually over time, especially when users are implanted with CIs at younger ages [36–41].

In addition to the transcription or rating of speech materials, vowel space area (VSA) also functions as a useful index for assessing speech performance. Articulatory working space is a graphic display of the first (F1) and second (F2) formants. The value of F1 varies with the height of the tongue, whereas the value of F2 is mostly determined by tongue retraction (back or front position). Crucially, the VSA has been shown to positively correlate with speech intelligibility scores, not only in people with typical development [42–46] but also in specific populations such as people with speech disorders [47–50] and people with hearing loss [51,52]. A larger VSA is indicative of clearer speech. The performance of CI speakers has been the focus of numerous studies on the acoustic analysis of VSA in people with hearing loss. The majority of studies have shown that CI children exhibit a smaller VSA than children with normal hearing [53–58]. Others have reported the opposite, namely that the vowel space performance of CI children approximates that of their peers with normal hearing [59]. However, this discrepancy might be partially attributable to demographic differences. For example, in comparison to other studies [53,54,56,57], most CI speakers in the study by Uchanski and Geers [59] had received implantation at an earlier age (i.e., <3 years) and their duration of CI use was longer as well (i.e., 4–6 years), which is likely what led to them having a similar vowel performance to that of the control group [32–36].

In addition to calculating the area of vowel space, the measure of formant values facilitates the assessment of the acoustic and articulatory features of each individual speech element. More crucially, by combining the computation of the VSA and the evaluation of formant patterns, researchers are able to identify the possible origins of discrepancies in speech performance. For example, the F2s of corner vowels in CI speakers have been found to be more divergent and generally lower than those in speakers with normal hearing, resulting in horizontally compressed vowel space [29,54,55,57,60].

Although a large body of work exists on the speech performance of CI speakers, only a few studies have focused on direct acoustic comparisons between CI and HA users. Horga and Liker [53] found that CI speakers achieved higher vowel quality than their HA counterparts, particularly in front and back vowels. However, opposite findings were presented by Verhoeven et al. [60]; in relation to the HA speakers, the CI speakers displayed greater overlaps between vowel categories, yielding reduced vowel contrasts and speech intelligibility. However, this disagreement between results could be a reflection of the severity of hearing loss in the HA samples. The HA participants in Horga and Liker [51] were all profoundly hearing-impaired, whereas those in Verhoeven et al. [58] had only mild-to-moderate hearing loss. The latter group with milder hearing loss might show higher overall speech outcomes, since children with more residual hearing have generally been reported to have higher performance in speech perception and production [61–63].

The aforementioned studies have shed light on differences in acoustic–articulatory performance between two groups using various hearing devices with distinct sound transmission principles; however, to the best of our knowledge, little research has targeted HA users alone. There is a large number of HA users worldwide [64], whose types of hearing loss can be categorised into three subgroups according to the damaged part of the auditory system: conductive hearing loss, sensorineural hearing loss, and mixed hearing loss. Conductive hearing loss is frequently caused by damage or an obstruction in the outer or middle ear, leading to problems in conducting airborne sounds. Thus, bone-conducting or bone-anchored HAs are used to transfer sound waves into sound vibrations, which further move across the skull into the inner ear. By contrast, the main cause of sensorineural hearing loss lies in the inner ear or along the auditory nerve, and patients normally wear air-conducting HAs. Mixed hearing loss refers to cases when conductive hearing loss occurs in conjunction with sensorineural hearing loss.

The quality of sound differs when it is transferred through different media [65]. For instance, signals delivered by HAs sound different to those transmitted by CIs. This is because CIs transform sounds into electrical current that directly stimulates the auditory nerve [66,67]. Similarly, because different hearing loss types are usually associated with different transmission paths, people with conductive hearing loss who use bone-conducting HAs are likely to perceive signals differently to people with sensorineural hearing loss who wear air-conducting HAs.

To shed greater light on the extent to which hearing loss type affects speech performance, the present study included all three types of hearing loss and examined their articulatory working space and acoustic-articulatory quality by using Mandarin Chinese corner vowels. Corner vowels are frequently used to calculate the size of the articulatory working space, because they represent the most extreme positions of the tongue, defining the boundary of the area within which vowels can be produced [50]. Because perceptual variation affects the quality of speech production [68–70], we expected to observe divergent speech quality across different types of hearing loss. In particular, we expected to observe media-dependent and therefore frequency-dependent effects on articulatory working space. Because bone more effectively transmits low-frequency sound than air does [65], people with conductive hearing loss wearing bone-conducting HAs might perceive sounds differently than people with the other two types of hearing loss. For example, the low-frequency components in the sound /i/ might overpower high-frequency components when the sound is transmitted through bone, in what is known as the occlusion effect. This results in a less typical acoustic representation of /i/, which in turn presumably affects speech production. Examining articulatory performance would hence provide us with insights into the perceived quality of sound associated with different signal transmission paths (i.e., airborne or bone-borne). Furthermore, the findings have valuable clinical implications regarding concerns such as HA fitting strategies and guidelines for speech training. Finally, regardless of the type of hearing loss, articulatory distortions should mostly occur in the back vowels (e.g., /i/) because of the lack of visible articulatory movements [54,55,57].

Materials and methods

Participants

Twenty-eight speakers with mild to moderately severe bilateral hearing loss participated in this study. They were all prelingually deaf and had been enrolled in auditory–verbal therapy programmes for an average of 4 years. At the time of the experiments, they mainly used oral communication. According to the type of hearing loss, they were assigned to three subgroups: conductive hearing loss (COND), mixed hearing loss (MIX), and sensorineural hearing loss (SNHL).

The COND group contained 11 participants (mean age: 9 years) whose hearing conditions resulted from congenital aural atresia or microtia, and who wore either bone-conducting or bone-anchored HAs. The MIX and SNHL groups consisted of 10 (mean age: 13 years) and seven (mean age: 14 years) participants, respectively. They were all fitted with air-conducting HAs. More auditory-related details of the participants in the hearing loss groups (HL) are summarised in Table 1. In addition, 26 speakers (mean age: 28 years) with normal hearing were recruited in this study as the control group (NH). All the participants were monolingually raised native speakers of Mandarin Chinese in Taiwan. None of the participants had cleft lip or cleft palate.

[Figure omitted. See PDF.]

Table 1. Speaker demographics.

https://doi.org/10.1371/journal.pone.0178588.t001

Although age has been found to affect the size of vowel space [71], we intentionally included adult NH speakers as the control group because they have more skilled articulator movements and their speech production is more likely to meet the characteristics of clear speech per definition [72,73]. Therefore, having an adult control group allows us to highlight the differences in speech intelligibility between the HL groups and the typical speech sample.

Ethics statements

Information about the experiment was provided and written informed consent was collected prior to participation. Parents or guardians were asked to provide written informed consent on behalf of participants who were minors. All participants were compensated financially. This study was conducted according to the principles expressed in the Declaration of Helsinki and the procedure was approved by the Institutional Review Board of the Chang Chung Medical Foundation in Taiwan.

Speech materials and recording procedures

The speech material comprised the phonetic chart for Mandarin Chinese, including three corner vowels /a, i, u/, and 34 other phonetic elements as fillers, ensuring that the participants remained naïve with respect to the purpose of the recording.

Prior to the recording session, participants in the HL groups were asked to complete a pure-tone audiometric test carried out by a licensed audiologist in a sound-treated room. Following the audiometric test, each speaker was provided with speech material written in Mandarin Phonetic Symbols, also known as Zhuyin fuhao, which are officially used in Taiwan for the phonetic transcription of Chinese sounds. During recording, the distance between the microphone and the speaker was maintained at approximately 15 cm. The speakers were instructed to produce each speech sound three times in isolation in a neutral voice at a normal speech rate and not to purposely exaggerate their articulation. The speech materials were recorded using Praat (Version 6.0.19) [74], and directly stored in a laptop (HP Probook 4421s) at a sampling rate of 44100 Hz with a resolution of 16 bits.

Acoustic analysis

F1 and F2 were measured at the steady-state segment of each corner vowel using Praat. The average values for F1 and F2 in Hz were first calculated for each speaker and each vowel, which were then used to obtain the grand average formant frequencies for each subgroup. According to the results of the acoustic measurements, each vowel was plotted on a chart with F1 on the y-axis and F2 on the X-axis to reflect its position in the oral cavity. Fig 1 illustrates the scatter plots of F1 and F2 for each group. The vowel ellipse has been used to indicate articulatory variability [60,75,76]. The elliptical range was drawn with two standard deviations (SDs) from the mean of each vowel, averaged over all participants in each group. The semimajor and semiminor of the ellipse represented either the SDs of the mean F1 or the mean F2. To determine the interspeaker variability for each vowel, the area of ellipse was calculated, with the centre coordinates corresponding to the average values of F1 and F2 as a reference [57,77]. Larger areas were indicative of enhanced interspeaker variability [60,75,76].

[Figure omitted. See PDF.]

Fig 1. Average values of the first (F1) and second (F2) formant for each group.

The ellipses were drawn with two standard deviations from the mean of each vowel, incorporating approximately 95% of the data points. Each symbol (a, u, i) represents the average F1 and F2 value for each speaker, and the red squares represent the central coordinate (i.e., the mean F1 and F2 values) for each ellipse.

https://doi.org/10.1371/journal.pone.0178588.g001

Vowel space area

To obtain the VSA produced by each group, the following formula (1) was applied [50]:(1)F1i represents the F1 value of the vowel /i/ and F2a represents the F2 value of the vowel /a/. The same principle applies to other symbols in the formula. A larger VSA indicates more intelligible speech [42,46,78].

Euclidean distance

The Euclidean distance in the F1–F2 plane was then measured to quantitatively compare the acoustic differences between the HL subgroups and the NH group across three corner vowels. The distance is calculated using formula (2), where F1_HLsp and F2_HLsp are the mean F1 and F2 value of a given vowel produced by a certain HL speaker (e.g., the average of the three tokens of /a/ produced by a speaker with conductive hearing loss), and and are the grand mean F1 and F2 values of the same vowel of the NH group [55,57,58].

(2)

A greater Euclidean distance indicates more dissimilar vowel quality between participants in the HL and NH groups [57].

Results

Demographic factors

We first evaluated the demographic variables that could affect the quality of vowel production among HL subgroups. Because the range of each variable was rather large, as shown in Table 1, Kruskal–Wallis tests were performed to detect whether the median of each variable differed between groups. No significant differences were found between subgroups in the pure-tone average threshold in the better ear (H(2) = 3.701, p = .854) or in relation to hearing age (i.e., duration of HA use) (H(2) = 5.742, p = .670) or duration of intervention (H(2) = 7.563, p = .114). The only significant difference was that for chronological age (H(2) = 11.201, p = .021). A follow-up test using the Bonferroni approach was conducted to evaluate pairwise differences among the three groups. A significant difference was observed between the COND and SNHL groups (H(2) = 29.267, p = .011), indicating that the COND group was younger than the SNHL group. No differences were observed between the other groups (MIX vs SNHL: H(2) = 2.629, p = 1.0; COND vs. MIX: H(2) = −7.527, p = .109)

Speech intelligibility: Vowel space area

On visual inspection of Fig 1, /i/ appeared to be the least stable sound across all vowels and groups, reflected in its greater ellipses. In particular, the F2s of /i/ in the COND group were generally shorter than those of other groups, resulting in a substantial degree of overlap in the formant frequency patterns between /u/ and /i/. A direct comparison between the values of vowel ellipse areas across groups appears to support the results of the visual inspection, as displayed in Fig 2. Namely, regardless of the type of hearing loss, the sound /i/ generally exhibited the highest interspeaker variability among three corner vowels, reflected in the largest ellipse area.

[Figure omitted. See PDF.]

Fig 2. Vowel ellipse area for each Mandarin Chinese corner vowel in each group.

https://doi.org/10.1371/journal.pone.0178588.g002

Fig 3 presents the VSA value for each group. First, a t-test was conducted to compare the VSA difference between the NH and HL groups. The results revealed that the NH speakers produced significantly larger VSAs than the HL speakers did (t(52) = 5.227, p < .0001, Cohen’s d = 1.50). This correlates with the results of previous studies [53–58], implying that people with hearing loss generally exhibit reduced speech intelligibility in comparison with people with normal hearing.

[Figure omitted. See PDF.]

Fig 3. Mandarin Chinese vowel formant space for each group.

https://doi.org/10.1371/journal.pone.0178588.g003

A one-way ANOVA test was then carried out to further examine whether any difference existed in VSA performance between each HL subgroup and the NH group. With a main effect of groups (F(3,50) = 9.685, p < .0001; η² = 0.91), post hoc comparisons using Dunnett’s T3 procedure showed that although no VSA difference was apparent between the SNHL and NH groups (F(1, 31) = 6.172, p = .080), both the COND and MIX groups exhibited significantly more compressed VSAs than the NH group did (NH vs COND: F(1, 35) = 20.736, p = .002; NH vs MIX: F(1, 34) = 13.965, p = .010). Moreover, no significant VSA difference was found between SNHL and COND (F(1, 16) = .379, p = .611), SNHL and MIX (F(1, 15) = .662, p = .094), or COND and MIX (F(1, 19) = .837, p = .988).

Vowel quality: Euclidean distance

To examine the mean Euclidean distance between each HL subgroup and the NH group across the corner vowels, repeated measures ANOVA was performed for the COND, MIX, and SNHL groups separately. Greater Euclidean distance indicated more acoustic dissimilarity between the target vowel in a given HL subgroup and the NH group. As shown in Fig 4, a significant main effect was found for the COND group (F(2,20) = 22.64, p < .0001, η² = 0.69), and the post hoc t-tests showed that /i/ had a significantly greater distance than /a/ and /u/ did (ps = .001), indicating that speakers with COND had difficulty pronouncing /i/ correctly. By contrast, no significant effect was found in the MIX and SNHL groups, suggesting that their vowel qualities were relatively similar to those of the NH group.

[Figure omitted. See PDF.]

Fig 4. Average Euclidean distance of each Mandarin corner vowel between each hearing loss subgroup and the normal hearing group.

Each point represents one speaker. Red squares stand for the average distance value and error bars represent standard deviations.

https://doi.org/10.1371/journal.pone.0178588.g004

To examine which formant feature was mainly responsible for the articulatory inconsistency of /i/ in the COND group, we calculated the differences between the COND and NH groups at the F1 and F2 formants, respectively. The statistical analysis confirmed the visual inspection of Fig 3; both the F1 and F2 values in the COND were significantly different from those in the NH group. Notably, in contrast with the relatively minor F1 differences (t(35) = 3.034, p = .005, Cohen’s d = 1.03), a substantial F2 discrepancy was found (t(35) = 6.174, p < .0001, Cohen’s d = 2.09), indicating that people with conductive hearing loss tended to retract the tongue farther backward while producing the sound /i/.

Overall, speakers with COND or MIX exhibited significantly smaller VSAs relative to the NH group, indicating reduced speech intelligibility. Specifically, in contrast to the relatively homogeneously centralised VSA in the MIX group, the more compressed articulatory working space in the COND group seemed to result from a less accurate articulation of /i/ with a substantial backward displacement of the tongue body, as mirrored in the significantly lower F2 value [20].

Discussion

The main aim of the present research was to explore whether speakers with different types of hearing loss produce vowels differently than speakers with normal hearing. Similarly to other investigations [53–58], the present results showed a generally more compressed articulatory working space in the HL groups than in the NH group (Fig 3), indicating less intelligible speech. However, a fine-grained analysis comparing vowel production between different HL subgroups revealed that people with SNHL performed similarly to the NH group, whereas the COND and MIX groups showed significantly reduced VSA. Unlike previous studies showing that hearing aid users generally have a smaller VSA than people with normal hearing [53,60], the present results suggest otherwise. Namely, the hearing aid users with SNHL exhibited VSA similar to that of their hearing counterparts. Although Verhoeven et al. [51] and Horga and Liker [58] have also collected speech data from conventional hearing aids users (i.e. air-conduction), they have not reported whether their samples included both SNHL and MIX groups or only an SNHL group. As the present results demonstrated, vowel quality tended to differ between these two types of hearing loss. The contradictory findings might therefore be attributed to the effect of hearing loss types. Crucially, this study showed that people with SNHL might eventually achieve a comparable level of speech intelligibility to people with typical hearing. However, other factors that might contribute to intelligible speech such as hearing age or the duration of intervention must be examined more thoroughly in future research.

Turning to the findings of significantly more reduced VSA in the COND and MIX groups, the calculation of the Euclidean distance further demonstrated that, in contrast to a centralised VSA in the MIX group, the heterogeneously shrunken VSA in the COND group was mainly caused by a significant divergence in /i/ production (Fig 4). More specifically, the analysis of acoustic profiles suggested that the reduction of F2 in /i/ was greater than F1, causing a horizontal shift of VSA towards the back of the cavity.

Previous research has claimed that the unstable production of /i/ along the front-back dimension is induced by less visible biofeedback involving tongue movements [54,55,57]. Compared to other vowels with prominent visual cues, such as openness (e.g., /a/) and roundedness (e.g., /u/), the lack of visibility impedes children with hearing loss in accurately acquiring the place of articulation. However, this assumption of articulatory visibility would only apply to an observation of overall less consistent performance of /i/ in all HL subgroups (Fig 3). By contrast, our data shows a highly specific effect, with F2 lowering in /i/ only for the COND group. Thus, this effect must be attributed to other causes.

The shrunken VSA induced by significantly centralised /i/ could simply reflect age difference, because the average chronological age of the COND group was younger than that of other subgroups. However, VSA has been shown to negatively correlate with chronological age; namely, older speakers display smaller VSA [71,79,80]. Therefore, the VSA reduction found in the COND group was not a result of factors related to chronological age.

By contrast, we suggest that the present result was more likely to be a consequence of signal conduction methods. Bone is more capable of conducting lower frequencies than air is; sounds transmitted through bone are therefore perceived to have deeper and lower tones [65]. All speakers with conductive hearing loss in the present study had either congenital aural atresia or microtia, and all were fitted with bone-conducting HAs. The closing at the outer ear pathway could cause the occlusion effect, which increases sound at 500 Hz up to 25 dB or at 200 Hz up to 40 dB [81]. In contrast to /a/ and /u/ with both formants located in the low-to-mid frequency range, the vowel /i/ is more dispersed in the phonetic space, with F1 in low frequencies and F2 in high frequencies [77]. In other words, when wearing bone-conducting HAs, the high-frequency component of the transmitted signal is likely to be masked, at least to some extent, by the low-frequency sounds, leading to perceptual distortion. Crucially, it has been assumed that perceptual experiences can help shape and establish internal acoustic representations of target speech sounds, which are stored in the memory, serving as a guide for speech production. For example, by observing developmental changes in vowel production, a past study found that infants were able to access phonetic category information and vocally imitate the sounds they heard [82]. Interestingly, a similar effect was also reported in second language learning, namely that the reinforcement of perceptual training could significantly improve performance in speech production, providing further support for the link between speech perception and production [83]. As a result, a constant perception of distorted sound would presumably affect the sensorimotor learning of speech, leading to poor production. Thus, the occlusion effect induced by bone-conducted stimulation probably caused a more substantial reduction of F2 in /i/ for participants with conductive hearing loss than for those with mixed or sensorineural hearing loss, because the /i/ sound they perceived would be more dominant at lower frequencies. However, future research is required to clarify whether the occlusion effect has an impact on overall speech performance in this population.

Although this study sheds light on speech intelligibility and vowel quality between people with different types of hearing loss, it has limitations that must be addressed. First, our findings are derived from a relatively small sample size. Therefore, caution is advisable when generalizing the research findings to a larger population of interest. Second, the participants in the current study were instructed to read aloud isolated phonemes, which might be considered less natural and rather monotonous in comparison to spontaneous speech. In particular, it has been found cross-linguistically that the coarticulatory effects involved in continuous speech may affect vowel production, probably leading to different intelligibility outcomes than phonemes pronounced in isolation [84–86]. In order to fully understand differences in natural speech performance between people with different types of hearing loss, future research should focus on intelligibility assessment for spontaneous speech.

Nevertheless, the present study was, to our knowledge, the first to report on how different types of hearing loss with distinct transmission paths affect speech performance. The findings suggested that bone-conducting HAs, typically used by people with conductive hearing loss, seemed to transmit signals differently in a frequency-dependent manner, resulting in low frequencies overpowering high frequencies. This in turn may affect speech production, with reduced intelligibility in the high-frequency range. Clinically, the current results highlight the role of the occlusion effect. When assessing the auditory performance of patients wearing bone-conducting HAs, the occlusion effect should be carefully considered to avoid signal distortions that may degrade sound quality. Speech therapists should also consider the possibility that reduced speech intelligibility might be the result of excessive low-frequency amplification.

Supporting information

[Figure omitted. See PDF.]

S1 File. Minimal dataset table.

The PTA and the formant values for each participant in each group.

https://doi.org/10.1371/journal.pone.0178588.s001

(XLS)

Acknowledgments

The authors would like to thank audiologists Dr. Hsiu-Wen Chang, Yen-Ming Chang, Wei-I Chen, and Yi-Wei Lin, who performed the audiometric tests of the hearing loss participants. Special thanks are extended to the participating families and children.

Author Contributions

1. Conceptualization: YCH.

2. Data curation: YJL LCT.

3. Funding acquisition: YCH.

4. Investigation: YJL LCT.

5. Methodology: YCH.

6. Project administration: YCH.

7. Resources: YJL LCT.

8. Supervision: YCH.

9. Visualization: YCH YJL LCT.

10. Writing – original draft: YCH.

11. Writing – review & editing: YCH.

Citation: Hung Y-C, Lee Y-J, Tsai L-C (2017) Vowel production of Mandarin-speaking hearing aid users with different types of hearing loss. PLoS ONE 12(6): e0178588. https://doi.org/10.1371/journal.pone.0178588

References

1. Osberger MJ. Speech intelligibility in the hearing impaired: Research and clinical implications. In: Kent R, editor. Intelligibility in Speech Disorders. Philadelphia: John Benjamins Publishing; 1992. pp. 233–264.

2. Most T, Ingber S, Heled-Ariam E. Social Competence, Sense of Loneliness, and Speech Intelligibility of Young Children With Hearing Loss in Individual Inclusion and Group Inclusion. J Deaf Stud Deaf Educ. 2012;17(2): 259–72.\ pmid:22186369

3. Calvert DR., Silverman SR. Speech and deafness: A text for learning and teaching. 1st ed. Washington: Alexander Graham Bell Association for the Deaf; 1975.

4. Martony J. Studies on the speech of the deaf. 1st ed. Stockholm: Speech Transmission Laboratory, Royal Institute of Technology; 1965.

5. Stevens KN, Nickerson RS, Rollins AM. Assessment of nasalization in the speech of deaf children. J of SpeeCh Hear Res. 1976; 19(2): 393–416.

6. Boone DR. Modification of the voices of deaf children. Volta Rev. 1966; 68: 686–692.

7. Hudgins CV. A comparative study of the speech coordinations of deaf and normal-hearing subjects. J Genet Psychol. 1934; 44: 3–46.

8. Hudgins CV, Numbers FC. An investigation of the intelligibility of the speech of the deaf. Genet Psychol Monogr. 1942; 25: 289–392.

9. Nober EH, Nober L. Effects of hearing loss on speech and language in the postbabbling stage. In: Jaffe B, editor. Hearing loss in children. Baltimore: Iniversity Park Press; 1977. p. 630–642.

10. Osberger MJ, McGarr N. Speech production characteristics of the hearing impaired. In: Lass N, editor. Speech and Language: Advances In Basic Science and Research. New York: Academic Press; 1982.

11. Markides A. The speech of deaf and partially hearing children with special reference to factors affecting intelligibility. Br J Disord Commun. 1970; 5: 126–140. pmid:5495165

12. Nober HN. Articulation of the deaf. Except Child. 1967; 33: 611–621. pmid:6042707

13. Smith CR. Residual hearing and speech production in deaf children. J Speech Lang Hear Res. 1975;18(4): 795–811.

14. Brannon JB. The speech production and spoken language of the deaf. Lang Speech. 1966; 9: 127–136. pmid:5944118

15. Smith CR. Residual hearing and speech production in deaf children. J Speech Hear Res. 1975;18:795–811. pmid:1207108

16. Calvert DR, Silverman SR. Speech and deafness. Washington, DC: Alexander Graham Bell Association for the Deaf; 1975.

17. Heider F, Heider G, Sykes J. A study of the spontaneous vocalizations of fourteen deaf children. Volta Rev. 1941; 43:10–14.

18. Liu J-X. A study on articulation ability of Mandarin phonemes and its related factors for the first grade hearing-impaired children in Taipei City. Bull Spec Educ. 1986; 2: 127–162.

19. Carr J. An investigation of the spontaneous speech sounds of five-year-old deaf-born children. J Speech Hear Disord. 1953; 18: 22–29. pmid:13053560

20. Ladefoged P. A Course in Phonetics. Orlando, FL: Harcourt Brace College; 1993.

21. Cancio ML, Singh S. Functional Phonetics Workbook. Plural Pub; 2007

22. Geffner D. Feature characteristics of spontaneous speech production in young deaf children. J Commun Disord. 1980;13(6): 443–454. pmid:7451673

23. Mosen RB. Durational aspects of vowel production in the speech of deaf children. J Speech Hear Res. 1974;17: 386–398. pmid:4424706

24. Bunton K, Kent RD, Kent JF, Duffy JR. The effects of flattening fundamental frequency contours on sentence intelligibility in speakers with dysarthria. Clin Linguist Phon. 2001;15(3):181–193.

25. Ertmer DJ. Assessing speech intelligibility in children with hearing loss: Toward revitalizing a valuable clinical tool. Lang Speech Hear Serv Sch. 2011; 42(1): 52–58. pmid:20601533

26. Samar VJ, Metz DE. Criterion validity of speech intelligibility rating-scale procedures for the hearing-impaired population. J Speech Lang Hear Res. 1988; 31(3):307.

27. Schiavetti N. Scaling procedures for the measurement of speech intelligibility. In: Kent R. D., editor. Intelligibility in Speech Disorders. Philadelphia, PA: John Benjamins; 1992. p. 11–34.

28. Chang B-L. The perceptual analysis of speech intelligibility in students with hearing impairment. Bull Spec Educ. 2000; 53–78.

29. Monsen RB. Toward measuring how well hearing-impaired children speak. J Speech Hear Res. 1978; 21(2):197–219. pmid:703272

30. Svirsky MA, Chin SB, Miyamoto RT, Sloan RB, Caldwell M. Speech intelligibility of profoundly deaf pediatric hearing aid users. Volta Rev. 2000;102(4): 175–198.

31. Markides A. Age at fitting of hearing aids and speech intelligibility. Br J Audiol. 1986; 20(2): 165–167. pmid:3719164

32. Habib MG, Waltzman SB, Tajudeen B, Svirsky MA. Speech production intelligibility of early implanted pediatric cochlear implant users. Int J Pediatr Otorhinolaryngol. 2010;74(8):855–859. pmid:20472308

33. Svirsky MA, Chin SB, Jester A. The effects of age at implantation on speech intelligibility in pediatric cochlear implant users: Clinical outcomes and sensitive periods. Audiol Med. 2007;5(4):293–306.

34. Osberger MJ, Maso M, Sam LK. Speech intelligibility of children with cochlear implants, tactile aids, or hearing aids. J Speech Lang Hear Res. 1993; 36(1): 186–203.

35. Peng S-C, Spencer LJ, Tomblin JB. Speech intelligibility of pediatric cochlear implant recipients with 7 years of device experience. J Speech Lang Hear Res. 2004; 47(6): 1227–1236. pmid:15842006

36. Tye-Murray N, Spencer L, Woodworth GG. Acquisition of speech by children who have prolonged cochlear implant experience. J Speech Hear Res. 1995; 38(2): 327–37. pmid:7596098

37. Allen MC, Nikolopoulos TP, O’Donoghue GM. Speech intelligibility in children after cochlear implantation. Am J Otol. 1998;19(6): 742–746. pmid:9831147

38. Calmels M-N, Saliba I, Wanna G, Cochard N, Fillaux J, Deguine O, et al. Speech perception and speech intelligibility in children after cochlear implantation. Int J Pediatr Otorhinolaryngol. 2004; 68(3): 347–351. pmid:15129946

39. Miyamoto RT, Kirk KI, Robbins AM, Todd S, Riley A. Speech perception and speech production skills of children with multichannel cochlear implants. Acta Otolaryngol. 1996; 116(2): 240–243. pmid:8725523

40. Mondain M, Sillon M, Vieu A, Lanvin M, Reuillard-Artieres F, Tobey E, et al. Speech perception skills and speech production intelligibility in French children with prelingual deafness and cochlear implants. Arch Otolaryngol Head Neck Surg. 1997; 123(2): 181–184. pmid:9046286

41. Robbins AM, Kirk KI, Osberger MJ, Ertmer D. Speech intelligibility of implanted children. Ann Otol Rhinol Laryngol Suppl. 1995;166: 399–401. pmid:7668721

42. Bradlow AR, Torretta GM, Pisoni DB. Intelligibility of normal speech I: Global and fine-grained acoustic-phonetic talker characteristics. Speech Commun. 1996; 20(3): 255–272. pmid:21461127

43. Burnham D, Kitamura C, Vollmer-Conna U, Fernald A, Kuhl PK, Kuhl PK, et al. What’s new, pussycat? On talking to babies and animals. Science. American Association for the Advancement of Science; 2002; 296(5572): 1435. pmid:12029126

44. Liu H-M, Kuhl PK, Tsao F-M. An association between mothers’ speech clarity and infants’ speech discrimination skills. Dev Sci. 2003;6(3): F1–10.

45. Krause JC, Braida LD. Acoustic properties of naturally produced clear speech at normal speaking rates. J Acoust Soc Am. 2004;115(1): 362–378. pmid:14759028

46. Turner GS, Tjaden K, Weismer G. The influence of speaking rate on vowel space and speech intelligibility for individuals with amyotrophic lateral sclerosis. J Speech Hear Res. 1995;38(5): 1001–13. pmid:8558870

47. Higgins CM, Hodge MM. Vowel area and intelligibility in children with and without dysarthria. J Med Speech Lang Pathol. 2002;10(4):271–277.

48. DuHadway CM, Hustad KC. Contributors to intelligibility in preschool- aged children with cerebral palsy. J Med Speech Lang Pathol. 2012; 20(4).

49. Weismer G, Jeng JY, Laures JS, Kent RD, Kent JF. Acoustic and intelligibility characteristics of sentence production in neurogenic speech disorders. Folia Phoniatr Logop. 2001; 53(1): 1–18. pmid:11125256

50. Liu H-M, Tsao F-M, Kuhl PK. The effect of reduced vowel working space on speech intelligibility in Mandarin-speaking young adults with cerebral palsy. J Acoust Soc Am. 2005; 117(6): 3879–3889. pmid:16018490

51. Metz DE, Schiavetti N, Samar VJ, Sitler RW. Acoustic dimensions of hearing-impaired speakers’ intelligibility: segmental and suprasegmental characteristics. J Speech Hear Res. 1990; 33(3): 476–87. pmid:2232766

52. Tseng S-C, Kuei K, Tsou P-C. Acoustic characteristics of vowels and plosives/affricates of Mandarin-speaking hearing-impaired children. Clin Linguist Phon. 2011; 25(9):784–803. pmid:21453033

53. Horga D, Liker M. Voice and pronunciation of cochlear implant speakers. Clin Linguist Phon. 2006; 20(2–3): 211–217. pmid:16428239

54. Liker M, Mildner V, Sindija B. Acoustic analysis of the speech of children with cochlear implants: a longitudinal study. Clin Linguist Phon. 2007; 21(1): 1–11. pmid:17364613

55. Neumeyer V, Harrington J, Draxler C. An acoustic analysis of the vowel space in young and old cochlear-implant speakers. Clin Linguist Phon. 2010; 24(9): 734–741. pmid:20645857

56. Ibertsson T, Sahleén B, Lofqvist A. Vowel spaces in Swedish children with cochlear implants. J Acoust Soc Am. 2008; 123(5): 3330.

57. Yang J, Brown E, Fox RA, Xu L. Acoustic properties of vowel production in prelingually deafened Mandarin-speaking children with cochlear implants. J Acoust Soc Am. 2015; 138(5): 2791–2799. pmid:26627755

58. Löfqvist A, Sahlén B, Ibertsson T. Vowel spaces in Swedish adolescents with cochlear implants. J Acoust Soc Am. 2010; 128(5): 3064–3069. pmid:21110601

59. Uchanski RM, Geers AE. Acoustic characteristics of the speech of young cochlear implant users: A comparison with normal-hearing age-mates. Ear Hear. 2003; 24(1 Suppl): 90S–105S.

60. Verhoeven J, Hide O, DeMaeyer S, Gillis S, Gillis S. Hearing impairment and vowel production: A comparison between normally hearing, hearing-aided and cochlear implanted Dutch children. J Commun Disord. 2016; 59: 24–39. pmid:26629749

61. Kiese-Himmel C, Reeh M. Assessment of expressive vocabulary outcomes in hearing-impaired children with hearing aids: Do bilaterally hearing-impaired children catch up? J Laryngol Otol; 2006; 120(08): 619–626.

62. Seifpanahi S, Dadkhah A, Dehqan A, Bakhtiar M, Salmalian T. Motor control of speaking rate and oral diadochokinesis in hearing-impaired Farsi speakers. Logoped Phoniatr Vocol. 2008; 33(3): 153–159. pmid:18608874

63. Wake M, Hughes EK, Poulakis Z, Collins C, Rickards FW. Outcomes of children with mild-profound congenital hearing loss at 7 to 8 years: A population study. Ear Hear. 2004; 25(1): 1–8. pmid:14770013

64. World Health Organization. Guidelines for hearing aids and services for developing countries. 2004. Geneva, Switzeland: World Health Organization.

65. Hedrick WR. Technology for diagnostic sonography. 1st ed. St. Louis: Elsevier; 2012.

66. Blamey PJ, Dooley GJ, Parisi ES, Clark GM. Pitch comparisons of acoustically and electrically evoked auditory sensations. Hear Res. 1996;99(1):139–150.

67. McDermott HJ, Sucher CM. Perceptual dissimilarities among acoustic stimuli and ipsilateral electric stimuli. Hear Res. 2006; 218(1): 81–88.

68. Kuhl PK. A new view of language acquisition. Proc Natl Acad Sci. 2000; 97(22): 11850–11857. pmid:11050219

69. Bradlow AR, Pisoni DB, Akahane-Yamada R, Tohkura Y. Training Japanese listeners to identify English /r/ and /l/: IV. Some effects of perceptual learning on speech production. J Acoust Soc Am. 1997; 101(4): 2299–2310. pmid:9104031

70. Flege JE, Bohn O-S, Jang S. Effects of experience on non-native speakers’ production and perception of English vowels. J Phon. 1997; 25(4): 437–470.

71. Pettinato M, Tuomainen O, Granlund S, Hazan V. Vowel space area in later childhood and adolescence: Effects of age, sex and ease of communication. J Phon. 2016; 54:1–14.

72. Pettinato M, Tuomainen O, Granlund S, Hazan V. Vowel space area in later childhood and adolescence: Effects of age, sex and ease of communication. J Phon. 2016:1–14.

73. Green JR, Moore CA, Reilly KJ. The Sequential Development of Jaw and Lip Control for Speech. J Speech Lang Hear Res. 2002; 45(1): 66–79. pmid:14748639

74. Boersma P, Weenink D. Praat: Doing phonetics by computer. 2012. Version 6.0.19. Available from: http://www.praat.org/

75. Nguyen N, Shaw JA. Why the SQUARE vowel is the most variable in Sydney. In: Proceedings of the 15th Australasian International Conference on Speech Science and Technology (SST2014). Christchurch, New Zealand; 2014.

76. Harrington J, Cox F, Evans Z. An acoustic phonetic study of broad, general, and cultivated Australian English vowels. Aust J Linguist. 1997; 17(2): 155–184.

77. Hung Y-C, Lin C-Y, Tsai L-C, Lee Y-J. Multidimensional Approach to the Development of a Mandarin Chinese-Oriented Sound Test. J Speech Lang Hear Res. 2016; 59(2): 349–358. pmid:27045325

78. Weismer G, Laures J, Jeng J-Y, Kent R, Kent J. Effect of speaking rate manipulations on acoustic and perceptual aspects of the dysarthria in amyotrophic lateral sclerosis. Folia Phoniatr Logop. 2000;52(5):201–219. pmid:10965174

79. Flipsen P Jr, Lee S. Reference data for the American English acoustic vowel space. Clin Linguist Phonetics,. 2012; 26(11–12): 926–933.

80. Vorperian HK, Kent RD. Vowel acoustic space development in children: a synthesis of acoustic and anatomic data. J Speech Lang Hear Res; 2007; 50(6):1510–1545. pmid:18055771

81. Stenfelt S, Reinfeldt S. A model of the occlusion effect with bone-conducted stimulation. Int J Audiol. 2007; 46(10): 595–608. pmid:17922349

82. Kuhl PK, Meltzoff AN. Infant vocalizations in response to speech: vocal imitation and developmental change. J Acoust Soc Am. 1996; 100: 2425–2438. pmid:8865648

83. Bradlow AR, Pisoni DB, Akahane-Yamada R, Tohkura Y. Training Japanese listeners to identify English /r/ and /l/: Some effects of perceptual learning on speech production. J Acoust Soc Am. 1997;101(4): 2299–3210. pmid:9104031

84. Dang J, Honda M, Honda K. Investigation of coarticulation in continuous speech of Japanese. Acoust Sci Technol. 2004; 25(5): 318–329.

85. Farnetani E, Recasens D. Anticipatory consonant-to-vowel coarticulation in the production of VCV sequences In Italian. Lang Speech. 1993; 36(Pt2-3): 279–302.

86. Warner-Czyz AD, Davis BL, MacNeilage PF. Accuracy of consonant–vowel syllables in young cochlear implant recipients and hearing children in the single-word period. J Speech Lang Hear Res. 2010; 53(1): 2–17. pmid:20150404