Language Experience and Subjective Word Familiarity on the Multimodal Perception of Non-Native Speakers’ Vowels

The present study investigated native (L1) and non-native (L2) speakers’ perception of the French vowels /ɔ̃, ɑ̃, ɛ̃, o/. Thirty-four American-English learners of French and 33 native speakers of Parisian French were asked to identify 60 monosyllabic words produced by a native speaker in three modalities of presentation: auditory-only (A-only); audiovisual (AV); and visual-only (V-only). The L2 participants also completed a vocabulary knowledge test of the words presented in the perception experiment that aimed to explore whether subjective word familiarity affected speech perception. Results showed that overall performance was better in the AV and A-only conditions for the two groups with the pattern of confusion differing across modalities. The lack of audiovisual benefit was not due to the vowel contrasts being not visually salient enough, as shown by the native group’s performance in the V-only modality, but to the L2 group’s weaker sensitivity to visual information. Additionally, a significant relationship was found between subjective word familiarity and AV and A-only (but not V-only) perception of non-native contrasts.

Category Exemplar Production Norms for Hong Kong Cantonese: Instance Probabilities and Word Familiarity

The lexical system of Hong Kong Cantonese has been heavily shaped by the local trilingual environment. The development of cultural- and language-specific norms for Hong Kong Cantonese is fundamental for understanding how the speaker population organize semantic memory, how they utilize their semantic resources, and what information processing strategies they use for the retrieval of semantic knowledge. This study presents a normative database of 72 lexical categories in Hong Kong Cantonese produced by native speakers in a category exemplar production task. Exemplars are enlisted under a category label, along with the instance probabilities and word familiarity scores. Possible English equivalents are given to the exemplars for the convenience of non-HKC speaker researchers. Statistics on categories were further extracted to capture the heterogeneity of the categories: the total number of valid exemplars, the number of exemplars covering 90% of the occurrence and the probabilities of the most frequent exemplars in each category. The database offers a direct lexical sketch of the vocabulary of modern Hong Kong Cantonese in a categorical structure. The category-exemplar lists and the comparative statistics together lay the foundations for further investigations on the Hong Kong Cantonese speaking population from multiple disciplines, such as the structure of semantic knowledge, the time-course of knowledge access, and the processing strategies of young adults. Results of this norm can be also used as a benchmark for other age groups. The database can serve as a crucial resource for establishing initial screening tests to assess the cognitive and psychological functioning of the Cantonese-speaking Hong Kong population in both educational and clinical settings. In sum, this normative study provides a fundamental resource for future studies on language processing mechanisms of Hong Kong Cantonese speaking population, as well as language studies and other cross-language/culture studies on Hong Kong Cantonese.

A novel corpus developed to evaluate the impact of hospital noise on speech intelligibility

Hospital noise often exceeds recommended sound levels set by health organizations leading to reductions in speech intelligibility and communication breakdowns between doctors and patients. However, quantifying the impact of hospital noise on intelligibility has been limited by stimuli employed in prior studies, which did not include medically related terminology. To address this gap, a corpus of medically related sentences was developed. Word frequency, word familiarity, and sentence predictability, factors known to impact intelligibility of speech, were quantified. Nearly 700 words were selected from the Merriam-Webster Medical Dictionary. Word frequency was taken from Lexique, a 51-million-word corpus of American subtitles (Brysbaert & New, 2009). Word familiarity was rated by 41 monolingual listeners. The words were then used to construct 200 sentences. To determine sentence predictability, the sentences were presented to 48 participants with one word missing; their task was to fill in the missing word. Three 40 item sentence sets with different familiarity / frequency types (low/low, high/low, high/high) were selected, all with low predictability levels. These sentences and 40 standard speech perception sentences were recorded by two male and two female talkers. This corpus can be used to assess how hospital noise impacts intelligibility across listener populations. Brysbaert, M., & New, B. (2009). Moving beyond Kučera and Francis: A critical evaluation of current word frequency norms and the introduction of a new and improved word frequency measure for American English. Behavior Research Methods, 41, 977-990. doi:10.3758/BRM.41.4.977.

Forward Digit Span and Word Familiarity Do Not Correlate With Differences in Speech Recognition in Individuals With Cochlear Implants After Accounting for Auditory Resolution

Purpose In individuals with cochlear implants, speech recognition is not associated with tests of working memory that primarily reflect storage, such as forward digit span. In contrast, our previous work found that vocoded speech recognition in individuals with normal hearing was correlated with performance on a forward digit span task. A possible explanation for this difference across groups is that variability in auditory resolution across individuals with cochlear implants could conceal the true relationship between speech and memory tasks. Here, our goal was to determine if performance on forward digit span and speech recognition tasks are correlated in individuals with cochlear implants after controlling for individual differences in auditory resolution. Method We measured sentence recognition ability in 20 individuals with cochlear implants with Perceptually Robust English Sentence Test Open-set sentences. Spectral and temporal modulation detection tasks were used to assess individual differences in auditory resolution, auditory forward digit span was used to assess working memory storage, and self-reported word familiarity was used to assess vocabulary. Results Individual differences in speech recognition were predicted by spectral and temporal resolution. A correlation was found between forward digit span and speech recognition, but this correlation was not significant after controlling for spectral and temporal resolution. No relationship was found between word familiarity and speech recognition. Forward digit span performance was not associated with individual differences in auditory resolution. Conclusions Our findings support the idea that sentence recognition in individuals with cochlear implants is primarily limited by individual differences in working memory processing, not storage. Studies examining the relationship between speech and memory should control for individual differences in auditory resolution.

The predictive utility of word familiarity for online engagements and funding

Metacognitive frameworks such as processing fluency often suggest people respond more favorably to simple and common language versus complex and technical language. It is easier for people to process information that is simple and nontechnical compared to complex information, therefore leading to more engagement with targets. In two studies covering 12 field samples (total n = 1,064,533), we establish and replicate this simpler-is-better phenomenon by demonstrating people engage more with nontechnical language when giving their time and attention (e.g., simple online language tends to receive more social engagements). However, people respond to complex language when giving their money (e.g., complex language within charitable giving campaigns and grant abstracts tend to receive more money). This evidence suggests people engage with the heuristic of complex language differently depending on a time or money target. These results underscore language as a lens into social and psychological processes and computational methods to measure text patterns at scale.

Language Familiarity and Proficiency Leads to Differential Cortical Processing During Translation Between Distantly Related Languages

In the midst of globalization, English is regarded as an international language, or Lingua Franca, but learning it as a second language (L2) remains still difficult to speakers of other languages. This is true especially for the speakers of languages distantly related to English such as Japanese. In this sense, exploring neural basis for translation between the first language (L1) and L2 is of great interest. There have been relatively many previous researches revealing brain activation patterns during translations between L1 and English as L2. These studies, which focused on language translation with close or moderate linguistic distance (LD), have suggested that the Broca area (BA 44/45) and the dorsolateral prefrontal cortex (DLPFC; BA 46) may play an important role on translation. However, the neural mechanism of language translation between Japanese and English, having large LD, has not been clarified. Thus, we used functional near infrared spectroscopy (fNIRS) to investigate the brain activation patterns during word translation between Japanese and English. We also assessed the effects of translation directions and word familiarity. All participants’ first language was Japanese and they were learning English. Their English proficiency was advanced or elementary. We selected English and Japanese words as stimuli based on the familiarity for Japanese people. Our results showed that the brain activation patterns during word translation largely differed depending on their English proficiency. The advanced group elicited greater activation on the left prefrontal cortex around the Broca’s area while translating words with low familiarity, but no activation was observed while translating words with high familiarity. On the other hand, the elementary group evoked greater activation on the left temporal area including the superior temporal gyrus (STG) irrespective of the word familiarity. These results suggested that different cognitive process could be involved in word translation corresponding to English proficiency in Japanese learners of English. These difference on the brain activation patterns between the advanced and elementary group may reflect the difference on the cognitive loads depending on the levels of automatization in one’s language processing.

The Differential Effects of Subtitles on the Comprehension of Native English Connected Speech Varying in Types and Word Familiarity

Connected speech produced by native speakers poses a challenge to second language learners. Video subtitles have been found to assist the decoding of English connected speech for learners of English as a foreign language (EFL). However, the presence of subtitles may divert the listeners’ attention to the visual cues while paying less attention to the speech signals. To test this proposal, we employed a bi-modal audio-visual listening test and examined whether EFL listeners were able to correctly identify the connected speech when misleading subtitles were present. We further tested whether connected speech with words of lower frequency further reduced the accuracy rate. Twenty-eight adolescent EFL learners, all with more than 10 years of experiences in learning English in schools, were tested with three major types of connected speech phonological processes, namely assimilation, elision, and juncture. The results of statistical analyses showed that matched and mismatched subtitles facilitated the comprehension of both familiar and unfamiliar connected speech. Error analyses revealed the degree of item-specific variations across the three types of connected speech processes as well as across the three subtitling conditions. This research provides insights on the immediate and long-term impact of subtitles on the decoding of English connected speech.

The Structure of Cross-Linguistic Differences: Meaning and Context of ‘Readability’ and its Russian Equivalent ‘Chitabelnost’

The article presents the results of an original study aimed at finding (1) frequency fluctuations of the term ‘readability’ in American discourse and its Russian equivalent ‘chitabelnost’ in Russian discourse over the period from 1920s to the present; and (2) semantic similarities and differences between the English term ‘readability’ and its Russian equivalent ‘chitabelnost’ over the same period of time. A contrastive analysis of the words testified to inconsiderable differences in the semantic structures of the terms in the period under study: the term ‘readability’ has been used with the following meanings: (1) ‘the quality of being legible or decipherable’ and (2) ‘the quality of being easy or enjoyable to read’. The Russian equivalent ‘chitabelnost’ has two contemporary meanings similar to the aforementioned English meanings as well as the obsolete ‘library book checkouts’. With the help of the Google NgramViewer, we identified the 1980s frequency peak of both terms when the modern notion of the concepts was formed. The research into the topical context of readability as ‘the quality of being easy or enjoyable to read’ demonstrated empiricist tendencies in American studies focused on two types of parameters, i.e. the ‘objective’ parameters of texts, i.e. sentence length, word counts, number of high/low frequency words, ratio of high/low frequency words to total words, sentence complexity, etc. and ‘individual’ variables affecting a potential reader, such as ‘word familiarity’, cognitive and linguistic abilities, cultural and topic knowledge, etc. The Russian school’s view, until the 1970s, had traditionally been more holistic and ‘biased’ towards an individuals’ factors. The results of the study have the potential to contribute to cross-linguistic research in the area of text readability assessment, semantics, and scientific literature searches.