Speechreading sentences with single‐channel vibrotactile presentation of voice fundamental frequency

1990 ◽  
Vol 88 (3) ◽  
pp. 1274-1285 ◽  
Author(s):  
Silvio P. Eberhardt ◽  
Lynne E. Bernstein ◽  
Marilyn E. Demorest ◽  
Moise H. Goldstein
Keyword(s):  
Fundamental Frequency ◽  
Single Channel ◽  
Voice Fundamental Frequency

Speechreading Supplemented by Single-Channel and Multichannel Tactile Displays of Voice Fundamental Frequency

1995 ◽  
Vol 38 (3) ◽  
pp. 690-705 ◽  
Author(s):  
Robin S. Waldstein ◽  
Arthur Boothroyd
Keyword(s):  
Fundamental Frequency ◽  
Single Channel ◽  
Index Finger ◽  
Tactile Display ◽  
Auditory Presentation ◽  
Enhancement Effect ◽  
Past Performance ◽  
Percentage Points ◽  
Tactile Displays ◽  
Voice Fundamental Frequency

The benefits of two tactile codes of voice fundamental frequency (F o ) were evaluated as supplements to the speechreading of sentences in two short-term training studies, each using 12 adults with normal hearing. In Experiment 1, a multichannel spatiotemporal display of F o , known as Portapitch, was used to stimulate the index finger. In an attempt to improve on past performance with this display, the coding scheme was modified to better cover the F o range of the talker in the training materials. For Experiment 2, to engage kinesthetic/proprioceptive pathways, a novel single-channel positional display was built, in which F o was coded as the vertical displacement of a small finger-rest. Input to both displays consisted of synthesized replicas of the F o contours of the sentences, prepared and perfected off-line. Training with the two tactile F o displays included auditory presentation of the synthesized F o contours in conjunction with the tactile patterns on alternate trials. Speechreading enhancement by the two tactile F o displays was compared to the enhancement provided when auditory F o information was available in conjunction with the tactile patterns, by auditory presentation of a sinusoidal indication of the presence or absence of voicing, and by a single-channel tactile display of the speech waveform presented to the index finger. Despite the modified coding strategy, the multichannel Portapitch provided a mean tactile speechreading enhancement of 7 percentage points, which was no greater than that found in previous studies. The novel positional F o display provided only a 4 percentage point enhancement. Neither F o display was better than the simple single-channel tactile transform of the full speech waveform, which gave a 7 percentage point enhancement effect. Auditory speechreading enhancement effects were 17 percentage points with the voicing indicator and approximately 35 percentage points when the auditory F o contour was provided in conjunction with the tactile displays. The findings are consistent with the hypothesis that subjects were not taking full advantage of the F o variation information available in the outputs of the two experimental tactile displays.

Signal-Processing Hearing Aids for the Totally and Profoundly Deaf

1987 ◽  
Vol 96 (1_suppl) ◽  
pp. 74-76
Author(s):  
J. R. Walliker ◽  
A. J. Fourcin
Keyword(s):  
Signal Processing ◽  
Fundamental Frequency ◽  
Hearing Aids ◽  
Single Channel ◽  
Round Window ◽  
Low Frequency ◽  
Single Chip ◽  
Desktop Computer ◽  
Signal Presentation ◽  
Voice Fundamental Frequency

We have developed a family of single-channel signal-processing aids for the profoundly and totally deaf. Common to them all are the analysis of speech into the components most important to the deaf lipreader; the synthesis of stimuli which make the best use of the patient's sensory abilities; and facilities to ensure accurate matching of the aid to the patient. The totally deaf are electrically stimulated by electrodes on the promontory or on the round window of the cochlea using charge-balanced controlled current square waves automatically adjusted to be at a comfortable level. Many potential candidates for electrocochlear stimulation have significant low frequency residual hearing, but do not find conventional hearing aids to be useful. We have found that they can often make very effective use of the voice fundamental frequency presented as an acoustic sinusoid. Our approach to these patients avoids the need for implant surgery but preserves that option should total loss of hearing occur in the future. Both electrocochlear and acoustic methods of signal presentation are implemented with similar hardware. The speech signal from a microphone or other source is analyzed by a voice fundamental frequency extractor and a voiceless sound detector. Their outputs are processed by a single chip microcomputer that synthesizes the output waveform. In both devices the aid is tailored to the patient using a desktop computer that stores amplitude-frequency characteristics and frequency mapping tables into a read-only memory.

scholarly journals Lipreading with single‐channel vibrotactile presentation of voice fundamental frequency

1987 ◽  
Vol 82 (S1) ◽  
pp. S22-S22
Author(s):  
Lynne E. Bernstein ◽  
Silvio P. Eberhardt ◽  
Marilyn E. Demorest
Keyword(s):  
Fundamental Frequency ◽  
Single Channel ◽  
Voice Fundamental Frequency

Effects of Laryngeal Topical Anesthesia on Voice Fundamental Frequency Perturbation

1980 ◽  
Vol 23 (2) ◽  
pp. 274-283 ◽  
Author(s):  
David Sorensen ◽  
Yoshiyuki Horii ◽  
Rebecca Leonard
Keyword(s):  
Fundamental Frequency ◽  
High Frequency ◽  
Frequency Control ◽  
Topical Anesthesia ◽  
Proprioceptive Feedback ◽  
Adult Males ◽  
Voice Fundamental Frequency

Fundamental frequency perturbation (jitter) during sustained vowel phonations of speakers under topical anesthesia of the larynx was investigated for five adult males. The results showed that the average jitter was significantly greater under the anesthesia than normal conditions, and that the jitter difference between the two conditions was more prominent at high frequency phonations. Implications of these data for tactile and proprioceptive feedback in phonatory frequency control are discussed.

A Study of Buccal Speech

1971 ◽  
Vol 14 (3) ◽  
pp. 652-658 ◽  
Author(s):  
Bernd Weinberg ◽  
Jan Westerhouse
Keyword(s):  
Fundamental Frequency ◽  
Speaking Rate ◽  
Intensive Study ◽  
Speech Characteristics ◽  
Voice Fundamental Frequency ◽  
Normal Speaking

An intensive study of a normal-speaking subject, proficient in the use of buccal speech, was conducted. With respect to voice fundamental frequency variability, phonation time, and speaking rate his buccal speech characteristics compared favorably with those reported for excellent esophageal speakers. However, the reduced intelligibility of his buccal speech on rhyme-test words, the high average fundamental frequency of his buccal voice, and his conspicuous buccal gestures during speech represent distinct vocal liabilities.

Speaking Fundamental Frequency Characteristics of Five- and Six-Year-Old Children with Mongolism

1970 ◽  
Vol 13 (2) ◽  
pp. 418-425 ◽  
Author(s):  
Bernd Weinberg ◽  
Marsha Zlatin
Keyword(s):  
Fundamental Frequency ◽  
Trisomy 21 ◽  
Clinical Observation ◽  
Control Sample ◽  
Frequency Standard ◽  
Normal Children ◽  
The Subject ◽  
The Mean ◽  
Voice Fundamental Frequency ◽  
Speaking Fundamental Frequency

Spontaneous speech samples of 27 children with trisomy-21 type Down’s syndrome and 66 normal children were tape-recorded and analyzed for mean fundamental frequency, standard deviation, and range. Results indicate that the mean speaking fundamental frequency (SFF) level for the sample of children with mongolism was significantly higher than the mean SFF level for the control sample. Approximately 50% of the children with mongolism had mean SFF levels exceeding the highest mean SFF level of their matched controls. In only two cases did the mean SFF for a child with mongolism fall below the mean SFF level for control children of the same age and sex. No child with mongolism exhibited a mean SFF level below the lowest mean SFF for any control subject. The subject in question is the clinical observation that children with mongolism typically have low voice fundamental frequency levels.

Sign in / Sign up

Export Citation Format

Share Document