Improving Children's Speech Recognition Through Time Scale Modification Based Speaking Rate Adaptation

2018 ◽  
Author(s):  
Hemant K. Kathania ◽  
S Shahnawazuddin ◽  
Waquar Ahmad ◽  
Nagraj Adiga ◽  
S. K. Jana ◽  
...  
Keyword(s):  
Speech Recognition ◽  
Time Scale ◽  
Rate Adaptation ◽  
Speaking Rate ◽  
Time Scale Modification ◽  
Children’S Speech Recognition ◽  
Children's Speech

scholarly journals Using Data Augmentation and Time-Scale Modification to Improve ASR of Children’s Speech in Noisy Environments

2021 ◽  
Vol 11 (18) ◽  
pp. 8420
Author(s):  
Hemant Kumar Kathania ◽  
Sudarsana Reddy Kadiri ◽  
Paavo Alku ◽  
Mikko Kurimo
Keyword(s):  
Time Scale ◽  
Additive Noise ◽  
Data Augmentation ◽  
Training Data ◽  
Speaking Rate ◽  
Noisy Environments ◽  
Testing Phase ◽  
Combining Data ◽  
Time Scale Modification ◽  
Children's Speech

Current ASR systems show poor performance in recognition of children’s speech in noisy environments because recognizers are typically trained with clean adults’ speech and therefore there are two mismatches between training and testing phases (i.e., clean speech in training vs. noisy speech in testing and adult speech in training vs. child speech in testing). This article studies methods to tackle the effects of these two mismatches in recognition of noisy children’s speech by investigating two techniques: data augmentation and time-scale modification. In the former, clean training data of adult speakers are corrupted with additive noise in order to obtain training data that better correspond to the noisy testing conditions. In the latter, the fundamental frequency (F0) and speaking rate of children’s speech are modified in the testing phase in order to reduce differences in the prosodic characteristics between the testing data of child speakers and the training data of adult speakers. A standard ASR system based on DNN–HMM was built and the effects of data augmentation, F0 modification, and speaking rate modification on word error rate (WER) were evaluated first separately and then by combining all three techniques. The experiments were conducted using children’s speech corrupted with additive noise of four different noise types in four different signal-to-noise (SNR) categories. The results show that the combination of all three techniques yielded the best ASR performance. As an example, the WER value averaged over all four noise types in the SNR category of 5 dB dropped from 32.30% to 12.09% when the baseline system, in which no data augmentation or time-scale modification were used, was replaced with a recognizer that was built using a combination of all three techniques. In summary, in recognizing noisy children’s speech with ASR systems trained with clean adult speech, considerable improvements in the recognition performance can be achieved by combining data augmentation based on noise addition in the system training phase and time-scale modification based on modifying F0 and speaking rate of children’s speech in the testing phase.

Sign in / Sign up

Export Citation Format

Share Document