Synthesis of Emotional Speech by Prosody Modification of Vowel Segments of Neutral Speech

Recent Patents on Computer Science ◽

10.2174/2213275912666191112144014 ◽

2019 ◽

Vol 12 ◽

Author(s):

Md Shah Fahad ◽

Shruti Gupta ◽

Abhinav ◽

Shreya Singh ◽

Akshay Deepak

Keyword(s):

Speech Synthesis ◽

Emotional Speech ◽

Vocal Cords ◽

Human Machine Interaction ◽

Fine Grained ◽

Opinion Score ◽

Intensity Parameters ◽

Prosody Modification ◽

Machine Interaction ◽

Gender Specific

Background: Emotional speech synthesis is the process of synthesising emotions in a neutral speech – potentially generated by a text-to-speech system – to make an artificial human-machine interaction human-like. It typically involves analysis and modification of speech parameters. Existing work on speech synthesis involving modification of prosody parameters does so at sentence, word, and syllable level. However, further fine-grained modification at vowel level has not been explored yet, thereby motivating our work. Objective: To explore prosody parameters at vowel level for emotion synthesis. Method: Our work modifies prosody features (duration, pitch, and intensity) for emotion synthesis. Specifically, it modifies the duration parameter of vowel-like and pause regions and the pitch and intensity parameters of only vowel-like regions. The modification is gender specific using emotional speech templates stored in a database and done using pitch synchronous overlap and add (PSOLA) method. Result: Comparison was done with the existing work on prosody modification at sentence, word and syllable label on IITKGP-SEHSC database. Improvements of 8.14%, 13.56%, and 2.80% for emotions angry, happy, and fear respectively were obtained for the relative mean opinion score. This was due to: (1) prosody modification at vowel-level being more fine-grained than sentence, word, or syllable level and (2) prosody patterns not being generated for consonant regions because vocal cords do not vibrate during consonant production. Conclusion: Our proposed work shows that an emotional speech generated using prosody modification at vowel-level is more convincible than prosody modification at sentence, word and syllable level.

Download Full-text