Coupled End-to-End Transfer Learning with Generalized Fisher Information

2018 ◽  
Author(s):  
Shixing Chen ◽  
Caojin Zhang ◽  
Ming Dong
Keyword(s):  
Transfer Learning ◽  
Fisher Information ◽  
End To End ◽  
Generalized Fisher Information

scholarly journals Cross-Language End-to-End Speech Recognition Research Based on Transfer Learning for the Low-Resource Tujia Language

Symmetry ◽  
2019 ◽  
Vol 11 (2) ◽  
pp. 179 ◽  
Author(s):  
Chongchong Yu ◽  
Yunbing Chen ◽  
Yueqiao Li ◽  
Meng Kang ◽  
Shixuan Xu ◽  
...  
Keyword(s):  
Speech Recognition ◽  
Transfer Learning ◽  
Short Term Memory ◽  
Recognition System ◽  
Language Recognition ◽  
Low Resource ◽  
End To End ◽  
The Cross ◽  
Hidden Layer ◽  
Cross Language

To rescue and preserve an endangered language, this paper studied an end-to-end speech recognition model based on sample transfer learning for the low-resource Tujia language. From the perspective of the Tujia language international phonetic alphabet (IPA) label layer, using Chinese corpus as an extension of the Tujia language can effectively solve the problem of an insufficient corpus in the Tujia language, constructing a cross-language corpus and an IPA dictionary that is unified between the Chinese and Tujia languages. The convolutional neural network (CNN) and bi-directional long short-term memory (BiLSTM) network were used to extract the cross-language acoustic features and train shared hidden layer weights for the Tujia language and Chinese phonetic corpus. In addition, the automatic speech recognition function of the Tujia language was realized using the end-to-end method that consists of symmetric encoding and decoding. Furthermore, transfer learning was used to establish the model of the cross-language end-to-end Tujia language recognition system. The experimental results showed that the recognition error rate of the proposed model is 46.19%, which is 2.11% lower than the that of the model that only used the Tujia language data for training. Therefore, this approach is feasible and effective.

scholarly journals Curriculum-Based Transfer Learning for an Effective End-to-End Spoken Language Understanding and Domain Portability

2019 ◽  
Author(s):  
Antoine Caubrière ◽  
Natalia Tomashenko ◽  
Antoine Laurent ◽  
Emmanuel Morin ◽  
Nathalie Camelin ◽  
...  
Keyword(s):  
Transfer Learning ◽  
Spoken Language ◽  
Language Understanding ◽  
Spoken Language Understanding ◽  
End To End
Sign in / Sign up

Export Citation Format

Share Document