Adaptive speech coding with DCT and neural net vector quantisation

1993 ◽  
Vol 29 (8) ◽  
pp. 704 ◽  
Author(s):  
L.V. Veleva ◽  
R.K. Kunchev
Keyword(s):  
Speech Coding ◽  
Neural Net ◽  
Vector Quantisation

Using artificial neural network condensation to facilitate adaption of machine learning in medical settings by reducing computational burden (Preprint)

2020 ◽  
Author(s):  
Dianbo Liu
Keyword(s):  
Neural Network ◽  
Machine Learning ◽  
Third World ◽  
Mortality Prediction ◽  
Neural Net ◽  
Medical Settings ◽  
Hidden Layer ◽  
Applications Of Machine Learning ◽  
Computational Resources ◽  
Developed Nations

BACKGROUND Applications of machine learning (ML) on health care can have a great impact on people’s lives. At the same time, medical data is usually big, requiring a significant amount of computational resources. Although it might not be a problem for wide-adoption of ML tools in developed nations, availability of computational resource can very well be limited in third-world nations and on mobile devices. This can prevent many people from benefiting of the advancement in ML applications for healthcare. OBJECTIVE In this paper we explored three methods to increase computational efficiency of either recurrent neural net-work(RNN) or feedforward (deep) neural network (DNN) while not compromising its accuracy. We used in-patient mortality prediction as our case analysis upon intensive care dataset. METHODS We reduced the size of RNN and DNN by applying pruning of “unused” neurons. Additionally, we modified the RNN structure by adding a hidden-layer to the RNN cell but reduce the total number of recurrent layers to accomplish a reduction of total parameters in the network. Finally, we implemented quantization on DNN—forcing the weights to be 8-bits instead of 32-bits. RESULTS We found that all methods increased implementation efficiency–including training speed, memory size and inference speed–without reducing the accuracy of mortality prediction. CONCLUSIONS This improvements allow the implementation of sophisticated NN algorithms on devices with lower computational resources.

Sign in / Sign up

Export Citation Format

Share Document