scholarly journals Fixed-Sign Binary Neural Network: An Efficient Design of Neural Network for Internet-of-Things Devices

IEEE Access ◽  
2020 ◽  
Vol 8 ◽  
pp. 164858-164863
Author(s):  
Yang Li ◽  
Yuanyuan Bao ◽  
Wai Chen
Keyword(s):  
Neural Network ◽  
Internet Of Things ◽  
Efficient Design ◽  
Fixed Sign ◽  
Binary Neural Network

scholarly journals An efficient pruning scheme of deep neural networks for Internet of Things applications

2021 ◽  
Vol 2021 (1) ◽  
Author(s):  
Chen Qi ◽  
Shibo Shen ◽  
Rongpeng Li ◽  
Zhifeng Zhao ◽  
Qing Liu ◽  
...  
Keyword(s):  
Neural Network ◽  
Neural Networks ◽  
Internet Of Things ◽  
Deep Neural Networks ◽  
Computational Cost ◽  
Superior Performance ◽  
Compact Structure ◽  
Resource Limited ◽  
Benchmark Datasets ◽  
Iot Devices

AbstractNowadays, deep neural networks (DNNs) have been rapidly deployed to realize a number of functionalities like sensing, imaging, classification, recognition, etc. However, the computational-intensive requirement of DNNs makes it difficult to be applicable for resource-limited Internet of Things (IoT) devices. In this paper, we propose a novel pruning-based paradigm that aims to reduce the computational cost of DNNs, by uncovering a more compact structure and learning the effective weights therein, on the basis of not compromising the expressive capability of DNNs. In particular, our algorithm can achieve efficient end-to-end training that transfers a redundant neural network to a compact one with a specifically targeted compression rate directly. We comprehensively evaluate our approach on various representative benchmark datasets and compared with typical advanced convolutional neural network (CNN) architectures. The experimental results verify the superior performance and robust effectiveness of our scheme. For example, when pruning VGG on CIFAR-10, our proposed scheme is able to significantly reduce its FLOPs (floating-point operations) and number of parameters with a proportion of 76.2% and 94.1%, respectively, while still maintaining a satisfactory accuracy. To sum up, our scheme could facilitate the integration of DNNs into the common machine-learning-based IoT framework and establish distributed training of neural networks in both cloud and edge.

scholarly journals Multiplexed neurochemical transmission emulated using a dual-excitatory synaptic transistor

2021 ◽  
Vol 5 (1) ◽  
Author(s):  
Mingxue Ma ◽  
Yao Ni ◽  
Zirong Chi ◽  
Wanqing Meng ◽  
Haiyang Yu ◽  
...  
Keyword(s):  
Neural Network ◽  
Central Nervous System ◽  
Nervous System ◽  
Long Term Potentiation ◽  
Short Term ◽  
Term Potentiation ◽  
Binary Neural Network ◽  
Neuromorphic Systems ◽  
Human Brains

AbstractThe ability to emulate multiplexed neurochemical transmission is an important step toward mimicking complex brain activities. Glutamate and dopamine are neurotransmitters that regulate thinking and impulse signals independently or synergistically. However, emulation of such simultaneous neurotransmission is still challenging. Here we report design and fabrication of synaptic transistor that emulates multiplexed neurochemical transmission of glutamate and dopamine. The device can perform glutamate-induced long-term potentiation, dopamine-induced short-term potentiation, or co-release-induced depression under particular stimulus patterns. More importantly, a balanced ternary system that uses our ambipolar synaptic device backtrack input ‘true’, ‘false’ and ‘unknown’ logic signals; this process is more similar to the information processing in human brains than a traditional binary neural network. This work provides new insight for neuromorphic systems to establish new principles to reproduce the complexity of a mammalian central nervous system from simple basic units.

Efficient Design of Spiking Neural Network With STDP Learning Based on Fast CORDIC

2021 ◽  
pp. 1-13
Author(s):  
Jiajun Wu ◽  
Yi Zhan ◽  
Zixuan Peng ◽  
Xinglong Ji ◽  
Guoyi Yu ◽  
...  
Keyword(s):  
Neural Network ◽  
Spiking Neural Network ◽  
Efficient Design
Sign in / Sign up

Export Citation Format

Share Document