Application and performance of convolutional neural networks to SAR

2018 ◽  
Author(s):  
Ram M. Narayanan ◽  
Maxine R. Fox
Keyword(s):  
Neural Networks ◽  
Convolutional Neural Networks ◽  
And Performance

scholarly journals Road Characteristics Detection Based on Joint Convolutional Neural Networks with Adaptive Squares

2021 ◽  
Vol 10 (6) ◽  
pp. 377
Author(s):  
Chiao-Ling Kuo ◽  
Ming-Hua Tsai
Keyword(s):  
Neural Networks ◽  
Convolutional Neural Networks ◽  
Autonomous Vehicles ◽  
Detection Accuracy ◽  
Geospatial Information ◽  
Combination Rules ◽  
And Performance ◽  
Road Characteristics ◽  
Machine Readable ◽  
Background Image

The importance of road characteristics has been highlighted, as road characteristics are fundamental structures established to support many transportation-relevant services. However, there is still huge room for improvement in terms of types and performance of road characteristics detection. With the advantage of geographically tiled maps with high update rates, remarkable accessibility, and increasing availability, this paper proposes a novel simple deep-learning-based approach, namely joint convolutional neural networks (CNNs) adopting adaptive squares with combination rules to detect road characteristics from roadmap tiles. The proposed joint CNNs are responsible for the foreground and background image classification and various types of road characteristics classification from previous foreground images, raising detection accuracy. The adaptive squares with combination rules help efficiently focus road characteristics, augmenting the ability to detect them and provide optimal detection results. Five types of road characteristics—crossroads, T-junctions, Y-junctions, corners, and curves—are exploited, and experimental results demonstrate successful outcomes with outstanding performance in reality. The information of exploited road characteristics with location and type is, thus, converted from human-readable to machine-readable, the results will benefit many applications like feature point reminders, road condition reports, or alert detection for users, drivers, and even autonomous vehicles. We believe this approach will also enable a new path for object detection and geospatial information extraction from valuable map tiles.

Diagnosis of Brain Tumor Using Nano Segmentation and Advanced-Convolutional Neural Networks Classification

2021 ◽  
Vol 11 (12) ◽  
pp. 2907-2917
Author(s):  
P. V. Deepa ◽  
S. Joseph Jawhar ◽  
J. Merry Geisa
Keyword(s):  
Neural Networks ◽  
Convolutional Neural Networks ◽  
Brain Tumours ◽  
Malignant Tumour ◽  
Training Data ◽  
Correct Identification ◽  
Imaging Model ◽  
And Performance ◽  
Percent Accuracy ◽  
High Level

The field of nanotechnology has lately acquired prominence according to the raised level of correct identification and performance in the patients using Computer-Aided Diagnosis (CAD). Nano-scale imaging model enables for a high level of precision and accuracy in determining if a brain tumour is malignant or benign. This contributes to people with brain tumours having a better standard of living. In this study, We present a revolutionary Semantic nano-segmentation methodology for the nanoscale classification of brain tumours. The suggested Advanced-Convolutional Neural Networks-based Semantic Nano-segmentation will aid radiologists in detecting brain tumours even when lesions are minor. ResNet-50 was employed in the suggested Advanced-Convolutional Neural Networks (A-CNN) approach. The tumour image is partitioned using Semantic Nano-segmentation, that has averaged dice and SSIM values of 0.9704 and 0.2133, correspondingly. The input is a nano-image, and the tumour image is segmented using Semantic Nano-segmentation, which has averaged dice and SSIM values of 0.9704 and 0.2133, respectively. The suggested Semantic nano segments achieves 93.2 percent and 92.7 percent accuracy for benign and malignant tumour pictures, correspondingly. For malignant or benign pictures, The accuracy of the A-CNN methodology of correct segmentation is 99.57 percent and 95.7 percent, respectively. This unique nano-method is designed to detect tumour areas in nanometers (nm) and hence accurately assess the illness. The suggested technique’s closeness to with regard to True Positive values, the ROC curve implies that it outperforms earlier approaches. A comparison analysis is conducted on ResNet-50 using testing and training data at rates of 90%–10%, 80%–20%, and 70%–30%, corresponding, indicating the utility of the suggested work.

scholarly journals MB-CNN: Memristive Binary Convolutional Neural Networks for Embedded Mobile Devices

2018 ◽  
Vol 8 (4) ◽  
pp. 38 ◽  
Author(s):  
Arjun Pal Chowdhury ◽  
Pranav Kulkarni ◽  
Mahdi Nazm Bojnordi
Keyword(s):  
Neural Networks ◽  
Mobile Devices ◽  
Convolutional Neural Networks ◽  
Mobile User ◽  
Power Performance ◽  
Performance Requirements ◽  
System Energy ◽  
And Performance ◽  
The Cost

Applications of neural networks have gained significant importance in embedded mobile devices and Internet of Things (IoT) nodes. In particular, convolutional neural networks have emerged as one of the most powerful techniques in computer vision, speech recognition, and AI applications that can improve the mobile user experience. However, satisfying all power and performance requirements of such low power devices is a significant challenge. Recent work has shown that binarizing a neural network can significantly improve the memory requirements of mobile devices at the cost of minor loss in accuracy. This paper proposes MB-CNN, a memristive accelerator for binary convolutional neural networks that perform XNOR convolution in-situ novel 2R memristive data blocks to improve power, performance, and memory requirements of embedded mobile devices. The proposed accelerator achieves at least 13.26 × , 5.91 × , and 3.18 × improvements in the system energy efficiency (computed by energy × delay) over the state-of-the-art software, GPU, and PIM architectures, respectively. The solution architecture which integrates CPU, GPU and MB-CNN outperforms every other configuration in terms of system energy and execution time.

scholarly journals Structured Sparsity of Convolutional Neural Networks via Nonconvex Sparse Group Regularization

2021 ◽  
Vol 6 ◽  
Author(s):  
Kevin Bui ◽  
Fredrick Park ◽  
Shuai Zhang ◽  
Yingyong Qi ◽  
Jack Xin
Keyword(s):  
Neural Networks ◽  
Convolutional Neural Networks ◽  
Group Lasso ◽  
Test Accuracy ◽  
Group Sparsity ◽  
Sparse Group Lasso ◽  
Nonconvex Regularization ◽  
And Performance ◽  
The Individual ◽  
Network Sparsification

Convolutional neural networks (CNN) have been hugely successful recently with superior accuracy and performance in various imaging applications, such as classification, object detection, and segmentation. However, a highly accurate CNN model requires millions of parameters to be trained and utilized. Even to increase its performance slightly would require significantly more parameters due to adding more layers and/or increasing the number of filters per layer. Apparently, many of these weight parameters turn out to be redundant and extraneous, so the original, dense model can be replaced by its compressed version attained by imposing inter- and intra-group sparsity onto the layer weights during training. In this paper, we propose a nonconvex family of sparse group lasso that blends nonconvex regularization (e.g., transformed ℓ1, ℓ1−ℓ2, and ℓ0) that induces sparsity onto the individual weights and ℓ2,1 regularization onto the output channels of a layer. We apply variable splitting onto the proposed regularization to develop an algorithm that consists of two steps per iteration: gradient descent and thresholding. Numerical experiments are demonstrated on various CNN architectures showcasing the effectiveness of the nonconvex family of sparse group lasso in network sparsification and test accuracy on par with the current state of the art.

scholarly journals Golf swing classification with multiple deep convolutional neural networks

2018 ◽  
Vol 14 (10) ◽  
pp. 155014771880218 ◽  
Author(s):  
Libin Jiao ◽  
Rongfang Bie ◽  
Hao Wu ◽  
Yu Wei ◽  
Jixin Ma ◽  
...  
Keyword(s):  
Neural Network ◽  
Neural Networks ◽  
Convolutional Neural Network ◽  
Convolutional Neural Networks ◽  
Golf Swing ◽  
Support Vector ◽  
Classification Methods ◽  
Deep Convolutional Neural Networks ◽  
Machine Method ◽  
And Performance

The use of smart sports equipment and body sensory systems supervising daily sports training is gradually emerging in professional and amateur sports; however, the problem of processing large amounts of data from sensors used in sport and discovering constructive knowledge is a novel topic and the focus of our research. In this article, we investigate golf swing data classification methods based on varieties of representative convolutional neural networks (deep convolutional neural networks) which are fed with swing data from embedded multi-sensors, to group the multi-channel golf swing data labeled by hybrid categories from different golf players and swing shapes. In particular, four convolutional neural classifiers are customized: “GolfVanillaCNN” with the convolutional layers, “GolfVGG” with the stacked convolutional layers, “GolfInception” with the multi-scale convolutional layers, and “GolfResNet” with the residual learning. Testing on the real-world swing dataset sampled from the system integrating two strain gage sensors, three-axis accelerometer, and three-axis gyroscope, we explore the accuracy and performance of our convolutional neural network–based classifiers from two perspectives: classification implementations and sensor combinations. Besides, we further evaluate the performance of these four classifiers in terms of classification accuracy, precision–recall curves, and F1 scores. These common classification indicators illustrate that our convolutional neural network–based classifiers can basically group the golf swing predefined by the combination of shapes and golf players correctly and outperform support vector machine method representing traditional classification methods.

scholarly journals Pipelined Training with Stale Weights in Deep Convolutional Neural Networks

2021 ◽  
Vol 2021 ◽  
pp. 1-16
Author(s):  
Lifu Zhang ◽  
Tarek S. Abdelrahman
Keyword(s):  
Neural Networks ◽  
Convolutional Neural Networks ◽  
Network Inference ◽  
Proof Of Concept ◽  
Statistical Efficiency ◽  
Deep Convolutional Neural Networks ◽  
Training Scheme ◽  
Memory Overhead ◽  
And Performance ◽  
The Impact

The growth in size and complexity of convolutional neural networks (CNNs) is forcing the partitioning of a network across multiple accelerators during training and pipelining of backpropagation computations over these accelerators. Pipelining results in the use of stale weights. Existing approaches to pipelined training avoid or limit the use of stale weights with techniques that either underutilize accelerators or increase training memory footprint. This paper contributes a pipelined backpropagation scheme that uses stale weights to maximize accelerator utilization and keep memory overhead modest. It explores the impact of stale weights on the statistical efficiency and performance using 4 CNNs (LeNet-5, AlexNet, VGG, and ResNet) and shows that when pipelining is introduced in early layers, training with stale weights converges and results in models with comparable inference accuracies to those resulting from nonpipelined training (a drop in accuracy of 0.4%, 4%, 0.83%, and 1.45% for the 4 networks, respectively). However, when pipelining is deeper in the network, inference accuracies drop significantly (up to 12% for VGG and 8.5% for ResNet-20). The paper also contributes a hybrid training scheme that combines pipelined with nonpipelined training to address this drop. The potential for performance improvement of the proposed scheme is demonstrated with a proof-of-concept pipelined backpropagation implementation in PyTorch on 2 GPUs using ResNet-56/110/224/362, achieving speedups of up to 1.8X over a 1-GPU baseline.

Sign in / Sign up

Export Citation Format

Share Document