scholarly journals Exploiting Weak Ties in Incomplete Network Datasets Using Simplified Graph Convolutional Neural Networks

2020 ◽  
Vol 2 (2) ◽  
pp. 125-146 ◽  
Author(s):  
Neda H. Bidoki ◽  
Alexander V. Mantzaris ◽  
Gita Sukthankar
Keyword(s):  
Neural Networks ◽  
Convolutional Neural Networks ◽  
Centrality Measures ◽  
Weak Ties ◽  
Original Graph ◽  
Convolutional Network ◽  
Strong Ties ◽  
Network Nodes ◽  
Node Removal ◽  
Selection Of

This paper explores the value of weak-ties in classifying academic literature with the use of graph convolutional neural networks. Our experiments look at the results of treating weak-ties as if they were strong-ties to determine if that assumption improves performance. This is done by applying the methodological framework of the Simplified Graph Convolutional Neural Network (SGC) to two academic publication datasets: Cora and Citeseer. The performance of SGC is compared to the original Graph Convolutional Network (GCN) framework. We also examine how node removal affects prediction accuracy by selecting nodes according to different centrality measures. These experiments provide insight for which nodes are most important for the performance of SGC. When removal is based on a more localized selection of nodes, augmenting the network with both strong-ties and weak-ties provides a benefit, indicating that SGC successfully leverages local information of network nodes.

scholarly journals An Efficient Algorithm for Cardiac Arrhythmia Classification Using Ensemble of Depthwise Separable Convolutional Neural Networks

2020 ◽  
Vol 10 (2) ◽  
pp. 483 ◽  
Author(s):  
Eko Ihsanto ◽  
Kalamullah Ramli ◽  
Dodi Sudiana ◽  
Teddy Surya Gunawan
Keyword(s):  
Neural Networks ◽  
Feature Extraction ◽  
Cardiac Arrhythmia ◽  
Convolutional Neural Networks ◽  
Computational Cost ◽  
Training Data ◽  
Qrs Detection ◽  
Convolutional Network ◽  
Novel Method ◽  
Electrocardiogram Ecg

Many algorithms have been developed for automated electrocardiogram (ECG) classification. Due to the non-stationary nature of the ECG signal, it is rather challenging to use traditional handcraft methods, such as time-based analysis of feature extraction and classification, to pave the way for machine learning implementation. This paper proposed a novel method, i.e., the ensemble of depthwise separable convolutional (DSC) neural networks for the classification of cardiac arrhythmia ECG beats. Using our proposed method, the four stages of ECG classification, i.e., QRS detection, preprocessing, feature extraction, and classification, were reduced to two steps only, i.e., QRS detection and classification. No preprocessing method was required while feature extraction was combined with classification. Moreover, to reduce the computational cost while maintaining its accuracy, several techniques were implemented, including All Convolutional Network (ACN), Batch Normalization (BN), and ensemble convolutional neural networks. The performance of the proposed ensemble CNNs were evaluated using the MIT-BIH arrythmia database. In the training phase, around 22% of the 110,057 beats data extracted from 48 records were utilized. Using only these 22% labeled training data, our proposed algorithm was able to classify the remaining 78% of the database into 16 classes. Furthermore, the sensitivity ( S n ), specificity ( S p ), and positive predictivity ( P p ), and accuracy ( A c c ) are 99.03%, 99.94%, 99.03%, and 99.88%, respectively. The proposed algorithm required around 180 μs, which is suitable for real time application. These results showed that our proposed method outperformed other state of the art methods.

scholarly journals Recognizing Ancient Characters from Tamil Palm Leaf Manuscripts using Convolution Based Deep Learning

2019 ◽  
Vol 8 (3) ◽  
pp. 6873-6880
Keyword(s):  
Neural Network ◽  
Neural Networks ◽  
Image Processing ◽  
Pattern Recognition ◽  
Deep Learning ◽  
Convolutional Neural Networks ◽  
Character Recognition ◽  
Optical Character Recognition ◽  
Convolutional Network ◽  
Palm Leaf

Palm leaf manuscripts has been one of the ancient writing methods but the palm leaf manuscripts content requires to be inscribed in a new set of leaves. This study has provided a solution to save the contents in palm leaf manuscripts by recognizing the handwritten Tamil characters in manuscripts and storing them digitally. Character recognition is one of the most essential fields of pattern recognition and image processing. Generally Optical character recognition is the method of e-translation of typewritten text or handwritten images into machine editable text. The handwritten Tamil character recognition has been one of the challenging and active areas of research in the field of pattern recognition and image processing. In this study a trial was made to identify Tamil handwritten characters without extraction of feature using convolutional neural networks. This study uses convolutional neural networks for recognizing and classifying the Tamil palm leaf manuscripts of characters from separated character images. The convolutional neural network is a deep learning approach for which it does not need to retrieve features and also a rapid approach for character recognition. In the proposed system every character is expanded to needed pixels. The expanded characters have predetermined pixels and these pixels are considered as characteristics for neural network training. The trained network is employed for recognition and classification. Convolutional Network Model development contains convolution layer, Relu layer, pooling layer, fully connected layer. The ancient Tamil character dataset of 60 varying class has been created. The outputs reveal that the proposed approach generates better rates of recognition than that of schemes based on feature extraction for handwritten character recognition. The accuracy of the proposed approach has been identified as 97% which shows that the proposed approach is effective in terms of recognition of ancient characters.

scholarly journals Self-paced Convolutional Neural Networks

2017 ◽  
Author(s):  
Hao Li ◽  
Maoguo Gong
Keyword(s):  
Neural Networks ◽  
Pattern Recognition ◽  
Stationary Solution ◽  
Convolutional Neural Networks ◽  
Reliable Data ◽  
Experimental Results ◽  
Theoretical Studies ◽  
Convolutional Network ◽  
Sample Weights ◽  
Learning Rates

Convolutional neural networks (CNNs) have achieved breakthrough performance in many pattern recognition tasks. In order to distinguish the reliable data from the noisy and confusing data, we improve CNNs with self-paced learning (SPL) for enhancing the learning robustness of CNNs. In the proposed self-paced convolutional network (SPCN), each sample is assigned to a weight to reflect the easiness of the sample. Then a dynamic self-paced function is incorporated into the leaning objective of CNN to jointly learn the parameters of CNN and the latent weight variable. SPCN learns the samples from easy to complex and the sample weights can dynamically control the learning rates for converging to better values. To gain more insights of SPCN, theoretical studies are conducted to show that SPCN converges to a stationary solution and is robust to the noisy and confusing data. Experimental results on MNIST and rectangles datasets demonstrate that the proposed method outperforms baseline methods.

scholarly journals Object detection in real time based on improved single shot multi-box detector algorithm

2020 ◽  
Vol 2020 (1) ◽  
Author(s):  
Ashwani Kumar ◽  
Zuopeng Justin Zhang ◽  
Hongbo Lyu
Keyword(s):  
Neural Networks ◽  
Object Detection ◽  
Real Time ◽  
Convolutional Neural Networks ◽  
Single Layer ◽  
Single Shot ◽  
Convolutional Network ◽  
Detection Techniques ◽  
Computational Performance ◽  
Speed Up

Abstract In today’s scenario, the fastest algorithm which uses a single layer of convolutional network to detect the objects from the image is single shot multi-box detector (SSD) algorithm. This paper studies object detection techniques to detect objects in real time on any device running the proposed model in any environment. In this paper, we have increased the classification accuracy of detecting objects by improving the SSD algorithm while keeping the speed constant. These improvements have been done in their convolutional layers, by using depth-wise separable convolution along with spatial separable convolutions generally called multilayer convolutional neural networks. The proposed method uses these multilayer convolutional neural networks to develop a system model which consists of multilayers to classify the given objects into any of the defined classes. The schemes then use multiple images and detect the objects from these images, labeling them with their respective class label. To speed up the computational performance, the proposed algorithm is applied along with the multilayer convolutional neural network which uses a larger number of default boxes and results in more accurate detection. The accuracy in detecting the objects is checked by different parameters such as loss function, frames per second (FPS), mean average precision (mAP), and aspect ratio. Experimental results confirm that our proposed improved SSD algorithm has high accuracy.

Comparison between CNN and Haar classifiers for surgical instrumentation classification

2017 ◽  
Vol 10 (28) ◽  
pp. 1351-1363 ◽  
Author(s):  
Paula C. Useche Murillo ◽  
Robinson Jimenez Moreno ◽  
Javier O. Pinzon Arenas
Keyword(s):  
Neural Networks ◽  
Object Recognition ◽  
Convolutional Neural Networks ◽  
Video Sequence ◽  
Surgical Instrumentation ◽  
Detection Stage ◽  
Scene Information ◽  
The One ◽  
Selection Of

The following paper presents the development, operation and comparison of two methods of object recognition trained for the classification of surgical instrumentation, where a video sequence is used to capture scene information constantly, in order to allow the selection of some of the instruments according to the needs of the doctor. The methods used were Convolutional Neural Networks (CNN) and Haar classifiers, where the first was added a previous element detection stage, and the second one was conditioned to allow it not only to detect elements, but also to classify them. With the CNN an accuracy of 96.4% in the classification of the two categories of the first branch of the tree was reached, while for Haar classifiers 90% accuracy was achieved in the detection of one of the five instruments, whose classifier was the one that presented the best results.

scholarly journals Image recognition algorithms based on deep learning

2021 ◽  
Vol 2137 (1) ◽  
pp. 012056
Author(s):  
Hongli Ma ◽  
Fang Xie ◽  
Tao Chen ◽  
Lei Liang ◽  
Jie Lu
Keyword(s):  
Neural Network ◽  
Neural Networks ◽  
Deep Learning ◽  
Convolutional Neural Network ◽  
Convolutional Neural Networks ◽  
Development Process ◽  
Research Direction ◽  
Learning Technology ◽  
Convolutional Network ◽  
Important Research Direction

Abstract Convolutional neural network is a very important research direction in deep learning technology. According to the current development of convolutional network, in this paper, convolutional neural networks are induced. Firstly, this paper induces the development process of convolutional neural network; then it introduces the structure of convolutional neural network and some typical convolutional neural networks. Finally, several examples of the application of deep learning is introduced.

scholarly journals A method of searching and marking artifacts in images applying detection and segmentation algorithms

2021 ◽  
pp. 7-18
Author(s):  
Andrey M. Kitenko ◽  
Keyword(s):  
Neural Networks ◽  
Network Models ◽  
Semantic Segmentation ◽  
Document Processing ◽  
Neural Network Models ◽  
Convolutional Network ◽  
Human Errors ◽  
Search And Selection ◽  
Stress Fatigue ◽  
Selection Of

The paper explores the possibility of using neural networks to single out target artifacts on different types of documents. Numerous types of neural networks are often used for document processing, from text analysis to the allocation of certain areas where the desired information may be contained. However, to date, there are no perfect document processing systems that can work autonomously, compensating for human errors that may appear in the process of work due to stress, fatigue and many other reasons. In this work, the emphasis is on the search and selection of target artifacts in drawings, in conditions of a small amount of initial data. The proposed method of searching and highlighting artifacts in the image consists of two main parts, detection and semantic segmentation of the detected area. The method is based on training with a teacher on marked-up data for two convolutional neural networks. The first convolutional network is used to detect an area with an artifact, in this example YoloV4 was taken as the basis. For semantic segmentation, the U-Net architecture is used, where the basis is the pre-trained Efficientnetb0. By combining these neural networks, good results were achieved, even for the selection of certain handwritten texts, without using the specifics of building neural network models for text recognition. This method can be used to search for and highlight artifacts in large datasets, while the artifacts themselves may be different in shape, color and type, and they may be located in different places of the image, have or not have intersection with other objects.

scholarly journals Dual Self-Paced Graph Convolutional Network: Towards Reducing Attribute Distortions Induced by Topology

2019 ◽  
Author(s):  
Liang Yang ◽  
Zhiyang Chen ◽  
Junhua Gu ◽  
Yuanfang Guo
Keyword(s):  
Neural Networks ◽  
Learning Strategies ◽  
Convolutional Neural Networks ◽  
Training Process ◽  
Training Set ◽  
Convolutional Network ◽  
Attribute Information ◽  
Topology Information ◽  
Node Classification ◽  
The Impact

The success of graph convolutional neural networks (GCNNs) based semi-supervised node classification is credited to the attribute smoothing (propagating) over the topology. However, the attributes may be interfered by the utilization of the topology information. This distortion will induce a certain amount of misclassifications of the nodes, which can be correctly predicted with only the attributes. By analyzing the impact of the edges in attribute propagations, the simple edges, which connect two nodes with similar attributes, should be given priority during the training process compared to the complex ones according to curriculum learning. To reduce the distortions induced by the topology while exploit more potentials of the attribute information, Dual Self-Paced Graph Convolutional Network (DSP-GCN) is proposed in this paper. Specifically, the unlabelled nodes with confidently predicted labels are gradually added into the training set in the node-level self-paced learning, while edges are gradually, from the simple edges to the complex ones, added into the graph during the training process in the edge-level self-paced learning. These two learning strategies are designed to mutually reinforce each other by coupling the selections of the edges and unlabelled nodes. Experimental results of transductive semi-supervised node classification on many real networks indicate that the proposed DSP-GCN has successfully reduced the attribute distortions induced by the topology while it gives superior performances with only one graph convolutional layer.

Sign in / Sign up

Export Citation Format

Share Document