scholarly journals An Improved Optical Flow Algorithm Based on Mask-R-CNN and K-Means for Velocity Calculation

2019 ◽  
Vol 9 (14) ◽  
pp. 2808 ◽  
Author(s):  
Yahui Peng ◽  
Xiaochen Liu ◽  
Chong Shen ◽  
Haoqian Huang ◽  
Donghua Zhao ◽  
...  
Keyword(s):  
Neural Network ◽  
Convolutional Neural Network ◽  
Optical Flow ◽  
Navigation System ◽  
Moving Objects ◽  
Harmful Effect ◽  
Improved Method ◽  
Vision Navigation ◽  
Vehicle Velocity ◽  
Flow Algorithm

Aiming at enhancing the accuracy and reliability of velocity calculation in vision navigation, an improved method is proposed in this paper. The method integrates Mask-R-CNN (Mask Region-based Convolutional Neural Network) and K-Means with the pyramid Lucas Kanade algorithm in order to reduce the harmful effect of moving objects on velocity calculation. Firstly, Mask-R-CNN is used to recognize the objects which have motions relative to the ground and covers them with masks to enhance the similarity between pixels and to reduce the impacts of the noisy moving pixels. Then, the pyramid Lucas Kanade algorithm is used to calculate the optical flow value. Finally, the value is clustered by the K-Means algorithm to abandon the outliers, and vehicle velocity is calculated by the processed optical flow. The prominent advantages of the proposed algorithm are (i) decreasing the bad impacts to velocity calculation, due to the objects which have relative motions; (ii) obtaining the correct optical flow sets and velocity calculation outputs with less fluctuation; and (iii) the applicability enhancement of the optical flow algorithm in complex navigation environment. The proposed algorithm is tested by actual experiments. Results with superior precision and reliability show the feasibility and effectiveness of the proposed method for vehicle velocity calculation in vision navigation system.

scholarly journals Superresolution Reconstruction of Video Based on Efficient Subpixel Convolutional Neural Network for Urban Computing

2020 ◽  
Vol 2020 ◽  
pp. 1-11
Author(s):  
Jie Shen ◽  
Mengxi Xu ◽  
Xinyu Du ◽  
Yunbo Xiong
Keyword(s):  
Neural Network ◽  
Deep Learning ◽  
Convolutional Neural Network ◽  
Optical Flow ◽  
Video Surveillance ◽  
Reconstruction Method ◽  
Motion Information ◽  
Learning Networks ◽  
Urban Computing ◽  
Deep Convolution Network

Video surveillance is an important data source of urban computing and intelligence. The low resolution of many existing video surveillance devices affects the efficiency of urban computing and intelligence. Therefore, improving the resolution of video surveillance is one of the important tasks of urban computing and intelligence. In this paper, the resolution of video is improved by superresolution reconstruction based on a learning method. Different from the superresolution reconstruction of static images, the superresolution reconstruction of video is characterized by the application of motion information. However, there are few studies in this area so far. Aimed at fully exploring motion information to improve the superresolution of video, this paper proposes a superresolution reconstruction method based on an efficient subpixel convolutional neural network, where the optical flow is introduced in the deep learning network. Fusing the optical flow features between successive frames can compensate for information in frames and generate high-quality superresolution results. In addition, in order to improve the superresolution, a superpixel convolution layer is added after the deep convolution network. Finally, experimental evaluations demonstrate the satisfying performance of our method compared with previous methods and other deep learning networks; our method is more efficient.

scholarly journals Combining Background Subtraction and Convolutional Neural Network for Anomaly Detection in Pumping-Unit Surveillance

Algorithms ◽  
2019 ◽  
Vol 12 (6) ◽  
pp. 115 ◽  
Author(s):  
Tianming Yu ◽  
Jianhua Yang ◽  
Wei Lu
Keyword(s):  
Neural Network ◽  
Anomaly Detection ◽  
Convolutional Neural Network ◽  
Background Subtraction ◽  
Moving Objects ◽  
High Accuracy ◽  
Clustering Method ◽  
Subtraction Method ◽  
Video Scene ◽  
Pumping Unit

Background subtraction plays a fundamental role for anomaly detection in video surveillance, which is able to tell where moving objects are in the video scene. Regrettably, the regular rotating pumping unit is treated as an abnormal object by the background-subtraction method in pumping-unit surveillance. As an excellent classifier, a deep convolutional neural network is able to tell what those objects are. Therefore, we combined background subtraction and a convolutional neural network to perform anomaly detection for pumping-unit surveillance. In the proposed method, background subtraction was applied to first extract moving objects. Then, a clustering method was adopted for extracting different object types that had more movement-foreground objects but fewer typical targets. Finally, nonpumping unit objects were identified as abnormal objects by the trained classification network. The experimental results demonstrate that the proposed method can detect abnormal objects in a pumping-unit scene with high accuracy.

scholarly journals HISTOGRAM OF ORIENTED GRADIENT UNTUK DETEKSI EKSPRESI WAJAH MANUSIA

2018 ◽  
Vol 10 (2) ◽  
pp. 81-86
Author(s):  
Marlinda Vasty Overbeek
Keyword(s):  
Neural Network ◽  
Convolutional Neural Network ◽  
Facial Expressions ◽  
Moving Objects ◽  
Image Data ◽  
Gradient Algorithm ◽  
Multi Layer Perceptron ◽  
Histogram Of Oriented Gradient ◽  
Perceptron Algorithm ◽  
Feature Extracting

This research focuses on the detection of human facial expressions using the Histogram of Oriented Gradient algorithm. Whereas for the classification algorithm, Convolutional Neural Network is used. Image data used in the form of seven different expressions of humans with the extraction of 48x48 pixels. The use of Histogram of Oriented Gradient as a feature extracting algorithm, because Histogram of Oriented Gradient is good to be used in detecting moving objects. Whereas Convolutional Neural Network is used because it is an improvement of the Multi Layer Perceptron algorithm. Of the three epoches done, it produced the best accuracy of 77% re-introduction of human facial expressions. These results are quite convincing because it only uses three epochs.

scholarly journals A Doorway Detection and Direction (3Ds) System for Social Robots via a Monocular Camera

Sensors ◽  
2020 ◽  
Vol 20 (9) ◽  
pp. 2477 ◽  
Author(s):  
Kamal M. Othman ◽  
Ahmad B. Rad
Keyword(s):  
Neural Network ◽  
Convolutional Neural Network ◽  
Navigation System ◽  
Social Robot ◽  
Indoor Navigation ◽  
Indoor Environments ◽  
Robotic Navigation ◽  
Monocular Camera ◽  
Simulation Results ◽  
Novel Algorithm

In this paper, we propose a novel algorithm to detect a door and its orientation in indoor settings from the view of a social robot equipped with only a monocular camera. The challenge is to achieve this goal with only a 2D image from a monocular camera. The proposed system is designed through the integration of several modules, each of which serves a special purpose. The detection of the door is addressed by training a convolutional neural network (CNN) model on a new dataset for Social Robot Indoor Navigation (SRIN). The direction of the door (from the robot’s observation) is achieved by three other modules: Depth module, Pixel-Selection module, and Pixel2Angle module, respectively. We include simulation results and real-time experiments to demonstrate the performance of the algorithm. The outcome of this study could be beneficial in any robotic navigation system for indoor environments.

Sign in / Sign up

Export Citation Format

Share Document