scholarly journals CNN-Based Person Detection Using Infrared Images for Night-Time Intrusion Warning Systems

Sensors ◽  
2019 ◽  
Vol 20 (1) ◽  
pp. 34 ◽  
Author(s):  
Jisoo Park ◽  
Jingdao Chen ◽  
Yong K. Cho ◽  
Dae Y. Kang ◽  
Byung J. Son
Keyword(s):  
Infrared Image ◽  
Human Detection ◽  
Detection Methods ◽  
Infrared Images ◽  
Night Time ◽  
Person Detection ◽  
Fine Grained ◽  
Public Areas ◽  
Infrared Cameras ◽  
Conventional Detection

Night-time surveillance is important for safety and security purposes. For this reason, several studies have attempted to automatically detect people intruding into restricted areas by using infrared cameras. However, detecting people from infrared CCTV (closed-circuit television) is challenging because they are usually installed in overhead locations and people only occupy small regions in the resulting image. Therefore, this study proposes an accurate and efficient method for detecting people in infrared CCTV images during the night-time. For this purpose, three different infrared image datasets were constructed; two obtained from an infrared CCTV installed on a public beach and another obtained from a forward looking infrared (FLIR) camera installed on a pedestrian bridge. Moreover, a convolution neural network (CNN)-based pixel-wise classifier for fine-grained person detection was implemented. The detection performance of the proposed method was compared against five conventional detection methods. The results demonstrate that the proposed CNN-based human detection approach outperforms conventional detection approaches in all datasets. Especially, the proposed method maintained F1 scores of above 80% in object-level detection for all datasets. By improving the performance of human detection from infrared images, we expect that this research will contribute to the safety and security of public areas during night-time.

Low-observable targets detection for autonomous vehicles based on dual-modal sensor fusion with deep learning approach

2019 ◽  
Vol 233 (9) ◽  
pp. 2270-2283
Author(s):  
Keke Geng ◽  
Wei Zou ◽  
Guodong Yin ◽  
Yang Li ◽  
Zihao Zhou ◽  
...  
Keyword(s):  
Neural Network ◽  
Deep Learning ◽  
Autonomous Vehicles ◽  
Deep Neural Network ◽  
Infrared Imaging ◽  
Infrared Image ◽  
Complex Environments ◽  
Infrared Images ◽  
Night Time ◽  
Perception System

Environment perception is a basic and necessary technology for autonomous vehicles to ensure safety and reliable driving. A lot of studies have focused on the ideal environment, while much less work has been done on the perception of low-observable targets, features of which may not be obvious in a complex environment. However, it is inevitable for autonomous vehicles to drive in environmental conditions such as rain, snow and night-time, during which the features of the targets are not obvious and detection models trained by images with significant features fail to detect low-observable target. This article mainly studies the efficient and intelligent recognition algorithm of low-observable targets in complex environments, focuses on the development of engineering method to dual-modal image (color–infrared images) low-observable target recognition and explores the applications of infrared imaging and color imaging for an intelligent perception system in autonomous vehicles. A dual-modal deep neural network is established to fuse the color and infrared images and detect low-observable targets in dual-modal images. A manually labeled color–infrared image dataset of low-observable targets is built. The deep learning neural network is trained to optimize internal parameters to make the system capable for both pedestrians and vehicle recognition in complex environments. The experimental results indicate that the dual-modal deep neural network has a better performance on the low-observable target detection and recognition in complex environments than traditional methods.

scholarly journals Improved Human Detection with a Fusion of Laser Scanner and Vision/Infrared Information for Mobile Applications

2018 ◽  
Vol 8 (10) ◽  
pp. 1967 ◽  
Author(s):  
Sebastian Budzan ◽  
Roman Wyżgolik ◽  
Witold Ilewicz
Keyword(s):  
Mobile Applications ◽  
Vision System ◽  
Laser Scanner ◽  
Local Binary Patterns ◽  
Detection Algorithm ◽  
Human Detection ◽  
Infrared Images ◽  
Driver Assistance Systems ◽  
Night Time ◽  
Working Distance

This paper presents a method for human detection using a laser scanner with vision or infrared images. Mobile applications require reliable and efficient methods for human detection, especially as a part of driver assistance systems, including pedestrian collision systems. The authors propose an efficient method for multimodal human detection based on a combination of the features and context information. Strictly, the human is detected in the vision/infrared images using a combination of local binary patterns and histogram of oriented gradients features with a neural network in a cascade manner. Next, using coordinates of detected humans from the vision system, the moving trajectory is predicted until the scanner working distance is reached by the individual human. Then the segmentation of data from the laser scanner is further carried out with respect to the predicted trajectory. Finally, human detection in the laser scanner working distance is performed based on modelling of the human legs. The modelling is based on the adaptive breakpoint detection algorithm and proposed improved polylines definition and fitting algorithm. The authors conducted a set of experiments in predefined scenarios, discussed the identified weakness and advantages of the proposed method, and outlined detailed future work, especially for night-time and low-light conditions.

scholarly journals Night-Time Vehicle Sensing in Far Infrared Image with Deep Learning

2016 ◽  
Vol 2016 ◽  
pp. 1-8 ◽  
Author(s):  
Hai Wang ◽  
Yingfeng Cai ◽  
Xiaobo Chen ◽  
Long Chen
Keyword(s):  
Detection Rate ◽  
False Positive Rate ◽  
Infrared Image ◽  
Far Infrared ◽  
Night Vision ◽  
Infrared Sensors ◽  
Night Time ◽  
Detection Rates ◽  
Positive Rate ◽  
And Performance

The use of night vision systems in vehicles is becoming increasingly common. Several approaches using infrared sensors have been proposed in the literature to detect vehicles in far infrared (FIR) images. However, these systems still have low vehicle detection rates and performance could be improved. This paper presents a novel method to detect vehicles using a far infrared automotive sensor. Firstly, vehicle candidates are generated using a constant threshold from the infrared frame. Contours are then generated by using a local adaptive threshold based on maximum distance, which decreases the number of processing regions for classification and reduces the false positive rate. Finally, vehicle candidates are verified using a deep belief network (DBN) based classifier. The detection rate is 93.9% which is achieved on a database of 5000 images and video streams. This result is approximately a 2.5% improvement on previously reported methods and the false detection rate is also the lowest among them.

Reflection interference removal for infrared thermography images based on GAN

2021 ◽  
Vol 63 (9) ◽  
pp. 529-533
Author(s):  
Jiali Zhang ◽  
Yupeng Tian ◽  
LiPing Ren ◽  
Jiaheng Cheng ◽  
JinChen Shi
Keyword(s):  
Neural Networks ◽  
Infrared Thermography ◽  
Metal Surfaces ◽  
Infrared Image ◽  
Infrared Camera ◽  
Infrared Images ◽  
Generative Adversarial Network ◽  
Adversarial Network ◽  
Continuous Application ◽  
Visible Images

Reflection in images is common and the removal of complex noise such as image reflection is still being explored. The problem is difficult and ill-posed, not only because there is no mixing function but also because there are no constraints in the output space (the processed image). When it comes to detecting defects on metal surfaces using infrared thermography, reflection from smooth metal surfaces can easily affect the final detection results. Therefore, it is essential to remove the reflection interference in infrared images. With the continuous application and expansion of neural networks in the field of image processing, researchers have tried to apply neural networks to remove image reflection. However, they have mainly focused on reflection interference removal in visible images and it is believed that no researchers have applied neural networks to remove reflection interference in infrared images. In this paper, the authors introduce the concept of a conditional generative adversarial network (cGAN) and propose an end-to-end trained network based on this with two types of loss: perceptual loss and adversarial loss. A self-built infrared reflection image dataset from an infrared camera is used. The experimental results demonstrate the effectiveness of this GAN for removing infrared image reflection.

scholarly journals Molecular marker assisted detection of the mycoparasite Coniothyrium minitans A69 in soil

2000 ◽  
Vol 53 ◽  
pp. 114-117 ◽  
Author(s):  
H.J. Ridgway ◽  
A. Stewart
Keyword(s):  
Detection Methods ◽  
Practical Application ◽  
Coniothyrium Minitans ◽  
Sterile Soil ◽  
Pcr Assay ◽  
Control Activity ◽  
Dna Recovery ◽  
Nonsterile Soil ◽  
Number Of Factors ◽  
Conventional Detection

Coniothyrium minitans A69 has been shown to have biological control activity against the plant pathogen Sclerotinia sclerotiorum and a PCR based assay has been developed to specifically identify this isolate The practical application of this PCR assay for detection of C minitans from soil was assessed Sterile and nonsterile soil was inoculated with spores from C minitans A69 at five different concentrations and DNA recovered using a SDS/Phenol/Chloroform method A number of factors affected DNA recovery and subsequent PCR with a maximum sensitivity of down to 1x102 spores/g soil achieved in sterile soil Detection of C minitans in nonsterile soil was hampered by failure of the fungus to germinate However this method has improved throughput and cost effectiveness compared with conventional detection methods involving quantitative colony recovery

scholarly journals Learning a Generative Model for Fusing Infrared and Visible Images via Conditional Generative Adversarial Network with Dual Discriminators

2019 ◽  
Author(s):  
Han Xu ◽  
Pengwei Liang ◽  
Wei Yu ◽  
Junjun Jiang ◽  
Jiayi Ma
Keyword(s):  
Probability Distribution ◽  
State Of The Art ◽  
Infrared Image ◽  
Infrared Images ◽  
Generative Adversarial Network ◽  
Visible Image ◽  
Qualitative And Quantitative ◽  
Adversarial Network ◽  
Fused Image ◽  
Visible Images

In this paper, we propose a new end-to-end model, called dual-discriminator conditional generative adversarial network (DDcGAN), for fusing infrared and visible images of different resolutions. Unlike the pixel-level methods and existing deep learning-based methods, the fusion task is accomplished through the adversarial process between a generator and two discriminators, in addition to the specially designed content loss. The generator is trained to generate real-like fused images to fool discriminators. The two discriminators are trained to calculate the JS divergence between the probability distribution of downsampled fused images and infrared images, and the JS divergence between the probability distribution of gradients of fused images and gradients of visible images, respectively. Thus, the fused images can compensate for the features that are not constrained by the single content loss. Consequently, the prominence of thermal targets in the infrared image and the texture details in the visible image can be preserved or even enhanced in the fused image simultaneously. Moreover, by constraining and distinguishing between the downsampled fused image and the low-resolution infrared image, DDcGAN can be preferably applied to the fusion of different resolution images. Qualitative and quantitative experiments on publicly available datasets demonstrate the superiority of our method over the state-of-the-art.

scholarly journals IMAGE SEGMENTATION AND OBJECT SELECTION BASED ON MULTI-THRESHOLD PROCESSING

2019 ◽  
Vol 22 (3) ◽  
pp. 24-35 ◽  
Author(s):  
Vladimir Yu. Volkov ◽  
Oleg A. Markelov ◽  
Mikhail I. Bogachev
Keyword(s):  
Remote Sensing ◽  
Image Segmentation ◽  
Test Methods ◽  
Object Identification ◽  
Detection Methods ◽  
Clustering Methods ◽  
Object Selection ◽  
Advantages And Disadvantages ◽  
Infrared Cameras ◽  
Threshold Processing

Introduction. Detection, isolation, selection and localization of variously shaped objects in images are essential in a variety of applications. Computer vision systems utilizing television and infrared cameras, synthetic aperture surveillance radars as well as laser and acoustic remote sensing systems are prominent examples. Such problems as object identification, tracking and matching as well as combining information from images available from different sources are essential. Objective. Design of image segmentation and object selection methods based on multi-threshold processing. Materials and methods. The segmentation methods are classified according to the objects they deal with, including (i) pixel-level threshold estimation and clustering methods, (ii) boundary detection methods, (iii) regional level, and (iv) other classifiers, including many non-parametric methods, such as machine learning, neural networks, fuzzy sets, etc. The keynote feature of the proposed approach is that the choice of the optimal threshold for the image segmentation among a variety of test methods is carried out using a posteriori information about the selection results. Results. The results of the proposed approach is compared against the results obtained using the well-known binary integration method. The comparison is carried out both using simulated objects with known shapes with additive synthesized noise as well as using observational remote sensing imagery. Conclusion. The article discusses the advantages and disadvantages of the proposed approach for the selection of objects in images, and provides recommendations for their use.

scholarly journals Short Circuit Recognition for Metal Electrorefining Using an Improved Faster R-CNN With Synthetic Infrared Images

2021 ◽  
Vol 15 ◽  
Author(s):  
Xin Li ◽  
Yonggang Li ◽  
Renchao Wu ◽  
Can Zhou ◽  
Hongqiu Zhu
Keyword(s):  
Detection System ◽  
Short Circuit ◽  
Infrared Image ◽  
Parameter Tuning ◽  
Recall Rate ◽  
Synthetic Methods ◽  
Synthetic Dataset ◽  
Small Scale ◽  
Infrared Images ◽  
Key Variables

This paper is concerned with the problem of short circuit detection in infrared image for metal electrorefining with an improved Faster Region-based Convolutional Neural Network (Faster R-CNN). To address the problem of insufficient label data, a framework for automatically generating labeled infrared images is proposed. After discussing factors that affect sample diversity, background, object shape, and gray scale distribution are established as three key variables for synthesis. Raw infrared images without fault are used as backgrounds. By simulating the other two key variables on the background, different classes of objects are synthesized. To improve the detection rate of small scale targets, an attention module is introduced in the network to fuse the semantic segment results of U-Net and the synthetic dataset. In this way, the Faster R-CNN can obtain rich representation ability about small scale object on the infrared images. Strategies of parameter tuning and transfer learning are also applied to improve the detection precision. The detection system trains on only synthetic dataset and tests on actual images. Extensive experiments on different infrared datasets demonstrate the effectiveness of the synthetic methods. The synthetically trained network obtains a mAP of 0.826, and the recall rate of small latent short circuit is superior to that of Faster R-CNN and U-Net, effectively avoiding short-circuit missed detection.

scholarly journals Classification of Infrared Objects in Manifold Space Using Kullback-Leibler Divergence of Gaussian Distributions of Image Points

Symmetry ◽  
2020 ◽  
Vol 12 (3) ◽  
pp. 434 ◽  
Author(s):  
Huilin Ge ◽  
Zhiyu Zhu ◽  
Kang Lou ◽  
Wei Wei ◽  
Runbang Liu ◽  
...  
Keyword(s):  
Manifold Learning ◽  
Gaussian Distribution ◽  
Classification Accuracy ◽  
Infrared Image ◽  
Data Sets ◽  
Dimensional Manifold ◽  
Infrared Images ◽  
Leibler Divergence ◽  
Data Points ◽  
Low Dimensional

Infrared image recognition technology can work day and night and has a long detection distance. However, the infrared objects have less prior information and external factors in the real-world environment easily interfere with them. Therefore, infrared object classification is a very challenging research area. Manifold learning can be used to improve the classification accuracy of infrared images in the manifold space. In this article, we propose a novel manifold learning algorithm for infrared object detection and classification. First, a manifold space is constructed with each pixel of the infrared object image as a dimension. Infrared images are represented as data points in this constructed manifold space. Next, we simulate the probability distribution information of infrared data points with the Gaussian distribution in the manifold space. Then, based on the Gaussian distribution information in the manifold space, the distribution characteristics of the data points of the infrared image in the low-dimensional space are derived. The proposed algorithm uses the Kullback-Leibler (KL) divergence to minimize the loss function between two symmetrical distributions, and finally completes the classification in the low-dimensional manifold space. The efficiency of the algorithm is validated on two public infrared image data sets. The experiments show that the proposed method has a 97.46% classification accuracy and competitive speed in regards to the analyzed data sets.

Sign in / Sign up

Export Citation Format

Share Document