Methods for real-time optical location and tracking of unmanned aerial vehicles using digital neural networks

Author(s):  
Igor S. Golyak ◽  
Dmitriy R. Anfimov ◽  
Iliya S. Golyak ◽  
Andrey N. Morozov ◽  
Anastasiya S. Tabalina ◽  
...  
2021 ◽  
Author(s):  
Mehmet Bilge Han Tas ◽  
Muhammed Coskun Irmak ◽  
Sedat Turan ◽  
Abdulsamet Hasiloglu

2020 ◽  
pp. 39-50
Author(s):  
A. N. Morozov ◽  
A. L. Nazolin ◽  
I. L. Fufurin

The paper considers a problem of detection and identification of unmanned aerial vehicles (UAVs) against the animate and inanimate objects and identification of their load by optical and spectral optical methods. The state-of-the-art analysis has shown that, when using the radar methods to detect small UAVs, there is a dead zone for distances of 250-700 m, and in this case it is important to use optical methods for detecting UAVs.The application possibilities and improvements of the optical scheme for detecting UAVs at long distances of about 1-2 km are considered. Location is performed by intrinsic infrared (IR) radiation of an object using the IR cameras and thermal imagers, as well as using a laser rangefinder (LIDAR). The paper gives examples of successful dynamic detection and recognition of objects from video images by methods of graph theory and neural networks using the network FasterR-CNN, YOLO and SSD models, including one frame received.The possibility for using the available spectral optical methods to analyze the chemical composition of materials that can be employed for remote identification of UAV coating materials, as well as for detecting trace amounts of matter on its surface has been studied. The advantages and disadvantages of the luminescent spectroscopy with UV illumination, Raman spectroscopy, differential absorption spectroscopy based on a tunable UV laser, spectral imaging methods (hyper / multispectral images), diffuse reflectance laser spectroscopy using infrared tunable quantum cascade lasers (QCL) have been shown.To assess the potential limiting distances for detecting and identifying UAVs, as well as identifying the chemical composition of an object by optical and spectral optical methods, a described experimental setup (a hybrid lidar UAV identification complex) is expected to be useful. The experimental setup structure and its performances are described. Such studies are aimed at development of scientific basics for remote detection, identification, tracking, and determination of UAV parameters and UAV belonging to different groups by optical location and spectroscopy methods, as well as for automatic optical UAV recognition in various environments against the background of moving wildlife. The proposed problem solution is to combine the optical location and spectral analysis methods, methods of the theory of statistics, graphs, deep learning, neural networks and automatic control methods, which is an interdisciplinary fundamental scientific task.


Robotics ◽  
2021 ◽  
Vol 10 (1) ◽  
pp. 12
Author(s):  
Yixiang Lim ◽  
Nichakorn Pongsarkornsathien ◽  
Alessandro Gardi ◽  
Roberto Sabatini ◽  
Trevor Kistan ◽  
...  

Advances in unmanned aircraft systems (UAS) have paved the way for progressively higher levels of intelligence and autonomy, supporting new modes of operation, such as the one-to-many (OTM) concept, where a single human operator is responsible for monitoring and coordinating the tasks of multiple unmanned aerial vehicles (UAVs). This paper presents the development and evaluation of cognitive human-machine interfaces and interactions (CHMI2) supporting adaptive automation in OTM applications. A CHMI2 system comprises a network of neurophysiological sensors and machine-learning based models for inferring user cognitive states, as well as the adaptation engine containing a set of transition logics for control/display functions and discrete autonomy levels. Models of the user’s cognitive states are trained on past performance and neurophysiological data during an offline calibration phase, and subsequently used in the online adaptation phase for real-time inference of these cognitive states. To investigate adaptive automation in OTM applications, a scenario involving bushfire detection was developed where a single human operator is responsible for tasking multiple UAV platforms to search for and localize bushfires over a wide area. We present the architecture and design of the UAS simulation environment that was developed, together with various human-machine interface (HMI) formats and functions, to evaluate the CHMI2 system’s feasibility through human-in-the-loop (HITL) experiments. The CHMI2 module was subsequently integrated into the simulation environment, providing the sensing, inference, and adaptation capabilities needed to realise adaptive automation. HITL experiments were performed to verify the CHMI2 module’s functionalities in the offline calibration and online adaptation phases. In particular, results from the online adaptation phase showed that the system was able to support real-time inference and human-machine interface and interaction (HMI2) adaptation. However, the accuracy of the inferred workload was variable across the different participants (with a root mean squared error (RMSE) ranging from 0.2 to 0.6), partly due to the reduced number of neurophysiological features available as real-time inputs and also due to limited training stages in the offline calibration phase. To improve the performance of the system, future work will investigate the use of alternative machine learning techniques, additional neurophysiological input features, and a more extensive training stage.


Author(s):  
Fernando A. Chicaiza ◽  
Cristian Gallardo ◽  
Christian P. Carvajal ◽  
Washington X. Quevedo ◽  
Jaime Santana ◽  
...  

2020 ◽  
Vol 161 ◽  
pp. 01087 ◽  
Author(s):  
Marina Vasileva ◽  
Ilyas Ismagilov ◽  
Alexander Gerasimov

The paper contains results of analytic research of unmanned aerial vehicles using in agriculture. The main problems arising in the creation and subsequent large volumes of high-resolution images real time transfer in unmanned aerial vehicles are highlighted. The Automated image processing and transfer system using new methods of information compression on unmanned aerial vehicles board is proposed. The paper considers the issues of consider the problems of constructing new orderings of Walsh functions and constructing fast compression algorithms in synthesized systems of discrete Walsh functions. For processing and subsequent transmission of information from UAVs recommended to use the fast DWT procedure, it allows for a hardware implementation capable of the real-time conversion performing due to its simplicity. The introduction of the proposed solutions for UAVs in agriculture allows to increase accurasy of electronic cartographic material, to keep electronic records of agricultural operations, to carry out operational monitoring of the crops state and to respond quickly for violations and deviations, to predict crop yields and plan their activities for short-term and long-term prospects.


Sign in / Sign up

Export Citation Format

Share Document