A Collision Avoidance Method Based on Deep Reinforcement Learning

This paper set out to investigate the usefulness of solving collision avoidance problems with the help of deep reinforcement learning in an unknown environment, especially in compact spaces, such as a narrow corridor. This research aims to determine whether a deep reinforcement learning-based collision avoidance method is superior to the traditional methods, such as potential field-based methods and dynamic window approach. Besides, the proposed obstacle avoidance method was developed as one of the capabilities to enable each robot in a novel robotic system, namely the Self-reconfigurable and Transformable Omni-Directional Robotic Modules (STORM), to navigate intelligently and safely in an unknown environment. A well-conceived hardware and software architecture with features that enable further expansion and parallel development designed for the ongoing STORM projects is also presented in this work. A virtual STORM module with skid-steer kinematics was simulated in Gazebo to reduce the gap between the simulations and the real-world implementations. Moreover, comparisons among multiple training runs of the neural networks with different parameters related to balance the exploitation and exploration during the training process, as well as tests and experiments conducted in both simulation and real-world, are presented in detail. Directions for future research are also provided in the paper.

A Collision Avoidance Method for Intelligent Ship Based on the Improved Bacterial Foraging Optimization Algorithm

The bacterial foraging optimization algorithm (BFOA) is an intelligent population optimization algorithm widely used in collision avoidance problems; however, the BFOA is inappropriate for the intelligent ship collision avoidance planning with high safety requirements because BFOA converges slowly, optimizes inaccurately, and has low stability. To fix the above shortcomings of BFOA, an autonomous collision avoidance algorithm based on the improved bacterial foraging optimization algorithm (IBFOA) is demonstrated in this paper. An adaptive diminishing fractal dimension chemotactic step length is designed to replace the fixed step length to achieve the adaptive step length adjustment, an optimal swimming search method is proposed to solve the invalid searching and repeated searching problems of the traditional BFOA, and the adaptive migration probability is developed to take the place of the fixed migration probability to prevent elite individuals from being lost in BOFA. The simulation of benchmark tests shows that the IBFOA has a better convergence speed, optimized accuracy, and higher stability; according to a collision avoidance simulation of intelligent ships which applies the IBFOA, it can realize the autonomous collision avoidance of intelligent ships in dynamic obstacles environment is quick and safe. This research can also be used for intelligent collision avoidance of automatic driving ships.

Multi-UAVs Formation Autonomous Control Method Based on RQPSO-FSM-DMPC

For various threats in the enemy defense area, in order to achieve covert penetration and implement effective combat against enemy, the unmanned aerial vehicles formation needs to be reconfigured in the process of penetration; the mutual collision avoidance problems and communication constraint problems among the formation also need to be considered. By establishing the virtual-leader formation model, this paper puts forward distributed model predictive control and finite state machine formation manager. Combined with distributed cooperative strategy establishing the formation reconfiguration cost function, this paper proposes that adopting the revised quantum-behaved particle swarm algorithm solves the cost function, and it is compared with the result which is solved by particle swarm algorithm. Simulation result shows that this algorithm can control multiple UAVs formation autonomous reconfiguration effectively and achieve covert penetration safely.