Vision- based control of a mobile manipulator with an adaptable-passive suspension for unstructured environments

2021 ◽  
pp. 1-38
Author(s):  
Antonio Cardenas ◽  
Osmar Quiroz ◽  
Ricardo Hernandez ◽  
Hugo I. Medellin-Castillo ◽  
Alejandro González ◽  
...  

Abstract The kinematic design and navigation control of a new autonomous mobile manipulator for uneven terrain is presented in this work. An innovative suspension system's design is based on the kinematic synthesis of an adaptable, passive mechanism that compensates for irregularities in the terrain and facilitate the control of the robotic platform using cameras. The proposed mobile robot suspension consists of two pairs of bogies joined by a crank-slider mechanism that allows the robot to adapt to the terrain irregularities. The mobile robot is also equipped with a robotic manipulator, of which a synthesis, simulation, and experimental validation are presented while manipulation is accomplished during movements on rough terrain. The proposed mobile robot has been fabricated using additive manufacturing (AM) techniques. A linear camera space manipulation (LCSM) control system has been developed and implemented to conduct experimental tests along uneven terrain. This mobile manipulator has been designed to transverse uneven terrain so that the loading platform is kept horizontal while crossing obstacles up to one-third of the size of its wheels. This feature allows the onboard cameras to stay oriented towards the target. The vision-based paradigm that enables the control of this mobile manipulator allows to estimate the position and orientation of its end effector and update the trajectory of the manipulator along the path towards the target. The experiments show a final precision for engagement of a pallet within +/− 2.5 mm in position and +/− 2 degrees in orientation.

Author(s):  
A Perez-Gracia ◽  
J M McCarthy

This article presents a formulation of the design equations for a spatial serial chain that uses the Clifford algebra exponential form of its kinematics equations. This is the even Clifford algebra C+( P3), known as dual quaternions. These equations define the position and orientation of the end effector in terms of rotations or translations about or along the joint axes of the chain. Because the coordinates of these axes appear explicitly, specifying a set of task positions these equations can be solved to determine the location of the joints. At the same time, joint parameters or certain dimensions are specified to ensure that the resulting robotic system has specific features.


Robotica ◽  
2019 ◽  
Vol 38 (8) ◽  
pp. 1415-1433 ◽  
Author(s):  
Hitesh Jangid ◽  
Subham Jain ◽  
Beteley Teka ◽  
Rekha Raja ◽  
Ashish Dutta

SUMMARYA mobile manipulator system (MMS) consists of a robotic arm mounted on a mobile platform that is used in rescue and relief, space exploration, warehouse automation, etc. As the total system has 14 Degrees of Freedom (DOF), it does not have a closed-form inverse kinematics (IK) solution. A learning-based method is proposed, which uses the forward kinematics data to learn the IK relation for motion of an MMS on a rough terrain, using a one-class support vector machine (SVM) framework. Once trained, the model estimates the joint probability distribution of the MMS configuration and end-effector position. This distribution is used to find the MMS configuration for a given desired end-effector path. Past research using a Kohonen Self organizing map (KSOM) neural network-based open-loop control method has shown that the MMS deviates from its desired path while moving on an uneven terrain due to unknown disturbances such as wheel slip, slide, and terrain deformation. Therefore, a new sequential two-stage SVM-based end-effector path-tracking control scheme is proposed to control the end-effector path. In this scheme, the error in the end-effector path is continuously tracked with the help of a Microsoft Kinect 2.0 (Microsoft Regional Sales, Singapore 119968) and is sent as a feedback to the controller. Once the error reaches a threshold value, the error correction step of the controller gets activated to correct the error until the desired accuracy is reached. The effectiveness of the proposed approach is proved through extensive simulations and experiments conducted on 3D terrain in which it is shown that the end effector can follow the desired path with an average experimental error of around 2 cm between the desired and final corrected path.


Author(s):  
Michael C. Frejek ◽  
Scott B. Nokleby

An algorithm for the simplified tele-operation of a mobile-manipulator system is presented. It allows for unified, intuitive, and coordinated control. Unlike other approaches, the mobile-manipulator system is modelled and controlled as two separate entities rather than as a whole. The algorithm consists of three states. In the first state, a joystick is used to freely control the manipulator’s position and orientation. The second state occurs when the manipulator approaches a singular configuration. This causes the mobile base to proceed in such a way as to keep the end-effector moving in its last direction. This is done through the use of a simple optimization routine. The third state is triggered by the user: once the end-effector is in the desired position, the mobile base and manipulator both move with respect to one another keeping the end-effector stationary and placing the manipulator into an ideal configuration. The proposed algorithm avoids the problems of algorithmic singularities and simplifies the control approach. A preliminary version of the algorithm has been implemented on the Jasper mobile-manipulator system with success.


Author(s):  
Jonathan Tapia ◽  
Eric Wineman ◽  
Patrick Benavidez ◽  
Aldo Jaimes ◽  
Ethan Cobb ◽  
...  

2021 ◽  
Vol 32 (4) ◽  
Author(s):  
Luigi D’Alfonso ◽  
Emanuele Garone ◽  
Pietro Muraca ◽  
Paolo Pugliese

AbstractIn this work, we face the problem of estimating the relative position and orientation of a camera and an object, when they are both equipped with inertial measurement units (IMUs), and the object exhibits a set of n landmark points with known coordinates (the so-called Pose estimation or PnP Problem). We present two algorithms that, fusing the information provided by the camera and the IMUs, solve the PnP problem with good accuracy. These algorithms only use the measurements given by IMUs’ inclinometers, as the magnetometers usually give inaccurate estimates of the Earth magnetic vector. The effectiveness of the proposed methods is assessed by numerical simulations and experimental tests. The results of the tests are compared with the most recent methods proposed in the literature.


Author(s):  
Javier Rolda´n Mckinley ◽  
Carl Crane ◽  
David B. Dooner

This paper introduces a reconfigurable closed-loop spatial mechanism that can be applied to repetitive motion tasks. The concept is to incorporate five pairs of non-circular gears into a six degree-of–freedom closed-loop spatial chain. The gear pairs are designed based on given mechanism parameters and a user defined motion specification of a coupler link of the mechanism. It is shown in the paper that planar gear pairs can be used if the spatial closed-loop chain is comprised of six pairs of parallel joint axes, i.e. the first joint axis is parallel to the second, the third is parallel to the fourth, ..., and the eleventh is parallel to the twelfth. This paper presents the synthesis of the gear pairs that satisfy a specified three-dimensional position and orientation need. Numerical approximations were used in the synthesis the non-circular gear pairs by introducing an auxiliary monotonic parameter associated to each end-effector position to parameterize the motion needs. The findings are supported by a computer animation. No previous known literature incorporates planar non-circular gears to fulfill spatial motion generation needs.


2020 ◽  
Vol 6 (1) ◽  
Author(s):  
Yusuf Özbek ◽  
Michael Vogele ◽  
Christian Plattner ◽  
Pedro Costa ◽  
Mario Griesser ◽  
...  

AbstractFluoroscopy-guided percutaneous biopsy interventions are mostly performed with traditional free-hand technique. The practical experience of the surgeon influences the duration of the intervention and the radiation exposure for patients and him-/herself. Especially when the placement of heavy and long instruments in double oblique angles is required, manual techniques reach their technical limitations very fast. The system presented herein automatizes the needle positioning using only two 2D scans while the robotic platform guides the intervention. These two images were used to plan the needle pathway and to estimate the pose of the robot using a custom-made end-effector with embedded registration fiducials. The estimated pose was subsequently used to transfer the planed needle path to the robot’s coordinate system and finally to compute the movement parameters in order to align the robot with this plan. To evaluate the system, two phantoms with 11 different targets on it were developed. The targets were punctured, and the application accuracy was measured quantitatively. The solution achieved sub-millimetric accuracy for needle placement (min. 0.23, max. 1.04 in mm). Our approach combines the advantages of fluoroscopic imaging and ensures automatic needle alignment with highly reduced X-ray radiation. The proposed system shows promising potential to be a guidance platform that is easy to combine with available fluoroscopic imaging systems and provides valuable help to the physician in more difficult interventions.


Author(s):  
Michael John Chua ◽  
Yen-Chen Liu

Abstract This paper presents cooperation and null-space control for networked mobile manipulators with high degrees of freedom (DOFs). First, kinematic model and Euler-Lagrange dynamic model of the mobile manipulator, which has an articulated robot arm mounted on a mobile base with omni-directional wheels, have been presented. Then, the dynamic decoupling has been considered so that the task-space and the null-space can be controlled separately to accomplish different missions. The motion of the end-effector is controlled in the task-space, and the force control is implemented to make sure the cooperation of the mobile manipulators, as well as the transportation tasks. Also, the null-space control for the manipulator has been combined into the decoupling control. For the mobile base, it is controlled in the null-space to track the velocity of the end-effector, avoid other agents, avoid the obstacles, and move in a defined range based on the length of the manipulator without affecting the main task. Numerical simulations have been addressed to demonstrate the proposed methods.


2021 ◽  
Vol ahead-of-print (ahead-of-print) ◽  
Author(s):  
Chuang Cheng ◽  
Hui Zhang ◽  
Hui Peng ◽  
Zhiqian Zhou ◽  
Bailiang Chen ◽  
...  

Purpose When the mobile manipulator is traveling on an unconstructed terrain, the external disturbance is generated. The load on the end of the mobile manipulator will be affected strictly by the disturbance. The purpose of this paper is to reject the disturbance and keep the end effector in a stable pose all the time, a control method is proposed for the onboard manipulator. Design/methodology/approach In this paper, the kinematics and dynamics models of the end pose stability control system for the tracked robot are built. Through the guidance of this model information, the control framework based on active disturbance rejection control (ADRC) is designed, which keeps the attitude of the end of the manipulator stable in the pitch, roll and yaw direction. Meanwhile, the control algorithm is operated with cloud computing because the research object, the rescue robot, aims to be lightweight and execute work with remote manipulation. Findings The challenging simulation experiments demonstrate that the methodology can achieve valid stability control performance in the challenging terrain road in terms of robustness and real-time. Originality/value This research facilitates the stable posture control of the end-effector of the mobile manipulator and maintains it in a suitable stable operating environment. The entire system can normally work even in dynamic disturbance scenarios and uncertain nonlinear modeling. Furthermore, an example is given to guide the parameter tuning of ADRC by using model information and estimate the unknown internal modeling uncertainty, which is difficult to be modeled or identified.


Sign in / Sign up

Export Citation Format

Share Document