scholarly journals Control of prehension for the transradial prosthesis: Natural-like image recognition system

2009 ◽  
Vol 19 (1) ◽  
pp. 27-31 ◽  
Author(s):  
Djordje Klisic ◽  
Milos Kostic ◽  
Strahinja Dosen ◽  
Dejan Popovic

We describe the hardware and software for the control of prehension for a dexterous transradial prosthesis. The prehension process comprises hand orientation (three degrees of freedom) and the opening of the hand in a manner that is appropriate for the shape and size of the object. The hardware consists of a standard web camera, accelerometer, ultrasound distance sensor, laser pointer and an LED illumination system. Software operating in real time estimates the shape and size of the object as well as the relative orientation of the hand with respect to the object. Based on this data, the controller generates signals that are sent to the three-dimensional (3D) wrist rotator, and drives which control fingers and thumb of the transradial prosthesis, thereby preparing the hand for palmar, lateral, or precision (2-digit or 3-digit) grasps. The choice of the grasp follows heuristics captured from healthy humans when grasping and expressed in the form of IF-THEN rules.

2020 ◽  
Author(s):  
Tom Manzocchi ◽  
Deirdre Walsh ◽  
Carneiro Marcus ◽  
Javier López-Cabrera ◽  
Soni Kishan

<p>Irrespective of the specific technique (variogram-based, object-based or training image-based) applied, geostatistical facies models usually use facies proportions as the constraining input parameter to be honoured in the output model. The three-dimensional interconnectivity of the facies bodies in these models increases as the facies proportion increases, and the universal percolation thresholds that define the onset of macroscopic connectivity in idealized statistical physics models define also the connectivity of these facies models. Put simply, the bodies are well connected when the model net:gross ratio exceeds about 30%, and because of the similar behaviour of different geostatistical approaches, some researchers have concluded that the same threshold applies to geological systems.</p><p>In this contribution we contend that connectivity in geological systems has more degrees of freedom than it does in conventional geostatistical facies models, and hence that geostatistical facies modelling should be constrained at input by a facies connectivity parameter as well as a facies proportion parameter. We have developed a method that decouples facies proportion from facies connectivity in the modelling process, and which allows systems to be generated in which both are defined independently at input. This so-called compression-based modelling approach applies the universal link between the connectivity and volume fraction in geostatistical modelling to first generate a model with the correct connectivity but incorrect volume fraction using a conventional geostatistical approach, and then applies a geometrical transform which scales the model to the correct facies proportions while maintaining the connectivity of the original model. The method is described and illustrated using examples representative of different geological systems. These include situations in which connectivity is both higher (e.g. fluid-driven injectite or karst networks) and lower (e.g. many depositional systems) than can be achieved in conventional geostatistical facies models.</p>


2021 ◽  
Vol 11 (17) ◽  
pp. 7917
Author(s):  
Hiba Sekkat ◽  
Smail Tigani ◽  
Rachid Saadane ◽  
Abdellah Chehri

While working side-by-side, humans and robots complete each other nowadays, and we may say that they work hand in hand. This study aims to evolve the grasping task by reaching the intended object based on deep reinforcement learning. Thereby, in this paper, we propose a deep deterministic policy gradient approach that can be applied to a numerous-degrees-of-freedom robotic arm towards autonomous objects grasping according to their classification and a given task. In this study, this approach is realized by a five-degrees-of-freedom robotic arm that reaches the targeted object using the inverse kinematics method. You Only Look Once v5 is employed for object detection, and backward projection is used to detect the three-dimensional position of the target. After computing the angles of the joints at the detected position by inverse kinematics, the robot’s arm is moved towards the target object’s emplacement thanks to the algorithm. Our approach provides a neural inverse kinematics solution that increases overall performance, and its simulation results reveal its advantages compared to the traditional one. The robot’s end grip joint can reach the targeted location by calculating the angle of every joint with an acceptable range of error. However, the accuracy of the angle and the posture are satisfied. Experiments reveal the performance of our proposal compared to the state-of-the-art approaches in vision-based grasp tasks. This is a new approach to grasp an object by referring to inverse kinematics. This method is not only easier than the standard one but is also more meaningful for multi-degrees of freedom robots.


2019 ◽  
Vol 63 (5) ◽  
pp. 50402-1-50402-9 ◽  
Author(s):  
Ing-Jr Ding ◽  
Chong-Min Ruan

Abstract The acoustic-based automatic speech recognition (ASR) technique has been a matured technique and widely seen to be used in numerous applications. However, acoustic-based ASR will not maintain a standard performance for the disabled group with an abnormal face, that is atypical eye or mouth geometrical characteristics. For governing this problem, this article develops a three-dimensional (3D) sensor lip image based pronunciation recognition system where the 3D sensor is efficiently used to acquire the action variations of the lip shapes of the pronunciation action from a speaker. In this work, two different types of 3D lip features for pronunciation recognition are presented, 3D-(x, y, z) coordinate lip feature and 3D geometry lip feature parameters. For the 3D-(x, y, z) coordinate lip feature design, 18 location points, each of which has 3D-sized coordinates, around the outer and inner lips are properly defined. In the design of 3D geometry lip features, eight types of features considering the geometrical space characteristics of the inner lip are developed. In addition, feature fusion to combine both 3D-(x, y, z) coordinate and 3D geometry lip features is further considered. The presented 3D sensor lip image based feature evaluated the performance and effectiveness using the principal component analysis based classification calculation approach. Experimental results on pronunciation recognition of two different datasets, Mandarin syllables and Mandarin phrases, demonstrate the competitive performance of the presented 3D sensor lip image based pronunciation recognition system.


2020 ◽  
Vol 67 (1) ◽  
pp. 133-141
Author(s):  
Dmitriy O. Khort ◽  
Aleksei I. Kutyrev ◽  
Igor G. Smirnov ◽  
Rostislav A. Filippov ◽  
Roman V. Vershinin

Technological capabilities of agricultural units cannot be optimally used without extensive automation of production processes and the use of advanced computer control systems. (Research purpose) To develop an algorithm for recognizing the coordinates of the location and ripeness of garden strawberries in different lighting conditions and describe the technological process of its harvesting in field conditions using a robotic actuator mounted on a self-propelled platform. (Materials and methods) The authors have developed a self-propelled platform with an automatic actuator for harvesting garden strawberry, which includes an actuator with six degrees of freedom, a co-axial gripper, mg966r servos, a PCA9685 controller, a Logitech HD C270 computer vision camera, a single-board Raspberry Pi 3 Model B+ computer, VL53L0X laser sensors, a SZBK07 300W voltage regulator, a Hubsan X4 Pro H109S Li-polymer battery. (Results and discussion) Using the Python programming language 3.7.2, the authors have developed a control algorithm for the automatic actuator, including operations to determine the X and Y coordinates of berries, their degree of maturity, as well as to calculate the distance to berries. It has been found that the effectiveness of detecting berries, their area and boundaries with a camera and the OpenCV library at the illumination of 300 Lux reaches 94.6 percent’s. With an increase in the robotic platform speed to 1.5 kilometre per hour and at the illumination of 300 Lux, the average area of the recognized berries decreased by 9 percent’s to 95.1 square centimeter, at the illumination of 200 Lux, the area of recognized berries decreased by 17.8 percent’s to 88 square centimeter, and at the illumination of 100 Lux, the area of recognized berries decreased by 36.4 percent’s to 76 square centimeter as compared to the real area of berries. (Conclusions) The authors have provided rationale for the technological process and developed an algorithm for harvesting garden strawberry using a robotic actuator mounted on a self-propelled platform. It has been proved that lighting conditions have a significant impact on the determination of the area, boundaries and ripeness of berries using a computer vision camera.


Micromachines ◽  
2021 ◽  
Vol 12 (4) ◽  
pp. 444
Author(s):  
Guoning Si ◽  
Liangying Sun ◽  
Zhuo Zhang ◽  
Xuping Zhang

This paper presents the design, fabrication, and testing of a novel three-dimensional (3D) three-fingered electrothermal microgripper with multiple degrees of freedom (multi DOFs). Each finger of the microgripper is composed of a V-shaped electrothermal actuator providing one DOF, and a 3D U-shaped electrothermal actuator offering two DOFs in the plane perpendicular to the movement of the V-shaped actuator. As a result, each finger possesses 3D mobilities with three DOFs. Each beam of the actuators is heated externally with the polyimide film. The durability of the polyimide film is tested under different voltages. The static and dynamic properties of the finger are also tested. Experiments show that not only can the microgripper pick and place microobjects, such as micro balls and even highly deformable zebrafish embryos, but can also rotate them in 3D space.


Symmetry ◽  
2021 ◽  
Vol 13 (4) ◽  
pp. 580
Author(s):  
Anna Lena Emonds ◽  
Katja Mombaur

As a whole, human sprinting seems to be a completely periodic and symmetrical motion. This view is changed when a person runs with a running-specific prosthesis after a unilateral amputation. The aim of our study is to investigate differences and similarities between unilateral below-knee amputee and non-amputee sprinters—especially with regard to whether asymmetry is a distracting factor for sprint performance. We established three-dimensional rigid multibody models of one unilateral transtibial amputee athlete and for reference purposes of three non-amputee athletes. They consist of 16 bodies (head, ipper, middle and lower trunk, upper and lower arms, hands, thighs, shanks and feet/running specific prosthesis) with 30 or 31 degrees of freedom (DOFs) for the amputee and the non-amputee athletes, respectively. Six DOFs are associated with the floating base, the remaining ones are rotational DOFs. The internal joints are equipped with torque actuators except for the prosthetic ankle joint. To model the spring-like properties of the prosthesis, the actuator is replaced by a linear spring-damper system. We consider a pair of steps which is modeled as a multiphase problem with each step consisting of a flight, touchdown and single-leg contact phase. Each phase is described by its own set of differential equations. By combining motion capture recordings with a least squares optimal control problem formulation including constraints, we reconstructed the dynamics of one sprinting trial for each athlete. The results show that even the non-amputee athletes showed less symmetrical sprinting than expected when examined on an individual level. Nevertheless, the asymmetry is much more pronounced in the amputee athlete. The amputee athlete applies larger torques in the arm and trunk joints to compensate the asymmetry and experiences a destabilizing influence of the trunk movement. Hence, the inter-limb asymmetry of the amputee has a significant effect on the control of the sprint movement and the maintenance of an upright body position.


Author(s):  
Rahid Zaman ◽  
Yujiang Xiang ◽  
Jazmin Cruz ◽  
James Yang

In this study, the three-dimensional (3D) asymmetric maximum weight lifting is predicted using an inverse-dynamics-based optimization method considering dynamic joint torque limits. The dynamic joint torque limits are functions of joint angles and angular velocities, and imposed on the hip, knee, ankle, wrist, elbow, shoulder, and lumbar spine joints. The 3D model has 40 degrees of freedom (DOFs) including 34 physical revolute joints and 6 global joints. A multi-objective optimization (MOO) problem is solved by simultaneously maximizing box weight and minimizing the sum of joint torque squares. A total of 12 male subjects were recruited to conduct maximum weight box lifting using squat-lifting strategy. Finally, the predicted lifting motion, ground reaction forces, and maximum lifting weight are validated with the experimental data. The prediction results agree well with the experimental data and the model’s predictive capability is demonstrated. This is the first study that uses MOO to predict maximum lifting weight and 3D asymmetric lifting motion while considering dynamic joint torque limits. The proposed method has the potential to prevent individuals’ risk of injury for lifting.


2015 ◽  
Vol 8 (2) ◽  
Author(s):  
Andrew Johnson ◽  
Xianwen Kong ◽  
James Ritchie

The determination of workspace is an essential step in the development of parallel manipulators. By extending the virtual-chain (VC) approach to the type synthesis of parallel manipulators, this technical brief proposes a VC approach to the workspace analysis of parallel manipulators. This method is first outlined before being illustrated by the production of a three-dimensional (3D) computer-aided-design (CAD) model of a 3-RPS parallel manipulator and evaluating it for the workspace of the manipulator. Here, R, P and S denote revolute, prismatic and spherical joints respectively. The VC represents the motion capability of moving platform of a manipulator and is shown to be very useful in the production of a graphical representation of the workspace. Using this approach, the link interferences and certain transmission indices can be easily taken into consideration in determining the workspace of a parallel manipulator.


Sign in / Sign up

Export Citation Format

Share Document