scholarly journals The Application of Deep Convolutional Neural Networks to Ultrasound for Modelling of Dynamic States within Human Skeletal Muscle

2017 ◽  
Author(s):  
Ryan J. Cunningham ◽  
Peter J. Harding ◽  
Ian D. Loram

AbstractThis paper concerns the fully automatic direct in vivo measurement of active and passive dynamic skeletal muscle states using ultrasound imaging. Despite the long standing medical need (myopathies, neuropathies, pain, injury, ageing), currently technology (electromyography, dynamometry, shear wave imaging) provides no general, non-invasive method for online estimation of skeletal intramuscular states. Ultrasound provides a technology in which static and dynamic muscle states can be observed non-invasively, yet current computational image understanding approaches are inadequate. We propose a new approach in which deep learning methods are used for understanding the content of ultrasound images of muscle in terms of its measured state. Ultrasound data synchronized with electromyography of the calf muscles, with measures of joint torque/angle were recorded from 19 healthy participants (6 female, ages: 30 ± 7.7). A segmentation algorithm previously developed by our group was applied to extract a region of interest of the medial gastrocnemius. Then a deep convolutional neural network was trained to predict the measured states (joint angle/torque, electromyography) directly from the segmented images. Results revealed for the first time that active and passive muscle states can be measured directly from standard b-mode ultrasound images, accurately predicting for a held out test participant changes in the joint angle, electromyography, and torque with as little error as 0.022°, 0.0001V, 0.256Nm (root mean square error) respectively.

2020 ◽  
Vol 17 (162) ◽  
pp. 20190715 ◽  
Author(s):  
Ryan J. Cunningham ◽  
Ian D. Loram

The objective is to test automated in vivo estimation of active and passive skeletal muscle states using ultrasonic imaging. Current technology (electromyography, dynamometry, shear wave imaging) provides no general, non-invasive method for online estimation of skeletal muscle states. Ultrasound (US) allows non-invasive imaging of muscle, yet current computational approaches have never achieved simultaneous extraction or generalization of independently varying active and passive states. We use deep learning to investigate the generalizable content of two-dimensional (2D) US muscle images. US data synchronized with electromyography of the calf muscles, with measures of joint moment/angle, were recorded from 32 healthy participants (seven female; ages: 27.5, 19–65). We extracted a region of interest of medial gastrocnemius and soleus using our prior developed accurate segmentation algorithm. From the segmented images, a deep convolutional neural network was trained to predict three absolute, drift-free components of the neurobiomechanical state (activity, joint angle, joint moment) during experimentally designed, simultaneous independent variation of passive (joint angle) and active (electromyography) inputs. For all 32 held-out participants (16-fold cross-validation) the ankle joint angle, electromyography and joint moment were estimated to accuracy 55 ± 8%, 57 ± 11% and 46 ± 9%, respectively. With 2D US imaging, deep neural networks can encode, in generalizable form, the activity–length–tension state relationship of these muscles. Observation-only, low-power 2D US imaging can provide a new category of technology for non-invasive estimation of neural output, length and tension in skeletal muscle. This proof of principle has value for personalized muscle assessment in pain, injury, neurological conditions, neuropathies, myopathies and ageing.


2004 ◽  
Vol 96 (2) ◽  
pp. 540-544 ◽  
Author(s):  
Tetsuro Muraoka ◽  
Tadashi Muramatsu ◽  
Tetsuo Fukunaga ◽  
Hiroaki Kanehisa

The purpose of this study was to clarify the influence of muscle-tendon complex stretch on electromechanical delay (EMD) in terms of the extent of tendon slack in the human medial gastrocnemius (MG). EMD and MG tendon length were measured at each of five ankle joint angles (-30, -20, -10, 0, and 5°: positive values for dorsiflexion) using percutaneous electrical stimulation and ultrasonography, respectively. The extent of MG tendon slack was calculated as MG tendon length shortening, standardized with MG tendon slack length obtained at the joint angle (-16° ± 5°) where the passive ankle joint torque was zero. EMD at -30° (19.2 ±2.2 ms) and -20° (17.2 ± 1.3 ms) was significantly greater than that at -10° (16.0 ±2.3 ms), 0° (15.0 ±1.4 ms), and 5° (14.8 ±1.4 ms), and at 0 and 5°, respectively. The relative EMD, normalized with the maximal EMD for each subject, decreased dependent on the extent of decrease in MG tendon slack. There were no significant differences in EMD among the joint angles (-10, 0, and 5°) where MG tendon slack was taken up. These results suggest that the extent of tendon slack is an important factor for determining EMD.


2021 ◽  
Vol 6 (7) ◽  
pp. 107-113
Author(s):  
Charles Nnamdi Udekwe ◽  
Akinlolu Adediran Ponnle

The geometry of the imaged transverse cross-section of carotid arteries in in-vivo B-mode ultrasound images are most times irregular, unsymmetrical, full of speckles and usually non-uniform. We had earlier developed a technique of cardinal point symmetry landmark distribution model (CPS-LDM) to completely characterize the Region of Interest (ROI) of the geometric shape of thick-walled simulated B-mode ultrasound images of carotid artery imaged in the transverse plane, but this was based on the symmetric property of the image. In this paper, this developed technique was applied to completely characterize the region of interest of the geometric shape of in-vivo B-mode ultrasound images of non-uniform carotid artery imaged in the transverse plane. In order to adapt the CPS-LD Model to the in-vivo carotid artery images, the single VS-VS vertical symmetry line common to the four ROIs of the symmetric image is replaced with each ROI having its own VS-VS vertical symmetry line. This adjustment enables the in-vivo carotid artery images possess symmetric properties, hence, ensuring that all mathematical operations of the CPS-LD Model are conveniently applied to them. This adaptability was observed to work well in segmenting the in-vivo carotid artery images. This paper shows the adaptive ability of the developed CPS-LD Model to successfully annotate and segment in-vivo B-mode ultrasound images of carotid arteries in the transverse cross-sectional plane either they are symmetrical or unsymmetrical.


2017 ◽  
Vol 123 (6) ◽  
pp. 1433-1442 ◽  
Author(s):  
Taylor J. M. Dick ◽  
James M. Wakeling

When muscles contract, they bulge in thickness or in width to maintain a (nearly) constant volume. These dynamic shape changes are tightly linked to the internal constraints placed on individual muscle fibers and play a key functional role in modulating the mechanical performance of skeletal muscle by increasing its range of operating velocities. Yet to date we have a limited understanding of the nature and functional implications of in vivo dynamic muscle shape change under submaximal conditions. This study determined how the in vivo changes in medial gastrocnemius (MG) fascicle velocity, pennation angle, muscle thickness, and subsequent muscle gearing varied as a function of force and velocity. To do this, we obtained recordings of MG tendon length, fascicle length, pennation angle, and thickness using B-mode ultrasound and muscle activation using surface electromyography during cycling at a range of cadences and loads. We found that that increases in contractile force were accompanied by reduced bulging in muscle thickness, reduced increases in pennation angle, and faster fascicle shortening. Although the force and velocity of a muscle contraction are inversely related due to the force-velocity effect, this study has shown how dynamic muscle shape changes are influenced by force and not influenced by velocity.NEW & NOTEWORTHY During movement, skeletal muscles contract and bulge in thickness or width. These shape changes play a key role in modulating the performance of skeletal muscle by increasing its range of operating velocities. Yet to date the underlying mechanisms associated with muscle shape change remain largely unexplored. This study identified muscle force, and not velocity, as the mechanistic driving factor to allow for muscle gearing to vary depending on the contractile conditions during human cycling.


2013 ◽  
Vol 2013 ◽  
pp. 1-10 ◽  
Author(s):  
Mitsuhiro Hayashibe ◽  
David Guiraud ◽  
Philippe Poignet

Skeletal muscle system has nonlinear dynamics and subject-specific characteristics. Thus, it is essential to identify the unknown parameters from noisy biomedical signals to improve the modeling accuracy in neuroprosthetic control. The objective of this work is to develop an experimental identification method for subject-specific biomechanical parameters of a physiological muscle model which can be employed to predict the nonlinear force properties of stimulated muscle. Our previously proposed muscle model, which can describe multiscale physiological system based on the Hill and Huxley models, was used for the identification. The identification protocols were performed on two rabbit experiments, where the medial gastrocnemius was attached to a motorized lever system to record the force by the nerve stimulation. The muscle model was identified using nonlinear Kalman filters: sigma-point and extended Kalman filter. The identified model was evaluated by comparison with experimental measurements in the cross-validation manner. The feasibility could be demonstrated by comparison between the estimated parameter and the measured value. The estimates with SPKF showed 5.7% and 2.9% error in each experiment with 7 different initial conditions. It reveals that SPKF has great advantage especially for the identification of multiscale muscle model which accounts for the high nonlinearity and discontinuous states between muscle contraction and relaxation process.


2018 ◽  
Vol 5 (5) ◽  
pp. 172371 ◽  
Author(s):  
Taylor J. M. Dick ◽  
James M. Wakeling

Skeletal muscle bulges when it contracts. These three-dimensional (3D) dynamic shape changes play an important role in muscle performance by altering the range of fascicle velocities over which a muscle operates. However traditional muscle models are one-dimensional (1D) and cannot fully explain in vivo shape changes. In this study we compared medial gastrocnemius behaviour during human cycling (fascicle length changes and rotations) predicted by a traditional 1D Hill-type model and by models that incorporate two-dimensional (2D) and 3D geometric constraints to in vivo measurements from B-mode ultrasound during a range of mechanical conditions ranging from 14 to 44 N m and 80 to 140 r.p.m. We found that a 1D model predicted fascicle lengths and pennation angles similar to a 2D model that allowed the aponeurosis to stretch, and to a 3D model that allowed for aponeurosis stretch and variable shape changes to occur. This suggests that if the intent of a model is to predict fascicle behaviour alone, then the traditional 1D Hill-type model may be sufficient. Yet, we also caution that 1D models are limited in their ability to infer the mechanisms by which shape changes influence muscle mechanics. To elucidate the mechanisms governing muscle shape change, future efforts should aim to develop imaging techniques able to characterize whole muscle 3D geometry in vivo during active contractions.


2012 ◽  
Vol 112 (2) ◽  
pp. 313-327 ◽  
Author(s):  
John Darby ◽  
Emma F. Hodson-Tole ◽  
Nicholas Costen ◽  
Ian D. Loram

To understand the functional significance of skeletal muscle anatomy, a method of quantifying local shape changes in different tissue structures during dynamic tasks is required. Taking advantage of the good spatial and temporal resolution of B-mode ultrasound imaging, we describe a method of automatically segmenting images into fascicle and aponeurosis regions and tracking movement of features, independently, in localized portions of each tissue. Ultrasound images (25 Hz) of the medial gastrocnemius muscle were collected from eight participants during ankle joint rotation (2° and 20°), isometric contractions (1, 5, and 50 Nm), and deep knee bends. A Kanade-Lucas-Tomasi feature tracker was used to identify and track any distinctive and persistent features within the image sequences. A velocity field representation of local movement was then found and subdivided between fascicle and aponeurosis regions using segmentations from a multiresolution active shape model (ASM). Movement in each region was quantified by interpolating the effect of the fields on a set of probes. ASM segmentation results were compared with hand-labeled data, while aponeurosis and fascicle movement were compared with results from a previously documented cross-correlation approach. ASM provided good image segmentations (<1 mm average error), with fully automatic initialization possible in sequences from seven participants. Feature tracking provided similar length change results to the cross-correlation approach for small movements, while outperforming it in larger movements. The proposed method provides the potential to distinguish between active and passive changes in muscle shape and model strain distributions during different movements/conditions and quantify nonhomogeneous strain along aponeuroses.


Author(s):  
R.J. Mount ◽  
R.V. Harrison

The sensory end organ of the ear, the organ of Corti, rests on a thin basilar membrane which lies between the bone of the central modiolus and the bony wall of the cochlea. In vivo, the organ of Corti is protected by the bony wall which totally surrounds it. In order to examine the sensory epithelium by scanning electron microscopy it is necessary to dissect away the protective bone and expose the region of interest (Fig. 1). This leaves the fragile organ of Corti susceptible to physical damage during subsequent handling. In our laboratory cochlear specimens, after dissection, are routinely prepared by the O-T- O-T-O technique, critical point dried and then lightly sputter coated with gold. This processing involves considerable specimen handling including several hours on a rotator during which the organ of Corti is at risk of being physically damaged. The following procedure uses low cost, readily available materials to hold the specimen during processing ,preventing physical damage while allowing an unhindered exchange of fluids.Following fixation, the cochlea is dehydrated to 70% ethanol then dissected under ethanol to prevent air drying. The holder is prepared by punching a hole in the flexible snap cap of a Wheaton vial with a paper hole punch. A small amount of two component epoxy putty is well mixed then pushed through the hole in the cap. The putty on the inner cap is formed into a “cup” to hold the specimen (Fig. 2), the putty on the outside is smoothed into a “button” to give good attachment even when the cap is flexed during handling (Fig. 3). The cap is submerged in the 70% ethanol, the bone at the base of the cochlea is seated into the cup and the sides of the cup squeezed with forceps to grip it (Fig.4). Several types of epoxy putty have been tried, most are either soluble in ethanol to some degree or do not set in ethanol. The only putty we find successful is “DUROtm MASTERMENDtm Epoxy Extra Strength Ribbon” (Loctite Corp., Cleveland, Ohio), this is a blue and yellow ribbon which is kneaded to form a green putty, it is available at many hardware stores.


Author(s):  
Neha Mehta ◽  
Svav Prasad ◽  
Leena Arya

Ultrasound imaging is one of the non-invasive imaging, that diagnoses the disease inside a human body and there are numerous ultrasonic devices being used frequently. Entropy as a well known statistical measure of uncertainty has a considerable impact on the medical images. A procedure for minimizing the entropy with respect to the region of interest is demonstrated. This new approach has shown the experiments using Extracted Region Of Interest Based Sharpened image, called as (EROIS) image based on Minimax entropy principle and various filters. In this turn, the approach also validates the versatility of the entropy concept. Experiments have been performed practically on the real-time ultrasound images collected from ultrasound centers and have shown a significant performance. The present approach has been validated with showing results over ultrasound images of the Human Gallbladder.


2017 ◽  
Vol 3 (2) ◽  
pp. 711-715
Author(s):  
Michael de Wild ◽  
Simon Zimmermann ◽  
Marcel Obrecht ◽  
Michel Dard

AbstractThin mechanically stable Ti-cages have been developed for the in-vivo application as X-ray and histology markers for the optimized evaluation of pre-clinical performance of bone graft materials. A metallic frame defines the region of interest during histological investigations and supports the identification of the defect site. This standardization of the procedure enhances the quality of pre-clinical experiments. Different models of thin metallic frameworks were designed and produced out of titanium by additive manufacturing (Selective Laser Melting). The productibility, the mechanical stability, the handling and suitability of several frame geometries were tested during surgery in artificial and in ex-vivo bone before a series of cages was preclinically investigated in the female Göttingen minipigs model. With our novel approach, a flexible process was established that can be adapted to the requirements of any specific animal model and bone graft testing.


Sign in / Sign up

Export Citation Format

Share Document