scholarly journals Real-time markerless video tracking of body parts in mice using deep neural networks

2018 ◽  
Author(s):  
Brandon Forys ◽  
Dongsheng Xiao ◽  
Pankaj Gupta ◽  
Jamie D Boyd ◽  
Timothy H Murphy
Keyword(s):  
Real Time ◽  
Behavioral Science ◽  
Behavioral Control ◽  
Brain Regions ◽  
Video Tracking ◽  
Frame Rate ◽  
Body Parts ◽  
Neural Basis ◽  
Movement Initiation ◽  
Optogenetic Stimulation

ABSTRACTMarkerless and accurate tracking of mouse movement is of interest to many biomedical, pharmaceutical, and behavioral science applications. The additional capability of tracking body parts in real-time with minimal latency opens up the possibility of manipulating motor feedback, allowing detailed explorations of the neural basis for behavioral control. Here we describe a system capable of tracking specific movements in mice at a frame rate of 30.3 Hz. To achieve these results, we adapt DeepLabCut – a robust movement-tracking deep neural network framework – for real-time tracking of body movements in mice. We estimate paw movements of mice in real time and demonstrate the concept of movement-triggered optogenetic stimulation by flashing a USB-CGPIO controlled LED that is triggered when real time analysis of movement exceeds a pre-set threshold. The mean time delay between movement initiation and LED flash was 93.44 ms, a latency sufficient for applying behaviorally-triggered feedback. This manuscript presents the rationale and details of the algorithms employed and shows implementation of the system using behaving mice. This system lays the groundwork for a behavior-triggered ‘closed loop’ brain-machine interface with optogenetic stimulation of specific brain regions for feedback.

144 Prefrontal Neurons Modulate Motor Behavior by Targeting Distinct Mediolateral Cortical Sites

Neurosurgery ◽  
2017 ◽  
Vol 64 (CN_suppl_1) ◽  
pp. 234-234
Author(s):  
Benjamin L Grannan ◽  
Wenhua Zhang ◽  
Songjun William Li ◽  
Ziv Williams
Keyword(s):  
Prefrontal Cortex ◽  
Motor Behavior ◽  
Behavioral Control ◽  
Motor Task ◽  
Field Potential ◽  
Cognitive Disorders ◽  
T Test ◽  
Neural Basis ◽  
Movement Initiation ◽  
Gc Analysis

Abstract INTRODUCTION Injury to the prefrontal cortex (PFC) can result in maladaptive and disinhibited behavior. However, the neural basis for behavioral control of the prefrontal cortex remains largely unknown. Here, we explored the role of the dorsolateral PFC (dlPFC) in orchestrating motor behavior by conducting simultaneous, invasive recordings of the DLPFC, supplementary motor area (SMA), and dorsal premotor (PMd) in primates. METHODS Cortical surface microarrays were implanted into the dlPFC, SMA, and PMd of two monkeys who then participated in a reward-based motor task. For each trial, a monkey received visual instructional cues correlating to a two-step joystick movement plan. They then received cues to either initiate or withhold each step of the plan. Coherence and Granger causality (GC) analysis of the local field potential (LFP) data was used to characterize the interactions between the cortical sites during various behavioral scenarios (initiation, withholding, continuing, or aborting an initiated motor task). RESULTS >Theta band (3-7 Hz) coherence activity was found to most greatly distinguish the four behavioral scenarios. Initiation and continuation cues were associated with increased dlPFC-SMA and dlPFC-PMd coherence (t-test, P < 10e-12), but a more significant increase was seen in dlPFC-SMA compared to dlPFC-PMd (ANOVA, P < 0.001). Inhibition of movement initiation was characterized by dlPFC-SMA coherence increase but lack of dlPFC-PMd coherence change (t-test, P = 0.9). Aborting an already initiated movement sequence was associated with a global decrement in coherence (t-test, P < 10e-35). GC analysis demonstrated that these coherence changes were generally associated with an increase of information flow from the PFC to the more distal mediolateral frontal sites. CONCLUSION We discovered two functional circuitries between the pre-frontal and pre-motor cortices that distinctly control initiation and inhibition of motor behavior. These findings provide an important circuit-based model on which to understand and prospectively treat neuro-cognitive disorders characterized by disinhibition and maladaptation.

Optimizing Design of Real-Time Spatial Moving Target Tracking System

2011 ◽  
Vol 328-330 ◽  
pp. 2234-2237
Author(s):  
Dong Sheng Liang ◽  
Zhao Hui Liu ◽  
Wen Liu
Keyword(s):  
Real Time ◽  
Video Processing ◽  
Tracking System ◽  
Processing System ◽  
Video Tracking ◽  
Image Resolution ◽  
Frame Rate ◽  
Moving Target ◽  
Detection And Tracking ◽  
Operation Speed

Achieving the detection and tracking of moving targets has been widely applied in all fields of today's society. Because of the shortcomings of traditional video tracking system, this paper proposes a novel method for designing video processing system based on hardware design of FPGA and DSP, and moving target in video can be detected and tracked by this system. In this system, DSP as the core of the system, it mainly completes the processing algorithms of video and image data, FPGA as a coprocessor, responsible for the completion of the processing of external data and logic. The hardware structure, link configuration, program code and other aspects of system are optimized. Finally, through the experiment, the input frame rate of video is 40frames/s, and the image resolution is 512pixels × 512pixels, median 16bites quantitative image sequence, the system can complete the relevant real-time detection and tracking algorithm and extract targets position of image sequences correctly. The results show that the advantage is that this system has powerful operation speed, real time, high accuracy and stability.

scholarly journals An Efficient Real Time Object Tracking Based on HSV Value

2021 ◽  
Vol 9 (11) ◽  
pp. 1197-1203
Author(s):  
Sheikh Summerah
Keyword(s):  
Object Tracking ◽  
Real Time ◽  
Moving Objects ◽  
Color Space ◽  
Video Tracking ◽  
Frame Rate ◽  
Long Distance ◽  
Hsv Color Space ◽  
Video Frames ◽  
Testing Stage

Abstract: This study presents a strategy to automate the process to recognize and track objects using color and motion. Video Tracking is the approach to detect a moving item using a camera across the long distance. The basic goal of video tracking is in successive video frames to link target objects. When objects move quicker in proportion to frame rate, the connection might be particularly difficult. This work develops a method to follow moving objects in real-time utilizing HSV color space values and OpenCV in distinct video frames.. We start by deriving the HSV value of an object to be tracked and then in the testing stage, track the object. It was seen that the objects were tracked with 90% accuracy. Keywords: HSV, OpenCV, Object tracking,

scholarly journals Object Tracking Using HSV Values and OpenCV

2021 ◽  
Vol 9 (12) ◽  
pp. 594-599
Author(s):  
Gowher Shafi
Keyword(s):  
Object Tracking ◽  
Real Time ◽  
Moving Objects ◽  
Video Tracking ◽  
Frame Rate ◽  
Colour Space ◽  
Long Distance ◽  
Video Frames ◽  
Hsv Colour Space ◽  
Percent Accuracy

Abstract: This research shows how to use colour and movement to automate the process of recognising and tracking things. Video tracking is a technique for detecting a moving object over a long distance using a camera. The main purpose of video tracking is to connect target objects in subsequent video frames. The connection may be particularly troublesome when things move faster than the frame rate. Using HSV colour space values and OpenCV in different video frames, this study proposes a way to track moving objects in real-time. We begin by calculating the HSV value of an item to be monitored, and then we track the object throughout the testing step. The items were shown to be tracked with 90 percent accuracy. Keywords: HSV, OpenCV, Object tracking, Video frames, GUI

scholarly journals Real-time FPGA-based implementation of the AKAZE algorithm with nonlinear scale space generation using image partitioning

2021 ◽  
Author(s):  
Parastoo Soleimani ◽  
David W. Capson ◽  
Kin Fun Li
Keyword(s):  
Real Time ◽  
Memory Management ◽  
Scale Space ◽  
Image Resolution ◽  
Hardware Architecture ◽  
Frame Rate ◽  
Time Sharing ◽  
Scale Invariant ◽  
Nonlinear Scale Space ◽  
Nonlinear Scale

AbstractThe first step in a scale invariant image matching system is scale space generation. Nonlinear scale space generation algorithms such as AKAZE, reduce noise and distortion in different scales while retaining the borders and key-points of the image. An FPGA-based hardware architecture for AKAZE nonlinear scale space generation is proposed to speed up this algorithm for real-time applications. The three contributions of this work are (1) mapping the two passes of the AKAZE algorithm onto a hardware architecture that realizes parallel processing of multiple sections, (2) multi-scale line buffers which can be used for different scales, and (3) a time-sharing mechanism in the memory management unit to process multiple sections of the image in parallel. We propose a time-sharing mechanism for memory management to prevent artifacts as a result of separating the process of image partitioning. We also use approximations in the algorithm to make hardware implementation more efficient while maintaining the repeatability of the detection. A frame rate of 304 frames per second for a $$1280 \times 768$$ 1280 × 768 image resolution is achieved which is favorably faster in comparison with other work.

scholarly journals Incerto-thalamic modulation of fear via GABA and dopamine

2021 ◽  
Author(s):  
Archana Venkataraman ◽  
Sarah C. Hunter ◽  
Maria Dhinojwala ◽  
Diana Ghebrezadik ◽  
JiDong Guo ◽  
...  
Keyword(s):  
Brain Regions ◽  
Zona Incerta ◽  
Dependent Manner ◽  
Post Traumatic Stress ◽  
Functional Roles ◽  
Functional Connections ◽  
Optogenetic Stimulation ◽  
Fear Generalization ◽  
Stimulation Of

AbstractFear generalization and deficits in extinction learning are debilitating dimensions of Post-Traumatic Stress Disorder (PTSD). Most understanding of the neurobiology underlying these dimensions comes from studies of cortical and limbic brain regions. While thalamic and subthalamic regions have been implicated in modulating fear, the potential for incerto-thalamic pathways to suppress fear generalization and rescue deficits in extinction recall remains unexplored. We first used patch-clamp electrophysiology to examine functional connections between the subthalamic zona incerta and thalamic reuniens (RE). Optogenetic stimulation of GABAergic ZI → RE cell terminals in vitro induced inhibitory post-synaptic currents (IPSCs) in the RE. We then combined high-intensity discriminative auditory fear conditioning with cell-type-specific and projection-specific optogenetics in mice to assess functional roles of GABAergic ZI → RE cell projections in modulating fear generalization and extinction recall. In addition, we used a similar approach to test the possibility of fear generalization and extinction recall being modulated by a smaller subset of GABAergic ZI → RE cells, the A13 dopaminergic cell population. Optogenetic stimulation of GABAergic ZI → RE cell terminals attenuated fear generalization and enhanced extinction recall. In contrast, optogenetic stimulation of dopaminergic ZI → RE cell terminals had no effect on fear generalization but enhanced extinction recall in a dopamine receptor D1-dependent manner. Our findings shed new light on the neuroanatomy and neurochemistry of ZI-located cells that contribute to adaptive fear by increasing the precision and extinction of learned associations. In so doing, these data reveal novel neuroanatomical substrates that could be therapeutically targeted for treatment of PTSD.

scholarly journals Real-time video tracking using PTZ cameras

2003 ◽  
Author(s):  
Sangkyu Kang ◽  
Joon-Ki Paik ◽  
Andreas Koschan ◽  
Besma R. Abidi ◽  
Mongi A. Abidi
Keyword(s):  
Real Time ◽  
Video Tracking
Sign in / Sign up

Export Citation Format

Share Document