Robot vision system with a correlation chip for real-time tracking, optical flow and depth map generation

2003 ◽  
Author(s):  
H. Inoue ◽  
T. Tachikawa ◽  
M. Inaba
Keyword(s):  
Optical Flow ◽  
Real Time ◽  
Vision System ◽  
Robot Vision ◽  
Depth Map ◽  
Map Generation ◽  
Real Time Tracking

Robot Vision System for Human Detection and Action Recognition

2020 ◽  
Vol 24 (3) ◽  
pp. 346-356
Author(s):  
Satoshi Hoshino ◽  
◽  
Kyohei Niimura
Keyword(s):  
Optical Flow ◽  
Real Time ◽  
Action Recognition ◽  
Autonomous Navigation ◽  
Vision System ◽  
Robot Vision ◽  
Human Detection ◽  
Time Performance ◽  
Camera Sensors ◽  
Camera Sensor

Mobile robots equipped with camera sensors are required to perceive humans and their actions for safe autonomous navigation. For simultaneous human detection and action recognition, the real-time performance of the robot vision is an important issue. In this paper, we propose a robot vision system in which original images captured by a camera sensor are described by the optical flow. These images are then used as inputs for the human and action classifications. For the image inputs, two classifiers based on convolutional neural networks are developed. Moreover, we describe a novel detector (a local search window) for clipping partial images around the target human from the original image. Since the camera sensor moves together with the robot, the camera movement has an influence on the calculation of optical flow in the image, which we address by further modifying the optical flow for changes caused by the camera movement. Through the experiments, we show that the robot vision system can detect humans and recognize the action in real time. Furthermore, we show that a moving robot can achieve human detection and action recognition by modifying the optical flow.

scholarly journals Optical Flow for Real-Time Human Detection and Action Recognition Based on CNN Classifiers

2019 ◽  
Vol 23 (4) ◽  
pp. 735-742
Author(s):  
Satoshi Hoshino ◽  
◽  
Kyohei Niimura
Keyword(s):  
Optical Flow ◽  
Real Time ◽  
Autonomous Navigation ◽  
Vision System ◽  
Robot Vision ◽  
Human Detection ◽  
Original Image ◽  
Search Window ◽  
Time Performance ◽  
Camera Sensors

Mobile robots equipped with camera sensors are required to perceive surrounding humans and their actions for safe and autonomous navigation. In this work, moving humans are the target objects. For robot vision, real-time performance is an important requirement. Therefore, we propose a robot vision system in which the original images captured by a camera sensor are described by optical flow. These images are then used as inputs to a classifier. For classifying images into human and not-human classifications, and the actions, we use a convolutional neural network (CNN), rather than coding invariant features. Moreover, we present a local search window as a novel detector for clipping partial images around target objects in an original image. Through the experiments, we ultimately show that the robot vision system is able to detect moving humans and recognize action in real time.

A Novel Robot Vision Employing a Silicon Retina

2001 ◽  
Vol 13 (6) ◽  
pp. 614-620 ◽  
Author(s):  
Kazuhiro Shimonomura ◽  
◽  
Seiji Kameda ◽  
Kazuo Ishii ◽  
Tetsuya Yagi ◽  
...  
Keyword(s):  
Real Time ◽  
Integrated Circuit ◽  
Large Scale ◽  
Analog Circuit ◽  
Vision System ◽  
Robot Vision ◽  
Illumination Condition ◽  
Output Image ◽  
Analog Cmos ◽  
Silicon Retina

A Robot vision system was designed using a silicon retina, which has been developed to mimick the parallel circuit structure of the vertebrate retina. The silicon retina used here is an analog CMOS very large-scale integrated circuit, which executes Laplacian-Gaussian like filtering on the image in real time. The processing is robust to change of illumination condition. Analog circuit modules were designed to detect the contour from the output image of the silicon retina and to binarize the output image. The images processed by the silicon retina as well as those by the analog circuit modules are received by the DOS/V-compatible mother-board with NTSC signal, which enables higher level processings using digital image processing techniques. This novel robot vision system can achieve real time and robust processings in natural illumination condition with a compact hardware and a low power consumption.

Sign in / Sign up

Export Citation Format

Share Document