Optical-flow estimation for multichannel video sequences

1997 ◽  
Author(s):  
Chun-Jen Tsai ◽  
Aggelos K. Katsaggelos
Keyword(s):  
Optical Flow ◽  
Video Sequences ◽  
Flow Estimation ◽  
Optical Flow Estimation

scholarly journals ESTIMATION OF THE CROSS CORRELATION BASED OPTICAL FLOW FOR VIDEO SURVEILLANCE

2014 ◽  
pp. 112-117
Author(s):  
Rauf Sadykhov ◽  
Denis Lamovsky
Keyword(s):  
Optical Flow ◽  
Video Surveillance ◽  
Cross Correlation ◽  
Video Sequence ◽  
Correlation Coefficients ◽  
General Purpose ◽  
Video Sequences ◽  
Flow Estimation ◽  
Optical Flow Estimation ◽  
Filtering Technique

This paper describes a new algorithm to calculate cross-correlation function. We combined box filtering technique for calculation of cross correlation coefficients with parallel processing using MMX/SSE technology of modern general purpose processors. We have used this algorithm for real time optical flow estimation between frames of video sequence. Our algorithm was tested on real world video sequences obtained from the cameras of video surveillance system.

scholarly journals Every Frame Counts: Joint Learning of Video Segmentation and Optical Flow

2020 ◽  
Vol 34 (07) ◽  
pp. 10713-10720
Author(s):  
Mingyu Ding ◽  
Zhe Wang ◽  
Bolei Zhou ◽  
Jianping Shi ◽  
Zhiwu Lu ◽  
...  
Keyword(s):  
Optical Flow ◽  
Video Segmentation ◽  
Video Clip ◽  
Semantic Segmentation ◽  
Temporal Consistency ◽  
Flow Estimation ◽  
Optical Flow Estimation ◽  
Optical Flows ◽  
Benchmark Datasets ◽  
Spatio Temporal

A major challenge for video semantic segmentation is the lack of labeled data. In most benchmark datasets, only one frame of a video clip is annotated, which makes most supervised methods fail to utilize information from the rest of the frames. To exploit the spatio-temporal information in videos, many previous works use pre-computed optical flows, which encode the temporal consistency to improve the video segmentation. However, the video segmentation and optical flow estimation are still considered as two separate tasks. In this paper, we propose a novel framework for joint video semantic segmentation and optical flow estimation. Semantic segmentation brings semantic information to handle occlusion for more robust optical flow estimation, while the non-occluded optical flow provides accurate pixel-level temporal correspondences to guarantee the temporal consistency of the segmentation. Moreover, our framework is able to utilize both labeled and unlabeled frames in the video through joint training, while no additional calculation is required in inference. Extensive experiments show that the proposed model makes the video semantic segmentation and optical flow estimation benefit from each other and outperforms existing methods under the same settings in both tasks.

Sign in / Sign up

Export Citation Format

Share Document