Structure-preserving Interpolation of Temporal and Spatial Image Sequences Using an Optical Flow-based Method

2007 ◽  
Vol 46 (03) ◽  
pp. 300-307 ◽  
Author(s):  
D. Säring ◽  
H. Handels ◽  
J. Ehrhardt
Keyword(s):  
Velocity Field ◽  
Optical Flow ◽  
Temporal Resolution ◽  
Interpolation Method ◽  
Image Data ◽  
Image Sequences ◽  
Registration Method ◽  
Structure Preserving ◽  
Spatial Image ◽  
Temporal And Spatial

Summary Objectives: Modern tomographic imaging devices enable the acquisition of spatial and temporal image sequences. But, the spatial and temporal resolution of such devices is limited and therefore image interpolation techniques are needed to represent images at a desired level of discretization. This paper presents a method for structure-preserving interpolation between neighboring slices in temporal or spatial image sequences. Methods: In a first step, the spatiotemporal velocity field between image slices is determined using an optical flow-based registration method in order to establish spatial correspondence between adjacent slices. An iterative algorithm is applied using the spatial and temporal image derivatives and a spatiotemporal smoothing step. Afterwards, the calculated velocity field is used to generate an interpolated image at the desired time by averaging intensities between corresponding points. Three quantitative measures are defined to evaluate the performance of the interpolation method. Results: The behaviorand capability of the algorithm is demonstrated by synthetic images. A population of 17 temporal and spatial image sequences are utilized to compare the optical flow-based interpolation method to linear and shape-based interpolation. The quantitative results show that the optical flow-based method outperforms the linear and shape-based interpolation statistically significantly. Conclusions: The interpolation method presented is able to generate image sequences with appropriate spatial or temporal resolution needed for image comparison, analysis or visualization tasks. Quantitative and qualitative measures extracted from synthetic phantoms and medical image data show that the new method definitely has advantages over linear and shape-based interpolation.

An Algorithm for Optical Flow Computation Based on a Quasi-Interpolant Operator

2006 ◽  
Vol 2 (1-2) ◽  
pp. 93-106 ◽  
Author(s):  
E. Francomano ◽  
C. Lodato ◽  
S. Lopes ◽  
A. Tortorici
Keyword(s):  
Velocity Field ◽  
Flow Field ◽  
Optical Flow ◽  
Linear Systems ◽  
Apparent Motion ◽  
Fundamental Problem ◽  
Image Sequences ◽  
Spline Functions ◽  
Flow Computation ◽  
Optical Flow Computation

A fundamental problem in the processing of image sequences is the computation of the velocity field of the apparent motion of brightness patterns usually referred to optical flow. In this paper a novel optical flow estimator based on a bivariate quasi-interpolant operator is presented. Namely, a non linear minimizing technique has been employed to compute the velocity vectors by modeling the flow field with a 2D quasi-interpolant operator based on centered cardinal B-spline functions. In this way an efficient computational scheme for optical flow estimate is provided. In addition the large solving linear systems involved in the process are sparse. Experiments on several image sequences have been carried out in order to investigate the performance of the optical flow estimator.

scholarly journals A Driver’s Visual Attention Prediction Using Optical Flow

Sensors ◽  
2021 ◽  
Vol 21 (11) ◽  
pp. 3722
Author(s):  
Byeongkeun Kang ◽  
Yeejin Lee
Keyword(s):  
Visual Attention ◽  
Optical Flow ◽  
Prediction Models ◽  
Apparent Movement ◽  
Image Sequences ◽  
Motion Information ◽  
Accuracy Improvement ◽  
Flow Maps ◽  
Current State ◽  
Motion Features

Motion in videos refers to the pattern of the apparent movement of objects, surfaces, and edges over image sequences caused by the relative movement between a camera and a scene. Motion, as well as scene appearance, are essential features to estimate a driver’s visual attention allocation in computer vision. However, the fact that motion can be a crucial factor in a driver’s attention estimation has not been thoroughly studied in the literature, although driver’s attention prediction models focusing on scene appearance have been well studied. Therefore, in this work, we investigate the usefulness of motion information in estimating a driver’s visual attention. To analyze the effectiveness of motion information, we develop a deep neural network framework that provides attention locations and attention levels using optical flow maps, which represent the movements of contents in videos. We validate the performance of the proposed motion-based prediction model by comparing it to the performance of the current state-of-art prediction models using RGB frames. The experimental results for a real-world dataset confirm our hypothesis that motion plays a role in prediction accuracy improvement, and there is a margin for accuracy improvement by using motion features.

scholarly journals A Quasi-Static Quantitative Ultrasound Elastography Algorithm Using Optical Flow

Sensors ◽  
2021 ◽  
Vol 21 (9) ◽  
pp. 3010
Author(s):  
Raphael Lamprecht ◽  
Florian Scheible ◽  
Marion Semmler ◽  
Alexander Sutor
Keyword(s):  
Optical Flow ◽  
Young’S Modulus ◽  
Elastic Properties ◽  
Young's Modulus ◽  
Image Data ◽  
Maximum Error ◽  
Ultrasound Elastography ◽  
Static Compression ◽  
Tissue Properties ◽  
A Performance

Ultrasound elastography is a constantly developing imaging technique which is capable of displaying the elastic properties of tissue. The measured characteristics could help to refine physiological tissue models, but also indicate pathological changes. Therefore, elastography data give valuable insights into tissue properties. This paper presents an algorithm that measures the spatially resolved Young’s modulus of inhomogeneous gelatin phantoms using a CINE sequence of a quasi-static compression and a load cell measuring the compressing force. An optical flow algorithm evaluates the resulting images, the stresses and strains are computed, and, conclusively, the Young’s modulus and the Poisson’s ratio are calculated. The whole algorithm and its results are evaluated by a performance descriptor, which determines the subsequent calculation and gives the user a trustability index of the modulus estimation. The algorithm shows a good match between the mechanically measured modulus and the elastography result—more precisely, the relative error of the Young’s modulus estimation with a maximum error 35%. Therefore, this study presents a new algorithm that is capable of measuring the elastic properties of gelatin specimens in a quantitative way using only the image data. Further, the computation is monitored and evaluated by a performance descriptor, which measures the trustability of the results.

scholarly journals Combined Local Global Optical Flow Approach in Bio-medical Image Sequences for blood flow detection

IJARCCE ◽  
2015 ◽  
pp. 468-473
Author(s):  
Kazi Md. Shahiduzzaman ◽  
Khan Mamun Reza ◽  
Nusrat Tazin
Keyword(s):  
Blood Flow ◽  
Optical Flow ◽  
Medical Image ◽  
Image Sequences ◽  
Flow Detection

Analysis of the Velocity Field of CMEs Using Optical Flow Methods

2006 ◽  
Vol 652 (2) ◽  
pp. 1747-1754 ◽  
Author(s):  
Robin C. Colaninno ◽  
Angelos Vourlidas
Keyword(s):  
Velocity Field ◽  
Optical Flow

Mouth Shape Detection Based on Template Matching and Optical Flow for Machine Lip Reading

2013 ◽  
Vol 1 (1) ◽  
pp. 14-25 ◽  
Author(s):  
Tsuyoshi Miyazaki ◽  
Toyoshiro Nakashima ◽  
Naohiro Ishii
Keyword(s):  
Optical Flow ◽  
Template Matching ◽  
High Speed ◽  
Image Sequences ◽  
Previous Method ◽  
The Other ◽  
High Speed Camera ◽  
Improved Method ◽  
Time Period ◽  
Lip Reading

The authors describe an improved method for detecting distinctive mouth shapes in Japanese utterance image sequences. Their previous method uses template matching. Two types of mouth shapes are formed when a Japanese phone is pronounced: one at the beginning of the utterance (the beginning mouth shape, BeMS) and the other at the end (the ending mouth shape, EMS). The authors’ previous method could detect mouth shapes, but it misdetected some shapes because the time period in which the BeMS was formed was short. Therefore, they predicted that a high-speed camera would be able to capture the BeMS with higher accuracy. Experiments showed that the BeMS could be captured; however, the authors faced another problem. Deformed mouth shapes that appeared in the transition from one shape to another were detected as the BeMS. This study describes the use of optical flow to prevent the detection of such mouth shapes. The time period in which the mouth shape is deformed is detected using optical flow, and the mouth shape during this time is ignored. The authors propose an improved method of detecting the BeMS and EMS in Japanese utterance image sequences by using template matching and optical flow.

scholarly journals The deployable telescope: a cutting-edge solution for high spatial and temporal resolved Earth observation

2018 ◽  
Vol 7 (6) ◽  
pp. 365-376 ◽  
Author(s):  
Dennis Dolkens ◽  
Hans Kuiper ◽  
Victor Villalba Corbacho
Keyword(s):  
Temporal Resolution ◽  
Systems Engineering ◽  
Systems Design ◽  
Image Data ◽  
Earth Observation ◽  
Cutting Edge ◽  
High Mass ◽  
Current Status ◽  
Active Optics ◽  
The Status

Abstract The increase of spatial and temporal resolution for Earth observation (EO) is the ultimate driver for science and societal applications. However, the state-of-the-art EO missions like DigitalGlobe’s Worldview-3, are very costly. Moreover, this system has a high mass of 2800 kg and limited swath width of about 15 km which limits the temporal resolution. In this article, we present the status of the deployable space telescope (DST) project, which has been running for 6 years now at the Delft University of Technology, as a cutting-edge solution to solve this issue. Deployable optics have the potential of revolutionising the field of high resolution EO. By splitting up the primary mirror (M1) of a telescope into deployable segments and placing the secondary mirror (M2) on a deployable boom, the launch volume of a telescope can be reduced by a factor of 4 or more, allowing for much lower launch costs. This allows for larger EO constellations, providing image data with a much better revisit time than existing solutions. The DST specification baseline, based on Wordview-3, aims to provide images with a ground resolution of 25 cm (panchromatic 450–650 nm) from an orbital altitude of 500 km. In this paper, the current status of the optical, thermo-mechanical, and active optics systems design are described. The concurrent design approach combined with a strict bottom-up and top-down compliant systems engineering approach show that the DST is a healthy system concept.

Sign in / Sign up

Export Citation Format

Share Document