Depth from focus for 3D reconstruction by iteratively building uniformly focused image set

Author(s):  
Sherzod Salokhiddinov ◽  
Seungkyu Lee
2020 ◽  
Vol 10 (23) ◽  
pp. 8522
Author(s):  
Sherzod Salokhiddinov ◽  
Seungkyu Lee

Estimating the 3D shape of a scene from differently focused set of images has been a practical approach for 3D reconstruction with color cameras. However, reconstructed depth with existing depth from focus (DFF) methods still suffer from poor quality with textureless and object boundary regions. In this paper, we propose an improved depth estimation based on depth from focus iteratively refining 3D shape from uniformly focused image set (UFIS). We investigated the appearance changes in spatial and frequency domains in iterative manner. In order to achieve sub-frame accuracy in depth estimation, optimal location of focused frame in DFF is estimated by fitting a polynomial curve on the dissimilarity measurements. In order to avoid wrong depth values on texture-less regions we propose to build a confidence map and use it to identify erroneous depth estimations. We evaluated our method on public and our own datasets obtained from different types of devices, such as smartphones, medical, and normal color cameras. Quantitative and qualitative evaluations on various test image sets show promising performance of the proposed method in depth estimation.


2017 ◽  
Vol 46 (1) ◽  
pp. 20160040
Author(s):  
X. Cui ◽  
X. Zhou ◽  
J. Lou ◽  
J. Zhang ◽  
M. Ran

Author(s):  
Jose-Maria Carazo ◽  
I. Benavides ◽  
S. Marco ◽  
J.L. Carrascosa ◽  
E.L. Zapata

Obtaining the three-dimensional (3D) structure of negatively stained biological specimens at a resolution of, typically, 2 - 4 nm is becoming a relatively common practice in an increasing number of laboratories. A combination of new conceptual approaches, new software tools, and faster computers have made this situation possible. However, all these 3D reconstruction processes are quite computer intensive, and the middle term future is full of suggestions entailing an even greater need of computing power. Up to now all published 3D reconstructions in this field have been performed on conventional (sequential) computers, but it is a fact that new parallel computer architectures represent the potential of order-of-magnitude increases in computing power and should, therefore, be considered for their possible application in the most computing intensive tasks.We have studied both shared-memory-based computer architectures, like the BBN Butterfly, and local-memory-based architectures, mainly hypercubes implemented on transputers, where we have used the algorithmic mapping method proposed by Zapata el at. In this work we have developed the basic software tools needed to obtain a 3D reconstruction from non-crystalline specimens (“single particles”) using the so-called Random Conical Tilt Series Method. We start from a pair of images presenting the same field, first tilted (by ≃55°) and then untilted. It is then assumed that we can supply the system with the image of the particle we are looking for (ideally, a 2D average from a previous study) and with a matrix describing the geometrical relationships between the tilted and untilted fields (this step is now accomplished by interactively marking a few pairs of corresponding features in the two fields). From here on the 3D reconstruction process may be run automatically.


Author(s):  
Adriana Verschoor ◽  
Ronald Milligan ◽  
Suman Srivastava ◽  
Joachim Frank

We have studied the eukaryotic ribosome from two vertebrate species (rabbit reticulocyte and chick embryo ribosomes) in several different electron microscopic preparations (Fig. 1a-d), and we have applied image processing methods to two of the types of images. Reticulocyte ribosomes were examined in both negative stain (0.5% uranyl acetate, in a double-carbon preparation) and frozen hydrated preparation as single-particle specimens. In addition, chick embryo ribosomes in tetrameric and crystalline assemblies in frozen hydrated preparation have been examined. 2D averaging, multivariate statistical analysis, and classification methods have been applied to the negatively stained single-particle micrographs and the frozen hydrated tetramer micrographs to obtain statistically well defined projection images of the ribosome (Fig. 2a,c). 3D reconstruction methods, the random conical reconstruction scheme and weighted back projection, were applied to the negative-stain data, and several closely related reconstructions were obtained. The principal 3D reconstruction (Fig. 2b), which has a resolution of 3.7 nm according to the differential phase residual criterion, can be compared to the images of individual ribosomes in a 2D tetramer average (Fig. 2c) at a similar resolution, and a good agreement of the general morphology and of many of the characteristic features is seen.Both data sets show the ribosome in roughly the same ’view’ or orientation, with respect to the adsorptive surface in the electron microscopic preparation, as judged by the agreement in both the projected form and the distribution of characteristic density features. The negative-stain reconstruction reveals details of the ribosome morphology; the 2D frozen-hydrated average provides projection information on the native mass-density distribution within the structure. The 40S subunit appears to have an elongate core of higher density, while the 60S subunit shows a more complex pattern of dense features, comprising a rather globular core, locally extending close to the particle surface.


2015 ◽  
Vol 29 (3) ◽  
pp. 119-129 ◽  
Author(s):  
Richard J. Stevenson ◽  
Deborah Hodgson ◽  
Megan J. Oaten ◽  
Luba Sominsky ◽  
Mehmet Mahmut ◽  
...  

Abstract. Both disgust and disease-related images appear able to induce an innate immune response but it is unclear whether these effects are independent or rely upon a common shared factor (e.g., disgust or disease-related cognitions). In this study we directly compared these two inductions using specifically generated sets of images. One set was disease-related but evoked little disgust, while the other set was disgust evoking but with less disease-relatedness. These two image sets were then compared to a third set, a negative control condition. Using a wholly within-subject design, participants viewed one image set per week, and provided saliva samples, before and after each viewing occasion, which were later analyzed for innate immune markers. We found that both the disease related and disgust images, relative to the negative control images, were not able to generate an innate immune response. However, secondary analyses revealed innate immune responses in participants with greater propensity to feel disgust following exposure to disease-related and disgusting images. These findings suggest that disgust images relatively free of disease-related themes, and disease-related images relatively free of disgust may be suboptimal cues for generating an innate immune response. Not only may this explain why disgust propensity mediates these effects, it may also imply a common pathway.


2007 ◽  
Vol 3 (1) ◽  
pp. 89-113
Author(s):  
Zoltán Gillay ◽  
László Fenyvesi

There was a method developed that generates the three-dimensional model of not axisymmetric produce, based on an arbitrary number of photos. The model can serve as a basis for calculating the surface area and the volume of produce. The efficiency of the reconstruction was tested on bell peppers and artificial shapes. In case of bell peppers 3-dimensional reconstruction was created from 4 images rotated in 45° angle intervals. The surface area and the volume were estimated on the basis of the reconstructed area. Furthermore, a new and simple reference method was devised to give precise results for the surface area of bell pepper. The results show that this 3D reconstruction-based surface area and volume calculation method is suitable to determine the surface area and volume of definite bell peppers with an acceptable error.


2020 ◽  
Vol 64 (2) ◽  
pp. 20506-1-20506-7
Author(s):  
Min Zhu ◽  
Rongfu Zhang ◽  
Pei Ma ◽  
Xuedian Zhang ◽  
Qi Guo

Abstract Three-dimensional (3D) reconstruction is extensively used in microscopic applications. Reducing excessive error points and achieving accurate matching of weak texture regions have been the classical challenges for 3D microscopic vision. A Multi-ST algorithm was proposed to improve matching accuracy. The process is performed in two main stages: scaled microscopic images and regularized cost aggregation. First, microscopic image pairs with different scales were extracted according to the Gaussian pyramid criterion. Second, a novel cost aggregation approach based on the regularized multi-scale model was implemented into all scales to obtain the final cost. To evaluate the performances of the proposed Multi-ST algorithm and compare different algorithms, seven groups of images from the Middlebury dataset and four groups of experimental images obtained by a binocular microscopic system were analyzed. Disparity maps and reconstruction maps generated by the proposed approach contained more information and fewer outliers or artifacts. Furthermore, 3D reconstruction of the plug gauges using the Multi-ST algorithm showed that the error was less than 0.025 mm.


Sign in / Sign up

Export Citation Format

Share Document