scholarly journals View-channel-depth light-field microscopy: real-time volumetric reconstruction of biological dynamics by deep learning

2018 ◽  
Author(s):  
Zhaoqiang Wang ◽  
Lanxin Zhu ◽  
Hao Zhang ◽  
Guo Li ◽  
Chengqiang Yi ◽  
...  
Keyword(s):  
High Speed ◽  
Light Field ◽  
Three Dimensional ◽  
Image Sequences ◽  
Biological Processes ◽  
Channel Depth ◽  
Volumetric Imaging ◽  
C Elegans ◽  
Volumetric Reconstruction ◽  
Zebrafish Heart

AbstractLight-field microscopy has emerged as a technique of choice for high-speed volumetric imaging of fast biological processes. However, artefacts, non-uniform resolution, and a slow reconstruction speed have limited its full capabilities for in toto extraction of the dynamic spatiotemporal patterns in samples. Here, we combined a view-channel-depth (VCD) neural network with light-field microscopy to mitigate these limitations, yielding artefact-free three-dimensional image sequences with uniform spatial resolution and three-order-higher video-rate reconstruction throughput. We imaged neuronal activities across moving C. elegans and blood flow in a beating zebrafish heart at single-cell resolution with volume rates up to 200 Hz.

Three Dimensional Imaging of LIGA-Made Microcomponents

2004 ◽  
Vol 126 (4) ◽  
pp. 813-821 ◽  
Author(s):  
Douglas Chinn ◽  
Peter Ostendorp ◽  
Mike Haugh ◽  
Russell Kershmann ◽  
Thomas Kurfess ◽  
...  
Keyword(s):  
Computer Aided Design ◽  
High Speed ◽  
Three Dimensional ◽  
Point Clouds ◽  
Three Dimensions ◽  
Cad Model ◽  
Volumetric Imaging ◽  
Data Registration ◽  
Liga Technology ◽  
Coordinate Metrology

Nickel and nickel-alloy microparts sized on the order of 5–1000 microns have been imaged in three dimensions using a new microscopic technique, Digital Volumetric Imaging (DVI). The gears were fabricated using Sandia National Laboratories’ LIGA technology (lithography, molding, and electroplating). The images were taken on a microscope built by Resolution Sciences Corporation by slicing the gear into one-micron thin slices, photographing each slice, and then reconstructing the image with software. The images were matched to the original CAD (computer aided design) model, allowing LIGA designers, for the first time, to see visually how much deviation from the design is induced by the manufacturing process. Calibration was done by imaging brass ball bearings and matching them to the CAD model of a sphere. A major advantage of DVI over scanning techniques is that internal defects can be imaged to very high resolution. In order to perform the metrology operations on the microcomponents, high-speed and high-precision algorithms are developed for coordinate metrology. The algorithms are based on a least-squares approach to data registration the {X,Y,Z} point clouds generated from the component surface onto a target geometry defined in a CAD model. Both primitive geometric element analyses as well as an overall comparison of the part geometry are discussed. Initial results of the micromeasurements are presented in the paper.

scholarly journals Single-Shot Optical Projection tomography for high-speed volumetric imaging

2021 ◽  
Author(s):  
Connor James Darling ◽  
Samuel P.X. Davis ◽  
Sunil Kumar ◽  
Paul M.W. French ◽  
James A McGinty
Keyword(s):  
High Speed ◽  
Low Cost ◽  
Single Shot ◽  
Optical Projection Tomography ◽  
Data Set ◽  
Volumetric Imaging ◽  
Optical Projection ◽  
Volumetric Reconstruction ◽  
Projection Images

We present a single-shot adaptation of Optical Projection Tomography (OPT) for high-speed volumetric snapshot imaging of dynamic mesoscopic samples. Conventional OPT has been applied to in vivo imaging of animal models such as D. rerio but the sequential acquisition of projection images required for volumetric reconstruction typically requires samples to be immobilised during the acquisition of an OPT data set. We present a proof-of-principle system capable of single-shot imaging of a 1 mm diameter volume, demonstrating camera-limited rates of up to 62.5 volumes/second, which we have applied to 3D imaging of a freely-swimming zebrafish embryo. This is achieved by recording 8 projection views simultaneously on 4 low-cost CMOS cameras. With no stage required to rotate the sample, this single-shot OPT system can be implemented with a component cost of under 5,000GBP. The system design can be adapted to different sized fields of view and may be applied to a broad range of dynamic samples, including fluid dynamics.

Structured Light Field Generated by Two Projectors for High-Speed Three Dimensional Measurement

2016 ◽  
Vol 28 (4) ◽  
pp. 523-532 ◽  
Author(s):  
Akihiro Obara ◽  
◽  
Xu Yang ◽  
Hiromasa Oku ◽  
Keyword(s):  
High Speed ◽  
Light Field ◽  
Stereo Matching ◽  
Structured Light ◽  
Three Dimensional ◽  
Depth Estimation ◽  
Image Features ◽  
Depth Information ◽  
Speed Tracking ◽  
Three Dimensional Measurement

[abstFig src='/00280004/10.jpg' width='300' text='Concept of SLF generated by two projectors' ] Triangulation is commonly used to restore 3D scenes, but its frame of less than 30 fps due to time-consuming stereo-matching is an obstacle for applications requiring that results be fed back in real time. The structured light field (SLF) our group proposed previously reduced the amount of calculation in 3D restoration, realizing high-speed measurement. Specifically, the SLF estimates depth information by projecting information on distance directly to a target. The SLF synthesized as reported, however, presents difficulty in extracting image features for depth estimation. In this paper, we propose synthesizing the SLF using two projectors with a certain layout. Our proposed SLF’s basic properties are based on an optical model. We evaluated the SLF’s performance using a prototype we developed and applied to the high-speed depth estimation of a target moving randomly at a speed of 1000 Hz. We demonstrate the target’s high-speed tracking based on high-speed depth information feedback.

Three-Dimensional Structural Characterization of Nonwoven Fabrics

2012 ◽  
Vol 18 (6) ◽  
pp. 1368-1379 ◽  
Author(s):  
Lalith B. Suragani Venu ◽  
Eunkyoung Shim ◽  
Nagendra Anantharamaiah ◽  
Behnam Pourdeyhimi
Keyword(s):  
High Speed ◽  
Imaging Technique ◽  
Low Cost ◽  
Three Dimensional ◽  
Complex Nature ◽  
Volumetric Imaging ◽  
Analysis Techniques ◽  
Nonwoven Fabrics ◽  
Nonwoven Materials

AbstractNonwoven materials are found in a gamut of critical applications. This is partly due to the fact that these structures can be produced at high speed and engineered to deliver unique functionality at low cost. The behavior of these materials is highly dependent on alignment of fibers within the structure. The ability to characterize and also to control the structure is important, but very challenging due to the complex nature of the structures. Thus, to date, focus has been placed mainly on two-dimensional analysis techniques for describing the behavior of nonwovens. This article demonstrates the utility of three-dimensional (3D) digital volumetric imaging technique for visualizing and characterizing a complex 3D class of nonwoven structures produced by hydroentanglement.

scholarly journals Capturing volumetric dynamics at high speed in the brain by confocal light field microscopy

2020 ◽  
Author(s):  
Zhenkun Zhang ◽  
Lu Bai ◽  
Lin Cong ◽  
Peng Yu ◽  
Tianlei Zhang ◽  
...  
Keyword(s):  
High Speed ◽  
Light Field ◽  
Prey Capture ◽  
Vascular System ◽  
Imaging Techniques ◽  
Three Dimensions ◽  
Proper Function ◽  
Imaging Method ◽  
Volumetric Imaging ◽  
Neural Activities

AbstractNeural network performs complex computations through coordinating collective neural dynamics that are fast and in three-dimensions. Meanwhile, its proper function relies on its 3D supporting environment, including the highly dynamic vascular system that drives energy and material flow. Better understanding of these processes requires methods to capture fast volumetric dynamics in thick tissue. This becomes challenging due to the trade-off between speed and optical sectioning capability in conventional imaging techniques. Here we present a new imaging method, confocal light field microscopy, to enable fast volumetric imaging deep into brain. We demonstrated the power of this method by recording whole brain calcium transients in freely swimming larval zebrafish and observed behaviorally correlated activities on single neurons during its prey capture. Furthermore, we captured neural activities and circulating blood cells over a volume ⌀ 800 μm × 150 μm at 70 Hz and up to 600 μm deep in the mice brain.

scholarly journals High-speed large-scale 4D activities mapping of moving C. elegans by deep-learning-enabled light-field microscopy on a chip

2021 ◽  
Author(s):  
Tingting Zhu ◽  
Lanxin Zhu ◽  
Yi Li ◽  
Xiaopeng Chen ◽  
Mingyang He ◽  
...  
Keyword(s):  
Deep Learning ◽  
High Speed ◽  
Large Scale ◽  
Light Field ◽  
Wild Type ◽  
C Elegans ◽  
Neural Activities ◽  
Biological Studies ◽  
Different Types ◽  
Field Imaging

We report a novel fusion of microfluidics and light-field microscopy, to achieve high-speed 4D (space + time) imaging of moving C. elegans on a chip. Our approach combines automatic chip-based worm loading / compartmentalization / flushing / reloading with instantaneous deep-learning light-field imaging of moving worm. Taken together, we realized intoto image-based screening of wild-type and uncoordinated-type worms at a volume rate of 33 Hz, with sustained observation of 1 minute per worm, and overall throughput of 42 worms per hour. With quickly yielding over 80000 image volumes that four-dimensionally visualize the dynamics of all the worms, we can quantitatively analyse their behaviours as well as the neural activities, and correlate the phenotypes with the neuron functions. The different types of worms can be readily identified as a result of the high-throughput activity mapping. Our approach shows great potential for various lab-on-a-chip biological studies, such as embryo sorting and cell growth assays.

scholarly journals High-speed multifocus phase imaging in thick tissue

2021 ◽  
Author(s):  
Sheng Xiao ◽  
Shuqi Zheng ◽  
Jerome Mertz
Keyword(s):  
High Speed ◽  
Imaging Techniques ◽  
Index Of Refraction ◽  
Phase Imaging ◽  
Biological Processes ◽  
Thick Sample ◽  
Volumetric Imaging ◽  
Phase Microscopy ◽  
Large Numbers ◽  
Qualitative Phase

Phase microscopy is widely used to image unstained biological samples. However, most phase imaging techniques require transmission geometries, making them unsuited for thick sample applications. Moreover, when applied to volumetric imaging, phase imaging generally requires large numbers of measurements, often making it too slow to capture live biological processes with fast 3D index-of-refraction variations. By combining oblique back-illumination microscopy and a z-splitter prism, we perform phase imaging that is both epi-mode and multifocus, enabling high-speed 3D phase imaging in thick, scattering tissues with a single camera. We demonstrate here 3D qualitative phase imaging of blood flow in chick embryos over a field of view of 546 × 546 × 137 μm3 at speeds up to 47 Hz.

scholarly journals Three-dimensional behavioural phenotyping of freely moving C. elegans using quantitative light field microscopy

PLoS ONE ◽  
2018 ◽  
Vol 13 (7) ◽  
pp. e0200108 ◽  
Author(s):  
Michael Shaw ◽  
Haoyun Zhan ◽  
Muna Elmi ◽  
Vijay Pawar ◽  
Clara Essmann ◽  
...  
Keyword(s):  
Light Field ◽  
Three Dimensional ◽  
C Elegans ◽  
Behavioural Phenotyping ◽  
Freely Moving

scholarly journals Instantaneous isotropic volumetric imaging of fast biological processes

2018 ◽  
Author(s):  
Nils Wagner ◽  
Nils Norlin ◽  
Jakob Gierten ◽  
Gustavo de Medeiros ◽  
Bálint Balázs ◽  
...  
Keyword(s):  
Blood Flow ◽  
Light Field ◽  
Flow Imaging ◽  
Biological Processes ◽  
Motion Artefacts ◽  
3D Images ◽  
Volumetric Imaging ◽  
Blood Flow Imaging ◽  
Cellular Resolution ◽  
Simultaneous Acquisition

AbstractCapturing highly dynamic biological processes at sub-cellular resolution is a recurring challenge in biology. Here we show that combining selective volume illumination with simultaneous acquisition of orthogonal light-fields yields 3D images with high, isotropic spatial resolution and free of reconstruction artefacts, thereby overcoming current limitations of light-field microscopy implementations. We demonstrate Medaka heart and blood flow imaging with single-cell resolution and free of motion artefacts at volume rates up to 200Hz.

scholarly journals Tri-Camera High-Speed Videogrammetry for Three-Dimensional Measurement of Laminated Rubber Bearings Based on the Large-Scale Shaking Table

2018 ◽  
Vol 10 (12) ◽  
pp. 1902 ◽  
Author(s):  
Xiaohua Tong ◽  
Kuifeng Luan ◽  
Xianglei Liu ◽  
Shijie Liu ◽  
Peng Chen ◽  
...  
Keyword(s):  
High Speed ◽  
Large Scale ◽  
Three Dimensional ◽  
Image Sequences ◽  
Bundle Adjustment ◽  
Shaking Table ◽  
Camera Image ◽  
Rubber Bearing ◽  
Laminated Rubber Bearing ◽  
Rubber Bearings

Laminated rubber bearings are widely used for the mitigation of seismic damage of large-scale structures and equipment. However, owing to the flexibility in horizontal direction, the traditional contacted transducer is difficult to acquire the displacement data accurately in the three directions, respectively. In this paper, three-dimensional displacement measurement of laminated rubber bearing based on the large-scale shaking table is achieved by the use of a tri-camera high-speed videogrammetric system consisting of three complementary-metal-oxide-semiconductor (CMOS) cameras, one synchronous controller, and one pair of 1000 watt light sources, which are used to simultaneously acquire the tri-camera image sequences of laminated rubber bearing at a speed of 300 frames per second (fps). Firstly, this paper proposes a fast image block technique for detecting and tracking targets in tri-camera image sequences by integration of techniques morphological edge detection, attribute based ellipse extraction and least-squares-based fitting adjustment. Secondly, this paper presents an integrated bundle adjustment approach, which brings continuous tracking points into one collinearity condition equation, to reconstruct the three dimensional coordinates of continuous tracking points, for the purpose of improving the accuracy of three-dimensional coordinates of tracking points based on tri-camera image sequences. At last, an empirical experiment was conducted to measure the three-dimensional displacement of laminated rubber bearings on the shaking table by the use of the proposed method. The experimental results showed that the proposed method could obtain three-dimensional displacement of laminated rubber bearings with an accuracy of more than 0.5 mm.

Sign in / Sign up

Export Citation Format

Share Document