scholarly journals Large depth-of-field fluorescence microscopy based on deep learning supported Fresnel incoherent correlation holography

2022 ◽  
Author(s):  
Peng Wu ◽  
Dejie Zhang ◽  
Jing Yuan ◽  
Shaoqun Zeng ◽  
Hui Gong ◽  
...  
Keyword(s):  
Deep Learning ◽  
Fluorescence Microscopy ◽  
Depth Of Field ◽  
Large Depth

scholarly journals Recurrent neural network-based volumetric fluorescence microscopy

2021 ◽  
Vol 10 (1) ◽  
Author(s):  
Luzhe Huang ◽  
Hanlong Chen ◽  
Yilin Luo ◽  
Yair Rivenson ◽  
Aydogan Ozcan
Keyword(s):  
Neural Network ◽  
Image Reconstruction ◽  
Fluorescence Microscopy ◽  
Recurrent Network ◽  
Sample Volume ◽  
Depth Of Field ◽  
Objective Lens ◽  
Wide Field ◽  
Volumetric Imaging ◽  
3D Image Reconstruction

AbstractVolumetric imaging of samples using fluorescence microscopy plays an important role in various fields including physical, medical and life sciences. Here we report a deep learning-based volumetric image inference framework that uses 2D images that are sparsely captured by a standard wide-field fluorescence microscope at arbitrary axial positions within the sample volume. Through a recurrent convolutional neural network, which we term as Recurrent-MZ, 2D fluorescence information from a few axial planes within the sample is explicitly incorporated to digitally reconstruct the sample volume over an extended depth-of-field. Using experiments on C. elegans and nanobead samples, Recurrent-MZ is demonstrated to significantly increase the depth-of-field of a 63×/1.4NA objective lens, also providing a 30-fold reduction in the number of axial scans required to image the same sample volume. We further illustrated the generalization of this recurrent network for 3D imaging by showing its resilience to varying imaging conditions, including e.g., different sequences of input images, covering various axial permutations and unknown axial positioning errors. We also demonstrated wide-field to confocal cross-modality image transformations using Recurrent-MZ framework and performed 3D image reconstruction of a sample using a few wide-field 2D fluorescence images as input, matching confocal microscopy images of the same sample volume. Recurrent-MZ demonstrates the first application of recurrent neural networks in microscopic image reconstruction and provides a flexible and rapid volumetric imaging framework, overcoming the limitations of current 3D scanning microscopy tools.

scholarly journals Modality attention and sampling enables deep learning with heterogeneous marker combinations in fluorescence microscopy

2021 ◽  
Author(s):  
Alvaro Gomariz ◽  
Tiziano Portenier ◽  
Patrick M. Helbling ◽  
Stephan Isringhausen ◽  
Ute Suessbier ◽  
...  
Keyword(s):  
Deep Learning ◽  
Fluorescence Microscopy

scholarly journals Asbestos Detection with Fluorescence Microscopy Images and Deep Learning

Sensors ◽  
2021 ◽  
Vol 21 (13) ◽  
pp. 4582
Author(s):  
Changjie Cai ◽  
Tomoki Nishimura ◽  
Jooyeon Hwang ◽  
Xiao-Ming Hu ◽  
Akio Kuroda
Keyword(s):  
Deep Learning ◽  
Fluorescence Microscopy ◽  
Occupational Safety ◽  
Graphics Processing Unit ◽  
Reference Method ◽  
Processing Unit ◽  
Fiber Concentration ◽  
Art Object ◽  
Wide Range ◽  
Microscopy Images

Fluorescent probes can be used to detect various types of asbestos (serpentine and amphibole groups); however, the fiber counting using our previously developed software was not accurate for samples with low fiber concentration. Machine learning-based techniques (e.g., deep learning) for image analysis, particularly Convolutional Neural Networks (CNN), have been widely applied to many areas. The objectives of this study were to (1) create a database of a wide-range asbestos concentration (0–50 fibers/liter) fluorescence microscopy (FM) images in the laboratory; and (2) determine the applicability of the state-of-the-art object detection CNN model, YOLOv4, to accurately detect asbestos. We captured the fluorescence microscopy images containing asbestos and labeled the individual asbestos in the images. We trained the YOLOv4 model with the labeled images using one GTX 1660 Ti Graphics Processing Unit (GPU). Our results demonstrated the exceptional capacity of the YOLOv4 model to learn the fluorescent asbestos morphologies. The mean average precision at a threshold of 0.5 ([email protected]) was 96.1% ± 0.4%, using the National Institute for Occupational Safety and Health (NIOSH) fiber counting Method 7400 as a reference method. Compared to our previous counting software (Intec/HU), the YOLOv4 achieved higher accuracy (0.997 vs. 0.979), particularly much higher precision (0.898 vs. 0.418), recall (0.898 vs. 0.780) and F-1 score (0.898 vs. 0.544). In addition, the YOLOv4 performed much better for low fiber concentration samples (<15 fibers/liter) compared to Intec/HU. Therefore, the FM method coupled with YOLOv4 is remarkable in detecting asbestos fibers and differentiating them from other non-asbestos particles.

Sign in / Sign up

Export Citation Format

Share Document