A novel generic dictionary-based denoising method for improving noisy and densely packed nuclei segmentation in 3D time-lapse fluorescence microscopy images

ABSTRACTTime-lapse fluorescence microscopy is an essential technique for quantifying various characteristics of cellular processes,i.e. cell survival, migration, and differentiation. To perform high-throughput quantification of cellular processes, nuclei segmentation and tracking should be performed in an automated manner. Nevertheless, nuclei segmentation and tracking are challenging tasks due to embedded noise, intensity inhomogeneity, shape variation as well as a weak boundary of nuclei. Although several nuclei segmentation approaches have been reported in the literature, dealing with embedded noise remains the most challenging part of any segmentation algorithm. We propose a novel denoising algorithms, based on sparse coding, that can both enhance very faint and noisy nuclei but simultaneously detect nuclei position accurately. Furthermore our method is based on a limited number of parameters,with only one being critical, which is the approximate size of the objects of interest. We also show that our denoising method coupled with classical segmentation method works properly in the context of the most challenging cases. To evaluate the performance of the proposed method, we tested our method on two datasets from the cell tracking challenge. Across all datasets, the proposed method achieved satisfactory results with 96.96% recall for C.elegans dataset. Besides, in Drosophila dataset, our method achieved very high recall (99.3%).