scholarly journals Simulation based benchmarking of isoform quantification in single-cell RNA-seq

2018 ◽  
Author(s):  
Jennifer Westoby ◽  
Marcela Sjoberg ◽  
Anne Ferguson-Smith ◽  
Martin Hemberg
Keyword(s):  
Single Cell ◽  
Confounding Factor ◽  
Simulated Data ◽  
Real Data ◽  
Mixed Population ◽  
Rna Seq ◽  
Simulation Based ◽  
Biological Insight ◽  
Isoform Quantification

AbstractSingle-cell RNA-seq has the potential to facilitate isoform quantification as the confounding factor of a mixed population of cells is eliminated. We carried out a benchmark for five popular isoform quantification tools. Performance was generally good when run on simulated data based on SMARTer and SMART-seq2 data, but was poor for simulated Drop-seq data. Importantly, the reduction in performance for single-cell RNA-seq compared with bulk RNA-seq was small. An important biological insight comes from our analysis of real data which showed that genes that express two isoforms in bulk RNA-seq predominantly express one or neither isoform in individual cells.

scholarly journals Simulation-based benchmarking of isoform quantification in single-cell RNA-seq

2018 ◽  
Vol 19 (1) ◽  
Author(s):  
Jennifer Westoby ◽  
Marcela Sjöberg Herrera ◽  
Anne C. Ferguson-Smith ◽  
Martin Hemberg
Keyword(s):  
Single Cell ◽  
Rna Seq ◽  
Simulation Based ◽  
Isoform Quantification

scholarly journals Splatter: simulation of single-cell RNA sequencing data

2017 ◽  
Author(s):  
Luke Zappia ◽  
Belinda Phipson ◽  
Alicia Oshlack
Keyword(s):  
Single Cell ◽  
Rna Sequencing ◽  
Real Data ◽  
Cell Types ◽  
Rna Seq ◽  
Sequencing Data ◽  
Sequencing Technologies ◽  
Simulation Based ◽  
Single Cell Rna Sequencing ◽  
Multiple Cell

AbstractAs single-cell RNA sequencing technologies have rapidly developed, so have analysis methods. Many methods have been tested, developed and validated using simulated datasets. Unfortunately, current simulations are often poorly documented, their similarity to real data is not demonstrated, or reproducible code is not available.Here we present the Splatter Bioconductor package for simple, reproducible and well-documented simulation of single-cell RNA-seq data. Splatter provides an interface to multiple simulation methods including Splat, our own simulation, based on a gamma-Poisson distribution. Splat can simulate single populations of cells, populations with multiple cell types or differentiation paths.

scholarly journals SPARSim single cell: a count data simulator for scRNA-seq data

2019 ◽  
Author(s):  
Giacomo Baruzzo ◽  
Ilaria Patuzzi ◽  
Barbara Di Camillo
Keyword(s):  
Single Cell ◽  
Count Data ◽  
Simulated Data ◽  
Real Data ◽  
R Package ◽  
Supplementary Information ◽  
Rna Seq ◽  
Distribution Of Zeros ◽  
New Methods ◽  
Research Fields

Abstract Motivation Single cell RNA-seq (scRNA-seq) count data show many differences compared with bulk RNA-seq count data, making the application of many RNA-seq pre-processing/analysis methods not straightforward or even inappropriate. For this reason, the development of new methods for handling scRNA-seq count data is currently one of the most active research fields in bioinformatics. To help the development of such new methods, the availability of simulated data could play a pivotal role. However, only few scRNA-seq count data simulators are available, often showing poor or not demonstrated similarity with real data. Results In this article we present SPARSim, a scRNA-seq count data simulator based on a Gamma-Multivariate Hypergeometric model. We demonstrate that SPARSim allows to generate count data that resemble real data in terms of count intensity, variability and sparsity, performing comparably or better than one of the most used scRNA-seq simulator, Splat. In particular, SPARSim simulated count matrices well resemble the distribution of zeros across different expression intensities observed in real count data. Availability and implementation SPARSim R package is freely available at http://sysbiobig.dei.unipd.it/? q=SPARSim and at https://gitlab.com/sysbiobig/sparsim. Supplementary information Supplementary data are available at Bioinformatics online.

scholarly journals Data-based RNA-seq Simulations by Binomial Thinning

2019 ◽  
Author(s):  
David Gerard
Keyword(s):  
Theoretical Model ◽  
Single Cell ◽  
Differential Expression Analysis ◽  
Simulated Data ◽  
Real Data ◽  
Theoretical Models ◽  
Simulation Method ◽  
R Package ◽  
Rna Seq ◽  
Ideal Model

AbstractWith the explosion in the number of methods designed to analyze bulk and single-cell RNA-seq data, there is a growing need for approaches that assess and compare these methods. The usual technique is to compare methods on data simulated according to some theoretical model. However, as real data often exhibit violations from theoretical models, this can result in un-substantiated claims of a method’s performance. Rather than generate data from a theoretical model, in this paper we develop methods to add signal to real RNA-seq datasets. Since the resulting simulated data are not generated from an unrealistic theoretical model, they exhibit realistic (annoying) attributes of real data. This lets RNA-seq methods developers assess their procedures in non-ideal (model-violating) scenarios. Our procedures may be applied to both single-cell and bulk RNA-seq. We show that our simulation method results in more realistic datasets and can alter the conclusions of a differential expression analysis study. We also demonstrate our approach by comparing various factor analysis techniques on RNA-seq datasets. Our tools are available in the seqgendiff R package on the Comprehensive R Archive Net-work: https://cran.r-project.org/package=seqgendiff.

scholarly journals Overcoming confounding plate effects in differential expression analyses of single-cell RNA-seq data

2016 ◽  
Author(s):  
Aaron T. L. Lun ◽  
John C. Marioni
Keyword(s):  
Single Cell ◽  
Error Control ◽  
Type I Error ◽  
Expression Profiles ◽  
Gene Expression Profiles ◽  
Simulated Data ◽  
Real Data ◽  
Type I ◽  
Rna Seq ◽  
Cell Counts

AbstractAn increasing number of studies are using single-cell RNA-sequencing (scRNA-seq) to characterize the gene expression profiles of individual cells. One common analysis applied to scRNA-seq data involves detecting differentially expressed (DE) genes between cells in different biological groups. However, many experiments are designed such that the cells to be compared are processed in separate plates or chips, meaning that the groupings are confounded with systematic plate effects. This confounding aspect is frequently ignored in DE analyses of scRNA-seq data. In this article, we demonstrate that failing to consider plate effects in the statistical model results in loss of type I error control. A solution is proposed whereby counts are summed from all cells in each plate and the count sums for all plates are used in the DE analysis. This restores type I error control in the presence of plate effects without compromising detection power in simulated data. Summation is also robust to varying numbers and library sizes of cells on each plate. Similar results are observed in DE analyses of real data where the use of count sums instead of single-cell counts improves specificity and the ranking of relevant genes. This suggests that summation can assist in maintaining statistical rigour in DE analyses of scRNA-seq data with plate effects.

scholarly journals Obstacles to Studying Alternative Splicing Using scRNA-seq

2019 ◽  
Author(s):  
Jennifer Westoby ◽  
Pavel Artemov ◽  
Martin Hemberg ◽  
Anne Ferguson-Smith
Keyword(s):  
Alternative Splicing ◽  
Single Cell ◽  
High Rate ◽  
Model Organisms ◽  
Rna Seq ◽  
Simulation Based ◽  
Simulation Results ◽  
The Impact ◽  
Isoform Quantification ◽  
Low Rate

AbstractBackgroundEarly single-cell RNA-seq (scRNA-seq) studies suggested that it was unusual to see more than one isoform being produced from a gene in a single cell, even when multiple isoforms were detected in matched bulk RNA-seq samples. However, these studies generally did not consider the impact of dropouts or isoform quantification errors, potentially confounding the results of these analyses.ResultsIn this study, we take a simulation based approach in which we explicitly account for dropouts and isoform quantification errors. We use our simulations to ask to what extent it is possible to study alternative splicing using scRNA-seq. Additionally, we ask what limitations must be overcome to make splicing analysis feasible. We find that the high rate of dropouts associated with scRNA-seq is a major obstacle to studying alternative splicing. In mice and other well established model organisms, the relatively low rate of isoform quantification errors poses a lesser obstacle to splicing analysis. We find that different models of isoform choice meaningfully change our simulation results.ConclusionsTo accurately study alternative splicing with single-cell RNA-seq, a better understanding of isoform choice and the errors associated with scRNA-seq is required. An increase in the capture efficiency of scRNA-seq would also be beneficial. Until some or all of the above are achieved, we do not recommend attempting to resolve isoforms in individual cells using scRNA-seq.

scholarly journals Evaluating the reproducibility of single-cell gene regulatory network inference algorithms

2020 ◽  
Author(s):  
Yoonjee Kang ◽  
Denis Thieffry ◽  
Laura Cantini
Keyword(s):  
Single Cell ◽  
Network Inference ◽  
Simulated Data ◽  
Ground Truth ◽  
Real Data ◽  
Gene Regulatory Network Inference ◽  
Sequencing Platform ◽  
Cell Network ◽  
Inference Algorithms ◽  
Inference Methods

AbstractNetworks are powerful tools to represent and investigate biological systems. The development of algorithms inferring regulatory interactions from functional genomics data has been an active area of research. With the advent of single-cell RNA-seq data (scRNA-seq), numerous methods specifically designed to take advantage of single-cell datasets have been proposed. However, published benchmarks on single-cell network inference are mostly based on simulated data. Once applied to real data, these benchmarks take into account only a small set of genes and only compare the inferred networks with an imposed ground-truth.Here, we benchmark four single-cell network inference methods based on their reproducibility, i.e. their ability to infer similar networks when applied to two independent datasets for the same biological condition. We tested each of these methods on real data from three biological conditions: human retina, T-cells in colorectal cancer, and human hematopoiesis.GENIE3 results to be the most reproducible algorithm, independently from the single-cell sequencing platform, the cell type annotation system, the number of cells constituting the dataset, or the thresholding applied to the links of the inferred networks. In order to ensure the reproducibility and ease extensions of this benchmark study, we implemented all the analyses in scNET, a Jupyter notebook available at https://github.com/ComputationalSystemsBiology/scNET.

scholarly journals CStone: A de novo transcriptome assembler for short-read data that identifies non-chimeric contigs based on underlying graph structure

2021 ◽  
Vol 17 (11) ◽  
pp. e1009631
Author(s):  
Raquel Linheiro ◽  
John Archer
Keyword(s):  
De Novo ◽  
Simulated Data ◽  
Real Data ◽  
Gene Families ◽  
Classification Systems ◽  
Whole Body ◽  
Cdna Libraries ◽  
Sequence Information ◽  
Rna Seq ◽  
High Quality

With the exponential growth of sequence information stored over the last decade, including that of de novo assembled contigs from RNA-Seq experiments, quantification of chimeric sequences has become essential when assembling read data. In transcriptomics, de novo assembled chimeras can closely resemble underlying transcripts, but patterns such as those seen between co-evolving sites, or mapped read counts, become obscured. We have created a de Bruijn based de novo assembler for RNA-Seq data that utilizes a classification system to describe the complexity of underlying graphs from which contigs are created. Each contig is labelled with one of three levels, indicating whether or not ambiguous paths exist. A by-product of this is information on the range of complexity of the underlying gene families present. As a demonstration of CStones ability to assemble high-quality contigs, and to label them in this manner, both simulated and real data were used. For simulated data, ten million read pairs were generated from cDNA libraries representing four species, Drosophila melanogaster, Panthera pardus, Rattus norvegicus and Serinus canaria. These were assembled using CStone, Trinity and rnaSPAdes; the latter two being high-quality, well established, de novo assembers. For real data, two RNA-Seq datasets, each consisting of ≈30 million read pairs, representing two adult D. melanogaster whole-body samples were used. The contigs that CStone produced were comparable in quality to those of Trinity and rnaSPAdes in terms of length, sequence identity of aligned regions and the range of cDNA transcripts represented, whilst providing additional information on chimerism. Here we describe the details of CStones assembly and classification process, and propose that similar classification systems can be incorporated into other de novo assembly tools. Within a related side study, we explore the effects that chimera’s within reference sets have on the identification of differentially expression genes. CStone is available at: https://sourceforge.net/projects/cstone/.

scholarly journals scDoc: correcting drop-out events in single-cell RNA-seq data

2020 ◽  
Vol 36 (15) ◽  
pp. 4233-4239
Author(s):  
Di Ran ◽  
Shanshan Zhang ◽  
Nicholas Lytal ◽  
Lingling An
Keyword(s):  
Single Cell ◽  
Simulated Data ◽  
Drop Out ◽  
Cellular Heterogeneity ◽  
Supplementary Information ◽  
Cell Subpopulation ◽  
Rna Seq ◽  
Imputation Methods ◽  
Similarity Estimation ◽  
Differential Expression Detection

Abstract Motivation Single-cell RNA-sequencing (scRNA-seq) has become an important tool to unravel cellular heterogeneity, discover new cell (sub)types, and understand cell development at single-cell resolution. However, one major challenge to scRNA-seq research is the presence of ‘drop-out’ events, which usually is due to extremely low mRNA input or the stochastic nature of gene expression. In this article, we present a novel single-cell RNA-seq drop-out correction (scDoc) method, imputing drop-out events by borrowing information for the same gene from highly similar cells. Results scDoc is the first method that directly involves drop-out information to accounting for cell-to-cell similarity estimation, which is crucial in scRNA-seq drop-out imputation but has not been appropriately examined. We evaluated the performance of scDoc using both simulated data and real scRNA-seq studies. Results show that scDoc outperforms the existing imputation methods in reference to data visualization, cell subpopulation identification and differential expression detection in scRNA-seq data. Availability and implementation R code is available at https://github.com/anlingUA/scDoc. Supplementary information Supplementary data are available at Bioinformatics online.

scholarly journals SimFuse: A Novel Fusion Simulator for RNA Sequencing (RNA-Seq) Data

2015 ◽  
Vol 2015 ◽  
pp. 1-5 ◽  
Author(s):  
Yuxiang Tan ◽  
Yann Tambouret ◽  
Stefano Monti
Keyword(s):  
Sample Size ◽  
Rna Sequencing ◽  
High Throughput Sequencing ◽  
Performance Metrics ◽  
Simulated Data ◽  
Real Data ◽  
Rna Seq ◽  
Sequencing Data ◽  
Detection Algorithms ◽  
Fusion Detection

The performance evaluation of fusion detection algorithms from high-throughput sequencing data crucially relies on the availability of data with known positive and negative cases of gene rearrangements. The use of simulated data circumvents some shortcomings of real data by generation of an unlimited number of true and false positive events, and the consequent robust estimation of accuracy measures, such as precision and recall. Although a few simulated fusion datasets from RNA Sequencing (RNA-Seq) are available, they are of limited sample size. This makes it difficult to systematically evaluate the performance of RNA-Seq based fusion-detection algorithms. Here, we present SimFuse to address this problem. SimFuse utilizes real sequencing data as the fusions’ background to closely approximate the distribution of reads from a real sequencing library and uses a reference genome as the template from which to simulate fusions’ supporting reads. To assess the supporting read-specific performance, SimFuse generates multiple datasets with various numbers of fusion supporting reads. Compared to an extant simulated dataset, SimFuse gives users control over the supporting read features and the sample size of the simulated library, based on which the performance metrics needed for the validation and comparison of alternative fusion-detection algorithms can be rigorously estimated.

Sign in / Sign up

Export Citation Format

Share Document