ScANVI is a variational inference model for single-cell RNA-seq data that can learn an underlying latent space, integrate technical batches and impute dropouts. In addition, to scVI, ScANVI is a semi-supervised model that can leverage labeled data to learn a cell-type classifier in the latent space and afterward predict cell types of new data. The learned low-dimensional latent representation of the data can be used for visualization and clustering.
scANVI takes as input a scRNA-seq gene expression matrix with cells and genes as well as a cell-type annotation for a subset of cells. We provide an extensive user guide.
- See our original manuscript for further details of the model: scANVI manuscript.
- See our manuscript on scvi-hub how to leverage pre-trained models.
This model can be used for fine tuning on new data using our Arches framework: Arches tutorial.
Model Description
The integrated Human Lung Cell Atlas (HLCA) represents the first large-scale, integrated single-cell reference atlas of the human lung.
Metrics
We provide here key performance metrics for the uploaded model, if provided by the data uploader.
Coefficient of variation
The cell-wise coefficient of variation summarizes how well variation between different cells is preserved by the generated model expression. Below a squared Pearson correlation coefficient of 0.4 , we would recommend not to use generated data for downstream analysis, while the generated latent space might still be useful for analysis.
Cell-wise Coefficient of Variation:
Metric | Training Value |
---|---|
Mean Absolute Error | 1.43 |
Pearson Correlation | 0.93 |
Spearman Correlation | 0.85 |
R² (R-Squared) | 0.85 |
The gene-wise coefficient of variation summarizes how well variation between different genes is preserved by the generated model expression. This value is usually quite high.
Gene-wise Coefficient of Variation:
Metric | Training Value |
---|---|
Mean Absolute Error | 6.25 |
Pearson Correlation | 0.88 |
Spearman Correlation | 0.98 |
R² (R-Squared) | 0.66 |
Differential expression metric
The differential expression metric provides a summary of the differential expression analysis between cell types or input clusters. We provide here the F1-score, Pearson Correlation Coefficient of Log-Foldchanges, Spearman Correlation Coefficient, and Area Under the Precision Recall Curve (AUPRC) for the differential expression analysis using Wilcoxon Rank Sum test for each cell-type.
Differential expression:
Index | gene_f1 | lfc_mae | lfc_pearson | lfc_spearman | roc_auc | pr_auc | n_cells |
---|---|---|---|---|---|---|---|
respiratory basal cell | 0.98 | 0.25 | 0.94 | 0.99 | 0.34 | 0.04 | 80113.00 |
alveolar macrophage | 0.98 | 0.23 | 0.95 | 0.99 | 0.34 | 0.04 | 78816.00 |
type II pneumocyte | 0.96 | 0.29 | 0.89 | 0.98 | 0.34 | 0.05 | 62405.00 |
club cell | 0.94 | 0.55 | 0.83 | 0.97 | 0.34 | 0.05 | 36023.00 |
nasal mucosa goblet cell | 0.97 | 0.65 | 0.81 | 0.97 | 0.34 | 0.05 | 35833.00 |
ciliated columnar cell of tracheobronchial tree | 0.97 | 0.23 | 0.97 | 0.99 | 0.34 | 0.05 | 35225.00 |
CD8-positive, alpha-beta T cell | 0.95 | 0.35 | 0.89 | 0.98 | 0.34 | 0.05 | 29074.00 |
elicited macrophage | 0.96 | 0.46 | 0.85 | 0.98 | 0.34 | 0.05 | 28223.00 |
capillary endothelial cell | 0.98 | 0.73 | 0.82 | 0.96 | 0.34 | 0.05 | 23205.00 |
CD4-positive, alpha-beta T cell | 0.96 | 0.43 | 0.89 | 0.97 | 0.34 | 0.05 | 21285.00 |
classical monocyte | 0.94 | 0.46 | 0.82 | 0.97 | 0.31 | 0.04 | 17695.00 |
natural killer cell | 0.96 | 0.61 | 0.83 | 0.96 | 0.34 | 0.05 | 16978.00 |
vein endothelial cell | 0.95 | 0.73 | 0.77 | 0.95 | 0.31 | 0.05 | 12975.00 |
alveolar type 2 fibroblast cell | 0.93 | 0.60 | 0.85 | 0.97 | 0.28 | 0.04 | 10321.00 |
CD1c-positive myeloid dendritic cell | 0.93 | 0.62 | 0.71 | 0.95 | 0.21 | 0.04 | 9133.00 |
non-classical monocyte | 0.93 | 0.76 | 0.78 | 0.96 | 0.26 | 0.04 | 8834.00 |
type I pneumocyte | 0.95 | 1.27 | 0.66 | 0.88 | 0.34 | 0.04 | 7937.00 |
pulmonary artery endothelial cell | 0.96 | 1.24 | 0.71 | 0.93 | 0.29 | 0.04 | 7391.00 |
mast cell | 0.93 | 0.72 | 0.75 | 0.94 | 0.25 | 0.04 | 6623.00 |
multi-ciliated epithelial cell | 0.88 | 1.48 | 0.72 | 0.94 | 0.28 | 0.04 | 5873.00 |
alveolar type 1 fibroblast cell | 0.96 | 1.48 | 0.70 | 0.92 | 0.24 | 0.04 | 5182.00 |
lung macrophage | 0.93 | 1.40 | 0.71 | 0.93 | 0.21 | 0.03 | 4805.00 |
respiratory hillock cell | 0.91 | 1.48 | 0.73 | 0.95 | 0.26 | 0.04 | 4600.00 |
endothelial cell of lymphatic vessel | 0.93 | 1.15 | 0.64 | 0.92 | 0.21 | 0.04 | 4595.00 |
B cell | 0.92 | 1.33 | 0.63 | 0.89 | 0.22 | 0.04 | 4511.00 |
epithelial cell of lower respiratory tract | 0.94 | 1.14 | 0.57 | 0.88 | 0.31 | 0.04 | 4393.00 |
lung pericyte | 0.94 | 2.59 | 0.65 | 0.87 | 0.26 | 0.04 | 3032.00 |
tracheobronchial smooth muscle cell | 0.93 | 1.55 | 0.68 | 0.90 | 0.17 | 0.03 | 2996.00 |
plasma cell | 0.80 | 1.32 | 0.63 | 0.85 | 0.16 | 0.03 | 1773.00 |
bronchial goblet cell | 0.93 | 1.53 | 0.73 | 0.93 | 0.19 | 0.03 | 1670.00 |
bronchus fibroblast of lung | 0.89 | 2.13 | 0.68 | 0.87 | 0.15 | 0.04 | 1573.00 |
serous secreting cell | 0.91 | 5.12 | 0.58 | 0.70 | 0.37 | 0.04 | 1472.00 |
epithelial cell of alveolus of lung | 0.93 | 2.34 | 0.57 | 0.84 | 0.19 | 0.04 | 1440.00 |
tracheobronchial serous cell | 0.81 | 3.34 | 0.59 | 0.70 | 0.38 | 0.04 | 1417.00 |
acinar cell | 0.88 | 1.98 | 0.69 | 0.91 | 0.20 | 0.04 | 1274.00 |
tracheobronchial goblet cell | 0.87 | 4.29 | 0.58 | 0.73 | 0.36 | 0.04 | 968.00 |
myofibroblast cell | 0.79 | 3.65 | 0.64 | 0.83 | 0.23 | 0.04 | 716.00 |
ionocyte | 0.85 | 3.36 | 0.64 | 0.79 | 0.25 | 0.03 | 561.00 |
smooth muscle cell | 0.84 | 3.10 | 0.64 | 0.85 | 0.22 | 0.03 | 556.00 |
plasmacytoid dendritic cell | 0.89 | 4.15 | 0.52 | 0.73 | 0.33 | 0.04 | 552.00 |
mucus secreting cell | 0.84 | 4.46 | 0.58 | 0.69 | 0.29 | 0.03 | 537.00 |
T cell | 0.91 | 2.85 | 0.57 | 0.83 | 0.25 | 0.03 | 500.00 |
stromal cell | 0.80 | 5.26 | 0.59 | 0.71 | 0.33 | 0.04 | 335.00 |
conventional dendritic cell | 0.73 | 4.25 | 0.52 | 0.73 | 0.32 | 0.04 | 322.00 |
dendritic cell | 0.69 | 4.74 | 0.48 | 0.73 | 0.37 | 0.04 | 312.00 |
fibroblast | 0.76 | 3.46 | 0.66 | 0.82 | 0.31 | 0.03 | 276.00 |
mesothelial cell | 0.77 | 4.37 | 0.52 | 0.70 | 0.34 | 0.04 | 230.00 |
brush cell of trachebronchial tree | 0.61 | 5.05 | 0.58 | 0.73 | 0.33 | 0.03 | 165.00 |
lung neuroendocrine cell | 0.73 | 4.32 | 0.58 | 0.70 | 0.31 | 0.03 | 159.00 |
hematopoietic stem cell | 0.42 | 7.59 | 0.45 | 0.55 | 0.40 | 0.04 | 60.00 |
Model Properties
We provide here key parameters used to setup and train the model.
Model Parameters
These provide the settings to setup the original model:
{
"n_hidden": 128,
"n_latent": 30,
"n_layers": 2,
"dropout_rate": 0.1,
"dispersion": "gene",
"gene_likelihood": "nb",
"linear_classifier": false,
"encode_covariates": true,
"deeply_inject_covariates": false,
"use_layer_norm": "both",
"use_batch_norm": "none"
}
Setup Data Arguments
Arguments passed to setup_anndata of the original model:
{
"labels_key": "scanvi_label",
"unlabeled_category": "unlabeled",
"layer": null,
"batch_key": "dataset",
"size_factor_key": null,
"categorical_covariate_keys": null,
"continuous_covariate_keys": null,
"use_minified": true
}
Data Registry
Registry elements for AnnData manager:
Registry Key | scvi-tools Location |
---|---|
X | adata.X |
batch | adata.obs['_scvi_batch'] |
labels | adata.obs['_scvi_labels'] |
latent_qzm | adata.obsm['scanvi_latent_qzm'] |
latent_qzv | adata.obsm['scanvi_latent_qzv'] |
minify_type | adata.uns['_scvi_adata_minify_type'] |
observed_lib_size | adata.obs['observed_lib_size'] |
- Data is Minified: False
Summary Statistics
Summary Stat Key | Value |
---|---|
n_batch | 14 |
n_cells | 584944 |
n_extra_categorical_covs | 0 |
n_extra_continuous_covs | 0 |
n_labels | 29 |
n_latent_qzm | 30 |
n_latent_qzv | 30 |
n_vars | 2000 |
Training
Training data url: Not provided by uploader
If provided by the original uploader, for those interested in understanding or replicating the training process, the code is available at the link below.
Training Code URL: https://github.com/LungCellAtlas/HLCA_reproducibility
References
Lisa Sikkema, Ciro Ramírez-Suástegui, Daniel C. Strobl, Tessa E. Gillett, Luke Zappia, Elo Madissoon, Nikolay S. Markov, Laure-Emmanuelle Zaragosi, Yuge Ji, Meshal Ansari, Marie-Jeanne Arguel, Leonie Apperloo, Martin Banchero, Christophe Bécavin, Marijn Berg, Evgeny Chichelnitskiy, Mei-i Chung, Antoine Collin, Aurore C. A. Gay, Janine Gote-Schniering, Baharak Hooshiar Kashani, Kemal Inecik, Manu Jain, Theodore S. Kapellos, Tessa M. Kole, Sylvie Leroy, Christoph H. Mayr, Amanda J. Oliver, Michael von Papen, Lance Peter, Chase J. Taylor, Thomas Walzthoeni, Chuan Xu, Linh T. Bui, Carlo De Donno, Leander Dony, Alen Faiz, Minzhe Guo, Austin J. Gutierrez, Lukas Heumos, Ni Huang, Ignacio L. Ibarra, Nathan D. Jackson, Preetish Kadur Lakshminarasimha Murthy, Mohammad Lotfollahi, Tracy Tabib, Carlos Talavera-López, Kyle J. Travaglini, Anna Wilbrey-Clark, Kaylee B. Worlock, Masahiro Yoshida, Lung Biological Network Consortium, Maarten van den Berge, Yohan Bossé, Tushar J. Desai, Oliver Eickelberg, Naftali Kaminski, Mark A. Krasnow, Robert Lafyatis, Marko Z. Nikolic, Joseph E. Powell, Jayaraj Rajagopal, Mauricio Rojas, Orit Rozenblatt-Rosen, Max A. Seibold, Dean Sheppard, Douglas P. Shepherd, Don D. Sin, Wim Timens, Alexander M. Tsankov, Jeffrey Whitsett, Yan Xu, Nicholas E. Banovich, Pascal Barbry, Thu Elizabeth Duong, Christine S. Falk, Kerstin B. Meyer, Jonathan A. Kropski, Dana Pe’er, Herbert B. Schiller, Purushothama Rao Tata, Joachim L. Schultze, Sara A. Teichmann, Alexander V. Misharin, Martijn C. Nawijn, Malte D. Luecken, and Fabian J. Theis. An integrated cell atlas of the lung in health and disease. Nature Medicine, June 2023. doi:10.1038/s41591-023-02327-2.