DOI: 10.25378/janelia.24937092
title: Drosophila data for whole-embryo lineage reconstruction with linajea

description: This article enables access to the drosophila data (120828) for "Automated reconstruction of whole-embryo cell lineages by learning from sparse annotations" (Malin-Mayor et al. 2023, DOI: https://doi.org/10.1038/s41587-022-01427-7).Here we provide the ground truth tracks used to train the deep learning model, the trained networks, and the predicted tracks. Additionally, we provide information on how to access the image data, although it is not uploaded here due to size. Related artifacts include the source code for experiments and methods.Image DataThe image dataset in n5/zarr format (as used in Malin-Mayor et al. 2023) can be accessed at the following Dropbox link: https://www.dropbox.com/scl/fi/vjaqxf447th926eespjwu/120828_drosophila_sequence.tar.gz?rlkey=lq9f83uhydzesfm8wh6pbpevc&dl=0. This image dataset was originally published in "Fast, accurate reconstruction of cell lineages from large-scale fluorescence microscopy data" (Amat et al. 2014, DOI: https://doi.org/10.1038/nmeth.3036).Ground Truth TracksInside <code>gt_tracks.zip</code> there are a number of files containing different subsets of tracks. Each has the following columns separated by tabs: <code>time, z, y, x, cell_id, parent_id, track_id</code>.<code>tracks.txt</code> is the main file containg manual annotations of individual cells from start to end of video used to train the model. These tracks are sparse, but each cell included in the <code>tracks.txt</code> had its whole lineage traced as completely as possible from start to end of the video.<code>tracks_side_1.txt</code> and <code>tracks_side_2.txt</code> contain the same tracks as <code>tracks.txt</code>, but each lineage is assigned to one of the two sides. As cells do not cross the center line of the embryo, this creates a natural division of the tracks into these two sides, which are used separetely for training and evaluation.<code>full_frame_divisions.txt</code> is a different set of manually annotated short tracks around divisions. These tracks cover every division in time points 150 and 300 and adjacent frames as completely as possible, and were used for evaluation and not model training.Trained Models<code>trained_networks.zip</code> includes both networks trained on the drosphila dataset. The config files are in the <code>drosophila_config_files</code> directory, and the other directories are named corresponding to the <code>model_name</code> in each config file and contain the trained model files. There is one model trained/validated on each side of the embryo, and evaluated on the other side, as described in Supplemental Note 1.Predicted Tracks<code>predicted_tracks.zip</code> contains both the TGMM baseline results and the results for the linajea method.<code>tgmm.txt</code> contains the TGMM results provided to us by the authors of the TGMM method.The linajea results are organized similarly to the trained models, with one text file for each side of the embryo. <code>drosophila_side_1_tracks_071621.txt</code> contains tracks generated by the model trained on side 2 and tested on side 1, and <code>drosophila_side_2_tracks_071621.txt</code> contains tracks generated by the model trained on side 1 and tested on side 2.<br>