Package: galaxies-datasets
Galaxies Datasetsis a collection of ready-to-use extragalactic astronomy datasets
for use with TensorFlow, Jax, and other Machine Learning frameworks.It follows thetensorflow_datasetsframework, making it very easy to switch
between different datasets. All datasets are exposed astf.data.Datasets, enabling
easy-to-use and high-performance input pipelines.UsageLoading a dataset can be as easy as:fromgalaxies_datasetsimportdatasetsimporttensorflow_datasetsastfds# Construct a tf.data.Datasetds=tfds.load("galaxy_zoo_challenge",split="train")# Build your input pipelineds=ds.shuffle(1000).batch(128).prefetch(10).take(5)In the example above:fromgalaxies_datasetsimportdatasetsregisters the collection of galactic datasets with thetensorflow_datasetspackage
making them available through its API. And that is it! …Almost.For more details on tensorflow_datasets check out thedocumentation.Some datasets require that you first manually download data. Check each dataset for
instructions.DatasetsCurrentlyavailable datasetsfocus on galaxy morphology.They include observational data from theGalaxy zoo project:galaxy_zoo_challengegalaxy_zoo2galaxy_zoo_decalsAs well as mock galaxy images from theEAGLE simulation:eagleInstallationYou can installGalaxies DatasetsviapipfromPyPI:$pipinstallgalaxies-datasetsScriptsGalaxies Datasetsprovides some scripts to download and prepare data. The scripts
are available through a command-line interface powered byTyper.For example, to download images and data from the EAGLE simulation you could simply do:galaxies_datasets eagle download USER SIMULATIONwhere USER is your username for the EAGLE public database and SIMULATION is the name
of one of the EAGLE simulations.For all available commands check theCommand-line Interfacereference, or run:galaxies_datasets --helpThe command-line interface also supports automatic completion in all operating
systems, in all the shells (Bash, Zsh, Fish, PowerShell), so that you can just hit
TAB and get the available options or subcommands.To install automatic completion in bash run:galaxies_datasets --install-completion bashCitationIf you use this software, please cite it as below, in addition to any citation
specific to the used datasets.@software{lucas_bignone_2021_5521451,author={Lucas Bignone},title={Galaxies Datasets},month=sep,year=2021,publisher={Zenodo},version={v0.1.1},doi={10.5281/zenodo.5521450},url={https://doi.org/10.5281/zenodo.5521450}}ContributingContributions are very welcome.
To learn more, see theContributor Guide.LicenseDistributed under the terms of theMIT license,Galaxies Datasetsis free and open source software.IssuesIf you encounter any problems,
pleasefile an issuealong with a detailed description.DisclaimerThis is a utility library that downloads and prepares datasets. We do not host
or distribute these datasets, vouch for their quality or fairness, or claim that you
have license to use the dataset. It is your responsibility to determine whether you
have permission to use the dataset under the dataset’s license.If you’re a dataset owner and wish to update any part of it (description, citation,
etc.), or do not want your dataset to be included in this library, please get in
touch through a GitHub issue. Thanks for your contribution to the ML community!CreditsThis project was generated from@cjolowicz’sHypermodern Python Cookiecuttertemplate.Icons made byFreepikfromwww.flaticon.com