Package: scikit-dataaccess
Import scientific data from various sources through one easy Python API.Use iterator patterns for each data source (configurable data generators + functions to get next data chunk).Skip parser programming and file format handling.Enjoy a common namespace for all data and unleash the power of data fusion.Handle data distribution in different modes: (1) local download, (2) caching of accessed data, or (3) online stream accessEasily pull data on cloud servers through Python scripts and facilitate large-scale parallel processing.Build on an extensible plattform: Adding access to a new data source only requires addition of its "DataFetcher.py".Open source (MIT License)Supported data sets:NamespacePreview(link)Description & Data SourceAstronomyastro.keplerLight curves for stars imaged by the NASA Kepler Space TelescopeSource: https://keplerscience.arc.nasa.govastro.spectraSpectra from the Sloan Digital Sky SurveySource: https://www.sdss.org/dr14/spectro/astro.tess.dataLight curves from TESS Data AlertsSource: https://archive.stsci.edu/prepds/tess-data-alerts/astro.tess.simulatedSimulated light curves from TESS End-to-End 6Source: https://archive.stsci.edu/prepds/tess-data-alerts/astro.voyagerData from the Voyager mission.Source: https://spdf.gsfc.nasa.gov/Engineeringengineering.la.traffic_countsTraffic Count data in Los Angeles.Source: https://data.lacity.org/A-Livable-and-Sustainable-City/LADOT-Traffic-Counts-Summary/94wu-3ps3engineering.webcam.mit_sailingImages from webcams located at the MIT Sailing PavilionSource: http://sailing.mit.edu/webcam.phpFinancefinance.timeseriesFinancial time series data retrieved using Alpha Vantage API.Source: https://www.alphavantage.co/Geosciencegeo.era_interimEra-Interim data at different pressure values fromthe European Centre for Medium-Range Weather Forecasts accessed through the University Corporation for Atmospheric Research.Source: https://rda.ucar.edu/datasets/ds627.0/geo.gldasLand hydrology model produced by NASA. This version of the data is generated to match the GRACE temporal and spatial characteristics and is available as a complementary data product.Source: https://grace.jpl.nasa.gov/data/get-data/land-water-contentgeo.graceNASA GRACE Tellus Monthly Mass Grids. 30-day measurements of changes in Earth’s gravity field to quantify equivalent water thickness.Source: https://grace.jpl.nasa.gov/data/get-data/monthly-mass-grids-landgeo.grace.masconNASA GRACE Tellus Monthly Mass Grids - Global Mascons. 30-day measurements of changes in Earth’s gravity field to quantify equivalent water thickness. Source: https://grace.jpl.nasa.gov/data/get-data/jpl_global_masconsgeo.groundwaterUnited States groundwater monitoring wells measuring the depth to water level. Source: https://waterservices.usgs.govgeo.magnetometerData collected at magnetic observatories operated by the U.S. Geological Survey. Source: https://geomag.usgs.govgeo.mahali.rinexRinex files from the MIT led NSF project studying the Earth’s ionosphere with GPS.Web: http://mahali.mit.edugeo.mahali.tecTotal Electron Content from the MIT led NSF project studying the Earth’s ionosphere with GPS.Web:http://mahali.mit.edugeo.mahali.temperatureTemperature data from the MIT led NSF project studying the Earth’s ionosphere with GPS.Web: http://mahali.mit.edugeo.modisSpectroradiometer aboard the NASA Terra and Aqua image satellites. Generates approximately daily images of the Earth’s surface.Source:https://modis.gsfc.nasa.govgeo.pboEarthScope - Plate Boundary Observatory (PBO): Daily GPS displacement time series measurements throughout the United States.Source: http://www.unavco.org/projects/major-projects/pbo/pbo.htmlgeo.sentinel_1Sentinel-1 TOPSAR data from the European Space Agency retrieved from the Alaska Satellite Facility.Source:https://www.asf.alaska.edu/geo.srtmElevation data at a one arc second resolution from the Shuttle Radar Topography Mission (SRTMGL1).Source: https://lpdaac.usgs.gov/dataset_discovery/measures/measures_products_table/srtmgl1_v003geo.uavsarUAVSAR SLC data from JPL.Source: https://uavsar.jpl.nasa.gov/geo.wyoming_soundingSounding data from the University of Wyoming.Source: http://weather.uwyo.edu/upperair/sounding.htmlPlanetary Scienceplanetary.odeMars planetary data from PDS Geosciences Node's Orbital Data Explorer.Source: http://pds-geosciences.wustl.edu/default.htmSolar Sciencesolar.sdoImages from the Solar Dynamics Observatory.Source: https://sdo.gsfc.nasa.gov/Installpipinstallscikit-dataaccessDocumentationUser Manual:/docs/skdaccess_manual.pdfCode documentation (Doxygen):/docs/skdaccess_doxygen.pdfCode visualization (treemap):/docs/skdaccess_treemap.pngCode class diagrams:/docs/class_diagramsContributorsProject lead:Victor Pankratius (MIT)Contributors: Cody M. Rude, Justin D. Li, David M. Blair, Michael G. Gowanlock, Guillaume Rongier, Victor PankratiusNew contributors welcome! Contactto contribute and add interface code for your own datasets :smile:AcknowledgementsWe acknowledge support from NASA AIST14-NNX15AG84G, NASA AIST16-80NSSC17K0125, NSF ACI-1442997, and NSF AGS-1343967.ExamplesCode examples (Jupyter notebooks) for all datasets listed above are available at:/skdaccess/examples