Package: opendatasets
opendatasetsopendatasetsis a Python library for downloading datasets from online sources likeKaggleand Google Drive using a simple Python command.InstallationInstall the library usingpip:pip install opendatasets --upgradeUsage - Downloading a datasetDatasets can be downloaded within a Jupyter notebook or Python script using theopendatasets.downloadhelper function. Here's some sample code for downloading theUS Elections Dataset:import opendatasets as od
dataset_url = 'https://www.kaggle.com/tunguz/us-elections-dataset'
od.download('https://www.kaggle.com/tunguz/us-elections-dataset')dataset_urlcan also point to a public Google Drive link or a raw file URL.Kaggle Credentialsopendatasetsuses theKaggle Official APIfor donwloading dataset from Kaggle.  Follow these steps to find your API credentials:Sign in tohttps://kaggle.com/,  then click on your profile picture on the top right and select "My Account" from the menu.Scroll down to the "API" section and click "Create New API Token". This will download a filekaggle.jsonwith the following contents:{"username":"YOUR_KAGGLE_USERNAME","key":"YOUR_KAGGLE_KEY"}When you runopendatsets.download, you will be asked to enter your username & Kaggle API, which you can get from the file downloaded in step 2.Note that you need to download thekaggle.jsonfile only once. You can also place thekaggle.jsonfile in the same directory as the Jupyter notebook, and the credentials will be read automatically.Some interesting datasetsYou can find interesting datasets on Kaggle:https://www.kaggle.com/datasetsYou can also create a new dataset on Kaggle by uploading a CSV file here:https://www.kaggle.com/datasets?new=true(make sure to keep your dataset public, otherwise it will not be downloadable)Video Games sales:https://www.kaggle.com/gregorut/videogamesalesWorld University Rankings:https://www.kaggle.com/mylesoneill/world-university-rankingsNetflix Tv shows and Movies:https://www.kaggle.com/shivamb/netflix-shows/notebooksStackOverflow Developer Survey:https://www.kaggle.com/stackoverflow/stack-overflow-2018-developer-surveyGoogle Play Store Android Apps Data:https://www.kaggle.com/lava18/google-play-store-appsIndian Stock Market Data:https://www.kaggle.com/rohanrao/nifty50-stock-market-dataIndian Air Quality:https://www.kaggle.com/rohanrao/air-quality-data-in-indiaWorldwide Covid-19 Cases:https://www.kaggle.com/imdevskp/corona-virus-reportUSA Covid-19 Cases:https://www.kaggle.com/sudalairajkumar/covid19-in-usaUS Election Results (2012):https://www.kaggle.com/tunguz/us-elections-datasetUS Stock Market:https://www.kaggle.com/borismarjanovic/price-volume-data-for-all-us-stocks-etfs/Crop production in India:https://www.kaggle.com/srinivas1/agricuture-crops-production-in-indiaAgricultural raw material prices:https://www.kaggle.com/kianwee/agricultural-raw-material-prices-19902020Agricultural land values:https://www.kaggle.com/jmullan/agricultural-land-values-19972017Digital payments in India:https://www.kaggle.com/lazycipher/upi-usage-statistics-aug16-to-feb20US Unemployment Rate Data:https://www.kaggle.com/jayrav13/unemployment-by-county-usIndia Road accident Data:https://community.data.gov.in/statistics-of-road-accidents-in-india/Data Science Jobs Data:https://www.kaggle.com/sl6149/data-scientist-job-market-in-the-ushttps://www.kaggle.com/jonatancr/data-science-jobs-around-the-worldhttps://www.kaggle.com/rkb0023/glassdoor-data-science-jobsYoutube Trending Videos:https://www.kaggle.com/datasnaek/youtube-newAsteroid Dataset:https://www.kaggle.com/sakhawat18/asteroid-datasetSolar flares Data:https://www.kaggle.com/khsamaha/solar-flares-rhessiF-1 Race Data:https://www.kaggle.com/cjgdev/formula-1-race-data-19502017Automobile Insurance:https://www.kaggle.com/aashishjhamtani/automobile-insurancePUBG video game matches:https://www.kaggle.com/skihikingkevin/pubg-match-deathsCounterStrike GO (video game)https://www.kaggle.com/mateusdmachado/csgo-professional-matcheshttps://www.kaggle.com/skihikingkevin/csgo-matchmaking-damageDota 2 (video game):https://www.kaggle.com/devinanzelmo/dota-2-matchesCricket One-Day Internationals Data:https://www.kaggle.com/jaykay12/odi-cricket-matches-19712017Cricket Indian Premier League Data:https://www.kaggle.com/nowke9/ipldataBasketball (NCAA):https://www.kaggle.com/ncaa/ncaa-basketballBasketball NBA Players Stats:https://www.kaggle.com/ncaa/ncaa-basketballFootball datasets:https://www.kaggle.com/martj42/international-football-results-from-1872-to-2017https://www.kaggle.com/abecklas/fifa-world-cuphttps://www.kaggle.com/egadharmawan/uefa-champion-league-final-all-season-19552019Hotel Booking Demand:https://www.kaggle.com/jessemostipak/hotel-booking-demandNew York Airbnb listings:https://www.kaggle.com/dgomonov/new-york-city-airbnb-open-dataOther sources to look for datasets:UCI Machine Learning Repositoryawesome-public-datasetsGoogle Dataset SearchIf you use an external source other than Kaggle, you'll create a new dataset on Kaggle by uploading a CSV file here:https://www.kaggle.com/datasets?new=true(make sure to keep your dataset public, otherwise it will not be downloadable usingopendatasets)Curated Datasetsopendatasetsalso provides some curated datsets that you can download by passing the Dataset ID toopendatasets.download. Here's an example:import opendatasets
opendatasets.download('stackoverflow-developer-survey-2020')The following datasets are available for download.Dataset IDDescriptionSourcestackoverflow-developer-survey-2020Stack Overflow Developer Survey 2020Stack Overflowowid-covid-19-latestCovid-19 Stats by Our World in DataOur World in Datastate-of-javascript-2016State of Javascript Annual Survey 2016StateOfJSstate-of-javascript-2017State of Javascript Annual Survey 2017StateOfJSstate-of-javascript-2018State of Javascript Annual Survey 2018StateOfJSstate-of-javascript-2019State of Javascript Annual Survey 2019StateOfJScountries-languages-spokenLanguages Spoken in Different CountriesInfopleaseMore datasets will be added soon..ContributingThis is an open source project and we welcome contributions.Local Development SetupClone the repository:git clone https://github.com/JovianML/opendatasets.gitSetup the Python environment for developmentconda create -n opendatasets python=3.5
conda activate opendatasets
pip install -r requirements.txtOpen up the project in VS code and make your changes. Make sure to install the Python Extension for VS Code and select theopendatasetsconda environment.This package is developed and maintained by theJovianteam.