Package: databrewer
DataBrewerThe missing datasets manager.Free software: MIT licenseDocumentation:https://databrewer.readthedocs.org.Databrewer let you search and discover datasets. Inspired by Homebrew, it
creates and index of known datasets that you can download with a single
command. It will provide an API to allow to do the same in, for example, a
IPython notebook so you no longer have to manually download datasets.QuickstartInstalldatabrewer:pip install databrewerUpdate the recipes index:databrewer updateSearch for some keywords:databrewer search nyc taxiExample output:andresmh-nyc-taxi-trips - NYC Taxi Trips. Data obtained through a FOIA request
nyc-tlc-taxi            - This dataset includes trip records from all trips
                          completed in yellow and green taxis in NYC in 2014 and
                                                    select months of 2015.Let’s check thenyc-tlc-taxidataset:databrewer info nyc-tlc-taxiWe can either download the entire dataset (which is huge!):databrewer download nyc-tlc-taxiOr just a few files in the dataset, or select a subset:databrewer download "nyc-tlc-taxi[green][2014-*]"NoteNote that*is the standard glob operator and[green]acts as selector.
The selectors depends on how the recipe if defined. When using selectors you
must enclose the name in quotes in most shells.Finally you need to know where the files are located for further processing:databrewer download "nyc-tlc-taxi[green][2014-*]"Example output:/Users/rolando/.databrewer/datasets/nyc-tlc-taxi/green_tripdata_2014-01.csv
/Users/rolando/.databrewer/datasets/nyc-tlc-taxi/green_tripdata_2014-02.csv
/Users/rolando/.databrewer/datasets/nyc-tlc-taxi/green_tripdata_2014-03.csv
/Users/rolando/.databrewer/datasets/nyc-tlc-taxi/green_tripdata_2014-04.csv
/Users/rolando/.databrewer/datasets/nyc-tlc-taxi/green_tripdata_2014-05.csv
/Users/rolando/.databrewer/datasets/nyc-tlc-taxi/green_tripdata_2014-06.csv
/Users/rolando/.databrewer/datasets/nyc-tlc-taxi/green_tripdata_2014-07.csv
/Users/rolando/.databrewer/datasets/nyc-tlc-taxi/green_tripdata_2014-08.csv
/Users/rolando/.databrewer/datasets/nyc-tlc-taxi/green_tripdata_2014-09.csv
/Users/rolando/.databrewer/datasets/nyc-tlc-taxi/green_tripdata_2014-10.csv
/Users/rolando/.databrewer/datasets/nyc-tlc-taxi/green_tripdata_2014-11.csv
/Users/rolando/.databrewer/datasets/nyc-tlc-taxi/green_tripdata_2014-12.csvDatasetsThe aim is to index known and not-so-known datasets. There is no plans to
standarize the dataset format as we want to keep it as published by the
authors.RecipesDatasets are defined in recipes which contains information about the dataset
and where to find it.These recipes are community maintained and hosted in thedatabrewer-recipesrepository.RoadmapInclude an API. For now it only provides a CLI-interface but in the near
future it will include an API so you can search, download and load datasets
directly in your Python code.ContributingYou can help by the following means:Spread the word!Request missing featuresReport usability issues or bugsRequest missing datasetsSeeCONTRIBUTING.rstfor more information.History0.1.1 (2017-05-05)Fix packaging issues.0.1.0 (2017-05-05)First release on PyPI.