Package: crime
crimeView Updated DocumentationSource code ishereEasily load online crime datasts. Explore available datasets from inside a python notebook, with descriptive cell outputs showing general info and descriptions of each dataset and documentation of each column.Install & Usepip install crimeimportcrimeascrLater, runpip install -U crimeevery few days to make sure you've got the latest version.Note: this library should work with any recent Python version, but it hasonly been tested with 3.9.How does it work?Crime pre-defines nicknames and ids for a collection of Socrata datasetslike this onefor you to pick from. This info isn't stored in the package itself, but rather inthis json fileon Github, which can be updated anytime without changing the code. Every time you importcrime, a Github API request is made to retrieve this configuration, so you'll need internet. Callingcr.sources()without parameters will just return this info, without making any additional requests.In addition to letting you load/preview any of these datasets,crime's most important feature is its ability to show a detailed description on each dataset, with full documentation on every column. When you runcr.sources('dataset_name'), an api request is made to Socrata to get the metadata on a particular dataset. The most useful information gets formatted & printed to your screen.Hereis what that output would look like if you looped through each dataset name and printed its description.Caching:Any dataset you load fully will get stored in memory. So next time you request it within the same Jupyter notebook session, it will be available immediately.Getting StartedUsecr.help()for a quick intro.Let's look at the crime data availablecr.sources()# returns a DataFrameYou'll get a DataFrame with basic info on all the sources. The index,Nameis the nickname with which you'll refer to the dataset moving forward.To examine a source, pass the name of the dataset tosources(). This will make an api request to get all of its metadata.Let's see the details oncrime_vs_incarcerationrate. All the info below is coming from Socrata's api.cr.sources('crime_vs_incarceration')Total Crime Rate vs Incarceration Rate Chart
https://dev.socrata.com/foundry/data.colorado.gov/ae3x-wvn9 

Total Crime includes: Violent crimes- Murder and non-negligent
manslaughter, forcible rape, robbery, and aggravated assault. Property
crimes - Burglary, larceny/theft, and motor vehicle theft. National or
state offense totals are based on data from all reporting agencies and
estimates for unreported areas. Rates are the number of reported
offenses per 100,000 population. These figures are based on end of
calendar year populations.

Rows:    31
Cols:    9
Period:  1982 to 2012

COLUMNS:
-------
Year
  Field:  year
  Type:   text
  Null:   -
  Count:  31

Population
  Field:  population
  Type:   number
  Null:   -
  Count:  31
  Min:    3,045,000
  Max:    5,187,582
  Avg:    4,019,137.06
  Sum:    124,593,249

Violent Crime Total
  Field:  violent_crime_total
  Type:   number
  Null:   -
  Count:  31
  Min:    13,811
  Max:    20,229
  Avg:    16,445.55
  Sum:    509,812(output is truncated to save space)Here's what you'll see for text/categorical columns...Race
  Field:  race
  Type:   text
  Null:   30
  Count:  209,241
  ITEMS:
     White  (164,446)
     Black  (39,467)
     Asian/Pacific Islander  (2,236)
     Unknown  (1,889)
     American Indian/Alaskan Native  (1,203)Now we'll load some datacr.load('arrest_demographics')Returns 5-row preview by default, because some datasets have severalmillionrows. To get the full dataset:cr.load('arrest_demographics',full=True)Get more info on a sourceReturn dictionary with full metadatacr.metadata('dataset_name')Return dataframe with metrics on each columncr.columns('dataset_name')CachingAny dataset loaded fully (by passingfull=True) will be stored in memory, regardless of whether you've assigned it to a variable. Next time you load it, you'll receive a new copy (not a reference) of the data.For example, if you run this at the top of your notebook...cr.load('arrest_demographics',full=True)Now, elsewhere in your notebook...EACH of these 3 lines will return the same thing: a COPY of the full dataset, returned instantly# Shorthand to fetch straight from the cache. Returns empty df if none are found in cachecr.df('arrest_demographics')cr.load('arrest_demographics',full=True)cr.load('arrest_demographics')Add/Modify SourcesFirst, select a dataset onOpenDataNetworkand hit "View API". If you're brought to an API pagelike this one, (not all datasets have one), locate the "Dataset Identifier" on top-right side of page. Use that asid. Forbase_url, use the section of the url that comes after/foundry/.cr.add_source("crime_rates","mb89-xnkg","data.colorado.gov")You can pass any additional values as keyword arguments. Valid ones includerows,full_name,web_url,from_year,to_year,location,type, andtopic.To restore the original list of sources, use:cr.reset_sources()Clear sources; start with a blank slatecr.clear_sources()No proper documentation yet. View thesource codeif needed.If there's a dataset not yet listed in our pre-defined sources, you can use thesodapyAPI wrapper to retrieve it manually.