/developers/dumps
Type: /type/page
body: value: Open Library provides dumps of all its data, generated every month. Most of the data dumps are formatted as tab separated files with the following columns:

 * `type` - type of record (/type/edition, /type/work etc.)
 * `key` - unique key of the record (/books/OL1M etc.)
 * `revision` - revision number of the record
 * `last_modified` - last modified timestamp
 * `JSON` - the complete record in JSON format

## Dumps

 * [editions dump (~ 9.2G)](https://openlibrary.org/data/ol_dump_editions_latest.txt.gz)
 * [works dump (~ 2.9G)](https://openlibrary.org/data/ol_dump_works_latest.txt.gz)
 * [authors dump (~ 0.5G)](https://openlibrary.org/data/ol_dump_authors_latest.txt.gz)
 * [all types dump (~ 12.4G)](https://openlibrary.org/data/ol_dump_latest.txt.gz): includes editions, works, authors, redirects, etc.
 * [complete dump (~ 29.6G)](https://openlibrary.org/data/ol_cdump_latest.txt.gz): also includes past revisions of all the records in Open Library
 * [ratings dump (~ 5M)](https://openlibrary.org/data/ol_dump_ratings_latest.txt.gz): with columns: "Work Key, Edition Key (optional), Rating, Date"
 * [reading log dump (~ 65M)](https://openlibrary.org/data/ol_dump_reading-log_latest.txt.gz): with columns "Work Key, Edition Key (optional), Shelf, Date"
 * [redirects dump (~ 50M)](https://openlibrary.org/data/ol_dump_redirects_latest.txt.gz)
 * [deletes dump (~ 75M)](https://openlibrary.org/data/ol_dump_deletes_latest.txt.gz)
 * [lists dump (~ 30M)](https://openlibrary.org/data/ol_dump_lists_latest.txt.gz)
 * [other dump (~ 10M)](https://openlibrary.org/data/ol_dump_other_latest.txt.gz)
 * [covers metadata dump (~ 70M)](https://openlibrary.org/data/ol_dump_covers_metadata_latest.txt.gz): with columns "id, width, height, created"
 * [wikidata dump (~ 700M)](https://openlibrary.org/data/ol_dump_wikidata_latest.txt.gz) (**NEW**): Wikidata records relevant to Open Library -- currently only authors. Columns "Wikidata ID, JSON"

For past dumps, see: https://archive.org/details/ol_exports?sort=-publicdate

Downloading the dumps take too long? Checkout the link above and download via torrent for higher speeds!

## Format of JSON records

A JSON schema for the various types is located at https://github.com/internetarchive/openlibrary-client/tree/master/olclient/schemata

 * Author Records: JSON serialization of a [type/author](/type/author)
 * Edition Records: JSON serialization of a [type/edition](/type/edition)
 * Work Records: JSON serialization of a [type/work](/type/work)

## Using Open Library Data Dumps

This guide by contributor on the `LibrariesHacked` GitHub about how to load Open Library's data dumps into PostgreSQL to make it more easily queriable:
https://github.com/LibrariesHacked/openlibrary-search

### DuckDB

[DuckDB](https://duckdb.org/) is another easy tool to query the dump without much work.

For example:
If you wanted to get all the Wikidata IDs currently in the authors table:
```
SELECT json_extract(column4, '$.remote_ids.wikidata') as wikidata_id
FROM read_csv('ol_dump_authors_2024-07-31.txt.gz') 
WHERE wikidata_id IS NOT NULL 
LIMIT 100;
```

## GraphQL

DiFronzo on GitHub has produced a GraphQL proxy to search books using work, edition and ISBN with the Open Library API. Deployed with Deno and GraphQL:

https://github.com/DiFronzo/OpenLibrary-GraphQL
DiFronzo/OpenLibrary-GraphQL

## OL Covers Dump

We do not yet have rolling monthly dumps of our book covers, despite a shared desire for their existence. Some historical cover dumps may be explored here:
https://archive.org/details/ol_data?tab=collection&query=identifier%3A*covers*&sort=-addeddate

Most covers are archived in the following items. Note `covers_0006` and `covers_0007` are presently unavailable. 

- https://archive.org/details/covers_0000
- https://archive.org/details/covers_0001
- https://archive.org/details/covers_0002
- https://archive.org/details/covers_0003
- https://archive.org/details/covers_0004
- https://archive.org/details/covers_0005
- https://archive.org/details/covers_0008
- https://archive.org/details/covers_0009
- https://archive.org/details/covers_0010
- https://archive.org/details/covers_0011
- https://archive.org/details/covers_0012
- https://archive.org/details/covers_0013
- https://archive.org/details/covers_0014
has_fulltext: true
title: Open Library Data Dumps
m: edit