commonsense/conceptnet5 — Issue #4: Database export scripts
Author: rspeer
Created: 2011-10-29 01:54:17+00:00
State: open

Exporting the database from MongoDB is not that hard; the "mongoexport" command does most of the work, and then we just need to zip the heck out of it (using bzip2 or xzip) and put it in our downloads directory.

We've promised a CC-By version, which means we need to:

* Determine the set of nodes that are CC-By-SA licensed (without using up tons of memory)
* Remove those nodes and all edges pointing to them
* Put the results in a new zip archive