Module Import alias Import alias ImportFrom alias alias ImportFrom alias alias ClassDef bases body Assign NameStore Str Assign NameStore Call AttributeLoad Str attr NameLoad Assign NameStore ListLoad Str Str Assign NameStore ListLoad Str Str Str Str Assign NameStore Str Assign NameStore Str Assign NameStore Dict Str Str NameLoad NameLoad Assign NameStore Call AttributeLoad NameLoad attr Str Assign NameStore Dict Str Str Str Str Num Num FunctionDef arguments args NameParam NameParam NameParam defaults NameLoad NameLoad body Assign AttributeStore NameLoad attr NameLoad If CompareIsNot NameLoad NameLoad body Assign AttributeStore NameLoad attr Call NameLoad AttributeLoad NameLoad attr keyword UnaryOpNot AttributeLoad NameLoad attr keyword AttributeLoad NameLoad attr keyword NameLoad orelse Assign AttributeStore NameLoad attr Call NameLoad AttributeLoad NameLoad attr keyword UnaryOpNot AttributeLoad NameLoad attr keyword AttributeLoad NameLoad attr decorator_list FunctionDef arguments args NameParam defaults body Expr Call AttributeLoad NameLoad attr Expr Call AttributeLoad NameLoad attr Expr Call AttributeLoad NameLoad attr Expr Call AttributeLoad NameLoad attr Return NameLoad decorator_list FunctionDef arguments args NameParam NameParam NameParam NameParam defaults body Expr Call AttributeLoad NameLoad attr Expr Call AttributeLoad AttributeLoad NameLoad attr attr decorator_list FunctionDef arguments args NameParam defaults body Expr Call AttributeLoad AttributeLoad NameLoad attr attr Str Call NameLoad Str Str keyword NameLoad keyword NameLoad Call NameLoad Str Str keyword NameLoad keyword AttributeLoad NameLoad attr For TupleStore NameStore NameStore Call AttributeLoad AttributeLoad NameLoad attr attr body Expr Call AttributeLoad NameLoad attr NameLoad NameLoad keyword AttributeLoad NameLoad attr decorator_list FunctionDef arguments args NameParam NameParam NameParam NameParam defaults NameLoad body Assign NameStore CompareEq AttributeLoad AttributeLoad AttributeLoad NameLoad attr attr attr NameLoad If CompareGt Call AttributeLoad Call AttributeLoad NameLoad attr NameLoad attr Num body If NameLoad body Expr Call AttributeLoad Call AttributeLoad NameLoad attr NameLoad attr keyword NameLoad orelse Expr Call AttributeLoad AttributeLoad AttributeLoad NameLoad attr attr attr keyword NameLoad keyword NameLoad Expr Call AttributeLoad AttributeLoad NameLoad attr attr decorator_list FunctionDef arguments args NameParam NameParam defaults body Assign NameStore CompareEq AttributeLoad AttributeLoad AttributeLoad NameLoad attr attr attr NameLoad Assign NameStore Call AttributeLoad Call AttributeLoad Call AttributeLoad NameLoad attr NameLoad attr AttributeLoad AttributeLoad AttributeLoad NameLoad attr attr attr attr If NameLoad body Return AttributeLoad NameLoad attr orelse Return NameLoad decorator_list FunctionDef arguments args NameParam defaults body Expr Call AttributeLoad AttributeLoad NameLoad attr attr Str Call NameLoad Str Str keyword NameLoad keyword NameLoad Call NameLoad Str Str keyword NameLoad keyword AttributeLoad NameLoad attr decorator_list FunctionDef arguments args NameParam NameParam NameParam defaults body Assign NameStore CompareEq AttributeLoad AttributeLoad AttributeLoad NameLoad attr attr attr NameLoad If CompareGt Call AttributeLoad Call AttributeLoad NameLoad attr NameLoad attr Num body Expr Call AttributeLoad Call AttributeLoad NameLoad attr NameLoad attr keyword NameLoad orelse Expr Call AttributeLoad AttributeLoad AttributeLoad NameLoad attr attr attr keyword NameLoad keyword NameLoad Expr Call AttributeLoad AttributeLoad NameLoad attr attr decorator_list FunctionDef arguments args NameParam NameParam defaults body If CompareEq NameLoad AttributeLoad NameLoad attr body Return AttributeLoad NameLoad attr Assign NameStore CompareEq AttributeLoad AttributeLoad AttributeLoad NameLoad attr attr attr NameLoad Assign NameStore Call AttributeLoad Call AttributeLoad Call AttributeLoad NameLoad attr NameLoad attr AttributeLoad AttributeLoad AttributeLoad NameLoad attr attr attr attr If NameLoad body Return Dict Str Str AttributeLoad NameLoad attr AttributeLoad NameLoad attr orelse Return NameLoad decorator_list FunctionDef arguments args NameParam defaults body Assign NameStore Call AttributeLoad Call AttributeLoad Call AttributeLoad NameLoad attr AttributeLoad AttributeLoad NameLoad attr attr attr AttributeLoad AttributeLoad AttributeLoad NameLoad attr attr attr AttributeLoad AttributeLoad AttributeLoad NameLoad attr attr attr attr Return BinOpAdd ListLoad AttributeLoad NameLoad attr NameLoad decorator_list FunctionDef arguments args NameParam defaults body Expr Call AttributeLoad AttributeLoad NameLoad attr attr Str Call NameLoad Str Str keyword NameLoad keyword NameLoad keyword Num Call NameLoad Str Str keyword NameLoad keyword NameLoad Call NameLoad Str Str keyword NameLoad keyword AttributeLoad NameLoad attr If AttributeLoad NameLoad attr body Expr Call AttributeLoad AttributeLoad NameLoad attr attr Str Expr Call AttributeLoad AttributeLoad NameLoad attr attr Str decorator_list FunctionDef arguments args NameParam defaults body Expr Call AttributeLoad AttributeLoad NameLoad attr attr Str Call NameLoad Str Str keyword NameLoad keyword NameLoad keyword Num Call NameLoad Str Str keyword NameLoad keyword NameLoad Call NameLoad Str Str keyword NameLoad keyword AttributeLoad NameLoad attr If AttributeLoad NameLoad attr body Expr Call AttributeLoad AttributeLoad NameLoad attr attr Str Expr Call AttributeLoad AttributeLoad NameLoad attr attr Str Expr Call AttributeLoad AttributeLoad NameLoad attr attr Str Expr Call AttributeLoad AttributeLoad NameLoad attr attr Str Call NameLoad Str Str keyword NameLoad keyword Num Call NameLoad Str Str keyword NameLoad keyword Num Call NameLoad Str Str keyword NameLoad keyword AttributeLoad NameLoad attr If AttributeLoad NameLoad attr body Expr Call AttributeLoad AttributeLoad NameLoad attr attr Str Expr Call AttributeLoad AttributeLoad NameLoad attr attr Str Expr Call AttributeLoad AttributeLoad NameLoad attr attr Str decorator_list FunctionDef arguments args NameParam defaults body If AttributeLoad NameLoad attr body Pass decorator_list FunctionDef arguments args NameParam NameParam defaults body Assign NameStore Call AttributeLoad Call AttributeLoad AttributeLoad NameLoad attr attr Str NameLoad attr Return NameLoad decorator_list FunctionDef arguments args NameParam NameParam defaults body Expr Str FunctionDef arguments args defaults body With Call NameLoad NameLoad Str NameStore body For TupleStore NameStore NameStore Call NameLoad NameLoad body Assign NameStore NameLoad Assign NameStore Call AttributeLoad Call AttributeLoad Call AttributeLoad NameLoad attr Str Str attr Str attr Str If CompareEq Call NameLoad NameLoad Num body Assign NameStore Call AttributeLoad Str attr BinOpAdd NameLoad Num Assign NameStore SubscriptLoad NameLoad Index Num orelse Assign NameStore SubscriptLoad NameLoad Index Num Assign NameStore SubscriptLoad NameLoad Index Num Expr Yield Dict Str Str Str NameLoad NameLoad Call AttributeLoad NameLoad attr Str Str decorator_list Expr Call AttributeLoad AttributeLoad AttributeLoad NameLoad attr attr attr Call NameLoad decorator_list FunctionDef arguments args NameParam NameParam defaults body Expr Str FunctionDef arguments args defaults body Assign NameStore Call NameLoad Call AttributeLoad NameLoad attr NameLoad For TupleStore NameStore NameStore Call NameLoad NameLoad body Assign NameStore NameLoad Assign NameStore NameLoad With Call NameLoad NameLoad Str NameStore body Assign NameStore Call AttributeLoad Call AttributeLoad NameLoad attr attr Str Str Expr Yield Dict Str Str Str NameLoad NameLoad Call AttributeLoad NameLoad attr Str Str decorator_list Expr Call AttributeLoad AttributeLoad AttributeLoad NameLoad attr attr attr Call NameLoad decorator_list FunctionDef arguments args NameParam NameParam NameParam NameParam NameParam defaults NameLoad NameLoad NameLoad body Expr Str Assign NameStore Call NameLoad IfExp CompareIsNot NameLoad NameLoad ListLoad NameLoad AttributeLoad NameLoad attr Assign NameStore Call NameLoad IfExp CompareIsNot NameLoad NameLoad ListLoad NameLoad AttributeLoad NameLoad attr Assign NameStore ListLoad Assign NameStore ListLoad Assign NameStore ListLoad Assign NameStore ListLoad FunctionDef arguments args defaults body With Call NameLoad NameLoad Str NameStore body Assign NameStore Call NameLoad NameLoad For NameStore NameLoad body Expr Yield NameLoad decorator_list FunctionDef arguments args defaults body With Call NameLoad NameLoad Str NameStore body For NameStore NameLoad body Expr Yield Call AttributeLoad Call AttributeLoad Call AttributeLoad NameLoad attr Str Str attr Str attr Str decorator_list FunctionDef arguments args NameParam defaults body Assign NameStore NameLoad Assign NameStore NameLoad For TupleStore NameStore NameStore Call NameLoad NameLoad body If CompareEq NameLoad Num body For TupleStore NameStore NameStore Call NameLoad NameLoad body If CompareIn Call AttributeLoad NameLoad attr NameLoad body Assign NameStore NameLoad orelse If CompareIn Call AttributeLoad NameLoad attr NameLoad body Assign NameStore NameLoad orelse Assign NameStore Call NameLoad NameLoad Expr Call AttributeLoad NameLoad attr NameLoad Expr Call AttributeLoad NameLoad attr NameLoad Expr Call AttributeLoad NameLoad attr Str orelse Assign NameStore BinOpSub NameLoad Num Assign NameStore Call AttributeLoad Str attr BinOpAdd NameLoad Num Assign NameStore Str Assign NameStore Num For TupleStore NameStore NameStore Call NameLoad NameLoad body If CompareEq NameLoad NameLoad body Assign NameStore NameLoad orelse If CompareEq NameLoad NameLoad body Assign NameStore NameLoad orelse Expr Call AttributeLoad NameLoad attr Dict Str Str Str NameLoad NameLoad Call AttributeLoad NameLoad attr Str Str Assign NameStore SubscriptLoad NameLoad Index NameLoad If CompareEq NameLoad Str body TryExcept body Expr Call NameLoad NameLoad handlers ExceptHandler type NameLoad body Assign NameStore Str If CompareEq NameLoad Str body TryExcept body Expr Call NameLoad NameLoad handlers ExceptHandler type NameLoad body Assign NameStore Str Assign SubscriptStore NameLoad Index NameLoad NameLoad AugAssignAdd NameStore Num Expr Yield Dict Str Str Str NameLoad NameLoad Call AttributeLoad NameLoad attr Str Str decorator_list FunctionDef arguments args defaults body For NameStore NameLoad body Assign NameStore SubscriptLoad NameLoad Index NameLoad Assign NameStore SubscriptLoad NameLoad Index NameLoad Expr Yield Dict Str Str Str NameLoad NameLoad NameLoad decorator_list Assign NameStore IfExp NameLoad Call NameLoad Call NameLoad Expr Call AttributeLoad AttributeLoad AttributeLoad NameLoad attr attr attr Call NameLoad NameLoad Expr Call AttributeLoad AttributeLoad AttributeLoad NameLoad attr attr attr Call NameLoad Expr Call AttributeLoad AttributeLoad AttributeLoad NameLoad attr attr attr NameLoad decorator_list FunctionDef arguments args NameParam NameParam defaults body Expr Str FunctionDef arguments args NameParam defaults body With Call NameLoad NameLoad Str NameStore body For NameStore NameLoad body Assign NameStore AttributeLoad NameLoad attr Assign NameStore Call AttributeLoad NameLoad attr Call AttributeLoad AttributeLoad NameLoad attr attr Str Expr Call AttributeLoad NameLoad attr Call AttributeLoad Call AttributeLoad Str attr NameLoad NameLoad attr Str Str decorator_list Assign NameStore Call AttributeLoad Call AttributeLoad NameLoad attr attr AttributeLoad AttributeLoad AttributeLoad NameLoad attr attr attr AttributeLoad AttributeLoad AttributeLoad NameLoad attr attr attr keyword AttributeLoad AttributeLoad AttributeLoad NameLoad attr attr attr Expr Call NameLoad NameLoad decorator_list FunctionDef arguments args NameParam NameParam NameParam NameParam NameParam defaults NameLoad NameLoad NameLoad body Expr Str Assign NameStore ListComp AttributeLoad NameLoad attr comprehension NameStore Call AttributeLoad Call AttributeLoad NameLoad attr attr AttributeLoad AttributeLoad AttributeLoad NameLoad attr attr attr keyword AttributeLoad AttributeLoad AttributeLoad NameLoad attr attr attr Assign NameStore Call NameLoad NameLoad Assign NameStore BinOpAdd ListLoad IfExp CompareIsNot NameLoad NameLoad NameLoad Str IfExp CompareIsNot NameLoad NameLoad NameLoad Str NameLoad FunctionDef arguments args NameParam defaults body With Call NameLoad NameLoad Str NameStore body Assign NameStore Call NameLoad NameLoad Expr Call AttributeLoad NameLoad attr NameLoad For NameStore NameLoad body Assign NameStore AttributeLoad NameLoad attr Assign NameStore AttributeLoad NameLoad attr Assign NameStore Call AttributeLoad NameLoad attr Call AttributeLoad AttributeLoad NameLoad attr attr Str Assign NameStore BinOpMult ListLoad Str NameLoad For NameStore Call AttributeLoad Call AttributeLoad NameLoad attr CompareEq AttributeLoad AttributeLoad AttributeLoad NameLoad attr attr attr NameLoad attr AttributeLoad AttributeLoad AttributeLoad NameLoad attr attr attr AttributeLoad AttributeLoad AttributeLoad NameLoad attr attr attr body Assign SubscriptStore NameLoad Index AttributeLoad NameLoad attr Call AttributeLoad NameLoad attr Call AttributeLoad AttributeLoad NameLoad attr attr Str Assign NameStore BinOpAdd ListLoad NameLoad NameLoad NameLoad Expr Call AttributeLoad NameLoad attr NameLoad decorator_list FunctionDef arguments args NameParam defaults body With Call NameLoad NameLoad Str NameStore body Expr Call AttributeLoad NameLoad attr Call AttributeLoad Call AttributeLoad Str attr Call AttributeLoad Str attr NameLoad attr Str Str For NameStore NameLoad body Assign NameStore AttributeLoad NameLoad attr Assign NameStore AttributeLoad NameLoad attr Assign NameStore Call AttributeLoad NameLoad attr Call AttributeLoad AttributeLoad NameLoad attr attr Str Assign NameStore BinOpMult ListLoad Str NameLoad For NameStore Call AttributeLoad Call AttributeLoad NameLoad attr CompareEq AttributeLoad AttributeLoad AttributeLoad NameLoad attr attr attr NameLoad attr AttributeLoad AttributeLoad AttributeLoad NameLoad attr attr attr AttributeLoad AttributeLoad AttributeLoad NameLoad attr attr attr body Assign SubscriptStore NameLoad Index AttributeLoad NameLoad attr Call AttributeLoad NameLoad attr Call AttributeLoad AttributeLoad NameLoad attr attr Str Assign NameStore BinOpAdd ListLoad NameLoad NameLoad NameLoad Expr Call AttributeLoad NameLoad attr Call AttributeLoad Call AttributeLoad Str attr Call AttributeLoad Str attr NameLoad attr Str Str decorator_list Assign NameStore Call AttributeLoad Call AttributeLoad NameLoad attr attr AttributeLoad AttributeLoad AttributeLoad NameLoad attr attr attr AttributeLoad AttributeLoad AttributeLoad NameLoad attr attr attr AttributeLoad AttributeLoad AttributeLoad NameLoad attr attr attr keyword AttributeLoad AttributeLoad AttributeLoad NameLoad attr attr attr If NameLoad body Expr Call NameLoad NameLoad orelse Expr Call NameLoad NameLoad decorator_list decorator_list
N/A N/A glob N/A re gluon.sql DAL Field utils.UnicodeIO UnicodeReader UnicodeWriter Corpus_DB N/A N/A N/A FILENAME corpus.db N/A CONNECTION N/A N/A sqlite://{} format FILENAME N/A DOC_IDS N/A doc_id docid N/A DOC_CONTENTS N/A doc_content doccontent docbody doc_body N/A MODEL_KEY corpus N/A MODEL_DESC Text Corpus N/A MODEL_ENTRY N/A model_key model_desc MODEL_KEY MODEL_DESC N/A LINEBREAKS_TABS N/A N/A re compile [\t\r\n\f] N/A DEFAULT_OPTIONS N/A token_regex min_freq min_doc_freq \w{3,} 5 3 __init__ N/A N/A self path isInit N/A None False N/A N/A N/A self isInit isInit N/A N/A path None N/A N/A N/A self db N/A DAL N/A Corpus_DB CONNECTION lazy_tables N/A N/A self isInit migrate_enabled N/A self isInit folder path N/A N/A N/A self db N/A DAL N/A Corpus_DB CONNECTION lazy_tables N/A N/A self isInit migrate_enabled N/A self isInit N/A __enter__ N/A N/A self N/A N/A N/A N/A N/A self DefineOptionsTable N/A N/A N/A self DefineModelsTable N/A N/A N/A self DefineCorpusTable N/A N/A N/A self DefineMetadataTables N/A self N/A __exit__ N/A N/A self type value traceback N/A N/A N/A N/A N/A self DefineCorpusTextSearch N/A N/A N/A N/A self db commit N/A DefineOptionsTable N/A N/A self N/A N/A N/A N/A N/A N/A self db define_table options N/A Field key string required True unique True N/A Field value string required True migrate N/A self isInit N/A N/A key value N/A N/A N/A Corpus_DB DEFAULT_OPTIONS iteritems N/A N/A N/A N/A self SetOption key value overwrite N/A self isInit N/A SetOption N/A N/A self key value overwrite N/A True N/A N/A where N/A N/A N/A N/A self db options key key N/A N/A N/A N/A N/A N/A self db where count 0 N/A N/A overwrite N/A N/A N/A N/A N/A N/A self db where update value value N/A N/A N/A N/A N/A N/A self db options insert key key value value N/A N/A N/A N/A self db commit N/A GetOption N/A N/A self key N/A N/A N/A where N/A N/A N/A N/A self db options key key N/A keyValue N/A N/A N/A N/A N/A N/A self db where select N/A N/A N/A self db options value first N/A keyValue N/A N/A N/A keyValue value N/A N/A None N/A DefineModelsTable N/A N/A self N/A N/A N/A N/A N/A N/A self db define_table models N/A Field model_key string required True unique True N/A Field model_desc string required True migrate N/A self isInit N/A AddModel N/A N/A self model_key model_desc N/A N/A N/A where N/A N/A N/A N/A self db models model_key model_key N/A N/A N/A N/A N/A N/A self db where count 0 N/A N/A N/A N/A N/A N/A self db where update model_desc model_desc N/A N/A N/A N/A N/A N/A self db models insert model_key model_key model_desc model_desc N/A N/A N/A N/A self db commit N/A GetModel N/A N/A self model_key N/A N/A N/A N/A model_key N/A Corpus_DB MODEL_KEY N/A N/A N/A Corpus_DB MODEL_ENTRY N/A where N/A N/A N/A N/A self db models model_key model_key N/A keyValue N/A N/A N/A N/A N/A N/A self db where select N/A N/A N/A self db models ALL first N/A keyValue N/A N/A N/A model_key model_desc N/A keyValue model_key N/A keyValue model_desc N/A N/A None N/A GetModels N/A N/A self N/A N/A N/A rows N/A N/A N/A N/A N/A N/A self db N/A N/A self db models select N/A N/A N/A self db models model_key N/A N/A N/A self db models model_desc as_list N/A N/A N/A N/A Corpus_DB MODEL_ENTRY rows N/A DefineCorpusTable N/A N/A self N/A N/A N/A N/A N/A N/A self db define_table corpus N/A Field doc_index integer required True unique True default -1 N/A Field doc_id string required True unique True N/A Field doc_content text required True migrate N/A self isInit N/A N/A self isInit N/A N/A N/A N/A N/A self db executesql CREATE UNIQUE INDEX IF NOT EXISTS corpus_doc_index ON corpus (doc_index); N/A N/A N/A N/A self db executesql CREATE UNIQUE INDEX IF NOT EXISTS corpus_doc_id    ON corpus (doc_id); N/A DefineMetadataTables N/A N/A self N/A N/A N/A N/A N/A N/A self db define_table fields N/A Field field_index integer required True unique True default -1 N/A Field field_name string required True unique True N/A Field field_type string required True migrate N/A self isInit N/A N/A self isInit N/A N/A N/A N/A N/A self db executesql CREATE UNIQUE INDEX IF NOT EXISTS field_index ON fields (field_index); N/A N/A N/A N/A self db executesql CREATE UNIQUE INDEX IF NOT EXISTS field_name  ON fields (field_name); N/A N/A N/A N/A self db executesql CREATE        INDEX IF NOT EXISTS field_type  ON fields (field_type); N/A N/A N/A N/A self db define_table metadata N/A Field doc_index integer required True default -1 N/A Field field_index integer required True default -1 N/A Field value text required True migrate N/A self isInit N/A N/A self isInit N/A N/A N/A N/A N/A self db executesql CREATE UNIQUE INDEX IF NOT EXISTS metadata_indexes     ON metadata (doc_index, field_index); N/A N/A N/A N/A self db executesql CREATE        INDEX IF NOT EXISTS metadata_doc_index   ON metadata (doc_index); N/A N/A N/A N/A self db executesql CREATE        INDEX IF NOT EXISTS metadata_field_index ON metadata (field_index); N/A DefineCorpusTextSearch N/A N/A self N/A N/A N/A N/A self isInit N/A N/A N/A SanitizeText N/A N/A self text N/A N/A N/A text N/A N/A N/A N/A N/A Corpus_DB LINEBREAKS_TABS sub text strip N/A text N/A ImportFromFile N/A N/A self filename N/A N/A N/A 
		filename = A plain-text file (utf-8 encoded) containing one document per line
		 ReadFile N/A N/A N/A N/A N/A N/A open filename r f N/A N/A N/A index line N/A enumerate f N/A N/A doc_index index N/A values N/A N/A N/A N/A N/A N/A line decode utf-8 ignore rstrip split N/A N/A N/A len values 1 N/A N/A doc_id N/A N/A doc{} format N/A doc_index 1 N/A doc_content N/A values N/A 0 N/A N/A doc_id N/A values N/A 0 N/A doc_content N/A values N/A 1 N/A N/A N/A doc_index doc_id doc_content doc_index doc_id N/A N/A doc_content encode utf-8 ignore N/A N/A N/A N/A N/A N/A self db corpus bulk_insert N/A ReadFile N/A ImportFromFolder N/A N/A self glob_pattern N/A N/A N/A 
		glob_pattern = A folder of files or a glob pattern for list of files (utf-8 encoded, one document per file)
		 ReadFolder N/A N/A N/A N/A N/A filenames N/A sorted N/A N/A glob glob glob_pattern N/A N/A index filename N/A enumerate filenames N/A N/A doc_index index N/A doc_id filename N/A N/A open filename r f N/A N/A doc_content N/A N/A N/A N/A f read decode utf-8 ignore N/A N/A N/A doc_index doc_id doc_content doc_index doc_id N/A N/A doc_content encode utf-8 ignore N/A N/A N/A N/A N/A N/A self db corpus bulk_insert N/A ReadFolder N/A ImportFromSpreadsheet N/A N/A self filename id_key content_key is_csv N/A None None False N/A N/A 
		filename = A tab- or comman-separated spreadsheet (utf-8 encoded, with a header row containing column names)
		id_key = Name of the column containing unique document IDs
		content_key = Name of the column containing the document contents
		 N/A doc_id_keys N/A frozenset N/A N/A id_key None N/A id_key N/A Corpus_DB DOC_IDS N/A doc_content_keys N/A frozenset N/A N/A content_key None N/A content_key N/A Corpus_DB DOC_CONTENTS N/A field_indexes N/A N/A field_names N/A N/A field_types N/A N/A metadata N/A ReadCSV N/A N/A N/A N/A N/A N/A open filename r f N/A N/A reader N/A UnicodeReader f N/A row reader N/A N/A N/A row N/A ReadTSV N/A N/A N/A N/A N/A N/A open filename r f N/A N/A line f N/A N/A N/A N/A N/A N/A N/A N/A N/A line decode utf-8 ignore rstrip split N/A ReadSpreadsheet N/A N/A reader N/A N/A N/A field_doc_id None N/A field_doc_content None N/A N/A row_index values N/A enumerate reader N/A N/A N/A row_index 0 N/A N/A N/A index field N/A enumerate values N/A N/A N/A N/A N/A field lower doc_id_keys N/A N/A field_doc_id index N/A N/A N/A N/A N/A field lower doc_content_keys N/A N/A field_doc_content index N/A N/A field_index N/A len field_indexes N/A N/A N/A field_indexes append field_index N/A N/A N/A field_names append field N/A N/A N/A field_types append integer N/A N/A doc_index N/A row_index 1 N/A doc_id N/A N/A doc{:d} format N/A doc_index 1 N/A doc_content N/A field_index 0 N/A N/A index value N/A enumerate values N/A N/A N/A field_doc_id index N/A N/A doc_id value N/A N/A N/A field_doc_content index N/A N/A doc_content value N/A N/A N/A N/A metadata append N/A doc_index field_index value doc_index field_index N/A N/A value encode utf-8 ignore N/A field_type N/A field_types N/A field_index N/A N/A field_type integer N/A N/A N/A N/A N/A int value N/A N/A N/A ValueError N/A N/A field_type double N/A N/A field_type double N/A N/A N/A N/A N/A float value N/A N/A N/A ValueError N/A N/A field_type string N/A N/A field_types N/A field_index field_type N/A field_index 1 N/A N/A N/A doc_index doc_id doc_content doc_index doc_id N/A N/A doc_content encode utf-8 ignore N/A GetFields N/A N/A N/A N/A N/A field_index field_indexes N/A N/A field_name N/A field_names N/A field_index N/A field_type N/A field_types N/A field_index N/A N/A N/A field_index field_name field_type field_index field_name field_type N/A N/A reader N/A is_csv N/A ReadCSV N/A ReadTSV N/A N/A N/A N/A N/A self db corpus bulk_insert N/A ReadSpreadsheet reader N/A N/A N/A N/A N/A self db fields bulk_insert N/A GetFields N/A N/A N/A N/A N/A self db metadata bulk_insert metadata N/A ExportToFile N/A N/A self filename N/A N/A N/A 
		filename = A tab-delimited file (utf-8 encoded, without header) containing docIDs and document contents
		 WriteFile N/A N/A rows N/A N/A N/A N/A open filename w f N/A N/A row rows N/A N/A doc_id N/A row doc_id N/A doc_content N/A N/A self SanitizeText N/A N/A N/A row doc_content decode utf-8 N/A N/A N/A f write N/A N/A N/A N/A {}	{}
 format doc_id doc_content encode utf-8 ignore N/A N/A rows N/A N/A N/A N/A self db select N/A N/A N/A self db corpus doc_id N/A N/A N/A self db corpus doc_content orderby N/A N/A N/A self db corpus doc_index N/A N/A WriteFile rows N/A ExportToSpreadsheet N/A N/A self filename id_key content_key is_csv N/A None None False N/A N/A 
		filename = A tab- or comma-separated spreadsheet (utf-8 encoded, with header) containing the text corpus and all metadata
		 N/A field_names N/A N/A row field_name N/A row N/A N/A N/A N/A self db select N/A N/A N/A self db fields field_name orderby N/A N/A N/A self db fields field_index N/A field_count N/A len field_names N/A all_field_names N/A N/A N/A N/A id_key None id_key doc_id N/A N/A content_key None content_key doc_content field_names WriteCSV N/A N/A rows N/A N/A N/A N/A open filename w f N/A N/A writer N/A UnicodeWriter f N/A N/A N/A writer writerow all_field_names N/A row rows N/A N/A doc_index N/A row doc_index N/A doc_id N/A row doc_id N/A doc_content N/A N/A self SanitizeText N/A N/A N/A row doc_content decode utf-8 N/A values N/A N/A field_count N/A d N/A N/A N/A N/A self db N/A N/A N/A N/A self db metadata doc_index doc_index select N/A N/A N/A self db metadata field_index N/A N/A N/A self db metadata value N/A N/A N/A values N/A N/A d field_index N/A N/A self SanitizeText N/A N/A N/A d value decode utf-8 N/A all_values N/A N/A doc_id doc_content values N/A N/A N/A writer writerow all_values N/A WriteTSV N/A N/A rows N/A N/A N/A N/A open filename w f N/A N/A N/A N/A f write N/A N/A N/A N/A {}
 format N/A N/A join all_field_names encode utf-8 ignore N/A row rows N/A N/A doc_index N/A row doc_index N/A doc_id N/A row doc_id N/A doc_content N/A N/A self SanitizeText N/A N/A N/A row doc_content decode utf-8 N/A values N/A N/A field_count N/A d N/A N/A N/A N/A self db N/A N/A N/A N/A self db metadata doc_index doc_index select N/A N/A N/A self db metadata field_index N/A N/A N/A self db metadata value N/A N/A N/A values N/A N/A d field_index N/A N/A self SanitizeText N/A N/A N/A d value decode utf-8 N/A all_values N/A N/A doc_id doc_content values N/A N/A N/A f write N/A N/A N/A N/A {}
 format N/A N/A join all_values encode utf-8 ignore N/A N/A rows N/A N/A N/A N/A self db select N/A N/A N/A self db corpus doc_index N/A N/A N/A self db corpus doc_id N/A N/A N/A self db corpus doc_content orderby N/A N/A N/A self db corpus doc_index N/A is_csv N/A N/A N/A WriteCSV rows N/A N/A N/A WriteTSV rows N/A N/A