Module Expr Str ImportFrom alias Import alias alias alias Import alias Import alias Import alias ImportFrom alias ImportFrom alias Assign NameStore Call AttributeLoad NameLoad attr Str Assign NameStore Num ClassDef bases NameLoad body FunctionDef arguments args NameParam defaults body Assign AttributeStore NameLoad attr NameLoad decorator_list FunctionDef arguments args NameParam NameParam NameParam defaults kwarg body Assign AttributeStore NameLoad attr Call AttributeLoad NameLoad attr Assign AttributeStore NameLoad attr Num Assign AttributeStore NameLoad attr NameLoad Assign AttributeStore NameLoad attr NameLoad Assign AttributeStore NameLoad attr NameLoad Expr Call AttributeLoad NameLoad attr BinOpMod Str NameLoad Assign AttributeStore NameLoad attr Call AttributeLoad NameLoad attr NameLoad decorator_list FunctionDef arguments args NameParam defaults body Expr Str If CompareIs AttributeLoad NameLoad attr NameLoad body Raise Call NameLoad Str Assign NameStore NameLoad While BoolOpAnd CompareIs NameLoad NameLoad UnaryOpNot AttributeLoad NameLoad attr body TryExcept body Assign NameStore Call AttributeLoad AttributeLoad NameLoad attr attr AttributeLoad NameLoad attr handlers ExceptHandler type AttributeLoad NameLoad attr body Continue If CompareIsNot NameLoad NameLoad body Expr Call AttributeLoad NameLoad attr BinOpMod Str TupleLoad AttributeLoad NameLoad attr AttributeLoad NameLoad attr Expr Call AttributeLoad NameLoad attr NameLoad Expr Call AttributeLoad AttributeLoad NameLoad attr attr AttributeLoad NameLoad attr orelse Expr Call AttributeLoad NameLoad attr BinOpMod Str AttributeLoad NameLoad attr decorator_list FunctionDef arguments args NameParam NameParam defaults body Expr Call AttributeLoad AttributeLoad NameLoad attr attr NameLoad AugAssignAdd AttributeStore NameLoad attr Num If BoolOpAnd NameLoad CompareEq BinOpMod AttributeLoad NameLoad attr NameLoad Num body Assign NameStore Call AttributeLoad AttributeLoad NameLoad attr attr Call AttributeLoad NameLoad attr Str Expr Call AttributeLoad AttributeLoad NameLoad attr attr NameLoad decorator_list Call AttributeLoad NameLoad attr Str FunctionDef arguments args NameParam defaults body Expr Call AttributeLoad NameLoad attr BinOpMod Str TupleLoad AttributeLoad NameLoad attr AttributeLoad NameLoad attr Assert Call NameLoad AttributeLoad AttributeLoad NameLoad attr attr AttributeLoad NameLoad attr Assign AttributeStore NameLoad attr NameLoad Return AttributeLoad AttributeLoad NameLoad attr attr decorator_list Call AttributeLoad NameLoad attr Str FunctionDef arguments args NameParam defaults body Expr Call AttributeLoad NameLoad attr BinOpMod Str AttributeLoad NameLoad attr Assign AttributeStore AttributeLoad NameLoad attr attr Call AttributeLoad AttributeLoad AttributeLoad NameLoad attr attr attr Assign AttributeStore NameLoad attr NameLoad decorator_list Call AttributeLoad NameLoad attr Str FunctionDef arguments args NameParam defaults body Expr Call AttributeLoad NameLoad attr BinOpMod Str AttributeLoad NameLoad attr Expr Call AttributeLoad NameLoad attr Num decorator_list decorator_list FunctionDef arguments args defaults body Expr Call AttributeLoad NameLoad attr keyword Str keyword AttributeLoad NameLoad attr Expr Call AttributeLoad NameLoad attr BinOpMod Str Call AttributeLoad Str attr AttributeLoad NameLoad attr Assign NameStore Call AttributeLoad AttributeLoad NameLoad attr attr SubscriptLoad AttributeLoad NameLoad attr Index Num If CompareLt Call NameLoad AttributeLoad NameLoad attr Num body Print BinOpMod SubscriptLoad Call NameLoad Index Str Call NameLoad Expr Call AttributeLoad NameLoad attr Num Expr Call AttributeLoad NameLoad attr Str Call NameLoad keyword NameLoad Expr Call AttributeLoad NameLoad attr BinOpMod Str NameLoad decorator_list If CompareEq NameLoad Str body Expr Call NameLoad
N/A N/A 
USAGE: %(program)s

    Worker ("slave") process used in computing distributed LSI. Run this script on every node in your cluster. If you wish, you may even run it multiple times on a single machine, to make better use of multiple cores (just beware that memory footprint increases accordingly).

Example: python -m gensim.models.lsi_worker
 __future__ with_statement N/A os sys logging N/A threading N/A tempfile N/A Queue gensim.models lsimodel gensim utils N/A logger N/A N/A logging getLogger gensim.models.lsi_worker N/A SAVE_DEBUG 0 Worker N/A object N/A __init__ N/A N/A self N/A N/A N/A N/A self model None N/A initialize N/A N/A self myid dispatcher N/A model_params N/A N/A N/A self lock_update N/A N/A threading Lock N/A N/A self jobsdone 0 N/A N/A self myid myid N/A N/A self dispatcher dispatcher N/A N/A self finished False N/A N/A N/A logger info N/A initializing worker #%s myid N/A N/A self model N/A N/A lsimodel LsiModel model_params N/A requestjob N/A N/A self N/A N/A N/A 
        Request jobs from the dispatcher, in a perpetual loop until `getstate()` is called.
         N/A N/A N/A self model None N/A N/A N/A RuntimeError worker must be initialized before receiving jobs N/A job None N/A N/A N/A job None N/A N/A self finished N/A N/A N/A N/A job N/A N/A N/A self dispatcher getjob N/A self myid N/A N/A N/A N/A Queue Empty N/A N/A N/A N/A job None N/A N/A N/A N/A logger info N/A worker #%s received job #%i N/A N/A self myid N/A self jobsdone N/A N/A N/A self processjob job N/A N/A N/A N/A self dispatcher jobdone N/A self myid N/A N/A N/A N/A logger info N/A worker #%i stopping asking for jobs N/A self myid N/A processjob N/A N/A self job N/A N/A N/A N/A N/A N/A self model add_documents job N/A N/A self jobsdone 1 N/A N/A SAVE_DEBUG N/A N/A N/A self jobsdone SAVE_DEBUG 0 N/A N/A fname N/A N/A N/A os path join N/A N/A tempfile gettempdir lsi_worker.pkl N/A N/A N/A N/A self model save fname N/A N/A N/A utils synchronous lock_update getstate N/A N/A self N/A N/A N/A N/A N/A logger info N/A worker #%i returning its state after %s jobs N/A N/A self myid N/A self jobsdone N/A N/A isinstance N/A N/A self model projection N/A lsimodel Projection N/A N/A self finished True N/A N/A N/A self model projection N/A N/A N/A utils synchronous lock_update reset N/A N/A self N/A N/A N/A N/A N/A logger info N/A resetting worker #%i N/A self myid N/A N/A N/A self model projection N/A N/A N/A N/A self model projection empty_like N/A N/A self finished False N/A N/A N/A utils synchronous lock_update exit N/A N/A self N/A N/A N/A N/A N/A logger info N/A terminating worker #%i N/A self myid N/A N/A N/A os _exit 0 N/A N/A main N/A N/A N/A N/A N/A N/A N/A logging basicConfig format %(asctime)s : %(levelname)s : %(message)s level N/A logging INFO N/A N/A N/A logger info N/A running %s N/A N/A join N/A sys argv N/A program N/A N/A N/A os path basename N/A N/A sys argv N/A 0 N/A N/A N/A len N/A sys argv 1 N/A N/A N/A N/A N/A globals N/A __doc__ N/A locals N/A N/A N/A sys exit 1 N/A N/A N/A utils pyro_daemon gensim.lsi_worker N/A Worker random_suffix True N/A N/A N/A logger info N/A finished running %s program N/A N/A N/A __name__ __main__ N/A N/A N/A main