Module Import alias Import alias Import alias ImportFrom alias alias alias ImportFrom alias alias ImportFrom alias alias alias alias ImportFrom alias ImportFrom alias ClassDef bases NameLoad body Expr Str FunctionDef arguments args NameParam defaults body Expr Str Import alias Assign NameStore Call AttributeLoad NameLoad attr Assign AttributeStore NameLoad attr Call AttributeLoad NameLoad attr AttributeLoad NameLoad attr Expr Call AttributeLoad AttributeLoad NameLoad attr attr Str Assign AttributeStore NameLoad attr Call AttributeLoad NameLoad attr AttributeLoad NameLoad attr Expr Call AttributeLoad AttributeLoad NameLoad attr attr Str decorator_list FunctionDef arguments args NameParam defaults body Expr Str Import alias Assign NameStore Call AttributeLoad NameLoad attr Assign AttributeStore NameLoad attr Call AttributeLoad NameLoad attr AttributeLoad NameLoad attr Expr Call AttributeLoad AttributeLoad NameLoad attr attr Str Assign AttributeStore NameLoad attr Call AttributeLoad NameLoad attr AttributeLoad NameLoad attr Expr Call AttributeLoad AttributeLoad NameLoad attr attr Str Expr Call AttributeLoad AttributeLoad NameLoad attr attr AttributeLoad NameLoad attr Str Assign AttributeStore NameLoad attr Call AttributeLoad NameLoad attr Expr Call AttributeLoad AttributeLoad NameLoad attr attr AttributeLoad NameLoad attr AttributeLoad NameLoad attr decorator_list decorator_list ClassDef bases NameLoad body Expr Str FunctionDef arguments args NameParam defaults vararg kwarg body TryExcept body If CompareEq AttributeLoad NameLoad attr Str body Expr Call AttributeLoad NameLoad attr orelse Expr Call AttributeLoad NameLoad attr NameLoad handlers ExceptHandler type NameLoad body Expr Call AttributeLoad NameLoad attr decorator_list FunctionDef arguments args NameParam defaults kwarg body Assign NameStore Call AttributeLoad NameLoad attr If CompareEq AttributeLoad NameLoad attr Str body Expr Call AttributeLoad NameLoad attr Print Str Assign NameStore Call AttributeLoad NameLoad attr Str NameLoad Assign NameStore Call AttributeLoad NameLoad attr keyword NameLoad Assign NameStore Num Assign NameStore NameStore Call NameLoad NameLoad For NameStore Call NameLoad BinOpAdd BinOpDiv Call NameLoad NameLoad NameLoad Num body Assign NameStore BinOpMult NameLoad NameLoad Assign NameStore BinOpAdd NameLoad NameLoad Assign NameStore SubscriptLoad NameLoad Slice NameLoad NameLoad Print BinOpMod Str TupleLoad NameLoad NameLoad For NameStore NameLoad body If CompareEq AttributeLoad NameLoad attr Str body Expr Call AttributeLoad AttributeLoad NameLoad attr attr ListLoad Call NameLoad NameLoad orelse Expr Call AttributeLoad NameLoad attr NameLoad If CompareEq AttributeLoad NameLoad attr Str body For NameStore NameLoad body Assign NameStore Call AttributeLoad AttributeLoad NameLoad attr attr AugAssignSub NameStore Num Assign NameStore Call AttributeLoad NameLoad attr Assign NameStore BinOpSub NameLoad NameLoad Assign NameStore BinOpDiv NameLoad BinOpSub NameLoad NameLoad Assign NameStore BinOpMult NameLoad NameLoad Assign NameStore BinOpAdd Call AttributeLoad AttributeLoad NameLoad attr attr Call AttributeLoad NameLoad attr keyword NameLoad Print BinOpMod Str TupleLoad NameLoad NameLoad Call NameLoad NameLoad Num Call AttributeLoad NameLoad attr Str Expr Call AttributeLoad NameLoad attr decorator_list FunctionDef arguments args NameParam defaults body If CompareEq AttributeLoad NameLoad attr Str body Print Str Expr Call AttributeLoad AttributeLoad NameLoad attr attr Str decorator_list FunctionDef arguments args NameParam defaults body Expr Call AttributeLoad NameLoad attr Print BinOpMod Str Call AttributeLoad NameLoad attr While NameLoad body If Call AttributeLoad AttributeLoad NameLoad attr attr Num body Assign NameStore SubscriptLoad Call AttributeLoad AttributeLoad NameLoad attr attr Slice Num If CompareEq NameLoad Str body Print BinOpMod Str Call AttributeLoad NameLoad attr Return Assign TupleStore NameStore NameStore Call AttributeLoad AttributeLoad NameLoad attr attr Print BinOpMod Str TupleLoad Call AttributeLoad NameLoad attr NameLoad Assign NameStore Call AttributeLoad NameLoad attr Expr Call AttributeLoad NameLoad attr NameLoad Assign NameStore BinOpSub Call AttributeLoad NameLoad attr NameLoad Expr Call AttributeLoad AttributeLoad NameLoad attr attr ListLoad NameLoad BinOpMod Str TupleLoad NameLoad Call NameLoad NameLoad Num decorator_list decorator_list ClassDef bases NameLoad body Expr Str Assign NameStore Str Assign NameStore Str FunctionDef arguments args NameParam NameParam NameParam NameParam defaults Str body Assign AttributeStore NameLoad attr NameLoad Assign AttributeStore NameLoad attr NameLoad Assign AttributeStore NameLoad attr NameLoad decorator_list FunctionDef arguments args NameParam NameParam defaults body Expr Str If Call NameLoad NameLoad TupleLoad NameLoad NameLoad body Assign NameStore Call AttributeLoad NameLoad attr NameLoad Assign NameStore Call NameLoad NameLoad AttributeLoad NameLoad attr Assign NameStore Call AttributeLoad NameLoad attr NameLoad If BoolOpOr UnaryOpNot NameLoad UnaryOpNot NameLoad body Expr Call AttributeLoad NameLoad attr Str Return Assign NameStore Call NameLoad For NameStore NameLoad body If UnaryOpNot NameLoad body Continue Assign TupleStore NameStore NameStore Call AttributeLoad NameLoad attr keyword NameLoad Expr Call AttributeLoad AttributeLoad NameLoad attr attr Num Expr Call AttributeLoad NameLoad attr NameLoad If NameLoad body Expr Call AttributeLoad NameLoad attr BinOpMod Str Call NameLoad NameLoad Str TryExcept body Assign NameStore Call NameLoad NameLoad keyword AttributeLoad NameLoad attr keyword AttributeLoad NameLoad attr keyword AttributeLoad AttributeLoad NameLoad attr attr Expr Call AttributeLoad NameLoad attr handlers ExceptHandler type NameLoad body Return Assign NameStore Call NameLoad For NameStore AttributeLoad NameLoad attr body Assign TupleStore NameStore NameStore Call AttributeLoad NameLoad attr keyword Call NameLoad NameLoad Expr Call AttributeLoad NameLoad attr NameLoad Expr Call AttributeLoad AttributeLoad NameLoad attr attr Num For NameStore NameLoad body For NameStore NameLoad body Expr Call AttributeLoad NameLoad attr NameLoad Num decorator_list FunctionDef arguments args NameParam defaults body Expr Str Expr Call AttributeLoad NameLoad attr decorator_list decorator_list ClassDef bases NameLoad body Expr Str FunctionDef arguments args NameParam NameParam NameParam NameParam defaults Str body Assign AttributeStore NameLoad attr NameLoad Assign AttributeStore NameLoad attr NameLoad Assign AttributeStore NameLoad attr NameLoad Assign AttributeStore NameLoad attr Call AttributeLoad NameLoad attr keyword AttributeLoad NameLoad attr decorator_list FunctionDef arguments args NameParam NameParam defaults body If Call NameLoad NameLoad TupleLoad NameLoad NameLoad body Assign NameStore Call AttributeLoad NameLoad attr NameLoad Assign NameStore Call NameLoad NameLoad AttributeLoad NameLoad attr TryExcept body Assign NameStore Call NameLoad NameLoad keyword AttributeLoad NameLoad attr keyword AttributeLoad NameLoad attr keyword AttributeLoad AttributeLoad NameLoad attr attr Expr Call AttributeLoad NameLoad attr handlers ExceptHandler type NameLoad body Return Assign NameStore Call AttributeLoad NameLoad attr keyword Num keyword Num For TupleStore NameStore NameStore Call AttributeLoad NameLoad attr body Expr Call AttributeLoad AttributeLoad NameLoad attr attr SubscriptLoad NameLoad Index Str keyword SubscriptLoad NameLoad Index Str decorator_list decorator_list ClassDef bases NameLoad body Expr Str FunctionDef arguments args NameParam defaults body If CompareEq AttributeLoad NameLoad attr Str body Expr Call AttributeLoad NameLoad attr orelse If CompareEq AttributeLoad NameLoad attr Str body Expr Call AttributeLoad NameLoad attr Expr Call AttributeLoad NameLoad attr Expr Call AttributeLoad AttributeLoad NameLoad attr attr Str orelse Expr Call AttributeLoad NameLoad attr decorator_list FunctionDef arguments args NameParam defaults body Expr Call AttributeLoad NameLoad attr While NameLoad body If Call AttributeLoad AttributeLoad NameLoad attr attr Num body Assign NameStore SubscriptLoad Call AttributeLoad AttributeLoad NameLoad attr attr Slice Num If CompareEq NameLoad Str body Return Assign NameStore Call AttributeLoad NameLoad attr Str Assign NameStore Call AttributeLoad NameLoad attr NameLoad Expr Call AttributeLoad NameLoad attr BinOpMod Str NameLoad Str Expr Call AttributeLoad NameLoad attr AttributeLoad NameLoad attr NameLoad If Call AttributeLoad AttributeLoad NameLoad attr attr Num body Assign TupleStore NameStore NameStore NameStore Call AttributeLoad AttributeLoad NameLoad attr attr Assign TupleStore NameStore NameStore NameStore Call AttributeLoad NameLoad attr Call AttributeLoad NameLoad attr Str Expr Call AttributeLoad AttributeLoad NameLoad attr attr ListLoad NameLoad NameLoad Call NameLoad NameLoad Call NameLoad NameLoad decorator_list FunctionDef arguments args NameParam NameParam defaults body Assign NameStore ListLoad If CompareEq AttributeLoad NameLoad attr Str body For NameStore NameLoad body Expr Call AttributeLoad AttributeLoad NameLoad attr attr ListLoad Str Call AttributeLoad NameLoad attr Str For NameStore NameLoad body Assign NameStore Call AttributeLoad AttributeLoad NameLoad attr attr Assign TupleStore NameStore NameStore NameStore NameLoad Expr Call AttributeLoad NameLoad attr TupleLoad Call AttributeLoad NameLoad attr Str Call NameLoad NameLoad Call NameLoad NameLoad Expr Call AttributeLoad NameLoad attr BinOpMod Str Call AttributeLoad NameLoad attr Str Str Expr Call AttributeLoad NameLoad attr Str orelse For NameStore NameLoad body Expr Call AttributeLoad NameLoad attr Call AttributeLoad NameLoad attr NameLoad Return NameLoad decorator_list FunctionDef arguments args NameParam defaults body Expr Str Pass decorator_list FunctionDef arguments args NameParam NameParam defaults body Pass decorator_list FunctionDef arguments args NameParam NameParam defaults body Pass decorator_list FunctionDef arguments args NameParam NameParam defaults body Pass decorator_list FunctionDef arguments args NameParam defaults body Expr Str Expr Call AttributeLoad NameLoad attr Str Str NameLoad Assign NameStore ListLoad Assign NameStore Call AttributeLoad NameLoad attr While NameLoad body Assign NameStore NameLoad Expr Call AttributeLoad NameLoad attr BinOpMod Str Call NameLoad NameLoad Str NameLoad For NameStore SubscriptLoad NameLoad Slice body Assign NameStore ListLoad Expr Call AttributeLoad NameLoad attr NameLoad For TupleStore NameStore NameStore Call AttributeLoad AttributeLoad AttributeLoad NameLoad attr attr attr body Assign NameStore Call AttributeLoad NameLoad attr NameLoad AugAssignAdd NameStore Call AttributeLoad NameLoad attr NameLoad Assign NameStore Call AttributeLoad NameLoad attr NameLoad Assign TupleStore NameStore NameStore Call AttributeLoad NameLoad attr NameLoad If BoolOpAnd NameLoad UnaryOpNot CompareIn NameLoad NameLoad body Assign NameStore Call AttributeLoad NameLoad attr NameLoad Expr Call AttributeLoad NameLoad attr TupleLoad NameLoad NameLoad Expr Call AttributeLoad NameLoad attr BinOpMod Str TupleLoad NameLoad NameLoad Str Expr Call AttributeLoad NameLoad attr AttributeLoad NameLoad attr NameLoad If CompareEq AttributeLoad NameLoad attr Str body Expr Call AttributeLoad AttributeLoad NameLoad attr attr BinOpMod Str Call AttributeLoad NameLoad attr Str Assign NameStore NameLoad Assign NameStore Call AttributeLoad NameLoad attr Break orelse Expr Call AttributeLoad AttributeLoad NameLoad attr attr AttributeLoad NameLoad attr If NameLoad body Continue Assign NameStore NameLoad Expr Call AttributeLoad NameLoad attr Expr Call AttributeLoad AttributeLoad NameLoad attr attr NameLoad decorator_list FunctionDef arguments args NameParam NameParam defaults body Assign NameStore Call AttributeLoad NameLoad attr NameLoad Assign NameStore Num Assign NameStore Num For NameStore AttributeLoad NameLoad attr body Assign NameStore Call AttributeLoad NameLoad attr NameLoad NameLoad If CompareEq NameLoad Num body AugAssignAdd NameStore Num orelse If CompareEq NameLoad Num body AugAssignAdd NameStore Num Expr Call AttributeLoad NameLoad attr BinOpMod Str TupleLoad NameLoad NameLoad NameLoad Str Return TupleLoad NameLoad NameLoad NameLoad decorator_list FunctionDef arguments args NameParam defaults body Expr Str Assign NameStore Call AttributeLoad NameLoad attr Assign NameStore Call NameLoad NameLoad Assign NameStore Call NameLoad AttributeLoad NameLoad attr Expr Call AttributeLoad NameLoad attr BinOpMod Str TupleLoad NameLoad BinOpDiv BinOpMult Num NameLoad NameLoad NameLoad Str For NameStore NameLoad body Expr Call AttributeLoad NameLoad attr NameLoad decorator_list FunctionDef arguments args NameParam defaults body Expr Str Assign NameStore ListLoad For NameStore AttributeLoad NameLoad attr body AugAssignAdd NameStore Call AttributeLoad NameLoad attr AttributeLoad NameLoad attr Return NameLoad decorator_list decorator_list ClassDef bases NameLoad body Expr Str Assign NameStore NameLoad Assign NameStore Str FunctionDef arguments args NameParam NameParam NameParam defaults Str body Assign AttributeStore NameLoad attr NameLoad Assign AttributeStore NameLoad attr NameLoad Assign AttributeStore NameLoad attr AttributeLoad AttributeLoad NameLoad attr attr Assign AttributeStore NameLoad attr AttributeLoad AttributeLoad NameLoad attr attr Expr Call AttributeLoad NameLoad attr decorator_list FunctionDef arguments args NameParam defaults body Expr Str For NameStore AttributeLoad NameLoad attr body Assign AttributeStore NameLoad attr AttributeLoad NameLoad attr decorator_list FunctionDef arguments args NameParam NameParam defaults body Expr Call AttributeLoad NameLoad attr BinOpMod Str TupleLoad Call NameLoad NameLoad AttributeLoad NameLoad attr AttributeLoad NameLoad attr Str decorator_list FunctionDef arguments args NameParam NameParam defaults body Assign TupleStore NameStore NameStore Call AttributeLoad AttributeLoad NameLoad attr attr NameLoad Return NameLoad decorator_list FunctionDef arguments args NameParam NameParam defaults body Expr Str Return Call AttributeLoad NameLoad attr NameLoad Call NameLoad AttributeLoad NameLoad attr decorator_list decorator_list ClassDef bases NameLoad body Expr Str Assign NameStore Str FunctionDef arguments args NameParam NameParam NameParam NameParam defaults Str body Assign AttributeStore NameLoad attr NameLoad Assign AttributeStore NameLoad attr NameLoad Expr Call AttributeLoad NameLoad attr Assign AttributeStore NameLoad attr AttributeLoad AttributeLoad NameLoad attr attr Assign AttributeStore NameLoad attr AttributeLoad AttributeLoad NameLoad attr attr Assign AttributeStore NameLoad attr NameLoad decorator_list FunctionDef arguments args NameParam NameParam defaults body Expr Call AttributeLoad NameLoad attr BinOpMod Str TupleLoad Call NameLoad NameLoad AttributeLoad NameLoad attr AttributeLoad NameLoad attr Str decorator_list FunctionDef arguments args NameParam NameParam defaults body Assign TupleStore NameStore NameStore Call AttributeLoad AttributeLoad NameLoad attr attr NameLoad keyword AttributeLoad AttributeLoad NameLoad attr attr Return NameLoad decorator_list FunctionDef arguments args NameParam NameParam defaults body Return Call AttributeLoad NameLoad attr NameLoad Call NameLoad AttributeLoad NameLoad attr Num decorator_list FunctionDef arguments args NameParam defaults body Expr Call AttributeLoad AttributeLoad NameLoad attr attr AttributeLoad AttributeLoad NameLoad attr attr decorator_list decorator_list ClassDef bases NameLoad body Assign NameStore NameLoad FunctionDef arguments args NameParam defaults body Expr Str Expr Call AttributeLoad AttributeLoad NameLoad attr attr AttributeLoad AttributeLoad NameLoad attr attr keyword NameLoad keyword NameLoad decorator_list FunctionDef arguments args NameParam defaults body Expr Str Assign NameStore ListLoad For NameStore AttributeLoad AttributeLoad NameLoad attr attr body AugAssignAdd NameStore ListComp NameLoad comprehension NameStore Call AttributeLoad NameLoad attr UnaryOpNot CompareIn NameLoad AttributeLoad AttributeLoad NameLoad attr attr Return NameLoad decorator_list decorator_list ClassDef bases NameLoad body Assign NameStore NameLoad FunctionDef arguments args NameParam defaults body Expr Str Expr Call AttributeLoad AttributeLoad NameLoad attr attr AttributeLoad AttributeLoad NameLoad attr attr keyword NameLoad decorator_list decorator_list
N/A N/A os N/A time N/A datetime sulci.thesaurus Trigger TriggerToDescriptor Descriptor sulci.textmining SemanticalTagger GlobalPMI sulci.rules_templates LemmatizerTemplateGenerator RuleTemplate ContextualTemplateGenerator LexicalTemplateGenerator sulci.log sulci_logger sulci config ZMQTrainer N/A object N/A N/A 
    Factorize the ZMQ configuration here.
     setup_socket_master N/A N/A self N/A N/A N/A 
        Configure the sockets for the master trainer.
         N/A zmq N/A context N/A N/A zmq Context N/A N/A self reqsocket N/A N/A context socket N/A zmq XREQ N/A N/A N/A N/A self reqsocket bind ipc:///tmp/sulci.action N/A N/A self pubsocket N/A N/A context socket N/A zmq PUB N/A N/A N/A N/A self pubsocket bind ipc:///tmp/sulci.apply N/A setup_socket_slave N/A N/A self N/A N/A N/A 
        Configure sockets for the workers (slaves).
         N/A zmq N/A context N/A N/A zmq Context N/A N/A self repsocket N/A N/A context socket N/A zmq XREP N/A N/A N/A N/A self repsocket connect ipc:///tmp/sulci.action N/A N/A self subsocket N/A N/A context socket N/A zmq SUB N/A N/A N/A N/A self subsocket connect ipc:///tmp/sulci.apply N/A N/A N/A N/A self subsocket setsockopt N/A zmq SUBSCRIBE N/A N/A self subpoller N/A N/A zmq Poller N/A N/A N/A N/A self subpoller register N/A self subsocket N/A zmq POLLIN N/A N/A ContentBaseTrainer N/A ZMQTrainer N/A N/A 
    Factorize here the training based on content processing (articles...).
     do N/A N/A self N/A args kwargs N/A N/A N/A N/A N/A N/A self mode slave N/A N/A N/A N/A self slave N/A N/A N/A N/A self master kwargs N/A N/A N/A KeyboardInterrupt N/A N/A N/A N/A self stop N/A master N/A N/A self N/A kwargs N/A N/A t_init N/A N/A time time N/A N/A N/A self mode master N/A N/A N/A N/A self setup_socket_master N/A MASTER -- ready N/A start N/A N/A kwargs get start None N/A qs N/A N/A config content_model_pks_for_trainer start start N/A step 1000 N/A forloop_remaining total N/A len qs N/A loop N/A range N/A N/A N/A len qs step 1 N/A N/A _from N/A loop step N/A _to N/A _from step N/A current_qs N/A qs N/A _from _to N/A N/A MASTER -- Processing qs from %d to %d N/A _from _to N/A pk current_qs N/A N/A N/A N/A self mode master N/A N/A N/A N/A N/A self reqsocket send_multipart N/A N/A str pk N/A N/A N/A N/A self train pk N/A N/A N/A self mode master N/A N/A idx current_qs N/A N/A status N/A N/A N/A self reqsocket recv N/A forloop_remaining 1 N/A t_now N/A N/A time time N/A t_diff N/A t_now t_init N/A average N/A t_diff N/A total forloop_remaining N/A time_remaining N/A average forloop_remaining N/A ETA N/A N/A N/A N/A datetime datetime now N/A N/A datetime timedelta seconds time_remaining N/A N/A MASTER -- %s -- %s remaining to process -- Avg: %s s -- ETA : %s N/A status forloop_remaining N/A round average 2 N/A N/A ETA strftime %a %d %R N/A N/A N/A self stop N/A stop N/A N/A self N/A N/A N/A N/A N/A self mode master N/A N/A 
MASTER -- Sending stop order N/A N/A N/A N/A self pubsocket send  stop N/A slave N/A N/A self N/A N/A N/A N/A N/A self setup_socket_slave N/A N/A SLAVE %s -- ready N/A N/A os getpid N/A True N/A N/A N/A N/A N/A self subpoller poll 0 N/A N/A action N/A N/A N/A N/A self subsocket recv N/A 1 N/A N/A action stop N/A N/A N/A SLAVE %s -- Stopping due to stop order received N/A N/A os getpid N/A N/A N/A idx pk N/A N/A N/A self repsocket recv_multipart N/A N/A SLAVE %s processing pk %s N/A N/A N/A os getpid pk N/A t_before N/A N/A time time N/A N/A N/A self train pk N/A tot_time N/A N/A N/A time time t_before N/A N/A N/A N/A self repsocket send_multipart N/A idx N/A Processed pk %s (%s s) N/A pk N/A round tot_time 2 N/A N/A SemanticalTrainer N/A ContentBaseTrainer N/A N/A 
    Create and update triggers. And make TriggerToDescriptor ponderation.
     N/A PENDING_EXT .pdg N/A VALID_EXT .trg __init__ N/A N/A self thesaurus pos_tagger mode N/A full N/A N/A N/A self thesaurus thesaurus N/A N/A self pos_tagger pos_tagger N/A N/A self mode mode N/A train N/A N/A self inst N/A N/A N/A 
        For the moment, human defined descriptors are a string with "," separator.
         N/A N/A isinstance inst N/A int str N/A N/A inst N/A N/A config content_model_getter inst N/A text N/A getattr inst N/A config SULCI_CONTENT_PROPERTY N/A descriptors N/A N/A config descriptors_getter inst N/A N/A N/A descriptors N/A text N/A N/A N/A N/A sulci_logger info Skipping item without data N/A N/A validated_descriptors N/A set N/A d descriptors N/A N/A N/A d N/A N/A N/A N/A dsc created N/A N/A Descriptor get_or_connect name d N/A N/A N/A N/A dsc count hincrby 1 N/A N/A N/A validated_descriptors add dsc N/A created N/A N/A N/A N/A sulci_logger info N/A Lairning descriptor not in thesaurus : %s N/A unicode dsc RED N/A N/A N/A S N/A SemanticalTagger text thesaurus N/A self thesaurus pos_tagger N/A self pos_tagger lexicon N/A N/A self pos_tagger lexicon N/A N/A N/A S deduplicate_keyentities N/A N/A N/A ValueError N/A N/A N/A current_triggers N/A set N/A ke N/A S keyentities N/A N/A N/A t created N/A N/A Trigger get_or_connect original N/A unicode ke N/A N/A N/A current_triggers add t N/A N/A N/A N/A t count hincrby 1 N/A d validated_descriptors N/A N/A t current_triggers N/A N/A N/A N/A t connect d 1 N/A clean_connections N/A N/A self N/A N/A N/A 
        Delete all the connection where score < 0.
         N/A N/A N/A TriggerToDescriptor clean_all_connections N/A N/A GlobalPMITrainer N/A ContentBaseTrainer N/A N/A 
    Create and update the global PMI data.
     __init__ N/A N/A self thesaurus pos_tagger mode N/A full N/A N/A N/A self thesaurus thesaurus N/A N/A self pos_tagger pos_tagger N/A N/A self mode mode N/A N/A self global_pmi N/A N/A GlobalPMI get corpus N/A config DEFAULT_DATABASE N/A train N/A N/A self inst N/A N/A N/A N/A isinstance inst N/A int str N/A N/A inst N/A N/A config content_model_getter inst N/A text N/A getattr inst N/A config SULCI_CONTENT_PROPERTY N/A N/A N/A S N/A SemanticalTagger text thesaurus N/A self thesaurus pos_tagger N/A self pos_tagger lexicon N/A N/A self pos_tagger lexicon N/A N/A N/A S deduplicate_keyentities N/A N/A N/A ValueError N/A N/A N/A ngrams N/A N/A S ngrams min_length 1 max_length 5 N/A N/A key values N/A N/A ngrams iteritems N/A N/A N/A N/A N/A self global_pmi add_ngram N/A values N/A stemms amount N/A values N/A count N/A N/A RuleTrainer N/A ZMQTrainer N/A N/A 
    Main trainer class for rules based, for factorisation.
     do N/A N/A self N/A N/A N/A N/A N/A self mode slave N/A N/A N/A N/A self slave N/A N/A N/A N/A self mode master N/A N/A N/A N/A self setup_socket_master N/A N/A N/A self train N/A N/A N/A N/A self pubsocket send  stop N/A N/A N/A N/A self train N/A slave N/A N/A self N/A N/A N/A N/A N/A self setup_socket_slave N/A True N/A N/A N/A N/A N/A self subpoller poll 0 N/A N/A rule N/A N/A N/A N/A self subsocket recv N/A 1 N/A N/A rule stop N/A N/A N/A rule N/A N/A rule decode utf-8 N/A template N/A N/A self get_template_instance rule N/A N/A N/A sulci_logger info N/A Applying rule %s rule RED N/A N/A N/A template apply_rule N/A self tokens rule N/A N/A N/A N/A self reppoller poll 0 N/A N/A N/A idx action rule N/A N/A N/A self repsocket recv_multipart N/A N/A _ good bad N/A N/A self test_rule N/A N/A rule decode utf-8 N/A N/A N/A N/A self repsocket send_multipart N/A idx rule N/A str good N/A str bad N/A test_rules N/A N/A self rules_candidates N/A N/A N/A pondered_rules N/A N/A N/A N/A self mode master N/A N/A rule rules_candidates N/A N/A N/A N/A N/A self reqsocket send_multipart N/A check N/A N/A rule encode utf-8 N/A rule rules_candidates N/A N/A resp N/A N/A N/A self reqsocket recv_multipart N/A N/A r good bad resp N/A N/A N/A pondered_rules append N/A N/A N/A r decode utf-8 N/A int good N/A int bad N/A N/A N/A sulci_logger info N/A Received rule %s N/A N/A r decode utf-8 MAGENTA N/A N/A N/A sulci_logger info All rules are received from slaves N/A N/A rule rules_candidates N/A N/A N/A N/A pondered_rules append N/A N/A self test_rule rule N/A pondered_rules N/A pretrain N/A N/A self N/A N/A N/A 
        Trainer specific training session preparation.
         N/A N/A log_error N/A N/A self token N/A N/A N/A N/A get_template_instance N/A N/A self tpl N/A N/A N/A N/A select_one_rule N/A N/A self rules N/A N/A N/A N/A train N/A N/A self N/A N/A N/A 
        Main factorized train method.
         N/A N/A N/A sulci_logger info Begin of training session. WHITE True N/A final_rules N/A N/A errors N/A N/A self get_errors N/A errors N/A N/A run_applied_rule False N/A N/A N/A sulci_logger info N/A %d errors for now... N/A len errors RED True N/A token_with_error N/A errors N/A N/A N/A rules_candidates N/A N/A N/A N/A self log_error token_with_error N/A N/A tpl _ N/A N/A N/A N/A self template_generator register items N/A N/A template N/A N/A self get_template_instance tpl N/A rules_candidates N/A N/A template make_rules token_with_error N/A pondered_rules N/A N/A self test_rules rules_candidates N/A N/A rule_candidate score N/A N/A self select_one_rule pondered_rules N/A N/A rule_candidate N/A N/A rule_candidate final_rules N/A N/A template N/A N/A self get_template_instance rule_candidate N/A N/A N/A final_rules append N/A rule_candidate score N/A N/A N/A sulci_logger info N/A Applying rule %s (%s) N/A rule_candidate score RED N/A N/A N/A template apply_rule N/A self tokens rule_candidate N/A N/A N/A self mode master N/A N/A N/A N/A N/A self pubsocket send N/A  %s N/A N/A rule_candidate encode utf-8 N/A run_applied_rule True N/A errors N/A N/A self get_errors N/A N/A N/A N/A N/A N/A token_with_error sample set_trained_position N/A token_with_error position N/A run_applied_rule N/A N/A N/A errors None N/A N/A N/A self display_errors N/A N/A N/A N/A self template_generator export final_rules N/A test_rule N/A N/A self rule N/A N/A N/A template N/A N/A self get_template_instance rule N/A bad 0 N/A good 0 N/A ttk N/A self tokens N/A N/A test N/A N/A template test_rule ttk rule N/A N/A test 1 N/A N/A good 1 N/A N/A N/A test -1 N/A N/A bad 1 N/A N/A N/A sulci_logger info N/A %s g: %d b : %d N/A rule good bad GRAY N/A N/A rule good bad N/A display_errors N/A N/A self N/A N/A N/A 
        Display errors in current step.
         N/A remaining_errors N/A N/A self get_errors N/A errors_count N/A len remaining_errors N/A total_words N/A len N/A self tokens N/A N/A N/A sulci_logger info N/A Remaining %d errors (%f %% of %d total words) N/A errors_count N/A N/A 100.0 errors_count total_words total_words RED N/A r_error remaining_errors N/A N/A N/A N/A self log_error r_error N/A get_errors N/A N/A self N/A N/A N/A 
        Retrieve token where tag !== verified_tag.
         N/A final N/A N/A sample N/A self samples N/A N/A final N/A N/A sample get_errors N/A self attr_name N/A final N/A N/A LemmatizerTrainer N/A RuleTrainer N/A N/A 
    Train the Lemmatizer.
     N/A template_generator LemmatizerTemplateGenerator N/A attr_name lemme __init__ N/A N/A self lemmatizer mode N/A full N/A N/A N/A self lemmatizer lemmatizer N/A N/A self mode mode N/A N/A self tokens N/A N/A self lemmatizer tokens N/A N/A self samples N/A N/A self lemmatizer samples N/A N/A N/A self pretrain N/A pretrain N/A N/A self N/A N/A N/A 
        We need to have the right tags, here
         N/A token N/A self tokens N/A N/A N/A token tag N/A token verified_tag N/A log_error N/A N/A self token N/A N/A N/A N/A N/A sulci_logger info N/A Error : %s, lemmatized %s instead of %s N/A N/A unicode token N/A token lemme N/A token verified_lemme WHITE N/A get_template_instance N/A N/A self tpl N/A N/A N/A N/A template _ N/A N/A N/A self template_generator get_instance tpl N/A template N/A select_one_rule N/A N/A self rules N/A N/A N/A 
        Having a set of rules candidate for correcting some error, select the
        one correcting the more case, and creating the less errors.
         N/A N/A N/A RuleTemplate select_one rules N/A len N/A self tokens N/A N/A POSTrainer N/A RuleTrainer N/A N/A 
    Pos Tagger trainer.
     N/A attr_name tag __init__ N/A N/A self tagger corpus mode N/A full N/A N/A N/A self tagger tagger N/A N/A self corpus corpus N/A N/A N/A self pretrain N/A N/A self tokens N/A N/A self corpus tokens N/A N/A self samples N/A N/A self corpus samples N/A N/A self mode mode N/A log_error N/A N/A self token N/A N/A N/A N/A N/A sulci_logger info N/A Error : %s, tagged %s instead of %s N/A N/A unicode token N/A token tag N/A token verified_tag WHITE N/A get_template_instance N/A N/A self tpl N/A N/A N/A N/A template _ N/A N/A N/A self template_generator get_instance tpl lexicon N/A N/A self tagger lexicon N/A template N/A select_one_rule N/A N/A self rules N/A N/A N/A N/A N/A RuleTemplate select_one rules N/A len N/A self corpus 3 N/A pretrain N/A N/A self N/A N/A N/A N/A N/A N/A self tagger tag_all N/A N/A self corpus tokens N/A N/A LexicalTrainer N/A POSTrainer N/A N/A template_generator LexicalTemplateGenerator pretrain N/A N/A self N/A N/A N/A 
        Tag the tokens, but not using POS rules, as we are training it.
         N/A N/A N/A N/A self tagger tag_all N/A N/A self corpus tokens lexical False contextual False N/A get_errors N/A N/A self N/A N/A N/A 
        We don't care about token in Lexicon, for lexical trainer.
         N/A final N/A N/A sample N/A N/A self corpus samples N/A N/A final N/A t N/A t N/A N/A sample get_errors N/A N/A t N/A N/A self tagger lexicon N/A final N/A N/A ContextualTrainer N/A POSTrainer N/A N/A template_generator ContextualTemplateGenerator pretrain N/A N/A self N/A N/A N/A 
        Tag the tokens, but not using the contextual rules, as we are training it.
         N/A N/A N/A N/A self tagger tag_all N/A N/A self corpus tokens contextual False N/A N/A