Module ImportFrom alias Import alias Import alias alias Import alias Import alias identifier Import alias ImportFrom alias Import alias identifier ImportFrom alias Expr Call AttributeLoad NameLoad attr keyword Str keyword AttributeLoad NameLoad attr Assign NameStore Call AttributeLoad NameLoad attr Str FunctionDef arguments args NameParam NameParam defaults body Assign NameStore Call AttributeLoad AttributeLoad NameLoad attr attr AttributeLoad NameLoad attr Assign NameStore Call AttributeLoad NameLoad attr NameLoad Return Call AttributeLoad AttributeLoad NameLoad attr attr NameLoad NameLoad decorator_list Expr Call AttributeLoad NameLoad attr Str NameLoad FunctionDef arguments args NameParam defaults body Assign NameStore Call AttributeLoad NameLoad attr SubscriptLoad NameLoad Index Str Print Str NameLoad Expr Call AttributeLoad NameLoad attr BinOpAdd Str Call NameLoad Call NameLoad NameLoad Assign NameStore SubscriptLoad NameLoad Index Str Expr Call AttributeLoad NameLoad attr Str Assign NameStore Call AttributeLoad NameLoad attr SubscriptLoad NameLoad Index Str Expr Call AttributeLoad NameLoad attr Str Assign NameStore Call AttributeLoad NameLoad attr NameLoad NameLoad keyword NameLoad Expr Call AttributeLoad NameLoad attr Str Assign NameStore Call AttributeLoad NameLoad attr SubscriptLoad NameLoad Index Str Assign NameStore Call AttributeLoad NameLoad attr NameLoad ListLoad NameLoad Assign NameStore SubscriptLoad SubscriptLoad NameLoad Index Str Index Str Expr Call AttributeLoad NameLoad attr Str Assign NameStore Call AttributeLoad NameLoad attr NameLoad keyword NameLoad Assign NameStore Call AttributeLoad NameLoad attr NameLoad keyword NameLoad Expr Call AttributeLoad NameLoad attr NameLoad NameLoad Assert CompareEq Call NameLoad Call AttributeLoad NameLoad attr Call NameLoad Call AttributeLoad NameLoad attr Assign NameStore Dict Str Str Num Num Assign NameStore Call AttributeLoad NameLoad attr NameLoad Assign NameStore DictComp NameLoad Call AttributeLoad NameLoad attr ListComp SubscriptLoad NameLoad Index NameLoad comprehension NameStore NameLoad comprehension TupleStore NameStore NameStore Call AttributeLoad NameLoad attr Assign NameStore Call AttributeLoad NameLoad attr NameLoad NameLoad Assign NameStore Call AttributeLoad NameLoad attr NameLoad Assign NameStore Call AttributeLoad NameLoad attr SubscriptLoad NameLoad Index Str Expr Call AttributeLoad NameLoad attr Str Assign NameStore Call AttributeLoad NameLoad attr NameLoad NameLoad keyword NameLoad Expr Call AttributeLoad NameLoad attr Str Assign NameStore Call AttributeLoad NameLoad attr NameLoad NameLoad keyword NameLoad Assign NameStore Call AttributeLoad NameLoad attr Call AttributeLoad NameLoad attr Expr Call AttributeLoad NameLoad attr Call AttributeLoad NameLoad attr Call AttributeLoad NameLoad attr Assign NameStore Call AttributeLoad NameLoad attr NameLoad Assign NameStore DictComp NameLoad ListComp Call AttributeLoad NameLoad attr NameLoad NameLoad comprehension NameStore NameLoad comprehension TupleStore NameStore NameStore Call AttributeLoad NameLoad attr Assign NameStore DictComp NameLoad ListComp Call AttributeLoad NameLoad attr NameLoad NameLoad comprehension NameStore NameLoad comprehension TupleStore NameStore NameStore Call AttributeLoad NameLoad attr Assign NameStore Call AttributeLoad NameLoad attr SubscriptLoad SubscriptLoad SubscriptLoad NameLoad Index Str Index Str Index Str Assign NameStore Call AttributeLoad NameLoad attr NameLoad NameLoad NameLoad Expr Call AttributeLoad NameLoad attr Str Assign NameStore Dict For TupleStore NameStore NameStore Call AttributeLoad NameLoad attr body TryExcept body Assign NameStore SubscriptLoad NameLoad Index NameLoad Assign NameStore Call AttributeLoad NameLoad attr NameLoad Assign SubscriptStore NameLoad Index NameLoad NameLoad handlers ExceptHandler type NameLoad name NameStore body Print BinOpAdd NameLoad Str Raise Assign NameStore Dict For TupleStore NameStore NameStore Call AttributeLoad NameLoad attr body Expr Call AttributeLoad NameLoad attr BinOpAdd Str NameLoad Assign NameStore SubscriptLoad NameLoad Index NameLoad Print Str NameLoad Print Str NameLoad Expr Call AttributeLoad NameLoad attr BinOpAdd Str Call NameLoad Call NameLoad NameLoad Assign SubscriptStore NameLoad Index NameLoad Call NameLoad NameLoad NameLoad Expr Call AttributeLoad NameLoad attr Str Print NameLoad decorator_list If CompareEq NameLoad Str body Assign NameStore Call NameLoad Expr Call AttributeLoad NameLoad attr Str keyword Str keyword Str Assign NameStore Call AttributeLoad NameLoad attr Assign NameStore Dict Assign NameStore AttributeLoad NameLoad attr With Call NameLoad NameLoad Str NameStore body Assign NameStore Call AttributeLoad NameLoad attr Call AttributeLoad NameLoad attr Expr Call NameLoad NameLoad
N/A argparse ArgumentParser N/A yaml N/A os sys N/A logging N/A numpy np N/A marmot marmot.experiment learning_utils N/A marmot.experiment.experiment_utils experiment_utils marmot.evaluation.evaluation_metrics weighted_fmeasure N/A N/A N/A logging basicConfig format %(asctime)s : %(levelname)s : %(message)s level N/A logging INFO N/A logger N/A N/A logging getLogger testlogger join_with_module_path N/A N/A loader node N/A N/A N/A module_path N/A N/A N/A os path dirname N/A marmot __file__ N/A resolved N/A N/A loader construct_scalar node N/A N/A N/A N/A os path join module_path resolved N/A N/A N/A N/A yaml add_constructor !join join_with_module_path main N/A N/A config N/A N/A N/A interesting_tokens N/A N/A experiment_utils import_and_call_function N/A config N/A interesting_tokens N/A INTERESTING TOKENS:  interesting_tokens N/A N/A N/A logger info N/A The number of interesting tokens is:  N/A str N/A len interesting_tokens N/A workers N/A config N/A workers N/A N/A N/A logger info building the context creators... N/A train_context_creators N/A N/A experiment_utils build_objects N/A config N/A context_creators N/A N/A N/A logger info mapping the training contexts over the interesting tokens in train... N/A train_contexts N/A N/A experiment_utils map_contexts interesting_tokens train_context_creators workers workers N/A N/A N/A logger info mapping the training contexts over the interesting tokens in test... N/A test_context_creator N/A N/A experiment_utils build_objects N/A config N/A testing N/A test_contexts N/A N/A experiment_utils map_contexts interesting_tokens N/A test_context_creator N/A min_total N/A N/A config N/A filters N/A min_total N/A N/A N/A logger info filtering the contexts by the total number of available instances... N/A train_contexts N/A N/A experiment_utils filter_contexts train_contexts min_total min_total N/A test_contexts N/A N/A experiment_utils filter_contexts test_contexts min_total min_total N/A N/A N/A experiment_utils sync_keys train_contexts test_contexts N/A N/A N/A set N/A N/A test_contexts keys N/A set N/A N/A train_contexts keys N/A wmt_binary_classes N/A BAD OK 0 1 N/A train_context_tags N/A N/A experiment_utils tags_from_contexts train_contexts N/A train_context_tags N/A k N/A N/A np array N/A N/A wmt_binary_classes N/A v N/A v val N/A N/A k val N/A N/A train_context_tags items N/A test_contexts N/A N/A experiment_utils convert_tagset wmt_binary_classes test_contexts N/A test_tags_actual N/A N/A experiment_utils tags_from_contexts test_contexts N/A feature_extractors N/A N/A experiment_utils build_feature_extractors N/A config N/A feature_extractors N/A N/A N/A logger info mapping the feature extractors over the contexts for test... N/A test_context_features N/A N/A experiment_utils token_contexts_to_features_categorical test_contexts feature_extractors workers workers N/A N/A N/A logger info mapping the feature extractors over the contexts for train... N/A train_context_features N/A N/A experiment_utils token_contexts_to_features_categorical train_contexts feature_extractors workers workers N/A all_values N/A N/A experiment_utils flatten N/A N/A test_context_features values N/A N/A N/A all_values extend N/A N/A experiment_utils flatten N/A N/A train_context_features values N/A binarizers N/A N/A experiment_utils fit_binarizers all_values N/A test_context_features N/A k N/A N/A N/A experiment_utils binarize v binarizers N/A v val N/A N/A k val N/A N/A test_context_features items N/A train_context_features N/A k N/A N/A N/A experiment_utils binarize v binarizers N/A v val N/A N/A k val N/A N/A train_context_features items N/A classifier_type N/A N/A experiment_utils import_class N/A N/A N/A config N/A learning N/A classifier N/A module N/A classifier_map N/A N/A learning_utils token_classifiers train_context_features train_context_tags classifier_type N/A N/A N/A logger info classifying the test instances N/A test_predictions N/A N/A N/A key features N/A N/A test_context_features iteritems N/A N/A N/A N/A classifier N/A classifier_map N/A key N/A predictions N/A N/A classifier predict features N/A N/A test_predictions N/A key predictions N/A N/A N/A KeyError N/A e N/A N/A N/A key  - is NOT in the classifier map N/A N/A f1_map N/A N/A N/A token predicted N/A N/A test_predictions iteritems N/A N/A N/A N/A logger info N/A Evaluating results for token =  token N/A actual N/A test_tags_actual N/A token N/A Actual:  actual N/A Predicted:  predicted N/A N/A N/A logger info N/A 	total instances:  N/A str N/A len predicted N/A N/A f1_map N/A token N/A weighted_fmeasure actual predicted N/A N/A N/A logger info Printing the map of f1 scores by token:  N/A f1_map N/A N/A N/A __name__ __main__ N/A N/A parser N/A ArgumentParser N/A N/A N/A parser add_argument configuration_file action store help path to the config file (in YAML format). N/A args N/A N/A parser parse_args N/A config N/A N/A cfg_path N/A args configuration_file N/A N/A open cfg_path r cfg_file N/A N/A config N/A N/A yaml load N/A N/A cfg_file read N/A N/A main config