Module ImportFrom alias ImportFrom alias alias ImportFrom alias alias alias alias alias alias Import alias alias ImportFrom alias ImportFrom alias Assign NameStore Call NameLoad Str Assign NameStore Call NameLoad keyword Str Assign NameStore Call NameLoad Assign NameStore Call NameLoad keyword Str Assign NameStore Call NameLoad NameLoad keyword NameLoad Assign NameStore Call NameLoad Assign NameStore Call NameLoad Assign NameStore Call NameLoad Assign NameStore Call NameLoad Call AttributeLoad NameLoad attr Assign NameStore BinOpAdd SubscriptLoad NameLoad Slice Num SubscriptLoad NameLoad Slice Num Num Assign NameStore Call NameLoad Call AttributeLoad NameLoad attr Assign NameStore BinOpAdd SubscriptLoad NameLoad Slice Num SubscriptLoad NameLoad Slice Num Num Assign NameStore ListLoad FunctionDef arguments args NameParam NameParam defaults body Assign NameStore ListLoad Assign NameStore Num For NameStore NameLoad body If CompareIs Call NameLoad NameLoad NameLoad body Assign NameStore Call AttributeLoad NameLoad attr orelse Assign NameStore ListLoad NameLoad Assign NameStore Str For NameStore Call NameLoad NameLoad BinOpAdd NameLoad Call NameLoad NameLoad body Assign NameStore Str Assign NameStore BinOpSub NameLoad NameLoad Assign NameStore SubscriptLoad SubscriptLoad NameLoad Index NameLoad Index Num Assign NameStore SubscriptLoad SubscriptLoad NameLoad Index NameLoad Index Num If BoolOpAnd CompareIs Call NameLoad NameLoad NameLoad CompareEq NameLoad Num body Assign NameStore BinOpAdd Str Call AttributeLoad NameLoad attr orelse If CompareIs Call NameLoad NameLoad NameLoad body Assign NameStore BinOpAdd Str Call AttributeLoad NameLoad attr For NameStore SubscriptLoad NameLoad Index Num body If CompareIn NameLoad NameLoad body If CompareEq NameLoad SubscriptLoad NameLoad Index Num body Assign NameStore Str orelse Assign NameStore Str For NameStore SubscriptLoad NameLoad Index Num body If BoolOpAnd CompareEq NameLoad Str CompareIn NameLoad NameLoad body If CompareEq NameLoad SubscriptLoad NameLoad Index Num body Assign NameStore Str orelse Assign NameStore Str For NameStore SubscriptLoad NameLoad Index Num body If BoolOpAnd CompareEq NameLoad Str CompareIn NameLoad NameLoad body If CompareEq NameLoad SubscriptLoad NameLoad Index Num body Assign NameStore Str orelse Assign NameStore Str Expr Call AttributeLoad NameLoad attr TupleLoad NameLoad NameLoad NameLoad NameLoad AugAssignAdd NameStore Call NameLoad NameLoad Return NameLoad decorator_list FunctionDef arguments args NameParam NameParam defaults body Assign NameStore ListLoad For NameStore NameLoad body Assign NameStore ListLoad Assign NameStore Call AttributeLoad Call AttributeLoad NameLoad attr attr NameLoad If CompareGtE NameLoad Num body Assign NameStore Call AttributeLoad NameLoad attr For NameStore Call NameLoad Call NameLoad NameLoad body AugAssignSub NameStore BinOpAdd Call NameLoad SubscriptLoad NameLoad Index NameLoad Num If CompareLt NameLoad Num body For NameStore Call NameLoad NameLoad BinOpAdd NameLoad Call NameLoad Call AttributeLoad NameLoad attr body Expr Call AttributeLoad NameLoad attr NameLoad Break Expr Call AttributeLoad NameLoad attr NameLoad Return NameLoad decorator_list FunctionDef arguments args NameParam defaults Str body Expr Str Assign NameStore Call AttributeLoad Call AttributeLoad NameLoad attr NameLoad Str keyword Str attr Assign NameStore ListLoad Assign NameStore ListLoad For NameStore NameLoad body Assign NameStore Call AttributeLoad NameLoad attr If CompareEq NameLoad Str body Expr Call AttributeLoad NameLoad attr NameLoad Assign NameStore ListLoad orelse Expr Call AttributeLoad NameLoad attr Call NameLoad Call AttributeLoad NameLoad attr Str Return NameLoad decorator_list FunctionDef arguments args NameParam NameParam NameParam defaults body Assign NameStore TupleLoad ListLoad ListLoad ListLoad For NameStore NameLoad body Assign NameStore Call NameLoad NameLoad NameLoad For NameStore Call NameLoad Num body If CompareNotIn SubscriptLoad NameLoad Index NameLoad SubscriptLoad NameLoad Index NameLoad body Expr Call AttributeLoad SubscriptLoad NameLoad Index NameLoad attr SubscriptLoad NameLoad Index NameLoad Return Call NameLoad NameLoad NameLoad decorator_list Assign NameStore Num Assign NameStore Num Assign NameStore BinOpAdd Call NameLoad Str Call NameLoad Str Assign NameStore ListLoad Assign NameStore ListLoad For NameStore NameLoad body Expr Call AttributeLoad NameLoad attr ListComp NameLoad comprehension TupleStore NameStore NameStore NameStore NameStore NameLoad Assign NameStore ListLoad Assign NameStore ListLoad For TupleStore NameStore NameStore Call NameLoad NameLoad body Assign NameStore Call AttributeLoad Str attr SubscriptLoad NameLoad Index NameLoad Assign NameStore SubscriptLoad NameLoad Index NameLoad Assign NameStore SubscriptLoad NameLoad Index NameLoad Assign NameStore Call NameLoad Call AttributeLoad NameLoad attr NameLoad Assign NameStore Call NameLoad Call AttributeLoad NameLoad attr NameLoad Assign NameStore ListComp TupleLoad NameLoad NameLoad comprehension TupleStore NameStore NameStore NameStore NameStore NameLoad Assign NameStore ListComp TupleLoad NameLoad NameLoad comprehension TupleStore NameStore NameStore NameStore NameStore ListComp NameLoad comprehension NameStore Call NameLoad NameLoad NameLoad NameLoad Assign NameStore ListComp TupleLoad NameLoad NameLoad comprehension TupleStore NameStore NameStore NameStore NameStore ListComp NameLoad comprehension NameStore Call NameLoad NameLoad NameLoad NameLoad If CompareEq Call NameLoad NameLoad Call NameLoad NameLoad body Expr Call AttributeLoad NameLoad attr NameLoad Expr Call AttributeLoad NameLoad attr NameLoad Expr Call AttributeLoad NameLoad attr NameLoad orelse Print NameLoad Print TupleLoad Print BinOpMod Str Call NameLoad Call NameLoad NameLoad ListLoad Call NameLoad NameLoad ListLoad Print BinOpMod Str Call NameLoad Call NameLoad NameLoad ListLoad Call NameLoad NameLoad ListLoad Assign NameStore Call NameLoad keyword Str Print Call AttributeLoad NameLoad attr NameLoad
N/A hazm DadeganReader baaz ChunkTreeInformationExtractor DependencyTreeInformationExtractor hazm Chunker Normalizer SequencePOSTagger IOBTagger DependencyParser Lemmatizer N/A codecs re nltk accuracy nltk.tree Tree N/A dadegan N/A DadeganReader resources/Dadegan/test.conll N/A tagger N/A SequencePOSTagger model Resources/postagger-remove-w3-all.model N/A lemmatizer N/A Lemmatizer N/A chunker N/A Chunker model Resources/chunker-dadeganFull.model N/A parser N/A DependencyParser tagger lemmatizer lemmatizer N/A normalizer N/A Normalizer N/A chunk_extractor N/A ChunkTreeInformationExtractor N/A dep_extractor N/A DependencyTreeInformationExtractor N/A trees N/A list N/A N/A dadegan chunked_trees N/A chunk_trees N/A N/A trees N/A 100 N/A trees N/A 200 300 N/A trees N/A list N/A N/A dadegan trees N/A dep_trees N/A N/A trees N/A 100 N/A trees N/A 200 300 N/A indices N/A tag_sent N/A N/A chunks args N/A N/A N/A tagged_sent N/A N/A global_index 0 N/A chunk chunks N/A N/A N/A N/A type chunk Tree N/A N/A tokens N/A N/A chunk leaves N/A N/A tokens N/A chunk N/A chunk_label O N/A c N/A range global_index N/A global_index N/A len tokens N/A N/A info_label O N/A local_index N/A c global_index N/A word N/A N/A tokens N/A local_index N/A 0 N/A tag N/A N/A tokens N/A local_index N/A 1 N/A N/A N/A N/A type chunk Tree N/A local_index 0 N/A N/A chunk_label N/A B- N/A N/A chunk label N/A N/A N/A N/A type chunk Tree N/A N/A chunk_label N/A I- N/A N/A chunk label N/A arg1 N/A args N/A 0 N/A N/A N/A c arg1 N/A N/A N/A c N/A arg1 N/A 0 N/A N/A info_label B-Arg1 N/A N/A info_label I-Arg1 N/A arg2 N/A args N/A 1 N/A N/A N/A N/A info_label O N/A c arg2 N/A N/A N/A c N/A arg2 N/A 0 N/A N/A info_label B-Arg2 N/A N/A info_label I-Arg2 N/A rel N/A args N/A 2 N/A N/A N/A N/A info_label O N/A c rel N/A N/A N/A c N/A rel N/A 0 N/A N/A info_label B-Rel N/A N/A info_label I-Rel N/A N/A N/A tagged_sent append N/A word tag chunk_label info_label N/A global_index N/A len tokens N/A tagged_sent N/A positions N/A N/A info sent N/A N/A N/A info_list N/A N/A arg info N/A N/A arg_list N/A N/A index N/A N/A N/A N/A sent strip find arg N/A N/A index 0 N/A N/A tokens N/A N/A sent split N/A i N/A range N/A len tokens N/A N/A index N/A N/A len N/A tokens N/A i 1 N/A N/A index 0 N/A N/A c N/A range i N/A i N/A len N/A N/A arg split N/A N/A N/A N/A arg_list append c N/A N/A N/A N/A info_list append arg_list N/A info_list N/A gold_IOB_sents N/A N/A filename N/A 200DadeganSents.txt N/A N/A 
	gold = []
	lines = codecs.open(filename, 'r', encoding='utf8').readlines()
	informations = []
	for line in lines:
		if len(re.findall(r'^\d+-', line)) == 0:
			if len(line) > 1:
				informations.append(line.replace('
', '').split(' + '))
			else:
				gold.append(info2iob(sentences[number], chunk_trees[number], informations))
				informations = []
		else:
			number = int(re.findall(r'^\d+-', line)[0][:-1])
			indices.append(number)
	 N/A lines N/A N/A N/A N/A codecs open filename r encoding utf8 readlines N/A gold N/A N/A sentence N/A N/A line lines N/A N/A line N/A N/A line strip N/A N/A line N/A N/A N/A N/A gold append sentence N/A sentence N/A N/A N/A N/A N/A sentence append N/A tuple N/A N/A line split N/A gold N/A info2iob N/A N/A sentence chunks informations N/A N/A N/A info_list N/A N/A N/A N/A N/A information informations N/A N/A temp_list N/A positions information sentence N/A i N/A range 3 N/A N/A N/A N/A temp_list N/A i N/A info_list N/A i N/A N/A N/A N/A N/A info_list N/A i append N/A temp_list N/A i N/A N/A tag_sent chunks info_list N/A N/A corrects 0 N/A total 0 N/A gold N/A N/A gold_IOB_sents Resources/Dadegan-pages/001.tsv N/A gold_IOB_sents Resources/Dadegan-pages/003.tsv N/A sentences N/A N/A evaluation_sents N/A N/A gold_sent gold N/A N/A N/A N/A sentences append N/A w N/A N/A w t c l gold_sent N/A dep_tagged_sents N/A N/A chunk_tagged_sents N/A N/A N/A number gold_sent N/A enumerate gold N/A N/A sentence N/A N/A join N/A sentences N/A number N/A chunk_tree N/A chunk_trees N/A number N/A dep_tree N/A dep_trees N/A number N/A chunk_informations N/A list N/A N/A chunk_extractor extract chunk_tree N/A dep_informations N/A list N/A N/A dep_extractor extract dep_tree N/A evaluation_sent N/A N/A w l N/A N/A w t c l gold_sent N/A dep_tagged_sent N/A N/A w l N/A N/A w t c l N/A tokens N/A tokens N/A info2iob sentence chunk_tree dep_informations N/A chunk_tagged_sent N/A N/A w l N/A N/A w t c l N/A tokens N/A tokens N/A info2iob sentence chunk_tree chunk_informations N/A N/A N/A len evaluation_sent N/A len dep_tagged_sent N/A N/A N/A N/A evaluation_sents append evaluation_sent N/A N/A N/A dep_tagged_sents append dep_tagged_sent N/A N/A N/A chunk_tagged_sents append chunk_tagged_sent N/A N/A chunk_tagged_sent N/A N/A N/A N/A dependency accuracy: %f N/A accuracy N/A sum evaluation_sents N/A N/A sum dep_tagged_sents N/A N/A N/A chunk accuracy: %f N/A accuracy N/A sum evaluation_sents N/A N/A sum chunk_tagged_sents N/A N/A information_tagger N/A IOBTagger model informations-all.model N/A N/A N/A information_tagger evaluate gold