Module Expr Str Import alias ImportFrom alias ImportFrom alias alias ImportFrom alias alias alias ImportFrom alias ImportFrom alias ImportFrom alias ImportFrom alias ImportFrom alias alias alias ImportFrom alias ImportFrom alias ImportFrom alias ImportFrom alias alias alias alias ImportFrom alias alias alias Expr Call AttributeLoad NameLoad attr keyword NameLoad Assign NameStore Call AttributeLoad NameLoad attr Str Expr Call AttributeLoad NameLoad attr NameLoad Assign NameStore TupleLoad Str Str Str Str Str Str Str Str Assign NameStore Dict FunctionDef arguments args NameParam NameParam defaults body Expr Str If UnaryOpNot Call AttributeLoad NameLoad attr AttributeLoad NameLoad attr body Assign SubscriptStore NameLoad Index AttributeLoad NameLoad attr Dict Assign NameStore SubscriptLoad NameLoad Index AttributeLoad NameLoad attr Assign NameStore Dict Str Str Str Str Str Str Str Call AttributeLoad NameLoad attr NameLoad AttributeLoad NameLoad attr Call AttributeLoad NameLoad attr NameLoad Call AttributeLoad NameLoad attr AttributeLoad NameLoad attr Call AttributeLoad NameLoad attr Call AttributeLoad NameLoad attr Expr Call AttributeLoad NameLoad attr Dict AttributeLoad NameLoad attr NameLoad decorator_list FunctionDef arguments args NameParam NameParam NameParam NameParam defaults body Expr Str Expr Call AttributeLoad NameLoad attr Call AttributeLoad Str attr NameLoad NameLoad NameLoad Call AttributeLoad NameLoad attr Str Assign NameStore Call AttributeLoad AttributeLoad NameLoad attr attr keyword NameLoad keyword NameLoad If NameLoad body Assign NameStore SubscriptLoad NameLoad Index Num orelse Assign NameStore Call NameLoad keyword NameLoad keyword NameLoad TryExcept body ImportFrom alias Assign AttributeStore NameLoad attr Call NameLoad NameLoad handlers ExceptHandler type NameLoad body Assign AttributeStore NameLoad attr NameLoad Assign AttributeStore NameLoad attr NameLoad Expr Call AttributeLoad NameLoad attr decorator_list FunctionDef arguments args NameParam NameParam NameParam defaults NameLoad body Expr Str Assign NameStore Call AttributeLoad AttributeLoad NameLoad attr attr keyword NameLoad Assign NameStore Call AttributeLoad NameLoad attr Str keyword NameLoad Assign NameStore Call NameLoad Call AttributeLoad NameLoad attr keyword NameLoad If NameLoad body Expr Call NameLoad NameLoad If NameLoad body Return SubscriptLoad NameLoad Index Num Return NameLoad decorator_list FunctionDef arguments args NameParam defaults body Expr Str Assign NameStore ListLoad NameLoad NameLoad NameLoad Assign NameStore ListLoad NameLoad NameLoad NameLoad Assign NameStore Call AttributeLoad AttributeLoad NameLoad attr attr keyword AttributeLoad NameLoad attr keyword BinOpSub AttributeLoad NameLoad attr Num Assign NameStore Call AttributeLoad AttributeLoad NameLoad attr attr keyword AttributeLoad NameLoad attr keyword BinOpAdd AttributeLoad NameLoad attr Num Assign NameStore Call NameLoad AttributeLoad NameLoad attr Str NameLoad Assign SubscriptStore NameLoad Index Num SubscriptLoad AttributeLoad NameLoad attr Index Num If AttributeLoad NameLoad attr body Assign SubscriptStore NameLoad Index Num SubscriptLoad AttributeLoad NameLoad attr Index Num If NameLoad body Assign NameStore SubscriptLoad NameLoad Index Num Assign NameStore Call NameLoad AttributeLoad NameLoad attr Str NameLoad If CompareEq NameLoad NameLoad body Assign SubscriptStore NameLoad Index Num SubscriptLoad AttributeLoad NameLoad attr Index Num If AttributeLoad NameLoad attr body Assign SubscriptStore NameLoad Index Num SubscriptLoad AttributeLoad NameLoad attr Index Num If NameLoad body Assign NameStore SubscriptLoad NameLoad Index Num Assign NameStore Call NameLoad AttributeLoad NameLoad attr Str NameLoad If CompareEq NameLoad NameLoad body Assign SubscriptStore NameLoad Index Num SubscriptLoad AttributeLoad NameLoad attr Index Num If AttributeLoad NameLoad attr body Assign SubscriptStore NameLoad Index Num SubscriptLoad AttributeLoad NameLoad attr Index Num Return TupleLoad NameLoad NameLoad decorator_list FunctionDef arguments args NameParam NameParam NameParam defaults body Expr Str Assign NameStore Call AttributeLoad NameLoad attr Assign NameStore NameLoad If CompareEq AttributeLoad NameLoad attr Str body Assign NameStore Call AttributeLoad AttributeLoad NameLoad attr attr Str NameLoad Assign NameStore Call AttributeLoad AttributeLoad NameLoad attr attr Str NameLoad Assign NameStore Call AttributeLoad AttributeLoad NameLoad attr attr Str NameLoad Assign NameStore Call NameLoad TupleLoad NameLoad NameLoad NameLoad If NameLoad body Assign NameStore Call NameLoad NameLoad keyword Call NameLoad NameLoad Assign NameStore Call AttributeLoad NameLoad attr Call NameLoad NameLoad Assign NameStore BinOpSub NameLoad NameLoad If CompareEq NameLoad Str body Assign NameStore Str orelse Assign NameStore NameLoad Expr Call NameLoad NameLoad AttributeLoad NameLoad attr NameLoad NameLoad Assign NameStore Call NameLoad NameLoad AttributeLoad NameLoad attr AttributeLoad NameLoad attr If UnaryOpNot NameLoad body Return Call NameLoad Str Assign TupleStore NameStore NameStore Call NameLoad NameLoad Assign TupleStore NameStore NameStore Call AttributeLoad NameLoad attr AttributeLoad NameLoad attr AugAssignAdd NameStore Num Assign NameStore Dict Str Str Str Str Str Str Str Str Str Str AttributeLoad NameLoad attr NameLoad AttributeLoad NameLoad attr AttributeLoad NameLoad attr Call NameLoad Call AttributeLoad Call AttributeLoad NameLoad attr attr NameLoad NameLoad Call AttributeLoad Str attr NameLoad NameLoad Str SubscriptLoad AttributeLoad NameLoad attr Index Num Return Call NameLoad NameLoad Str NameLoad decorator_list NameLoad FunctionDef arguments args NameParam NameParam NameParam defaults body Expr Str Assign NameStore NameLoad If CompareEq AttributeLoad NameLoad attr Str body Assign NameStore Call AttributeLoad AttributeLoad NameLoad attr attr Str NameLoad Assign NameStore Call AttributeLoad AttributeLoad NameLoad attr attr Str NameLoad Assign NameStore Call AttributeLoad AttributeLoad NameLoad attr attr Str NameLoad Assign NameStore Call AttributeLoad AttributeLoad NameLoad attr attr Str NameLoad Assign NameStore Call AttributeLoad AttributeLoad NameLoad attr attr Str NameLoad Assign NameStore Call NameLoad TupleLoad NameLoad NameLoad NameLoad NameLoad NameLoad If NameLoad body Assign NameStore Call NameLoad NameLoad keyword Call NameLoad NameLoad Assign NameStore Call AttributeLoad NameLoad attr Call NameLoad NameLoad Assign NameStore Call AttributeLoad NameLoad attr Call NameLoad NameLoad Assign NameStore BinOpSub NameLoad NameLoad Assign NameStore ListComp Call NameLoad NameLoad comprehension NameStore Call AttributeLoad NameLoad attr Str Assign NameStore Dict For NameStore Call NameLoad Call NameLoad AttributeLoad NameLoad attr body Assign NameStore Call AttributeLoad AttributeLoad NameLoad attr attr Call AttributeLoad Str attr NameLoad Num Assign SubscriptStore NameLoad Index SubscriptLoad NameLoad Index NameLoad Call NameLoad NameLoad If CompareEq NameLoad Str body Assign NameStore Str orelse If CompareEq NameLoad Str body Assign NameStore Call NameLoad Call NameLoad AttributeLoad NameLoad attr Assign NameStore Call AttributeLoad Str attr ListComp Call NameLoad SubscriptLoad NameLoad Index NameLoad comprehension NameStore NameLoad Expr Call NameLoad NameLoad AttributeLoad NameLoad attr NameLoad NameLoad Assign NameStore Call NameLoad NameLoad AttributeLoad NameLoad attr AttributeLoad NameLoad attr If UnaryOpNot NameLoad body Return Call NameLoad Str Assign TupleStore NameStore NameStore Call NameLoad NameLoad Assign TupleStore NameStore NameStore Call AttributeLoad NameLoad attr AttributeLoad NameLoad attr AugAssignAdd NameStore Num Assign NameStore ListLoad Assign NameStore Call NameLoad Call NameLoad AttributeLoad NameLoad attr Expr Call NameLoad NameLoad For NameStore NameLoad body Expr Call AttributeLoad NameLoad attr SubscriptLoad AttributeLoad NameLoad attr Index NameLoad Assign NameStore Dict Str Str Str Str Str Str Str Str Str Str AttributeLoad NameLoad attr NameLoad AttributeLoad NameLoad attr AttributeLoad NameLoad attr Call AttributeLoad Str attr ListComp Call NameLoad NameLoad comprehension NameStore NameLoad NameLoad NameLoad Call AttributeLoad Str attr NameLoad NameLoad Str NameLoad Return Call NameLoad NameLoad Str NameLoad decorator_list NameLoad FunctionDef arguments args NameParam NameParam NameParam defaults body Expr Str If CompareEq AttributeLoad NameLoad attr Str body Assign NameStore Call AttributeLoad AttributeLoad NameLoad attr attr Str Assign NameStore Call AttributeLoad AttributeLoad NameLoad attr attr Str Num Assign NameStore Call AttributeLoad AttributeLoad NameLoad attr attr Str NameLoad Assign NameStore Call AttributeLoad AttributeLoad NameLoad attr attr Str NameLoad Assign NameStore Call AttributeLoad AttributeLoad NameLoad attr attr Str Assign NameStore Call AttributeLoad AttributeLoad NameLoad attr attr Str Assign NameStore Call AttributeLoad AttributeLoad NameLoad attr attr Str Str Assign NameStore Call AttributeLoad AttributeLoad NameLoad attr attr Str NameLoad Assign NameStore Call NameLoad NameLoad keyword Call NameLoad NameLoad Assign NameStore NameLoad If BoolOpAnd NameLoad NameLoad body Assign NameStore Call AttributeLoad NameLoad attr Call NameLoad NameLoad Assign NameStore Call AttributeLoad NameLoad attr Call NameLoad NameLoad Assign NameStore BinOpSub NameLoad NameLoad Assign NameStore ListComp Call NameLoad NameLoad comprehension NameStore Call AttributeLoad NameLoad attr Str Assign NameStore Call NameLoad SubscriptLoad NameLoad Index Call NameLoad NameLoad Print Print Call AttributeLoad Str attr NameLoad Print Call AttributeLoad Str attr NameLoad Print Call AttributeLoad Str attr NameLoad Print Call AttributeLoad Str attr NameLoad Print Call AttributeLoad Str attr NameLoad Print Call AttributeLoad Str attr Call AttributeLoad NameLoad attr Str Print Print AttributeLoad NameLoad attr Print If CompareEq NameLoad Str body Assign NameStore ListLoad If NameLoad body Expr Call AttributeLoad NameLoad attr Str Expr Call AttributeLoad NameLoad attr NameLoad Expr Call AttributeLoad NameLoad attr NameLoad Assign NameStore Call AttributeLoad Str attr NameLoad orelse If CompareEq NameLoad Str body Assign NameStore Str Expr Call NameLoad NameLoad AttributeLoad NameLoad attr NameLoad NameLoad Assign NameStore Call NameLoad NameLoad AttributeLoad NameLoad attr AttributeLoad NameLoad attr If UnaryOpNot NameLoad body Return Call NameLoad Str Assign TupleStore NameStore NameStore Call NameLoad NameLoad Assign TupleStore NameStore NameStore Call AttributeLoad NameLoad attr AttributeLoad NameLoad attr Assign NameStore ListLoad Assign NameStore Call NameLoad Call NameLoad AttributeLoad NameLoad attr Expr Call NameLoad NameLoad For NameStore NameLoad body Expr Call AttributeLoad NameLoad attr SubscriptLoad AttributeLoad NameLoad attr Index NameLoad Assign NameStore Dict Str Str Str Str Str Str Str Str Str Str Str AttributeLoad NameLoad attr NameLoad NameLoad NameLoad AttributeLoad NameLoad attr Call AttributeLoad Str attr ListComp Call NameLoad NameLoad comprehension NameStore NameLoad Call AttributeLoad Str attr BinOpAdd NameLoad Num NameLoad AttributeLoad NameLoad attr NameLoad Return Call NameLoad NameLoad Str NameLoad decorator_list NameLoad FunctionDef arguments args NameParam NameParam NameParam defaults body Expr Str If CompareEq AttributeLoad NameLoad attr Str body Assign NameStore Call AttributeLoad AttributeLoad NameLoad attr attr Str NameLoad Assign NameStore Call AttributeLoad AttributeLoad NameLoad attr attr Str Assign NameStore Call AttributeLoad AttributeLoad NameLoad attr attr Str Assign NameStore Call AttributeLoad AttributeLoad NameLoad attr attr Str Assign NameStore Call AttributeLoad AttributeLoad NameLoad attr attr Str Assign NameStore Call AttributeLoad AttributeLoad NameLoad attr attr Str NameLoad Assign NameStore Call AttributeLoad AttributeLoad NameLoad attr attr Str Assign NameStore Call NameLoad NameLoad keyword Call NameLoad NameLoad Assign NameStore NameLoad If BoolOpAnd NameLoad NameLoad body Assign NameStore Call AttributeLoad NameLoad attr Call NameLoad NameLoad Assign NameStore Call AttributeLoad NameLoad attr Call NameLoad NameLoad Assign NameStore BinOpSub NameLoad NameLoad Assign NameStore Dict If NameLoad body For NameStore Call NameLoad Call NameLoad NameLoad body Assign NameStore Dict For NameStore NameLoad body Assign NameStore Call AttributeLoad AttributeLoad NameLoad attr attr Call AttributeLoad Str attr NameLoad NameLoad If BoolOpAnd NameLoad CompareNotEq NameLoad Str body Assign SubscriptStore NameLoad Index NameLoad NameLoad If NameLoad body Assign SubscriptStore NameLoad Index NameLoad NameLoad Print Print Call AttributeLoad Str attr NameLoad Print Call AttributeLoad Str attr NameLoad Print Call AttributeLoad Str attr NameLoad Print Call AttributeLoad Str attr NameLoad Print Call AttributeLoad Str attr NameLoad Print If CompareEq NameLoad Str body If NameLoad body Assign NameStore Str orelse Assign NameStore ListLoad If NameLoad body Expr Call AttributeLoad NameLoad attr Str For TupleStore NameStore NameStore Call AttributeLoad NameLoad attr body Assign NameStore ListComp Call AttributeLoad Str attr NameLoad NameLoad comprehension TupleStore NameStore NameStore Call AttributeLoad NameLoad attr Expr Call AttributeLoad NameLoad attr Call AttributeLoad Str attr NameLoad Call AttributeLoad Str attr NameLoad Assign NameStore Call AttributeLoad Str attr NameLoad orelse If CompareEq NameLoad Str body Assign NameStore Str Expr Call NameLoad NameLoad AttributeLoad NameLoad attr NameLoad NameLoad Assign NameStore Call NameLoad NameLoad AttributeLoad NameLoad attr AttributeLoad NameLoad attr If UnaryOpNot NameLoad body Return Call NameLoad Str Assign TupleStore NameStore NameStore Call NameLoad NameLoad Assign TupleStore NameStore NameStore Call AttributeLoad NameLoad attr AttributeLoad NameLoad attr Assign NameStore SubscriptLoad SubscriptLoad AttributeLoad NameLoad attr Index Num Index Num Assign NameStore Call AttributeLoad SubscriptLoad SubscriptLoad AttributeLoad NameLoad attr Index Num Index Num attr Str Assign NameStore Dict Str Str Str Str Str Str Str Str Str Str Str AttributeLoad NameLoad attr NameLoad NameLoad NameLoad NameLoad AttributeLoad NameLoad attr Call AttributeLoad Str attr BinOpAdd NameLoad Num NameLoad AttributeLoad NameLoad attr NameLoad Return Call NameLoad NameLoad Str NameLoad decorator_list NameLoad FunctionDef arguments args NameParam NameParam NameParam defaults body Expr Str Assign NameStore Call AttributeLoad NameLoad attr Assign NameStore NameLoad If CompareEq AttributeLoad NameLoad attr Str body Assign NameStore Call AttributeLoad AttributeLoad NameLoad attr attr Str NameLoad Assign NameStore Call AttributeLoad AttributeLoad NameLoad attr attr Str NameLoad Assign NameStore Call AttributeLoad AttributeLoad NameLoad attr attr Str NameLoad Assign NameStore Call AttributeLoad AttributeLoad NameLoad attr attr Str NameLoad Assign NameStore Call NameLoad TupleLoad NameLoad NameLoad NameLoad NameLoad If NameLoad body Assign NameStore Call NameLoad NameLoad keyword Call NameLoad NameLoad Assign NameStore Call AttributeLoad NameLoad attr Call NameLoad NameLoad Assign NameStore BinOpSub NameLoad NameLoad If CompareEq NameLoad Str body Assign NameStore Str orelse Assign NameStore NameLoad If CompareEq NameLoad Str body If CompareEq NameLoad Str body Assign NameStore Str orelse If CompareEq NameLoad Str body Assign NameStore Str Expr Call NameLoad NameLoad AttributeLoad NameLoad attr NameLoad NameLoad Assign NameStore Call NameLoad NameLoad AttributeLoad NameLoad attr AttributeLoad NameLoad attr If UnaryOpNot NameLoad body Return Call NameLoad Str Assign TupleStore NameStore NameStore Call NameLoad NameLoad If SubscriptLoad NameLoad Index Num body Assign SubscriptStore NameLoad Index Num Call AttributeLoad Call AttributeLoad SubscriptLoad NameLoad Index Num attr Str Str attr Str Str Assign SubscriptStore NameLoad Index Num Call AttributeLoad SubscriptLoad NameLoad Index Num attr Str Str Assign SubscriptStore NameLoad Index Num Call AttributeLoad SubscriptLoad NameLoad Index Num attr Str Str If SubscriptLoad NameLoad Index Num body Assign SubscriptStore NameLoad Index Num Call AttributeLoad Call AttributeLoad SubscriptLoad NameLoad Index Num attr Str Str attr Str Str Assign TupleStore NameStore NameStore Call AttributeLoad NameLoad attr AttributeLoad NameLoad attr AugAssignAdd NameStore Num Assign NameStore SubscriptLoad AttributeLoad NameLoad attr Slice Num Assign NameStore NameLoad If Call NameLoad Num Num body Expr Call AttributeLoad NameLoad attr Assign NameStore NameLoad Assign NameStore Dict Str Str Str Str Str Str Str Str Str Str Str AttributeLoad NameLoad attr NameLoad AttributeLoad NameLoad attr AttributeLoad NameLoad attr Call NameLoad Call AttributeLoad Call AttributeLoad NameLoad attr attr NameLoad NameLoad NameLoad Call AttributeLoad Str attr NameLoad NameLoad Str NameLoad Return Call NameLoad NameLoad Str NameLoad decorator_list FunctionDef arguments args NameParam NameParam defaults body Expr Str Expr Call AttributeLoad NameLoad attr Call AttributeLoad Str attr BoolOpOr AttributeLoad AttributeLoad NameLoad attr attr Str Assign NameStore Call NameLoad NameLoad keyword NameLoad Assign NameStore Call AttributeLoad AttributeLoad NameLoad attr attr keyword NameLoad If UnaryOpNot NameLoad body Return Call NameLoad Str Assign NameStore Call AttributeLoad NameLoad attr If CompareEq NameLoad Str body Return Call NameLoad NameLoad NameLoad NameLoad orelse If CompareEq NameLoad Str body Return Call NameLoad NameLoad NameLoad NameLoad orelse If CompareEq NameLoad Str body Return Call NameLoad NameLoad NameLoad NameLoad orelse If CompareEq NameLoad Str body Return Call NameLoad NameLoad NameLoad NameLoad orelse If CompareEq NameLoad Str body Return Call NameLoad NameLoad NameLoad NameLoad Assign NameStore Call AttributeLoad Str attr NameLoad Raise NameLoad NameLoad decorator_list NameLoad FunctionDef arguments args NameParam defaults body Expr Str Expr Call AttributeLoad NameLoad attr Call AttributeLoad Str attr BoolOpOr AttributeLoad AttributeLoad NameLoad attr attr Str If Call AttributeLoad Call AttributeLoad AttributeLoad AttributeLoad NameLoad attr attr attr keyword Str attr body Expr Call AttributeLoad NameLoad attr Call AttributeLoad Str attr AttributeLoad AttributeLoad NameLoad attr attr Return Call NameLoad Str Expr Call NameLoad NameLoad Assign NameStore Dict For TupleStore NameStore NameStore NameLoad body Assign SubscriptStore NameLoad Index NameLoad ListLoad If AttributeLoad AttributeLoad NameLoad attr attr body Assign NameStore Call AttributeLoad AttributeLoad NameLoad attr attr keyword NameLoad orelse Assign NameStore Call AttributeLoad AttributeLoad NameLoad attr attr keyword NameLoad keyword AttributeLoad NameLoad attr keyword NameLoad For NameStore NameLoad body If UnaryOpNot Call AttributeLoad NameLoad attr AttributeLoad NameLoad attr body Assign SubscriptStore NameLoad Index AttributeLoad NameLoad attr Dict Assign NameStore SubscriptLoad NameLoad Index AttributeLoad NameLoad attr If UnaryOpNot Call AttributeLoad NameLoad attr AttributeLoad AttributeLoad NameLoad attr attr body Expr Call NameLoad NameLoad AttributeLoad NameLoad attr Assign NameStore SubscriptLoad NameLoad Index AttributeLoad AttributeLoad NameLoad attr attr Expr Call AttributeLoad SubscriptLoad NameLoad Index NameLoad attr NameLoad If CompareEq Call NameLoad SubscriptLoad NameLoad Index NameLoad Num body Expr Call AttributeLoad NameLoad attr NameLoad Assign NameStore Dict Str Str Str Str Str NameLoad NameLoad Str Return Call NameLoad NameLoad Str NameLoad decorator_list NameLoad FunctionDef arguments args NameParam NameParam defaults NameLoad body Expr Str Expr Call AttributeLoad NameLoad attr Call AttributeLoad Str attr AttributeLoad AttributeLoad NameLoad attr attr If Call AttributeLoad Call AttributeLoad AttributeLoad AttributeLoad NameLoad attr attr attr keyword Str attr body Expr Call AttributeLoad NameLoad attr Call AttributeLoad Str attr AttributeLoad AttributeLoad NameLoad attr attr Return Call NameLoad Str If NameLoad body Assign NameStore Call NameLoad NameLoad keyword NameLoad Assign NameStore Call AttributeLoad NameLoad attr Assign NameStore ListLoad For NameStore Call AttributeLoad AttributeLoad NameLoad attr attr body Expr Call AttributeLoad NameLoad attr TupleLoad AttributeLoad NameLoad attr Call AttributeLoad NameLoad attr NameLoad Assign NameStore NameLoad Assign NameStore ListLoad Assign NameStore Call NameLoad Assign NameStore Call NameLoad Call AttributeLoad AttributeLoad NameLoad attr attr For NameStore Call AttributeLoad AttributeLoad NameLoad attr attr keyword NameLoad body Assign NameStore ListLoad For NameStore NameLoad body Assign NameStore Call AttributeLoad AttributeLoad NameLoad attr attr keyword NameLoad keyword NameLoad If Call AttributeLoad NameLoad attr body Assign NameStore Call NameLoad AttributeLoad SubscriptLoad NameLoad Index Num attr Expr Call AttributeLoad NameLoad attr TupleLoad AttributeLoad NameLoad attr AttributeLoad NameLoad attr NameLoad AugAssignAdd SubscriptStore NameLoad Index AttributeLoad SubscriptLoad NameLoad Index Num attr Num If CompareEq Call NameLoad NameLoad Call NameLoad NameLoad body Expr Call AttributeLoad NameLoad attr NameLoad Assign NameStore ListLoad Assign NameStore Call AttributeLoad NameLoad attr Assign NameStore Call NameLoad Call NameLoad Call AttributeLoad NameLoad attr For NameStore Call NameLoad NameLoad body Assign NameStore SubscriptLoad NameLoad Index NameLoad Expr Call AttributeLoad NameLoad attr TupleLoad NameLoad NameLoad BinOpDiv BinOpMult Num NameLoad NameLoad TryExcept body If CompareGt Call NameLoad NameLoad Num body TryExcept body ImportFrom alias Assign NameStore Call NameLoad keyword ListLoad TupleLoad Str Str Str TupleLoad Str Str Str Assert CompareEq NameLoad Num handlers ExceptHandler type NameLoad body Expr Call AttributeLoad NameLoad attr Str ImportFrom alias Expr Call AttributeLoad NameLoad attr Assign NameStore Call NameLoad NameLoad Assign NameStore TupleLoad Call AttributeLoad NameLoad attr Call AttributeLoad NameLoad attr Call AttributeLoad NameLoad attr Call AttributeLoad NameLoad attr handlers ExceptHandler type NameLoad body Assign NameStore NameLoad ExceptHandler type NameLoad body Assign NameStore NameLoad Assign NameStore Dict Str Str Str Str Str Str Str Str Str Call AttributeLoad NameLoad attr NameLoad NameLoad NameLoad NameLoad NameLoad AttributeLoad NameLoad attr AttributeLoad NameLoad attr Str Return Call NameLoad NameLoad Str NameLoad orelse Assign NameStore Dict For TupleStore NameStore NameStore NameLoad body Assign SubscriptStore NameLoad Index NameLoad ListLoad If AttributeLoad AttributeLoad NameLoad attr attr body Assign NameStore Call AttributeLoad AttributeLoad NameLoad attr attr keyword NameLoad orelse Assign NameStore Call AttributeLoad AttributeLoad NameLoad attr attr keyword NameLoad keyword NameLoad For NameStore NameLoad body If UnaryOpNot Call AttributeLoad NameLoad attr AttributeLoad NameLoad attr body Assign SubscriptStore NameLoad Index AttributeLoad NameLoad attr Dict Assign NameStore SubscriptLoad NameLoad Index AttributeLoad NameLoad attr If UnaryOpNot Call AttributeLoad NameLoad attr AttributeLoad AttributeLoad NameLoad attr attr body Expr Call NameLoad NameLoad AttributeLoad NameLoad attr Assign NameStore SubscriptLoad NameLoad Index AttributeLoad AttributeLoad NameLoad attr attr Expr Call AttributeLoad SubscriptLoad NameLoad Index NameLoad attr NameLoad If CompareEq Call NameLoad SubscriptLoad NameLoad Index NameLoad Num body Expr Call AttributeLoad NameLoad attr NameLoad Assign NameStore Dict Str Str Str Str Str NameLoad NameLoad Str Return Call NameLoad NameLoad Str NameLoad decorator_list NameLoad FunctionDef arguments args NameParam NameParam defaults NameLoad body Expr Str Assign NameStore Call NameLoad NameLoad keyword NameLoad Assign NameStore Call NameLoad Str Assign NameStore Call AttributeLoad NameLoad attr Call NameLoad Dict Str ListLoad Call AttributeLoad NameLoad attr Assign NameStore Call AttributeLoad Str attr Call NameLoad AttributeLoad NameLoad attr Call AttributeLoad NameLoad attr Assign NameStore Call NameLoad NameLoad keyword Str Assign SubscriptStore NameLoad Index Str Call AttributeLoad Str attr NameLoad Return NameLoad decorator_list NameLoad FunctionDef arguments args NameParam NameParam defaults NameLoad body Expr Str Assign NameStore Call NameLoad NameLoad keyword NameLoad Assign NameStore ListLoad Assign NameStore Call NameLoad Call AttributeLoad AttributeLoad NameLoad attr attr For NameStore Call AttributeLoad AttributeLoad NameLoad attr attr keyword NameLoad body Assign NameStore ListLoad For NameStore NameLoad body Assign NameStore Call AttributeLoad AttributeLoad NameLoad attr attr keyword NameLoad keyword NameLoad If Call AttributeLoad NameLoad attr body Assign NameStore Call NameLoad AttributeLoad SubscriptLoad NameLoad Index Num attr Assign NameStore Call AttributeLoad Str attr AttributeLoad NameLoad attr AttributeLoad NameLoad attr NameLoad Expr Call AttributeLoad NameLoad attr NameLoad If CompareEq Call NameLoad NameLoad Call NameLoad NameLoad body Expr Call AttributeLoad NameLoad attr NameLoad Assign NameStore Call AttributeLoad Str attr NameLoad Assign NameStore Call AttributeLoad Str attr Call NameLoad AttributeLoad NameLoad attr Call AttributeLoad NameLoad attr Assign NameStore Call NameLoad NameLoad keyword Str Assign SubscriptStore NameLoad Index Str Call AttributeLoad Str attr NameLoad Return NameLoad decorator_list NameLoad
N/A N/A 
Project: Appraise evaluation system
 Author: Christian Federmann <cfedermann@gmail.com>
 N/A logging collections Counter datetime datetime date random randint seed shuffle time mktime django.contrib.admin.views.decorators staff_member_required django.contrib.auth.decorators login_required django.http HttpResponse django.shortcuts get_object_or_404 redirect render django.template Context django.template.defaultfilters slugify django.template.loader get_template appraise.evaluation.models APPRAISE_TASK_TYPE_CHOICES EvaluationTask EvaluationItem EvaluationResult appraise.settings LOG_LEVEL LOG_HANDLER COMMIT_TAG N/A N/A N/A logging basicConfig level LOG_LEVEL N/A LOGGER N/A N/A logging getLogger appraise.evaluation.views N/A N/A N/A LOGGER addHandler LOG_HANDLER N/A ERROR_CLASSES N/A terminology lexical_choice syntax insertion morphology misspelling punctuation other N/A APPRAISE_TASK_CACHE N/A _update_task_cache N/A N/A task user N/A N/A N/A 
    Updates the APPRAISE_TASK_CACHE for the given user.
     N/A N/A N/A N/A APPRAISE_TASK_CACHE has_key N/A task task_id N/A N/A N/A APPRAISE_TASK_CACHE N/A N/A task task_id N/A N/A _cache N/A APPRAISE_TASK_CACHE N/A N/A task task_id N/A _task_data N/A finished header status status_users task_name url status_url N/A N/A task is_finished_for_user user N/A task get_status_header N/A N/A task get_status_for_user user N/A N/A task get_status_for_users N/A task task_name N/A N/A task get_absolute_url N/A N/A task get_status_url N/A N/A N/A _cache update N/A N/A user username _task_data N/A _save_results N/A N/A item user duration raw_result N/A N/A N/A 
    Creates or updates the EvaluationResult for the given item and user.
     N/A N/A N/A LOGGER debug N/A N/A item: {}, user: {}, duration: {}, raw_result: {} format item user duration N/A N/A raw_result encode utf-8 N/A _existing_result N/A N/A N/A EvaluationResult objects filter item item user user N/A _existing_result N/A N/A _result N/A _existing_result N/A 0 N/A N/A _result N/A EvaluationResult item item user user N/A N/A django.utils.dateparse parse_time N/A N/A _result duration N/A str duration N/A N/A N/A TypeError N/A N/A N/A _result duration duration N/A N/A _result raw_result raw_result N/A N/A N/A _result save N/A _find_next_item_to_process N/A N/A items user random_order N/A False N/A N/A 
    Computes the next item the current user should process or None, if done.
     N/A user_results N/A N/A N/A EvaluationResult objects filter user user N/A processed_items N/A N/A user_results values_list item__pk flat True N/A unprocessed_items N/A list N/A N/A items exclude pk__in processed_items N/A random_order N/A N/A N/A shuffle unprocessed_items N/A unprocessed_items N/A N/A N/A unprocessed_items N/A 0 N/A None N/A _compute_context_for_item N/A N/A item N/A N/A N/A 
    Computes the source and reference texts for item, including context.
    
    Left/right context is only displayed if it belongs to the same document,
    hence we check the doc-id attribute before adding context.
    
     N/A source_text N/A None None None N/A reference_text N/A None None None N/A left_context N/A N/A N/A EvaluationItem objects filter task N/A item task pk N/A N/A item id 1 N/A right_context N/A N/A N/A EvaluationItem objects filter task N/A item task pk N/A N/A item id 1 N/A _item_doc_id N/A getattr N/A item attributes doc-id None N/A N/A source_text N/A 1 N/A N/A item source N/A 0 N/A N/A item reference N/A N/A N/A reference_text N/A 1 N/A N/A item reference N/A 0 N/A left_context N/A N/A _left N/A left_context N/A 0 N/A _left_doc_id N/A getattr N/A _left attributes doc-id None N/A N/A _left_doc_id _item_doc_id N/A N/A N/A source_text N/A 0 N/A N/A _left source N/A 0 N/A N/A _left reference N/A N/A N/A reference_text N/A 0 N/A N/A _left reference N/A 0 N/A right_context N/A N/A _right N/A right_context N/A 0 N/A _right_doc_id N/A getattr N/A _right attributes doc-id None N/A N/A _right_doc_id _item_doc_id N/A N/A N/A source_text N/A 2 N/A N/A _right source N/A 0 N/A N/A _right reference N/A N/A N/A reference_text N/A 2 N/A N/A _right reference N/A 0 N/A N/A source_text reference_text N/A _handle_quality_checking N/A N/A request task items N/A N/A N/A 
    Handler for Quality Checking tasks.
    
    Finds the next item belonging to the given task, renders the page template
    and creates an EvaluationResult instance on HTTP POST submission.
    
     N/A start_datetime N/A N/A datetime now N/A form_valid False N/A N/A N/A request method POST N/A N/A item_id N/A N/A N/A request POST get item_id None N/A now_timestamp N/A N/A N/A request POST get now None N/A submit_button N/A N/A N/A request POST get submit_button None N/A form_valid N/A all N/A item_id now_timestamp submit_button N/A form_valid N/A N/A current_item N/A get_object_or_404 EvaluationItem pk N/A int item_id N/A now_datetime N/A N/A datetime fromtimestamp N/A float now_timestamp N/A duration N/A start_datetime now_datetime N/A N/A submit_button FLAG_ERROR N/A N/A _raw_result SKIPPED N/A N/A _raw_result submit_button N/A N/A _save_results current_item N/A request user duration _raw_result N/A item N/A _find_next_item_to_process items N/A request user N/A task random_order N/A N/A item N/A N/A N/A redirect appraise.evaluation.views.overview N/A N/A source_text reference_text N/A _compute_context_for_item item N/A N/A finished_items total_items N/A N/A task get_finished_for_user N/A request user N/A finished_items 1 N/A dictionary N/A action_url commit_tag description item_id now reference_text source_text task_progress title translation N/A request path COMMIT_TAG N/A task description N/A item id N/A mktime N/A N/A N/A N/A datetime now timetuple reference_text source_text N/A N/A {0:03d}/{1:03d} format finished_items total_items Translation Quality Checking N/A N/A item translations N/A 0 N/A N/A render request evaluation/quality_checking.html dictionary N/A login_required _handle_ranking N/A N/A request task items N/A N/A N/A 
    Handler for Ranking tasks.
    
    Finds the next item belonging to the given task, renders the page template
    and creates an EvaluationResult instance on HTTP POST submission.
    
     N/A form_valid False N/A N/A N/A request method POST N/A N/A item_id N/A N/A N/A request POST get item_id None N/A end_timestamp N/A N/A N/A request POST get end_timestamp None N/A order_random N/A N/A N/A request POST get order None N/A start_timestamp N/A N/A N/A request POST get start_timestamp None N/A submit_button N/A N/A N/A request POST get submit_button None N/A form_valid N/A all N/A item_id end_timestamp order_random start_timestamp submit_button N/A form_valid N/A N/A current_item N/A get_object_or_404 EvaluationItem pk N/A int item_id N/A start_datetime N/A N/A datetime fromtimestamp N/A float start_timestamp N/A end_datetime N/A N/A datetime fromtimestamp N/A float end_timestamp N/A duration N/A end_datetime start_datetime N/A order N/A N/A int x N/A x N/A N/A order_random split , N/A ranks N/A N/A index N/A range N/A len N/A current_item translations N/A N/A rank N/A N/A N/A request POST get N/A N/A rank_{0} format index -1 N/A N/A ranks N/A N/A order N/A index N/A int rank N/A N/A submit_button FLAG_ERROR N/A N/A _raw_result SKIPPED N/A N/A N/A submit_button SUBMIT N/A N/A _raw_result N/A range N/A len N/A current_item translations N/A _raw_result N/A N/A , join N/A N/A str N/A ranks N/A x N/A x _raw_result N/A N/A _save_results current_item N/A request user duration _raw_result N/A item N/A _find_next_item_to_process items N/A request user N/A task random_order N/A N/A item N/A N/A N/A redirect appraise.evaluation.views.overview N/A N/A source_text reference_text N/A _compute_context_for_item item N/A N/A finished_items total_items N/A N/A task get_finished_for_user N/A request user N/A finished_items 1 N/A translations N/A N/A order N/A range N/A len N/A item translations N/A N/A shuffle order N/A index order N/A N/A N/A N/A translations append N/A N/A item translations N/A index N/A dictionary N/A action_url commit_tag description item_id order reference_text source_text task_progress title translations N/A request path COMMIT_TAG N/A task description N/A item id N/A N/A , join N/A N/A str x N/A x order reference_text source_text N/A N/A {0:03d}/{1:03d} format finished_items total_items Ranking translations N/A N/A render request evaluation/ranking.html dictionary N/A login_required _handle_postediting N/A N/A request task items N/A N/A N/A 
    Handler for Post-editing tasks.
    
    Finds the next item belonging to the given task, renders the page template
    and creates an EvaluationResult instance on HTTP POST submission.
    
     N/A N/A N/A request method POST N/A N/A item_id N/A N/A N/A request POST get item_id N/A edit_id N/A N/A N/A request POST get edit_id 0 N/A end_timestamp N/A N/A N/A request POST get end_timestamp None N/A order_random N/A N/A N/A request POST get order None N/A submit_button N/A N/A N/A request POST get submit_button N/A from_scratch N/A N/A N/A request POST get from_scratch N/A postedited N/A N/A N/A request POST get postedited EMPTY N/A start_timestamp N/A N/A N/A request POST get start_timestamp None N/A current_item N/A get_object_or_404 EvaluationItem pk N/A int item_id N/A duration None N/A N/A end_timestamp start_timestamp N/A N/A start_datetime N/A N/A datetime fromtimestamp N/A float start_timestamp N/A end_datetime N/A N/A datetime fromtimestamp N/A float end_timestamp N/A duration N/A end_datetime start_datetime N/A order N/A N/A int x N/A x N/A N/A order_random split , N/A real_id N/A str N/A order N/A N/A int edit_id N/A N/A N/A N/A item_id: {0} format item_id N/A N/A N/A edit_id: {0} format edit_id N/A N/A N/A real_id: {0} format real_id N/A N/A N/A submit_button: {0} format submit_button N/A N/A N/A from_scratch: {0} format from_scratch N/A N/A N/A postedited: {0} format N/A N/A postedited encode utf-8 N/A N/A N/A request POST N/A N/A N/A submit_button SUBMIT N/A N/A _results N/A N/A from_scratch N/A N/A N/A N/A _results append FROM_SCRATCH N/A N/A N/A _results append real_id N/A N/A N/A _results append postedited N/A _raw_result N/A N/A join _results N/A N/A N/A submit_button FLAG_ERROR N/A N/A _raw_result SKIPPED N/A N/A _save_results current_item N/A request user duration _raw_result N/A item N/A _find_next_item_to_process items N/A request user N/A task random_order N/A N/A item N/A N/A N/A redirect appraise.evaluation.views.overview N/A N/A source_text reference_text N/A _compute_context_for_item item N/A N/A _finished _total N/A N/A task get_finished_for_user N/A request user N/A translations N/A N/A order N/A range N/A len N/A item translations N/A N/A shuffle order N/A index order N/A N/A N/A N/A translations append N/A N/A item translations N/A index N/A dictionary N/A title item_id source_text reference_text translations description order task_progress action_url commit_tag Post-editing N/A item id source_text reference_text translations N/A task description N/A N/A , join N/A N/A str x N/A x order N/A N/A {0:03d}/{1:03d} format N/A _finished 1 _total N/A request path COMMIT_TAG N/A N/A render request evaluation/postediting.html dictionary N/A login_required _handle_error_classification N/A N/A request task items N/A N/A N/A 
    Handler for Error Classification tasks.
    
    Finds the next item belonging to the given task, renders the page template
    and creates an EvaluationResult instance on HTTP POST submission.
    
     N/A N/A N/A request method POST N/A N/A end_timestamp N/A N/A N/A request POST get start_timestamp None N/A item_id N/A N/A N/A request POST get item_id N/A words N/A N/A N/A request POST get words N/A missing_words N/A N/A N/A request POST get missing_words N/A too_many_errors N/A N/A N/A request POST get too_many_errors N/A start_timestamp N/A N/A N/A request POST get start_timestamp None N/A submit_button N/A N/A N/A request POST get submit_button N/A current_item N/A get_object_or_404 EvaluationItem pk N/A int item_id N/A duration None N/A N/A end_timestamp start_timestamp N/A N/A start_datetime N/A N/A datetime fromtimestamp N/A float start_timestamp N/A end_datetime N/A N/A datetime fromtimestamp N/A float end_timestamp N/A duration N/A end_datetime start_datetime N/A errors N/A N/A words N/A N/A index N/A range N/A int words N/A N/A _errors N/A N/A error ERROR_CLASSES N/A N/A severity N/A N/A N/A request POST get N/A N/A {0}_{1} format error index N/A N/A severity N/A severity NONE N/A N/A N/A _errors N/A error severity N/A _errors N/A N/A N/A errors N/A index _errors N/A N/A N/A N/A item_id: {0} format item_id N/A N/A N/A missing_words: {0} format missing_words N/A N/A N/A too_many_errors: {0} format too_many_errors N/A N/A N/A submit_button: {0} format submit_button N/A N/A N/A errors: {0} format errors N/A N/A N/A submit_button SUBMIT N/A N/A too_many_errors N/A N/A _raw_result TOO_MANY_ERRORS N/A N/A _errors N/A N/A missing_words N/A N/A N/A N/A _errors append MISSING_WORDS N/A N/A index data N/A N/A errors items N/A N/A _word_i N/A N/A N/A {}:{} format k v N/A N/A k v N/A N/A data items N/A N/A N/A _errors append N/A N/A {}={} format index N/A N/A , join _word_i N/A _raw_result N/A N/A join _errors N/A N/A N/A submit_button FLAG_ERROR N/A N/A _raw_result SKIPPED N/A N/A _save_results current_item N/A request user duration _raw_result N/A item N/A _find_next_item_to_process items N/A request user N/A task random_order N/A N/A item N/A N/A N/A redirect appraise.evaluation.views.overview N/A N/A source_text reference_text N/A _compute_context_for_item item N/A N/A _finished _total N/A N/A task get_finished_for_user N/A request user N/A translation N/A N/A N/A item translations N/A 0 N/A 0 N/A words N/A N/A N/A N/A N/A item translations N/A 0 N/A 0 split N/A dictionary N/A title item_id source_text reference_text translation words description task_progress action_url commit_tag Error Classification N/A item id source_text reference_text translation words N/A task description N/A N/A {0:03d}/{1:03d} format N/A _finished 1 _total N/A request path COMMIT_TAG N/A N/A render request evaluation/error_classification.html dictionary N/A login_required _handle_three_way_ranking N/A N/A request task items N/A N/A N/A 
    Handler for 3-Way Ranking tasks.

    Finds the next item belonging to the given task, renders the page template
    and creates an EvaluationResult instance on HTTP POST submission.

     N/A start_datetime N/A N/A datetime now N/A form_valid False N/A N/A N/A request method POST N/A N/A item_id N/A N/A N/A request POST get item_id None N/A now_timestamp N/A N/A N/A request POST get now None N/A order_reversed N/A N/A N/A request POST get order_reversed None N/A submit_button N/A N/A N/A request POST get submit_button None N/A form_valid N/A all N/A item_id now_timestamp order_reversed submit_button N/A form_valid N/A N/A current_item N/A get_object_or_404 EvaluationItem pk N/A int item_id N/A now_datetime N/A N/A datetime fromtimestamp N/A float now_timestamp N/A duration N/A start_datetime now_datetime N/A N/A submit_button FLAG_ERROR N/A N/A _raw_result SKIPPED N/A N/A _raw_result submit_button N/A N/A order_reversed yes N/A N/A N/A submit_button A>B N/A N/A _raw_result A<B N/A N/A N/A submit_button A<B N/A N/A _raw_result A>B N/A N/A _save_results current_item N/A request user duration _raw_result N/A item N/A _find_next_item_to_process items N/A request user N/A task random_order N/A N/A item N/A N/A N/A redirect appraise.evaluation.views.overview N/A N/A source_text reference_text N/A _compute_context_for_item item N/A N/A source_text N/A 0 N/A N/A N/A source_text N/A 0 N/A N/A N/A N/A N/A source_text N/A 0 replace [[[ replace ]]] N/A N/A source_text N/A 1 N/A N/A N/A source_text N/A 1 replace [[[ <code> N/A N/A source_text N/A 1 N/A N/A N/A source_text N/A 1 replace ]]] </code> N/A N/A source_text N/A 2 N/A N/A N/A source_text N/A 2 N/A N/A N/A N/A N/A source_text N/A 2 replace [[[ replace ]]] N/A N/A finished_items total_items N/A N/A task get_finished_for_user N/A request user N/A finished_items 1 N/A translations N/A N/A item translations N/A 2 N/A order_reversed False N/A N/A randint 0 1 N/A N/A N/A N/A translations reverse N/A order_reversed True N/A dictionary N/A action_url commit_tag description item_id now order_reversed reference_text source_text task_progress title translations N/A request path COMMIT_TAG N/A task description N/A item id N/A mktime N/A N/A N/A N/A datetime now timetuple order_reversed reference_text source_text N/A N/A {0:03d}/{1:03d} format finished_items total_items 3-Way Ranking translations N/A N/A render request evaluation/three_way_ranking.html dictionary N/A task_handler N/A N/A request task_id N/A N/A N/A 
    General task handler.
    
    Finds the task with the given task_id and redirects to its task handler.
    
     N/A N/A N/A LOGGER info N/A N/A Rendering task handler view for user "{0}". format N/A N/A N/A request user username Anonymous N/A task N/A get_object_or_404 EvaluationTask task_id task_id N/A items N/A N/A N/A EvaluationItem objects filter task task N/A N/A items N/A N/A N/A redirect appraise.evaluation.views.overview N/A _task_type N/A N/A task get_task_type_display N/A N/A _task_type Quality Checking N/A N/A N/A _handle_quality_checking request task items N/A N/A N/A _task_type Ranking N/A N/A N/A _handle_ranking request task items N/A N/A N/A _task_type Post-editing N/A N/A N/A _handle_postediting request task items N/A N/A N/A _task_type Error classification N/A N/A N/A _handle_error_classification request task items N/A N/A N/A _task_type 3-Way Ranking N/A N/A N/A _handle_three_way_ranking request task items N/A _msg N/A N/A No handler for task type: "{0}" format _task_type N/A NotImplementedError _msg N/A login_required overview N/A N/A request N/A N/A N/A 
    Renders the evaluation tasks overview.
     N/A N/A N/A LOGGER info N/A N/A Rendering evaluation task overview for user "{0}". format N/A N/A N/A request user username Anonymous N/A N/A N/A N/A N/A N/A N/A request user groups filter name WMT13 exists N/A N/A N/A N/A LOGGER info N/A N/A Redirecting user "{0}" to WMT13 overview. format N/A N/A request user username N/A N/A redirect appraise.wmt13.views.overview N/A N/A seed None N/A evaluation_tasks N/A N/A N/A task_type_id task_type APPRAISE_TASK_TYPE_CHOICES N/A N/A N/A evaluation_tasks N/A task_type N/A N/A N/A N/A request user is_superuser N/A N/A _tasks N/A N/A N/A EvaluationTask objects filter task_type task_type_id N/A N/A _tasks N/A N/A N/A EvaluationTask objects filter task_type task_type_id users N/A request user active True N/A _task _tasks N/A N/A N/A N/A N/A APPRAISE_TASK_CACHE has_key N/A _task task_id N/A N/A N/A APPRAISE_TASK_CACHE N/A N/A _task task_id N/A N/A _cache N/A APPRAISE_TASK_CACHE N/A N/A _task task_id N/A N/A N/A N/A _cache has_key N/A N/A request user username N/A N/A N/A _update_task_cache _task N/A request user N/A _task_data N/A _cache N/A N/A N/A request user username N/A N/A N/A N/A evaluation_tasks N/A task_type append _task_data N/A N/A N/A len N/A evaluation_tasks N/A task_type 0 N/A N/A N/A N/A evaluation_tasks pop task_type N/A dictionary N/A active_page commit_tag evaluation_tasks title OVERVIEW COMMIT_TAG evaluation_tasks Evaluation Task Overview N/A N/A render request evaluation/overview.html dictionary N/A login_required status_view N/A N/A request task_id N/A None N/A N/A 
    Renders the evaluation tasks status page for staff users.
     N/A N/A N/A LOGGER info N/A N/A Rendering evaluation task overview for user "{0}". format N/A N/A request user username N/A N/A N/A N/A N/A N/A N/A request user groups filter name WMT13 exists N/A N/A N/A N/A LOGGER info N/A N/A Redirecting user "{0}" to WMT13 overview. format N/A N/A request user username N/A N/A redirect appraise.wmt13.views.overview N/A task_id N/A N/A task N/A get_object_or_404 EvaluationTask task_id task_id N/A headers N/A N/A task get_status_header N/A status N/A N/A user N/A N/A N/A task users all N/A N/A N/A N/A status append N/A N/A user username N/A N/A task get_status_for_user user N/A scores None N/A result_data N/A N/A raw_result_data N/A Counter N/A users N/A list N/A N/A N/A task users all N/A item N/A N/A N/A EvaluationItem objects filter task task N/A N/A results N/A N/A user users N/A N/A qset N/A N/A N/A EvaluationResult objects filter user user item item N/A N/A N/A qset exists N/A N/A category N/A str N/A N/A qset N/A 0 results N/A N/A N/A results append N/A N/A user id N/A item id category N/A N/A raw_result_data N/A N/A N/A qset N/A 0 raw_result 1 N/A N/A N/A len results N/A len users N/A N/A N/A N/A result_data extend results N/A _raw_results N/A N/A _keys N/A N/A raw_result_data keys N/A _total_results N/A float N/A sum N/A N/A raw_result_data values N/A key N/A sorted _keys N/A N/A value N/A raw_result_data N/A key N/A N/A N/A _raw_results append N/A key value N/A N/A 100 value _total_results N/A N/A N/A N/A N/A len users 1 N/A N/A N/A nltk.metrics.agreement AnnotationTask N/A chk N/A AnnotationTask data N/A N/A b 1 k N/A a 1 k N/A N/A chk 1.0 N/A N/A N/A AssertionError N/A N/A N/A N/A LOGGER debug Fixing outdated version of AnnotationTask. appraise.utils AnnotationTask N/A N/A N/A result_data sort N/A annotation_task N/A AnnotationTask result_data N/A scores N/A N/A N/A annotation_task alpha N/A N/A annotation_task kappa N/A N/A annotation_task S N/A N/A annotation_task pi N/A N/A N/A ZeroDivisionError N/A N/A scores None N/A N/A ImportError N/A N/A scores None N/A dictionary N/A combined commit_tag headers scores raw_results status task_id task_name title N/A N/A task get_status_for_users COMMIT_TAG headers scores _raw_results status N/A task task_id N/A task task_name Evaluation Task Status N/A N/A render request evaluation/status_task.html dictionary N/A N/A evaluation_tasks N/A N/A N/A task_type_id task_type APPRAISE_TASK_TYPE_CHOICES N/A N/A N/A evaluation_tasks N/A task_type N/A N/A N/A N/A request user is_superuser N/A N/A _tasks N/A N/A N/A EvaluationTask objects filter task_type task_type_id N/A N/A _tasks N/A N/A N/A EvaluationTask objects filter task_type task_type_id active True N/A _task _tasks N/A N/A N/A N/A N/A APPRAISE_TASK_CACHE has_key N/A _task task_id N/A N/A N/A APPRAISE_TASK_CACHE N/A N/A _task task_id N/A N/A _cache N/A APPRAISE_TASK_CACHE N/A N/A _task task_id N/A N/A N/A N/A _cache has_key N/A N/A request user username N/A N/A N/A _update_task_cache _task N/A request user N/A _task_data N/A _cache N/A N/A N/A request user username N/A N/A N/A N/A evaluation_tasks N/A task_type append _task_data N/A N/A N/A len N/A evaluation_tasks N/A task_type 0 N/A N/A N/A N/A evaluation_tasks pop task_type N/A dictionary N/A active_page commit_tag evaluation_tasks title STATUS COMMIT_TAG evaluation_tasks Evaluation Task Status N/A N/A render request evaluation/status.html dictionary N/A staff_member_required export_task_results N/A N/A request task_id N/A None N/A N/A 
    Exports the task with the given task_id to an XML download.
     N/A task N/A get_object_or_404 EvaluationTask task_id task_id N/A template N/A get_template evaluation/result_export.xml N/A export_xml N/A N/A template render N/A Context N/A tasks N/A N/A N/A task export_to_xml N/A export_filename N/A N/A exported-task-{}-{} format N/A slugify N/A task task_name N/A N/A date today N/A response N/A HttpResponse export_xml mimetype text/xml; charset=UTF-8 N/A N/A response N/A Content-Disposition N/A N/A attachment; filename="{0}.xml" format export_filename N/A response N/A staff_member_required export_agreement_data N/A N/A request task_id N/A None N/A N/A 
    Exports the agreement data for the task with the given task_id.
    
    The format per line is as follows, items are separated by tab characters.
    
    <coder>	<item>	<class>
    ...
    
     N/A task N/A get_object_or_404 EvaluationTask task_id task_id N/A result_data N/A N/A users N/A list N/A N/A N/A task users all N/A item N/A N/A N/A EvaluationItem objects filter task task N/A N/A results N/A N/A user users N/A N/A qset N/A N/A N/A EvaluationResult objects filter user user item item N/A N/A N/A qset exists N/A N/A category N/A str N/A N/A qset N/A 0 results N/A data N/A N/A {}	{}	{} format N/A user username N/A item id category N/A N/A N/A results append data N/A N/A N/A len results N/A len users N/A N/A N/A N/A result_data extend results N/A export_txt N/A N/A join result_data N/A export_filename N/A N/A agreement-data-{}-{} format N/A slugify N/A task task_name N/A N/A date today N/A response N/A HttpResponse export_txt mimetype text/plain; charset=UTF-8 N/A N/A response N/A Content-Disposition N/A N/A attachment; filename="{0}.txt" format export_filename N/A response N/A staff_member_required