Module Import alias identifier Import alias Import alias Import alias Import alias FunctionDef arguments args NameParam NameParam defaults body Assign NameStore ListLoad For NameStore Call NameLoad Call NameLoad NameLoad body Assign NameStore BinOpSub NameLoad NameLoad If CompareLt NameLoad Num body Assign NameStore Num Assign NameStore SubscriptLoad NameLoad Slice NameLoad NameLoad Expr Call AttributeLoad NameLoad attr Call AttributeLoad NameLoad attr NameLoad Return NameLoad decorator_list FunctionDef arguments args defaults body Assign NameStore SubscriptLoad Call NameLoad SubscriptLoad Call AttributeLoad NameLoad attr Call NameLoad Str Index Str Num Slice Num Assign NameStore SubscriptLoad Call NameLoad SubscriptLoad Call AttributeLoad NameLoad attr Call NameLoad Str Index Str Num Slice Num Assign NameStore SubscriptLoad Call NameLoad SubscriptLoad Call AttributeLoad NameLoad attr Call NameLoad Str Index Str Num Slice Num Assign NameStore SubscriptLoad Call NameLoad SubscriptLoad Call AttributeLoad NameLoad attr Call NameLoad Str Index Str Num Slice Num Assign NameStore SubscriptLoad Call AttributeLoad NameLoad attr Call NameLoad Str Index Str Expr Call AttributeLoad NameLoad attr NameLoad keyword Str keyword Str Expr Call AttributeLoad NameLoad attr NameLoad keyword Str keyword Str Expr Call AttributeLoad NameLoad attr NameLoad keyword Str keyword Str Expr Call AttributeLoad NameLoad attr NameLoad keyword Str keyword Str Expr Call AttributeLoad NameLoad attr NameLoad keyword Str keyword Str Expr Call AttributeLoad NameLoad attr Str Expr Call AttributeLoad NameLoad attr Str Expr Call AttributeLoad NameLoad attr keyword Str decorator_list FunctionDef arguments args NameParam NameParam NameParam defaults body If CompareEq Call NameLoad NameLoad Call NameLoad NameLoad body Assign NameStore Num Assign NameStore NameLoad For NameStore NameLoad body Assign NameStore Call AttributeLoad NameLoad attr SubscriptLoad NameLoad Index NameLoad If CompareEq NameLoad NameLoad body Return NameLoad If CompareEq NameLoad NameLoad body Assign NameStore Call NameLoad Call AttributeLoad NameLoad attr Num AugAssignAdd NameStore Num Return NameLoad orelse Return NameLoad decorator_list FunctionDef arguments args NameParam NameParam NameParam NameParam defaults Num NameLoad body Assign NameStore ListLoad Assign NameStore ListLoad Assign NameStore NameLoad Assign NameStore NameLoad With Call NameLoad BinOpAdd Str NameLoad NameStore body Assign NameStore Call AttributeLoad NameLoad attr NameLoad Print NameLoad Assign NameStore Call AttributeLoad NameLoad attr Str Assign NameStore ListLoad Assign NameStore Num For NameStore NameLoad body Expr Call AttributeLoad NameLoad attr Call AttributeLoad NameLoad attr NameLoad If CompareEq NameLoad NameLoad body Print BinOpAdd Str NameLoad orelse Print BinOpAdd Str NameLoad AugAssignAdd NameStore Num For NameStore NameLoad body Assign NameStore Call NameLoad NameLoad NameLoad NameLoad If CompareNotEq NameLoad NameLoad body Expr Call AttributeLoad NameLoad attr NameLoad Expr Call AttributeLoad NameLoad attr SubscriptLoad NameLoad Index NameLoad Assign NameStore Call NameLoad NameLoad If BoolOpOr CompareEq NameLoad NameLoad CompareGt NameLoad NameLoad body Assign NameStore NameLoad If BoolOpOr CompareEq NameLoad NameLoad CompareLt NameLoad NameLoad body Assign NameStore NameLoad If CompareEq Call NameLoad NameLoad Num body Print SubscriptLoad NameLoad Index NameLoad Print Str Assign NameStore BinOpMult ListLoad NameLoad Call NameLoad BinOpSub BinOpAdd NameLoad Num NameLoad For NameStore Call NameLoad Num Call NameLoad NameLoad body Assign NameStore SubscriptLoad NameLoad Index NameLoad Assign NameStore SubscriptLoad NameLoad Index NameLoad Assign NameStore Call NameLoad Call NameLoad NameLoad If CompareEq NameLoad Num body Print NameLoad If CompareEq SubscriptLoad NameLoad Index NameLoad NameLoad body Assign SubscriptStore NameLoad Index NameLoad ListLoad NameLoad orelse Expr Call AttributeLoad SubscriptLoad NameLoad Index NameLoad attr NameLoad Assign NameStore ListLoad Assign NameStore ListLoad Print Str For NameStore Call NameLoad Num Call NameLoad NameLoad body Assign NameStore Num Assign NameStore Call NameLoad BinOpAdd NameLoad NameLoad For NameStore SubscriptLoad NameLoad Index NameLoad body AugAssignAdd NameStore NameLoad Expr Call AttributeLoad NameLoad attr NameLoad If CompareEq Call NameLoad BinOpAdd NameLoad NameLoad Num body Print Str Print BinOpDiv NameLoad Call NameLoad SubscriptLoad NameLoad Index NameLoad Expr Call AttributeLoad NameLoad attr BinOpDiv NameLoad Call NameLoad SubscriptLoad NameLoad Index NameLoad If NameLoad body Expr Call AttributeLoad NameLoad attr NameLoad NameLoad Expr Call AttributeLoad NameLoad attr Str Expr Call AttributeLoad NameLoad attr Str Expr Call AttributeLoad NameLoad attr Str Expr Call AttributeLoad NameLoad attr Return TupleLoad NameLoad NameLoad decorator_list FunctionDef arguments args NameParam defaults body If CompareLt Call NameLoad NameLoad Num body Print Str Print Str Return If CompareEq Call NameLoad NameLoad Num body Expr Call NameLoad SubscriptLoad NameLoad Index Num SubscriptLoad NameLoad Index Num Call NameLoad SubscriptLoad NameLoad Index Num orelse If CompareEq Call NameLoad NameLoad Num body Assign TupleStore NameStore NameStore Call NameLoad SubscriptLoad NameLoad Index Num SubscriptLoad NameLoad Index Num Call NameLoad SubscriptLoad NameLoad Index Num Assign TupleStore NameStore NameStore Call NameLoad SubscriptLoad NameLoad Index Num SubscriptLoad NameLoad Index Num Call NameLoad SubscriptLoad NameLoad Index Num orelse Expr Call NameLoad SubscriptLoad NameLoad Index Num SubscriptLoad NameLoad Index Num decorator_list Expr Call NameLoad AttributeLoad NameLoad attr
N/A N/A matplotlib.pyplot plt N/A os N/A pickle N/A re N/A sys moving_average N/A N/A array over N/A N/A N/A averages N/A N/A x N/A xrange N/A len array N/A N/A base_index N/A x over N/A N/A base_index 0 N/A N/A base_index 0 N/A vals N/A array N/A base_index x N/A N/A N/A averages append N/A N/A np mean vals N/A averages N/A plotting_scratch_work N/A N/A N/A N/A N/A qlin N/A N/A moving_average N/A N/A N/A np load N/A open latest_first_run_linear.npz N/A rewards 100 N/A 2200 N/A sar0 N/A N/A moving_average N/A N/A N/A np load N/A open sarsa0rewards.npz N/A rewards 100 N/A 2200 N/A sar50 N/A N/A moving_average N/A N/A N/A np load N/A open sarsa50rewards.npz N/A rewards 100 N/A 2200 N/A sar98 N/A N/A moving_average N/A N/A N/A np load N/A open sarsa98rewards.npz N/A rewards 100 N/A 2200 N/A rand N/A N/A N/A np load N/A open random_latest.npz N/A rewards N/A N/A N/A plt plot qlin color b label replay memory q-learning N/A N/A N/A plt plot sar0 color c label sarsa lambda = 0.0 N/A N/A N/A plt plot sar50 color r label sarsa lambda = 0.50 N/A N/A N/A plt plot sar98 color g label sarsa lambda = 0.98 N/A N/A N/A plt plot rand color k label random N/A N/A N/A plt xlabel Episodes N/A N/A N/A plt ylabel Adjusted Score N/A N/A N/A plt legend loc upper left N/A weight_key_matches N/A N/A weight_key_tuple regexes domain_index N/A N/A N/A N/A N/A len weight_key_tuple N/A len regexes N/A N/A on_regex 0 N/A stored_domain None N/A regex regexes N/A N/A match N/A N/A regex match N/A weight_key_tuple N/A on_regex N/A N/A match None N/A N/A None N/A N/A on_regex domain_index N/A N/A stored_domain N/A float N/A N/A match group 1 N/A on_regex 1 N/A stored_domain N/A N/A None N/A graph N/A N/A weight_filename weight_str domain_from_regex plot N/A 0 True N/A N/A domain_val N/A N/A range_val N/A N/A min None N/A max None N/A N/A open N/A weights/ weight_filename weight_file N/A N/A weights N/A N/A pickle load weight_file N/A weights N/A key_tuple_components N/A N/A weight_str split | N/A regexes N/A N/A on_regex 0 N/A regex_str key_tuple_components N/A N/A N/A N/A regexes append N/A N/A re compile regex_str N/A N/A on_regex domain_from_regex N/A N/A N/A Adding key regex (+domain):  regex_str N/A N/A N/A Adding key regex:  regex_str N/A on_regex 1 N/A weight_key_tuple weights N/A N/A match_domain N/A weight_key_matches weight_key_tuple regexes domain_from_regex N/A N/A match_domain None N/A N/A N/A N/A domain_val append match_domain N/A N/A N/A range_val append N/A weights N/A weight_key_tuple N/A roundedD N/A round match_domain N/A N/A N/A max None N/A roundedD max N/A N/A max roundedD N/A N/A N/A min None N/A roundedD min N/A N/A min roundedD N/A N/A N/A int roundedD 5 N/A N/A N/A weights N/A weight_key_tuple N/A N/A domain_buckets N/A N/A None N/A int N/A N/A max 1 min N/A i N/A range 0 N/A len domain_val N/A N/A d_v N/A domain_val N/A i N/A r_v N/A range_val N/A i N/A roundedD N/A int N/A round d_v N/A N/A roundedD 5 N/A N/A r_v N/A N/A N/A domain_buckets N/A roundedD None N/A N/A N/A domain_buckets N/A roundedD N/A r_v N/A N/A N/A N/A N/A domain_buckets N/A roundedD append r_v N/A domain_val N/A N/A range_val N/A N/A N/A i N/A range 0 N/A len domain_buckets N/A N/A total 0.0 N/A domain_v N/A int N/A min i N/A range_v N/A domain_buckets N/A domain_v N/A N/A total range_v N/A N/A N/A domain_val append domain_v N/A N/A N/A int N/A min i 5 N/A N/A N/A N/A total N/A len N/A domain_buckets N/A domain_v N/A N/A N/A range_val append N/A total N/A len N/A domain_buckets N/A domain_v N/A plot N/A N/A N/A N/A plt scatter domain_val range_val N/A N/A N/A plt xlabel X Position (Paddle) N/A N/A N/A plt ylabel Feature Weight N/A N/A N/A plt title Paddle X-Position Feature Cross Action 3 N/A N/A N/A plt show N/A N/A domain_val range_val N/A main N/A N/A argv N/A N/A N/A N/A N/A len argv 3 N/A N/A usage: python graph_util.y [weight_filename] [weight_regex_string] [optional_group_to_match N/A example: python scripts/weight_util.py 3bucket.pkl "diff\-x\-pos\-(\-?[0-9]+)|action\-3" 0 N/A N/A N/A N/A len argv 4 N/A N/A N/A graph N/A argv N/A 1 N/A argv N/A 2 N/A int N/A argv N/A 3 N/A N/A N/A N/A len argv 5 N/A N/A N/A d r N/A graph N/A argv N/A 1 N/A argv N/A 2 N/A int N/A argv N/A 4 N/A N/A d2 r2 N/A graph N/A argv N/A 1 N/A argv N/A 3 N/A int N/A argv N/A 4 N/A N/A N/A graph N/A argv N/A 1 N/A argv N/A 2 N/A N/A N/A main N/A sys argv