Module Import alias Import alias Import alias Import alias Import alias Import alias Import alias ImportFrom alias identifier Assign NameStore Str ClassDef bases body FunctionDef arguments args NameParam NameParam defaults body Return BinOpDiv Num BinOpAdd Num BinOpPow Num UnaryOpUSub NameLoad decorator_list FunctionDef arguments args NameParam NameParam defaults body AugAssignMult AttributeStore NameLoad attr NameLoad Assign SubscriptStore AttributeLoad NameLoad attr Index Str BinOpMod Str AttributeLoad NameLoad attr decorator_list FunctionDef arguments args NameParam NameParam defaults body AugAssignAdd AttributeStore NameLoad attr NameLoad Assign AttributeStore NameLoad attr Call AttributeLoad NameLoad attr AttributeLoad NameLoad attr Expr Call AttributeLoad AttributeLoad NameLoad attr attr AttributeLoad NameLoad attr Assign SubscriptStore AttributeLoad NameLoad attr Index Str BinOpMod Str AttributeLoad NameLoad attr decorator_list FunctionDef arguments args NameParam NameParam defaults body AugAssignAdd AttributeStore NameLoad attr NameLoad Assign AttributeStore NameLoad attr Call AttributeLoad NameLoad attr AttributeLoad NameLoad attr Expr Call AttributeLoad AttributeLoad NameLoad attr attr AttributeLoad NameLoad attr Assign SubscriptStore AttributeLoad NameLoad attr Index Str BinOpMod Str AttributeLoad NameLoad attr decorator_list FunctionDef arguments args NameParam NameParam defaults body AugAssignAdd AttributeStore NameLoad attr NameLoad Assign AttributeStore NameLoad attr Call AttributeLoad NameLoad attr AttributeLoad NameLoad attr Expr Call AttributeLoad AttributeLoad NameLoad attr attr AttributeLoad NameLoad attr Assign SubscriptStore AttributeLoad NameLoad attr Index Str BinOpMod Str AttributeLoad NameLoad attr decorator_list FunctionDef arguments args NameParam NameParam defaults body Assign AttributeStore NameLoad attr NameLoad Expr Call AttributeLoad NameLoad attr Assign AttributeStore NameLoad attr Num Assign AttributeStore NameLoad attr Num Assign AttributeStore NameLoad attr Num Expr Call AttributeLoad NameLoad attr NameLoad Expr Call AttributeLoad NameLoad attr NameLoad Expr Call AttributeLoad NameLoad attr NameLoad Expr Call AttributeLoad NameLoad attr NameLoad Assign AttributeStore NameLoad attr Call AttributeLoad NameLoad attr NameLoad keyword Num keyword Num Expr Call AttributeLoad AttributeLoad NameLoad attr attr keyword Num keyword Num decorator_list FunctionDef arguments args NameParam NameParam defaults body Assign AttributeStore NameLoad attr Call AttributeLoad NameLoad attr NameLoad keyword Str keyword Lambda arguments args defaults Call AttributeLoad NameLoad attr AttributeLoad NameLoad attr Expr Call AttributeLoad AttributeLoad NameLoad attr attr keyword Num keyword Num keyword Num Assign AttributeStore NameLoad attr Call AttributeLoad NameLoad attr AttributeLoad NameLoad attr Assign AttributeStore NameLoad attr Call AttributeLoad NameLoad attr NameLoad keyword BinOpMod Str AttributeLoad NameLoad attr Expr Call AttributeLoad AttributeLoad NameLoad attr attr keyword Num keyword Num Assign AttributeStore NameLoad attr Call AttributeLoad NameLoad attr NameLoad keyword Str keyword Lambda arguments args defaults Call AttributeLoad NameLoad attr AttributeLoad NameLoad attr Expr Call AttributeLoad AttributeLoad NameLoad attr attr keyword Num keyword Num keyword Num decorator_list FunctionDef arguments args NameParam NameParam defaults body Assign AttributeStore NameLoad attr Call AttributeLoad NameLoad attr NameLoad keyword Str keyword Lambda arguments args defaults Call AttributeLoad NameLoad attr AttributeLoad NameLoad attr Expr Call AttributeLoad AttributeLoad NameLoad attr attr keyword Num keyword Num keyword Num Assign AttributeStore NameLoad attr Call AttributeLoad NameLoad attr AttributeLoad NameLoad attr Assign AttributeStore NameLoad attr Call AttributeLoad NameLoad attr NameLoad keyword BinOpMod Str AttributeLoad NameLoad attr Expr Call AttributeLoad AttributeLoad NameLoad attr attr keyword Num keyword Num Assign AttributeStore NameLoad attr Call AttributeLoad NameLoad attr NameLoad keyword Str keyword Lambda arguments args defaults Call AttributeLoad NameLoad attr AttributeLoad NameLoad attr Expr Call AttributeLoad AttributeLoad NameLoad attr attr keyword Num keyword Num keyword Num decorator_list FunctionDef arguments args NameParam NameParam defaults body Assign AttributeStore NameLoad attr Call AttributeLoad NameLoad attr NameLoad keyword Str keyword Lambda arguments args defaults Call AttributeLoad NameLoad attr AttributeLoad NameLoad attr Expr Call AttributeLoad AttributeLoad NameLoad attr attr keyword Num keyword Num Assign AttributeStore NameLoad attr Call AttributeLoad NameLoad attr AttributeLoad NameLoad attr Assign AttributeStore NameLoad attr Call AttributeLoad NameLoad attr NameLoad keyword BinOpMod Str AttributeLoad NameLoad attr Expr Call AttributeLoad AttributeLoad NameLoad attr attr keyword Num keyword Num Assign AttributeStore NameLoad attr Call AttributeLoad NameLoad attr NameLoad keyword Str keyword Lambda arguments args defaults Call AttributeLoad NameLoad attr AttributeLoad NameLoad attr Expr Call AttributeLoad AttributeLoad NameLoad attr attr keyword Num keyword Num decorator_list FunctionDef arguments args NameParam NameParam defaults body Assign AttributeStore NameLoad attr Call AttributeLoad NameLoad attr NameLoad keyword Str keyword Lambda arguments args defaults Call AttributeLoad NameLoad attr Num Expr Call AttributeLoad AttributeLoad NameLoad attr attr keyword Num keyword Num Assign AttributeStore NameLoad attr Call AttributeLoad NameLoad attr NameLoad keyword BinOpMod Str AttributeLoad NameLoad attr Expr Call AttributeLoad AttributeLoad NameLoad attr attr keyword Num keyword Num Assign AttributeStore NameLoad attr Call AttributeLoad NameLoad attr NameLoad keyword Str keyword Lambda arguments args defaults Call AttributeLoad NameLoad attr Num Expr Call AttributeLoad AttributeLoad NameLoad attr attr keyword Num keyword Num decorator_list FunctionDef arguments args NameParam defaults body Assign AttributeStore NameLoad attr Num decorator_list FunctionDef arguments args NameParam NameParam defaults body Assign AttributeStore NameLoad attr Num Assign AttributeStore NameLoad attr Num Assign AttributeStore NameLoad attr Num Assign AttributeStore NameLoad attr Num Expr Call AttributeLoad NameLoad attr NameLoad If CompareEq NameLoad Str body Assign AttributeStore NameLoad attr Call AttributeLoad NameLoad attr AttributeLoad NameLoad attr Assign AttributeStore NameLoad attr Call AttributeLoad NameLoad attr AttributeLoad NameLoad attr orelse If CompareEq NameLoad Str body Assign AttributeStore NameLoad attr Call AttributeLoad NameLoad attr AttributeLoad NameLoad attr Assign AttributeStore NameLoad attr Call AttributeLoad NameLoad attr AttributeLoad NameLoad attr orelse Raise Str Assign NameStore Lambda arguments args NameParam defaults Call AttributeLoad NameLoad attr AttributeLoad NameLoad attr NameLoad Assign NameStore Lambda arguments args NameParam defaults Call AttributeLoad AttributeLoad NameLoad attr attr NameLoad Assign AttributeStore NameLoad attr Call AttributeLoad NameLoad attr keyword NameLoad Expr Call AttributeLoad AttributeLoad NameLoad attr attr AttributeLoad NameLoad attr Expr Call AttributeLoad AttributeLoad NameLoad attr attr AttributeLoad NameLoad attr Expr Call AttributeLoad AttributeLoad NameLoad attr attr AttributeLoad NameLoad attr Assign AttributeStore NameLoad attr NameLoad Assign AttributeStore NameLoad attr NameLoad Assign AttributeStore NameLoad attr Num Assign AttributeStore NameLoad attr Call AttributeLoad NameLoad attr keyword AttributeLoad NameLoad attr Expr Call AttributeLoad AttributeLoad NameLoad attr attr decorator_list FunctionDef arguments args NameParam defaults body Assign AttributeStore NameLoad attr NameLoad For NameStore Call NameLoad Num body If UnaryOpNot AttributeLoad NameLoad attr body Expr Call AttributeLoad NameLoad attr Num TryExcept body Expr Call AttributeLoad AttributeLoad NameLoad attr attr handlers ExceptHandler body Pass Expr Call AttributeLoad NameLoad attr Num decorator_list FunctionDef arguments args NameParam defaults body AugAssignAdd AttributeStore NameLoad attr Num Assign NameStore Call AttributeLoad AttributeLoad NameLoad attr attr Assign NameStore Call AttributeLoad AttributeLoad NameLoad attr attr NameLoad If CompareEq Call NameLoad NameLoad Num body Expr Call AttributeLoad AttributeLoad NameLoad attr attr Assign NameStore Call AttributeLoad AttributeLoad NameLoad attr attr Assign NameStore Call AttributeLoad AttributeLoad NameLoad attr attr NameLoad Print Str Assign NameStore Call AttributeLoad AttributeLoad NameLoad attr attr NameLoad If CompareIs NameLoad NameLoad body Raise Str Assign TupleStore NameStore NameStore Call AttributeLoad AttributeLoad NameLoad attr attr NameLoad Expr Call AttributeLoad AttributeLoad NameLoad attr attr NameLoad NameLoad NameLoad NameLoad decorator_list FunctionDef arguments args NameParam defaults body If CompareNotEq NameLoad Str body Raise Str Assign NameStore Call AttributeLoad AttributeLoad NameLoad attr attr Assign NameStore Call AttributeLoad AttributeLoad NameLoad attr attr Assign NameStore BinOpMult Num Call NameLoad NameLoad NameLoad Assign TupleStore NameStore NameStore TupleLoad BinOpSub BinOpSub NameLoad NameLoad Num BinOpAdd NameLoad Num Assign TupleStore NameStore NameStore Call AttributeLoad AttributeLoad NameLoad attr attr Assign TupleStore NameStore NameStore Call AttributeLoad AttributeLoad NameLoad attr attr If UnaryOpNot CompareIn Str Call NameLoad NameLoad body Expr Call AttributeLoad AttributeLoad NameLoad attr attr NameLoad NameLoad BinOpAdd NameLoad NameLoad NameLoad Expr Call AttributeLoad AttributeLoad NameLoad attr attr BinOpAdd NameLoad NameLoad NameLoad BinOpAdd NameLoad NameLoad BinOpSub NameLoad NameLoad Expr Call AttributeLoad AttributeLoad NameLoad attr attr BinOpAdd NameLoad NameLoad BinOpSub NameLoad NameLoad NameLoad BinOpSub NameLoad NameLoad Expr Call AttributeLoad AttributeLoad NameLoad attr attr NameLoad BinOpSub NameLoad NameLoad NameLoad NameLoad Assign AttributeStore NameLoad attr Num Expr Call AttributeLoad AttributeLoad NameLoad attr attr BinOpAdd NameLoad BinOpDiv NameLoad Num BinOpAdd NameLoad Num keyword Str Expr Call AttributeLoad AttributeLoad NameLoad attr attr BinOpSub NameLoad Num BinOpSub NameLoad BinOpDiv NameLoad Num keyword Str Expr Call AttributeLoad AttributeLoad NameLoad attr attr BinOpSub NameLoad Num BinOpSub NameLoad BinOpDiv NameLoad Num keyword Str Expr Call AttributeLoad AttributeLoad NameLoad attr attr BinOpSub NameLoad Num BinOpAdd BinOpSub NameLoad BinOpDiv NameLoad Num Num keyword Str Expr Call AttributeLoad AttributeLoad NameLoad attr attr BinOpSub NameLoad Num BinOpAdd BinOpSub NameLoad BinOpDiv NameLoad Num Num keyword Str Assign NameStore BinOpDiv BinOpSub NameLoad NameLoad Num Assign NameStore BinOpDiv BinOpSub NameLoad NameLoad Num For NameStore Call NameLoad Num body Assign NameStore BinOpAdd NameLoad BinOpMult NameLoad NameLoad For NameStore Call NameLoad Num body Assign NameStore BinOpAdd NameLoad BinOpMult NameLoad NameLoad Assign NameStore Call AttributeLoad AttributeLoad NameLoad attr attr NameLoad NameLoad Assign TupleStore NameStore NameStore TupleLoad NameLoad NameLoad If UnaryOpNot Call AttributeLoad AttributeLoad NameLoad attr attr NameLoad body Assign NameStore Str orelse For NameStore TupleLoad Str Str Str body Assign NameStore Call AttributeLoad AttributeLoad NameLoad attr attr NameLoad NameLoad If BoolOpOr CompareIs NameLoad NameLoad CompareGt NameLoad NameLoad body Assign TupleStore NameStore NameStore TupleLoad NameLoad NameLoad If CompareNotEq NameLoad Str body If CompareEq NameLoad Str body Assign NameStore Str orelse If CompareEq NameLoad Str body Assign NameStore Str orelse If CompareEq NameLoad Str body Assign NameStore Str Assign NameStore BinOpDiv NameLoad Num Assign NameStore BinOpDiv NameLoad Num Assign TupleStore NameStore NameStore TupleLoad BinOpAdd NameLoad BinOpMult NameLoad NameLoad BinOpSub NameLoad BinOpMult NameLoad NameLoad Expr Call AttributeLoad AttributeLoad NameLoad attr attr NameLoad NameLoad BinOpAdd NameLoad NameLoad BinOpAdd NameLoad NameLoad keyword NameLoad decorator_list FunctionDef arguments args NameParam defaults body Assign AttributeStore NameLoad attr Num Expr Call AttributeLoad AttributeLoad NameLoad attr attr While NameLoad body Assign NameStore Num Assign NameStore Call NameLoad NameLoad AttributeLoad NameLoad attr Expr Call AttributeLoad NameLoad attr NameLoad Assign AttributeStore NameLoad attr BinOpSub Call NameLoad BinOpDiv NameLoad AttributeLoad NameLoad attr Num If UnaryOpNot AttributeLoad NameLoad attr body Assign AttributeStore NameLoad attr NameLoad Return For NameStore Call NameLoad AttributeLoad NameLoad attr body Expr Call AttributeLoad NameLoad attr Assign AttributeStore NameLoad attr Num Expr Call AttributeLoad NameLoad attr Expr Call AttributeLoad AttributeLoad NameLoad attr attr decorator_list FunctionDef arguments args NameParam defaults body Expr Call AttributeLoad AttributeLoad NameLoad attr attr decorator_list decorator_list FunctionDef arguments args defaults body Global identifier Assign NameStore Call AttributeLoad NameLoad attr Expr Call AttributeLoad NameLoad attr Str Expr Call AttributeLoad NameLoad attr Num Num Assign NameStore Call NameLoad NameLoad FunctionDef arguments args defaults body Expr Call AttributeLoad AttributeLoad NameLoad attr attr AttributeLoad NameLoad attr AttributeLoad NameLoad attr Expr Call AttributeLoad NameLoad attr Num NameLoad decorator_list Expr Call NameLoad Expr Call AttributeLoad NameLoad attr Str AttributeLoad NameLoad attr TryExcept body Expr Call AttributeLoad NameLoad attr handlers ExceptHandler body Expr Call AttributeLoad NameLoad attr decorator_list
N/A N/A Tkinter N/A qlearningAgents N/A time N/A threading N/A sys N/A crawler N/A math math pi PI N/A robotType crawler Application N/A N/A sigmoid N/A N/A self x N/A N/A N/A N/A 1.0 N/A 1.0 N/A 2.0 N/A x N/A incrementSpeed N/A N/A self inc N/A N/A N/A N/A self tickTime inc N/A N/A N/A self speed_label N/A text N/A Step Delay: %.5f N/A self tickTime N/A incrementEpsilon N/A N/A self inc N/A N/A N/A N/A self ep inc N/A N/A self epsilon N/A N/A self sigmoid N/A self ep N/A N/A N/A N/A self learner setEpsilon N/A self epsilon N/A N/A N/A self epsilon_label N/A text N/A Epsilon: %.3f N/A self epsilon N/A incrementGamma N/A N/A self inc N/A N/A N/A N/A self ga inc N/A N/A self gamma N/A N/A self sigmoid N/A self ga N/A N/A N/A N/A self learner setDiscount N/A self gamma N/A N/A N/A self gamma_label N/A text N/A Discount: %.3f N/A self gamma N/A incrementAlpha N/A N/A self inc N/A N/A N/A N/A self al inc N/A N/A self alpha N/A N/A self sigmoid N/A self al N/A N/A N/A N/A self learner setLearningRate N/A self alpha N/A N/A N/A self alpha_label N/A text N/A Learning Rate: %.3f N/A self alpha N/A __initGUI N/A N/A self win N/A N/A N/A N/A self win win N/A N/A N/A win grid N/A N/A self dec -0.5 N/A N/A self inc 0.5 N/A N/A self tickTime 0.1 N/A N/A N/A self setupSpeedButtonAndLabel win N/A N/A N/A self setupEpsilonButtonAndLabel win N/A N/A N/A self setUpGammaButtonAndLabel win N/A N/A N/A self setupAlphaButtonAndLabel win N/A N/A self canvas N/A N/A Tkinter Canvas root height 200 width 1000 N/A N/A N/A N/A self canvas grid row 2 columnspan 10 N/A setupAlphaButtonAndLabel N/A N/A self win N/A N/A N/A N/A self alpha_minus N/A N/A Tkinter Button win text - command N/A N/A N/A N/A N/A N/A self incrementAlpha N/A self dec N/A N/A N/A N/A self alpha_minus grid row 1 column 3 padx 10 N/A N/A self alpha N/A N/A self sigmoid N/A self al N/A N/A self alpha_label N/A N/A Tkinter Label win text N/A Learning Rate: %.3f N/A self alpha N/A N/A N/A N/A self alpha_label grid row 1 column 4 N/A N/A self alpha_plus N/A N/A Tkinter Button win text + command N/A N/A N/A N/A N/A N/A self incrementAlpha N/A self inc N/A N/A N/A N/A self alpha_plus grid row 1 column 5 padx 10 N/A setUpGammaButtonAndLabel N/A N/A self win N/A N/A N/A N/A self gamma_minus N/A N/A Tkinter Button win text - command N/A N/A N/A N/A N/A N/A self incrementGamma N/A self dec N/A N/A N/A N/A self gamma_minus grid row 1 column 0 padx 10 N/A N/A self gamma N/A N/A self sigmoid N/A self ga N/A N/A self gamma_label N/A N/A Tkinter Label win text N/A Discount: %.3f N/A self gamma N/A N/A N/A N/A self gamma_label grid row 1 column 1 N/A N/A self gamma_plus N/A N/A Tkinter Button win text + command N/A N/A N/A N/A N/A N/A self incrementGamma N/A self inc N/A N/A N/A N/A self gamma_plus grid row 1 column 2 padx 10 N/A setupEpsilonButtonAndLabel N/A N/A self win N/A N/A N/A N/A self epsilon_minus N/A N/A Tkinter Button win text - command N/A N/A N/A N/A N/A N/A self incrementEpsilon N/A self dec N/A N/A N/A N/A self epsilon_minus grid row 0 column 3 N/A N/A self epsilon N/A N/A self sigmoid N/A self ep N/A N/A self epsilon_label N/A N/A Tkinter Label win text N/A Epsilon: %.3f N/A self epsilon N/A N/A N/A N/A self epsilon_label grid row 0 column 4 N/A N/A self epsilon_plus N/A N/A Tkinter Button win text + command N/A N/A N/A N/A N/A N/A self incrementEpsilon N/A self inc N/A N/A N/A N/A self epsilon_plus grid row 0 column 5 N/A setupSpeedButtonAndLabel N/A N/A self win N/A N/A N/A N/A self speed_minus N/A N/A Tkinter Button win text - command N/A N/A N/A N/A N/A N/A self incrementSpeed 0.5 N/A N/A N/A N/A self speed_minus grid row 0 column 0 N/A N/A self speed_label N/A N/A Tkinter Label win text N/A Step Delay: %.5f N/A self tickTime N/A N/A N/A N/A self speed_label grid row 0 column 1 N/A N/A self speed_plus N/A N/A Tkinter Button win text + command N/A N/A N/A N/A N/A N/A self incrementSpeed 2 N/A N/A N/A N/A self speed_plus grid row 0 column 2 N/A skip5kSteps N/A N/A self N/A N/A N/A N/A self stepsToSkip 5000 N/A __init__ N/A N/A self win N/A N/A N/A N/A self ep 0 N/A N/A self ga 2 N/A N/A self al 2 N/A N/A self stepCount 0 N/A N/A N/A self __initGUI win N/A N/A robotType crawler N/A N/A N/A self robot N/A N/A crawler CrawlingRobot N/A self canvas N/A N/A self robotEnvironment N/A N/A crawler CrawlingRobotEnvironment N/A self robot N/A N/A N/A robotType pendulum N/A N/A N/A self robot N/A N/A pendulum PendulumRobot N/A self canvas N/A N/A self robotEnvironment N/A N/A pendulum PendulumRobotEnvironment N/A self robot N/A N/A Unknown RobotType N/A simulationFn N/A N/A N/A agent N/A N/A N/A simulation SimulationEnvironment N/A self robotEnvironment agent N/A actionFn N/A N/A N/A state N/A N/A N/A N/A self robotEnvironment getPossibleActions state N/A N/A self learner N/A N/A qlearningAgents QLearningAgent actionFn actionFn N/A N/A N/A N/A self learner setEpsilon N/A self epsilon N/A N/A N/A N/A self learner setLearningRate N/A self alpha N/A N/A N/A N/A self learner setDiscount N/A self gamma N/A N/A self running True N/A N/A self stopped False N/A N/A self stepsToSkip 0 N/A N/A self thread N/A N/A threading Thread target N/A self run N/A N/A N/A N/A self thread start N/A exit N/A N/A self N/A N/A N/A N/A self running False N/A i N/A range 5 N/A N/A N/A N/A self stopped N/A N/A N/A N/A time sleep 0.1 N/A N/A N/A N/A N/A N/A self win destroy N/A N/A N/A N/A N/A N/A N/A sys exit 0 N/A step N/A N/A self N/A N/A N/A N/A self stepCount 1 N/A state N/A N/A N/A self robotEnvironment getCurrentState N/A actions N/A N/A N/A self robotEnvironment getPossibleActions state N/A N/A N/A len actions 0.0 N/A N/A N/A N/A N/A self robotEnvironment reset N/A state N/A N/A N/A self robotEnvironment getCurrentState N/A actions N/A N/A N/A self robotEnvironment getPossibleActions state N/A Reset! N/A action N/A N/A N/A self learner getAction state N/A N/A action None N/A N/A None action returned: Code Not Complete N/A N/A nextState reward N/A N/A N/A self robotEnvironment doAction action N/A N/A N/A N/A self learner observeTransition state action nextState reward N/A animatePolicy N/A N/A self N/A N/A N/A N/A robotType pendulum N/A N/A Only pendulum can animatePolicy N/A totWidth N/A N/A N/A self canvas winfo_reqwidth N/A totHeight N/A N/A N/A self canvas winfo_reqheight N/A length N/A 0.48 N/A min totWidth totHeight N/A N/A x y N/A N/A N/A totWidth length 30 N/A length 10 N/A N/A angleMin angleMax N/A N/A N/A self robot getMinAndMaxAngle N/A N/A velMin velMax N/A N/A N/A self robot getMinAndMaxAngleVelocity N/A N/A N/A animatePolicyBox N/A dir self N/A N/A N/A N/A N/A self canvas create_line x y N/A x length y N/A N/A N/A N/A self canvas create_line N/A x length y N/A x length N/A y length N/A N/A N/A N/A self canvas create_line N/A x length N/A y length x N/A y length N/A N/A N/A N/A self canvas create_line x N/A y length x y N/A N/A self animatePolicyBox 1 N/A N/A N/A N/A self canvas create_text N/A x N/A length 2 N/A y 10 text angle N/A N/A N/A N/A self canvas create_text N/A x 30 N/A y N/A length 2 text velocity N/A N/A N/A N/A self canvas create_text N/A x 60 N/A y N/A length 4 text Blue = kickLeft N/A N/A N/A N/A self canvas create_text N/A x 60 N/A N/A y N/A length 4 20 text Red = kickRight N/A N/A N/A N/A self canvas create_text N/A x 60 N/A N/A y N/A length 4 40 text White = doNothing N/A angleDelta N/A N/A angleMax angleMin 100 N/A velDelta N/A N/A velMax velMin 100 N/A i N/A range 100 N/A N/A angle N/A angleMin N/A i angleDelta N/A j N/A range 100 N/A N/A vel N/A velMin N/A j velDelta N/A state N/A N/A N/A self robotEnvironment getState angle vel N/A N/A max argMax N/A None None N/A N/A N/A N/A N/A self learner seenState state N/A N/A argMax unseen N/A N/A action N/A kickLeft kickRight doNothing N/A N/A qVal N/A N/A N/A self learner getQValue state action N/A N/A N/A max None N/A qVal max N/A N/A N/A max argMax N/A qVal action N/A N/A argMax unseen N/A N/A N/A argMax kickLeft N/A N/A color blue N/A N/A N/A argMax kickRight N/A N/A color red N/A N/A N/A argMax doNothing N/A N/A color white N/A dx N/A length 100.0 N/A dy N/A length 100.0 N/A N/A x0 y0 N/A N/A x N/A i dx N/A y N/A j dy N/A N/A N/A N/A self canvas create_rectangle x0 y0 N/A x0 dx N/A y0 dy fill color N/A run N/A N/A self N/A N/A N/A N/A self stepCount 0 N/A N/A N/A N/A self learner startEpisode N/A True N/A N/A minSleep 0.01 N/A tm N/A max minSleep N/A self tickTime N/A N/A N/A time sleep tm N/A N/A self stepsToSkip N/A N/A int N/A tm N/A self tickTime 1 N/A N/A N/A self running N/A N/A N/A self stopped True N/A N/A i N/A range N/A self stepsToSkip N/A N/A N/A N/A self step N/A N/A self stepsToSkip 0 N/A N/A N/A self step N/A N/A N/A N/A self learner stopEpisode N/A start N/A N/A self N/A N/A N/A N/A N/A N/A self win mainloop N/A N/A run N/A N/A N/A N/A N/A root N/A root N/A N/A Tkinter Tk N/A N/A N/A root title Crawler GUI N/A N/A N/A root resizable 0 0 N/A app N/A Application root update_gui N/A N/A N/A N/A N/A N/A N/A N/A app robot draw N/A app stepCount N/A app tickTime N/A N/A N/A root after 10 update_gui N/A N/A N/A update_gui N/A N/A N/A root protocol WM_DELETE_WINDOW N/A app exit N/A N/A N/A N/A N/A app start N/A N/A N/A N/A N/A N/A app exit N/A