2022-12-10 09:59:44 - r - INFO: - Hyperparameters:
2022-12-10 09:59:44 - r - INFO: - ================================================================================
2022-12-10 09:59:44 - r - INFO: -         Name        	       Value        	        Type        
2022-12-10 09:59:44 - r - INFO: -       env_name      	  CliffWalking-v0   	   <class 'str'>    
2022-12-10 09:59:44 - r - INFO: -     new_step_api    	         1          	   <class 'bool'>   
2022-12-10 09:59:44 - r - INFO: -       wrapper       	envs.wrappers.CliffWalkingWapper	   <class 'str'>    
2022-12-10 09:59:44 - r - INFO: -        render       	         0          	   <class 'bool'>   
2022-12-10 09:59:44 - r - INFO: -      algo_name      	       DynaQ        	   <class 'str'>    
2022-12-10 09:59:44 - r - INFO: -         mode        	        test        	   <class 'str'>    
2022-12-10 09:59:44 - r - INFO: -         seed        	         1          	   <class 'int'>    
2022-12-10 09:59:44 - r - INFO: -        device       	        cpu         	   <class 'str'>    
2022-12-10 09:59:44 - r - INFO: -      train_eps      	        100         	   <class 'int'>    
2022-12-10 09:59:44 - r - INFO: -       test_eps      	         10         	   <class 'int'>    
2022-12-10 09:59:44 - r - INFO: -       eval_eps      	         10         	   <class 'int'>    
2022-12-10 09:59:44 - r - INFO: -   eval_per_episode  	         5          	   <class 'int'>    
2022-12-10 09:59:44 - r - INFO: -      max_steps      	        100         	   <class 'int'>    
2022-12-10 09:59:44 - r - INFO: -   load_checkpoint   	         1          	   <class 'bool'>   
2022-12-10 09:59:44 - r - INFO: -      load_path      	Train_CliffWalking-v0_DynaQ_20221210-095808	   <class 'str'>    
2022-12-10 09:59:44 - r - INFO: -       show_fig      	         0          	   <class 'bool'>   
2022-12-10 09:59:44 - r - INFO: -       save_fig      	         1          	   <class 'bool'>   
2022-12-10 09:59:44 - r - INFO: -    epsilon_start    	        0.95        	  <class 'float'>   
2022-12-10 09:59:44 - r - INFO: -     epsilon_end     	        0.01        	  <class 'float'>   
2022-12-10 09:59:44 - r - INFO: -    epsilon_decay    	        300         	   <class 'int'>    
2022-12-10 09:59:44 - r - INFO: -        gamma        	        0.99        	  <class 'float'>   
2022-12-10 09:59:44 - r - INFO: -          lr         	        0.1         	  <class 'float'>   
2022-12-10 09:59:44 - r - INFO: -      n_planning     	         10         	   <class 'int'>    
2022-12-10 09:59:44 - r - INFO: -   exploration_type  	      e-greedy      	   <class 'str'>    
2022-12-10 09:59:44 - r - INFO: - ================================================================================
2022-12-10 09:59:44 - r - INFO: - n_states: 48, n_actions: 4
2022-12-10 09:59:44 - r - INFO: - Start testing!
2022-12-10 09:59:44 - r - INFO: - Env: CliffWalking-v0, Algorithm: DynaQ, Device: cpu
2022-12-10 09:59:44 - r - INFO: - Episode: 1/10, Reward: -13.000, Step: 13
2022-12-10 09:59:44 - r - INFO: - Episode: 2/10, Reward: -13.000, Step: 13
2022-12-10 09:59:44 - r - INFO: - Episode: 3/10, Reward: -13.000, Step: 13
2022-12-10 09:59:44 - r - INFO: - Episode: 4/10, Reward: -13.000, Step: 13
2022-12-10 09:59:44 - r - INFO: - Episode: 5/10, Reward: -13.000, Step: 13
2022-12-10 09:59:44 - r - INFO: - Episode: 6/10, Reward: -13.000, Step: 13
2022-12-10 09:59:44 - r - INFO: - Episode: 7/10, Reward: -13.000, Step: 13
2022-12-10 09:59:44 - r - INFO: - Episode: 8/10, Reward: -13.000, Step: 13
2022-12-10 09:59:44 - r - INFO: - Episode: 9/10, Reward: -13.000, Step: 13
2022-12-10 09:59:44 - r - INFO: - Episode: 10/10, Reward: -13.000, Step: 13
2022-12-10 09:59:44 - r - INFO: - Finish testing!