ClassControl/CartPole-v1/Test_CartPole-v1_DRQN_20230204-223710/logs/log.txt

2023-02-04 22:37:10 - r - INFO: - Hyperparameters:
2023-02-04 22:37:10 - r - INFO: - ================================================================================
2023-02-04 22:37:10 - r - INFO: -         Name        	       Value        	        Type        
2023-02-04 22:37:10 - r - INFO: -       env_name      	    CartPole-v1     	   <class 'str'>    
2023-02-04 22:37:10 - r - INFO: -     new_step_api    	         1          	   <class 'bool'>   
2023-02-04 22:37:10 - r - INFO: -       wrapper       	        None        	   <class 'str'>    
2023-02-04 22:37:10 - r - INFO: -        render       	         0          	   <class 'bool'>   
2023-02-04 22:37:10 - r - INFO: -      algo_name      	        DRQN        	   <class 'str'>    
2023-02-04 22:37:10 - r - INFO: -         mode        	        test        	   <class 'str'>    
2023-02-04 22:37:10 - r - INFO: -         seed        	         0          	   <class 'int'>    
2023-02-04 22:37:10 - r - INFO: -        device       	        cuda        	   <class 'str'>    
2023-02-04 22:37:10 - r - INFO: -      train_eps      	        100         	   <class 'int'>    
2023-02-04 22:37:10 - r - INFO: -       test_eps      	         10         	   <class 'int'>    
2023-02-04 22:37:10 - r - INFO: -       eval_eps      	         10         	   <class 'int'>    
2023-02-04 22:37:10 - r - INFO: -   eval_per_episode  	         5          	   <class 'int'>    
2023-02-04 22:37:10 - r - INFO: -      max_steps      	        200         	   <class 'int'>    
2023-02-04 22:37:10 - r - INFO: -   load_checkpoint   	         1          	   <class 'bool'>   
2023-02-04 22:37:10 - r - INFO: -      load_path      	Train_CartPole-v1_DRQN_20230204-223146	   <class 'str'>    
2023-02-04 22:37:10 - r - INFO: -       show_fig      	         0          	   <class 'bool'>   
2023-02-04 22:37:10 - r - INFO: -       save_fig      	         1          	   <class 'bool'>   
2023-02-04 22:37:10 - r - INFO: -    epsilon_start    	        0.1         	  <class 'float'>   
2023-02-04 22:37:10 - r - INFO: -     epsilon_end     	       0.001        	  <class 'float'>   
2023-02-04 22:37:10 - r - INFO: -    epsilon_decay    	       0.995        	  <class 'float'>   
2023-02-04 22:37:10 - r - INFO: -      hidden_dim     	         64         	   <class 'int'>    
2023-02-04 22:37:10 - r - INFO: -        gamma        	        0.99        	  <class 'float'>   
2023-02-04 22:37:10 - r - INFO: -          lr         	       0.001        	  <class 'float'>   
2023-02-04 22:37:10 - r - INFO: -     buffer_size     	       100000       	   <class 'int'>    
2023-02-04 22:37:10 - r - INFO: -      batch_size     	         64         	   <class 'int'>    
2023-02-04 22:37:10 - r - INFO: -    target_update    	         4          	   <class 'int'>    
2023-02-04 22:37:10 - r - INFO: -     lookup_step     	         10         	   <class 'int'>    
2023-02-04 22:37:10 - r - INFO: -     min_epi_num     	         16         	   <class 'int'>    
2023-02-04 22:37:10 - r - INFO: -     max_epi_len     	        128         	   <class 'int'>    
2023-02-04 22:37:10 - r - INFO: -     max_epi_num     	        100         	   <class 'int'>    
2023-02-04 22:37:10 - r - INFO: -     value_layers    	[{'layer_type': 'linear', 'layer_dim': ['n_states', 64], 'activation': 'relu'}, {'layer_type': 'linear', 'layer_dim': [64, 64], 'activation': 'relu'}, {'layer_type': 'linear', 'layer_dim': [64, 'n_actions'], 'activation': 'none'}]	   <class 'str'>    
2023-02-04 22:37:10 - r - INFO: -       task_dir      	/home/dingli/rl-tutorials/joyrl/tasks/Test_CartPole-v1_DRQN_20230204-223710	   <class 'str'>    
2023-02-04 22:37:10 - r - INFO: -      model_dir      	/home/dingli/rl-tutorials/joyrl/tasks/Test_CartPole-v1_DRQN_20230204-223710/models	   <class 'str'>    
2023-02-04 22:37:10 - r - INFO: -       res_dir       	/home/dingli/rl-tutorials/joyrl/tasks/Test_CartPole-v1_DRQN_20230204-223710/results	   <class 'str'>    
2023-02-04 22:37:10 - r - INFO: -       log_dir       	/home/dingli/rl-tutorials/joyrl/tasks/Test_CartPole-v1_DRQN_20230204-223710/logs	   <class 'str'>    
2023-02-04 22:37:10 - r - INFO: -       traj_dir      	/home/dingli/rl-tutorials/joyrl/tasks/Test_CartPole-v1_DRQN_20230204-223710/traj	   <class 'str'>    
2023-02-04 22:37:10 - r - INFO: - ================================================================================
2023-02-04 22:37:10 - r - INFO: - n_states: 4, n_actions: 2
2023-02-04 22:37:13 - r - INFO: - Start testing!
2023-02-04 22:37:13 - r - INFO: - Env: CartPole-v1, Algorithm: DRQN, Device: cuda
2023-02-04 22:37:13 - r - INFO: - Episode: 1/10, Reward: 200.000, Step: 200
2023-02-04 22:37:13 - r - INFO: - Episode: 2/10, Reward: 200.000, Step: 200
2023-02-04 22:37:14 - r - INFO: - Episode: 3/10, Reward: 200.000, Step: 200
2023-02-04 22:37:14 - r - INFO: - Episode: 4/10, Reward: 200.000, Step: 200
2023-02-04 22:37:14 - r - INFO: - Episode: 5/10, Reward: 200.000, Step: 200
2023-02-04 22:37:14 - r - INFO: - Episode: 6/10, Reward: 200.000, Step: 200
2023-02-04 22:37:14 - r - INFO: - Episode: 7/10, Reward: 200.000, Step: 200
2023-02-04 22:37:15 - r - INFO: - Episode: 8/10, Reward: 200.000, Step: 200
2023-02-04 22:37:15 - r - INFO: - Episode: 9/10, Reward: 200.000, Step: 200
2023-02-04 22:37:15 - r - INFO: - Episode: 10/10, Reward: 200.000, Step: 200
2023-02-04 22:37:15 - r - INFO: - Finish testing!