2023-04-04 16:19:39 - r - INFO: - Hyperparameters:
2023-04-04 16:19:39 - r - INFO: - ================================================================================
2023-04-04 16:19:39 - r - INFO: -         Name        	       Value        	        Type        
2023-04-04 16:19:39 - r - INFO: -       env_name      	LunarLanderContinuous-v2	   <class 'str'>    
2023-04-04 16:19:39 - r - INFO: -      continuous     	         1          	   <class 'bool'>   
2023-04-04 16:19:39 - r - INFO: -     new_step_api    	         1          	   <class 'bool'>   
2023-04-04 16:19:39 - r - INFO: -       wrapper       	        None        	   <class 'str'>    
2023-04-04 16:19:39 - r - INFO: -        render       	         1          	   <class 'bool'>   
2023-04-04 16:19:39 - r - INFO: -      algo_name      	        SAC         	   <class 'str'>    
2023-04-04 16:19:39 - r - INFO: -         mode        	        test        	   <class 'str'>    
2023-04-04 16:19:39 - r - INFO: -     render_mode     	       human        	   <class 'str'>    
2023-04-04 16:19:39 - r - INFO: -      mp_backend     	         mp         	   <class 'str'>    
2023-04-04 16:19:39 - r - INFO: -         seed        	        666         	   <class 'int'>    
2023-04-04 16:19:39 - r - INFO: -        device       	        cpu         	   <class 'str'>    
2023-04-04 16:19:39 - r - INFO: -      train_eps      	        2000        	   <class 'int'>    
2023-04-04 16:19:39 - r - INFO: -       test_eps      	         20         	   <class 'int'>    
2023-04-04 16:19:39 - r - INFO: -       eval_eps      	         10         	   <class 'int'>    
2023-04-04 16:19:39 - r - INFO: -   eval_per_episode  	         5          	   <class 'int'>    
2023-04-04 16:19:39 - r - INFO: -      max_steps      	        500         	   <class 'int'>    
2023-04-04 16:19:39 - r - INFO: -   load_checkpoint   	         1          	   <class 'bool'>   
2023-04-04 16:19:39 - r - INFO: -      load_path      	Train_LunarLanderContinuous-v2_SAC_20230402-170158	   <class 'str'>    
2023-04-04 16:19:39 - r - INFO: -       show_fig      	         0          	   <class 'bool'>   
2023-04-04 16:19:39 - r - INFO: -       save_fig      	         1          	   <class 'bool'>   
2023-04-04 16:19:39 - r - INFO: -     policy_type     	      Gaussian      	   <class 'str'>    
2023-04-04 16:19:39 - r - INFO: -          lr         	       0.001        	  <class 'float'>   
2023-04-04 16:19:39 - r - INFO: -        gamma        	        0.99        	  <class 'float'>   
2023-04-04 16:19:39 - r - INFO: -         tau         	       0.005        	  <class 'float'>   
2023-04-04 16:19:39 - r - INFO: -        alpha        	        0.2         	  <class 'float'>   
2023-04-04 16:19:39 - r - INFO: - automatic_entropy_tuning	         0          	   <class 'bool'>   
2023-04-04 16:19:39 - r - INFO: -      batch_size     	         64         	   <class 'int'>    
2023-04-04 16:19:39 - r - INFO: -      hidden_dim     	        256         	   <class 'int'>    
2023-04-04 16:19:39 - r - INFO: -       n_epochs      	         1          	   <class 'int'>    
2023-04-04 16:19:39 - r - INFO: -     start_steps     	       10000        	   <class 'int'>    
2023-04-04 16:19:39 - r - INFO: -  target_update_fre  	         1          	   <class 'int'>    
2023-04-04 16:19:39 - r - INFO: -     buffer_size     	      1000000       	   <class 'int'>    
2023-04-04 16:19:39 - r - INFO: -       task_dir      	G:\Python3\RL\Pytorch\joyrl-offline-main/tasks/Test_LunarLanderContinuous-v2_SAC_20230404-161934	   <class 'str'>    
2023-04-04 16:19:39 - r - INFO: -       res_dir       	G:\Python3\RL\Pytorch\joyrl-offline-main/tasks/Test_LunarLanderContinuous-v2_SAC_20230404-161934/results	   <class 'str'>    
2023-04-04 16:19:39 - r - INFO: -       log_dir       	G:\Python3\RL\Pytorch\joyrl-offline-main/tasks/Test_LunarLanderContinuous-v2_SAC_20230404-161934/logs	   <class 'str'>    
2023-04-04 16:19:39 - r - INFO: -       traj_dir      	G:\Python3\RL\Pytorch\joyrl-offline-main/tasks/Test_LunarLanderContinuous-v2_SAC_20230404-161934/traj	   <class 'str'>    
2023-04-04 16:19:39 - r - INFO: -        tb_dir       	G:\Python3\RL\Pytorch\joyrl-offline-main/tasks/Test_LunarLanderContinuous-v2_SAC_20230404-161934/tb_logs	   <class 'str'>    
2023-04-04 16:19:39 - r - INFO: - ================================================================================
2023-04-04 16:19:39 - r - INFO: - action_bound: 1.0
2023-04-04 16:19:39 - r - INFO: - n_states: 8, n_actions: 2
2023-04-04 16:19:39 - r - INFO: - Start testing!
2023-04-04 16:19:39 - r - INFO: - Env: LunarLanderContinuous-v2, Algorithm: SAC, Device: cpu
2023-04-04 16:19:45 - r - INFO: - Episode: 1/20, Reward: 247.478, Step: 230
2023-04-04 16:19:49 - r - INFO: - Episode: 2/20, Reward: 260.547, Step: 195
2023-04-04 16:19:53 - r - INFO: - Episode: 3/20, Reward: 259.074, Step: 178
2023-04-04 16:19:57 - r - INFO: - Episode: 4/20, Reward: 296.493, Step: 192
2023-04-04 16:20:01 - r - INFO: - Episode: 5/20, Reward: 292.460, Step: 225
2023-04-04 16:20:07 - r - INFO: - Episode: 6/20, Reward: 282.687, Step: 294
2023-04-04 16:20:12 - r - INFO: - Episode: 7/20, Reward: 239.822, Step: 242
2023-04-04 16:20:16 - r - INFO: - Episode: 8/20, Reward: 270.872, Step: 196
2023-04-04 16:20:21 - r - INFO: - Episode: 9/20, Reward: 276.446, Step: 213
2023-04-04 16:20:24 - r - INFO: - Episode: 10/20, Reward: 284.918, Step: 186
2023-04-04 16:20:31 - r - INFO: - Episode: 11/20, Reward: 278.167, Step: 305
2023-04-04 16:20:34 - r - INFO: - Episode: 12/20, Reward: 294.946, Step: 180
2023-04-04 16:20:39 - r - INFO: - Episode: 13/20, Reward: 277.009, Step: 211
2023-04-04 16:20:43 - r - INFO: - Episode: 14/20, Reward: 275.229, Step: 199
2023-04-04 16:20:48 - r - INFO: - Episode: 15/20, Reward: 283.965, Step: 237
2023-04-04 16:20:52 - r - INFO: - Episode: 16/20, Reward: 268.659, Step: 226
2023-04-04 16:20:57 - r - INFO: - Episode: 17/20, Reward: 277.079, Step: 235
2023-04-04 16:21:02 - r - INFO: - Episode: 18/20, Reward: 263.336, Step: 245
2023-04-04 16:21:07 - r - INFO: - Episode: 19/20, Reward: 238.160, Step: 221
2023-04-04 16:21:12 - r - INFO: - Episode: 20/20, Reward: 293.206, Step: 257
2023-04-04 16:21:12 - r - INFO: - Finish testing!