johnjim0816's picture
update CartPole-v1 NoisyDQN
54d82df
raw
history blame
4.51 kB
2023-03-19 19:09:43 - r - INFO: - Hyperparameters:
2023-03-19 19:09:43 - r - INFO: - ================================================================================
2023-03-19 19:09:43 - r - INFO: - Name Value Type
2023-03-19 19:09:43 - r - INFO: - env_name CartPole-v1 <class 'str'>
2023-03-19 19:09:43 - r - INFO: - new_step_api 1 <class 'bool'>
2023-03-19 19:09:43 - r - INFO: - wrapper None <class 'str'>
2023-03-19 19:09:43 - r - INFO: - render 0 <class 'bool'>
2023-03-19 19:09:43 - r - INFO: - algo_name BC <class 'str'>
2023-03-19 19:09:43 - r - INFO: - mode test <class 'str'>
2023-03-19 19:09:43 - r - INFO: - seed 1 <class 'int'>
2023-03-19 19:09:43 - r - INFO: - device cuda <class 'str'>
2023-03-19 19:09:43 - r - INFO: - train_eps 1 <class 'int'>
2023-03-19 19:09:43 - r - INFO: - test_eps 10 <class 'int'>
2023-03-19 19:09:43 - r - INFO: - eval_eps 10 <class 'int'>
2023-03-19 19:09:43 - r - INFO: - eval_per_episode 1 <class 'int'>
2023-03-19 19:09:43 - r - INFO: - max_steps 200 <class 'int'>
2023-03-19 19:09:43 - r - INFO: - load_checkpoint 1 <class 'bool'>
2023-03-19 19:09:43 - r - INFO: - load_path Train_CartPole-v1_BC_20230319-190431 <class 'str'>
2023-03-19 19:09:43 - r - INFO: - show_fig 0 <class 'bool'>
2023-03-19 19:09:43 - r - INFO: - save_fig 1 <class 'bool'>
2023-03-19 19:09:43 - r - INFO: - continuous 0 <class 'bool'>
2023-03-19 19:09:43 - r - INFO: - lr 0.0003 <class 'float'>
2023-03-19 19:09:43 - r - INFO: - batch_size 256 <class 'int'>
2023-03-19 19:09:43 - r - INFO: - train_iterations 500 <class 'int'>
2023-03-19 19:09:43 - r - INFO: - actor_hidden_dim 256 <class 'int'>
2023-03-19 19:09:43 - r - INFO: - critic_hidden_dim 256 <class 'int'>
2023-03-19 19:09:43 - r - INFO: - expert_path tasks/Collect_CartPole-v1_PPO_20230319-170351/traj/traj.pkl <class 'str'>
2023-03-19 19:09:43 - r - INFO: - task_dir /home/dingli/joyrl_offline/tasks/Test_CartPole-v1_BC_20230319-190943 <class 'str'>
2023-03-19 19:09:43 - r - INFO: - res_dir /home/dingli/joyrl_offline/tasks/Test_CartPole-v1_BC_20230319-190943/results <class 'str'>
2023-03-19 19:09:43 - r - INFO: - log_dir /home/dingli/joyrl_offline/tasks/Test_CartPole-v1_BC_20230319-190943/logs <class 'str'>
2023-03-19 19:09:43 - r - INFO: - traj_dir /home/dingli/joyrl_offline/tasks/Test_CartPole-v1_BC_20230319-190943/traj <class 'str'>
2023-03-19 19:09:43 - r - INFO: - tb_dir /home/dingli/joyrl_offline/tasks/Test_CartPole-v1_BC_20230319-190943/tb_logs <class 'str'>
2023-03-19 19:09:43 - r - INFO: - ================================================================================
2023-03-19 19:09:43 - r - INFO: - n_states: 4, n_actions: 2
2023-03-19 19:09:47 - r - INFO: - Start testing!
2023-03-19 19:09:47 - r - INFO: - Env: CartPole-v1, Algorithm: BC, Device: cuda
2023-03-19 19:09:48 - r - INFO: - Episode: 1/10, Reward: 200.000, Step: 200
2023-03-19 19:09:48 - r - INFO: - Episode: 2/10, Reward: 200.000, Step: 200
2023-03-19 19:09:49 - r - INFO: - Episode: 3/10, Reward: 149.000, Step: 149
2023-03-19 19:09:50 - r - INFO: - Episode: 4/10, Reward: 200.000, Step: 200
2023-03-19 19:09:50 - r - INFO: - Episode: 5/10, Reward: 200.000, Step: 200
2023-03-19 19:09:51 - r - INFO: - Episode: 6/10, Reward: 200.000, Step: 200
2023-03-19 19:09:51 - r - INFO: - Episode: 7/10, Reward: 200.000, Step: 200
2023-03-19 19:09:52 - r - INFO: - Episode: 8/10, Reward: 200.000, Step: 200
2023-03-19 19:09:53 - r - INFO: - Episode: 9/10, Reward: 200.000, Step: 200
2023-03-19 19:09:53 - r - INFO: - Episode: 10/10, Reward: 177.000, Step: 177
2023-03-19 19:09:53 - r - INFO: - Finish testing!