abhi762 commited on
Commit
77e854a
1 Parent(s): e890250

Push Reinforce agent to the Hub

Browse files
README.md ADDED
@@ -0,0 +1,62 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ tags:
3
+ - CartPole-v1
4
+ - ppo
5
+ - deep-reinforcement-learning
6
+ - reinforcement-learning
7
+ - custom-implementation
8
+ - deep-rl-class
9
+ model-index:
10
+ - name: PPO
11
+ results:
12
+ - task:
13
+ type: reinforcement-learning
14
+ name: reinforcement-learning
15
+ dataset:
16
+ name: CartPole-v1
17
+ type: CartPole-v1
18
+ metrics:
19
+ - type: mean_reward
20
+ value: 208.40 +/- 63.43
21
+ name: mean_reward
22
+ verified: false
23
+ ---
24
+
25
+ # PPO Agent Playing CartPole-v1
26
+
27
+ This is a trained model of a PPO agent playing CartPole-v1.
28
+ To learn to code your own PPO agent and train it Unit 8 of the Deep Reinforcement Learning Class: https://github.com/huggingface/deep-rl-class/tree/main/unit8
29
+
30
+ # Hyperparameters
31
+ ```python
32
+ {'exp_name': 'train_new'
33
+ 'seed': 1
34
+ 'torch_deterministic': True
35
+ 'cuda': True
36
+ 'track': False
37
+ 'wandb_project_name': 'cleanRL'
38
+ 'wandb_entity': None
39
+ 'capture_video': False
40
+ 'env_id': 'CartPole-v1'
41
+ 'total_timesteps': 50000
42
+ 'learning_rate': 0.00025
43
+ 'num_envs': 4
44
+ 'num_steps': 128
45
+ 'anneal_lr': True
46
+ 'gae': True
47
+ 'gamma': 0.99
48
+ 'gae_lambda': 0.95
49
+ 'num_minibatches': 4
50
+ 'update_epochs': 4
51
+ 'norm_adv': True
52
+ 'clip_coef': 0.2
53
+ 'clip_vloss': True
54
+ 'ent_coef': 0.01
55
+ 'vf_coef': 0.5
56
+ 'max_grad_norm': 0.5
57
+ 'target_kl': None
58
+ 'repo_id': 'abhi762/ppo'
59
+ 'batch_size': 512
60
+ 'minibatch_size': 128}
61
+ ```
62
+
logs/events.out.tfevents.1673325098.hmecl002157.18132.0 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:4b7c5480f5fababc988f9256347d2c8e8ed293fafbfa461d7c0de19ade110dfa
3
+ size 108292
model.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:6486cad10e90628c49587eff1aaf051d63429656dde9cf2d0cde671fddd63eb1
3
+ size 38550
replay.mp4 ADDED
Binary file (22.4 kB). View file
 
results.json ADDED
@@ -0,0 +1 @@
 
 
1
+ {"env_id": "CartPole-v1", "mean_reward": 208.4, "std_reward": 63.43059198840887, "n_evaluation_episodes": 10, "eval_datetime": "2023-01-10T10:02:56.748691"}