FernandoD95 commited on
Commit
51f96aa
1 Parent(s): 9de0f5c

Push agent to the Hub

Browse files
README.md ADDED
@@ -0,0 +1,62 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ tags:
3
+ - CartPole-v1
4
+ - ppo
5
+ - deep-reinforcement-learning
6
+ - reinforcement-learning
7
+ - custom-implementation
8
+ - deep-rl-course
9
+ model-index:
10
+ - name: PPO
11
+ results:
12
+ - task:
13
+ type: reinforcement-learning
14
+ name: reinforcement-learning
15
+ dataset:
16
+ name: CartPole-v1
17
+ type: CartPole-v1
18
+ metrics:
19
+ - type: mean_reward
20
+ value: 93.00 +/- 67.47
21
+ name: mean_reward
22
+ verified: false
23
+ ---
24
+
25
+ # PPO Agent Playing CartPole-v1
26
+
27
+ This is a trained model of a PPO agent playing CartPole-v1.
28
+
29
+ # Hyperparameters
30
+ ```python
31
+ {'exp_name': 'PPO'
32
+ 'gym_id': 'CartPole-v1'
33
+ 'learning_rate': 0.00025
34
+ 'seed': 1
35
+ 'total_timesteps': 25000
36
+ 'torch_deterministic': True
37
+ 'cuda': True
38
+ 'track': False
39
+ 'wandb_project_name': 'ppo-implementation-details'
40
+ 'wandb_entity': None
41
+ 'capture_video': False
42
+ 'env_id': 'CartPole-v1'
43
+ 'repo_id': 'FernandoD95/Reinforce_1'
44
+ 'num_envs': 4
45
+ 'num_steps': 128
46
+ 'anneal_lr': True
47
+ 'gae': True
48
+ 'gamma': 0.99
49
+ 'gae_lambda': 0.95
50
+ 'num_minibatches': 4
51
+ 'update_epochs': 4
52
+ 'norm_adv': True
53
+ 'clip_coef': 0.2
54
+ 'clip_vloss': True
55
+ 'ent_coef': 0.01
56
+ 'vf_coef': 0.5
57
+ 'max_grad_norm': 0.5
58
+ 'target_kl': None
59
+ 'batch_size': 512
60
+ 'minibatch_size': 128}
61
+ ```
62
+
logs/events.out.tfevents.1717166571.81cc7cf5722a.13558.0 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:65c1a279a5edc197790b2fd014e131f35c974f34e8410d2f11c0c09c3384abc7
3
+ size 76471
model.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3ac941a7ac0f662a3f15b27b7ab70f1daffbfd5c71c0a89a0d4fdad5d0beb3ed
3
+ size 40466
replay.mp4 ADDED
Binary file (13.7 kB). View file
 
results.json ADDED
@@ -0,0 +1 @@
 
 
1
+ {"env_id": "CartPole-v1", "mean_reward": 93.0, "std_reward": 67.47147545444668, "n_evaluation_episodes": 10, "eval_datetime": "2024-05-31T14:43:24.835342"}