Hugging Face's logo

qgallouedec
/
Hopper-v4-ppo_continuous_action-seed1

Reinforcement Learning
TensorBoard
cleanrl
Hopper-v4
deep-reinforcement-learning
custom-implementation
Eval Results
Model card Files Metrics Community
qgallouedec HF staff commited on
Commit
3121818
•
1 Parent(s): 61f745e

pushing model

Browse files
Files changed (9) hide show
  1. README.md +3 -3
  2. events.out.tfevents.1712439170.MacBook-Pro-de-Quentin.local.21719.0 → events.out.tfevents.1712439414.MacBook-Pro-de-Quentin.local.22067.0 +2 -2
  3. replay.mp4 +0 -0
  4. videos/Hopper-v4__ppo_continuous_action__1__1712439170-eval/rl-video-episode-0.mp4 +0 -0
  5. videos/Hopper-v4__ppo_continuous_action__1__1712439170-eval/rl-video-episode-1.mp4 +0 -0
  6. videos/Hopper-v4__ppo_continuous_action__1__1712439170-eval/rl-video-episode-8.mp4 +0 -0
  7. videos/Hopper-v4__ppo_continuous_action__1__1712439414-eval/rl-video-episode-0.mp4 +0 -0
  8. videos/Hopper-v4__ppo_continuous_action__1__1712439414-eval/rl-video-episode-1.mp4 +0 -0
  9. videos/Hopper-v4__ppo_continuous_action__1__1712439414-eval/rl-video-episode-8.mp4 +0 -0
README.md CHANGED
@@ -16,7 +16,7 @@ model-index:
16
  type: Hopper-v4
17
  metrics:
18
  - type: mean_reward
19
- value: 21.51 +/- 36.78
20
  name: mean_reward
21
  verified: false
22
  ---
@@ -46,14 +46,14 @@ curl -OL https://huggingface.co/qgallouedec/Hopper-v4-ppo_continuous_action-seed
46
  curl -OL https://huggingface.co/qgallouedec/Hopper-v4-ppo_continuous_action-seed1/raw/main/pyproject.toml
47
  curl -OL https://huggingface.co/qgallouedec/Hopper-v4-ppo_continuous_action-seed1/raw/main/poetry.lock
48
  poetry install --all-extras
49
- python ppo_continuous_action.py --env-id Hopper-v4 --capture-video --save-model --upload-model --hf-entity qgallouedec --total-timesteps 50000
50
  ```
51
 
52
  # Hyperparameters
53
  ```python
54
  {'anneal_lr': True,
55
  'batch_size': 2048,
56
- 'capture_video': True,
57
  'clip_coef': 0.2,
58
  'clip_vloss': True,
59
  'cuda': True,
 
16
  type: Hopper-v4
17
  metrics:
18
  - type: mean_reward
19
+ value: 13.96 +/- 25.82
20
  name: mean_reward
21
  verified: false
22
  ---
 
46
  curl -OL https://huggingface.co/qgallouedec/Hopper-v4-ppo_continuous_action-seed1/raw/main/pyproject.toml
47
  curl -OL https://huggingface.co/qgallouedec/Hopper-v4-ppo_continuous_action-seed1/raw/main/poetry.lock
48
  poetry install --all-extras
49
+ python ppo_continuous_action.py --env-id Hopper-v4 --save-model --upload-model --hf-entity qgallouedec --total-timesteps 50000
50
  ```
51
 
52
  # Hyperparameters
53
  ```python
54
  {'anneal_lr': True,
55
  'batch_size': 2048,
56
+ 'capture_video': False,
57
  'clip_coef': 0.2,
58
  'clip_vloss': True,
59
  'cuda': True,
events.out.tfevents.1712439170.MacBook-Pro-de-Quentin.local.21719.0 → events.out.tfevents.1712439414.MacBook-Pro-de-Quentin.local.22067.0 RENAMED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:d5b8f6b2f594c04ecbf3ad3744014d4b9e1d6c0a4f048a44644d0a671e30f416
3
- size 100294
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:74ad1a5010d15a5034c35e9305d11ce83ee9ea6f2ae8dfc71313bf991575ca9e
3
+ size 100295
replay.mp4 CHANGED
Binary files a/replay.mp4 and b/replay.mp4 differ
 
videos/Hopper-v4__ppo_continuous_action__1__1712439170-eval/rl-video-episode-0.mp4 DELETED
Binary file (159 kB)
 
videos/Hopper-v4__ppo_continuous_action__1__1712439170-eval/rl-video-episode-1.mp4 DELETED
Binary file (64.4 kB)
 
videos/Hopper-v4__ppo_continuous_action__1__1712439170-eval/rl-video-episode-8.mp4 DELETED
Binary file (45.3 kB)
 
videos/Hopper-v4__ppo_continuous_action__1__1712439414-eval/rl-video-episode-0.mp4 ADDED
Binary file (111 kB). View file
 
videos/Hopper-v4__ppo_continuous_action__1__1712439414-eval/rl-video-episode-1.mp4 ADDED
Binary file (33.3 kB). View file
 
videos/Hopper-v4__ppo_continuous_action__1__1712439414-eval/rl-video-episode-8.mp4 ADDED
Binary file (40 kB). View file