Antonio Serrano Muñoz commited on
Commit
d2a0a76
1 Parent(s): e0aa092
Files changed (3) hide show
  1. README.md +84 -1
  2. agent.pickle +3 -0
  3. agent.pt +3 -0
README.md CHANGED
@@ -1,3 +1,86 @@
1
  ---
2
- license: mit
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
3
  ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
  ---
2
+ library_name: skrl
3
+ tags:
4
+ - deep-reinforcement-learning
5
+ - reinforcement-learning
6
+ - skrl
7
+ model-index:
8
+ - name: PPO
9
+ results:
10
+ - metrics:
11
+ - type: mean_reward
12
+ value: -38.54 +/- 17.49
13
+ name: Total reward (mean)
14
+ task:
15
+ type: reinforcement-learning
16
+ name: reinforcement-learning
17
+ dataset:
18
+ name: IsaacGymEnvs-FactoryTaskNutBoltPlace
19
+ type: IsaacGymEnvs-FactoryTaskNutBoltPlace
20
  ---
21
+
22
+ <!-- ---
23
+ torch: -38.54 +/- 17.49
24
+ jax: -60.9 +/- 0.84
25
+ numpy: -58.9 +/- 1.8
26
+ --- -->
27
+
28
+ # IsaacGymEnvs-FactoryTaskNutBoltPlace-PPO
29
+
30
+ Trained agent for [NVIDIA Isaac Gym Preview](https://github.com/NVIDIA-Omniverse/IsaacGymEnvs) environments.
31
+
32
+ - **Task:** FactoryTaskNutBoltPlace
33
+ - **Agent:** [PPO](https://skrl.readthedocs.io/en/latest/api/agents/ppo.html)
34
+
35
+ # Usage (with skrl)
36
+
37
+ Note: Visit the skrl [Examples](https://skrl.readthedocs.io/en/latest/intro/examples.html) section to access the scripts.
38
+
39
+ * PyTorch
40
+
41
+ ```python
42
+ from skrl.utils.huggingface import download_model_from_huggingface
43
+
44
+ # assuming that there is an agent named `agent`
45
+ path = download_model_from_huggingface("skrl/IsaacGymEnvs-FactoryTaskNutBoltPlace-PPO", filename="agent.pt")
46
+ agent.load(path)
47
+ ```
48
+
49
+ * JAX
50
+
51
+ ```python
52
+ from skrl.utils.huggingface import download_model_from_huggingface
53
+
54
+ # assuming that there is an agent named `agent`
55
+ path = download_model_from_huggingface("skrl/IsaacGymEnvs-FactoryTaskNutBoltPlace-PPO", filename="agent.pickle")
56
+ agent.load(path)
57
+ ```
58
+
59
+ # Hyperparameters
60
+
61
+ Note: Undefined parameters keep their values by default.
62
+
63
+ ```python
64
+ # https://skrl.readthedocs.io/en/latest/api/agents/ppo.html#configuration-and-hyperparameters
65
+ cfg = PPO_DEFAULT_CONFIG.copy()
66
+ cfg["rollouts"] = 120 # memory_size
67
+ cfg["learning_epochs"] = 8
68
+ cfg["mini_batches"] = 30 # 120 * 128 / 512
69
+ cfg["discount_factor"] = 0.99
70
+ cfg["lambda"] = 0.95
71
+ cfg["learning_rate"] = 1e-4
72
+ cfg["random_timesteps"] = 0
73
+ cfg["learning_starts"] = 0
74
+ cfg["grad_norm_clip"] = 0
75
+ cfg["ratio_clip"] = 0.2
76
+ cfg["value_clip"] = 0.2
77
+ cfg["clip_predicted_values"] = True
78
+ cfg["entropy_loss_scale"] = 0.0
79
+ cfg["value_loss_scale"] = 1.0
80
+ cfg["kl_threshold"] = 0.016
81
+ cfg["rewards_shaper"] = None
82
+ cfg["state_preprocessor"] = RunningStandardScaler
83
+ cfg["state_preprocessor_kwargs"] = {"size": env.observation_space, "device": device}
84
+ cfg["value_preprocessor"] = RunningStandardScaler
85
+ cfg["value_preprocessor_kwargs"] = {"size": 1, "device": device}
86
+ ```
agent.pickle ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:45e4adf79f0848dfa96397bf0fb37d7e5663ad921b558f414e883588bf4ac3de
3
+ size 1172233
agent.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:086651b9c749d94cab416632d3ebbef2055a7c489d1c153f3d9613e0c715911e
3
+ size 606990