Initial Push

Browse files

Files changed (12) hide show

README.md +37 -0
config.json +1 -0
ppo-PandaPickAndPlaceDense-v3.zip +3 -0
ppo-PandaPickAndPlaceDense-v3/_stable_baselines3_version +1 -0
ppo-PandaPickAndPlaceDense-v3/data +127 -0
ppo-PandaPickAndPlaceDense-v3/policy.optimizer.pth +3 -0
ppo-PandaPickAndPlaceDense-v3/policy.pth +3 -0
ppo-PandaPickAndPlaceDense-v3/pytorch_variables.pth +3 -0
ppo-PandaPickAndPlaceDense-v3/system_info.txt +9 -0
replay.mp4 +0 -0
results.json +1 -0
vec_normalize.pkl +3 -0

README.md ADDED Viewed

	@@ -0,0 +1,37 @@

+---
+library_name: stable-baselines3
+tags:
+- PandaPickAndPlaceDense-v3
+- deep-reinforcement-learning
+- reinforcement-learning
+- stable-baselines3
+model-index:
+- name: PPO
+  results:
+  - task:
+      type: reinforcement-learning
+      name: reinforcement-learning
+    dataset:
+      name: PandaPickAndPlaceDense-v3
+      type: PandaPickAndPlaceDense-v3
+    metrics:
+    - type: mean_reward
+      value: -8.39 +/- 3.33
+      name: mean_reward
+      verified: false
+---
+# **PPO** Agent playing **PandaPickAndPlaceDense-v3**
+This is a trained model of a **PPO** agent playing **PandaPickAndPlaceDense-v3**
+using the [stable-baselines3 library](https://github.com/DLR-RM/stable-baselines3).
+## Usage (with Stable-baselines3)
+TODO: Add your code
+```python
+from stable_baselines3 import ...
+from huggingface_sb3 import load_from_hub
+...
+```

config.json ADDED Viewed

	@@ -0,0 +1 @@

+ {"policy_class": {":type:": "<class 'abc.ABCMeta'>", ":serialized:": "gAWVRQAAAAAAAACMIXN0YWJsZV9iYXNlbGluZXMzLmNvbW1vbi5wb2xpY2llc5SMG011bHRpSW5wdXRBY3RvckNyaXRpY1BvbGljeZSTlC4=", "__module__": "stable_baselines3.common.policies", "__doc__": "\n MultiInputActorClass policy class for actor-critic algorithms (has both policy and value prediction).\n Used by A2C, PPO and the likes.\n\n :param observation_space: Observation space (Tuple)\n :param action_space: Action space\n :param lr_schedule: Learning rate schedule (could be constant)\n :param net_arch: The specification of the policy and value networks.\n :param activation_fn: Activation function\n :param ortho_init: Whether to use or not orthogonal initialization\n :param use_sde: Whether to use State Dependent Exploration or not\n :param log_std_init: Initial value for the log standard deviation\n :param full_std: Whether to use (n_features x n_actions) parameters\n for the std instead of only (n_features,) when using gSDE\n :param use_expln: Use ``expln()`` function instead of ``exp()`` to ensure\n a positive standard deviation (cf paper). It allows to keep variance\n above zero and prevent it from growing too fast. In practice, ``exp()`` is usually enough.\n :param squash_output: Whether to squash the output using a tanh function,\n this allows to ensure boundaries when using gSDE.\n :param features_extractor_class: Uses the CombinedExtractor\n :param features_extractor_kwargs: Keyword arguments\n to pass to the features extractor.\n :param share_features_extractor: If True, the features extractor is shared between the policy and value networks.\n :param normalize_images: Whether to normalize images or not,\n dividing by 255.0 (True by default)\n :param optimizer_class: The optimizer to use,\n ``th.optim.Adam`` by default\n :param optimizer_kwargs: Additional keyword arguments,\n excluding the learning rate, to pass to the optimizer\n ", "__init__": "<function MultiInputActorCriticPolicy.__init__ at 0x7f05f95f11b0>", "__abstractmethods__": "frozenset()", "_abc_impl": "<_abc._abc_data object at 0x7f05f95e3f80>"}, "verbose": 1, "policy_kwargs": {":type:": "<class 'dict'>", ":serialized:": "gAWVbwAAAAAAAAB9lCiMCG5ldF9hcmNolH2UKIwCcGmUXZQoTQAITQAITQAIZYwCdmaUXZQoTQAITQAITQAIZXWMDWFjdGl2YXRpb25fZm6UjBt0b3JjaC5ubi5tb2R1bGVzLmFjdGl2YXRpb26UjARSZUxVlJOUdS4=", "net_arch": {"pi": [2048, 2048, 2048], "vf": [2048, 2048, 2048]}, "activation_fn": "<class 'torch.nn.modules.activation.ReLU'>"}, "num_timesteps": 8723380, "_total_timesteps": 15000000, "_num_timesteps_at_start": 0, "seed": null, "action_noise": null, "start_time": 1718177593100130111, "learning_rate": 0.00015, "tensorboard_log": "./ppoPandaPickAndPlaceDense-v3/", "_last_obs": {":type:": "<class 'collections.OrderedDict'>", ":serialized:": "gAWVywgAAAAAAACMC2NvbGxlY3Rpb25zlIwLT3JkZXJlZERpY3SUk5QpUpQojA1hY2hpZXZlZF9nb2FslIwSbnVtcHkuY29yZS5udW1lcmljlIwLX2Zyb21idWZmZXKUk5QolvAAAAAAAAAAnS0aP40Uv76ziio9qRG0vvQwQD4vnSo9K9VCP0dRUr+6iSo9ljmcPrca1D5XZio9sbtyvzu2xT8zhio9+e0pP0Zbm78zhio99B9ivibqtr7clio9QXJkP+irA79XZio9+7FlvxMKmz8alyo9pbBQP5+Ggz9acyo9AfkGP1vVzr9oOS09AylgPyeHuz9XZio9PPDjPM4OND4vnSo9JyO8P8GVyr+vmCo9R79Vv7Bnl76ziio97fsOP3Btt78zhio9/epHv+ylzb8alyo9FxriPsFVDr8vnSo9IneBv/rKiD5XZio9w7xev+8Cr75XZio9lIwFbnVtcHmUjAVkdHlwZZSTlIwCZjSUiYiHlFKUKEsDjAE8lE5OTkr/////Sv////9LAHSUYksUSwOGlIwBQ5R0lFKUjAxkZXNpcmVkX2dvYWyUaAcolvAAAAAAAAAA0snMPyam0D9KIIu/PR+dP9RWd79KIIu/LOzjPfJsi730Kkg/+N2tP/Y7pj5KIIu/bx/7vjanxT3vWoI/Jr9Xv//Iw79KIIu/ZqkBPlSshT9gCA0/EJo5v6eYtj9RYpE8pmIGPoLASb80WpM/r5yIv1NoZ75rbOI/BIibP2xzUj4Gp3u/YqZzP7KrSz9vx7a+3y1Xv3vqbr8BwuA/fK81Phnjgz9xsXU/tyXQv5VAv7/rUKa9mKnKvJ0khD+8ZK8/eUm2O5MnU71KIIu/qm1tvwI1y75KIIu/J7ybP+BxwD4H6gs8ySMqviyKOz5KNI4/lGgOSxRLA4aUaBJ0lFKUjAtvYnNlcnZhdGlvbpRoByiW8AUAAAAAAADZoJQ/8vMFP+z3AT/eC5u+DkcIP12etL+4qWA/nS0aP40Uv76ziio9/FxVu4NezDpH0oS7sDB0PA1xrLrp15o8keV+OuWiprth2QO6IotzP+Kepz+mVSK/zJgfP97AvD43P5Q/ALiJv6kRtL70MEA+L50qPQVPa7uXcnA6c+f0u2wDdjygK5m68ReWPIGupjvHDIU6GQAHu34ILT9vX6K+ZPunP488oD9beq0+ewhMP0R6jb8r1UI/R1FSv7qJKj0KjlW7XL3OOjIsl7ufzHM8YFitusUAmzxMu4Q6aHaru7/MA7oztHY/iW2JP2DCEUDt0ak/60Fmvw1o4r8R75I/ljmcPrca1D5XZio9V+M3uxI9uDrLhLq7hj9bPFny6bmj15o8Ds9+OheaprtXWAW7HO6yPvO0or9eHlg/LPCLv9l6z7/SsEm+coiSP7G7cr87tsU/M4YqPbbfaru3ifY6X5e4uwdBZDxoPDi6o9eaPP/OfjoWmqa7IQwDu3eZZj+vrXo+L5YEvy/8QD4jJ62/1HiRP3zAjj/57Sk/RlubvzOGKj2332q7won2OnAmvbsEQWQ8/Ts4uqPXmjz/zn46Fpqmu3cMA7vkvkc/+dVWvXTYoz/190i/2dxfv3wDJT+FJ16/9B9ivibqtr7clio9DfZxu7rKwTqPWJy7QqhsPBAvojkT4Jo82k+DOlNspru3tIO6UonnPs52oD3ckBC/S5K/P6rYlb9/72Y/dSpoP0FyZD/oqwO/V2YqPXvjN7sRPbg6/pq1u3s/WzzC9em5mdeaPF/WfjoXmqa7p1cFu4CLbD+0Qm6/YOr5PtCxiT+F2QQ/lftfP/cjXr/7sWW/EwqbPxqXKj1G0HG79OXBOigiNrtIpGw8+8OkOaPXmjwi0n46v5mmu6TGg7qIumk/bKV8vj+cUD/zBME/1U9Wv4ovoz//7o2/pbBQP5+Ggz9acyo9NcpGu2lG0jors7C7FQ9OPL/1o7r5ops86/u5O22fJLxehgW7HAB6P44NHr1cnSs/GzrOPu+9gbyBdIk9A++NvwH5Bj9b1c6/aDktPRmuZ7uLOKM69Wyvuyf4YzwA5sa5o9eaPAPPfjoYmqa71QrzukwBar4qPxa/2oV/vplrmz95IWa/S2PAPzXCXz8DKWA/J4e7P1dmKj1O4ze7Gj24OuDxzru2P1s8lu7puaPXmjwOz346F5qmuzRbBbseu7c+7p3Vv2Dbl7+jIc29nOyuPlaAIb/e3F8/PPDjPM4OND4vnSo97jVau9nNrjrr5FO7SnJYPB+HYDrxF5Y8ao20u4e8Erx3Fdi6I1tZP2rm7jz5yyE/qmvdvjkuzD8yWhs/xLxfPycjvD/Blcq/r5gqPfmzX7t2c4A6hw+zuzw8WjyvSoe67JaaPClZrDoetqG7+DIxu+BGXT9sCJC/VGksQHldTL/A6p6/L4R6P6T+kj9Hv1W/sGeXvrOKKj2oWlW7HVTMOiNX1bomMHQ8smusuqPXmjzs0346qpqmu4wcBLr7ows+Ujr0PEYSPD50uRw/RO/hvxmBfT+x/pI/7fsOP3Btt78zhio9tt9qu7GJ9jqR6bW7CUFkPKY8OLqj15o8/85+OhWaprvvCwO7Hop7P71rZT9s5VK/4wkfP2sJ772sYsU9Q2qNv/3qR7/spc2/GpcqPVrRcbux4sE6vVeFu3ukbDyW06Q5o9eaPCLSfjq/maa76LqDunfcnT1FiwA/DVcsv2v8vT6tTjM/FQE7P3N6kj8XGuI+wVUOvy+dKj3+NVq7z82uOvQNibsQc1g8QJBgOvcXljz0krS7+LcSvD0e2LpvQ4I/lvJYvjRIzT70CuA+Qw+9P8FxxD9/J16/IneBv/rKiD5XZio9VuM3uxM9uDphI7y7ij9bPA3y6bmj15o8Ds9+OheapruSWAW7QFQ5PzOmyT9lTlu/y9zyvT1i8j4MB7c9IopWv8O8Xr/vAq++V2YqPVDjN7sYPbg6rTXJu6k/Wzyk7+m5o9eaPA7PfjoXmqa7ZloFu5RoDksUSxOGlGgSdJRSlHUu", "achieved_goal": "[[ 0.6022585 -0.37320367 0.04163618]\n [-0.35169724 0.18768674 0.04165381]\n [ 0.7610652 -0.8215527 0.04163525]\n [ 0.30512685 0.41426632 0.04160151]\n [-0.94817644 1.5446237 0.04163189]\n [ 0.6637874 -1.213723 0.04163189]\n [-0.22082502 -0.35725516 0.04164778]\n [ 0.8923684 -0.51434183 0.04160151]\n [-0.897247 1.211245 0.04164801]\n [ 0.8151954 1.0275458 0.04161391]\n [ 0.527237 -1.6158861 0.04229107]\n [ 0.8756258 1.465062 0.04160151]\n [ 0.02782451 0.17583773 0.04165381]\n [ 1.4698228 -1.5826951 0.04164952]\n [-0.8349499 -0.29571295 0.04163618]\n [ 0.5585316 -1.4330273 0.04163189]\n [-0.7809294 -1.606626 0.04164801]\n [ 0.4416053 -0.555996 0.04165381]\n [-1.0114481 0.2671736 0.04160151]\n [-0.8700678 -0.34181926 0.04160151]]", "desired_goal": "[[ 1.5999091 1.6300704 -1.0869229 ]\n [ 1.2275158 -0.96616864 -1.0869229 ]\n [ 0.11129031 -0.06807889 0.7819054 ]\n [ 1.3583364 0.32467622 -1.0869229 ]\n [-0.4904742 0.09651034 1.0184001 ]\n [-0.84276044 -1.5295714 -1.0869229 ]\n [ 0.12662277 1.0443215 0.55090904]\n [-0.72500706 1.4265336 0.01774708]\n [ 0.13123569 -0.7880937 1.1511903 ]\n [-1.0672816 -0.2259839 1.7689337 ]\n [ 1.2150884 0.20551842 -0.9830173 ]\n [ 0.95175755 0.7955886 -0.3569903 ]\n [-0.8405437 -0.9332654 1.7559205 ]\n [ 0.17742723 1.030368 0.9597388 ]\n [-1.626151 -1.4941584 -0.08120903]\n [-0.02473907 1.0323673 1.3702617 ]\n [ 0.00556296 -0.05155141 -1.0869229 ]\n [-0.9274546 -0.3968888 -1.0869229 ]\n [ 1.2166795 0.3758688 0.00853968]\n [-0.16615213 0.18314427 1.1109707 ]]", "observation": "[[ 1.1611587e+00 5.2325356e-01 5.0768924e-01 -3.0282491e-01\n 5.3233421e-01 -1.4110829e+00 8.7758970e-01 6.0225850e-01\n -3.7320367e-01 4.1636180e-02 -3.2556644e-03 1.5592132e-03\n -4.0533873e-03 1.4904186e-02 -1.3156250e-03 1.8901782e-02\n 9.7235391e-04 -5.0853365e-03 -5.0296454e-04]\n [ 9.5134175e-01 1.3095362e+00 -6.3411939e-01 6.2342525e-01\n 3.6865896e-01 1.1581792e+00 -1.0759277e+00 -3.5169724e-01\n 1.8768674e-01 4.1653808e-02 -3.5905254e-03 9.1723487e-04\n -7.4738800e-03 1.5015464e-02 -1.1685975e-03 1.8321963e-02\n 5.0867205e-03 1.0150903e-03 -2.0599423e-03]\n [ 6.7591083e-01 -3.1713435e-01 1.3123593e+00 1.2518481e+00\n 3.3882412e-01 7.9700440e-01 -1.1052938e+00 7.6106519e-01\n -8.2155269e-01 4.1635253e-02 -3.2585883e-03 1.5772986e-03\n -4.6134228e-03 1.4880328e-02 -1.3225190e-03 1.8921265e-02\n 1.0126620e-03 -5.2326210e-03 -5.0277630e-04]\n [ 9.6368712e-01 1.0736552e+00 2.2774887e+00 1.3267189e+00\n -8.9944333e-01 -1.7688004e+00 1.1479207e+00 3.0512685e-01\n 4.1426632e-01 4.1601505e-02 -2.8059089e-03 1.4056286e-03\n -5.6920997e-03 1.3381844e-02 -4.4621786e-04 1.8901652e-02\n 9.7201846e-04 -5.0842869e-03 -2.0346844e-03]\n [ 3.4947288e-01 -1.2711471e+00 8.4421337e-01 -1.0932670e+00\n -1.6209365e+00 -1.9696358e-01 1.1447890e+00 -9.4817644e-01\n 1.5446237e+00 4.1631889e-02 -3.5838909e-03 1.8809353e-03\n -5.6332792e-03 1.3931519e-02 -7.0280442e-04 1.8901652e-02\n 9.7201759e-04 -5.0842864e-03 -1.9996243e-03]\n [ 9.0077919e-01 2.4480318e-01 -5.1791662e-01 1.8846200e-01\n -1.3527569e+00 1.1364999e+00 1.1152492e+00 6.6378742e-01\n -1.2137229e+00 4.1631889e-02 -3.5838911e-03 1.8809366e-03\n -5.7724044e-03 1.3931517e-02 -7.0279819e-04 1.8901652e-02\n 9.7201759e-04 -5.0842864e-03 -1.9996443e-03]\n [ 7.8025651e-01 -5.2450154e-02 1.2800431e+00 -7.8503352e-01\n -8.7446362e-01 6.4458442e-01 -8.6779052e-01 -2.2082502e-01\n -3.5725516e-01 4.1647777e-02 -3.6920339e-03 1.4785149e-03\n -4.7712992e-03 1.4444413e-02 3.0934112e-04 1.8905675e-02\n 1.0018304e-03 -5.0788312e-03 -1.0048364e-03]\n [ 4.5221955e-01 7.8351602e-02 -5.6471038e-01 1.4966520e+00\n -1.1706746e+00 9.0209192e-01 9.0689784e-01 8.9236838e-01\n -5.1434183e-01 4.1601505e-02 -2.8059173e-03 1.4056285e-03\n -5.5421581e-03 1.3381834e-02 -4.4624327e-04 1.8901633e-02\n 9.7212748e-04 -5.0842869e-03 -2.0346434e-03]\n [ 9.2400360e-01 -9.3070531e-01 4.8811626e-01 1.0757389e+00\n 5.1894408e-01 8.7493259e-01 -8.6773628e-01 -8.9724702e-01\n 1.2112449e+00 4.1648008e-02 -3.6897822e-03 1.4793263e-03\n -2.7791355e-03 1.4443465e-02 3.1426534e-04 1.8901652e-02\n 9.7206433e-04 -5.0842459e-03 -1.0053706e-03]\n [ 9.1300249e-01 -2.4672478e-01 8.1488413e-01 1.5079635e+00\n -8.3715564e-01 1.2748883e+00 -1.1088561e+00 8.1519538e-01\n 1.0275458e+00 4.1613914e-02 -3.0332927e-03 1.6042712e-03\n -5.3924522e-03 1.2576838e-02 -1.2509151e-03 1.8998610e-02\n 5.6757829e-03 -1.0047776e-02 -2.0374279e-03]\n [ 9.7656417e-01 -3.8587146e-02 6.7036986e-01 4.0278706e-01\n -1.5837638e-02 6.7116745e-02 -1.1088566e+00 5.2723700e-01\n -1.6158861e+00 4.2291075e-02 -3.5351573e-03 1.2452764e-03\n -5.3535649e-03 1.3914145e-02 -3.7936866e-04 1.8901652e-02\n 9.7201782e-04 -5.0842874e-03 -1.8542657e-03]\n [-2.2852057e-01 -5.8690131e-01 -2.4953404e-01 1.2142211e+00\n -8.9894825e-01 1.5030302e+00 8.7405711e-01 8.7562579e-01\n 1.4650620e+00 4.1601505e-02 -2.8059068e-03 1.4056296e-03\n -6.3154548e-03 1.3381889e-02 -4.4618984e-04 1.8901652e-02\n 9.7201846e-04 -5.0842869e-03 -2.0348551e-03]\n [ 3.5884947e-01 -1.6688821e+00 -1.1863823e+00 -1.0016181e-01\n 3.4164894e-01 -6.3086450e-01 8.7446392e-01 2.7824514e-02\n 1.7583773e-01 4.1653808e-02 -3.3296305e-03 1.3336494e-03\n -3.2332491e-03 1.3210842e-02 8.5650565e-04 1.8321963e-02\n -5.5100219e-03 -8.9560812e-03 -1.6485889e-03]\n [ 8.4904689e-01 2.9162604e-02 6.3201863e-01 -4.3246204e-01\n 1.5951606e+00 6.0684502e-01 8.7397408e-01 1.4698228e+00\n -1.5826951e+00 4.1649517e-02 -3.4134372e-03 9.8000350e-04\n -5.4644975e-03 1.3320025e-02 -1.0321940e-03 1.8870793e-02\n 1.3149130e-03 -4.9350401e-03 -2.7038436e-03]\n [ 8.6436272e-01 -1.1252570e+00 2.6939287e+00 -7.9830128e-01\n -1.2415390e+00 9.7857946e-01 1.1483960e+00 -8.3494991e-01\n -2.9571295e-01 4.1636180e-02 -3.2555256e-03 1.5589033e-03\n -1.6276579e-03 1.4904058e-02 -1.3154654e-03 1.8901652e-02\n 9.7209099e-04 -5.0843554e-03 -5.0396542e-04]\n [ 1.3636772e-01 2.9812966e-02 1.8366346e-01 6.1220479e-01\n -1.7651143e+00 9.9025112e-01 1.1483976e+00 5.5853158e-01\n -1.4330273e+00 4.1631889e-02 -3.5838909e-03 1.8809346e-03\n -5.5515249e-03 1.3931521e-02 -7.0280803e-04 1.8901652e-02\n 9.7201759e-04 -5.0842860e-03 -1.9996127e-03]\n [ 9.8257625e-01 8.9617521e-01 -8.2381320e-01 6.2124461e-01\n -1.1671718e-01 9.6379608e-02 -1.1048054e+00 -7.8092939e-01\n -1.6066260e+00 4.1648008e-02 -3.6898465e-03 1.4792291e-03\n -4.0692971e-03 1.4443512e-02 3.1438161e-04 1.8901652e-02\n 9.7206433e-04 -5.0842459e-03 -1.0050209e-03]\n [ 7.7080660e-02 5.0212508e-01 -6.7320329e-01 3.7106642e-01\n 7.0041925e-01 7.3048526e-01 1.1443619e+00 4.4160530e-01\n -5.5599600e-01 4.1653808e-02 -3.3296342e-03 1.3336482e-03\n -4.1825715e-03 1.3211027e-02 8.5664168e-04 1.8321974e-02\n -5.5106822e-03 -8.9549944e-03 -1.6488504e-03]\n [ 1.0176829e+00 -2.1186289e-01 4.0094149e-01 4.3758357e-01\n 1.4770283e+00 1.5347215e+00 -8.6779016e-01 -1.0114481e+00\n 2.6717359e-01 4.1601505e-02 -2.8059087e-03 1.4056287e-03\n -5.7415222e-03 1.3381848e-02 -4.4621565e-04 1.8901652e-02\n 9.7201846e-04 -5.0842869e-03 -2.0346981e-03]\n [ 7.2394180e-01 1.5753845e+00 -8.5666496e-01 -1.1858519e-01\n 4.7340575e-01 8.9368910e-02 -8.3804524e-01 -8.7006778e-01\n -3.4181926e-01 4.1601505e-02 -2.8059073e-03 1.4056293e-03\n -6.1404319e-03 1.3381877e-02 -4.4619769e-04 1.8901652e-02\n 9.7201846e-04 -5.0842869e-03 -2.0348071e-03]]"}, "_last_episode_starts": {":type:": "<class 'numpy.ndarray'>", ":serialized:": "gAWVhwAAAAAAAACMEm51bXB5LmNvcmUubnVtZXJpY5SMC19mcm9tYnVmZmVylJOUKJYUAAAAAAAAAAAAAAAAAAAAAAABAAAAAAAAAAAAlIwFbnVtcHmUjAVkdHlwZZSTlIwCYjGUiYiHlFKUKEsDjAF8lE5OTkr/////Sv////9LAHSUYksUhZSMAUOUdJRSlC4="}, "_last_original_obs": {":type:": "<class 'collections.OrderedDict'>", ":serialized:": "gAWVywgAAAAAAACMC2NvbGxlY3Rpb25zlIwLT3JkZXJlZERpY3SUk5QpUpQojA1hY2hpZXZlZF9nb2FslIwSbnVtcHkuY29yZS5udW1lcmljlIwLX2Zyb21idWZmZXKUk5QolvAAAAAAAAAAUYgDvjfMiL0K16M8eJjfvT1/TjsK16M8tzt2PRPRED4K16M8Bjv8vIItsr0K16M8zfpGvTQUAj4K16M85Z6uPGdqGT4K16M8SgL/PfSRPT0K16M8vOdtPYl+Cb4K16M8zVMJPhclAL4K16M8evqUPbcaFb0K16M8twPnvTgi4z0K16M8lr0YvVGOCr4K16M8e5PYPcfolr0K16M8H2KTu6pktj0K16M8cQqHPL2tl70K16M8Ip3CPdLsmzwK16M8yiP2PZ+92b0K16M8tm0XvoDntb0K16M8RcXnPBKjTr0K16M8fKXvPY+wtT0K16M8lIwFbnVtcHmUjAVkdHlwZZSTlIwCZjSUiYiHlFKUKEsDjAE8lE5OTkr/////Sv////9LAHSUYksUSwOGlIwBQ5R0lFKUjAxkZXNpcmVkX2dvYWyUaAcolvAAAAAAAAAAmnoqPdiZObwK16M89s7LPdXWfz1F3hs+Vx2QPUCbX72bxVQ+WBWvPTziBz4K16M8uyH2vdufq70MaV4+HPqLvX+UX71RiAE+7GDKPBPSrL1HIys9AecxvLRcHj1OlrU9Kx/pvZJWkb0K16M8ZrcVPs/Enb2agEw+11tHvXRFVLyxKPI9/zaovVdua73HchU9U/6IvPd2ez3d8CI+JNMbvdDnQTx2WzY+0mGJPYrKuD2XJpI9wv8RPbqM1bwK16M8ngwVPgCbAb4K16M80G+1vbvwwjwK16M8z5qePfTcjzwK16M8KWG9Pd+RDL4K16M8lGgOSxRLA4aUaBJ0lFKUjAtvYnNlcnZhdGlvbpRoByiW8AUAAAAAAADqch09GWwarEMjSj4AAAAAAAAAgAAAAAAAAAAAUYgDvjfMiL0K16M8AAAAAAAAAIAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA6nIdPRlsGqxDI0o+AAAAAAAAAIAAAAAAAAAAAHiY3709f047CtejPAAAAAAAAACAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAOpyHT0ZbBqsQyNKPgAAAAAAAACAAAAAAAAAAAC3O3Y9E9EQPgrXozwAAAAAAAAAgAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAADqch09GWwarEMjSj4AAAAAAAAAgAAAAAAAAAAABjv8vIItsr0K16M8AAAAAAAAAIAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA6nIdPRlsGqxDI0o+AAAAAAAAAIAAAAAAAAAAAM36Rr00FAI+CtejPAAAAAAAAACAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAOpyHT0ZbBqsQyNKPgAAAAAAAACAAAAAAAAAAADlnq48Z2oZPgrXozwAAAAAAAAAgAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAADqch09GWwarEMjSj4AAAAAAAAAgAAAAAAAAAAASgL/PfSRPT0K16M8AAAAAAAAAIAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA6nIdPRlsGqxDI0o+AAAAAAAAAIAAAAAAAAAAALznbT2Jfgm+CtejPAAAAAAAAACAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAOpyHT0ZbBqsQyNKPgAAAAAAAACAAAAAAAAAAADNUwk+FyUAvgrXozwAAAAAAAAAgAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAADqch09GWwarEMjSj4AAAAAAAAAgAAAAAAAAAAAevqUPbcaFb0K16M8AAAAAAAAAIAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA6nIdPRlsGqxDI0o+AAAAAAAAAIAAAAAAAAAAALcD5704IuM9CtejPAAAAAAAAACAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAOpyHT0ZbBqsQyNKPgAAAAAAAACAAAAAAAAAAACWvRi9UY4KvgrXozwAAAAAAAAAgAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAADqch09GWwarEMjSj4AAAAAAAAAgAAAAAAAAAAAe5PYPcfolr0K16M8AAAAAAAAAIAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA6nIdPRlsGqxDI0o+AAAAAAAAAIAAAAAAAAAAAB9ik7uqZLY9CtejPAAAAAAAAACAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAOpyHT0ZbBqsQyNKPgAAAAAAAACAAAAAAAAAAABxCoc8va2XvQrXozwAAAAAAAAAgAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAADqch09GWwarEMjSj4AAAAAAAAAgAAAAAAAAAAAIp3CPdLsmzwK16M8AAAAAAAAAIAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA6nIdPRlsGqxDI0o+AAAAAAAAAIAAAAAAAAAAAMoj9j2fvdm9CtejPAAAAAAAAACAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAOpyHT0ZbBqsQyNKPgAAAAAAAACAAAAAAAAAAAC2bRe+gOe1vQrXozwAAAAAAAAAgAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAADqch09GWwarEMjSj4AAAAAAAAAgAAAAAAAAAAARcXnPBKjTr0K16M8AAAAAAAAAIAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA6nIdPRlsGqxDI0o+AAAAAAAAAIAAAAAAAAAAAHyl7z2PsLU9CtejPAAAAAAAAACAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAJRoDksUSxOGlGgSdJRSlHUu", "achieved_goal": "[[-0.1284497 -0.06679576 0.02 ]\n [-0.10917753 0.00315089 0.02 ]\n [ 0.06011554 0.14142255 0.02 ]\n [-0.03078986 -0.08700086 0.02 ]\n [-0.04857903 0.1270302 0.02 ]\n [ 0.021316 0.14981996 0.02 ]\n [ 0.12451608 0.04628177 0.02 ]\n [ 0.05808233 -0.13427176 0.02 ]\n [ 0.13410874 -0.12514149 0.02 ]\n [ 0.07274337 -0.03640243 0.02 ]\n [-0.11280005 0.11090511 0.02 ]\n [-0.03729018 -0.13530852 0.02 ]\n [ 0.10575005 -0.07368618 0.02 ]\n [-0.00449778 0.08905919 0.02 ]\n [ 0.01648447 -0.07406185 0.02 ]\n [ 0.09502627 0.01903382 0.02 ]\n [ 0.12018545 -0.1063187 0.02 ]\n [-0.14787945 -0.08882046 0.02 ]\n [ 0.02829231 -0.05044848 0.02 ]\n [ 0.11701486 0.08871567 0.02 ]]", "desired_goal": "[[ 0.04162083 -0.01132818 0.02 ]\n [ 0.09951584 0.06246074 0.15221508]\n [ 0.07036846 -0.05459142 0.20778506]\n [ 0.08548993 0.13269895 0.02 ]\n [-0.12018152 -0.08380099 0.2171976 ]\n [-0.06834814 -0.05458498 0.12649657]\n [ 0.02470442 -0.08438506 0.04178169]\n [-0.0108583 0.03866263 0.08866559]\n [-0.11382898 -0.0709659 0.02 ]\n [ 0.14620742 -0.07703554 0.19970933]\n [-0.04867157 -0.01295601 0.11824168]\n [-0.08213615 -0.05747828 0.03648641]\n [-0.01672283 0.06139275 0.15912195]\n [-0.03804316 0.01183505 0.17808327]\n [ 0.06708111 0.09023006 0.07136267]\n [ 0.0356443 -0.02606808 0.02 ]\n [ 0.14555594 -0.12656784 0.02 ]\n [-0.08859217 0.02379643 0.02 ]\n [ 0.07744371 0.01756141 0.02 ]\n [ 0.09247047 -0.1372752 0.02 ]]", "observation": "[[ 3.84396687e-02 -2.19447225e-12 1.97400138e-01 0.00000000e+00\n -0.00000000e+00 0.00000000e+00 0.00000000e+00 -1.28449693e-01\n -6.67957589e-02 1.99999996e-02 0.00000000e+00 -0.00000000e+00\n 0.00000000e+00 0.00000000e+00 0.00000000e+00 0.00000000e+00\n 0.00000000e+00 0.00000000e+00 0.00000000e+00]\n [ 3.84396687e-02 -2.19447225e-12 1.97400138e-01 0.00000000e+00\n -0.00000000e+00 0.00000000e+00 0.00000000e+00 -1.09177530e-01\n 3.15089454e-03 1.99999996e-02 0.00000000e+00 -0.00000000e+00\n 0.00000000e+00 0.00000000e+00 0.00000000e+00 0.00000000e+00\n 0.00000000e+00 0.00000000e+00 0.00000000e+00]\n [ 3.84396687e-02 -2.19447225e-12 1.97400138e-01 0.00000000e+00\n -0.00000000e+00 0.00000000e+00 0.00000000e+00 6.01155423e-02\n 1.41422555e-01 1.99999996e-02 0.00000000e+00 -0.00000000e+00\n 0.00000000e+00 0.00000000e+00 0.00000000e+00 0.00000000e+00\n 0.00000000e+00 0.00000000e+00 0.00000000e+00]\n [ 3.84396687e-02 -2.19447225e-12 1.97400138e-01 0.00000000e+00\n -0.00000000e+00 0.00000000e+00 0.00000000e+00 -3.07898633e-02\n -8.70008618e-02 1.99999996e-02 0.00000000e+00 -0.00000000e+00\n 0.00000000e+00 0.00000000e+00 0.00000000e+00 0.00000000e+00\n 0.00000000e+00 0.00000000e+00 0.00000000e+00]\n [ 3.84396687e-02 -2.19447225e-12 1.97400138e-01 0.00000000e+00\n -0.00000000e+00 0.00000000e+00 0.00000000e+00 -4.85790260e-02\n 1.27030194e-01 1.99999996e-02 0.00000000e+00 -0.00000000e+00\n 0.00000000e+00 0.00000000e+00 0.00000000e+00 0.00000000e+00\n 0.00000000e+00 0.00000000e+00 0.00000000e+00]\n [ 3.84396687e-02 -2.19447225e-12 1.97400138e-01 0.00000000e+00\n -0.00000000e+00 0.00000000e+00 0.00000000e+00 2.13160012e-02\n 1.49819955e-01 1.99999996e-02 0.00000000e+00 -0.00000000e+00\n 0.00000000e+00 0.00000000e+00 0.00000000e+00 0.00000000e+00\n 0.00000000e+00 0.00000000e+00 0.00000000e+00]\n [ 3.84396687e-02 -2.19447225e-12 1.97400138e-01 0.00000000e+00\n -0.00000000e+00 0.00000000e+00 0.00000000e+00 1.24516085e-01\n 4.62817699e-02 1.99999996e-02 0.00000000e+00 -0.00000000e+00\n 0.00000000e+00 0.00000000e+00 0.00000000e+00 0.00000000e+00\n 0.00000000e+00 0.00000000e+00 0.00000000e+00]\n [ 3.84396687e-02 -2.19447225e-12 1.97400138e-01 0.00000000e+00\n -0.00000000e+00 0.00000000e+00 0.00000000e+00 5.80823272e-02\n -1.34271756e-01 1.99999996e-02 0.00000000e+00 -0.00000000e+00\n 0.00000000e+00 0.00000000e+00 0.00000000e+00 0.00000000e+00\n 0.00000000e+00 0.00000000e+00 0.00000000e+00]\n [ 3.84396687e-02 -2.19447225e-12 1.97400138e-01 0.00000000e+00\n -0.00000000e+00 0.00000000e+00 0.00000000e+00 1.34108737e-01\n -1.25141487e-01 1.99999996e-02 0.00000000e+00 -0.00000000e+00\n 0.00000000e+00 0.00000000e+00 0.00000000e+00 0.00000000e+00\n 0.00000000e+00 0.00000000e+00 0.00000000e+00]\n [ 3.84396687e-02 -2.19447225e-12 1.97400138e-01 0.00000000e+00\n -0.00000000e+00 0.00000000e+00 0.00000000e+00 7.27433711e-02\n -3.64024304e-02 1.99999996e-02 0.00000000e+00 -0.00000000e+00\n 0.00000000e+00 0.00000000e+00 0.00000000e+00 0.00000000e+00\n 0.00000000e+00 0.00000000e+00 0.00000000e+00]\n [ 3.84396687e-02 -2.19447225e-12 1.97400138e-01 0.00000000e+00\n -0.00000000e+00 0.00000000e+00 0.00000000e+00 -1.12800054e-01\n 1.10905111e-01 1.99999996e-02 0.00000000e+00 -0.00000000e+00\n 0.00000000e+00 0.00000000e+00 0.00000000e+00 0.00000000e+00\n 0.00000000e+00 0.00000000e+00 0.00000000e+00]\n [ 3.84396687e-02 -2.19447225e-12 1.97400138e-01 0.00000000e+00\n -0.00000000e+00 0.00000000e+00 0.00000000e+00 -3.72901782e-02\n -1.35308519e-01 1.99999996e-02 0.00000000e+00 -0.00000000e+00\n 0.00000000e+00 0.00000000e+00 0.00000000e+00 0.00000000e+00\n 0.00000000e+00 0.00000000e+00 0.00000000e+00]\n [ 3.84396687e-02 -2.19447225e-12 1.97400138e-01 0.00000000e+00\n -0.00000000e+00 0.00000000e+00 0.00000000e+00 1.05750047e-01\n -7.36861750e-02 1.99999996e-02 0.00000000e+00 -0.00000000e+00\n 0.00000000e+00 0.00000000e+00 0.00000000e+00 0.00000000e+00\n 0.00000000e+00 0.00000000e+00 0.00000000e+00]\n [ 3.84396687e-02 -2.19447225e-12 1.97400138e-01 0.00000000e+00\n -0.00000000e+00 0.00000000e+00 0.00000000e+00 -4.49778093e-03\n 8.90591890e-02 1.99999996e-02 0.00000000e+00 -0.00000000e+00\n 0.00000000e+00 0.00000000e+00 0.00000000e+00 0.00000000e+00\n 0.00000000e+00 0.00000000e+00 0.00000000e+00]\n [ 3.84396687e-02 -2.19447225e-12 1.97400138e-01 0.00000000e+00\n -0.00000000e+00 0.00000000e+00 0.00000000e+00 1.64844710e-02\n -7.40618482e-02 1.99999996e-02 0.00000000e+00 -0.00000000e+00\n 0.00000000e+00 0.00000000e+00 0.00000000e+00 0.00000000e+00\n 0.00000000e+00 0.00000000e+00 0.00000000e+00]\n [ 3.84396687e-02 -2.19447225e-12 1.97400138e-01 0.00000000e+00\n -0.00000000e+00 0.00000000e+00 0.00000000e+00 9.50262696e-02\n 1.90338232e-02 1.99999996e-02 0.00000000e+00 -0.00000000e+00\n 0.00000000e+00 0.00000000e+00 0.00000000e+00 0.00000000e+00\n 0.00000000e+00 0.00000000e+00 0.00000000e+00]\n [ 3.84396687e-02 -2.19447225e-12 1.97400138e-01 0.00000000e+00\n -0.00000000e+00 0.00000000e+00 0.00000000e+00 1.20185450e-01\n -1.06318705e-01 1.99999996e-02 0.00000000e+00 -0.00000000e+00\n 0.00000000e+00 0.00000000e+00 0.00000000e+00 0.00000000e+00\n 0.00000000e+00 0.00000000e+00 0.00000000e+00]\n [ 3.84396687e-02 -2.19447225e-12 1.97400138e-01 0.00000000e+00\n -0.00000000e+00 0.00000000e+00 0.00000000e+00 -1.47879452e-01\n -8.88204575e-02 1.99999996e-02 0.00000000e+00 -0.00000000e+00\n 0.00000000e+00 0.00000000e+00 0.00000000e+00 0.00000000e+00\n 0.00000000e+00 0.00000000e+00 0.00000000e+00]\n [ 3.84396687e-02 -2.19447225e-12 1.97400138e-01 0.00000000e+00\n -0.00000000e+00 0.00000000e+00 0.00000000e+00 2.82923076e-02\n -5.04484847e-02 1.99999996e-02 0.00000000e+00 -0.00000000e+00\n 0.00000000e+00 0.00000000e+00 0.00000000e+00 0.00000000e+00\n 0.00000000e+00 0.00000000e+00 0.00000000e+00]\n [ 3.84396687e-02 -2.19447225e-12 1.97400138e-01 0.00000000e+00\n -0.00000000e+00 0.00000000e+00 0.00000000e+00 1.17014855e-01\n 8.87156650e-02 1.99999996e-02 0.00000000e+00 -0.00000000e+00\n 0.00000000e+00 0.00000000e+00 0.00000000e+00 0.00000000e+00\n 0.00000000e+00 0.00000000e+00 0.00000000e+00]]"}, "_episode_num": 0, "use_sde": false, "sde_sample_freq": -1, "_current_progress_remaining": 0.4210986666666666, "_stats_window_size": 100, "ep_info_buffer": {":type:": "<class 'collections.deque'>", ":serialized:": "gAWV4AsAAAAAAACMC2NvbGxlY3Rpb25zlIwFZGVxdWWUk5QpS2SGlFKUKH2UKIwBcpRHwAn+X7cfvF6MAWyUSzKMAXSUR0DUgccVSGahdX2UKGgGR8AlKo4uK4x2aAdLMmgIR0DUggZJL/S6dX2UKGgGR8AkQAfdRBNVaAdLMmgIR0DUgffHcUM5dX2UKGgGR8Ak/UHY6GQCaAdLMmgIR0DUgd4Glhw3dX2UKGgGR8AnYKhL5AQhaAdLMmgIR0DUgdClMyrQdX2UKGgGR8Al12FFlTWHaAdLMmgIR0DUghUzWPLgdX2UKGgGR8Apa+otL+PzaAdLMmgIR0DUghuLCN0edX2UKGgGR8ALXyoXKr7waAdLMmgIR0DUgd+obXHzdX2UKGgGR7+gOavzOHFhaAdLAWgIR0DUgeE5Jbt7dX2UKGgGR8AUcOLBKtgbaAdLMmgIR0DUgeecZtN0dX2UKGgGR8ApNaMaS9uhaAdLMmgIR0DUgg/ZqVQidX2UKGgGR8AqN+xW1c+raAdLMmgIR0DUgjTsIE8rdX2UKGgGR8AlkT3Zf2K3aAdLMmgIR0DUghkKKHfudX2UKGgGR8AmCExqO939aAdLMmgIR0DUgi52ki2VdX2UKGgGR8AROWGATZg5aAdLMmgIR0DUgg0fhddFdX2UKGgGR8AdeGtZFG5MaAdLMmgIR0DUgfzVf/m1dX2UKGgGR8AQ7qY7aIvbaAdLMmgIR0DUggy88La3dX2UKGgGR8Anqc4HX2/SaAdLMmgIR0DUgjxP+GXYdX2UKGgGR8AmeNI9TxXoaAdLMmgIR0DUggay8jA0dX2UKGgGR8Agv2h7E5yVaAdLMmgIR0DUgha+zt1IdX2UKGgGR8AhyrkKeCkHaAdLMmgIR0DUgflCkXUIdX2UKGgGR8Asw4TbnHNpaAdLMmgIR0DUggo8nuzAdX2UKGgGR8Amm9ytFKChaAdLMmgIR0DUgkmx/ustdX2UKGgGR8AhQGorFwT/aAdLMmgIR0DUgjtt+CsfdX2UKGgGR8Ai295hScbzaAdLMmgIR0DUgiKTbFjvdX2UKGgGR8AuawFC9h7WaAdLMmgIR0DUghTjrAxjdX2UKGgGR8AkfUVBUrCnaAdLMmgIR0DUgllUyYXwdX2UKGgGR8Ad+ZKFqSHNaAdLMmgIR0DUgl/e0ojOdX2UKGgGR8AsKgh8pkPMaAdLMmgIR0DUgiUllbu/dX2UKGgGR8AhvH9WIXTFaAdLMmgIR0DUgiubKA8TdX2UKGgGR8AiAEUTL4etaAdLMmgIR0DUglPncL0BdX2UKGgGR8AWapEQXhwVaAdLMmgIR0DUgnkRWcSXdX2UKGgGR8AlEQ7tAs06aAdLMmgIR0DUgl7uPV/ddX2UKGgGR8AjVg9eQdS3aAdLMmgIR0DUgnW4lQdkdX2UKGgGR8AqMjWTX8O1aAdLMmgIR0DUglVeZ5RkdX2UKGgGR8AkSKLsKLKnaAdLMmgIR0DUgkeoP07KdX2UKGgGR8AizdeIEbHZaAdLMmgIR0DUgliHwgDBdX2UKGgGR8AZ9C5VfeDWaAdLMmgIR0DUgoqw5eZ5dX2UKGgGR8AmRKOktVaPaAdLMmgIR0DUglT9ETg3dX2UKGgGR8AegYuTRplCaAdLMmgIR0DUgmzAymALdX2UKGgGR8Aa8XKr7wazaAdLMmgIR0DUgldDzAerdX2UKGgGR8AOTj94u9OAaAdLMmgIR0DUgm3qyGBXdX2UKGgGR8AS22TgVGkOaAdLMmgIR0DUgrC4ZuQ7dX2UKGgGR8Am4gvlEJBxaAdLMmgIR0DUgqJA6dUbdX2UKGgGR7+htxdY4hllaAdLAWgIR0DUgrPB1s+FdX2UKGgGR8Apxspobn5jaAdLMmgIR0DUgosAksz3dX2UKGgGR8Are5Jbt7a7aAdLMmgIR0DUgoGKqGUOdX2UKGgGR8AceGgzxgAqaAdLMmgIR0DUgsbmnwXqdX2UKGgGR8AkdX+VC5VfaAdLMmgIR0DUgs8Es8PndX2UKGgGR7+nGXHBDXvqaAdLAWgIR0DUgsoSIxgzdX2UKGgGR8AiWqFRHf/FaAdLMmgIR0DUgpb6DXe4dX2UKGgGR8AWYJ2MbWEsaAdLMmgIR0DUgp5/Tb35dX2UKGgGR8Ahf1A7gbZOaAdLMmgIR0DUgshPfsNUdX2UKGgGR8ApJFQVKwpwaAdLMmgIR0DUgu4eYD1XdX2UKGgGR8AcDedkJ8fFaAdLMmgIR0DUgtSahHskdX2UKGgGR8Ampjslb/wRaAdLMmgIR0DUgutH8TBZdX2UKGgGR8AU6tA9mpVCaAdLMmgIR0DUgswyBTXKdX2UKGgGR8Ayt9US7GvPaAdLMmgIR0DUgr3AoG6gdX2UKGgGR8Aar4i5d4VzaAdLMmgIR0DUgs7TUiIMdX2UKGgGR8ARMI4VARkFaAdLMmgIR0DUgwB+1Bt2dX2UKGgGR8AolGHYYixFaAdLMmgIR0DUgsrej2zwdX2UKGgGR8AndJGvwEyMaAdLMmgIR0DUguH4593KdX2UKGgGR8AO6fFrEcbSaAdLMmgIR0DUgswcJdB0dX2UKGgGR8AWWfoRqXWwaAdLMmgIR0DUguMOhCdCdX2UKGgGR8AeICHRCx/vaAdLMmgIR0DUgxeB/ZuidX2UKGgGR8AZ3EuQIUrTaAdLMmgIR0DUgyhOafBfdX2UKGgGR8ArQYw7DEWJaAdLMmgIR0DUgwAF3Y+TdX2UKGgGR8Ako2XLNfPYaAdLMmgIR0DUgvLzI3irdX2UKGgGR8AoPrjYI0IkaAdLMmgIR0DUgz24kNWmdX2UKGgGR8Alb0q6OHWSaAdLMmgIR0DUgziymhugdX2UKGgGR8AntY8uBczJaAdLMmgIR0DUgwKJJoTPdX2UKGgGR8AZK1qnFYMfaAdLMmgIR0DUgwjxYq5LdX2UKGgGR8AhHl2/zreJaAdLMmgIR0DUgzFZQpF1dX2UKGgGR8Akm8PFvQ4TaAdLMmgIR0DUg1aLgn+idX2UKGgGR8AjRxVhkRSQaAdLMmgIR0DUgzoajvd/dX2UKGgGR8AwnaF23azvaAdLMmgIR0DUg0+RW912dX2UKGgGR8AvUX3QD3dsaAdLMmgIR0DUgy5FSbYsdX2UKGgGR7+aE8JUo8ZDaAdLAWgIR0DUgy/CYTkAdX2UKGgGR8AppZElVtGeaAdLMmgIR0DUgx4OPNmldX2UKGgGR8Ad/Hhjvuw5aAdLMmgIR0DUgy3SjQAudX2UKGgGR8AudAt4A0bcaAdLMmgIR0DUg10rZrYXdX2UKGgGR8Af+obXHzYmaAdLMmgIR0DUgyeGfwqidX2UKGgGR8AsjvnbItDlaAdLMmgIR0DUgzbD7655dX2UKGgGR8Ajpmvnr6ciaAdLMmgIR0DUgxlvQ4S6dX2UKGgGR8AgNiSaEzwdaAdLMmgIR0DUgypByCFsdX2UKGgGR8AlRxb0OEuhaAdLMmgIR0DUg1oQ5FPSdX2UKGgGR8AfKx5cC5mRaAdLMmgIR0DUg2oHt4RmdX2UKGgGR8Ak2zFdcB2faAdLMmgIR0DUg0DzxwyZdX2UKGgGR8Apl+SbH6uXaAdLMmgIR0DUgzODujREdX2UKGgGR8AcxSMtK7I1aAdLMmgIR0DUg36VcD8tdX2UKGgGR8AYesFMZgogaAdLMmgIR0DUg3mPV/c4dX2UKGgGR8AWyj2zv7WNaAdLMmgIR0DUg0O16Vt5dX2UKGgGR8APpH09QoCuaAdLMmgIR0DUg0owQDmsdX2UKGgGR8AhlvMr3CbdaAdLMmgIR0DUg3KhzvJBdX2UKGgGR8AiwFnIyTIOaAdLMmgIR0DUg5e+0w8GdX2UKGgGR8AjpGKhtcfOaAdLMmgIR0DUg3vpwCKadX2UKGgGR8AmYrYoRZlnaAdLMmgIR0DUg5FA/s3RdX2UKGgGR8AmqxcmjTKDaAdLMmgIR0DUg3DZ+QU6dX2UKGgGR8AdV9jPOY6XaAdLMmgIR0DUg18oPTXrdX2UKGgGR8AlHoX9BKL9aAdLMmgIR0DUg29X3g1ndWUu"}, "ep_success_buffer": {":type:": "<class 'collections.deque'>", ":serialized:": "gAWVhgAAAAAAAACMC2NvbGxlY3Rpb25zlIwFZGVxdWWUk5QpS2SGlFKUKImJiYmJiYmJiImJiYmJiYmJiYmJiYmJiYmJiYmJiYmJiYmJiYmJiYmJiYmJiImJiYmIiYmJiYmJiYmJiYmJiYmJiYmJiYmJiYmJiYmJiImJiYmJiYmJiYmJiYmJiYmJiYmJiYllLg=="}, "_n_updates": 4240, "n_steps": 2048, "gamma": 0.99, "gae_lambda": 0.95, "ent_coef": 0.1, "vf_coef": 0.5, "max_grad_norm": 0.5, "rollout_buffer_class": {":type:": "<class 'abc.ABCMeta'>", ":serialized:": "gAWVOgAAAAAAAACMIHN0YWJsZV9iYXNlbGluZXMzLmNvbW1vbi5idWZmZXJzlIwRRGljdFJvbGxvdXRCdWZmZXKUk5Qu", "__module__": "stable_baselines3.common.buffers", "__annotations__": "{'observation_space': <class 'gymnasium.spaces.dict.Dict'>, 'obs_shape': typing.Dict[str, typing.Tuple[int, ...]], 'observations': typing.Dict[str, numpy.ndarray]}", "__doc__": "\n Dict Rollout buffer used in on-policy algorithms like A2C/PPO.\n Extends the RolloutBuffer to use dictionary observations\n\n It corresponds to ``buffer_size`` transitions collected\n using the current policy.\n This experience will be discarded after the policy update.\n In order to use PPO objective, we also store the current value of each state\n and the log probability of each taken action.\n\n The term rollout here refers to the model-free notion and should not\n be used with the concept of rollout used in model-based RL or planning.\n Hence, it is only involved in policy and value function training but not action selection.\n\n :param buffer_size: Max number of element in the buffer\n :param observation_space: Observation space\n :param action_space: Action space\n :param device: PyTorch device\n :param gae_lambda: Factor for trade-off of bias vs variance for Generalized Advantage Estimator\n Equivalent to Monte-Carlo advantage estimate when set to 1.\n :param gamma: Discount factor\n :param n_envs: Number of parallel environments\n ", "__init__": "<function DictRolloutBuffer.__init__ at 0x7f05f97c00d0>", "reset": "<function DictRolloutBuffer.reset at 0x7f05f97c0160>", "add": "<function DictRolloutBuffer.add at 0x7f05f97c01f0>", "get": "<function DictRolloutBuffer.get at 0x7f05f97c0280>", "_get_samples": "<function DictRolloutBuffer._get_samples at 0x7f05f97c0310>", "__abstractmethods__": "frozenset()", "_abc_impl": "<_abc._abc_data object at 0x7f05f97b9000>"}, "rollout_buffer_kwargs": {}, "batch_size": 2048, "n_epochs": 20, "clip_range": {":type:": "<class 'function'>", ":serialized:": "gAWVbQUAAAAAAACMF2Nsb3VkcGlja2xlLmNsb3VkcGlja2xllIwOX21ha2VfZnVuY3Rpb26Uk5QoaACMDV9idWlsdGluX3R5cGWUk5SMCENvZGVUeXBllIWUUpQoSwFLAEsASwFLA0sTQwx0AIgAfACDAYMBUwCUToWUjAVmbG9hdJSFlIwScHJvZ3Jlc3NfcmVtYWluaW5nlIWUjGAvaG9tZS90b21lay9weXRvcmNoX2xlYXJuaW5nL3ZlbnYvbGliL3B5dGhvbjMuMTAvc2l0ZS1wYWNrYWdlcy9zdGFibGVfYmFzZWxpbmVzMy9jb21tb24vdXRpbHMucHmUjAg8bGFtYmRhPpRLYUMCDACUjA52YWx1ZV9zY2hlZHVsZZSFlCl0lFKUfZQojAtfX3BhY2thZ2VfX5SMGHN0YWJsZV9iYXNlbGluZXMzLmNvbW1vbpSMCF9fbmFtZV9flIwec3RhYmxlX2Jhc2VsaW5lczMuY29tbW9uLnV0aWxzlIwIX19maWxlX1+UjGAvaG9tZS90b21lay9weXRvcmNoX2xlYXJuaW5nL3ZlbnYvbGliL3B5dGhvbjMuMTAvc2l0ZS1wYWNrYWdlcy9zdGFibGVfYmFzZWxpbmVzMy9jb21tb24vdXRpbHMucHmUdU5OaACMEF9tYWtlX2VtcHR5X2NlbGyUk5QpUpSFlHSUUpRoAIwSX2Z1bmN0aW9uX3NldHN0YXRllJOUaCF9lH2UKGgYaA+MDF9fcXVhbG5hbWVfX5SMIWdldF9zY2hlZHVsZV9mbi48bG9jYWxzPi48bGFtYmRhPpSMD19fYW5ub3RhdGlvbnNfX5R9lIwOX19rd2RlZmF1bHRzX1+UTowMX19kZWZhdWx0c19flE6MCl9fbW9kdWxlX1+UaBmMB19fZG9jX1+UTowLX19jbG9zdXJlX1+UaACMCl9tYWtlX2NlbGyUk5RoAihoByhLAUsASwBLAUsDSxNDDHQAiAB8AIMBgwFTAJROhZRoCoWUaAyFlIxgL2hvbWUvdG9tZWsvcHl0b3JjaF9sZWFybmluZy92ZW52L2xpYi9weXRob24zLjEwL3NpdGUtcGFja2FnZXMvc3RhYmxlX2Jhc2VsaW5lczMvY29tbW9uL3V0aWxzLnB5lIwIPGxhbWJkYT6US2FDAgwAlGgRhZQpdJRSlH2UKGgWjBhzdGFibGVfYmFzZWxpbmVzMy5jb21tb26UaBiMHnN0YWJsZV9iYXNlbGluZXMzLmNvbW1vbi51dGlsc5RoGoxgL2hvbWUvdG9tZWsvcHl0b3JjaF9sZWFybmluZy92ZW52L2xpYi9weXRob24zLjEwL3NpdGUtcGFja2FnZXMvc3RhYmxlX2Jhc2VsaW5lczMvY29tbW9uL3V0aWxzLnB5lHVOTmgdKVKUhZR0lFKUaCNoQn2UfZQoaBhoNmgmjCFnZXRfc2NoZWR1bGVfZm4uPGxvY2Fscz4uPGxhbWJkYT6UaCh9lGgqTmgrTmgsaD1oLU5oLmgwaAIoaAcoSwFLAEsASwFLAUsTQwSIAFMAlGgyKYwBX5SFlGg1jARmdW5jlEuFQwIEAZSMA3ZhbJSFlCl0lFKUaDtOTmgdKVKUhZR0lFKUaCNoU32UfZQoaBhoSmgmjBljb25zdGFudF9mbi48bG9jYWxzPi5mdW5jlGgofZRoKk5oK05oLGg9aC1OaC5oMEc/yZmZmZmZmoWUUpSFlIwXX2Nsb3VkcGlja2xlX3N1Ym1vZHVsZXOUXZSMC19fZ2xvYmFsc19flH2UdYaUhlIwhZRSlIWUaFtdlGhdfZR1hpSGUjCFlFKUhZRoW12UaF19lHWGlIZSMC4="}, "clip_range_vf": null, "normalize_advantage": true, "target_kl": null, "observation_space": {":type:": "<class 'gymnasium.spaces.dict.Dict'>", ":serialized:": "gAWVMgQAAAAAAACMFWd5bW5hc2l1bS5zcGFjZXMuZGljdJSMBERpY3SUk5QpgZR9lCiMBnNwYWNlc5SMC2NvbGxlY3Rpb25zlIwLT3JkZXJlZERpY3SUk5QpUpQojA1hY2hpZXZlZF9nb2FslIwUZ3ltbmFzaXVtLnNwYWNlcy5ib3iUjANCb3iUk5QpgZR9lCiMBWR0eXBllIwFbnVtcHmUjAVkdHlwZZSTlIwCZjSUiYiHlFKUKEsDjAE8lE5OTkr/////Sv////9LAHSUYowNYm91bmRlZF9iZWxvd5SMEm51bXB5LmNvcmUubnVtZXJpY5SMC19mcm9tYnVmZmVylJOUKJYDAAAAAAAAAAEBAZRoE4wCYjGUiYiHlFKUKEsDjAF8lE5OTkr/////Sv////9LAHSUYksDhZSMAUOUdJRSlIwNYm91bmRlZF9hYm92ZZRoHCiWAwAAAAAAAAABAQGUaCBLA4WUaCR0lFKUjAZfc2hhcGWUSwOFlIwDbG93lGgcKJYMAAAAAAAAAAAAIMEAACDBAAAgwZRoFksDhZRoJHSUUpSMBGhpZ2iUaBwolgwAAAAAAAAAAAAgQQAAIEEAACBBlGgWSwOFlGgkdJRSlIwIbG93X3JlcHKUjAUtMTAuMJSMCWhpZ2hfcmVwcpSMBDEwLjCUjApfbnBfcmFuZG9tlE51YowMZGVzaXJlZF9nb2FslGgNKYGUfZQoaBBoFmgZaBwolgMAAAAAAAAAAQEBlGggSwOFlGgkdJRSlGgnaBwolgMAAAAAAAAAAQEBlGggSwOFlGgkdJRSlGgsSwOFlGguaBwolgwAAAAAAAAAAAAgwQAAIMEAACDBlGgWSwOFlGgkdJRSlGgzaBwolgwAAAAAAAAAAAAgQQAAIEEAACBBlGgWSwOFlGgkdJRSlGg4jAUtMTAuMJRoOowEMTAuMJRoPE51YowLb2JzZXJ2YXRpb26UaA0pgZR9lChoEGgWaBloHCiWEwAAAAAAAAABAQEBAQEBAQEBAQEBAQEBAQEBlGggSxOFlGgkdJRSlGgnaBwolhMAAAAAAAAAAQEBAQEBAQEBAQEBAQEBAQEBAZRoIEsThZRoJHSUUpRoLEsThZRoLmgcKJZMAAAAAAAAAAAAIMEAACDBAAAgwQAAIMEAACDBAAAgwQAAIMEAACDBAAAgwQAAIMEAACDBAAAgwQAAIMEAACDBAAAgwQAAIMEAACDBAAAgwQAAIMGUaBZLE4WUaCR0lFKUaDNoHCiWTAAAAAAAAAAAACBBAAAgQQAAIEEAACBBAAAgQQAAIEEAACBBAAAgQQAAIEEAACBBAAAgQQAAIEEAACBBAAAgQQAAIEEAACBBAAAgQQAAIEEAACBBlGgWSxOFlGgkdJRSlGg4jAUtMTAuMJRoOowEMTAuMJRoPE51YnVoLE5oEE5oPE51Yi4=", "spaces": "OrderedDict([('achieved_goal', Box(-10.0, 10.0, (3,), float32)), ('desired_goal', Box(-10.0, 10.0, (3,), float32)), ('observation', Box(-10.0, 10.0, (19,), float32))])", "_shape": null, "dtype": null, "_np_random": null}, "action_space": {":type:": "<class 'gymnasium.spaces.box.Box'>", ":serialized:": "gAWVpwEAAAAAAACMFGd5bW5hc2l1bS5zcGFjZXMuYm94lIwDQm94lJOUKYGUfZQojAVkdHlwZZSMBW51bXB5lIwFZHR5cGWUk5SMAmY0lImIh5RSlChLA4wBPJROTk5K/////0r/////SwB0lGKMDWJvdW5kZWRfYmVsb3eUjBJudW1weS5jb3JlLm51bWVyaWOUjAtfZnJvbWJ1ZmZlcpSTlCiWBAAAAAAAAAABAQEBlGgIjAJiMZSJiIeUUpQoSwOMAXyUTk5OSv////9K/////0sAdJRiSwSFlIwBQ5R0lFKUjA1ib3VuZGVkX2Fib3ZllGgRKJYEAAAAAAAAAAEBAQGUaBVLBIWUaBl0lFKUjAZfc2hhcGWUSwSFlIwDbG93lGgRKJYQAAAAAAAAAAAAgL8AAIC/AACAvwAAgL+UaAtLBIWUaBl0lFKUjARoaWdolGgRKJYQAAAAAAAAAAAAgD8AAIA/AACAPwAAgD+UaAtLBIWUaBl0lFKUjAhsb3dfcmVwcpSMBC0xLjCUjAloaWdoX3JlcHKUjAMxLjCUjApfbnBfcmFuZG9tlE51Yi4=", "dtype": "float32", "bounded_below": "[ True True True True]", "bounded_above": "[ True True True True]", "_shape": [4], "low": "[-1. -1. -1. -1.]", "high": "[1. 1. 1. 1.]", "low_repr": "-1.0", "high_repr": "1.0", "_np_random": null}, "n_envs": 20, "lr_schedule": {":type:": "<class 'function'>", ":serialized:": "gAWVsQMAAAAAAACMF2Nsb3VkcGlja2xlLmNsb3VkcGlja2xllIwOX21ha2VfZnVuY3Rpb26Uk5QoaACMDV9idWlsdGluX3R5cGWUk5SMCENvZGVUeXBllIWUUpQoSwFLAEsASwFLA0sTQwx0AIgAfACDAYMBUwCUToWUjAVmbG9hdJSFlIwScHJvZ3Jlc3NfcmVtYWluaW5nlIWUjGAvaG9tZS90b21lay9weXRvcmNoX2xlYXJuaW5nL3ZlbnYvbGliL3B5dGhvbjMuMTAvc2l0ZS1wYWNrYWdlcy9zdGFibGVfYmFzZWxpbmVzMy9jb21tb24vdXRpbHMucHmUjAg8bGFtYmRhPpRLYUMCDACUjA52YWx1ZV9zY2hlZHVsZZSFlCl0lFKUfZQojAtfX3BhY2thZ2VfX5SMGHN0YWJsZV9iYXNlbGluZXMzLmNvbW1vbpSMCF9fbmFtZV9flIwec3RhYmxlX2Jhc2VsaW5lczMuY29tbW9uLnV0aWxzlIwIX19maWxlX1+UjGAvaG9tZS90b21lay9weXRvcmNoX2xlYXJuaW5nL3ZlbnYvbGliL3B5dGhvbjMuMTAvc2l0ZS1wYWNrYWdlcy9zdGFibGVfYmFzZWxpbmVzMy9jb21tb24vdXRpbHMucHmUdU5OaACMEF9tYWtlX2VtcHR5X2NlbGyUk5QpUpSFlHSUUpRoAIwSX2Z1bmN0aW9uX3NldHN0YXRllJOUaCF9lH2UKGgYaA+MDF9fcXVhbG5hbWVfX5SMIWdldF9zY2hlZHVsZV9mbi48bG9jYWxzPi48bGFtYmRhPpSMD19fYW5ub3RhdGlvbnNfX5R9lIwOX19rd2RlZmF1bHRzX1+UTowMX19kZWZhdWx0c19flE6MCl9fbW9kdWxlX1+UaBmMB19fZG9jX1+UTowLX19jbG9zdXJlX1+UaACMCl9tYWtlX2NlbGyUk5RoAihoByhLAUsASwBLAUsBSxNDBIgAUwCUaAkpjAFflIWUaA6MBGZ1bmOUS4VDAgQBlIwDdmFslIWUKXSUUpRoFU5OaB0pUpSFlHSUUpRoI2g9fZR9lChoGGg0aCaMGWNvbnN0YW50X2ZuLjxsb2NhbHM+LmZ1bmOUaCh9lGgqTmgrTmgsaBloLU5oLmgwRz8jqSowVTJhhZRSlIWUjBdfY2xvdWRwaWNrbGVfc3VibW9kdWxlc5RdlIwLX19nbG9iYWxzX1+UfZR1hpSGUjCFlFKUhZRoRV2UaEd9lHWGlIZSMC4="}, "system_info": {"OS": "Linux-5.15.146.1-microsoft-standard-WSL2-x86_64-with-glibc2.35 # 1 SMP Thu Jan 11 04:09:03 UTC 2024", "Python": "3.10.12", "Stable-Baselines3": "2.3.2", "PyTorch": "2.3.0+cu121", "GPU Enabled": "True", "Numpy": "1.26.4", "Cloudpickle": "3.0.0", "Gymnasium": "0.29.1", "OpenAI Gym": "0.26.2"}}

ppo-PandaPickAndPlaceDense-v3.zip ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:3223ea0f5e418a2f5e76f175ac56bd7ed9f2bc56bc5083adf201dbb09d6035b2
+size 202887601

ppo-PandaPickAndPlaceDense-v3/_stable_baselines3_version ADDED Viewed

	@@ -0,0 +1 @@


1	+ 2.3.2

ppo-PandaPickAndPlaceDense-v3/data ADDED Viewed

	@@ -0,0 +1,127 @@

+{
+    "policy_class": {
+        ":type:": "<class 'abc.ABCMeta'>",
+        ":serialized:": "gAWVRQAAAAAAAACMIXN0YWJsZV9iYXNlbGluZXMzLmNvbW1vbi5wb2xpY2llc5SMG011bHRpSW5wdXRBY3RvckNyaXRpY1BvbGljeZSTlC4=",
+        "__module__": "stable_baselines3.common.policies",
+        "__doc__": "\n    MultiInputActorClass policy class for actor-critic algorithms (has both policy and value prediction).\n    Used by A2C, PPO and the likes.\n\n    :param observation_space: Observation space (Tuple)\n    :param action_space: Action space\n    :param lr_schedule: Learning rate schedule (could be constant)\n    :param net_arch: The specification of the policy and value networks.\n    :param activation_fn: Activation function\n    :param ortho_init: Whether to use or not orthogonal initialization\n    :param use_sde: Whether to use State Dependent Exploration or not\n    :param log_std_init: Initial value for the log standard deviation\n    :param full_std: Whether to use (n_features x n_actions) parameters\n        for the std instead of only (n_features,) when using gSDE\n    :param use_expln: Use ``expln()`` function instead of ``exp()`` to ensure\n        a positive standard deviation (cf paper). It allows to keep variance\n        above zero and prevent it from growing too fast. In practice, ``exp()`` is usually enough.\n    :param squash_output: Whether to squash the output using a tanh function,\n        this allows to ensure boundaries when using gSDE.\n    :param features_extractor_class: Uses the CombinedExtractor\n    :param features_extractor_kwargs: Keyword arguments\n        to pass to the features extractor.\n    :param share_features_extractor: If True, the features extractor is shared between the policy and value networks.\n    :param normalize_images: Whether to normalize images or not,\n         dividing by 255.0 (True by default)\n    :param optimizer_class: The optimizer to use,\n        ``th.optim.Adam`` by default\n    :param optimizer_kwargs: Additional keyword arguments,\n        excluding the learning rate, to pass to the optimizer\n    ",
+        "__init__": "<function MultiInputActorCriticPolicy.__init__ at 0x7f05f95f11b0>",
+        "__abstractmethods__": "frozenset()",
+        "_abc_impl": "<_abc._abc_data object at 0x7f05f95e3f80>"
+    },
+    "verbose": 1,
+    "policy_kwargs": {
+        ":type:": "<class 'dict'>",
+        ":serialized:": "gAWVbwAAAAAAAAB9lCiMCG5ldF9hcmNolH2UKIwCcGmUXZQoTQAITQAITQAIZYwCdmaUXZQoTQAITQAITQAIZXWMDWFjdGl2YXRpb25fZm6UjBt0b3JjaC5ubi5tb2R1bGVzLmFjdGl2YXRpb26UjARSZUxVlJOUdS4=",
+        "net_arch": {
+            "pi": [
+                2048,
+                2048,
+                2048
+            ],
+            "vf": [
+                2048,
+                2048,
+                2048
+            ]
+        },
+        "activation_fn": "<class 'torch.nn.modules.activation.ReLU'>"
+    },
+    "num_timesteps": 8723380,
+    "_total_timesteps": 15000000,
+    "_num_timesteps_at_start": 0,
+    "seed": null,
+    "action_noise": null,
+    "start_time": 1718177593100130111,
+    "learning_rate": 0.00015,
+    "tensorboard_log": "./ppoPandaPickAndPlaceDense-v3/",
+    "_last_obs": {
+        ":type:": "<class 'collections.OrderedDict'>",
+        ":serialized:": "gAWVywgAAAAAAACMC2NvbGxlY3Rpb25zlIwLT3JkZXJlZERpY3SUk5QpUpQojA1hY2hpZXZlZF9nb2FslIwSbnVtcHkuY29yZS5udW1lcmljlIwLX2Zyb21idWZmZXKUk5QolvAAAAAAAAAAnS0aP40Uv76ziio9qRG0vvQwQD4vnSo9K9VCP0dRUr+6iSo9ljmcPrca1D5XZio9sbtyvzu2xT8zhio9+e0pP0Zbm78zhio99B9ivibqtr7clio9QXJkP+irA79XZio9+7FlvxMKmz8alyo9pbBQP5+Ggz9acyo9AfkGP1vVzr9oOS09AylgPyeHuz9XZio9PPDjPM4OND4vnSo9JyO8P8GVyr+vmCo9R79Vv7Bnl76ziio97fsOP3Btt78zhio9/epHv+ylzb8alyo9FxriPsFVDr8vnSo9IneBv/rKiD5XZio9w7xev+8Cr75XZio9lIwFbnVtcHmUjAVkdHlwZZSTlIwCZjSUiYiHlFKUKEsDjAE8lE5OTkr/////Sv////9LAHSUYksUSwOGlIwBQ5R0lFKUjAxkZXNpcmVkX2dvYWyUaAcolvAAAAAAAAAA0snMPyam0D9KIIu/PR+dP9RWd79KIIu/LOzjPfJsi730Kkg/+N2tP/Y7pj5KIIu/bx/7vjanxT3vWoI/Jr9Xv//Iw79KIIu/ZqkBPlSshT9gCA0/EJo5v6eYtj9RYpE8pmIGPoLASb80WpM/r5yIv1NoZ75rbOI/BIibP2xzUj4Gp3u/YqZzP7KrSz9vx7a+3y1Xv3vqbr8BwuA/fK81Phnjgz9xsXU/tyXQv5VAv7/rUKa9mKnKvJ0khD+8ZK8/eUm2O5MnU71KIIu/qm1tvwI1y75KIIu/J7ybP+BxwD4H6gs8ySMqviyKOz5KNI4/lGgOSxRLA4aUaBJ0lFKUjAtvYnNlcnZhdGlvbpRoByiW8AUAAAAAAADZoJQ/8vMFP+z3AT/eC5u+DkcIP12etL+4qWA/nS0aP40Uv76ziio9/FxVu4NezDpH0oS7sDB0PA1xrLrp15o8keV+OuWiprth2QO6IotzP+Kepz+mVSK/zJgfP97AvD43P5Q/ALiJv6kRtL70MEA+L50qPQVPa7uXcnA6c+f0u2wDdjygK5m68ReWPIGupjvHDIU6GQAHu34ILT9vX6K+ZPunP488oD9beq0+ewhMP0R6jb8r1UI/R1FSv7qJKj0KjlW7XL3OOjIsl7ufzHM8YFitusUAmzxMu4Q6aHaru7/MA7oztHY/iW2JP2DCEUDt0ak/60Fmvw1o4r8R75I/ljmcPrca1D5XZio9V+M3uxI9uDrLhLq7hj9bPFny6bmj15o8Ds9+OheaprtXWAW7HO6yPvO0or9eHlg/LPCLv9l6z7/SsEm+coiSP7G7cr87tsU/M4YqPbbfaru3ifY6X5e4uwdBZDxoPDi6o9eaPP/OfjoWmqa7IQwDu3eZZj+vrXo+L5YEvy/8QD4jJ62/1HiRP3zAjj/57Sk/RlubvzOGKj2332q7won2OnAmvbsEQWQ8/Ts4uqPXmjz/zn46Fpqmu3cMA7vkvkc/+dVWvXTYoz/190i/2dxfv3wDJT+FJ16/9B9ivibqtr7clio9DfZxu7rKwTqPWJy7QqhsPBAvojkT4Jo82k+DOlNspru3tIO6UonnPs52oD3ckBC/S5K/P6rYlb9/72Y/dSpoP0FyZD/oqwO/V2YqPXvjN7sRPbg6/pq1u3s/WzzC9em5mdeaPF/WfjoXmqa7p1cFu4CLbD+0Qm6/YOr5PtCxiT+F2QQ/lftfP/cjXr/7sWW/EwqbPxqXKj1G0HG79OXBOigiNrtIpGw8+8OkOaPXmjwi0n46v5mmu6TGg7qIumk/bKV8vj+cUD/zBME/1U9Wv4ovoz//7o2/pbBQP5+Ggz9acyo9NcpGu2lG0jors7C7FQ9OPL/1o7r5ops86/u5O22fJLxehgW7HAB6P44NHr1cnSs/GzrOPu+9gbyBdIk9A++NvwH5Bj9b1c6/aDktPRmuZ7uLOKM69Wyvuyf4YzwA5sa5o9eaPAPPfjoYmqa71QrzukwBar4qPxa/2oV/vplrmz95IWa/S2PAPzXCXz8DKWA/J4e7P1dmKj1O4ze7Gj24OuDxzru2P1s8lu7puaPXmjwOz346F5qmuzRbBbseu7c+7p3Vv2Dbl7+jIc29nOyuPlaAIb/e3F8/PPDjPM4OND4vnSo97jVau9nNrjrr5FO7SnJYPB+HYDrxF5Y8ao20u4e8Erx3Fdi6I1tZP2rm7jz5yyE/qmvdvjkuzD8yWhs/xLxfPycjvD/Blcq/r5gqPfmzX7t2c4A6hw+zuzw8WjyvSoe67JaaPClZrDoetqG7+DIxu+BGXT9sCJC/VGksQHldTL/A6p6/L4R6P6T+kj9Hv1W/sGeXvrOKKj2oWlW7HVTMOiNX1bomMHQ8smusuqPXmjzs0346qpqmu4wcBLr7ows+Ujr0PEYSPD50uRw/RO/hvxmBfT+x/pI/7fsOP3Btt78zhio9tt9qu7GJ9jqR6bW7CUFkPKY8OLqj15o8/85+OhWaprvvCwO7Hop7P71rZT9s5VK/4wkfP2sJ772sYsU9Q2qNv/3qR7/spc2/GpcqPVrRcbux4sE6vVeFu3ukbDyW06Q5o9eaPCLSfjq/maa76LqDunfcnT1FiwA/DVcsv2v8vT6tTjM/FQE7P3N6kj8XGuI+wVUOvy+dKj3+NVq7z82uOvQNibsQc1g8QJBgOvcXljz0krS7+LcSvD0e2LpvQ4I/lvJYvjRIzT70CuA+Qw+9P8FxxD9/J16/IneBv/rKiD5XZio9VuM3uxM9uDphI7y7ij9bPA3y6bmj15o8Ds9+OheapruSWAW7QFQ5PzOmyT9lTlu/y9zyvT1i8j4MB7c9IopWv8O8Xr/vAq++V2YqPVDjN7sYPbg6rTXJu6k/Wzyk7+m5o9eaPA7PfjoXmqa7ZloFu5RoDksUSxOGlGgSdJRSlHUu",
+        "achieved_goal": "[[ 0.6022585  -0.37320367  0.04163618]\n [-0.35169724  0.18768674  0.04165381]\n [ 0.7610652  -0.8215527   0.04163525]\n [ 0.30512685  0.41426632  0.04160151]\n [-0.94817644  1.5446237   0.04163189]\n [ 0.6637874  -1.213723    0.04163189]\n [-0.22082502 -0.35725516  0.04164778]\n [ 0.8923684  -0.51434183  0.04160151]\n [-0.897247    1.211245    0.04164801]\n [ 0.8151954   1.0275458   0.04161391]\n [ 0.527237   -1.6158861   0.04229107]\n [ 0.8756258   1.465062    0.04160151]\n [ 0.02782451  0.17583773  0.04165381]\n [ 1.4698228  -1.5826951   0.04164952]\n [-0.8349499  -0.29571295  0.04163618]\n [ 0.5585316  -1.4330273   0.04163189]\n [-0.7809294  -1.606626    0.04164801]\n [ 0.4416053  -0.555996    0.04165381]\n [-1.0114481   0.2671736   0.04160151]\n [-0.8700678  -0.34181926  0.04160151]]",
+        "desired_goal": "[[ 1.5999091   1.6300704  -1.0869229 ]\n [ 1.2275158  -0.96616864 -1.0869229 ]\n [ 0.11129031 -0.06807889  0.7819054 ]\n [ 1.3583364   0.32467622 -1.0869229 ]\n [-0.4904742   0.09651034  1.0184001 ]\n [-0.84276044 -1.5295714  -1.0869229 ]\n [ 0.12662277  1.0443215   0.55090904]\n [-0.72500706  1.4265336   0.01774708]\n [ 0.13123569 -0.7880937   1.1511903 ]\n [-1.0672816  -0.2259839   1.7689337 ]\n [ 1.2150884   0.20551842 -0.9830173 ]\n [ 0.95175755  0.7955886  -0.3569903 ]\n [-0.8405437  -0.9332654   1.7559205 ]\n [ 0.17742723  1.030368    0.9597388 ]\n [-1.626151   -1.4941584  -0.08120903]\n [-0.02473907  1.0323673   1.3702617 ]\n [ 0.00556296 -0.05155141 -1.0869229 ]\n [-0.9274546  -0.3968888  -1.0869229 ]\n [ 1.2166795   0.3758688   0.00853968]\n [-0.16615213  0.18314427  1.1109707 ]]",
+        "observation": "[[ 1.1611587e+00  5.2325356e-01  5.0768924e-01 -3.0282491e-01\n   5.3233421e-01 -1.4110829e+00  8.7758970e-01  6.0225850e-01\n  -3.7320367e-01  4.1636180e-02 -3.2556644e-03  1.5592132e-03\n  -4.0533873e-03  1.4904186e-02 -1.3156250e-03  1.8901782e-02\n   9.7235391e-04 -5.0853365e-03 -5.0296454e-04]\n [ 9.5134175e-01  1.3095362e+00 -6.3411939e-01  6.2342525e-01\n   3.6865896e-01  1.1581792e+00 -1.0759277e+00 -3.5169724e-01\n   1.8768674e-01  4.1653808e-02 -3.5905254e-03  9.1723487e-04\n  -7.4738800e-03  1.5015464e-02 -1.1685975e-03  1.8321963e-02\n   5.0867205e-03  1.0150903e-03 -2.0599423e-03]\n [ 6.7591083e-01 -3.1713435e-01  1.3123593e+00  1.2518481e+00\n   3.3882412e-01  7.9700440e-01 -1.1052938e+00  7.6106519e-01\n  -8.2155269e-01  4.1635253e-02 -3.2585883e-03  1.5772986e-03\n  -4.6134228e-03  1.4880328e-02 -1.3225190e-03  1.8921265e-02\n   1.0126620e-03 -5.2326210e-03 -5.0277630e-04]\n [ 9.6368712e-01  1.0736552e+00  2.2774887e+00  1.3267189e+00\n  -8.9944333e-01 -1.7688004e+00  1.1479207e+00  3.0512685e-01\n   4.1426632e-01  4.1601505e-02 -2.8059089e-03  1.4056286e-03\n  -5.6920997e-03  1.3381844e-02 -4.4621786e-04  1.8901652e-02\n   9.7201846e-04 -5.0842869e-03 -2.0346844e-03]\n [ 3.4947288e-01 -1.2711471e+00  8.4421337e-01 -1.0932670e+00\n  -1.6209365e+00 -1.9696358e-01  1.1447890e+00 -9.4817644e-01\n   1.5446237e+00  4.1631889e-02 -3.5838909e-03  1.8809353e-03\n  -5.6332792e-03  1.3931519e-02 -7.0280442e-04  1.8901652e-02\n   9.7201759e-04 -5.0842864e-03 -1.9996243e-03]\n [ 9.0077919e-01  2.4480318e-01 -5.1791662e-01  1.8846200e-01\n  -1.3527569e+00  1.1364999e+00  1.1152492e+00  6.6378742e-01\n  -1.2137229e+00  4.1631889e-02 -3.5838911e-03  1.8809366e-03\n  -5.7724044e-03  1.3931517e-02 -7.0279819e-04  1.8901652e-02\n   9.7201759e-04 -5.0842864e-03 -1.9996443e-03]\n [ 7.8025651e-01 -5.2450154e-02  1.2800431e+00 -7.8503352e-01\n  -8.7446362e-01  6.4458442e-01 -8.6779052e-01 -2.2082502e-01\n  -3.5725516e-01  4.1647777e-02 -3.6920339e-03  1.4785149e-03\n  -4.7712992e-03  1.4444413e-02  3.0934112e-04  1.8905675e-02\n   1.0018304e-03 -5.0788312e-03 -1.0048364e-03]\n [ 4.5221955e-01  7.8351602e-02 -5.6471038e-01  1.4966520e+00\n  -1.1706746e+00  9.0209192e-01  9.0689784e-01  8.9236838e-01\n  -5.1434183e-01  4.1601505e-02 -2.8059173e-03  1.4056285e-03\n  -5.5421581e-03  1.3381834e-02 -4.4624327e-04  1.8901633e-02\n   9.7212748e-04 -5.0842869e-03 -2.0346434e-03]\n [ 9.2400360e-01 -9.3070531e-01  4.8811626e-01  1.0757389e+00\n   5.1894408e-01  8.7493259e-01 -8.6773628e-01 -8.9724702e-01\n   1.2112449e+00  4.1648008e-02 -3.6897822e-03  1.4793263e-03\n  -2.7791355e-03  1.4443465e-02  3.1426534e-04  1.8901652e-02\n   9.7206433e-04 -5.0842459e-03 -1.0053706e-03]\n [ 9.1300249e-01 -2.4672478e-01  8.1488413e-01  1.5079635e+00\n  -8.3715564e-01  1.2748883e+00 -1.1088561e+00  8.1519538e-01\n   1.0275458e+00  4.1613914e-02 -3.0332927e-03  1.6042712e-03\n  -5.3924522e-03  1.2576838e-02 -1.2509151e-03  1.8998610e-02\n   5.6757829e-03 -1.0047776e-02 -2.0374279e-03]\n [ 9.7656417e-01 -3.8587146e-02  6.7036986e-01  4.0278706e-01\n  -1.5837638e-02  6.7116745e-02 -1.1088566e+00  5.2723700e-01\n  -1.6158861e+00  4.2291075e-02 -3.5351573e-03  1.2452764e-03\n  -5.3535649e-03  1.3914145e-02 -3.7936866e-04  1.8901652e-02\n   9.7201782e-04 -5.0842874e-03 -1.8542657e-03]\n [-2.2852057e-01 -5.8690131e-01 -2.4953404e-01  1.2142211e+00\n  -8.9894825e-01  1.5030302e+00  8.7405711e-01  8.7562579e-01\n   1.4650620e+00  4.1601505e-02 -2.8059068e-03  1.4056296e-03\n  -6.3154548e-03  1.3381889e-02 -4.4618984e-04  1.8901652e-02\n   9.7201846e-04 -5.0842869e-03 -2.0348551e-03]\n [ 3.5884947e-01 -1.6688821e+00 -1.1863823e+00 -1.0016181e-01\n   3.4164894e-01 -6.3086450e-01  8.7446392e-01  2.7824514e-02\n   1.7583773e-01  4.1653808e-02 -3.3296305e-03  1.3336494e-03\n  -3.2332491e-03  1.3210842e-02  8.5650565e-04  1.8321963e-02\n  -5.5100219e-03 -8.9560812e-03 -1.6485889e-03]\n [ 8.4904689e-01  2.9162604e-02  6.3201863e-01 -4.3246204e-01\n   1.5951606e+00  6.0684502e-01  8.7397408e-01  1.4698228e+00\n  -1.5826951e+00  4.1649517e-02 -3.4134372e-03  9.8000350e-04\n  -5.4644975e-03  1.3320025e-02 -1.0321940e-03  1.8870793e-02\n   1.3149130e-03 -4.9350401e-03 -2.7038436e-03]\n [ 8.6436272e-01 -1.1252570e+00  2.6939287e+00 -7.9830128e-01\n  -1.2415390e+00  9.7857946e-01  1.1483960e+00 -8.3494991e-01\n  -2.9571295e-01  4.1636180e-02 -3.2555256e-03  1.5589033e-03\n  -1.6276579e-03  1.4904058e-02 -1.3154654e-03  1.8901652e-02\n   9.7209099e-04 -5.0843554e-03 -5.0396542e-04]\n [ 1.3636772e-01  2.9812966e-02  1.8366346e-01  6.1220479e-01\n  -1.7651143e+00  9.9025112e-01  1.1483976e+00  5.5853158e-01\n  -1.4330273e+00  4.1631889e-02 -3.5838909e-03  1.8809346e-03\n  -5.5515249e-03  1.3931521e-02 -7.0280803e-04  1.8901652e-02\n   9.7201759e-04 -5.0842860e-03 -1.9996127e-03]\n [ 9.8257625e-01  8.9617521e-01 -8.2381320e-01  6.2124461e-01\n  -1.1671718e-01  9.6379608e-02 -1.1048054e+00 -7.8092939e-01\n  -1.6066260e+00  4.1648008e-02 -3.6898465e-03  1.4792291e-03\n  -4.0692971e-03  1.4443512e-02  3.1438161e-04  1.8901652e-02\n   9.7206433e-04 -5.0842459e-03 -1.0050209e-03]\n [ 7.7080660e-02  5.0212508e-01 -6.7320329e-01  3.7106642e-01\n   7.0041925e-01  7.3048526e-01  1.1443619e+00  4.4160530e-01\n  -5.5599600e-01  4.1653808e-02 -3.3296342e-03  1.3336482e-03\n  -4.1825715e-03  1.3211027e-02  8.5664168e-04  1.8321974e-02\n  -5.5106822e-03 -8.9549944e-03 -1.6488504e-03]\n [ 1.0176829e+00 -2.1186289e-01  4.0094149e-01  4.3758357e-01\n   1.4770283e+00  1.5347215e+00 -8.6779016e-01 -1.0114481e+00\n   2.6717359e-01  4.1601505e-02 -2.8059087e-03  1.4056287e-03\n  -5.7415222e-03  1.3381848e-02 -4.4621565e-04  1.8901652e-02\n   9.7201846e-04 -5.0842869e-03 -2.0346981e-03]\n [ 7.2394180e-01  1.5753845e+00 -8.5666496e-01 -1.1858519e-01\n   4.7340575e-01  8.9368910e-02 -8.3804524e-01 -8.7006778e-01\n  -3.4181926e-01  4.1601505e-02 -2.8059073e-03  1.4056293e-03\n  -6.1404319e-03  1.3381877e-02 -4.4619769e-04  1.8901652e-02\n   9.7201846e-04 -5.0842869e-03 -2.0348071e-03]]"
+    },
+    "_last_episode_starts": {
+        ":type:": "<class 'numpy.ndarray'>",
+        ":serialized:": "gAWVhwAAAAAAAACMEm51bXB5LmNvcmUubnVtZXJpY5SMC19mcm9tYnVmZmVylJOUKJYUAAAAAAAAAAAAAAAAAAAAAAABAAAAAAAAAAAAlIwFbnVtcHmUjAVkdHlwZZSTlIwCYjGUiYiHlFKUKEsDjAF8lE5OTkr/////Sv////9LAHSUYksUhZSMAUOUdJRSlC4="
+    },
+    "_last_original_obs": {
+        ":type:": "<class 'collections.OrderedDict'>",
+        ":serialized:": "gAWVywgAAAAAAACMC2NvbGxlY3Rpb25zlIwLT3JkZXJlZERpY3SUk5QpUpQojA1hY2hpZXZlZF9nb2FslIwSbnVtcHkuY29yZS5udW1lcmljlIwLX2Zyb21idWZmZXKUk5QolvAAAAAAAAAAUYgDvjfMiL0K16M8eJjfvT1/TjsK16M8tzt2PRPRED4K16M8Bjv8vIItsr0K16M8zfpGvTQUAj4K16M85Z6uPGdqGT4K16M8SgL/PfSRPT0K16M8vOdtPYl+Cb4K16M8zVMJPhclAL4K16M8evqUPbcaFb0K16M8twPnvTgi4z0K16M8lr0YvVGOCr4K16M8e5PYPcfolr0K16M8H2KTu6pktj0K16M8cQqHPL2tl70K16M8Ip3CPdLsmzwK16M8yiP2PZ+92b0K16M8tm0XvoDntb0K16M8RcXnPBKjTr0K16M8fKXvPY+wtT0K16M8lIwFbnVtcHmUjAVkdHlwZZSTlIwCZjSUiYiHlFKUKEsDjAE8lE5OTkr/////Sv////9LAHSUYksUSwOGlIwBQ5R0lFKUjAxkZXNpcmVkX2dvYWyUaAcolvAAAAAAAAAAmnoqPdiZObwK16M89s7LPdXWfz1F3hs+Vx2QPUCbX72bxVQ+WBWvPTziBz4K16M8uyH2vdufq70MaV4+HPqLvX+UX71RiAE+7GDKPBPSrL1HIys9AecxvLRcHj1OlrU9Kx/pvZJWkb0K16M8ZrcVPs/Enb2agEw+11tHvXRFVLyxKPI9/zaovVdua73HchU9U/6IvPd2ez3d8CI+JNMbvdDnQTx2WzY+0mGJPYrKuD2XJpI9wv8RPbqM1bwK16M8ngwVPgCbAb4K16M80G+1vbvwwjwK16M8z5qePfTcjzwK16M8KWG9Pd+RDL4K16M8lGgOSxRLA4aUaBJ0lFKUjAtvYnNlcnZhdGlvbpRoByiW8AUAAAAAAADqch09GWwarEMjSj4AAAAAAAAAgAAAAAAAAAAAUYgDvjfMiL0K16M8AAAAAAAAAIAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA6nIdPRlsGqxDI0o+AAAAAAAAAIAAAAAAAAAAAHiY3709f047CtejPAAAAAAAAACAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAOpyHT0ZbBqsQyNKPgAAAAAAAACAAAAAAAAAAAC3O3Y9E9EQPgrXozwAAAAAAAAAgAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAADqch09GWwarEMjSj4AAAAAAAAAgAAAAAAAAAAABjv8vIItsr0K16M8AAAAAAAAAIAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA6nIdPRlsGqxDI0o+AAAAAAAAAIAAAAAAAAAAAM36Rr00FAI+CtejPAAAAAAAAACAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAOpyHT0ZbBqsQyNKPgAAAAAAAACAAAAAAAAAAADlnq48Z2oZPgrXozwAAAAAAAAAgAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAADqch09GWwarEMjSj4AAAAAAAAAgAAAAAAAAAAASgL/PfSRPT0K16M8AAAAAAAAAIAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA6nIdPRlsGqxDI0o+AAAAAAAAAIAAAAAAAAAAALznbT2Jfgm+CtejPAAAAAAAAACAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAOpyHT0ZbBqsQyNKPgAAAAAAAACAAAAAAAAAAADNUwk+FyUAvgrXozwAAAAAAAAAgAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAADqch09GWwarEMjSj4AAAAAAAAAgAAAAAAAAAAAevqUPbcaFb0K16M8AAAAAAAAAIAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA6nIdPRlsGqxDI0o+AAAAAAAAAIAAAAAAAAAAALcD5704IuM9CtejPAAAAAAAAACAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAOpyHT0ZbBqsQyNKPgAAAAAAAACAAAAAAAAAAACWvRi9UY4KvgrXozwAAAAAAAAAgAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAADqch09GWwarEMjSj4AAAAAAAAAgAAAAAAAAAAAe5PYPcfolr0K16M8AAAAAAAAAIAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA6nIdPRlsGqxDI0o+AAAAAAAAAIAAAAAAAAAAAB9ik7uqZLY9CtejPAAAAAAAAACAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAOpyHT0ZbBqsQyNKPgAAAAAAAACAAAAAAAAAAABxCoc8va2XvQrXozwAAAAAAAAAgAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAADqch09GWwarEMjSj4AAAAAAAAAgAAAAAAAAAAAIp3CPdLsmzwK16M8AAAAAAAAAIAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA6nIdPRlsGqxDI0o+AAAAAAAAAIAAAAAAAAAAAMoj9j2fvdm9CtejPAAAAAAAAACAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAOpyHT0ZbBqsQyNKPgAAAAAAAACAAAAAAAAAAAC2bRe+gOe1vQrXozwAAAAAAAAAgAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAADqch09GWwarEMjSj4AAAAAAAAAgAAAAAAAAAAARcXnPBKjTr0K16M8AAAAAAAAAIAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA6nIdPRlsGqxDI0o+AAAAAAAAAIAAAAAAAAAAAHyl7z2PsLU9CtejPAAAAAAAAACAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAJRoDksUSxOGlGgSdJRSlHUu",
+        "achieved_goal": "[[-0.1284497  -0.06679576  0.02      ]\n [-0.10917753  0.00315089  0.02      ]\n [ 0.06011554  0.14142255  0.02      ]\n [-0.03078986 -0.08700086  0.02      ]\n [-0.04857903  0.1270302   0.02      ]\n [ 0.021316    0.14981996  0.02      ]\n [ 0.12451608  0.04628177  0.02      ]\n [ 0.05808233 -0.13427176  0.02      ]\n [ 0.13410874 -0.12514149  0.02      ]\n [ 0.07274337 -0.03640243  0.02      ]\n [-0.11280005  0.11090511  0.02      ]\n [-0.03729018 -0.13530852  0.02      ]\n [ 0.10575005 -0.07368618  0.02      ]\n [-0.00449778  0.08905919  0.02      ]\n [ 0.01648447 -0.07406185  0.02      ]\n [ 0.09502627  0.01903382  0.02      ]\n [ 0.12018545 -0.1063187   0.02      ]\n [-0.14787945 -0.08882046  0.02      ]\n [ 0.02829231 -0.05044848  0.02      ]\n [ 0.11701486  0.08871567  0.02      ]]",
+        "desired_goal": "[[ 0.04162083 -0.01132818  0.02      ]\n [ 0.09951584  0.06246074  0.15221508]\n [ 0.07036846 -0.05459142  0.20778506]\n [ 0.08548993  0.13269895  0.02      ]\n [-0.12018152 -0.08380099  0.2171976 ]\n [-0.06834814 -0.05458498  0.12649657]\n [ 0.02470442 -0.08438506  0.04178169]\n [-0.0108583   0.03866263  0.08866559]\n [-0.11382898 -0.0709659   0.02      ]\n [ 0.14620742 -0.07703554  0.19970933]\n [-0.04867157 -0.01295601  0.11824168]\n [-0.08213615 -0.05747828  0.03648641]\n [-0.01672283  0.06139275  0.15912195]\n [-0.03804316  0.01183505  0.17808327]\n [ 0.06708111  0.09023006  0.07136267]\n [ 0.0356443  -0.02606808  0.02      ]\n [ 0.14555594 -0.12656784  0.02      ]\n [-0.08859217  0.02379643  0.02      ]\n [ 0.07744371  0.01756141  0.02      ]\n [ 0.09247047 -0.1372752   0.02      ]]",
+        "observation": "[[ 3.84396687e-02 -2.19447225e-12  1.97400138e-01  0.00000000e+00\n  -0.00000000e+00  0.00000000e+00  0.00000000e+00 -1.28449693e-01\n  -6.67957589e-02  1.99999996e-02  0.00000000e+00 -0.00000000e+00\n   0.00000000e+00  0.00000000e+00  0.00000000e+00  0.00000000e+00\n   0.00000000e+00  0.00000000e+00  0.00000000e+00]\n [ 3.84396687e-02 -2.19447225e-12  1.97400138e-01  0.00000000e+00\n  -0.00000000e+00  0.00000000e+00  0.00000000e+00 -1.09177530e-01\n   3.15089454e-03  1.99999996e-02  0.00000000e+00 -0.00000000e+00\n   0.00000000e+00  0.00000000e+00  0.00000000e+00  0.00000000e+00\n   0.00000000e+00  0.00000000e+00  0.00000000e+00]\n [ 3.84396687e-02 -2.19447225e-12  1.97400138e-01  0.00000000e+00\n  -0.00000000e+00  0.00000000e+00  0.00000000e+00  6.01155423e-02\n   1.41422555e-01  1.99999996e-02  0.00000000e+00 -0.00000000e+00\n   0.00000000e+00  0.00000000e+00  0.00000000e+00  0.00000000e+00\n   0.00000000e+00  0.00000000e+00  0.00000000e+00]\n [ 3.84396687e-02 -2.19447225e-12  1.97400138e-01  0.00000000e+00\n  -0.00000000e+00  0.00000000e+00  0.00000000e+00 -3.07898633e-02\n  -8.70008618e-02  1.99999996e-02  0.00000000e+00 -0.00000000e+00\n   0.00000000e+00  0.00000000e+00  0.00000000e+00  0.00000000e+00\n   0.00000000e+00  0.00000000e+00  0.00000000e+00]\n [ 3.84396687e-02 -2.19447225e-12  1.97400138e-01  0.00000000e+00\n  -0.00000000e+00  0.00000000e+00  0.00000000e+00 -4.85790260e-02\n   1.27030194e-01  1.99999996e-02  0.00000000e+00 -0.00000000e+00\n   0.00000000e+00  0.00000000e+00  0.00000000e+00  0.00000000e+00\n   0.00000000e+00  0.00000000e+00  0.00000000e+00]\n [ 3.84396687e-02 -2.19447225e-12  1.97400138e-01  0.00000000e+00\n  -0.00000000e+00  0.00000000e+00  0.00000000e+00  2.13160012e-02\n   1.49819955e-01  1.99999996e-02  0.00000000e+00 -0.00000000e+00\n   0.00000000e+00  0.00000000e+00  0.00000000e+00  0.00000000e+00\n   0.00000000e+00  0.00000000e+00  0.00000000e+00]\n [ 3.84396687e-02 -2.19447225e-12  1.97400138e-01  0.00000000e+00\n  -0.00000000e+00  0.00000000e+00  0.00000000e+00  1.24516085e-01\n   4.62817699e-02  1.99999996e-02  0.00000000e+00 -0.00000000e+00\n   0.00000000e+00  0.00000000e+00  0.00000000e+00  0.00000000e+00\n   0.00000000e+00  0.00000000e+00  0.00000000e+00]\n [ 3.84396687e-02 -2.19447225e-12  1.97400138e-01  0.00000000e+00\n  -0.00000000e+00  0.00000000e+00  0.00000000e+00  5.80823272e-02\n  -1.34271756e-01  1.99999996e-02  0.00000000e+00 -0.00000000e+00\n   0.00000000e+00  0.00000000e+00  0.00000000e+00  0.00000000e+00\n   0.00000000e+00  0.00000000e+00  0.00000000e+00]\n [ 3.84396687e-02 -2.19447225e-12  1.97400138e-01  0.00000000e+00\n  -0.00000000e+00  0.00000000e+00  0.00000000e+00  1.34108737e-01\n  -1.25141487e-01  1.99999996e-02  0.00000000e+00 -0.00000000e+00\n   0.00000000e+00  0.00000000e+00  0.00000000e+00  0.00000000e+00\n   0.00000000e+00  0.00000000e+00  0.00000000e+00]\n [ 3.84396687e-02 -2.19447225e-12  1.97400138e-01  0.00000000e+00\n  -0.00000000e+00  0.00000000e+00  0.00000000e+00  7.27433711e-02\n  -3.64024304e-02  1.99999996e-02  0.00000000e+00 -0.00000000e+00\n   0.00000000e+00  0.00000000e+00  0.00000000e+00  0.00000000e+00\n   0.00000000e+00  0.00000000e+00  0.00000000e+00]\n [ 3.84396687e-02 -2.19447225e-12  1.97400138e-01  0.00000000e+00\n  -0.00000000e+00  0.00000000e+00  0.00000000e+00 -1.12800054e-01\n   1.10905111e-01  1.99999996e-02  0.00000000e+00 -0.00000000e+00\n   0.00000000e+00  0.00000000e+00  0.00000000e+00  0.00000000e+00\n   0.00000000e+00  0.00000000e+00  0.00000000e+00]\n [ 3.84396687e-02 -2.19447225e-12  1.97400138e-01  0.00000000e+00\n  -0.00000000e+00  0.00000000e+00  0.00000000e+00 -3.72901782e-02\n  -1.35308519e-01  1.99999996e-02  0.00000000e+00 -0.00000000e+00\n   0.00000000e+00  0.00000000e+00  0.00000000e+00  0.00000000e+00\n   0.00000000e+00  0.00000000e+00  0.00000000e+00]\n [ 3.84396687e-02 -2.19447225e-12  1.97400138e-01  0.00000000e+00\n  -0.00000000e+00  0.00000000e+00  0.00000000e+00  1.05750047e-01\n  -7.36861750e-02  1.99999996e-02  0.00000000e+00 -0.00000000e+00\n   0.00000000e+00  0.00000000e+00  0.00000000e+00  0.00000000e+00\n   0.00000000e+00  0.00000000e+00  0.00000000e+00]\n [ 3.84396687e-02 -2.19447225e-12  1.97400138e-01  0.00000000e+00\n  -0.00000000e+00  0.00000000e+00  0.00000000e+00 -4.49778093e-03\n   8.90591890e-02  1.99999996e-02  0.00000000e+00 -0.00000000e+00\n   0.00000000e+00  0.00000000e+00  0.00000000e+00  0.00000000e+00\n   0.00000000e+00  0.00000000e+00  0.00000000e+00]\n [ 3.84396687e-02 -2.19447225e-12  1.97400138e-01  0.00000000e+00\n  -0.00000000e+00  0.00000000e+00  0.00000000e+00  1.64844710e-02\n  -7.40618482e-02  1.99999996e-02  0.00000000e+00 -0.00000000e+00\n   0.00000000e+00  0.00000000e+00  0.00000000e+00  0.00000000e+00\n   0.00000000e+00  0.00000000e+00  0.00000000e+00]\n [ 3.84396687e-02 -2.19447225e-12  1.97400138e-01  0.00000000e+00\n  -0.00000000e+00  0.00000000e+00  0.00000000e+00  9.50262696e-02\n   1.90338232e-02  1.99999996e-02  0.00000000e+00 -0.00000000e+00\n   0.00000000e+00  0.00000000e+00  0.00000000e+00  0.00000000e+00\n   0.00000000e+00  0.00000000e+00  0.00000000e+00]\n [ 3.84396687e-02 -2.19447225e-12  1.97400138e-01  0.00000000e+00\n  -0.00000000e+00  0.00000000e+00  0.00000000e+00  1.20185450e-01\n  -1.06318705e-01  1.99999996e-02  0.00000000e+00 -0.00000000e+00\n   0.00000000e+00  0.00000000e+00  0.00000000e+00  0.00000000e+00\n   0.00000000e+00  0.00000000e+00  0.00000000e+00]\n [ 3.84396687e-02 -2.19447225e-12  1.97400138e-01  0.00000000e+00\n  -0.00000000e+00  0.00000000e+00  0.00000000e+00 -1.47879452e-01\n  -8.88204575e-02  1.99999996e-02  0.00000000e+00 -0.00000000e+00\n   0.00000000e+00  0.00000000e+00  0.00000000e+00  0.00000000e+00\n   0.00000000e+00  0.00000000e+00  0.00000000e+00]\n [ 3.84396687e-02 -2.19447225e-12  1.97400138e-01  0.00000000e+00\n  -0.00000000e+00  0.00000000e+00  0.00000000e+00  2.82923076e-02\n  -5.04484847e-02  1.99999996e-02  0.00000000e+00 -0.00000000e+00\n   0.00000000e+00  0.00000000e+00  0.00000000e+00  0.00000000e+00\n   0.00000000e+00  0.00000000e+00  0.00000000e+00]\n [ 3.84396687e-02 -2.19447225e-12  1.97400138e-01  0.00000000e+00\n  -0.00000000e+00  0.00000000e+00  0.00000000e+00  1.17014855e-01\n   8.87156650e-02  1.99999996e-02  0.00000000e+00 -0.00000000e+00\n   0.00000000e+00  0.00000000e+00  0.00000000e+00  0.00000000e+00\n   0.00000000e+00  0.00000000e+00  0.00000000e+00]]"
+    },
+    "_episode_num": 0,
+    "use_sde": false,
+    "sde_sample_freq": -1,
+    "_current_progress_remaining": 0.4210986666666666,
+    "_stats_window_size": 100,
+    "ep_info_buffer": {
+        ":type:": "<class 'collections.deque'>",
+        ":serialized:": "gAWV4AsAAAAAAACMC2NvbGxlY3Rpb25zlIwFZGVxdWWUk5QpS2SGlFKUKH2UKIwBcpRHwAn+X7cfvF6MAWyUSzKMAXSUR0DUgccVSGahdX2UKGgGR8AlKo4uK4x2aAdLMmgIR0DUggZJL/S6dX2UKGgGR8AkQAfdRBNVaAdLMmgIR0DUgffHcUM5dX2UKGgGR8Ak/UHY6GQCaAdLMmgIR0DUgd4Glhw3dX2UKGgGR8AnYKhL5AQhaAdLMmgIR0DUgdClMyrQdX2UKGgGR8Al12FFlTWHaAdLMmgIR0DUghUzWPLgdX2UKGgGR8Apa+otL+PzaAdLMmgIR0DUghuLCN0edX2UKGgGR8ALXyoXKr7waAdLMmgIR0DUgd+obXHzdX2UKGgGR7+gOavzOHFhaAdLAWgIR0DUgeE5Jbt7dX2UKGgGR8AUcOLBKtgbaAdLMmgIR0DUgeecZtN0dX2UKGgGR8ApNaMaS9uhaAdLMmgIR0DUgg/ZqVQidX2UKGgGR8AqN+xW1c+raAdLMmgIR0DUgjTsIE8rdX2UKGgGR8AlkT3Zf2K3aAdLMmgIR0DUghkKKHfudX2UKGgGR8AmCExqO939aAdLMmgIR0DUgi52ki2VdX2UKGgGR8AROWGATZg5aAdLMmgIR0DUgg0fhddFdX2UKGgGR8AdeGtZFG5MaAdLMmgIR0DUgfzVf/m1dX2UKGgGR8AQ7qY7aIvbaAdLMmgIR0DUggy88La3dX2UKGgGR8Anqc4HX2/SaAdLMmgIR0DUgjxP+GXYdX2UKGgGR8AmeNI9TxXoaAdLMmgIR0DUggay8jA0dX2UKGgGR8Agv2h7E5yVaAdLMmgIR0DUgha+zt1IdX2UKGgGR8AhyrkKeCkHaAdLMmgIR0DUgflCkXUIdX2UKGgGR8Asw4TbnHNpaAdLMmgIR0DUggo8nuzAdX2UKGgGR8Amm9ytFKChaAdLMmgIR0DUgkmx/ustdX2UKGgGR8AhQGorFwT/aAdLMmgIR0DUgjtt+CsfdX2UKGgGR8Ai295hScbzaAdLMmgIR0DUgiKTbFjvdX2UKGgGR8AuawFC9h7WaAdLMmgIR0DUghTjrAxjdX2UKGgGR8AkfUVBUrCnaAdLMmgIR0DUgllUyYXwdX2UKGgGR8Ad+ZKFqSHNaAdLMmgIR0DUgl/e0ojOdX2UKGgGR8AsKgh8pkPMaAdLMmgIR0DUgiUllbu/dX2UKGgGR8AhvH9WIXTFaAdLMmgIR0DUgiubKA8TdX2UKGgGR8AiAEUTL4etaAdLMmgIR0DUglPncL0BdX2UKGgGR8AWapEQXhwVaAdLMmgIR0DUgnkRWcSXdX2UKGgGR8AlEQ7tAs06aAdLMmgIR0DUgl7uPV/ddX2UKGgGR8AjVg9eQdS3aAdLMmgIR0DUgnW4lQdkdX2UKGgGR8AqMjWTX8O1aAdLMmgIR0DUglVeZ5RkdX2UKGgGR8AkSKLsKLKnaAdLMmgIR0DUgkeoP07KdX2UKGgGR8AizdeIEbHZaAdLMmgIR0DUgliHwgDBdX2UKGgGR8AZ9C5VfeDWaAdLMmgIR0DUgoqw5eZ5dX2UKGgGR8AmRKOktVaPaAdLMmgIR0DUglT9ETg3dX2UKGgGR8AegYuTRplCaAdLMmgIR0DUgmzAymALdX2UKGgGR8Aa8XKr7wazaAdLMmgIR0DUgldDzAerdX2UKGgGR8AOTj94u9OAaAdLMmgIR0DUgm3qyGBXdX2UKGgGR8AS22TgVGkOaAdLMmgIR0DUgrC4ZuQ7dX2UKGgGR8Am4gvlEJBxaAdLMmgIR0DUgqJA6dUbdX2UKGgGR7+htxdY4hllaAdLAWgIR0DUgrPB1s+FdX2UKGgGR8Apxspobn5jaAdLMmgIR0DUgosAksz3dX2UKGgGR8Are5Jbt7a7aAdLMmgIR0DUgoGKqGUOdX2UKGgGR8AceGgzxgAqaAdLMmgIR0DUgsbmnwXqdX2UKGgGR8AkdX+VC5VfaAdLMmgIR0DUgs8Es8PndX2UKGgGR7+nGXHBDXvqaAdLAWgIR0DUgsoSIxgzdX2UKGgGR8AiWqFRHf/FaAdLMmgIR0DUgpb6DXe4dX2UKGgGR8AWYJ2MbWEsaAdLMmgIR0DUgp5/Tb35dX2UKGgGR8Ahf1A7gbZOaAdLMmgIR0DUgshPfsNUdX2UKGgGR8ApJFQVKwpwaAdLMmgIR0DUgu4eYD1XdX2UKGgGR8AcDedkJ8fFaAdLMmgIR0DUgtSahHskdX2UKGgGR8Ampjslb/wRaAdLMmgIR0DUgutH8TBZdX2UKGgGR8AU6tA9mpVCaAdLMmgIR0DUgswyBTXKdX2UKGgGR8Ayt9US7GvPaAdLMmgIR0DUgr3AoG6gdX2UKGgGR8Aar4i5d4VzaAdLMmgIR0DUgs7TUiIMdX2UKGgGR8ARMI4VARkFaAdLMmgIR0DUgwB+1Bt2dX2UKGgGR8AolGHYYixFaAdLMmgIR0DUgsrej2zwdX2UKGgGR8AndJGvwEyMaAdLMmgIR0DUguH4593KdX2UKGgGR8AO6fFrEcbSaAdLMmgIR0DUgswcJdB0dX2UKGgGR8AWWfoRqXWwaAdLMmgIR0DUguMOhCdCdX2UKGgGR8AeICHRCx/vaAdLMmgIR0DUgxeB/ZuidX2UKGgGR8AZ3EuQIUrTaAdLMmgIR0DUgyhOafBfdX2UKGgGR8ArQYw7DEWJaAdLMmgIR0DUgwAF3Y+TdX2UKGgGR8Ako2XLNfPYaAdLMmgIR0DUgvLzI3irdX2UKGgGR8AoPrjYI0IkaAdLMmgIR0DUgz24kNWmdX2UKGgGR8Alb0q6OHWSaAdLMmgIR0DUgziymhugdX2UKGgGR8AntY8uBczJaAdLMmgIR0DUgwKJJoTPdX2UKGgGR8AZK1qnFYMfaAdLMmgIR0DUgwjxYq5LdX2UKGgGR8AhHl2/zreJaAdLMmgIR0DUgzFZQpF1dX2UKGgGR8Akm8PFvQ4TaAdLMmgIR0DUg1aLgn+idX2UKGgGR8AjRxVhkRSQaAdLMmgIR0DUgzoajvd/dX2UKGgGR8AwnaF23azvaAdLMmgIR0DUg0+RW912dX2UKGgGR8AvUX3QD3dsaAdLMmgIR0DUgy5FSbYsdX2UKGgGR7+aE8JUo8ZDaAdLAWgIR0DUgy/CYTkAdX2UKGgGR8AppZElVtGeaAdLMmgIR0DUgx4OPNmldX2UKGgGR8Ad/Hhjvuw5aAdLMmgIR0DUgy3SjQAudX2UKGgGR8AudAt4A0bcaAdLMmgIR0DUg10rZrYXdX2UKGgGR8Af+obXHzYmaAdLMmgIR0DUgyeGfwqidX2UKGgGR8AsjvnbItDlaAdLMmgIR0DUgzbD7655dX2UKGgGR8Ajpmvnr6ciaAdLMmgIR0DUgxlvQ4S6dX2UKGgGR8AgNiSaEzwdaAdLMmgIR0DUgypByCFsdX2UKGgGR8AlRxb0OEuhaAdLMmgIR0DUg1oQ5FPSdX2UKGgGR8AfKx5cC5mRaAdLMmgIR0DUg2oHt4RmdX2UKGgGR8Ak2zFdcB2faAdLMmgIR0DUg0DzxwyZdX2UKGgGR8Apl+SbH6uXaAdLMmgIR0DUgzODujREdX2UKGgGR8AcxSMtK7I1aAdLMmgIR0DUg36VcD8tdX2UKGgGR8AYesFMZgogaAdLMmgIR0DUg3mPV/c4dX2UKGgGR8AWyj2zv7WNaAdLMmgIR0DUg0O16Vt5dX2UKGgGR8APpH09QoCuaAdLMmgIR0DUg0owQDmsdX2UKGgGR8AhlvMr3CbdaAdLMmgIR0DUg3KhzvJBdX2UKGgGR8AiwFnIyTIOaAdLMmgIR0DUg5e+0w8GdX2UKGgGR8AjpGKhtcfOaAdLMmgIR0DUg3vpwCKadX2UKGgGR8AmYrYoRZlnaAdLMmgIR0DUg5FA/s3RdX2UKGgGR8AmqxcmjTKDaAdLMmgIR0DUg3DZ+QU6dX2UKGgGR8AdV9jPOY6XaAdLMmgIR0DUg18oPTXrdX2UKGgGR8AlHoX9BKL9aAdLMmgIR0DUg29X3g1ndWUu"
+    },
+    "ep_success_buffer": {
+        ":type:": "<class 'collections.deque'>",
+        ":serialized:": "gAWVhgAAAAAAAACMC2NvbGxlY3Rpb25zlIwFZGVxdWWUk5QpS2SGlFKUKImJiYmJiYmJiImJiYmJiYmJiYmJiYmJiYmJiYmJiYmJiYmJiYmJiYmJiYmJiImJiYmIiYmJiYmJiYmJiYmJiYmJiYmJiYmJiYmJiYmJiImJiYmJiYmJiYmJiYmJiYmJiYmJiYllLg=="
+    },
+    "_n_updates": 4240,
+    "n_steps": 2048,
+    "gamma": 0.99,
+    "gae_lambda": 0.95,
+    "ent_coef": 0.1,
+    "vf_coef": 0.5,
+    "max_grad_norm": 0.5,
+    "rollout_buffer_class": {
+        ":type:": "<class 'abc.ABCMeta'>",
+        ":serialized:": "gAWVOgAAAAAAAACMIHN0YWJsZV9iYXNlbGluZXMzLmNvbW1vbi5idWZmZXJzlIwRRGljdFJvbGxvdXRCdWZmZXKUk5Qu",
+        "__module__": "stable_baselines3.common.buffers",
+        "__annotations__": "{'observation_space': <class 'gymnasium.spaces.dict.Dict'>, 'obs_shape': typing.Dict[str, typing.Tuple[int, ...]], 'observations': typing.Dict[str, numpy.ndarray]}",
+        "__doc__": "\n    Dict Rollout buffer used in on-policy algorithms like A2C/PPO.\n    Extends the RolloutBuffer to use dictionary observations\n\n    It corresponds to ``buffer_size`` transitions collected\n    using the current policy.\n    This experience will be discarded after the policy update.\n    In order to use PPO objective, we also store the current value of each state\n    and the log probability of each taken action.\n\n    The term rollout here refers to the model-free notion and should not\n    be used with the concept of rollout used in model-based RL or planning.\n    Hence, it is only involved in policy and value function training but not action selection.\n\n    :param buffer_size: Max number of element in the buffer\n    :param observation_space: Observation space\n    :param action_space: Action space\n    :param device: PyTorch device\n    :param gae_lambda: Factor for trade-off of bias vs variance for Generalized Advantage Estimator\n        Equivalent to Monte-Carlo advantage estimate when set to 1.\n    :param gamma: Discount factor\n    :param n_envs: Number of parallel environments\n    ",
+        "__init__": "<function DictRolloutBuffer.__init__ at 0x7f05f97c00d0>",
+        "reset": "<function DictRolloutBuffer.reset at 0x7f05f97c0160>",
+        "add": "<function DictRolloutBuffer.add at 0x7f05f97c01f0>",
+        "get": "<function DictRolloutBuffer.get at 0x7f05f97c0280>",
+        "_get_samples": "<function DictRolloutBuffer._get_samples at 0x7f05f97c0310>",
+        "__abstractmethods__": "frozenset()",
+        "_abc_impl": "<_abc._abc_data object at 0x7f05f97b9000>"
+    },
+    "rollout_buffer_kwargs": {},
+    "batch_size": 2048,
+    "n_epochs": 20,
+    "clip_range": {
+        ":type:": "<class 'function'>",
+        ":serialized:": "gAWVbQUAAAAAAACMF2Nsb3VkcGlja2xlLmNsb3VkcGlja2xllIwOX21ha2VfZnVuY3Rpb26Uk5QoaACMDV9idWlsdGluX3R5cGWUk5SMCENvZGVUeXBllIWUUpQoSwFLAEsASwFLA0sTQwx0AIgAfACDAYMBUwCUToWUjAVmbG9hdJSFlIwScHJvZ3Jlc3NfcmVtYWluaW5nlIWUjGAvaG9tZS90b21lay9weXRvcmNoX2xlYXJuaW5nL3ZlbnYvbGliL3B5dGhvbjMuMTAvc2l0ZS1wYWNrYWdlcy9zdGFibGVfYmFzZWxpbmVzMy9jb21tb24vdXRpbHMucHmUjAg8bGFtYmRhPpRLYUMCDACUjA52YWx1ZV9zY2hlZHVsZZSFlCl0lFKUfZQojAtfX3BhY2thZ2VfX5SMGHN0YWJsZV9iYXNlbGluZXMzLmNvbW1vbpSMCF9fbmFtZV9flIwec3RhYmxlX2Jhc2VsaW5lczMuY29tbW9uLnV0aWxzlIwIX19maWxlX1+UjGAvaG9tZS90b21lay9weXRvcmNoX2xlYXJuaW5nL3ZlbnYvbGliL3B5dGhvbjMuMTAvc2l0ZS1wYWNrYWdlcy9zdGFibGVfYmFzZWxpbmVzMy9jb21tb24vdXRpbHMucHmUdU5OaACMEF9tYWtlX2VtcHR5X2NlbGyUk5QpUpSFlHSUUpRoAIwSX2Z1bmN0aW9uX3NldHN0YXRllJOUaCF9lH2UKGgYaA+MDF9fcXVhbG5hbWVfX5SMIWdldF9zY2hlZHVsZV9mbi48bG9jYWxzPi48bGFtYmRhPpSMD19fYW5ub3RhdGlvbnNfX5R9lIwOX19rd2RlZmF1bHRzX1+UTowMX19kZWZhdWx0c19flE6MCl9fbW9kdWxlX1+UaBmMB19fZG9jX1+UTowLX19jbG9zdXJlX1+UaACMCl9tYWtlX2NlbGyUk5RoAihoByhLAUsASwBLAUsDSxNDDHQAiAB8AIMBgwFTAJROhZRoCoWUaAyFlIxgL2hvbWUvdG9tZWsvcHl0b3JjaF9sZWFybmluZy92ZW52L2xpYi9weXRob24zLjEwL3NpdGUtcGFja2FnZXMvc3RhYmxlX2Jhc2VsaW5lczMvY29tbW9uL3V0aWxzLnB5lIwIPGxhbWJkYT6US2FDAgwAlGgRhZQpdJRSlH2UKGgWjBhzdGFibGVfYmFzZWxpbmVzMy5jb21tb26UaBiMHnN0YWJsZV9iYXNlbGluZXMzLmNvbW1vbi51dGlsc5RoGoxgL2hvbWUvdG9tZWsvcHl0b3JjaF9sZWFybmluZy92ZW52L2xpYi9weXRob24zLjEwL3NpdGUtcGFja2FnZXMvc3RhYmxlX2Jhc2VsaW5lczMvY29tbW9uL3V0aWxzLnB5lHVOTmgdKVKUhZR0lFKUaCNoQn2UfZQoaBhoNmgmjCFnZXRfc2NoZWR1bGVfZm4uPGxvY2Fscz4uPGxhbWJkYT6UaCh9lGgqTmgrTmgsaD1oLU5oLmgwaAIoaAcoSwFLAEsASwFLAUsTQwSIAFMAlGgyKYwBX5SFlGg1jARmdW5jlEuFQwIEAZSMA3ZhbJSFlCl0lFKUaDtOTmgdKVKUhZR0lFKUaCNoU32UfZQoaBhoSmgmjBljb25zdGFudF9mbi48bG9jYWxzPi5mdW5jlGgofZRoKk5oK05oLGg9aC1OaC5oMEc/yZmZmZmZmoWUUpSFlIwXX2Nsb3VkcGlja2xlX3N1Ym1vZHVsZXOUXZSMC19fZ2xvYmFsc19flH2UdYaUhlIwhZRSlIWUaFtdlGhdfZR1hpSGUjCFlFKUhZRoW12UaF19lHWGlIZSMC4="
+    },
+    "clip_range_vf": null,
+    "normalize_advantage": true,
+    "target_kl": null,
+    "observation_space": {
+        ":type:": "<class 'gymnasium.spaces.dict.Dict'>",
+        ":serialized:": "gAWVMgQAAAAAAACMFWd5bW5hc2l1bS5zcGFjZXMuZGljdJSMBERpY3SUk5QpgZR9lCiMBnNwYWNlc5SMC2NvbGxlY3Rpb25zlIwLT3JkZXJlZERpY3SUk5QpUpQojA1hY2hpZXZlZF9nb2FslIwUZ3ltbmFzaXVtLnNwYWNlcy5ib3iUjANCb3iUk5QpgZR9lCiMBWR0eXBllIwFbnVtcHmUjAVkdHlwZZSTlIwCZjSUiYiHlFKUKEsDjAE8lE5OTkr/////Sv////9LAHSUYowNYm91bmRlZF9iZWxvd5SMEm51bXB5LmNvcmUubnVtZXJpY5SMC19mcm9tYnVmZmVylJOUKJYDAAAAAAAAAAEBAZRoE4wCYjGUiYiHlFKUKEsDjAF8lE5OTkr/////Sv////9LAHSUYksDhZSMAUOUdJRSlIwNYm91bmRlZF9hYm92ZZRoHCiWAwAAAAAAAAABAQGUaCBLA4WUaCR0lFKUjAZfc2hhcGWUSwOFlIwDbG93lGgcKJYMAAAAAAAAAAAAIMEAACDBAAAgwZRoFksDhZRoJHSUUpSMBGhpZ2iUaBwolgwAAAAAAAAAAAAgQQAAIEEAACBBlGgWSwOFlGgkdJRSlIwIbG93X3JlcHKUjAUtMTAuMJSMCWhpZ2hfcmVwcpSMBDEwLjCUjApfbnBfcmFuZG9tlE51YowMZGVzaXJlZF9nb2FslGgNKYGUfZQoaBBoFmgZaBwolgMAAAAAAAAAAQEBlGggSwOFlGgkdJRSlGgnaBwolgMAAAAAAAAAAQEBlGggSwOFlGgkdJRSlGgsSwOFlGguaBwolgwAAAAAAAAAAAAgwQAAIMEAACDBlGgWSwOFlGgkdJRSlGgzaBwolgwAAAAAAAAAAAAgQQAAIEEAACBBlGgWSwOFlGgkdJRSlGg4jAUtMTAuMJRoOowEMTAuMJRoPE51YowLb2JzZXJ2YXRpb26UaA0pgZR9lChoEGgWaBloHCiWEwAAAAAAAAABAQEBAQEBAQEBAQEBAQEBAQEBlGggSxOFlGgkdJRSlGgnaBwolhMAAAAAAAAAAQEBAQEBAQEBAQEBAQEBAQEBAZRoIEsThZRoJHSUUpRoLEsThZRoLmgcKJZMAAAAAAAAAAAAIMEAACDBAAAgwQAAIMEAACDBAAAgwQAAIMEAACDBAAAgwQAAIMEAACDBAAAgwQAAIMEAACDBAAAgwQAAIMEAACDBAAAgwQAAIMGUaBZLE4WUaCR0lFKUaDNoHCiWTAAAAAAAAAAAACBBAAAgQQAAIEEAACBBAAAgQQAAIEEAACBBAAAgQQAAIEEAACBBAAAgQQAAIEEAACBBAAAgQQAAIEEAACBBAAAgQQAAIEEAACBBlGgWSxOFlGgkdJRSlGg4jAUtMTAuMJRoOowEMTAuMJRoPE51YnVoLE5oEE5oPE51Yi4=",
+        "spaces": "OrderedDict([('achieved_goal', Box(-10.0, 10.0, (3,), float32)), ('desired_goal', Box(-10.0, 10.0, (3,), float32)), ('observation', Box(-10.0, 10.0, (19,), float32))])",
+        "_shape": null,
+        "dtype": null,
+        "_np_random": null
+    },
+    "action_space": {
+        ":type:": "<class 'gymnasium.spaces.box.Box'>",
+        ":serialized:": "gAWVpwEAAAAAAACMFGd5bW5hc2l1bS5zcGFjZXMuYm94lIwDQm94lJOUKYGUfZQojAVkdHlwZZSMBW51bXB5lIwFZHR5cGWUk5SMAmY0lImIh5RSlChLA4wBPJROTk5K/////0r/////SwB0lGKMDWJvdW5kZWRfYmVsb3eUjBJudW1weS5jb3JlLm51bWVyaWOUjAtfZnJvbWJ1ZmZlcpSTlCiWBAAAAAAAAAABAQEBlGgIjAJiMZSJiIeUUpQoSwOMAXyUTk5OSv////9K/////0sAdJRiSwSFlIwBQ5R0lFKUjA1ib3VuZGVkX2Fib3ZllGgRKJYEAAAAAAAAAAEBAQGUaBVLBIWUaBl0lFKUjAZfc2hhcGWUSwSFlIwDbG93lGgRKJYQAAAAAAAAAAAAgL8AAIC/AACAvwAAgL+UaAtLBIWUaBl0lFKUjARoaWdolGgRKJYQAAAAAAAAAAAAgD8AAIA/AACAPwAAgD+UaAtLBIWUaBl0lFKUjAhsb3dfcmVwcpSMBC0xLjCUjAloaWdoX3JlcHKUjAMxLjCUjApfbnBfcmFuZG9tlE51Yi4=",
+        "dtype": "float32",
+        "bounded_below": "[ True  True  True  True]",
+        "bounded_above": "[ True  True  True  True]",
+        "_shape": [
+            4
+        ],
+        "low": "[-1. -1. -1. -1.]",
+        "high": "[1. 1. 1. 1.]",
+        "low_repr": "-1.0",
+        "high_repr": "1.0",
+        "_np_random": null
+    },
+    "n_envs": 20,
+    "lr_schedule": {
+        ":type:": "<class 'function'>",
+        ":serialized:": "gAWVsQMAAAAAAACMF2Nsb3VkcGlja2xlLmNsb3VkcGlja2xllIwOX21ha2VfZnVuY3Rpb26Uk5QoaACMDV9idWlsdGluX3R5cGWUk5SMCENvZGVUeXBllIWUUpQoSwFLAEsASwFLA0sTQwx0AIgAfACDAYMBUwCUToWUjAVmbG9hdJSFlIwScHJvZ3Jlc3NfcmVtYWluaW5nlIWUjGAvaG9tZS90b21lay9weXRvcmNoX2xlYXJuaW5nL3ZlbnYvbGliL3B5dGhvbjMuMTAvc2l0ZS1wYWNrYWdlcy9zdGFibGVfYmFzZWxpbmVzMy9jb21tb24vdXRpbHMucHmUjAg8bGFtYmRhPpRLYUMCDACUjA52YWx1ZV9zY2hlZHVsZZSFlCl0lFKUfZQojAtfX3BhY2thZ2VfX5SMGHN0YWJsZV9iYXNlbGluZXMzLmNvbW1vbpSMCF9fbmFtZV9flIwec3RhYmxlX2Jhc2VsaW5lczMuY29tbW9uLnV0aWxzlIwIX19maWxlX1+UjGAvaG9tZS90b21lay9weXRvcmNoX2xlYXJuaW5nL3ZlbnYvbGliL3B5dGhvbjMuMTAvc2l0ZS1wYWNrYWdlcy9zdGFibGVfYmFzZWxpbmVzMy9jb21tb24vdXRpbHMucHmUdU5OaACMEF9tYWtlX2VtcHR5X2NlbGyUk5QpUpSFlHSUUpRoAIwSX2Z1bmN0aW9uX3NldHN0YXRllJOUaCF9lH2UKGgYaA+MDF9fcXVhbG5hbWVfX5SMIWdldF9zY2hlZHVsZV9mbi48bG9jYWxzPi48bGFtYmRhPpSMD19fYW5ub3RhdGlvbnNfX5R9lIwOX19rd2RlZmF1bHRzX1+UTowMX19kZWZhdWx0c19flE6MCl9fbW9kdWxlX1+UaBmMB19fZG9jX1+UTowLX19jbG9zdXJlX1+UaACMCl9tYWtlX2NlbGyUk5RoAihoByhLAUsASwBLAUsBSxNDBIgAUwCUaAkpjAFflIWUaA6MBGZ1bmOUS4VDAgQBlIwDdmFslIWUKXSUUpRoFU5OaB0pUpSFlHSUUpRoI2g9fZR9lChoGGg0aCaMGWNvbnN0YW50X2ZuLjxsb2NhbHM+LmZ1bmOUaCh9lGgqTmgrTmgsaBloLU5oLmgwRz8jqSowVTJhhZRSlIWUjBdfY2xvdWRwaWNrbGVfc3VibW9kdWxlc5RdlIwLX19nbG9iYWxzX1+UfZR1hpSGUjCFlFKUhZRoRV2UaEd9lHWGlIZSMC4="
+    }
+}

ppo-PandaPickAndPlaceDense-v3/policy.optimizer.pth ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:482e45708af6938f0d10c3a4f68866ba56925400497b5cac83c0c019a737ff03
+size 135231613

ppo-PandaPickAndPlaceDense-v3/policy.pth ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:3f421cd39541f2d49abaadafb4f4eb597f5b2b633ed32c3212995b8f11d26d7c
+size 67615395

ppo-PandaPickAndPlaceDense-v3/pytorch_variables.pth ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:0c35cea3b2e60fb5e7e162d3592df775cd400e575a31c72f359fb9e654ab00c5
+size 864

ppo-PandaPickAndPlaceDense-v3/system_info.txt ADDED Viewed

	@@ -0,0 +1,9 @@

+- OS: Linux-5.15.146.1-microsoft-standard-WSL2-x86_64-with-glibc2.35 # 1 SMP Thu Jan 11 04:09:03 UTC 2024
+- Python: 3.10.12
+- Stable-Baselines3: 2.3.2
+- PyTorch: 2.3.0+cu121
+- GPU Enabled: True
+- Numpy: 1.26.4
+- Cloudpickle: 3.0.0
+- Gymnasium: 0.29.1
+- OpenAI Gym: 0.26.2

replay.mp4 ADDED Viewed

Binary file (717 kB). View file

results.json ADDED Viewed

	@@ -0,0 +1 @@


1	+ {"mean_reward": -8.39106743708253, "std_reward": 3.3271363186628617, "is_deterministic": true, "n_eval_episodes": 10, "eval_datetime": "2024-06-12T17:54:57.094936"}

vec_normalize.pkl ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:6ab6695be15897dcb2807775b5141c7f0c7cc80a8bde9af42501b4cd4999d0d2
+size 3132