Initial commit

.gitattributes

@@ -0,0 +1,39 @@
+*.7z filter=lfs diff=lfs merge=lfs -text
+*.arrow filter=lfs diff=lfs merge=lfs -text
+*.bin filter=lfs diff=lfs merge=lfs -text
+*.bz2 filter=lfs diff=lfs merge=lfs -text
+*.ckpt filter=lfs diff=lfs merge=lfs -text
+*.ftz filter=lfs diff=lfs merge=lfs -text
+*.gz filter=lfs diff=lfs merge=lfs -text
+*.h5 filter=lfs diff=lfs merge=lfs -text
+*.joblib filter=lfs diff=lfs merge=lfs -text
+*.lfs.* filter=lfs diff=lfs merge=lfs -text
+*.mlmodel filter=lfs diff=lfs merge=lfs -text
+*.model filter=lfs diff=lfs merge=lfs -text
+*.msgpack filter=lfs diff=lfs merge=lfs -text
+*.npy filter=lfs diff=lfs merge=lfs -text
+*.npz filter=lfs diff=lfs merge=lfs -text
+*.onnx filter=lfs diff=lfs merge=lfs -text
+*.ot filter=lfs diff=lfs merge=lfs -text
+*.parquet filter=lfs diff=lfs merge=lfs -text
+*.pb filter=lfs diff=lfs merge=lfs -text
+*.pickle filter=lfs diff=lfs merge=lfs -text
+*.pkl filter=lfs diff=lfs merge=lfs -text
+*.pt filter=lfs diff=lfs merge=lfs -text
+*.pth filter=lfs diff=lfs merge=lfs -text
+*.rar filter=lfs diff=lfs merge=lfs -text
+*.safetensors filter=lfs diff=lfs merge=lfs -text
+saved_model/**/* filter=lfs diff=lfs merge=lfs -text
+*.tar.* filter=lfs diff=lfs merge=lfs -text
+*.tar filter=lfs diff=lfs merge=lfs -text
+*.tflite filter=lfs diff=lfs merge=lfs -text
+*.tgz filter=lfs diff=lfs merge=lfs -text
+*.wasm filter=lfs diff=lfs merge=lfs -text
+*.xz filter=lfs diff=lfs merge=lfs -text
+*.zip filter=lfs diff=lfs merge=lfs -text
+*.zst filter=lfs diff=lfs merge=lfs -text
+*tfevents* filter=lfs diff=lfs merge=lfs -text
+datasets/buffer.hdf5 filter=lfs diff=lfs merge=lfs -text
+datasets/buffer_inference_500000.hdf5 filter=lfs diff=lfs merge=lfs -text
+data/buffer.hdf5 filter=lfs diff=lfs merge=lfs -text
+data/buffer_inference_500000.hdf5 filter=lfs diff=lfs merge=lfs -text

README.md

@@ -0,0 +1,63 @@
+---
+library_name: metamotivo
+license: cc-by-nc-4.0
+tags:
+- facebook
+- meta
+- pytorch
+seed: 4
+repo_url: https://github.com/facebookresearch/metamotivo
+docs_url: https://metamotivo.metademolab.com/
+---
+# Meta Motivo S
+
+Meta Motivo is a behavioral foundation model pre-trained with a novel unsupervised reinforcement learning algorithm to control the movements of a complex virtual humanoid agent. At test time, our model can be prompted to solve unseen tasks such as motion tracking, pose reaching, and reward optimization without any additional learning or fine-tuning.
+
+This model is as described in ["Zero-shot Whole-Body Humanoid Control via Behavioral Foundation Models"](https://metamotivo.metademolab.com/) and corresponds to seed number 4 out of 5 evaluated in the paper.
+
+**Model Developer:** Meta
+
+# Model Details
+
+Meta Motivo is composed by multiple networks
+- forward net \\(F(s,a,z)\\)
+- backward net \\(B(s)\\)
+- actor net \\(\pi(s,z)\\)
+- discriminator net \\(D(s,z)\\)
+- critic net \\(Q(s,a,z)\\)
+
+### Network architectures
+
+**Forward, actor, and critic.** All these networks are MLPs with ReLU activations, except for the first hidden layer which uses a layernorm followed by tanh. The networks have two initial "embedding layers", one processing `(s,z)`, and the other processing `s` alone. The second embedding layer has half the hidden units of the first layer, and their outputs are concatenated and fed into the main MLP. We use 2 embedding layers and 2 hidden layers for the main MLP, each with 1024 hidden units. The actor network outputs the mean of a Gaussian distribution with fixed standard deviation, while the forward and critic networks output a d-dimensional vector and a scalar, respectively. The two latter networks use an ensemble of two networks.
+
+**Backward.** The backward map is a simple MLP composed of a layernorm operation, a linear layer with 256 hidden units, a tanh activation function, and another linear layer which outputs a d-dimensional vector that is then normalized in l2-norm.
+
+**Discriminator.** The discriminator is an MLP with 3 hidden layers of 1024 units and ReLU activations, except for the first hidden layer which uses a layernorm followed by tanh. It takes as input a state observation `s` and a latent variable `z`, and has a sigmoidal unit at the output. 
+
+
+See the `config.json` file for more details.
+
+## How to use
+
+```bash
+> pip install "metamotivo[all] @ git+https://github.com/facebookresearch/metamotivo.git"
+```
+and then
+```python
+from metamotivo.fb_cpr.huggingface import FBcprModel
+
+model = FBcprModel.from_pretrained("facebook/metamotivo-S-4")
+```
+
+# Citation
+
+If you find our code useful for your research, please consider citing:
+
+    @article{tirinzoni2024metamotivo,
+        title={Zero-shot Whole-Body Humanoid Control via Behavioral Foundation Models},
+        author={Tirinzoni, Andrea and Touati, Ahmed and Farebrother, Jesse and Guzek, Mateusz and Kanervisto, Anssi and Xu, Yingchen and Lazaric, Alessandro and Pirotta, Matteo},
+    }
+
+# License
+
+Meta Motivo is CC-BY-NC 4.0 licensed as of now.

config.json

@@ -0,0 +1,44 @@
+{
+    "obs_dim": 358,
+    "action_dim": 69,
+    "device": "cpu",
+    "archi": {
+        "z_dim": 256,
+        "norm_z": true,
+        "f": {
+            "hidden_dim": 1024,
+            "model": "simple",
+            "hidden_layers": 2,
+            "embedding_layers": 2,
+            "num_parallel": 2,
+            "ensemble_mode": "batch"
+        },
+        "b": {
+            "hidden_dim": 256,
+            "hidden_layers": 1,
+            "norm": true
+        },
+        "actor": {
+            "hidden_dim": 1024,
+            "model": "simple",
+            "hidden_layers": 2,
+            "embedding_layers": 2
+        },
+        "critic": {
+            "hidden_dim": 1024,
+            "model": "simple",
+            "hidden_layers": 2,
+            "embedding_layers": 2,
+            "num_parallel": 2,
+            "ensemble_mode": "batch"
+        },
+        "discriminator": {
+            "hidden_dim": 1024,
+            "hidden_layers": 3
+        }
+    },
+    "inference_batch_size": 500000,
+    "seq_length": 8,
+    "actor_std": 0.2,
+    "norm_obs": true
+}

data/buffer.hdf5

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:9a29316ca378beed4de6192fb1b38a94722602307dbaf61d997997693cb66a7f
+size 19834241408

data/buffer_inference_500000.hdf5

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:7a967a69fc4fc553a3f85e0613ae727759046b4b83b8c58e08414bb3dfde8be8
+size 2778004096

model.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:950d671ff7f0b73912686aefb319cf1942c78aa79114b568ac687940e0c3b56b
+size 98097048