armandpl commited on
Commit
ab1803b
1 Parent(s): fe22f1a

add encoder

Browse files
Files changed (2) hide show
  1. README.md +3 -3
  2. encoder.onnx +3 -0
README.md CHANGED
@@ -4,7 +4,7 @@ datasets:
4
  pipeline_tag: robotics
5
  ---
6
 
7
- This model has been trained on a larger version of the commabody dataset. It includes a vqgan gan encoder/decoder fine tuned from imagenet, as well as a GPT2 trained to predict the next frame, wheel speeds and actions.
8
- It can be used either as a simulator or as a policy.
9
 
10
- todo: link to blog post, link to body-jim example script, include example video
 
4
  pipeline_tag: robotics
5
  ---
6
 
7
+ This model has been trained on a larger version of the commabody dataset.
8
+ It includes a [vqgan](https://github.com/CompVis/taming-transformers) encoder/decoder fine tuned from imagenet. It compresses images of size 250x160 to 16x10 tokens.
9
 
10
+ It also includes a GPT2 model trained to predict the next frame, wheel speeds and actions. It can be used either as a simulator or as a policy.
encoder.onnx ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:edda6a54630d1250822cc743127d54ace177418b859e6170bc90ba4901cbe8f2
3
+ size 119675145