liruiw commited on
Commit
0682722
1 Parent(s): 65d9af7

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +16 -12
README.md CHANGED
@@ -1,22 +1,26 @@
 
 
 
1
 
2
- Website: liruiw.github.io/hpt
3
 
 
4
 
5
- See the [HPT](https://github.com/liruiw/HPT-Pretrain) GitHub README and the [LeRobot](https://github.com/huggingface/lerobot) Implementation for instructions on how to use this checkpoint for fine-tuning.
6
 
 
7
 
8
- BibTeX:
9
 
 
 
10
  @inproceedings{wang2024hpt,
11
- author={Lirui Wang, Xinlei Chen, Jialiang Zhao, Kaiming He, Russ Tedrake},
12
- title={Scaling Proprioceptive-Visual Learning with Heterogeneous Pre-trained Transformers},
13
- year={2024},
14
- eprint={2407.16677},
15
- archivePrefix={arXiv},
16
- primaryClass={cs.RO},
17
- url={https://arxiv.org/abs/2407.16677}}
18
 
19
 
20
- Contact
21
 
22
- Lirui Wang (liruiw@mit.edu)
 
1
+ # 🦾 Heterogenous Pre-trained Transformers
2
+
3
+ [Lirui Wang](https://liruiw.github.io/), [Xinlei Chen](https://xinleic.xyz/), [Jialiang Zhao](https://alanz.info/), [Kaiming He](https://people.csail.mit.edu/kaiming/)
4
 
5
+ Neural Information Processing Systems (Spotlight), 2024
6
 
7
+ You can find more details on our [project page](https://liruiw.github.io/hpt). An alternative clean implementation of HPT in Hugging Face can also be found [here](https://github.com/liruiw/lerobot/tree/hpt_squash/lerobot/common/policies/hpt).
8
 
 
9
 
10
+ **TL;DR:** HPT aligns different embodiment to a shared latent space and investigates the scaling behaviors in policy learning. Put a scalable transformer in the middle of your policy and don’t train from scratch!
11
 
 
12
 
13
+ If you find HPT useful in your research, please consider citing:
14
+ ```
15
  @inproceedings{wang2024hpt,
16
+ author = {Lirui Wang, Xinlei Chen, Jialiang Zhao, Kaiming He},
17
+ title = {Scaling Proprioceptive-Visual Learning with Heterogeneous Pre-trained Transformers},
18
+ booktitle = {Neurips},
19
+ year = {2024}
20
+ }
21
+ ```
 
22
 
23
 
24
+ ## Contact
25
 
26
+ If you have any questions, feel free to contact me through email (liruiw@mit.edu). Enjoy!