Create README.md

README.md

@@ -0,0 +1,43 @@
+---
+tags:
+- opt_metasq
+---
+
+# This repo let's you run the following checkpoint using facebookresearch/metaseq.
+
+Do the following:
+
+## 1. Install PyTorch
+```
+pip3 install torch==1.10.1+cu113 torchvision==0.11.2+cu113 torchaudio==0.10.1+cu113 -f https://download.pytorch.org/whl/cu113/torch_stable.html
+```
+
+## 2. Install Megatron
+```
+git clone https://github.com/patrickvonplaten/Megatron-LM.git
+cd Megatron-LM
+pip3 install six regex
+pip3 install -e .
+```
+## 3. Install fairscale
+```
+git clone https://github.com/facebookresearch/fairscale.git
+cd fairscale
+git checkout prefetch_fsdp_params_simple
+pip3 install -e .
+```
+## 4. Install metaseq
+```
+git clone https://github.com/patrickvonplaten/metaseq.git
+cd metaseq
+pip3 install -e .
+```
+
+## 5. Clone this repo (click top right on "How to clone")
+
+## 6. Run the following:
+
+```bash
+cd <path/to/cloned/repo>
+bash run.sh
+```