Jae-Won Chung commited on
Commit
b5a071f
1 Parent(s): 69897d5

Docker images are open now

Browse files
pegasus/README.md CHANGED
@@ -24,9 +24,9 @@ Otherwise, you can set up Rust [here](https://www.rust-lang.org/tools/install),
24
  Every node must have two things:
25
 
26
  1. This repository cloned under `~/workspace/leaderboard`.
27
- - If you want a different path, search and replace in `setup-nodes.yaml`.
28
  2. Model weights under `/data/leaderboard/weights`.
29
- - If you want a different path, search and replace in `setup-nodes.yaml` and `benchmark.yaml`.
30
 
31
  ### Specify node names for Pegasus
32
 
@@ -37,11 +37,11 @@ Modify `hosts.yaml` with nodes. See the file for an example.
37
 
38
  ### Set up Docker containers on your nodes with Pegasus
39
 
40
- This builds our Docker image and spawns one container per GPU (named `leaderboard%d`), for every node.
41
 
42
  ```console
43
  $ cd pegasus
44
- $ cp setup-nodes.yaml queue.yaml
45
  $ pegasus b
46
  ```
47
 
 
24
  Every node must have two things:
25
 
26
  1. This repository cloned under `~/workspace/leaderboard`.
27
+ - If you want a different path, search and replace in `spawn-containers.yaml`.
28
  2. Model weights under `/data/leaderboard/weights`.
29
+ - If you want a different path, search and replace in `setupspawn-containers.yaml` and `benchmark.yaml`.
30
 
31
  ### Specify node names for Pegasus
32
 
 
37
 
38
  ### Set up Docker containers on your nodes with Pegasus
39
 
40
+ This spawns one container per GPU (named `leaderboard%d`), for every node.
41
 
42
  ```console
43
  $ cd pegasus
44
+ $ cp spawn-containers.yaml queue.yaml
45
  $ pegasus b
46
  ```
47
 
pegasus/{setup-nodes.yaml → spawn-containers.yaml} RENAMED
@@ -3,5 +3,4 @@
3
  # {{ gpu }} is defined in `hosts.yaml`, and will be filled in when Pegasus
4
  # determines the specific node and gpu the generated job command will run on.
5
  # We check {{ gpu }} = 0 to ensure that the image is only built once on each node.
6
- - if [ {{ gpu }} = 0 ]; then cd workspace/leaderboard && docker build -t ml-energy:latest .; fi
7
- - docker run -dit --name leaderboard{{ gpu }} --gpus '"device={{ gpu }}"' -v /data/leaderboard:/data/leaderboard -v $HOME/workspace/leaderboard:/workspace/leaderboard ml-energy:latest bash
 
3
  # {{ gpu }} is defined in `hosts.yaml`, and will be filled in when Pegasus
4
  # determines the specific node and gpu the generated job command will run on.
5
  # We check {{ gpu }} = 0 to ensure that the image is only built once on each node.
6
+ - docker run -dit --name leaderboard{{ gpu }} --gpus '"device={{ gpu }}"' -v /data/leaderboard:/data/leaderboard -v $HOME/workspace/leaderboard:/workspace/leaderboard mlenergy/leaderboard:latest bash