quarterturn commited on
Commit
e5c051b
·
1 Parent(s): 1cd0c92

updated README.md; changed to have user download either model himself

Browse files
Files changed (1) hide show
  1. README.md +12 -3
README.md CHANGED
@@ -8,12 +8,21 @@ A simple python and gradio script to use Molmo 7B for image captioning. The prom
8
 
9
  Install:
10
  1. clone the repo
11
- 2. cd to "models" and clone Molmo-7B-D-0924:
12
- ```
 
 
13
  git lfs install
14
  git clone https://huggingface.co/allenai/Molmo-7B-D-0924
15
  ```
16
- Since the 4-bit quant isn't that large, I have included it here. There's no need to clone it seperately. The full 32-bit version is big, so I leave it up to you to clone it if you want it.
 
 
 
 
 
 
 
17
 
18
  1. create a python3 venv or use conda to create an environment, eg:
19
  ``` conda create -n caption python=3.11 ```
 
8
 
9
  Install:
10
  1. clone the repo
11
+ 2. cd to "models" and choose a model:
12
+
13
+ For max precision clone Molmo-7B-D-0924:
14
+ ```
15
  git lfs install
16
  git clone https://huggingface.co/allenai/Molmo-7B-D-0924
17
  ```
18
+ You'll need a 24GB GPU since the model loads at bf16.
19
+
20
+ For slightly less preccision, but much lower memory needed, clone molmo-7B-D-bnb-4bit:
21
+ ```
22
+ git lfs install
23
+ git clone https://huggingface.co/cyan2k/molmo-7B-D-bnb-4bit
24
+ ```
25
+ A 12GB GPU should be fine.
26
 
27
  1. create a python3 venv or use conda to create an environment, eg:
28
  ``` conda create -n caption python=3.11 ```