quarterturn
commited on
Commit
·
e5c051b
1
Parent(s):
1cd0c92
updated README.md; changed to have user download either model himself
Browse files
README.md
CHANGED
@@ -8,12 +8,21 @@ A simple python and gradio script to use Molmo 7B for image captioning. The prom
|
|
8 |
|
9 |
Install:
|
10 |
1. clone the repo
|
11 |
-
2. cd to "models" and
|
12 |
-
|
|
|
|
|
13 |
git lfs install
|
14 |
git clone https://huggingface.co/allenai/Molmo-7B-D-0924
|
15 |
```
|
16 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
17 |
|
18 |
1. create a python3 venv or use conda to create an environment, eg:
|
19 |
``` conda create -n caption python=3.11 ```
|
|
|
8 |
|
9 |
Install:
|
10 |
1. clone the repo
|
11 |
+
2. cd to "models" and choose a model:
|
12 |
+
|
13 |
+
For max precision clone Molmo-7B-D-0924:
|
14 |
+
```
|
15 |
git lfs install
|
16 |
git clone https://huggingface.co/allenai/Molmo-7B-D-0924
|
17 |
```
|
18 |
+
You'll need a 24GB GPU since the model loads at bf16.
|
19 |
+
|
20 |
+
For slightly less preccision, but much lower memory needed, clone molmo-7B-D-bnb-4bit:
|
21 |
+
```
|
22 |
+
git lfs install
|
23 |
+
git clone https://huggingface.co/cyan2k/molmo-7B-D-bnb-4bit
|
24 |
+
```
|
25 |
+
A 12GB GPU should be fine.
|
26 |
|
27 |
1. create a python3 venv or use conda to create an environment, eg:
|
28 |
``` conda create -n caption python=3.11 ```
|