networkstatic vishnoianil commited on
Commit
3d47a36
·
unverified ·
1 Parent(s): a513e62

Add poetry install shell cmd to the readme (#7)

Browse files

* Add poetry install shell cmd to the readme

Signed-off-by: Brent Salisbury <bsalisbu@redhat.com>

* Add GPU support instructions

- Validated on an EC2 GPU instance to work.
- Closes #8

Signed-off-by: Brent Salisbury <bsalisbu@redhat.com>

* Update README.md

Signed-off-by: Anil Vishnoi <vishnoianil@gmail.com>

---------

Signed-off-by: Brent Salisbury <bsalisbu@redhat.com>
Signed-off-by: Anil Vishnoi <vishnoianil@gmail.com>
Co-authored-by: Anil Vishnoi <vishnoianil@gmail.com>

Files changed (1) hide show
  1. README.md +24 -0
README.md CHANGED
@@ -10,6 +10,9 @@
10
  Install the dependencies
11
 
12
  ```sh
 
 
 
13
  # Install dependencies
14
  poetry install
15
 
@@ -30,3 +33,24 @@ curl -X 'POST' \
30
  }
31
  }'
32
  ```
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
10
  Install the dependencies
11
 
12
  ```sh
13
+ # Install poetry if not already available
14
+ curl -sSL https://install.python-poetry.org | python3 -
15
+
16
  # Install dependencies
17
  poetry install
18
 
 
33
  }
34
  }'
35
  ```
36
+
37
+ ### Cuda GPU Support
38
+
39
+ For GPU support try the following:
40
+
41
+ ```sh
42
+ # Create a virtual env
43
+ python3 -m venv venv
44
+
45
+ # Activate the venv
46
+ source venv/bin/active
47
+
48
+ # Install torch with the special index
49
+ pip install torch torchvision torchaudio --index-url https://download.pytorch.org/whl/cu124
50
+
51
+ # Install the package
52
+ pip install -e .
53
+
54
+ # Run the server
55
+ poetry run uvicorn docling_serve.app:app --reload
56
+ ```