Parma7876 commited on
Commit
b86a63f
·
verified ·
1 Parent(s): 7c1644c

Update readme.md

Browse files

Update readme.md to properly handle limit multimodal arg, verified on vllm serve

Files changed (1) hide show
  1. README.md +4 -4
README.md CHANGED
@@ -46,11 +46,11 @@ We recommand deploy GUI-Owl-7B through vllm
46
  This script has been validated on an A100 with 96 GB of VRAM.
47
  ```bash
48
  PIXEL_ARGS='{"min_pixels":3136,"max_pixels":10035200}'
49
- IMAGE_LIMIT_ARGS='image=2'
50
  MP_SIZE=1
51
  MM_KWARGS=(
52
  --mm-processor-kwargs $PIXEL_ARGS
53
- --limit-mm-per-prompt $IMAGE_LIMIT_ARGS
54
  )
55
 
56
  vllm serve $CKPT \
@@ -65,11 +65,11 @@ If you want GUI-Owl to recieve more than two images, you could increase `IMAGE_L
65
  For example:
66
  ```bash
67
  PIXEL_ARGS='{"min_pixels":3136,"max_pixels":3211264}'
68
- IMAGE_LIMIT_ARGS='image=5'
69
  MP_SIZE=1
70
  MM_KWARGS=(
71
  --mm-processor-kwargs $PIXEL_ARGS
72
- --limit-mm-per-prompt $IMAGE_LIMIT_ARGS
73
  )
74
 
75
  vllm serve $CKPT \
 
46
  This script has been validated on an A100 with 96 GB of VRAM.
47
  ```bash
48
  PIXEL_ARGS='{"min_pixels":3136,"max_pixels":10035200}'
49
+
50
  MP_SIZE=1
51
  MM_KWARGS=(
52
  --mm-processor-kwargs $PIXEL_ARGS
53
+ --limit-mm-per-prompt '{"image":2,"video":0}' \
54
  )
55
 
56
  vllm serve $CKPT \
 
65
  For example:
66
  ```bash
67
  PIXEL_ARGS='{"min_pixels":3136,"max_pixels":3211264}'
68
+
69
  MP_SIZE=1
70
  MM_KWARGS=(
71
  --mm-processor-kwargs $PIXEL_ARGS
72
+ --limit-mm-per-prompt '{"image":5,"video":0}'
73
  )
74
 
75
  vllm serve $CKPT \