Spaces:

nateraw
/

text-generation-inference

Runtime error

nateraw commited on May 2, 2023

Commit

9acf314

•

1 Parent(s): f9158ff

Update Dockerfile

Files changed (1) hide show

Dockerfile CHANGED Viewed

@@ -115,10 +115,10 @@ ENV PATH=/opt/conda/bin:$PATH \
 # Text Generation Inference base env
 ENV HUGGINGFACE_HUB_CACHE=/data \
     HF_HUB_ENABLE_HF_TRANSFER=1 \
-    MODEL_ID=bigscience/bloom-560m \
     QUANTIZE=false \
     NUM_SHARD=1 \
-    PORT=80
 LABEL com.nvidia.volumes.needed="nvidia_driver"

 # Text Generation Inference base env
 ENV HUGGINGFACE_HUB_CACHE=/data \
     HF_HUB_ENABLE_HF_TRANSFER=1 \
+    MODEL_ID=google/flan-t5-small \
     QUANTIZE=false \
     NUM_SHARD=1 \
+    PORT=7860
 LABEL com.nvidia.volumes.needed="nvidia_driver"