add example for text-generation-inference

README.md

@@ -92,6 +92,15 @@ print(output)
 # The use of vaccines has led to a significant reduction in the incidence and severity of many diseases, including measles, mumps, rubella, and polio. 
 ```
 
+It can also be used with text-generation-inference
+
+```sh
+model=Writer/palmyra-med-20b
+volume=$PWD/data
+
+docker run --gpus all --shm-size 1g -p 8080:80 -v $volume:/data ghcr.io/huggingface/text-generation-inference --model-id $model
+```
+
 ##  Dataset
 For the fine-tuning of our LLMs, we used a custom-curated medical dataset that combines data from
 two publicly available sources: PubMedQA (Jin et al. 2019) and MedQA (Zhang et al. 2018).The