add example for text-generation-inference

#1
by nbroad HF staff - opened
Files changed (1) hide show
  1. README.md +9 -0
README.md CHANGED
@@ -92,6 +92,15 @@ print(output)
92
  # The use of vaccines has led to a significant reduction in the incidence and severity of many diseases, including measles, mumps, rubella, and polio.
93
  ```
94
 
 
 
 
 
 
 
 
 
 
95
  ## Dataset
96
  For the fine-tuning of our LLMs, we used a custom-curated medical dataset that combines data from
97
  two publicly available sources: PubMedQA (Jin et al. 2019) and MedQA (Zhang et al. 2018).The
 
92
  # The use of vaccines has led to a significant reduction in the incidence and severity of many diseases, including measles, mumps, rubella, and polio.
93
  ```
94
 
95
+ It can also be used with text-generation-inference
96
+
97
+ ```sh
98
+ model=Writer/palmyra-med-20b
99
+ volume=$PWD/data
100
+
101
+ docker run --gpus all --shm-size 1g -p 8080:80 -v $volume:/data ghcr.io/huggingface/text-generation-inference --model-id $model
102
+ ```
103
+
104
  ## Dataset
105
  For the fine-tuning of our LLMs, we used a custom-curated medical dataset that combines data from
106
  two publicly available sources: PubMedQA (Jin et al. 2019) and MedQA (Zhang et al. 2018).The