mwitiderrick commited on
Commit
d9ab5da
·
1 Parent(s): 05a0ae8

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +5 -3
README.md CHANGED
@@ -12,7 +12,7 @@ formatted_prompt = f"<|im_start|>user\n{prompt}<|im_end|>\n<|im_start|>assistan
12
 
13
  model = TextGeneration(model="hf:nm-testing/TinyLlama-1.1B-Chat-v0.4-pruned50-quant")
14
  print(model(formatted_prompt, max_new_tokens=300).generations[0].text)
15
- ```
16
  """
17
  Banana bread is a delicious and healthy recipe that is easy to make. Here is a recipe for banana bread:
18
 
@@ -45,6 +45,7 @@ Step 4: Pour the batter into the prepared pan.
45
  Step 5
46
  """
47
  ```
 
48
  from deepsparse import TextGeneration
49
 
50
  prompt = "How to get in a good university?"
@@ -52,7 +53,7 @@ formatted_prompt = f"<|im_start|>user\n{prompt}<|im_end|>\n<|im_start|>assistan
52
 
53
  model = TextGeneration(model="hf:nm-testing/TinyLlama-1.1B-Chat-v0.4-pruned50-quant")
54
  print(model(formatted_prompt, max_new_tokens=200).generations[0].text)
55
- ```
56
  """
57
  There are several factors to consider when choosing a university:
58
 
@@ -65,9 +66,10 @@ There are several factors to consider when choosing a university:
65
 
66
  It's important to consider the location, faculty, and amenities when choosing a university. It's also important to research the job market and the salaries for jobs in the university. It's also important to research the job market and the
67
  """
 
68
  ## One-shot and Export
69
 
70
- ```
71
  git clone https://github.com/neuralmagic/sparseml
72
  pip install -e "sparseml[transformers]" "torch<2"
73
  cd sparseml
 
12
 
13
  model = TextGeneration(model="hf:nm-testing/TinyLlama-1.1B-Chat-v0.4-pruned50-quant")
14
  print(model(formatted_prompt, max_new_tokens=300).generations[0].text)
15
+
16
  """
17
  Banana bread is a delicious and healthy recipe that is easy to make. Here is a recipe for banana bread:
18
 
 
45
  Step 5
46
  """
47
  ```
48
+ ```python
49
  from deepsparse import TextGeneration
50
 
51
  prompt = "How to get in a good university?"
 
53
 
54
  model = TextGeneration(model="hf:nm-testing/TinyLlama-1.1B-Chat-v0.4-pruned50-quant")
55
  print(model(formatted_prompt, max_new_tokens=200).generations[0].text)
56
+
57
  """
58
  There are several factors to consider when choosing a university:
59
 
 
66
 
67
  It's important to consider the location, faculty, and amenities when choosing a university. It's also important to research the job market and the salaries for jobs in the university. It's also important to research the job market and the
68
  """
69
+ ```
70
  ## One-shot and Export
71
 
72
+ ```bash
73
  git clone https://github.com/neuralmagic/sparseml
74
  pip install -e "sparseml[transformers]" "torch<2"
75
  cd sparseml