mgoin commited on
Commit
7ce50b1
β€’
1 Parent(s): 2b7c887

Update app.py

Browse files
Files changed (1) hide show
  1. app.py +2 -1
app.py CHANGED
@@ -14,7 +14,7 @@ Model ID: {MODEL_ID}
14
  πŸš€ **Experience the power of LLM mathematical reasoning** through [our MPT sparse finetuned](https://arxiv.org/abs/2310.06927) on the [GSM8K dataset](https://huggingface.co/datasets/gsm8k).
15
  GSM8K, short for Grade School Math 8K, is a collection of 8.5K high-quality linguistically diverse grade school math word problems, designed to challenge question-answering systems with multi-step reasoning.
16
  Observe the model's performance in deciphering complex math questions, such as "Natalia sold clips to 48 of her friends in April, and then she sold half as many clips in May. How many clips did Natalia sell altogether in April and May?" and offering detailed step-by-step solutions.
17
- ## Accelerated Inferenced on CPUs
18
  The MPT model runs purely on CPU courtesy of [sparse software execution by DeepSparse](https://github.com/neuralmagic/deepsparse/tree/main/research/mpt).
19
  DeepSparse provides accelerated inference by taking advantage of the MPT model's weight sparsity to deliver tokens fast!
20
 
@@ -30,6 +30,7 @@ pipe = deepsparse.Pipeline.create(
30
  model_path=MODEL_ID,
31
  sequence_length=MAX_MAX_NEW_TOKENS,
32
  prompt_sequence_length=16,
 
33
  )
34
 
35
  def clear_and_save_textbox(message: str) -> Tuple[str, str]:
 
14
  πŸš€ **Experience the power of LLM mathematical reasoning** through [our MPT sparse finetuned](https://arxiv.org/abs/2310.06927) on the [GSM8K dataset](https://huggingface.co/datasets/gsm8k).
15
  GSM8K, short for Grade School Math 8K, is a collection of 8.5K high-quality linguistically diverse grade school math word problems, designed to challenge question-answering systems with multi-step reasoning.
16
  Observe the model's performance in deciphering complex math questions, such as "Natalia sold clips to 48 of her friends in April, and then she sold half as many clips in May. How many clips did Natalia sell altogether in April and May?" and offering detailed step-by-step solutions.
17
+ ## Accelerated Inference on CPUs
18
  The MPT model runs purely on CPU courtesy of [sparse software execution by DeepSparse](https://github.com/neuralmagic/deepsparse/tree/main/research/mpt).
19
  DeepSparse provides accelerated inference by taking advantage of the MPT model's weight sparsity to deliver tokens fast!
20
 
 
30
  model_path=MODEL_ID,
31
  sequence_length=MAX_MAX_NEW_TOKENS,
32
  prompt_sequence_length=16,
33
+ num_cores=8,
34
  )
35
 
36
  def clear_and_save_textbox(message: str) -> Tuple[str, str]: