Repository: stanford-crfm/helm
Issue: Add the ability to show instance descriptions
Root cause: Documentation Deficiency

In many of the MedHELM scenarios, the data is redacted for compliance reasons. This makes the benchmark understanding difficult for users exploring the leaderboard.

The request is to add, possibly in the header of the benchmark page (see below), an example of what the model is being asked.

<img width="839" height="417" alt="Image" src="https://github.com/user-attachments/assets/a5b04efa-88fc-404e-b771-8fdd00b911d4" />

As an example, this is what we are including in the appendix of the paper to exemplify the task being evaluated.

<img width="381" height="374" alt="Image" src="https://github.com/user-attachments/assets/37064c0a-c73b-4fac-b2d4-b5aa43a49d1e" />

<img width="383" height="316" alt="Image" src="https://github.com/user-attachments/assets/20e2fec5-9d06-48d9-9b6f-755d96eaeb68" />


#3755 provides the ability to provide both a short and a long description in the scenario run group description. You can put the instance examples in the long scenario descriptions by modifying `schema_medhelm.yaml`.

For instance, you would change this:

```yaml
  - name: shc_ptbm_med
    display_name: ADHD-Behavior
    description: ADHD-Behavior is a benchmark that evaluates a model's ability to detect whether a clinician recommends parent training in behavior management, an evidence-based first-line treatment for young children diagnosed with ADHD. Each instance includes a clinical note from a pediatric visit and a binary classification task [(Pillai et al., 2024)](https://doi.org/10.1093/jamia/ocae001).
```

by renaming `description` to `short_description` and then adding your example in `description`:

```yaml
  - name: shc_ptbm_med
    display_name: ADHD-Behavior
    short_description: ADHD-Behavior is a benchmark that evaluates a model's ability to detect whether a clinician recommends parent training in behavior management, an evidence-based first-line treatment for young children diagnosed with ADHD. Each instance includes a clinical note from a pediatric visit and a binary classification task [(Pillai et al., 2024)](https://doi.org/10.1093/jamia/ocae001).
    description: "ADHD-Behavior is a benchmark that evaluates a model's ability to detect whether a clinician recommends parent training in behavior management, an evidence-based first-line treatment for young children diagnosed with ADHD. Each instance includes a clinical note from a pediatric visit and a binary classification task [(Pillai et al., 2024)](https://doi.org/10.1093/jamia/ocae001).\n
      \n
      **Context**: The context includes a clinical note documenting...\n
      \n
      **Example**:\n
      \n
      ```\n
      Date: ...\n
      Patient: ...\n
      Visit Type: ...\n
      ```"
```

<img width="1826" height="738" alt="Image" src="https://github.com/user-attachments/assets/ff3b79ad-fed4-45a5-a80b-dc506ad281de" />

You will need to reformat your text from LaTeX to Markdown in YAML. It might be helpful to write a script to do this. You might also find this [YAML multi-line string guide](https://yaml-multiline.info/) helpful.

After you've made the change, I will need to rebuild the live frontend to pick up these changes.