Repository: rungalileo/docs-official
Pull request #120: 34 running experiments in console
Author: login: EvanGottschalk
Created: 2025-04-29T19:52:35Z | Merged: 2025-05-12T17:19:48Z

## Describe your changes

What did you change? Why did you change it?

## Shortcut ticket

For Galileo internally raised PRs only, please update this with your shortcut ticket.

[SC-]()

## Checklist before requesting a review

- [x] - Is this ready for review? If not, raise as a draft PR
- [x] - This deployed to a staging environment correctly
- [x] - I have reviewed my changes
- [x] - I have reviewed the deployed version of my changes
- [x] - I have tested any code that is added or updated
- [x] - I have verified all images and videos are clear, with appropriate zoom
- [x] - I have reviewed any spelling mistakes or broken links highlighted by the checks
- [x] - This references a feature that is public. If not, add a note and we can schedule the merge for after the feature release


Diff:
diff --git a/concepts/experiments/running-experiments-in-console.mdx b/concepts/experiments/running-experiments-in-console.mdx
index 9538a44c9..3c62dc103 100644
--- a/concepts/experiments/running-experiments-in-console.mdx
+++ b/concepts/experiments/running-experiments-in-console.mdx
@@ -5,60 +5,83 @@ icon: "hand-pointer"
 
 This section will guide you through the process of running experiments in the Galileo Console.
 
-## 🚶 Experiment Walkthrough
+## Experiment Walkthrough
 
 Follow these steps to test and improve your AI projects using [Galileo's Console UI](https://app.galileo.ai).
 
-### Step 1: Select Project & Open Playground
 
-On [app.galileo.ai](https://app.galileo.ai), use the **drop down menu in the top-left** to select the project you would like to experiment with. Or, create a new project.
+
+
+### Step 1 - Select Project and Open Playground
+
+In the [Galileo Console](https://app.galileo.ai), use the **drop down menu in the top-left** to select the project you would like to experiment with. Or, create a new project.
 
 Then, click the **"Open Playground"** button to access the Galileo Console.
 
 ![app.galileo.ai](/images/console-ui/home-navigation.png)
 
-### Step 2: Select Model & Enter API Keys
 
-In the Galileo Console UI, **select a model** using the "Model" drop down menu.
+
+### Step 2 - Select Model and Enter API Keys
+
+In the Galileo Console, **select a model** using the "Model" drop down menu.
 
 Some models require that you **enter your corresponding API key**. Visit their respective API platforms to obtain your keys, then add it using the [integrations page](https://app.galileo.ai/settings/integrations) in the Galileo console.
 
 ![Select a Model](/images/console-ui/model-select.png)
 
-### Step 3: Configure Model Settings
+
+
+### Step 3 - Configure Model Settings
 
 Click the settings icon **to the right of your model name** to adjust its behavior:
 
-- **Max Length:** Sets the maximum number of tokens the model can generate in its output.
-- **Temperature:** Controls randomness in output—higher values make responses more creative, lower values make them more focused and deterministic.
-- **Top P:** Limits sampling to the most likely tokens whose cumulative probability is within this threshold (a form of nucleus sampling).
-- **Frequency Penalty:** Reduces the likelihood of the model repeating the same tokens by penalizing frequent ones.
-- **Presence Penalty:** Discourages the model from mentioning tokens that have already appeared, promoting new content.
+* **Max Length:** Sets the maximum number of tokens the model can generate in its output.
+* **Temperature:** Controls randomness in output—higher values make responses more creative, lower values make them more focused and deterministic.
+* **Top P:** Limits sampling to the most likely tokens whose cumulative probability is within this threshold (a form of nucleus sampling).
+* **Frequency Penalty:** Reduces the likelihood of the model repeating the same tokens by penalizing frequent ones.
+* **Presence Penalty:** Discourages the model from mentioning tokens that have already appeared, promoting new content.
 
 ![Configure Model Settings](/images/console-ui/model-settings.png)
 
-### Step 4: Configure Prompt Data
+
+
+
+
+### Step 4 - Configure Prompt Data
 
 There are **two ways** to set the prompt data for your experiment:
 
-- **Option 1**: Add prompts and variables through the console UI
-  - Ideal for quick tests
-- **Option 2**: Use datasets from past experiments or create new ones
-  - Ideal for real, fully-configured experiments
+* **Option 1**: Add prompts and variables through the console UI. Ideal for quick tests.
+* **Option 2**: Use datasets from past experiments or create new ones. Ideal for real, fully-configured experiments.
+
+
+
 
-### Step 4, Option 1: Add Prompt & Variables
+### Step 4 Option 1 - Add Prompt and Variables
 
 In the Editor section, **add your prompt**.
 
-In your prompt, you can use **variable names with curly brackets** (e.g. `{{variable_name}}`). This is great for testing how changing individual words in a prompt structure affects outputs.
+In your prompt, you can use **variable names with curly brackets** (e.g. `{{variable_name}}`). Add new variable options with the **new tab icon** next to "Variable Set" and fill them in with different values to be used in place of your variable.
 
-Add new variable options with the **new tab icon** next to "VARIABLE SET 1 OF 1", or delete them with the **trash can icon**.
+You can also use **nested variables** by entering JSON formatted key-value pairs into the "Variable Set" text input field. Then, refer to their values with either `{{key}}` or `{{input.key}}`
+
+```json
+{
+  "pepperoni": "pepperoni pizza",
+  "anchovy": "pizza with anchovies"
+}
+```
+In this example, both `{{pepperoni}}` and `{{input.pepperoni}}` will result in "pepperoni pizza" being used in the prompt. This approach is great for testing how changing individual words in a prompt structure affects outputs.
 
 Add new messages beyond the initial prompt with the "+ Add Message" button **below the prompt field**. New messages can be from the user or the model ("system").
 
 ![Add Variables](/images/console-ui/variables-example.png)
 
-### Step 4, Option 2: Add Dataset
+
+
+
+### Step 4 Option 2 - Add Dataset
 
 Click the "Add Dataset" button to **choose a dataset** to be used by your model.
 
@@ -68,7 +91,10 @@ The datasets listed are from your past experiments. You can also [add your own](
 
 ![Add Dataset](/images/console-ui/dataset-select.png)
 
-### Step 5: Add Metrics
+
+
+
+### Step 5 - Add Metrics
 
 Click the "+ Add Metric" button to **choose metrics** by which your experiment's outputs are measured.
 
@@ -80,28 +106,37 @@ Scores are produced for each selected metric after running an experiment.
 
 ![Add Metrics](/images/console-ui/metrics-select.png)
 
-### Step 6: Add More Models, Prompts, and Settings
+
+
+
+
+### Step 6 - Add More Models, Prompts, and Settings
 
 Add **additional prompt sections** with the "+ Compare Prompt" button in the top-right.
 
 Each new prompt section can have its own distinct configuration of:
-
-- Model
-- Model settings
-- Prompt
-- Message conversation
+* Model
+* Model settings
+* Prompt
+* Message conversation
 
 Add new prompt sections and **customize their settings** as needed for your experiment.
 
 ![Add More Adjustments](/images/console-ui/two-models-example.png)
 
-### Step 7: Run Experiments
+
+
+
+### Step 7 - Run Experiments
 
 Click the **"Run All" button in the top-right** to run your experiments, generate outputs, and calculate evaluations based on your chosen metrics.
 
 ![Run Experiments](/images/console-ui/generating-results.png)
 
-### Step 8: Review Outputs
+
+
+
+### Step 8 - Review Outputs
 
 After the experiment has completed, **scroll down** to view their outputs and evaluations.
 
@@ -109,7 +144,10 @@ The more distinct prompts and variable sets you used, the more results there wil
 
 ![Review Outputs](/images/console-ui/experiment-results.png)
 
-### Step 9: Log Experiment Results
+
+
+
+### Step 9 - Log Experiment Results
 
 Click the "Log as Experiment" button above the outputs to **record all the details of the experiment**.
 
@@ -119,107 +157,31 @@ Use a **descriptive name** for your experiment so that it's easy to keep track o
 
 ![Log Results](/images/console-ui/experiment-name.png)
 
-### Step 10: Continue Experimenting!
+
+
+### Step 10 - Continue Experimenting!
 
 That's it! Now, further customize and configure your experiment to meet your testing goals. Log your experiment results, and create new projects to try out different configurations.
 
-If you encounter any errors, visit our [Common Errors guide](references/faqs/errors).
+If you encounter any errors, visit our [Common Errors guide](/references/faqs/errors).
+
+
+
+
 
-## ⚙️ Experiment Settings & Options
+## Experiment Settings and Options
 
-![Continue Experimenting](/images/console-ui/labeled-console-ui.png)
+![Continue Experimenting!](/images/console-ui/labeled-console-ui.png)
 
 1. **Model Select** - choose model to be used with prompt/dataset (and enter API keys if necessary)
 2. **Model Settings** - adjust model-specific settings. [Learn more about model settings →](#step-3-configure-model-settings)
 3. **Message Originator** - select if the content of the prompt is from a user or from the model itself ("system").
-4. **Prompt Entry** - add your prompt for the experiment. Use variables with curly brackets (e.g. `{{variable_name}}`) and add variable values in the variable entry field (#9). [Learn more about prompts & variables →](#step-4-option-1-add-prompt--variables)
+4. **Prompt Entry** - add your prompt for the experiment. Use variables with curly brackets (e.g. `{{variable_name}}`) and add variable values in the variable entry field (#9). [Learn more about prompts and variables →](#step-4-option-1-add-prompt-and-variables)
 5. **Add Message** - use a multi-prompt conversation in your experiment by adding new messages.
-6. **Dataset Select** - instead entering prompt(s), select a dataset of prompt data structures from a prior project, or add a new one. [Learn more about datasets →](/concepts/experiments/datasets)
+6. **Dataset Select** - instead of entering prompt(s), select a dataset of prompt data structures from a prior project, or add a new one. [Learn more about datasets →](/concepts/experiments/datasets)
 7. **Metrics Select** - select metrics by which your experiment is evaluated. Select from Galileo's many presets, or create your own metrics. Scores are produced for each metric after running an experiment. [Learn more about metrics →](/concepts/metrics/overview)
 8. **Add Variable Set** - add new groups of values for the variables used in your prompt. This adds a new "VARIABLE SET" section along the bottom of the screen.
 9. **Variable Value Entry** - set the values of the variables used in your prompt.
 10. **Log Experiment** - record your experiment's prompt data, settings, metric evaluations, and outputs. [Learn more about logging →](/getting-started/logging)
 11. **Run Individual Experiment** - run your experiment using its individual prompt data and settings. When using multiple prompts, a "Run All" button appears in the top-right to run all of your experiments.
-12. **Add Prompt Section** - add a new prompt section. Each prompt section can be configured with different models and prompts to compare and contrast their ouputs and metric evaluations. [Learn more about metrics →](/concepts/metrics/overview)
-
-## 🧪 Examples of Common Experiment Scenarios
-
-These examples illustrate how users typically run experiments in the Galileo Console to validate and improve AI application performance.
-
-### Example 1: Validating a Sentiment Analysis Function
-
-**Goal:** Ensure the model correctly classifies customer reviews as Positive, Neutral, or Negative.
-
-**Setup:**
-
-- **Function**: `analyze_sentiment` – takes in review text, returns a label and optional confidence score.
-- **Dataset**: 1,000 real customer reviews across different products.
-- **Metrics**: Correctness (using exact label match), Token Highlighting enabled.
-
-**Steps:**
-
-1. Upload or select the review dataset.
-2. Select the `analyze_sentiment` function.
-3. Choose **Correctness** as the metric and enable token-level explainability.
-4. Run the experiment.
-
-**Expected Outcome:**
-High accuracy in Positive/Negative samples. Token-level highlights reveal the influence of negation words and intensifiers.
-
-### Example 2: Comparing Two LLMs on a Customer Support Task
-
-**Goal:** Identify which model gives more helpful responses to customer queries.
-
-**Setup:**
-
-- **Functions**: `gpt-4` and `claude-3-haiku` versions of the same prompt template.
-- **Dataset**: 100 frequently asked customer service questions.
-- **Metrics**: Relevance and Completeness (measured via Galileo’s scoring UI or custom feedback rubric).
-
-**Steps:**
-
-1. Create one experiment per model with identical datasets.
-2. Manually score Relevance and Completeness or configure custom metrics.
-3. Use the Experiment Comparison view.
-
-**Expected Outcome:**
-Clear visual comparison of performance by metric. Decision support for production model selection.
-
-### Example 3: Safety Evaluation of a Chatbot
-
-**Goal:** Check for potential unsafe or toxic responses to edge-case prompts.
-
-**Setup:**
-
-- **Function**: `chatbot_response_v2`
-- **Dataset**: Curated prompts designed to trigger edge behaviors (e.g., controversial, sensitive, or adversarial topics).
-- **Metrics**: Safety (with Galileo's built-in Safety scoring model).
-
-**Steps:**
-
-1. Select the edge-case dataset.
-2. Select the chatbot function.
-3. Choose **Safety** as the metric.
-4. Run the experiment and review flagged outputs.
-
-**Expected Outcome:**
-Identification of prompt types that lead to unsafe outputs. Use results to fine-tune safety guardrails or re-train the model.
-
-### Example 4: Post-Deployment Regression Test
-
-**Goal:** Validate that a recent model update did not degrade performance on core use cases.
-
-**Setup:**
-
-- **Function**: `qa_model_v3`
-- **Dataset**: Golden set of key use-case inputs with known expected behavior.
-- **Metrics**: Correctness, Token Highlighting.
-
-**Steps:**
-
-1. Run the latest model version on the test set.
-2. Compare against the previous experiment’s results using Experiment Comparison.
-3. Investigate any performance dips.
-
-**Expected Outcome:**
-Confidence in regression safety. Easy rollback if new issues are detected.
+12. **Add Prompt Section** - add a new prompt section. Each prompt section can be configured with different models and prompts to compare and contrast their outputs and metric evaluations. [Learn more about metrics →](/concepts/metrics/overview)
\ No newline at end of file
diff --git a/images/console-ui/home-navigation.png b/images/console-ui/home-navigation.png
index 05ad7636e..8b59916e7 100644
Binary files a/images/console-ui/home-navigation.png and b/images/console-ui/home-navigation.png differ


Reviews:
user: login: rschwabco
body: Samll nits
state: DISMISSED
author_association: CONTRIBUTOR
submitted_at: 2025-04-30T19:03:54Z
user: login: EvanGottschalk
state: COMMENTED
author_association: CONTRIBUTOR
submitted_at: 2025-05-05T16:55:28Z
user: login: jimbobbennett
state: CHANGES_REQUESTED
author_association: CONTRIBUTOR
submitted_at: 2025-05-09T15:36:26Z
user: login: jimbobbennett
state: APPROVED
author_association: CONTRIBUTOR
submitted_at: 2025-05-09T20:08:45Z
user: login: jimbobbennett
state: APPROVED
author_association: CONTRIBUTOR
submitted_at: 2025-05-12T17:18:34Z

Review comments:
diff_hunk: @@ -5,40 +5,304 @@ icon: "hand-pointer"
 
 import { Screenshot } from '/snippets/Screenshot.mdx';
 
-{/* Note: When screenshots are available, add the imageUrl prop to each Screenshot component */}
 
-{/* Screenshot: Console Homepage Navigation */}
+
+This section will guide you through the process of running experiments in the Galileo Console.
+
+## 🚶 Experiment Walkthrough
+
+Follow these steps to test and improve your AI projects using [Galileo's Console UI](https://app.galileo.ai).
+
+
+
+
+### Step 1: Select Project & Open Playground
+
+On [app.galileo.ai](https://app.galileo.ai), use the **drop down menu in the top-left** to select the project you would like to experiment with. Or, create a new project.
path: getting-started/experiments/running-experiments-in-console.mdx
user: login: rschwabco
body: 
```suggestion
In the [Galileo Console](https://app.galileo.ai), use the **drop down menu in the top-left** to select the project you would like to experiment with. Or, create a new project.
```
created_at: 2025-04-30T18:58:11Z
author_association: CONTRIBUTOR
diff_hunk: @@ -5,40 +5,304 @@ icon: "hand-pointer"
 
 import { Screenshot } from '/snippets/Screenshot.mdx';
 
-{/* Note: When screenshots are available, add the imageUrl prop to each Screenshot component */}
 
-{/* Screenshot: Console Homepage Navigation */}
+
+This section will guide you through the process of running experiments in the Galileo Console.
+
+## 🚶 Experiment Walkthrough
+
+Follow these steps to test and improve your AI projects using [Galileo's Console UI](https://app.galileo.ai).
+
+
+
+
+### Step 1: Select Project & Open Playground
+
+On [app.galileo.ai](https://app.galileo.ai), use the **drop down menu in the top-left** to select the project you would like to experiment with. Or, create a new project.
+
+Then, click the **"Open Playground"** button to access the Galileo Console.
+
 <Screenshot
-  alt="Console homepage navigation showing the main dashboard and key navigation elements"
-  placeholder="Add screenshot of console homepage navigation"
+  alt="app.galileo.ai"
+  imageUrl="/images/console-ui/home-navigation.png"
 />
 
-{/* Screenshot: New Experiment Creation */}
+
+
+
+### Step 2: Select Model & Enter API Keys
+
+In the Galileo Console UI, **select a model** using the "Model" drop down menu.
path: getting-started/experiments/running-experiments-in-console.mdx
user: login: rschwabco
body: 
```suggestion
In the Galileo Console, **select a model** using the "Model" drop down menu.
```
created_at: 2025-04-30T18:58:50Z
author_association: CONTRIBUTOR
diff_hunk: @@ -5,40 +5,304 @@ icon: "hand-pointer"
 
 import { Screenshot } from '/snippets/Screenshot.mdx';
 
-{/* Note: When screenshots are available, add the imageUrl prop to each Screenshot component */}
 
-{/* Screenshot: Console Homepage Navigation */}
+
+This section will guide you through the process of running experiments in the Galileo Console.
+
+## 🚶 Experiment Walkthrough
+
+Follow these steps to test and improve your AI projects using [Galileo's Console UI](https://app.galileo.ai).
+
+
+
+
+### Step 1: Select Project & Open Playground
+
+On [app.galileo.ai](https://app.galileo.ai), use the **drop down menu in the top-left** to select the project you would like to experiment with. Or, create a new project.
+
+Then, click the **"Open Playground"** button to access the Galileo Console.
+
 <Screenshot
-  alt="Console homepage navigation showing the main dashboard and key navigation elements"
-  placeholder="Add screenshot of console homepage navigation"
+  alt="app.galileo.ai"
+  imageUrl="/images/console-ui/home-navigation.png"
 />
 
-{/* Screenshot: New Experiment Creation */}
+
+
+
+### Step 2: Select Model & Enter API Keys
+
+In the Galileo Console UI, **select a model** using the "Model" drop down menu.
+
+Some models require that you **enter your corresponding API key**. Visit their respective API platforms to obtain your keys.
+
 <Screenshot
-  alt="Form for creating a new experiment, showing all available configuration options"
-  placeholder="Add screenshot of new experiment creation form"
+  alt="Select a Model"
+  imageUrl="/images/console-ui/model-select.png"
 />
 
-{/* Screenshot: Experiment Configuration */}
+
+
+
+### Step 3: Configure Model Settings
+
+Click the settings icon **to the right of your model name** to adjust its behavior:
+
+* **Max Length:** Sets the maximum number of tokens the model can generate in its output.
+* **Temperature:** Controls randomness in output—higher values make responses more creative, lower values make them more focused and deterministic.
+* **Top P:** Limits sampling to the most likely tokens whose cumulative probability is within this threshold (a form of nucleus sampling).
+* **Frequency Penalty:** Reduces the likelihood of the model repeating the same tokens by penalizing frequent ones.
+* **Presence Penalty:** Discourages the model from mentioning tokens that have already appeared, promoting new content.
+
 <Screenshot
-  alt="Detailed view of experiment configuration options and settings"
-  placeholder="Add screenshot of experiment configuration options"
+  alt="Configure Model Settings"
+  imageUrl="/images/console-ui/model-settings.png"
 />
 
-{/* Screenshot: Running Experiment Status */}
+
+
+
+
+### Step 4: Configure Prompt Data
+
+There are **two ways** to set the prompt data for your experiment:
+
+* **Option 1**: Add prompts and variables through the console UI
+  * Ideal for quick tests
+* **Option 2**: Use datasets from past experiments or create new ones
+  * Ideal for real, fully-configured experiments
path: getting-started/experiments/running-experiments-in-console.mdx
user: login: rschwabco
body: This is a bit weirldy structured, probably get rid of the bullets
created_at: 2025-04-30T18:59:56Z
author_association: CONTRIBUTOR
diff_hunk: @@ -5,40 +5,304 @@ icon: "hand-pointer"
 
 import { Screenshot } from '/snippets/Screenshot.mdx';
 
-{/* Note: When screenshots are available, add the imageUrl prop to each Screenshot component */}
 
-{/* Screenshot: Console Homepage Navigation */}
+
+This section will guide you through the process of running experiments in the Galileo Console.
+
+## 🚶 Experiment Walkthrough
+
+Follow these steps to test and improve your AI projects using [Galileo's Console UI](https://app.galileo.ai).
+
+
+
+
+### Step 1: Select Project & Open Playground
+
+On [app.galileo.ai](https://app.galileo.ai), use the **drop down menu in the top-left** to select the project you would like to experiment with. Or, create a new project.
+
+Then, click the **"Open Playground"** button to access the Galileo Console.
+
 <Screenshot
-  alt="Console homepage navigation showing the main dashboard and key navigation elements"
-  placeholder="Add screenshot of console homepage navigation"
+  alt="app.galileo.ai"
+  imageUrl="/images/console-ui/home-navigation.png"
 />
 
-{/* Screenshot: New Experiment Creation */}
+
+
+
+### Step 2: Select Model & Enter API Keys
+
+In the Galileo Console UI, **select a model** using the "Model" drop down menu.
+
+Some models require that you **enter your corresponding API key**. Visit their respective API platforms to obtain your keys.
+
 <Screenshot
-  alt="Form for creating a new experiment, showing all available configuration options"
-  placeholder="Add screenshot of new experiment creation form"
+  alt="Select a Model"
+  imageUrl="/images/console-ui/model-select.png"
 />
 
-{/* Screenshot: Experiment Configuration */}
+
+
+
+### Step 3: Configure Model Settings
+
+Click the settings icon **to the right of your model name** to adjust its behavior:
+
+* **Max Length:** Sets the maximum number of tokens the model can generate in its output.
+* **Temperature:** Controls randomness in output—higher values make responses more creative, lower values make them more focused and deterministic.
+* **Top P:** Limits sampling to the most likely tokens whose cumulative probability is within this threshold (a form of nucleus sampling).
+* **Frequency Penalty:** Reduces the likelihood of the model repeating the same tokens by penalizing frequent ones.
+* **Presence Penalty:** Discourages the model from mentioning tokens that have already appeared, promoting new content.
+
 <Screenshot
-  alt="Detailed view of experiment configuration options and settings"
-  placeholder="Add screenshot of experiment configuration options"
+  alt="Configure Model Settings"
+  imageUrl="/images/console-ui/model-settings.png"
 />
 
-{/* Screenshot: Running Experiment Status */}
+
+
+
+
+### Step 4: Configure Prompt Data
+
+There are **two ways** to set the prompt data for your experiment:
+
+* **Option 1**: Add prompts and variables through the console UI
+  * Ideal for quick tests
+* **Option 2**: Use datasets from past experiments or create new ones
+  * Ideal for real, fully-configured experiments
+
+
+
+
+### Step 4, Option 1: Add Prompt & Variables
+
+In the Editor section, **add your prompt**.
+
+In your prompt, you can use **variable names with curly brackets** (e.g. `{{variable_name}}`). This is great for testing how changing individual words in a prompt structure affects outputs.
+
+Add new variable options with the **new tab icon** next to "VARIABLE SET 1 OF 1", or delete them with the **trash can icon**.
+
+Add new messages beyond the initial prompt with the "+ Add Message" button **below the prompt field**. New messages can be from the user or the model ("system").
+
 <Screenshot
-  alt="Live view of a running experiment showing progress and current status"
-  placeholder="Add screenshot of running experiment status"
+  alt="Add Variables"
+  imageUrl="/images/console-ui/variables-example.png"
 />
path: getting-started/experiments/running-experiments-in-console.mdx
user: login: rschwabco
body: We should explain how to use nested variables
created_at: 2025-04-30T19:00:39Z
author_association: CONTRIBUTOR
diff_hunk: @@ -5,40 +5,304 @@ icon: "hand-pointer"
 
 import { Screenshot } from '/snippets/Screenshot.mdx';
 
-{/* Note: When screenshots are available, add the imageUrl prop to each Screenshot component */}
 
-{/* Screenshot: Console Homepage Navigation */}
+
+This section will guide you through the process of running experiments in the Galileo Console.
+
+## 🚶 Experiment Walkthrough
+
+Follow these steps to test and improve your AI projects using [Galileo's Console UI](https://app.galileo.ai).
+
+
+
+
+### Step 1: Select Project & Open Playground
+
+On [app.galileo.ai](https://app.galileo.ai), use the **drop down menu in the top-left** to select the project you would like to experiment with. Or, create a new project.
+
+Then, click the **"Open Playground"** button to access the Galileo Console.
+
 <Screenshot
-  alt="Console homepage navigation showing the main dashboard and key navigation elements"
-  placeholder="Add screenshot of console homepage navigation"
+  alt="app.galileo.ai"
+  imageUrl="/images/console-ui/home-navigation.png"
 />
 
-{/* Screenshot: New Experiment Creation */}
+
+
+
+### Step 2: Select Model & Enter API Keys
+
+In the Galileo Console UI, **select a model** using the "Model" drop down menu.
+
+Some models require that you **enter your corresponding API key**. Visit their respective API platforms to obtain your keys.
+
 <Screenshot
-  alt="Form for creating a new experiment, showing all available configuration options"
-  placeholder="Add screenshot of new experiment creation form"
+  alt="Select a Model"
+  imageUrl="/images/console-ui/model-select.png"
 />
 
-{/* Screenshot: Experiment Configuration */}
+
+
+
+### Step 3: Configure Model Settings
+
+Click the settings icon **to the right of your model name** to adjust its behavior:
+
+* **Max Length:** Sets the maximum number of tokens the model can generate in its output.
+* **Temperature:** Controls randomness in output—higher values make responses more creative, lower values make them more focused and deterministic.
+* **Top P:** Limits sampling to the most likely tokens whose cumulative probability is within this threshold (a form of nucleus sampling).
+* **Frequency Penalty:** Reduces the likelihood of the model repeating the same tokens by penalizing frequent ones.
+* **Presence Penalty:** Discourages the model from mentioning tokens that have already appeared, promoting new content.
+
 <Screenshot
-  alt="Detailed view of experiment configuration options and settings"
-  placeholder="Add screenshot of experiment configuration options"
+  alt="Configure Model Settings"
+  imageUrl="/images/console-ui/model-settings.png"
 />
 
-{/* Screenshot: Running Experiment Status */}
+
+
+
+
+### Step 4: Configure Prompt Data
+
+There are **two ways** to set the prompt data for your experiment:
+
+* **Option 1**: Add prompts and variables through the console UI
+  * Ideal for quick tests
+* **Option 2**: Use datasets from past experiments or create new ones
+  * Ideal for real, fully-configured experiments
+
+
+
+
+### Step 4, Option 1: Add Prompt & Variables
+
+In the Editor section, **add your prompt**.
+
+In your prompt, you can use **variable names with curly brackets** (e.g. `{{variable_name}}`). This is great for testing how changing individual words in a prompt structure affects outputs.
+
+Add new variable options with the **new tab icon** next to "VARIABLE SET 1 OF 1", or delete them with the **trash can icon**.
+
+Add new messages beyond the initial prompt with the "+ Add Message" button **below the prompt field**. New messages can be from the user or the model ("system").
+
 <Screenshot
-  alt="Live view of a running experiment showing progress and current status"
-  placeholder="Add screenshot of running experiment status"
+  alt="Add Variables"
+  imageUrl="/images/console-ui/variables-example.png"
 />
 
-{/* Screenshot: Completed Experiment Results */}
+
+
+
+### Step 4, Option 2: Add Dataset
+
+Click the "Add Dataset" button to **choose a dataset** to be used by your model.
+
+The datasets listed are from your past experiments. You can also [add your own](/getting-started/experiments/datasets) by clicking "Create new dataset".
+
+[Learn more about datasets →](/getting-started/experiments/datasets)
+
 <Screenshot
-  alt="Results view of a completed experiment showing metrics and outcomes"
-  placeholder="Add screenshot of completed experiment results"
+  alt="Add Dataset"
+  imageUrl="/images/console-ui/dataset-select.png"
 />
 
-## Running Experiments
 
-This section will guide you through the process of running experiments in the Galileo Console.
 
-{/* TODO: Add more content */}
\ No newline at end of file
+
+### Step 5: Add Metrics
+
+Click the "+ Add Metric" button to **choose metrics** by which your experiment's outputs are measured.
+
+Filter and select from the preset metrics, or add your own by clicking "+ Create New Metric" in the top-right.
+
+Scores are produced for each selected metric after running an experiment.
+
+[Learn more about metrics →](/concepts/metrics/overview)
+
+<Screenshot
+  alt="Add Metrics"
+  imageUrl="/images/console-ui/metrics-select.png"
+/>
+
+
+
+
+
+### Step 6: Add More Models, Prompts, and Settings
+
+Add **additional prompt sections** with the "+ Compare Prompt" button in the top-right.
+
+Each new prompt section can have its own distinct configuration of:
+* Model
+* Model settings
+* Prompt
+* Message conversation
+
+Add new prompt sections and **customize their settings** as needed for your experiment.
+
+<Screenshot
+  alt="Add More Adjustments"
+  imageUrl="/images/console-ui/two-models-example.png"
+/>
+
+
+
+
+### Step 7: Run Experiments
+
+Click the **"Run All" button in the top-right** to run your experiments, generate outputs, and calculate evaluations based on your chosen metrics.
+
+<Screenshot
+  alt="Run Experiments"
+  imageUrl="/images/console-ui/generating-results.png"
+/>
+
+
+
+
+### Step 8: Review Outputs
+
+After the experiment has completed, **scroll down** to view their outputs and evaluations.
+
+The more distinct prompts and variable sets you used, the more results there will be.
+
+<Screenshot
+  alt="Review Outputs"
+  imageUrl="/images/console-ui/experiment-results.png"
+/>
+
+
+
+
+### Step 9: Log Experiment Results
+
+Click the "Log as Experiment" button above the outputs to **record all the details of the experiment**.
+
+Use a **descriptive name** for your experiment so that it's easy to keep track of your progress.
+
+[Learn more about logging →](/getting-started/logging)
+
+<Screenshot
+  alt="Log Results"
+  imageUrl="/images/console-ui/experiment-name.png"
+/>
+
+
+
+
+### Step 10: Continue Experimenting!
+
+That's it! Now, further customize and configure your experiment to meet your testing goals. Log your experiment results, and create new projects to try out different configurations.
+
+If you encounter any errors, visit our [Common Errors guide](references/faqs/errors).
+
+
+
+
+
+## ⚙️ Experiment Settings & Options
+
+<Screenshot
+  alt="Continue Experimenting!"
+  imageUrl="/images/console-ui/labeled-console-ui.png"
+/>
+
+1. **Model Select** - choose model to be used with prompt/dataset (and enter API keys if necessary)
+2. **Model Settings** - adjust model-specific settings. [Learn more about model settings →](#step-3-configure-model-settings)
+3. **Message Originator** - select if the content of the prompt is from a user or from the model itself ("system").
+4. **Prompt Entry** - add your prompt for the experiment. Use variables with curly brackets (e.g. `{{variable_name}}`) and add variable values in the variable entry field (#9). [Learn more about prompts & variables →](#step-4-option-1-add-prompt--variables)
+5. **Add Message** - use a multi-prompt conversation in your experiment by adding new messages.
+6. **Dataset Select** - instead entering prompt(s), select a dataset of prompt data structures from a prior project, or add a new one. [Learn more about datasets →](/getting-started/experiments/datasets)
+7. **Metrics Select** - select metrics by which your experiment is evaluated. Select from Galileo's many presets, or create your own metrics. Scores are produced for each metric after running an experiment. [Learn more about metrics →](/concepts/metrics/overview)
+8. **Add Variable Set** - add new groups of values for the variables used in your prompt. This adds a new "VARIABLE SET" section along the bottom of the screen.
+9. **Variable Value Entry** - set the values of the variables used in your prompt.
+10. **Log Experiment** - record your experiment's prompt data, settings, metric evaluations, and outputs. [Learn more about logging →](/getting-started/logging)
+11. **Run Individual Experiment** - run your experiment using its individual prompt data and settings. When using multiple prompts, a "Run All" button appears in the top-right to run all of your experiments.
+12. **Add Prompt Section** - add a new prompt section. Each prompt section can be configured with different models and prompts to compare and contrast their ouputs and metric evaluations. [Learn more about metrics →](/concepts/metrics/overview)
+
+
+
+
+## 🧪 Examples of Common Experiment Scenarios
path: getting-started/experiments/running-experiments-in-console.mdx
user: login: rschwabco
body: I think we can remove the example section. 
created_at: 2025-04-30T19:03:01Z
author_association: CONTRIBUTOR
diff_hunk: @@ -5,40 +5,304 @@ icon: "hand-pointer"
 
 import { Screenshot } from '/snippets/Screenshot.mdx';
 
-{/* Note: When screenshots are available, add the imageUrl prop to each Screenshot component */}
 
-{/* Screenshot: Console Homepage Navigation */}
+
+This section will guide you through the process of running experiments in the Galileo Console.
+
+## 🚶 Experiment Walkthrough
+
+Follow these steps to test and improve your AI projects using [Galileo's Console UI](https://app.galileo.ai).
+
+
+
+
+### Step 1: Select Project & Open Playground
+
+On [app.galileo.ai](https://app.galileo.ai), use the **drop down menu in the top-left** to select the project you would like to experiment with. Or, create a new project.
+
+Then, click the **"Open Playground"** button to access the Galileo Console.
+
 <Screenshot
-  alt="Console homepage navigation showing the main dashboard and key navigation elements"
-  placeholder="Add screenshot of console homepage navigation"
+  alt="app.galileo.ai"
+  imageUrl="/images/console-ui/home-navigation.png"
 />
 
-{/* Screenshot: New Experiment Creation */}
+
+
+
+### Step 2: Select Model & Enter API Keys
+
+In the Galileo Console UI, **select a model** using the "Model" drop down menu.
+
+Some models require that you **enter your corresponding API key**. Visit their respective API platforms to obtain your keys.
+
 <Screenshot
-  alt="Form for creating a new experiment, showing all available configuration options"
-  placeholder="Add screenshot of new experiment creation form"
+  alt="Select a Model"
+  imageUrl="/images/console-ui/model-select.png"
 />
 
-{/* Screenshot: Experiment Configuration */}
+
+
+
+### Step 3: Configure Model Settings
+
+Click the settings icon **to the right of your model name** to adjust its behavior:
+
+* **Max Length:** Sets the maximum number of tokens the model can generate in its output.
+* **Temperature:** Controls randomness in output—higher values make responses more creative, lower values make them more focused and deterministic.
+* **Top P:** Limits sampling to the most likely tokens whose cumulative probability is within this threshold (a form of nucleus sampling).
+* **Frequency Penalty:** Reduces the likelihood of the model repeating the same tokens by penalizing frequent ones.
+* **Presence Penalty:** Discourages the model from mentioning tokens that have already appeared, promoting new content.
+
 <Screenshot
-  alt="Detailed view of experiment configuration options and settings"
-  placeholder="Add screenshot of experiment configuration options"
+  alt="Configure Model Settings"
+  imageUrl="/images/console-ui/model-settings.png"
 />
 
-{/* Screenshot: Running Experiment Status */}
+
+
+
+
+### Step 4: Configure Prompt Data
+
+There are **two ways** to set the prompt data for your experiment:
+
+* **Option 1**: Add prompts and variables through the console UI
+  * Ideal for quick tests
+* **Option 2**: Use datasets from past experiments or create new ones
+  * Ideal for real, fully-configured experiments
+
+
+
+
+### Step 4, Option 1: Add Prompt & Variables
+
+In the Editor section, **add your prompt**.
+
+In your prompt, you can use **variable names with curly brackets** (e.g. `{{variable_name}}`). This is great for testing how changing individual words in a prompt structure affects outputs.
+
+Add new variable options with the **new tab icon** next to "VARIABLE SET 1 OF 1", or delete them with the **trash can icon**.
+
+Add new messages beyond the initial prompt with the "+ Add Message" button **below the prompt field**. New messages can be from the user or the model ("system").
+
 <Screenshot
-  alt="Live view of a running experiment showing progress and current status"
-  placeholder="Add screenshot of running experiment status"
+  alt="Add Variables"
+  imageUrl="/images/console-ui/variables-example.png"
 />
 
-{/* Screenshot: Completed Experiment Results */}
+
+
+
+### Step 4, Option 2: Add Dataset
+
+Click the "Add Dataset" button to **choose a dataset** to be used by your model.
+
+The datasets listed are from your past experiments. You can also [add your own](/getting-started/experiments/datasets) by clicking "Create new dataset".
+
+[Learn more about datasets →](/getting-started/experiments/datasets)
+
 <Screenshot
-  alt="Results view of a completed experiment showing metrics and outcomes"
-  placeholder="Add screenshot of completed experiment results"
+  alt="Add Dataset"
+  imageUrl="/images/console-ui/dataset-select.png"
 />
 
-## Running Experiments
 
-This section will guide you through the process of running experiments in the Galileo Console.
 
-{/* TODO: Add more content */}
\ No newline at end of file
+
+### Step 5: Add Metrics
+
+Click the "+ Add Metric" button to **choose metrics** by which your experiment's outputs are measured.
+
+Filter and select from the preset metrics, or add your own by clicking "+ Create New Metric" in the top-right.
+
+Scores are produced for each selected metric after running an experiment.
+
+[Learn more about metrics →](/concepts/metrics/overview)
+
+<Screenshot
+  alt="Add Metrics"
+  imageUrl="/images/console-ui/metrics-select.png"
+/>
+
+
+
+
+
+### Step 6: Add More Models, Prompts, and Settings
+
+Add **additional prompt sections** with the "+ Compare Prompt" button in the top-right.
+
+Each new prompt section can have its own distinct configuration of:
+* Model
+* Model settings
+* Prompt
+* Message conversation
+
+Add new prompt sections and **customize their settings** as needed for your experiment.
+
+<Screenshot
+  alt="Add More Adjustments"
+  imageUrl="/images/console-ui/two-models-example.png"
+/>
+
+
+
+
+### Step 7: Run Experiments
+
+Click the **"Run All" button in the top-right** to run your experiments, generate outputs, and calculate evaluations based on your chosen metrics.
+
+<Screenshot
+  alt="Run Experiments"
+  imageUrl="/images/console-ui/generating-results.png"
+/>
+
+
+
+
+### Step 8: Review Outputs
+
+After the experiment has completed, **scroll down** to view their outputs and evaluations.
+
+The more distinct prompts and variable sets you used, the more results there will be.
+
+<Screenshot
+  alt="Review Outputs"
+  imageUrl="/images/console-ui/experiment-results.png"
+/>
+
+
+
+
+### Step 9: Log Experiment Results
+
+Click the "Log as Experiment" button above the outputs to **record all the details of the experiment**.
+
+Use a **descriptive name** for your experiment so that it's easy to keep track of your progress.
+
+[Learn more about logging →](/getting-started/logging)
+
+<Screenshot
+  alt="Log Results"
+  imageUrl="/images/console-ui/experiment-name.png"
+/>
+
+
+
+
+### Step 10: Continue Experimenting!
+
+That's it! Now, further customize and configure your experiment to meet your testing goals. Log your experiment results, and create new projects to try out different configurations.
+
+If you encounter any errors, visit our [Common Errors guide](references/faqs/errors).
+
+
+
+
+
+## ⚙️ Experiment Settings & Options
path: getting-started/experiments/running-experiments-in-console.mdx
user: login: rschwabco
body: 
```suggestion
## Experiment Settings & Options
```
created_at: 2025-04-30T19:03:32Z
author_association: CONTRIBUTOR
diff_hunk: @@ -5,40 +5,304 @@ icon: "hand-pointer"
 
 import { Screenshot } from '/snippets/Screenshot.mdx';
 
-{/* Note: When screenshots are available, add the imageUrl prop to each Screenshot component */}
 
-{/* Screenshot: Console Homepage Navigation */}
+
+This section will guide you through the process of running experiments in the Galileo Console.
+
+## 🚶 Experiment Walkthrough
+
+Follow these steps to test and improve your AI projects using [Galileo's Console UI](https://app.galileo.ai).
+
+
+
+
+### Step 1: Select Project & Open Playground
+
+On [app.galileo.ai](https://app.galileo.ai), use the **drop down menu in the top-left** to select the project you would like to experiment with. Or, create a new project.
+
+Then, click the **"Open Playground"** button to access the Galileo Console.
+
 <Screenshot
-  alt="Console homepage navigation showing the main dashboard and key navigation elements"
-  placeholder="Add screenshot of console homepage navigation"
+  alt="app.galileo.ai"
+  imageUrl="/images/console-ui/home-navigation.png"
 />
 
-{/* Screenshot: New Experiment Creation */}
+
+
+
+### Step 2: Select Model & Enter API Keys
+
+In the Galileo Console UI, **select a model** using the "Model" drop down menu.
+
+Some models require that you **enter your corresponding API key**. Visit their respective API platforms to obtain your keys.
+
 <Screenshot
-  alt="Form for creating a new experiment, showing all available configuration options"
-  placeholder="Add screenshot of new experiment creation form"
+  alt="Select a Model"
+  imageUrl="/images/console-ui/model-select.png"
 />
 
-{/* Screenshot: Experiment Configuration */}
+
+
+
+### Step 3: Configure Model Settings
+
+Click the settings icon **to the right of your model name** to adjust its behavior:
+
+* **Max Length:** Sets the maximum number of tokens the model can generate in its output.
+* **Temperature:** Controls randomness in output—higher values make responses more creative, lower values make them more focused and deterministic.
+* **Top P:** Limits sampling to the most likely tokens whose cumulative probability is within this threshold (a form of nucleus sampling).
+* **Frequency Penalty:** Reduces the likelihood of the model repeating the same tokens by penalizing frequent ones.
+* **Presence Penalty:** Discourages the model from mentioning tokens that have already appeared, promoting new content.
+
 <Screenshot
-  alt="Detailed view of experiment configuration options and settings"
-  placeholder="Add screenshot of experiment configuration options"
+  alt="Configure Model Settings"
+  imageUrl="/images/console-ui/model-settings.png"
 />
 
-{/* Screenshot: Running Experiment Status */}
+
+
+
+
+### Step 4: Configure Prompt Data
+
+There are **two ways** to set the prompt data for your experiment:
+
+* **Option 1**: Add prompts and variables through the console UI
+  * Ideal for quick tests
+* **Option 2**: Use datasets from past experiments or create new ones
+  * Ideal for real, fully-configured experiments
+
+
+
+
+### Step 4, Option 1: Add Prompt & Variables
+
+In the Editor section, **add your prompt**.
+
+In your prompt, you can use **variable names with curly brackets** (e.g. `{{variable_name}}`). This is great for testing how changing individual words in a prompt structure affects outputs.
+
+Add new variable options with the **new tab icon** next to "VARIABLE SET 1 OF 1", or delete them with the **trash can icon**.
+
+Add new messages beyond the initial prompt with the "+ Add Message" button **below the prompt field**. New messages can be from the user or the model ("system").
+
 <Screenshot
-  alt="Live view of a running experiment showing progress and current status"
-  placeholder="Add screenshot of running experiment status"
+  alt="Add Variables"
+  imageUrl="/images/console-ui/variables-example.png"
 />
path: getting-started/experiments/running-experiments-in-console.mdx
user: login: EvanGottschalk
body: Sounds good. Where should I look to learn about nested variables?
created_at: 2025-05-05T16:55:28Z
author_association: CONTRIBUTOR
diff_hunk: @@ -5,69 +5,95 @@ icon: "hand-pointer"
 
 This section will guide you through the process of running experiments in the Galileo Console.
 
-## 🚶 Experiment Walkthrough
+## Experiment Walkthrough
 
 Follow these steps to test and improve your AI projects using [Galileo's Console UI](https://app.galileo.ai).
 
+
+
+
 ### Step 1: Select Project & Open Playground
 
-On [app.galileo.ai](https://app.galileo.ai), use the **drop down menu in the top-left** to select the project you would like to experiment with. Or, create a new project.
+In the [Galileo Console](https://app.galileo.ai), use the **drop down menu in the top-left** to select the project you would like to experiment with. Or, create a new project.
 
 Then, click the **"Open Playground"** button to access the Galileo Console.
 
 ![app.galileo.ai](/images/console-ui/home-navigation.png)
 
+
+
 ### Step 2: Select Model & Enter API Keys
 
-In the Galileo Console UI, **select a model** using the "Model" drop down menu.
+In the Galileo Console, **select a model** using the "Model" drop down menu.
 
-Some models require that you **enter your corresponding API key**. Visit their respective API platforms to obtain your keys, then add it using the [integrations page](https://app.galileo.ai/settings/integrations) in the Galileo console.
+Some models require that you **enter your corresponding API key**. Visit their respective API platforms to obtain your keys.
 
 ![Select a Model](/images/console-ui/model-select.png)
 
+
+
 ### Step 3: Configure Model Settings
 
 Click the settings icon **to the right of your model name** to adjust its behavior:
 
-- **Max Length:** Sets the maximum number of tokens the model can generate in its output.
-- **Temperature:** Controls randomness in output—higher values make responses more creative, lower values make them more focused and deterministic.
-- **Top P:** Limits sampling to the most likely tokens whose cumulative probability is within this threshold (a form of nucleus sampling).
-- **Frequency Penalty:** Reduces the likelihood of the model repeating the same tokens by penalizing frequent ones.
-- **Presence Penalty:** Discourages the model from mentioning tokens that have already appeared, promoting new content.
+* **Max Length:** Sets the maximum number of tokens the model can generate in its output.
+* **Temperature:** Controls randomness in output—higher values make responses more creative, lower values make them more focused and deterministic.
+* **Top P:** Limits sampling to the most likely tokens whose cumulative probability is within this threshold (a form of nucleus sampling).
+* **Frequency Penalty:** Reduces the likelihood of the model repeating the same tokens by penalizing frequent ones.
+* **Presence Penalty:** Discourages the model from mentioning tokens that have already appeared, promoting new content.
 
 ![Configure Model Settings](/images/console-ui/model-settings.png)
 
+
+
+
+
 ### Step 4: Configure Prompt Data
 
 There are **two ways** to set the prompt data for your experiment:
 
-- **Option 1**: Add prompts and variables through the console UI
-  - Ideal for quick tests
-- **Option 2**: Use datasets from past experiments or create new ones
-  - Ideal for real, fully-configured experiments
+* **Option 1**: Add prompts and variables through the console UI. Ideal for quick tests.
+* **Option 2**: Use datasets from past experiments or create new ones. Ideal for real, fully-configured experiments.
+
+
+
 
 ### Step 4, Option 1: Add Prompt & Variables
 
 In the Editor section, **add your prompt**.
 
-In your prompt, you can use **variable names with curly brackets** (e.g. `{{variable_name}}`). This is great for testing how changing individual words in a prompt structure affects outputs.
+In your prompt, you can use **variable names with curly brackets** (e.g. `{{variable_name}}`). Add new variable options with the **new tab icon** next to "Variable Set" and fill them in with different values to be used in place of your variable.
 
-Add new variable options with the **new tab icon** next to "VARIABLE SET 1 OF 1", or delete them with the **trash can icon**.
+You can also use **nested variables** by entering JSON formatted key-value pairs into the "Variable Set" text input field. Then, refer to their values with either `{{key}}` or `{{input.key}}`
+
+```
path: concepts/experiments/running-experiments-in-console.mdx
user: login: jimbobbennett
body: ```suggestion
```json
```
created_at: 2025-05-09T15:29:10Z
author_association: CONTRIBUTOR
diff_hunk: @@ -5,69 +5,95 @@ icon: "hand-pointer"
 
 This section will guide you through the process of running experiments in the Galileo Console.
 
-## 🚶 Experiment Walkthrough
+## Experiment Walkthrough
 
 Follow these steps to test and improve your AI projects using [Galileo's Console UI](https://app.galileo.ai).
 
+
+
+
 ### Step 1: Select Project & Open Playground
 
-On [app.galileo.ai](https://app.galileo.ai), use the **drop down menu in the top-left** to select the project you would like to experiment with. Or, create a new project.
+In the [Galileo Console](https://app.galileo.ai), use the **drop down menu in the top-left** to select the project you would like to experiment with. Or, create a new project.
 
 Then, click the **"Open Playground"** button to access the Galileo Console.
 
 ![app.galileo.ai](/images/console-ui/home-navigation.png)
 
+
+
 ### Step 2: Select Model & Enter API Keys
 
-In the Galileo Console UI, **select a model** using the "Model" drop down menu.
+In the Galileo Console, **select a model** using the "Model" drop down menu.
 
-Some models require that you **enter your corresponding API key**. Visit their respective API platforms to obtain your keys, then add it using the [integrations page](https://app.galileo.ai/settings/integrations) in the Galileo console.
+Some models require that you **enter your corresponding API key**. Visit their respective API platforms to obtain your keys.
path: concepts/experiments/running-experiments-in-console.mdx
user: login: jimbobbennett
body: ```suggestion
Some models require that you **enter your corresponding API key**. Visit their respective API platforms to obtain your keys, then add it using the [integrations page](https://app.galileo.ai/settings/integrations) in the Galileo console.
```

Revert removing this please
created_at: 2025-05-09T15:33:50Z
author_association: CONTRIBUTOR
diff_hunk: @@ -5,69 +5,95 @@ icon: "hand-pointer"
 
 This section will guide you through the process of running experiments in the Galileo Console.
 
-## 🚶 Experiment Walkthrough
+## Experiment Walkthrough
 
 Follow these steps to test and improve your AI projects using [Galileo's Console UI](https://app.galileo.ai).
 
+
+
+
 ### Step 1: Select Project & Open Playground
 
-On [app.galileo.ai](https://app.galileo.ai), use the **drop down menu in the top-left** to select the project you would like to experiment with. Or, create a new project.
+In the [Galileo Console](https://app.galileo.ai), use the **drop down menu in the top-left** to select the project you would like to experiment with. Or, create a new project.
 
 Then, click the **"Open Playground"** button to access the Galileo Console.
 
 ![app.galileo.ai](/images/console-ui/home-navigation.png)
 
+
+
 ### Step 2: Select Model & Enter API Keys
 
-In the Galileo Console UI, **select a model** using the "Model" drop down menu.
+In the Galileo Console, **select a model** using the "Model" drop down menu.
 
-Some models require that you **enter your corresponding API key**. Visit their respective API platforms to obtain your keys, then add it using the [integrations page](https://app.galileo.ai/settings/integrations) in the Galileo console.
+Some models require that you **enter your corresponding API key**. Visit their respective API platforms to obtain your keys.
 
 ![Select a Model](/images/console-ui/model-select.png)
 
+
+
 ### Step 3: Configure Model Settings
 
 Click the settings icon **to the right of your model name** to adjust its behavior:
 
-- **Max Length:** Sets the maximum number of tokens the model can generate in its output.
-- **Temperature:** Controls randomness in output—higher values make responses more creative, lower values make them more focused and deterministic.
-- **Top P:** Limits sampling to the most likely tokens whose cumulative probability is within this threshold (a form of nucleus sampling).
-- **Frequency Penalty:** Reduces the likelihood of the model repeating the same tokens by penalizing frequent ones.
-- **Presence Penalty:** Discourages the model from mentioning tokens that have already appeared, promoting new content.
+* **Max Length:** Sets the maximum number of tokens the model can generate in its output.
+* **Temperature:** Controls randomness in output—higher values make responses more creative, lower values make them more focused and deterministic.
+* **Top P:** Limits sampling to the most likely tokens whose cumulative probability is within this threshold (a form of nucleus sampling).
+* **Frequency Penalty:** Reduces the likelihood of the model repeating the same tokens by penalizing frequent ones.
+* **Presence Penalty:** Discourages the model from mentioning tokens that have already appeared, promoting new content.
 
 ![Configure Model Settings](/images/console-ui/model-settings.png)
 
+
+
+
+
 ### Step 4: Configure Prompt Data
 
 There are **two ways** to set the prompt data for your experiment:
 
-- **Option 1**: Add prompts and variables through the console UI
-  - Ideal for quick tests
-- **Option 2**: Use datasets from past experiments or create new ones
-  - Ideal for real, fully-configured experiments
+* **Option 1**: Add prompts and variables through the console UI. Ideal for quick tests.
+* **Option 2**: Use datasets from past experiments or create new ones. Ideal for real, fully-configured experiments.
+
+
+
 
 ### Step 4, Option 1: Add Prompt & Variables
 
 In the Editor section, **add your prompt**.
 
-In your prompt, you can use **variable names with curly brackets** (e.g. `{{variable_name}}`). This is great for testing how changing individual words in a prompt structure affects outputs.
+In your prompt, you can use **variable names with curly brackets** (e.g. `{{variable_name}}`). Add new variable options with the **new tab icon** next to "Variable Set" and fill them in with different values to be used in place of your variable.
 
-Add new variable options with the **new tab icon** next to "VARIABLE SET 1 OF 1", or delete them with the **trash can icon**.
+You can also use **nested variables** by entering JSON formatted key-value pairs into the "Variable Set" text input field. Then, refer to their values with either `{{key}}` or `{{input.key}}`
+
+```
+{
+  "pepperoni": "pepperoni pizza",
+  "anchovy": "pizza with anchovies"
+}
+```
+In this example, both `{{pepperoni}}` and `{{input.pepperoni}}` will result in "pepperoni pizza" being used in the prompt. This approach is great for testing how changing individual words in a prompt structure affects outputs.
 
 Add new messages beyond the initial prompt with the "+ Add Message" button **below the prompt field**. New messages can be from the user or the model ("system").
 
 ![Add Variables](/images/console-ui/variables-example.png)
 
+
+
+
 ### Step 4, Option 2: Add Dataset
 
 Click the "Add Dataset" button to **choose a dataset** to be used by your model.
 
-The datasets listed are from your past experiments. You can also [add your own](/concepts/experiments/datasets) by clicking "Create new dataset".
+The datasets listed are from your past experiments. You can also [add your own](/getting-started/experiments/datasets) by clicking "Create new dataset".
path: concepts/experiments/running-experiments-in-console.mdx
user: login: jimbobbennett
body: ```suggestion
The datasets listed are from your past experiments. You can also [add your own](/concepts/experiments/datasets) by clicking "Create new dataset".
```
created_at: 2025-05-09T15:34:59Z
author_association: CONTRIBUTOR
diff_hunk: @@ -5,69 +5,95 @@ icon: "hand-pointer"
 
 This section will guide you through the process of running experiments in the Galileo Console.
 
-## 🚶 Experiment Walkthrough
+## Experiment Walkthrough
 
 Follow these steps to test and improve your AI projects using [Galileo's Console UI](https://app.galileo.ai).
 
+
+
+
 ### Step 1: Select Project & Open Playground
 
-On [app.galileo.ai](https://app.galileo.ai), use the **drop down menu in the top-left** to select the project you would like to experiment with. Or, create a new project.
+In the [Galileo Console](https://app.galileo.ai), use the **drop down menu in the top-left** to select the project you would like to experiment with. Or, create a new project.
 
 Then, click the **"Open Playground"** button to access the Galileo Console.
 
 ![app.galileo.ai](/images/console-ui/home-navigation.png)
 
+
+
 ### Step 2: Select Model & Enter API Keys
 
-In the Galileo Console UI, **select a model** using the "Model" drop down menu.
+In the Galileo Console, **select a model** using the "Model" drop down menu.
 
-Some models require that you **enter your corresponding API key**. Visit their respective API platforms to obtain your keys, then add it using the [integrations page](https://app.galileo.ai/settings/integrations) in the Galileo console.
+Some models require that you **enter your corresponding API key**. Visit their respective API platforms to obtain your keys.
 
 ![Select a Model](/images/console-ui/model-select.png)
 
+
+
 ### Step 3: Configure Model Settings
 
 Click the settings icon **to the right of your model name** to adjust its behavior:
 
-- **Max Length:** Sets the maximum number of tokens the model can generate in its output.
-- **Temperature:** Controls randomness in output—higher values make responses more creative, lower values make them more focused and deterministic.
-- **Top P:** Limits sampling to the most likely tokens whose cumulative probability is within this threshold (a form of nucleus sampling).
-- **Frequency Penalty:** Reduces the likelihood of the model repeating the same tokens by penalizing frequent ones.
-- **Presence Penalty:** Discourages the model from mentioning tokens that have already appeared, promoting new content.
+* **Max Length:** Sets the maximum number of tokens the model can generate in its output.
+* **Temperature:** Controls randomness in output—higher values make responses more creative, lower values make them more focused and deterministic.
+* **Top P:** Limits sampling to the most likely tokens whose cumulative probability is within this threshold (a form of nucleus sampling).
+* **Frequency Penalty:** Reduces the likelihood of the model repeating the same tokens by penalizing frequent ones.
+* **Presence Penalty:** Discourages the model from mentioning tokens that have already appeared, promoting new content.
 
 ![Configure Model Settings](/images/console-ui/model-settings.png)
 
+
+
+
+
 ### Step 4: Configure Prompt Data
 
 There are **two ways** to set the prompt data for your experiment:
 
-- **Option 1**: Add prompts and variables through the console UI
-  - Ideal for quick tests
-- **Option 2**: Use datasets from past experiments or create new ones
-  - Ideal for real, fully-configured experiments
+* **Option 1**: Add prompts and variables through the console UI. Ideal for quick tests.
+* **Option 2**: Use datasets from past experiments or create new ones. Ideal for real, fully-configured experiments.
+
+
+
 
 ### Step 4, Option 1: Add Prompt & Variables
 
 In the Editor section, **add your prompt**.
 
-In your prompt, you can use **variable names with curly brackets** (e.g. `{{variable_name}}`). This is great for testing how changing individual words in a prompt structure affects outputs.
+In your prompt, you can use **variable names with curly brackets** (e.g. `{{variable_name}}`). Add new variable options with the **new tab icon** next to "Variable Set" and fill them in with different values to be used in place of your variable.
 
-Add new variable options with the **new tab icon** next to "VARIABLE SET 1 OF 1", or delete them with the **trash can icon**.
+You can also use **nested variables** by entering JSON formatted key-value pairs into the "Variable Set" text input field. Then, refer to their values with either `{{key}}` or `{{input.key}}`
+
+```
+{
+  "pepperoni": "pepperoni pizza",
+  "anchovy": "pizza with anchovies"
+}
+```
+In this example, both `{{pepperoni}}` and `{{input.pepperoni}}` will result in "pepperoni pizza" being used in the prompt. This approach is great for testing how changing individual words in a prompt structure affects outputs.
 
 Add new messages beyond the initial prompt with the "+ Add Message" button **below the prompt field**. New messages can be from the user or the model ("system").
 
 ![Add Variables](/images/console-ui/variables-example.png)
 
+
+
+
 ### Step 4, Option 2: Add Dataset
 
 Click the "Add Dataset" button to **choose a dataset** to be used by your model.
 
-The datasets listed are from your past experiments. You can also [add your own](/concepts/experiments/datasets) by clicking "Create new dataset".
+The datasets listed are from your past experiments. You can also [add your own](/getting-started/experiments/datasets) by clicking "Create new dataset".
 
-[Learn more about datasets →](/concepts/experiments/datasets)
+[Learn more about datasets →](/getting-started/experiments/datasets)
path: concepts/experiments/running-experiments-in-console.mdx
user: login: jimbobbennett
body: ```suggestion
[Learn more about datasets →](/concepts/experiments/datasets)
```
created_at: 2025-05-09T15:35:13Z
author_association: CONTRIBUTOR
diff_hunk: @@ -119,107 +157,31 @@ Use a **descriptive name** for your experiment so that it's easy to keep track o
 
 ![Log Results](/images/console-ui/experiment-name.png)
 
+
+
 ### Step 10: Continue Experimenting!
 
 That's it! Now, further customize and configure your experiment to meet your testing goals. Log your experiment results, and create new projects to try out different configurations.
 
-If you encounter any errors, visit our [Common Errors guide](references/faqs/errors).
+If you encounter any errors, visit our [Common Errors guide](/references/faqs/errors).
+
+
+
+
 
-## ⚙️ Experiment Settings & Options
+## Experiment Settings & Options
 
-![Continue Experimenting](/images/console-ui/labeled-console-ui.png)
+![Continue Experimenting!](/images/console-ui/labeled-console-ui.png)
 
 1. **Model Select** - choose model to be used with prompt/dataset (and enter API keys if necessary)
 2. **Model Settings** - adjust model-specific settings. [Learn more about model settings →](#step-3-configure-model-settings)
 3. **Message Originator** - select if the content of the prompt is from a user or from the model itself ("system").
 4. **Prompt Entry** - add your prompt for the experiment. Use variables with curly brackets (e.g. `{{variable_name}}`) and add variable values in the variable entry field (#9). [Learn more about prompts & variables →](#step-4-option-1-add-prompt--variables)
 5. **Add Message** - use a multi-prompt conversation in your experiment by adding new messages.
-6. **Dataset Select** - instead entering prompt(s), select a dataset of prompt data structures from a prior project, or add a new one. [Learn more about datasets →](/concepts/experiments/datasets)
+6. **Dataset Select** - instead of entering prompt(s), select a dataset of prompt data structures from a prior project, or add a new one. [Learn more about datasets →](/getting-started/experiments/datasets)
path: concepts/experiments/running-experiments-in-console.mdx
user: login: jimbobbennett
body: ```suggestion
6. **Dataset Select** - instead of entering prompt(s), select a dataset of prompt data structures from a prior project, or add a new one. [Learn more about datasets →](/concepts/experiments/datasets)
```
created_at: 2025-05-09T15:36:06Z
author_association: CONTRIBUTOR

PR comments:
user: login: EvanGottschalk
created_at: 2025-05-07T09:14:19Z
body: Conflicts are resolved. Should be ready to merge.
author_association: CONTRIBUTOR
user: login: jimbobbennett
created_at: 2025-05-07T21:25:44Z
body: @EvanGottschalk - more conflicts!
author_association: CONTRIBUTOR
user: login: github-actions[bot]
created_at: 2025-05-09T14:33:09Z
body: ✅ Mintlify Dev Server Started Successfully!

The documentation can be served without errors.
<!-- Sticky Pull Request Commentmintlify-dev -->
author_association: NONE
user: login: EvanGottschalk
created_at: 2025-05-09T15:01:40Z
body: I removed the latest conflicts @jimbobbennett. Let me know what you think!
author_association: CONTRIBUTOR