Quick start: Evaluate and track a prompt template
Quick start: Evaluate and track a prompt template Take this tutorial to learn how to evaluate and track a prompt template. You can evaluate prompt templates in projects or deployment spaces to measure the performance of foundation model tasks and understand how your model generates responses. Then, you can track the prompt template in an AI use case to capture and share facts about the asset to help you meet governance and compliance goals. Required services : watsonx.governance Your basic workflow includes these tasks: 1. Open a project that contains the prompt template to evaluate. Projects are where you can collaborate with others to work with assets. 2. Evaluate a prompt template using test data. 3. Review the results on the AI Factsheet. 4. Track the evaluated prompt template in an AI use case. 5. Deploy and test your evaluated prompt template. Read about prompt templates With watsonx.governance, you can evaluate prompt templates in projects to measure how effectively your foundation models generate responses for the following task types: * Classification * Summarization * Generation * Question answering * Entity extraction [Read more about evaluating prompt templates in projects](https://dataplatform.cloud.ibm.com/docs/content/wsj/model/wos-eval-prompt.html) [Read more about evaluating prompt templates in deployment spaces](https://dataplatform.cloud.ibm.com/docs/content/wsj/model/wos-eval-prompt-spaces.html) Watch a video about evaluating and tracking a prompt template ![Watch Video](https://dataplatform.cloud.ibm.com/docs/content/wsj/getting-started/images/lc-video.png) Watch this video to preview the steps in this tutorial. There might be slight differences in the user interface shown in the video. The video is intended to be a companion to the written tutorial. This video provides a visual method to learn the concepts and tasks in this documentation. Try a tutorial to evaluating and tracking a prompt template In this tutorial, you will complete these tasks: * [Task 1: Create a project](https://dataplatform.cloud.ibm.com/docs/content/wsj/getting-started/get-started-evaluate-prompt.html?context=cdpaas&locale=enstep01) * [Task 2: Evaluate the sample prompt template](https://dataplatform.cloud.ibm.com/docs/content/wsj/getting-started/get-started-evaluate-prompt.html?context=cdpaas&locale=enstep02) * [Task 3: Create a model inventory and AI use case](https://dataplatform.cloud.ibm.com/docs/content/wsj/getting-started/get-started-evaluate-prompt.html?context=cdpaas&locale=enstep03) * [Task 4: Start tracking the prompt template](https://dataplatform.cloud.ibm.com/docs/content/wsj/getting-started/get-started-evaluate-prompt.html?context=cdpaas&locale=enstep04) * [Task 5: Create a new project for validation](https://dataplatform.cloud.ibm.com/docs/content/wsj/getting-started/get-started-evaluate-prompt.html?context=cdpaas&locale=enstep05) * [Task 6: Validate the prompt template](https://dataplatform.cloud.ibm.com/docs/content/wsj/getting-started/get-started-evaluate-prompt.html?context=cdpaas&locale=enstep06) * [Task 7: Deploy the prompt template](https://dataplatform.cloud.ibm.com/docs/content/wsj/getting-started/get-started-evaluate-prompt.html?context=cdpaas&locale=enstep07) Expand all sections * Tips for completing this tutorial ### Use the video picture-in-picture Tip: Start the video, then as you scroll through the tutorial, the video moves to picture-in-picture mode. Close the video table of contents for the best experience with picture-in-picture. You can use picture-in-picture mode so you can follow the video as you complete the tasks in this tutorial. Click the timestamps for each task to follow along.The following animated image shows how to use the video picture-in-picture and table of contents features: ![How to use picture-in-picture and chapters](https://dataplatform.cloud.ibm.com/docs/content/wsj/getting-started/images/pip-and-chapters.gif){: width="560px" height="315px" data-tearsheet="this"} ### Get help in the community If you need help with this tutorial, you can ask a question or find an answer in the [Cloud Pak for Data Community discussion forum](https://community.ibm.com/community/user/cloudpakfordata/communities/community-home/digestviewer?communitykey=c0c16ff2-10ef-4b50-ae4c-57d769937235){: new_window}. ### Set up your browser windows For the optimal experience completing this tutorial, open Cloud Pak for Data in one browser window, and keep this tutorial page open in another browser window to switch easily between the two applications. Consider arranging the two browser windows side-by-side to make it easier to follow along. ![Side-by-side tutorial and UI](https://dataplatform.cloud.ibm.com/docs/content/wsj/getting-started/images/tutorial-side-by-side.png){: width="560px" height="315px" data-tearsheet="this"} Tip: If you encounter a guided tour while completing this tutorial in the user interface, click Maybe later. [Back to the top](https://dataplatform.cloud.ibm.com/docs/content/wsj/getting-started/get-started-evaluate-prompt.html?context=cdpaas&locale=envideo-preview) * Task 1: Create a project ![preview tutorial video](https://dataplatform.cloud.ibm.com/docs/content/wsj/getting-started/images/lc-video.png) To preview this task, watch the video beginning at 00:08. You need a project store the prompt template and the evaluation. Follow these steps to create a project based on a sample: 1. Access the [Getting started with watsonx governance](https://dataplatform.cloud.ibm.com/exchange/public/entry/view/1b6c8d6e-a45c-4bf1-84ee-8fe9a6daa56d){: external} project in the Samples. 1. Click Create project. 1. Accept the default values for the project name, and click Create. 1. Click View new project when the project is successfully created. 1. Associate a Watson Machine Learning service with the project: 1. When the project opens, click the Manage tab, and select the Services and integrations page. 1. On the IBM services tab, click Associate service. 1. Select your Watson Machine Learning instance. If you don't have a Watson Machine Learning service instance provisioned yet, follow these steps: 1. Click New service. 1. Select Watson Machine Learning. 1. Click Create. 1. Select the new service instance from the list. 1. Click Associate service. 1. If necessary, click Cancel to return to the Services & Integrations page. 1. Click the Assets tab in the project to see the sample assets. For more information or to watch a video, see [Creating a project](https://dataplatform.cloud.ibm.com/docs/content/wsj/getting-started/projects.html){: new_window}.For more information on associated services, see [Adding associated services](https://dataplatform.cloud.ibm.com/docs/content/wsj/getting-started/assoc-services.html){: new_window}. ### ![Checkpoint icon](https://dataplatform.cloud.ibm.com/docs/content/wsj/getting-started/images/checkmark--filled-blue.svg){: iih} Check your progress The following image shows the project Assets tab. You are now ready to evaluate the sample prompt template in the project. ![Sample project assets](https://dataplatform.cloud.ibm.com/docs/content/wsj/getting-started/images/wx-gov-sample-project.png){: width="100%" } [Back to the top](https://dataplatform.cloud.ibm.com/docs/content/wsj/getting-started/get-started-evaluate-prompt.html?context=cdpaas&locale=envideo-preview) * Task 2: Evaluate the sample prompt template