vania-janet/multiturn-rag-retrieval-data huggingface dataset:
],0.0006239631911739707,0.0004095369658898562],0.0007835839642211795,0.0004147835716139525],0.0009441681322641671,0.0004200618132017553],0.001105654751881957,0.0004253697406966239],0.0012679812498390675,0.000430705287726596],0.0014310830738395452,0.0004360663006082177],0.001594893983565271,0.0004414506256580353],0.0017593461088836193,0.0004468560218811035],0.0019243697170168161,0.00045228019007481635],0.002089893678203225,0.0004577208310365677],0.002255844883620739,0.0004631755000445992],0.0024221492931246758,0.0004686417814809829],0.0025887303054332733,0.0004741171724162996],0.002755511086434126,0.00047959911171346903],0.002922412706539035,
For more information, see [Bootstrapping annotation](https://cloud.ibm.com/docs/watson-knowledge-studio?topic=watson-knowledge-studio-preannotation).







 December 2017 



 New features and changes 

Launch on Cloud
: Knowledge Studio launched on IBM Cloud. For more information about the migration process and schedule, see [Migrating to IBM Cloud](https://cloud.ibm.com/docs/watson-knowledge-studio?topic=watson-knowledge-studio-migrate).

Redesigned navigation
: For more information about the navigation changes, see [Table 2](https://cloud.ibm.com/docs/watson-knowledge-studio?topic=watson-knowledge-studio-release-notesseptember2017) in the September 2017 release notes.

Added pre-annotator
: Added IBM Watson® Natural Language Understanding as a pre-annotator.

Added setting to Service Details page
: Added user and storage management settings to the Service Details page. For more information about adding users, see [Assembling a team](https://cloud.ibm.com/docs/watson-knowledge-studio?topic=watson-knowledge-studio-team). For more information about setting storage limits, see [Troubleshooting > Storage space issues](https://cloud.ibm.com/docs/watson-knowledge-studio?topic=watson-knowledge-studio-troubleshootingstorage).

Added Performance page
: Added a Performance page for model quality evaluation and guidance about how to improve quality.







 November 2017 



 Changes 

Bug fixes
: Fixed an issue where some relation annotations were missing in the downloaded corpus.
: Fixed an issue where a model could not be withdrawn from deployment if its status was None.
: Fixed an issue where the model could not be evaluated for Korean.







 October 2017 



 Changes 

Export issue fixed
[Verify value computer for product entity](https://cloud.ibm.com/docs-content/v1/content/a2b18c153837bce00a5b4de496e4b4ca64bbf56e/assistant-data/images/oe-go-to-entity.png)

The annotation is added to the entity you associated it with, and the system begins to train itself on the new data.

The term you annotated is added to the entity as a new dictionary value. If you associated the annotated term with an existing entity value, then the term is added as a synonym of that entity value instead of as an independent entity value.

![Shows mobile phones was added as a synonym for device value](https://cloud.ibm.com/docs-content/v1/content/a2b18c153837bce00a5b4de496e4b4ca64bbf56e/assistant-data/images/oe-phones-added.png)
10. To see all of the mentions you annotated for a particular entity, from the entity's configuration page, click the Annotation tab.

![Annotation view selector highlighted](https://cloud.ibm.com/docs-content/v1/content/a2b18c153837bce00a5b4de496e4b4ca64bbf56e/assistant-data/images/oe-annotated.png)

Contextual entities understand values that you have not explicitly defined. The system makes predictions about additional entity values based on how your user examples are annotated, and uses those values to train other entities. Any similar user examples are added to the Annotation view, so you can see how this option impacts training.

If you do not want your contextual entities to use this expanded understanding of entity values, select all the user examples in the Annotation view for that entity, and then click Delete.
[The "Delete a role" icon.](images/wks_delete.png "The "Delete a role" icon.") next to the AWARD role.

![A screen capture of deleting a role from an entity type.](images/wks_tut_delete_role.png "A screen capture that shows the cursor hovering over the "Delete a role" icon.")
4. Click Save.









 What to do next 

After you finish making changes to the type system, you can begin adding documents to your workspace.







 Lesson 4: Adding a dictionary 

In this lesson, you will learn how to add a dictionary to a workspace in Knowledge Studio. Dictionaries are used for pre-annotating text when creating a machine learning model.



 About this task 

For more information about dictionaries, see [Adding dictionaries to a workspace](https://cloud.ibm.com/docs/watson-knowledge-studio-data?topic=watson-knowledge-studio-data-dictionarieswks_projdictionaries).





 Procedure 



1. Download the [dictionary-items-organization.csv ![External link icon](https://cloud.ibm.com/docs-content/v1/content/148d3bd95f946aa1bb53ea1540475f522e6b61c9/icons/launch-glyph.svg)](https://watson-developer-cloud.github.io/doc-tutorial-downloads/knowledge-studio/dictionary-items-organization.csv) file to your computer. This file contains dictionary terms in CSV format, suitable for uploading into a Knowledge Studio dictionary.
2. Click Assets > Dictionaries.
3. Click Create Dictionary to add a dictionary.

Do not click Upload dictionary, which is used to upload a dictionary that you want to use as-is. For the tutorial, you will create a new editable dictionary and then upload terms into it.
4.
(images/wks_delete.jpg "The "Delete a role" icon.") next to the AWARD role.

![A screen capture of deleting a role from an entity type.](images/wks_tut_delete_role.png "A screen capture that shows the cursor hovering over the "Delete a role" icon.")
4. Click Save.









 What to do next 

After you finish making changes to the type system, you can begin adding documents to your workspace.







 Lesson 4: Adding a dictionary 

In this lesson, you will learn how to add a dictionary to a workspace in Knowledge Studio. Dictionaries are used for pre-annotating text when creating a machine learning model.



 About this task 

For more information about dictionaries, see [Adding dictionaries to a workspace](https://cloud.ibm.com/docs/watson-knowledge-studio?topic=watson-knowledge-studio-dictionarieswks_projdictionaries).





 Procedure 



1. Download the [dictionary-items-organization.csv ![External link icon](https://cloud.ibm.com/docs-content/v1/content/50eddb8fd81f33092880335ff107a78ff5cd0f65/icons/launch-glyph.svg)](https://watson-developer-cloud.github.io/doc-tutorial-downloads/knowledge-studio/dictionary-items-organization.csv) file to your computer. This file contains dictionary terms in CSV format, suitable for uploading into a Knowledge Studio dictionary.
2. Click Assets > Dictionaries.
3. Click Create Dictionary to add a dictionary.

Do not click Upload dictionary, which is used to upload a dictionary that you want to use as-is. For the tutorial, you will create a new editable dictionary and then upload terms into it.
4. In the Name field, type Test dictionary and click Save to create the (empty) dictionary.
Norwegian (Bokmål) (nb) Classifier (Document and Text), Custom entities, Dictionary, Optical character recognition v1, Parts of speech, Regular expressions, Smart Document Understanding, Stemmer, Table Understanding 
 Norwegian (Nynorsk) (nn) Classifier (Document and Text), Custom entities, Dictionary, Optical character recognition v1, Parts of speech, Regular expressions, Smart Document Understanding, Stemmer, Table Understanding 
 Polish (pl) Classifier (Document and Text), Custom entities, Dictionary, Optical character recognition v1, Parts of speech, Regular expressions, Smart Document Understanding, Table Understanding 
 Portuguese, Brazilian (pt-br) Advanced rules models, Built-in entities, Classifier (Document and Text), Custom entities, Dictionary, Document sentiment, Keywords, Machine Learning, Optical character recognition v1 (Installed), Optical character recognition v2 (Cloud-managed), Parts of speech, Regular expressions, Smart Document Understanding, Stemmer, Table Understanding 
 Romanian (ro) Classifier (Document and Text), Custom entities, Dictionary, Optical character recognition v1, Parts of speech, Phrase sentiment, Regular expressions, Smart Document Understanding, Stemmer, Table Understanding 
 Russian (ru) Classifier (Document and Text), Custom entities, Dictionary, Optical character recognition v1, Parts of speech, Phrase sentiment, Regular expressions, Smart Document Understanding, Stemmer, Table Understanding 
 Serbian (sr)<br><br>[1] Classifier (Document and Text), Custom entities, Dictionary, Parts of speech, Regular expressions 
 Slovak (sk) Classifier (Document and Text), Custom entities, Dictionary, Optical character recognition v1, Parts of speech, Regular expressions, Smart Document Understanding, Table Understanding 
 Spanish (es) Advanced rules models, Built-in entities, Classifier (Document and Text), Custom entities, Dictionary, Document sentiment, Keywords, Machine Learning, Optical character recognition v1 (Installed), Optical character recognition v2 (Cloud-managed), Parts of speech, Phrase sentiment, Regular expressions, Smart Document Understanding, Stemmer, Table Understanding 
 Swedish (sv) Classifier (Document and Text), Custom entities, Dictionary, Optical character recognition v1, Parts of speech, Regular expressions, Smart Document Understanding, Stemmer, Table Understanding 



Optical character recognition (OCR) v2 was introduced in Cloud-managed service instances on 2 November 2022.
[checkmark icon](https://cloud.ibm.com/docs-content/v1/content/f16b1f78a92498247223b337bd9303c2758b9ba8/icons/checkmark-icon.svg) 
 Create a content mining project type and then use the built-in Content Mining application to do in-depth data analysis (IBM Cloud Pak for Data, Enterprise, and Premium plans only) ![checkmark icon](https://cloud.ibm.com/docs-content/v1/content/f16b1f78a92498247223b337bd9303c2758b9ba8/icons/checkmark-icon.svg) 
 Perform real-time NLP with the Analyze API (IBM Cloud Pak for Data and Enterprise plans only) ![checkmark icon](https://cloud.ibm.com/docs-content/v1/content/f16b1f78a92498247223b337bd9303c2758b9ba8/icons/checkmark-icon.svg) 
 Apply a pretrained Smart Document Understanding model to your collection for similar benefits with less effort ![checkmark icon](https://cloud.ibm.com/docs-content/v1/content/f16b1f78a92498247223b337bd9303c2758b9ba8/icons/checkmark-icon.svg) 
 Process text from scanned documents or other images ![checkmark icon](https://cloud.ibm.com/docs-content/v1/content/f16b1f78a92498247223b337bd9303c2758b9ba8/icons/checkmark-icon.svg) !
[checkmark icon](https://cloud.ibm.com/docs-content/v1/content/f16b1f78a92498247223b337bd9303c2758b9ba8/icons/checkmark-icon.svg) ![checkmark icon](https://cloud.ibm.com/docs-content/v1/content/f16b1f78a92498247223b337bd9303c2758b9ba8/icons/checkmark-icon.svg) ![checkmark icon](https://cloud.ibm.com/docs-content/v1/content/f16b1f78a92498247223b337bd9303c2758b9ba8/icons/checkmark-icon.svg) 
 Sentiment of Document 
 Table Understanding ![checkmark icon](https://cloud.ibm.com/docs-content/v1/content/f16b1f78a92498247223b337bd9303c2758b9ba8/icons/checkmark-icon.svg) 



For more information about the following prebuilt enrichments, see the following topics:



* [Contracts](https://cloud.ibm.com/docs/discovery-data?topic=discovery-data-contracts-schema)
* [Table Understanding](https://cloud.ibm.com/docs/discovery-data?topic=discovery-data-understanding_tables)



For more information about how to create custom enrichments, see [Adding domain-specific resources](https://cloud.ibm.com/docs/discovery-data?topic=discovery-data-domain).
[Checkmark icon](https://cloud.ibm.com/docs-content/v1/content/6f3c07c34058f637b1c86044ca4f9b24214330a7/activity-tracker/images/checkmark-icon.svg) ![Checkmark icon](https://cloud.ibm.com/docs-content/v1/content/6f3c07c34058f637b1c86044ca4f9b24214330a7/activity-tracker/images/checkmark-icon.svg) 
 Natural Language Understanding ![Checkmark icon](https://cloud.ibm.com/docs-content/v1/content/6f3c07c34058f637b1c86044ca4f9b24214330a7/activity-tracker/images/checkmark-icon.svg) ![Checkmark icon](https://cloud.ibm.com/docs-content/v1/content/6f3c07c34058f637b1c86044ca4f9b24214330a7/activity-tracker/images/checkmark-icon.svg) 
 Text to Speech ![Checkmark icon](https://cloud.ibm.com/docs-content/v1/content/6f3c07c34058f637b1c86044ca4f9b24214330a7/activity-tracker/images/checkmark-icon.svg) ![Checkmark icon](https://cloud.ibm.com/docs-content/v1/content/6f3c07c34058f637b1c86044ca4f9b24214330a7/activity-tracker/images/checkmark-icon.svg) 
 Speech to Text !
Spanish [Version 1](https://cloud.ibm.com/docs/natural-language-understanding/?topic=natural-language-understanding-entity-types-version-1) [Version 1](https://cloud.ibm.com/docs/natural-language-understanding/?topic=natural-language-understanding-entity-types-version-1) [Version 1](https://cloud.ibm.com/docs/natural-language-understanding/?topic=natural-language-understanding-entity-types-version-1) [Version 1](https://cloud.ibm.com/docs/natural-language-understanding/?topic=natural-language-understanding-entity-types-version-1) [Version 2](https://cloud.ibm.com/docs/natural-language-understanding/?topic=natural-language-understanding-entity-types-version-2) [Version 2](https://cloud.ibm.com/docs/natural-language-understanding/?topic=natural-language-understanding-entity-types-version-2) [Version 2](https://cloud.ibm.com/docs/natural-language-understanding/?topic=natural-language-understanding-entity-types-version-2)
[Checkmark icon](https://cloud.ibm.com/docs-content/v1/content/6f3c07c34058f637b1c86044ca4f9b24214330a7/activity-tracker/images/checkmark-icon.svg) ![Checkmark icon](https://cloud.ibm.com/docs-content/v1/content/6f3c07c34058f637b1c86044ca4f9b24214330a7/activity-tracker/images/checkmark-icon.svg) 
 IBM Watson® Language Translator ![Checkmark icon](https://cloud.ibm.com/docs-content/v1/content/6f3c07c34058f637b1c86044ca4f9b24214330a7/activity-tracker/images/checkmark-icon.svg) ![Checkmark icon](https://cloud.ibm.com/docs-content/v1/content/6f3c07c34058f637b1c86044ca4f9b24214330a7/activity-tracker/images/checkmark-icon.svg) 
 IBM Watson® Machine Learning ![Checkmark icon](https://cloud.ibm.com/docs-content/v1/content/6f3c07c34058f637b1c86044ca4f9b24214330a7/activity-tracker/images/checkmark-icon.svg) ![Checkmark icon](https://cloud.ibm.com/docs-content/v1/content/6f3c07c34058f637b1c86044ca4f9b24214330a7/activity-tracker/images/checkmark-icon.svg) 
 Natural Language Understanding !
French [Version 1](https://cloud.ibm.com/docs/natural-language-understanding/?topic=natural-language-understanding-entity-types-version-1) [Version 2](https://cloud.ibm.com/docs/natural-language-understanding/?topic=natural-language-understanding-entity-types-version-2) [Version 2](https://cloud.ibm.com/docs/natural-language-understanding/?topic=natural-language-understanding-entity-types-version-2) [Version 2](https://cloud.ibm.com/docs/natural-language-understanding/?topic=natural-language-understanding-entity-types-version-2) [Version 2](https://cloud.ibm.com/docs/natural-language-understanding/?topic=natural-language-understanding-entity-types-version-2) [Version 2](https://cloud.ibm.com/docs/natural-language-understanding/?topic=natural-language-understanding-entity-types-version-2) [Version 2](https://cloud.ibm.com/docs/natural-language-understanding/?topic=natural-language-understanding-entity-types-version-2)
Japanese [Version 1](https://cloud.ibm.com/docs/natural-language-understanding/?topic=natural-language-understanding-entity-types-version-1) [Version 2](https://cloud.ibm.com/docs/natural-language-understanding/?topic=natural-language-understanding-entity-types-version-2) [Version 2](https://cloud.ibm.com/docs/natural-language-understanding/?topic=natural-language-understanding-entity-types-version-2) [Version 2](https://cloud.ibm.com/docs/natural-language-understanding/?topic=natural-language-understanding-entity-types-version-2) [Version 2](https://cloud.ibm.com/docs/natural-language-understanding/?topic=natural-language-understanding-entity-types-version-2) [Version 2](https://cloud.ibm.com/docs/natural-language-understanding/?topic=natural-language-understanding-entity-types-version-2) [Version 2](https://cloud.ibm.com/docs/natural-language-understanding/?topic=natural-language-understanding-entity-types-version-2)
German [Version 1](https://cloud.ibm.com/docs/natural-language-understanding/?topic=natural-language-understanding-entity-types-version-1) [Version 2](https://cloud.ibm.com/docs/natural-language-understanding/?topic=natural-language-understanding-entity-types-version-2) [Version 2](https://cloud.ibm.com/docs/natural-language-understanding/?topic=natural-language-understanding-entity-types-version-2) [Version 2](https://cloud.ibm.com/docs/natural-language-understanding/?topic=natural-language-understanding-entity-types-version-2) [Version 2](https://cloud.ibm.com/docs/natural-language-understanding/?topic=natural-language-understanding-entity-types-version-2) [Version 2](https://cloud.ibm.com/docs/natural-language-understanding/?topic=natural-language-understanding-entity-types-version-2) [Version 2](https://cloud.ibm.com/docs/natural-language-understanding/?topic=natural-language-understanding-entity-types-version-2)
For more information, see [Environment variable settings for Smart Document Understanding](https://cloud.ibm.com/docs/discovery-data?topic=discovery-data-troubleshoottroubleshoot-sdu).
: Discovery for Content Intelligence and Table Understanding enrichments are configured out of the box to be applied on a field named html. When a user uploads a JSON document without a root-level field named html, these enrichments will not yield results in the index. To run the enrichments on this kind of JSON documents, users must re-configure the enrichments to run on an existing field (or fields) in the JSON document.





 2.1.0 release, 27 November 2019 

New release now available
: IBM Watson® Discovery for IBM Cloud Pak® for Data version 2.1.0 is available.
: Discovery for Cloud Pak for Data now works with IBM Cloud Pak® for Data 2.5.0.0.

New Project-based interface
: Test your application like an end-user would with the Document retrieval, Conversational Search, and Content Mining project types. For more information, see [Creating projects](https://cloud.ibm.com/docs/discovery-data?topic=discovery-data-projects).

New Content Mining app
: Build an end user interface for extracting insights proactively from your entire corpus. For more information, see [Analyzing your data with the Content Mining application](https://cloud.ibm.com/docs/discovery-data?topic=discovery-data-contentminerapp).

New Content Intelligence add-on
: Option to enrich your documents with pre-built domain knowledge for Contracts. For more information, see [Document Retrieval for Contracts](https://cloud.ibm.com/docs/discovery-data?topic=discovery-data-projectsdoc-retrieval-contracts).

New reusable components
: Use reusable components to quickly build your application with Discovery. We ship an autocomplete, rich preview, results and facets component.
Swedish [Version 1](https://cloud.ibm.com/docs/natural-language-understanding/?topic=natural-language-understanding-entity-types-version-1) [Version 1](https://cloud.ibm.com/docs/natural-language-understanding/?topic=natural-language-understanding-entity-types-version-1) [Version 1](https://cloud.ibm.com/docs/natural-language-understanding/?topic=natural-language-understanding-entity-types-version-1) [Version 1](https://cloud.ibm.com/docs/natural-language-understanding/?topic=natural-language-understanding-entity-types-version-1) [Version 1](https://cloud.ibm.com/docs/natural-language-understanding/?topic=natural-language-understanding-entity-types-version-1) [Version 1](https://cloud.ibm.com/docs/natural-language-understanding/?topic=natural-language-understanding-entity-types-version-1) [Version 2](https://cloud.ibm.com/docs/natural-language-understanding/?topic=natural-language-understanding-entity-types-version-2)
Korean [Version 1](https://cloud.ibm.com/docs/natural-language-understanding/?topic=natural-language-understanding-entity-types-version-1) [Version 1](https://cloud.ibm.com/docs/natural-language-understanding/?topic=natural-language-understanding-entity-types-version-1) [Version 1](https://cloud.ibm.com/docs/natural-language-understanding/?topic=natural-language-understanding-entity-types-version-1) [Version 1](https://cloud.ibm.com/docs/natural-language-understanding/?topic=natural-language-understanding-entity-types-version-1) [Version 2](https://cloud.ibm.com/docs/natural-language-understanding/?topic=natural-language-understanding-entity-types-version-2) [Version 2](https://cloud.ibm.com/docs/natural-language-understanding/?topic=natural-language-understanding-entity-types-version-2) [Version 2](https://cloud.ibm.com/docs/natural-language-understanding/?topic=natural-language-understanding-entity-types-version-2)
Chinese [Version 2](https://cloud.ibm.com/docs/natural-language-understanding/?topic=natural-language-understanding-entity-types-version-2) [Version 2](https://cloud.ibm.com/docs/natural-language-understanding/?topic=natural-language-understanding-entity-types-version-2) [Version 2](https://cloud.ibm.com/docs/natural-language-understanding/?topic=natural-language-understanding-entity-types-version-2) [Version 2](https://cloud.ibm.com/docs/natural-language-understanding/?topic=natural-language-understanding-entity-types-version-2) [Version 2](https://cloud.ibm.com/docs/natural-language-understanding/?topic=natural-language-understanding-entity-types-version-2) [Version 2](https://cloud.ibm.com/docs/natural-language-understanding/?topic=natural-language-understanding-entity-types-version-2) [Version 2](https://cloud.ibm.com/docs/natural-language-understanding/?topic=natural-language-understanding-entity-types-version-2)
[Checkmark icon](https://cloud.ibm.com/docs-content/v1/content/adcecdbe4e86955f88aac7f3c1e7ec3ff44992ef/icons/checkmark-icon.svg) ![Checkmark icon](https://cloud.ibm.com/docs-content/v1/content/adcecdbe4e86955f88aac7f3c1e7ec3ff44992ef/icons/checkmark-icon.svg) 
 Text to Speech ![Checkmark icon](https://cloud.ibm.com/docs-content/v1/content/adcecdbe4e86955f88aac7f3c1e7ec3ff44992ef/icons/checkmark-icon.svg) ![Checkmark icon](https://cloud.ibm.com/docs-content/v1/content/adcecdbe4e86955f88aac7f3c1e7ec3ff44992ef/icons/checkmark-icon.svg) 
 Toolchain ![Checkmark icon](https://cloud.ibm.com/docs-content/v1/content/adcecdbe4e86955f88aac7f3c1e7ec3ff44992ef/icons/checkmark-icon.svg) ![Checkmark icon](https://cloud.ibm.com/docs-content/v1/content/adcecdbe4e86955f88aac7f3c1e7ec3ff44992ef/icons/checkmark-icon.svg) ![Checkmark icon](https://cloud.ibm.com/docs-content/v1/content/adcecdbe4e86955f88aac7f3c1e7ec3ff44992ef/icons/checkmark-icon.svg) !
English [Version 1](https://cloud.ibm.com/docs/natural-language-understanding/?topic=natural-language-understanding-entity-types-version-1) [Version 1](https://cloud.ibm.com/docs/natural-language-understanding/?topic=natural-language-understanding-entity-types-version-1) [Version 1](https://cloud.ibm.com/docs/natural-language-understanding/?topic=natural-language-understanding-entity-types-version-1) [Version 1](https://cloud.ibm.com/docs/natural-language-understanding/?topic=natural-language-understanding-entity-types-version-1) [Version 1](https://cloud.ibm.com/docs/natural-language-understanding/?topic=natural-language-understanding-entity-types-version-1) [Version 2](https://cloud.ibm.com/docs/natural-language-understanding/?topic=natural-language-understanding-entity-types-version-2) [Version 2](https://cloud.ibm.com/docs/natural-language-understanding/?topic=natural-language-understanding-entity-types-version-2)