vania-janet/multiturn-rag-retrieval-data huggingface dataset:
IBM has not tested those products and cannot confirm the accuracy of performance, compatibility or any other claims related to non-IBM products. Questions on the capabilities of non-IBM products should be addressed to the suppliers of those products.

Statements regarding IBM's future direction or intent are subject to change or withdrawal without notice, and represent goals and objectives only.

All IBM prices shown are IBM's suggested retail prices, are current and are subject to change without notice. Dealer prices may vary.

This information is for planning purposes only. The information herein is subject to change before the products described become available.

This information contains examples of data and reports used in daily business operations. To illustrate them as completely as possible, the examples include the names of individuals, companies, brands, and products. All of these names are fictitious and any similarity to actual people or business enterprises is entirely coincidental.

COPYRIGHT LICENSE:

This information contains sample application programs in source language, which illustrate programming techniques on various operating platforms. You may copy, modify, and distribute these sample programs in any form without payment to IBM, for the purposes of developing, using, marketing or distributing application programs conforming to the application programming interface for the operating platform for which the sample programs are written. These examples have not been thoroughly tested under all conditions. IBM, therefore, cannot guarantee or imply reliability, serviceability, or function of these programs. The sample programs are provided "AS IS", without warranty of any kind. IBM shall not be liable for any damages arising out of your use of the sample programs.

Each copy or any portion of these sample programs or any derivative work must include a copyright notice as follows:

© (your company name) (year). Portions of this code are derived from IBM Corp. Sample Programs. © Copyright IBM Corp. 2019.

SANCTIONS & EMBARGOES

The United States prohibits most commercial transactions and other dealings with a handful of countries for foreign policy and national security reasons. These prohibitions – formally known as trade and economic sanctions or comprehensive embargoes – currently target Iran, Cuba, North Korea, and Syria.

IBM Cloud implements network-wide blocking of communications to IP addresses which originate from countries subject to those trade and economic sanctions.
IBM Cloud Notices 

This information was developed for products and services that are offered in the US. This material might be available from IBM in other languages. However, you might be required to own a copy of the product or product version in that language to access it.

IBM may not offer the products, services, or features discussed in this document in other countries. Consult your local IBM representative for information on the products and services currently available in your area. Any reference to an IBM product, program, or service is not intended to state or imply that only that IBM product, program, or service may be used. Any functionally equivalent product, program, or service that does not infringe any IBM intellectual property right may be used instead. However, it is the user's responsibility to evaluate and verify the operation of any non-IBM product, program, or service.

IBM may have patents or pending patent applications covering subject matter that is described in this document. The furnishing of this document does not grant you any license to these patents. You can send license inquiries, in writing, to:

IBM Director of LicensingIBM CorporationNorth Castle Drive, MD-NC119Armonk, NY 10504-1785US

For license inquiries regarding double-byte character set (DBCS) information, contact the IBM Intellectual Property Department in your country or send inquiries, in writing, to:

Intellectual Property LicensingLegal and Intellectual Property LawIBM Japan Ltd.19-21, Nihonbashi-Hakozakicho, Chuo-kuTokyo 103-8510, Japan

INTERNATIONAL BUSINESS MACHINES CORPORATION PROVIDES THIS PUBLICATION "AS IS" WITHOUT WARRANTY OF ANY KIND, EITHER EXPRESS OR IMPLIED, INCLUDING, BUT NOT LIMITED TO, THE IMPLIED WARRANTIES OF NON-INFRINGEMENT, MERCHANTABILITY OR FITNESS FOR A PARTICULAR PURPOSE. Some jurisdictions do not allow disclaimer of express or implied warranties in certain transactions, therefore, this statement may not apply to you.

This information might include technical inaccuracies or typographical errors. Changes are periodically made to the information herein; these changes will be incorporated in new editions of the publication. IBM may make improvements and/or changes in the product(s) and/or the program(s) described in this publication at any time without notice.
For more information, see [Deploying and Connecting a Cloud Databases Instance](https://cloud.ibm.com/docs/databases-for-etcd?topic=cloud-databases-create-instance-tutorial).





 11 October 2022 

Protecting IBM Cloud® Databases for etcd resources with context-based restrictions
: Context-based restrictions (CBR) give account owners and administrators the ability to define and enforce access restrictions for IBM Cloud® resources based on the context of access requests. Access to Cloud Databases resources can be controlled with CBR and identity and access management (IAM) policies. For more information, see [Protecting Cloud Databases resources with context-based restrictions](https://cloud.ibm.com/docs/databases-for-etcd?topic=cloud-databases-cbr&interface=ui).





 25 March 2022 

IBM Cloud® Databases for etcd Security Goals Updated
: Available security and compliance goals updated. See updated goals [here](https://cloud.ibm.com/docs/databases-for-redis?topic=databases-for-etcd-manage-security-compliance).





 30 June 2021 

General Availability of IBM Cloud® Databases for etcd support for IBM Cloud Databases enabled by IBM Cloud Satellite.
: A distributed cloud provides consistent security and services across environments, centralized workload visibility, reduced latency, easier compliance and higher application development velocity. See blog post announcement [here](https://www.ibm.com/cloud/blog/announcements/deploy-managed-cloud-native-databases-anywhere-with-ibm-cloud-satellite).





 13 April 2020 

IBM Cloud® Databases for etcd autoscaling
: We are excited to announce that autoscaling of your deployments based on disk capacity and disk I/O utilization is now available for IBM Cloud® Databases for etcd via the UI, API, and CLI. See blog post announcement [here](https://www.ibm.com/cloud/blog/announcements/ibm-cloud-databases-portfolio-introduces-autoscaling).





 6 August 2019 

New Regions Available for IBM Cloud Database Services
See [Get a list of all databases in the instance](https://cloud.ibm.com/apidocs/cloudantgetalldbs).

New! Pluggable storage engine
: Add a pluggable storage engine.

Improvement
: Update MochiWeb to version 2.17.

Attachments
: Ensure deterministic revisions for attachments. See [COUCHDB-3255](https://issues.apache.org/jira/browse/COUCHDB-3255).

chttpd multipart
: Prevent chttpd multipart zombie processes.

Unconditional retries
: Avoid unconditional retries in replicator's HTTP client.

Session support
: Prepare for session support in replicator.







 February 2018 



 15 February 2018 

The following changes were made in build 6656:

Query parameters
: Update _design_docs to respect the query parameters that are used by _all_docs. See [Get design documents](https://cloud.ibm.com/apidocs/cloudantpostalldocs).

COPY request
: When you send a COPY request to /$DATABASE/docid endpoint, IBM Cloudant now decodes the Destination header and creates a new ID without escaped values.

Replication document
: Remove headers from replication document on read.

update_seq and offset parameters
: If the keys parameter is specified and the update_seq parameter is set to true, the update_seq and offset parameters return null in the response.

Semantics
: Change semantics of status codes for create database.





 7 February 2018 

Db2 Warehouse on Cloud feature is deprecated
: To find alternatives to IBM Cloudant's IBM® Db2® Warehouse on Cloud feature, see the [data-flow-examples repository](https://github.com/cloudant-labs/data-flow-examples) for tutorials on extracting IBM Cloudant documents and writing the data to a Db2 Warehouse on Cloud table.







 January 2018 



 10 January 2018 

The following changes were made in build 6620:

IBM Cloudant Query and empty partial_filter_selector field
To return all documents that contain the entity IBM, but not the entity Watson: Click Search for Documents, Use the Discovery Query Language then:



* Click the Field drop-down and choose enriched_text.entities.text, for the Operator choose contains, then enter the Value of IBM. Click Add rule, then for the Field choose enriched_text.entities.text, for the Operator choose does not contain, then enter the Value of Watson.

The query enriched_text.entities.text:IBM,enriched_text.entities.text:!Watson displays under the Visual Query Builder. The operator :! specifies "does not contain".







 Step 4: Build a combined query 

You can combine query parameters together to build more targeted queries. Let's try using both the filter and query parameters to return documents about IBM acquisitions. The filter parameter narrows the results to only documents that mention IBM, and then the query parameter returns all results about acquisitions, in order of relevance.



1. Click on the build queries icon ![Query icon](https://cloud.ibm.com/docs-content/v1/content/ded4adc3ea0bd2a81b113c579f2b1183926da211/discovery/images/icon_queryBuilder.png) to open the query page. Select the collection that contains the IBM Press Releases and click Get started.
2. Under Filter which documents you query:



* Click the Field drop-down and choose enriched_text.entities.text, for the Operator choose contains, then enter the Value of IBM.

The query enriched_text.entities.text:IBM narrows the documents to only those that mention the entity IBM.



3. Under Search for Documents, click Use the Discovery Query Language, then:



* Click the Field drop-down and choose enriched_text.concepts.text, for the Operator choose contains, then enter the Value of world wide web.

The query enriched_text.concepts.text:"world wide web" returns all documents that include the concept of world wide web, and those documents are ranked in order of relevance.



4. Click More options, then Fields to return and choose Specify.
Design document management 

The scalable JSON data store for IBM Cloudant has several querying mechanisms, all of which generate indices that are created and maintained separately from the core data.

Article contributed by Glynn Bird, Developer Advocate at IBM Cloudant, [glynn@cloudant.com](mailto:glynn@cloudant.com).

Indexing isn't performed immediately when a document is saved. Instead, indexing is scheduled to happen later, providing a faster, non-blocking write throughput.



* MapReduce views are indexes into the data set with key value pairs that are stored in a BTree for efficient retrieval by key or range of keys.
* Search Indexes are constructed by using Apache Lucene to allow free-text search, faceting, and complex ad hoc queries.



IBM® Cloudant® for IBM Cloud®'s [search indexes](https://cloud.ibm.com/docs/Cloudant?topic=Cloudant-cloudant-search) and [MapReduce views](https://cloud.ibm.com/docs/Cloudant?topic=Cloudant-creating-views-mapreduce) are configured by adding design documents to a database. Design documents are JSON documents that include the instructions about how the view or index is to be built. Let's take a simple example. Assume that you have a simple collection of data documents, similar to the following example.

See an example of a simple data document:

{
"_id": "23966717-5A6F-E581-AF79-BB55D6BBB613",
"_rev": "1-96daf2e7c7c0c277d0a63c49b57919bc",
"doc_name": "Markdown Reference",
"body": "Lorem Ipsum",
"ts": 1422358827
}

Each data document includes a name, a body, and a timestamp.
IBM Cloud® Databases 

The IBM Cloud® Databases portfolio includes nine database-as-a-service offerings on the IBM Cloud. In addition to the comprehensive information in the IBM Cloud® Databases docs, links to additional sources of information are provided below.

 Developer tools 

[API & SDK reference](https://cloud.ibm.com/apidocs/cloud-databases-api/cloud-databases-api-v5introduction)[CLI reference](https://cloud.ibm.com/docs/databases-cli-plugin)[Terraform reference](https://registry.terraform.io/providers/IBM-Cloud/ibm/latest/docs/resources/database)

 Recommended content 

[Getting to production for IBM Cloud® Databases Prework and a sample checklist](https://cloud.ibm.com/docs/cloud-databases?topic=cloud-databases-best-practices&interface=ui)[Provisioning an IBM Cloud® Databases deployment To create an IBM Cloud® Databases deployment, first create an IBM Cloud service instance.](https://cloud.ibm.com/docs/cloud-databases?topic=cloud-databases-provisioning&interface=ui)[Protecting Cloud Databases resources with context-based restrictions Context-based restrictions give account owners and administrators the ability to define and enforce access restrictions for IBM Cloud® resources based on the context of access requests. Access to Cloud Databases resources can be controlled with context-based restrictions and Identity and Access Management (IAM) policies.](https://cloud.ibm.com/docs/cloud-databases?topic=cloud-databases-cbr&interface=ui)

 Learn more 

[IBM Developer<br><br>Visit IBM Developer for technical articles, code patterns, tutorials, and more.<br><br>![112-Developer-tools.svg](https://cloud.ibm.com/media/docs/images/homepage/112-Developer-tools.svg)](https://developer.ibm.com/depmodels/cloud/)[Architecture Center<br><br>Discover the architecture references available for this product.<br><br>!
CouchDB 1.6 _users database support
: Support for the CouchDB 1.6 _users database features, including server-side hashing of passwords when documents are created in the _users database.

/_bulk_get endpoint
: /_bulk_get endpoint to reduce the number of requests that are used in replication to mobile clients.

Design document metadata
: Design document metadata contains an update pending field.

Eliminate error
: IBM Cloudant Query no longer returns an error if no valid index exists.







 February 2016 



 4 February 2016 

dbcopy
: The dbcopy feature can cause problems under some circumstances. Information about the feature was removed from the documentation. Use of dbcopy is discouraged.







 November 2014 



 6 November 2014 

generate_api_key endpoint is deprecated
: An earlier method of generating API keys by issuing the POST command to the https://cloudant.com/api/generate_api_key endpoint is deprecated.







 July 2014 



 1 July 2014 

New! Introducing IBM Cloudant Classic
: IBM® Cloudant® for IBM Cloud® is a document-oriented database as a service (DBaaS). It stores data as documents in JSON format. It is built with scalability, high availability, and durability in mind.
* [Indexing and querying](https://cloud.ibm.com/docs/Cloudant?topic=Cloudant-indexing-and-querying)
* [IBM Cloudant in practice](https://cloud.ibm.com/docs/Cloudant?topic=Cloudant-cloudant-in-practice)



* Sample apps



* [Offline First shopping list](https://developer.ibm.com/patterns/create-an-offline-first-shopping-list-progressive-web-app/)
* [Serverless web application and API](https://cloud.ibm.com/docs/solution-tutorials?topic=solution-tutorials-serverless-api-webappserverless-api-webapp)
* [Create a climate rating system on the IBM Cloud](https://developer.ibm.com/tutorials/provision-a-couchdb-instance-using-cloudant-cfc-starter-kit-2/)
* [Mobile application with serverless backend](https://cloud.ibm.com/docs/solution-tutorials?topic=solution-tutorials-serverless-mobile-backendserverless-mobile-backend)
* [Gather, visualize, and analyze IoT data](https://cloud.ibm.com/docs/solution-tutorials?topic=solution-tutorials-gather-visualize-analyze-iot-datagather-visualize-analyze-iot-data)



* [Client libraries](https://cloud.ibm.com/docs/Cloudant?topic=Cloudant-client-libraries)
* Apache CouchDB



* [Comparing Apache CouchDB and IBM Cloudant](https://cloud.ibm.com/docs/Cloudant?topic=Cloudant-couchdb-and-cloudant)
* [Comparison of IBM Cloudant and Apache CouchDB API endpoints](https://cloud.ibm.com/docs/Cloudant?topic=Cloudant-comparison-of-ibm-cloudant-and-couchdb-api-endpoints)



* Other offerings
FAQ 

Find answers to frequently asked questions.

For more information about Discovery-specific concepts, such as projects or enrichments, see the [glossary](https://cloud.ibm.com/docs/discovery-data?topic=discovery-data-glossary).



 How do I search the product documentation? 

To search the entire IBM Cloud Docs site, enter your search term into the search field in the IBM Cloud website banner. To search for information about the Discovery service only, scroll to the start of the page and enter your search term into the search field in the page header.

Zoom

![Shows where the documentation search field is situated at the start of the page](https://cloud.ibm.com/docs-content/v1/content/f16b1f78a92498247223b337bd9303c2758b9ba8/discovery-data/images/search-doc.png)

Figure 1. Search bar for this product documentation versus all IBM Cloud docs





 How does Watson Discovery access my data? 

Discovery has built-in connectors that can crawl various data sources, including websites, IBM Cloud Object Storage, Box, Microsoft SharePoint, and Salesforce sites. It even has support for you to build custom connectors. You can schedule crawls so that as the source data changes, the latest version is picked up by your collection automatically. Discovery only ever reads from external data sources; it never writes, updates, or deletes any content in the original data source. For more information, see [Creating collections](https://cloud.ibm.com/docs/discovery-data?topic=discovery-data-collections)





 Can I upload documents? 

Yes, you can upload documents directly to a collection in your project. An upload is a one-time operation that you can use to get started. An alternative approach is to connect to a data source and crawl the source for information. When you crawl data sources, the data can stay where it is and you can set up a schedule by which to crawl the external source to find new and changed information.
[Databases for etcd](https://cloud.ibm.com/docs/cloud-databases?topic=cloud-databases-cbr) IAM-enabled 
 [Databases for MongoDB](https://cloud.ibm.com/docs/cloud-databases?topic=cloud-databases-cbr) IAM-enabled 
 [Databases for MySQL](https://cloud.ibm.com/docs/cloud-databases?topic=cloud-databases-cbr) IAM-enabled 
 [Databases for PostgreSQL](https://cloud.ibm.com/docs/cloud-databases?topic=cloud-databases-cbr) IAM-enabled 
 [Databases for Redis](https://cloud.ibm.com/docs/cloud-databases?topic=cloud-databases-cbr) IAM-enabled 
 Direct Link IAM-enabled 
 [Event Notifications](https://cloud.ibm.com/docs/event-notifications?topic=event-notifications-en-access-control-cbr) IAM-enabled 
 [Event Streams](https://cloud.ibm.com/docs/EventStreams?topic=EventStreams-restrict_accessconfiguring_cbr) IAM-enabled 
 [Kubernetes Service](https://cloud.ibm.com/docs/containers?topic=containers-cbr&interface=ui) / [Red Hat OpenShift](https://cloud.ibm.com/docs/openshift?topic=openshift-cbr&interface=ui) IAM-enabled 
 [Messages for RabbitMQ](https://cloud.ibm.com/docs/cloud-databases?topic=cloud-databases-cbr) IAM-enabled 
 Secrets Manager IAM-enabled 
 [VPC Infrastructure Services](https://cloud.ibm.com/docs/vpc?topic=vpc-cbr&interface=clinetwork-zone) IAM-enabled
For example, you can enable the API by making changes in the Identify fields, Manage fields, CSV settings, or Processing settings (such as OCR or FAQ extraction settings) pages, or by applying a Smart Document Understanding model to the older collection.
* The API is available only from Plus and Enterprise plan instances.



For more information about the new API, see the [API reference documentation](https://cloud.ibm.com/apidocs/discovery-datalistdocuments).

More messages are shown to keep you informed about the status of document processing
: An issue was fixed which previously prevented informative messages from being displayed about the status of document conversion and indexing during the ingestion process. Now that the issue is fixed, you might see more messages than usual when you add or reprocess documents. This increase is expected. Nothing you did caused the increase in messages.





 6 April 2022 

Project tile has a more intuitive menu
: The project tile was updated to include an overflow menu that you can use to perform actions such as deleting or renaming a project.





 30 March 2022 

A new document classifier API is available
: Use the new document classifier to programmatically get, add, update, or delete a document classifier. Document classifier methods are supported on installed intances (IBM Cloud Pak for Data) or IBM Cloud-managed Premium or Enterprise plan instances.

For more information about the new API, see the [API reference documentation](https://cloud.ibm.com/apidocs/discovery-datalistdocumentclassifiers). For more information about adding a document classifier by using the product user interface, see [Classifying documents](https://cloud.ibm.com/docs/discovery-data?topic=discovery-data-cm-doc-classifier).





 21 March 2022 

Visualize enrichments found in your documents
: When you click to view the passage from a search result, a document preview page is displayed that shows a representation of the original document where the search result was found. For most document types, you can open a new advanced view of the document to see useful summary information, such as the number of occurrences of any enrichments that are detected in the document.
: Option to enrich your documents with pre-built domain knowledge for Contracts. For more information, see [Document Retrieval for Contracts](https://cloud.ibm.com/docs/discovery-data?topic=discovery-data-projectsdoc-retrieval-contracts).

New reusable components
: Use reusable components to quickly build your application with Discovery. We ship an autocomplete, rich preview, results and facets component. For more information, see [Building and deploying components](https://cloud.ibm.com/docs/discovery-data?topic=discovery-data-deploy).

New Czech, Polish, Romanian, Russian, and Slovak language support
: Basic support for Czech, Slovak, Russian, Polish and Romanian is added. For more information, see [Language support](https://cloud.ibm.com/docs/discovery-data?topic=discovery-data-language-support).

New built-in table understanding
: Extract tables from your documents without training, and optionally return tables as answers to natural language queries. For more information, see [Understanding tables](https://cloud.ibm.com/docs/discovery-data?topic=discovery-data-understanding_tables).

New SDK connector
: Build custom connectors your Discovery users can use to build their own applications. For more information, see [Building and implementing a custom connector](https://cloud.ibm.com/docs/discovery-data?topic=discovery-data-build-connector).

New pre-built sample project
: The sample project is preloaded with data, so you can learn about Discovery. For more information, see [Getting started with Watson Discovery](https://cloud.ibm.com/docs/discovery-data?topic=discovery-data-getting-started).

New passage retrieval
: Will return the most relevant passages from your documents, plus you can specify the number of passages returned per document. See [Passages](https://cloud.ibm.com/docs/discovery-data?topic=discovery-data-query-parameterspassages).

New project-level querying and relevancy training