vania-janet/multiturn-rag-retrieval-data huggingface dataset:
Any IBM Cloud Activity Tracker or audit log events generated come from the context-based restrictions service, not Cloud Databases. Cloud Databases supports audit events only for customer interactions with context-based restrictions-protected platform endpoint calls. Cloud Databases does not support audit events when you enable context-based restrictions rules on the control plane API for your instances. For more information, see [Monitoring context-based restrictions](https://cloud.ibm.com/docs/account?topic=account-cbr-monitor).

To start protecting your Cloud Databases resources with context-based restrictions, see the tutorial for [Leveraging context-based restrictions to secure your resources](https://cloud.ibm.com/docs/account?topic=account-context-restrictions-tutorial).



 How Cloud Databases integrates with context-based restrictions 

You can create context-based restrictions for the Cloud Databases service, specific resources, and specific APIs.



 Protecting Cloud Databases resources 

You can create context-based restrictions rules to protect specific regions, resource groups, and instances.

Region
: Protects Cloud Databases resources in a specific region. If you include a region in your context-based restrictions rule, resources in the network zones that you associate with the rule can interact with resources only in that region. If you use the CLI, you can specify the --region option to protect resources in a specific region. If you use the UI, you can specify Region in the resource attributes.

Resource groups
: Protects a specific resource group. If you include a resource group in your context-based restrictions rule, resources in the network zones that you associate with the rule can interact only with resources in that resource group. Scoping a rule to a specific resource group is available only for rules that protect the cluster API type. If you use the CLI, you can specify the --resource-group-id option to protect resources in a specific resource group. If you use the UI, you can specify the Resource group in the resource attributes.

Instance
: Protects a specific instance. If you include an instance in your context-based restrictions rule, resources in the network zones that you associate with the rule can interact only with resources in that instance.
List collection fields [GET /v1/environments/{environment_id}/collections/{collection_id}/fields](https://cloud.ibm.com/apidocs/discoverylistcollectionfields) <br>v1 lists the fields per collection. [GET /v2/projects/{project_id}/fields](https://cloud.ibm.com/apidocs/discovery-datalistfields) <br>v2 lists fields per project instead. You can pass a single collection ID with the collection_ids parameter to get fields from a single collection. 





 Collections API notes 

The following table shows the important differences between the v1 and v2 collection APIs.



Collections API notes

 Method Notes 

 Create a collection The v2 response doesn't include the status and configuration_id fields. You can get status information for a specific document by using the [Get document details](https://cloud.ibm.com/apidocs/discovery-datagetdocument) method. <br>The objects disk_usage, training_status, and crawl_status are not present in the response body in v2. The document_counts object is not present in the response body in v2 currently. Training status is returned in the [Get project](https://cloud.ibm.com/apidocs/discovery-datagetproject) method response. The other information is not available in v2. In v2, you can define the enrichments to apply to the documents in the collection by specifying an optional enrichments object. 
 Get collection details The v2 response doesn't include the status and configuration_id fields. You can get status information for a specific document by using the [Get document details](https://cloud.ibm.com/apidocs/discovery-datagetdocument) method. <br>The objects document_counts, disk_usage, training_status, and crawl_status are not present in the response body in v2. Training status is returned in the Get project method response. The other information is not available in v2.
IBM Cloud completes annual PCI DSS assessments by using an approved Qualified Security Assessor (QSA), and the resulting Attestations of Compliance (AOCs) and Service Responsibility Matrix (SRM) guides are available upon customer request. Auditors reviewed Databases for Redis for compliance under PCI DSS version 3.2.1 at Service Provider Level 1.

Customers are responsible for the storing, processing, and transmission of their cardholder data, and can create cardholder data environments (CDEs) that can store, transmit, or process cardholder data by using Databases for Redis. Customers can request and use the IBM Cloud AOCs and SRM guides when they seek their own PCI DSS certifications. It is the responsibility of the customer to document and operate CDEs and applications that are built by using IBM Cloud Platform services in a PCI DSS-compliant manner.

It is the customer’s responsibility to familiarize themselves with these processes and to manage data retention and removal from the service according to the customer’s policies.

A full list of PCI DSS-ready IBM Cloud Platform services, and options to request a PCI DSS AOC and SRM guide, can be found at the [IBM Cloud compliance page](https://www.ibm.com/cloud/compliance/industry).





 Terms 



* [The IBM Privacy Policy](https://www.ibm.com/privacy/us/en/)
* [The IBM Cloud Notices and Terms of Use](https://cloud.ibm.com/docs/overview/terms-of-use/notices.htmlnotices)
If you want to retain information about the relationship of two or more documents to one another, you can do so. For example, if 3 documents are uploaded from the same folder and their placement in the folder is significant to their meaning, you might want to retain the parent folder information.

When you upload a document, no such information about its relationships to other documents is stored by default. To add the information, you can use the API to add the documents. When you add documents by using the API, you can specify metadata values. You might want to specify a metadata value, such as "foldername": "company_a", for each document.

Alternatively, you can copy the document body of each document into a JSON file, where each document is an object in a single array. When the JSON file is ingested, each item in the array is added as a separate document with a seprarate document ID. Each document shares the same parent ID, which identifies the relationship between them.

You can quickly find documents that share the same parent ID or other common metadata value from the Manage data page. Customize the view to show the field, such as extracted_metadata.parent_document_id or extracted_metadata.foldername, that the documents share in common.





 Can I customize Discovery to understand my data 

Yes. Use the intuitive tools provided with the product to teach Discovery about the unique terminology of your domain. For example, you can teach it to recognize patterns, such as BOM or part numbers that you use, or add dictionaries that recognize your product names and other industry-specific word meanings. For more information, see [Adding domain-specific resources](https://cloud.ibm.com/docs/discovery-data?topic=discovery-data-domain).





 How does the Smart Document Understanding tool work? 

You can use the Smart Document Understanding tool to teach Discovery about sections in your documents with distinct format and structure that you want Discovery to index. You can define a new field, and then annotate documents to train Discovery to understand what type of information is typically stored in the field.
If an unhealthy IP address is detected, traffic is not routed to this IP address anymore.







 What if I want to load balance workloads on the private network? 

IBM Cloud does not offer a global load balancer service on the private network. However, you can connect your cluster to a private load balancer that you host in your on-prem network by using one of the [supported VPN options](https://cloud.ibm.com/docs/openshift?topic=openshift-vpn). Make sure to expose your apps on the private network by using [Ingress](https://cloud.ibm.com/docs/openshift?topic=openshift-ingress-about-roks4), [routers](https://cloud.ibm.com/docs/openshift?topic=openshift-openshift_routes), or [Network Load Balancers (NLBs)](https://cloud.ibm.com/docs/openshift?topic=openshift-loadbalancer-about), and use the private IP address in your VPN settings to connect your app to your on-prem network.
15c3-5 In November 2011, the SEC implemented the final provision of Rule 15c3-5 curbing unfiltered market access. The provision mandated that brokers verify their clients’ order flow for compliance with credit and capital thresholds before routing to market centers

Again, the answer is accurate (despite there being some extraneous text at the beginning of the passage).

In both examples, a somewhat complex question is asked and the passage that is returned provides a valid answer.

However, not every question returns as clear an answer. Next, we try some queries that generate answers we might want to improve.
4. Enter Where do muni bond trades get reported to?

In this case, the response does not answer the question completely.

Post-trade transparency, in the form of transaction reports, generally is available for corporate and municipal bonds. 1. Transaction Reports in Corporate Bonds: TRACE Transactions in corporate bonds must be reported to the Trade Reporting
5. Similarly, the search query, What are PTFs?, does not return a direct answer.

Despite the surge in trading volume during the event window, there was no noticeable change in net positions of PTFs or bank-dealers. However, the report also finds evidence that some PTFs and bank-dealers may have contributed to the volatility



Your project is answering some of the questions successfully. Only one passage is being returned for each query. Let's see whether we can improve the responses that are given to these simpler search queries.





 Step 5: Create a user-trained Smart Document Understanding (SDU) model 

To improve the quality of the search results, build a Smart Document Understanding model for this document. The model helps Discovery understand the document structure. You can then instruct Discovery about which sections of the document to search and which sections to ignore.



1. From the Improvement tools panel of the Improve and customize page, expand Define structure, and then click New fields.

Zoom

![Shows the New fields tool in the Improvement tools panel.]
How do I get support for running the IBM Blockchain Platform Ansible playbook? 

Ansible is an open source technology and this product is not officially supported by IBM. For support related to the usage of the IBM Blockchain Platform and Ansible playbooks use the [GitHub repository](https://github.com/IBM-Blockchain/ansible-collection/issues).





 Can the IBM Blockchain Platform monitor the health of a client application? 

The IBM Blockchain Platform console does not monitor the health of blockchain client applications, but IBM Cloud does offer tooling such as [IBM Log Analysis](https://cloud.ibm.com/catalog/services/ibm-log-analysis) and [IBM Cloud Monitoring](https://cloud.ibm.com/catalog/services/ibm-cloud-monitoring) that can be used for their health monitoring.





 Where does IBM store the customer's logs and how long does IBM keep the audit logs for the blockchain platform service? 

The logs are stored in the customer's Kubernetes cluster. IBM does not have access to the logs and it is up to the customer to manage all of their log data including retention management.





 Do we have access to logging services and what logs are available to me? 

With IBM Blockchain Platform, you can now directly access logs from your Kubernetes dashboard. It is recommend that you take advantage of the IBM Log Analysis service that allows you to easily parse the logs in real time.





 Where can I see the price breakdown for IBM Cloud Kubernetes Service, Storage, and Blockchain in my monthly invoice? 

Actual cost breakdowns are visible from your Invoices in the IBM Cloud Dashboard. For detailed steps, see the [Billing](https://cloud.ibm.com/docs/blockchain?topic=blockchain-ibp-saas-pricingibp-saas-pricing-billing) section in the Pricing topic.





 Is there a best practice for monitoring my blockchain resources? 

You are responsible for the health monitoring and resource allocation of the blockchain nodes in your Kubernetes cluster.
Versions 2.1.3 and 2.5.x of the IBM Blockchain Platform can be used with the Ansible collection to deploy a Hyperledger Fabric network.
* How do I get support for running the IBM Blockchain Platform Ansible playbook?

Ansible is an open source technology and this product is not officially supported by IBM. For support related to the usage of the IBM Blockchain Platform and Ansible playbooks use the [GitHub repository](https://github.com/IBM-Blockchain/ansible-collection/issues).
* How can I find the examples and tutorials within the VSCode extension?

The IBM Blockchain Platform extension provides guided tutorials within VS Code to help you get started. You can find these tutorials on the extension home page when the extension is first installed. However, you can return to the tutorials and the home page by going to the extensions tab. For more information, see [Guided tutorials in VS Code](https://cloud.ibm.com/docs/blockchain?topic=blockchain-develop-vscodedevelop-vscode-guided-tutorials).
* Can the IBM Blockchain Platform monitor the health of a client application?

The IBM Blockchain Platform console does not monitor the health of blockchain client applications, but IBM Cloud does offer tooling such as [IBM Log Analysis](https://cloud.ibm.com/catalog/services/ibm-log-analysis) and [IBM Cloud Monitoring](https://cloud.ibm.com/catalog/services/ibm-cloud-monitoring) that can be used for their health monitoring.
* Where does IBM store the customer's logs and how long does IBM keep the audit logs for the blockchain platform service?

The logs are stored in the customer's Kubernetes cluster. IBM does not have access to the logs and it is up to the customer to manage all of their log data including retention management.
* Do we have access to logging services and what logs are available to me?

With IBM Blockchain Platform, you can now directly access logs from your Kubernetes dashboard.
The following changes were made in build 8349:

IAM trusted profiles
: Fix bug in IAM trusted profiles.

Runtime environment
: Upgrade runtime environment to Erlang/OTP 24.







 November 2022 



 17 November 2022 

The following changes were made in build 8341:

_bulk_get endpoint
: Optimize _bulk_get endpoint.

_changes endpoint
: Fix eventsource formatted feed.
: Remove support for the long-deprecated change sequence format.

dbcopy
: Prevent further use of dbcopy feature for all but current users.

Compaction
: Fix smoosh get_priority/2 case clause.

Replication
: Use the _bulk_get endpoint for replication if available.
: Return a string for the default start sequence from _scheduler/{jobs,docs} endpoints.

_session endpoint
: Return error when POSTing to /_session with content type other than application/x-www-form-urlencoded or application/json.

Runtime environment
: Upgrade runtime environment to Erlang/OTP 23 patch release.







 September 2022 



 21 September 2022 

The following changes were made in build 8336:

Runtime environment
: Upgrade runtime environment to Erlang/OTP 23 patch release.

View collation
: Upgrade view collator to libicu 67.1.







 August 2022 



 5 August 2022 

The following changes were made in build 8335:

Bulk docs
: Improve performance for _bulk_docs endpoint.

Compaction
: Fix bugs in automatic compaction.
: Fix race between database deletion and compaction.

Document updates
: Improve reliability of document updates during heavy load.
: Return a 400 response for new_edits=false document update without revisions.

Replicator
: Introduce numerous performance improvements.







 June 2022 



 10 June 2022 

The following changes were made in build 8310:

All databases
: Fix skip and limit parameters for _all_dbs and _dbs_info endpoints.

Attachments
* Now, you're ready to release the code that depends on the second view.
* Delete _design/fetchv1 when we're sure it's no longer needed.



Using versioned design documents is a simple way to manage change control in your design documents, but you must remember to remove the older versions later.





 Move and switch design documents 

Another approach relies on the fact that IBM Cloudant recognizes when it has two identical design documents, and doesn't waste time and resources to rebuild views that it already has. In other words, if you take your design document _design/fetch and create an exact duplicate _design/fetch_OLD, then both endpoints would work interchangeably without triggering any reindexing.

To switch to the new view, follow these steps:



1. Create a duplicate copy of the design document that you want to change, for example by adding _OLD to its name: _design/fetch_OLD.
2. Put the new or "incoming" design document into the database by using a name with the suffix _NEW: _design/fetch_NEW.
3. Query the fetch_NEW view to ensure that it starts to build.
4. Poll the _active_tasks endpoint and wait until the index is finished building.
5. Put a duplicate copy of the new design document into _design/fetch.
6. Delete design document _design/fetch_NEW.
7. Delete design document _design/fetch_OLD.









 Move and switch tooling 

The command-line, Node.js, couchmigrate script automates the Move and switch procedure. It can be installed by using the following command:

npm install -g couchmigrate

To use the couchmigrate script, first define the URL of the CouchDB/IBM Cloudant instance by setting an environment variable called COUCH_URL. Run the following command to define the URL for the IBM Cloudant instance:

export COUCH_URL=https://127.0.0.1:5984

The URL must start with https:// and can include authentication credentials. Run the following command to define the URL of the IBM Cloudant instance with authentication credentials:
The IBM Cloudant team does not make back ups of your databases; this task is the responsibility of the customer. You must ensure that all copies of your database are removed from your system. For more information, see [IBM Cloudant backup and recovery](https://cloud.ibm.com/docs/Cloudant?topic=Cloudant-ibm-cloudant-backup-and-recoveryibm-cloudant-backup-and-recovery).

If you need more help, go to the [IBM Cloud Support portal](https://www.ibm.com/cloud/support).
Versions 2.1.3 and 2.5.x of the IBM Blockchain Platform can be used with the Ansible collection to deploy a Hyperledger Fabric network.
* How do I get support for running the IBM Blockchain Platform Ansible playbook?

Ansible is an open source technology and this product is not officially supported by IBM. For support related to the usage of the IBM Blockchain Platform and Ansible playbooks use the [GitHub repository](https://github.com/IBM-Blockchain/ansible-collection/issues).
* Can the IBM Blockchain Platform monitor the health of a client application?

The IBM Blockchain Platform console does not monitor the health of blockchain client applications, but IBM Cloud does offer tooling such as [IBM Log Analysis](https://cloud.ibm.com/catalog/services/ibm-log-analysis) and [IBM Cloud Monitoring](https://cloud.ibm.com/catalog/services/ibm-cloud-monitoring) that can be used for their health monitoring.
* Where does IBM store the customer's logs and how long does IBM keep the audit logs for the blockchain platform service?

The logs are stored in the customer's Kubernetes cluster. IBM does not have access to the logs and it is up to the customer to manage all of their log data including retention management.
* Do we have access to logging services and what logs are available to me?

With IBM Blockchain Platform, you can now directly access logs from your Kubernetes dashboard. It is recommend that you take advantage of the IBM Log Analysis service that allows you to easily parse the logs in real time.
* Is there a best practice for monitoring my blockchain resources?

You are responsible for the health monitoring and resource allocation of the blockchain nodes in your Kubernetes cluster. While requests against the nodes are being actively processed, you should be monitoring for spikes in resource consumption to avoid problems. IBM recommends that you configure IBM Cloud Monitoring and set up alerts to track when blockchain nodes are reaching their limits.
Kubernetes security bulletins that affect IBM Cloud Kubernetes Service users or the IBM Cloud platform are published in the [IBM Cloud security bulletin](https://cloud.ibm.com/status?component=containers-kubernetes&selected=security).

Some CVEs require the latest patch update for a version that you can install as part of the regular [cluster update process](https://cloud.ibm.com/docs/containers?topic=containers-updateupdate) in IBM Cloud Kubernetes Service. Make sure to apply security patches in time to protect your cluster from malicious attacks. For more information about what is included in a security patch, refer to the [version change log](https://cloud.ibm.com/docs/containers?topic=containers-cs_versionscs_versions_available).
* Does the service offer support for bare metal and GPU?

Certain VPC worker node flavors offer GPU support. For more information, see the [VPC flavors](https://cloud.ibm.com/docs/containers?topic=containers-vpc-flavors).

Yes, you can provision your worker node as a single-tenant physical bare metal server. Bare metal servers come with high-performance benefits for workloads such as data, GPU, and AI. Additionally, all the hardware resources are dedicated to your workloads, so you don't have to worry about "noisy neighbors".

For more information about available bare metal flavors and how bare metal is different from virtual machines, see [Physical machines (bare metal)](https://cloud.ibm.com/docs/containers?topic=containers-planning_worker_nodesbm).
* What is the smallest size cluster that I can make?

Your cluster must have at least 1 worker node to run default Kubernetes components. You can't have a cluster with 0 worker nodes, and you can't power off or suspend billing for your worker nodes. Additionally, the type of cluster and the number of worker pools that you have can impact the size of your cluster.