vania-janet/multiturn-rag-retrieval-data huggingface dataset:
: Data Engine supports index management, also referred to as data skipping. Index management can significantly boost performance and reduce cost of your SQL queries by skipping over irrelevant data.
: Service access role Manager is required to run catalog management or index management commands.

Catalog management
: Data Engine database catalog support is extended to support [views](https://cloud.ibm.com/docs/sql-query?topic=sql-query-sql-referencechapterCreateView).
: Data Engine catalog management is out of the Beta stage and can be used with the Standard plan.





 April 2020 

Database catalog
: Data Engine support for [database catalog](https://cloud.ibm.com/docs/services/sql-query?topic=sql-query-hivemetastore) is generally available with full production support. The database catalog is based on Hive Metastore and significantly speeds up query execution and decouples data management from SQL users and applications.





 January 2020 

Support for all endpoints
: Data Engine fully supports all current public and private IBM Cloud® Object Storage endpoints (ending with appdomain.cloud, for example, s3.us.cloud-object-storage.appdomain.cloud) and all new single data center endpoints (for example, sng01).





 December 2019 

Key Protect
: You can use [Key Protect](https://cloud.ibm.com/catalog/services/key-protect) as a secure credential broker to pass credentials to data resources referenced by your queries, thus ensuring safe handling of your secrets. For more information, see the [authentication documentation](https://cloud.ibm.com/docs/sql-query?topic=sql-query-authentication).





 November 2019 

MULTILINE option
: You can specify a [MULTILINE](https://cloud.ibm.com/docs/sql-query?topic=sql-query-sql-referenceexternalTableSpec) option for JSON input data if individual JSON records are stored across multiple lines.





 October 2019 

New open source script for uploading large volumes
"log_server" : {
"type" : "ibm-log-analysis"
},
"enable" : true
}









 Schema examples 

The following schema example represents the data required to specify command option. These example model the data structure and include placeholder values for the expected value type. When you run a command, replace these values with the values that apply to your environment as appropriate.



 Runtime 

The following example shows the format of the Runtime object.

{
"spark_version" : "3.3"
}
Asia-Pacific OSA22 01 Cascade Lake, SAP-certified Cascade Lake Cascade Lake, SAP-certified Cascade Lake 
 Asia-Pacific OSA23 01 Cascade Lake, SAP-certified Cascade Lake Cascade Lake, SAP-certified Cascade Lake 
 Asia-Pacific SNG01 02 Skylake, Cascade Lake, SAP-certified Cascade Lake Skylake, Cascade Lake, SAP-certified Cascade Lake 
 Asia-Pacific SYD01 01-02 Skylake, Cascade Lake, SAP-certified Skylake, Cascade Lake, SAP-certified Cascade Lake 
 Asia-Pacific SYD04 01 Skylake, Cascade Lake, SAP-certified Cascade Lake Skylake, Cascade Lake, SAP-certified Cascade Lake 
 Asia-Pacific SYD05 01 Skylake, Cascade Lake, SAP-certified Cascade Lake Skylake, Cascade Lake, SAP-certified Cascade Lake 
 Asia-Pacific TOK02 01-02 Skylake, Cascade Lake, SAP-certified Cascade Lake Skylake, Cascade Lake, SAP-certified Cascade Lake 
 Asia-Pacific TOK04 01 Skylake, Cascade Lake, SAP-certified Cascade Lake Skylake, Cascade Lake, SAP-certified Cascade Lake 
 Asia-Pacific TOK05 01 Skylake, Cascade Lake, SAP-certified Cascade Lake Skylake, Cascade Lake, SAP-certified Cascade Lake 







 Backup of management components 

You are responsible for maintaining and ensuring the availability of all instance components. It is recommended that you plan for backup or high availability of all management components. For more information, see [Backing up components](https://cloud.ibm.com/docs/vmwaresolutions?topic=vmwaresolutions-solution_backingup).





 Services for vCenter Server instances 

You can order services for your instance based on your needs, for example, disaster recovery. For more information, see [Ordering services for vCenter Server instances](https://cloud.ibm.com/docs/vmwaresolutions?topic=vmwaresolutions-vc_addingservices).

Add-on services support varies between vCenter Server with NSX-T™ and existing vCenter Server with NSX-V instances V4.7 and earlier.
(https://registry.terraform.io/providers/IBM-Cloud/ibm/latest/docs/data-sources/is_dedicated_host)<br> * [ibm_is_dedicated_host_disk](https://registry.terraform.io/providers/IBM-Cloud/ibm/latest/docs/data-sources/is_dedicated_host_disk)<br> * [ibm_is_dedicated_host_disks](https://registry.terraform.io/providers/IBM-Cloud/ibm/latest/docs/data-sources/is_dedicated_host_disks)<br> * [ibm_is_dedicated_host_group](https://registry.terraform.io/providers/IBM-Cloud/ibm/latest/docs/data-sources/is_dedicated_host_group)<br> * [ibm_is_dedicated_host_groups](https://registry.terraform.io/providers/IBM-Cloud/ibm/latest/docs/data-sources/is_dedicated_host_groups)<br> * [ibm_is_dedicated_host_profile](https://registry.terraform.io/providers/IBM-Cloud/ibm/latest/docs/data-sources/is_dedicated_host_profile)<br> * [ibm_is_dedicated_host_
Relation types (Version 2) 

The following table lists the relation types returned by the Version 2 relation type system. The relation type system that Natural Language Understanding uses differs based on which language you are using. For more details, see the [Relation type systems](https://cloud.ibm.com/docs/natural-language-understanding?topic=natural-language-understanding-relation-type-systems) page.

The entity types used by this relation type system are listed on the [Entity types (Version 2)](https://cloud.ibm.com/docs/natural-language-understanding?topic=natural-language-understanding-entity-types-version-2) page.



 Relation Description 

 affiliatedWith Exists between two entities that have an affiliation or are similarly connected. 
 basedIn Exists between an Organization and the place where it is mainly, only, or intrinsically located. 
 bornAt Exists between a Person and the place where they were born. 
 bornOn Exists between a Person and the Date or Time when they were born. 
 clientOf Exists between two entities when one is a direct business client of the other (that is, pays for certain services or products). 
 colleague Exists between two Persons who are part of the same Organization. 
 competitor Exists between two Organizations that are engaged in economic competition. 
 contactOf Relates contact information with an entity. 
 diedAt Exists between a Person and the place at which he, she, or it died. 
 diedOn Exists between a Person and the Date or Time on which he, she, or it died. 
 dissolvedOn Exists between an Organization or URL and the Date or Time when it was dissolved. 
 educatedAt Exists between a Person and the Organization at which he or she is or was educated. 
 employedBy Exists between two entities when one pays the other for certain work or services; monetary reward must be involved. In many circumstances, marking this relation requires world knowledge. 
 foundedOn Exists between an Organization or URL and the Date or Time on which it was founded. 
 founderOf Exists between a Person and a Facility, Organization, or URL that they founded. 
 locatedAt Exists between an entity and its location. 
 managerOf Exists between a Person and another entity such as a Person or Organization that he or she manages as his or her job.
BI.S4.H4.3000 (VMware) 112 224 3072 GB 257,373 OLAP/OLTP 
 BI.S4.H4.6000 (VMware) 112 224 6144 GB 257,373 OLAP/OLTP 
 BI.S4.H8.6000 (VMware) 224 448 6144 GB 495,603 OLAP/OLTP 







 Understanding Bare Metal profile names 

The Bare Metal profile names are contextual and sequential, below uses an SAP HANA certified server as an example:



Table 2. Profile naming for SAP HANA

 Profile name Naming convention component What it means 

 BI.S3.H8401 BI IBM Cloud) Infrastructure 
 S2 Series 2 (processor generation) \n<br><br><br><br> * S2 is Intel Broadwell<br> * S3 is Intel Skylake/Kaby Lake<br> * S4 is Intel Cascade Lake<br><br><br> 
 H HANA-certified server 
 8 8-socket server 
 4 4 TB RAM 
 01 Revision number (00 is launch, 01 is first revision, and so on) 
 A or B Available as appliances with preconfigured built-in disks (A) or as boot servers only (B)
The method by which a client is billed for cloud service usage. Examples include paying in advance, such as with subscriptions, and payment in arrears, as in Pay-As-You-Go accounts.





 billing unit 

The highest level billing entity within an enterprise. Each account or account group is linked to a billing unit, which manages all associated contracts, invoices, orders, and payments. A billing unit can contain one or more credit pools. See also [enterprise](https://cloud.ibm.com/docs/overview?topic=overview-glossaryx2026915), [credit pool](https://cloud.ibm.com/docs/overview?topic=overview-glossaryx9796950).





 bind 

To establish a connection between software components on a network using an agreed-to protocol. In web services, the bind operation occurs when the service requester invokes or initiates an interaction with the service at run time using the binding details in the service description to locate, contact, and invoke the service.





 blind data 

A set of documents annotated with the ground truth, such as question and answer pairs, semantic annotation, and passage judgment. Blind data is never released or seen by developers and is used to test the system periodically to evaluate performance on unseen data. See also [training data](https://cloud.ibm.com/docs/overview?topic=overview-glossaryx2860199), [testing data](https://cloud.ibm.com/docs/overview?topic=overview-glossaryx7736833).





 block 

A unit that contains ordered transactions in a blockchain network. Blocks are immutable and contain the cryptographic hash of the previous block to create a chain of blocks. This iterative process confirms the integrity of the previous block, all the way back to the initial block. See also [genesis block](https://cloud.ibm.com/docs/overview?topic=overview-glossaryx9076628).





 blocklist
[Immutable backup environment sandbox example](https://cloud.ibm.com/docs-content/v1/content/5bdb37c0149145723c5437e8176651928565e722/vmwaresolutions/images/veeam-cr-sa-sb-ire-detail.svg)

Figure 2. Immutable backup environment sandbox example



 Related links 



* [Tier-1 logical router](https://docs.vmware.com/en/VMware-NSX-T-Data-Center/3.1/administration/GUID-DAEF8457-8363-4F33-84DA-68AA36A2DE3C.html)
* [Network Address Translation (NAT)](https://docs.vmware.com/en/VMware-NSX-T-Data-Center/3.1/administration/GUID-7AD2C384-4303-4D6C-A44A-DEF45AA18A92.html)
* [Distributed firewall](https://docs.vmware.com/en/VMware-NSX-T-Data-Center/3.1/administration/GUID-6AB240DB-949C-4E95-A9A7-4AC6EF5E3036.html)
* [Tags](https://docs.vmware.com/en/VMware-NSX-T-Data-Center/3.1/administration/GUID-358DF469-75C8-48C4-B0E2-279E55C7BB3E.html)
* [Segments](https://docs.vmware.com/en/VMware-NSX-T-Data-Center/3.1/administration/GUID-316E5027-E588-455C-88AD-A7DA930A4F0B.html)
See also [host](https://cloud.ibm.com/docs/overview?topic=overview-glossaryx2002243), [Uniform Resource Locator](https://cloud.ibm.com/docs/overview?topic=overview-glossaryx2042491), [custom domain](https://cloud.ibm.com/docs/overview?topic=overview-glossaryx5728384), [domain](https://cloud.ibm.com/docs/overview?topic=overview-glossaryx2021210), [route](https://cloud.ibm.com/docs/overview?topic=overview-glossaryx2037338).





 subject 

The user, service ID, or access group that is granted access by an access policy.





 subnet 

See [subnetwork](https://cloud.ibm.com/docs/overview?topic=overview-glossaryx2040149).





 subnetwork (subnet) 

A network that is divided into smaller independent subgroups, which still are interconnected.





 subscription code 

A code used to apply credits to an account after a subscription is purchased.





 subtype 

A type that extends or implements another type; the supertype.





 surface form 

The form of a word or multiword unit as it is found in the corpus. For example, some surface forms of the lemma 'organize' are the terms 'organizing' and 'organized'. See also [lemma](https://cloud.ibm.com/docs/overview?topic=overview-glossaryx2763345), [dictionary](https://cloud.ibm.com/docs/overview?topic=overview-glossaryx2001532).





 system of engagement (SoE) 

An information technology (IT) system that incorporates technologies that encourage user interaction through email, collaboration systems, and networking. A system of engagement often uses cloud technologies to extend the usefulness of systems of record. See also [system of record](https://cloud.ibm.com/docs/overview?topic=overview-glossaryx6735061).
* A single vSAN datastore is created from all storage.



The available vSAN features depend on the license edition that you select when you order the instance. For more information, see [VMware vSAN edition comparison](https://cloud.ibm.com/docs/vmwaresolutions?topic=vmwaresolutions-solution-appendixsolution-appendix-vsan-editions).



 Virtual network setup for vSAN 

For this design, the vSAN traffic traverses between ESXi hosts on a dedicated private VLAN. The two network adapters attached to the private network switch are configured within vSphere as a vSphere Distributed Switch (vDS) with both network adapters as uplinks. A dedicated vSAN kernel port group that is configured for the vSAN VLAN resides within the vDS. Jumbo frames (MTU 9000) are enabled for the private vDS.

vSAN does not load balance traffic across uplinks. As a result, one adapter is active while the other is in standby to support high availability (HA). The network failover policy for vSAN is configured as Explicit Failover between physical network ports.

For more information about physical NIC connections, see [Physical host NIC connections](https://cloud.ibm.com/docs/vmwaresolutions?topic=vmwaresolutions-design_physicalinfrastructuredesign_physicalinfrastructure-host-connect).





 vSAN policy design 

When vSAN is enabled and configured, storage policies are configured to define the VM storage characteristics. Storage characteristics specify different levels of service for different VMs.

The default storage policy in this design tolerates a single failure. The default policy is configured with erasure coding, with Failure tolerance method set to RAID-5/6 (Erasure Coding) - Capacity and Primary level of failures set to 1. The RAID 5 configuration requires a minimum of four hosts.

Alternatively, you can choose the RAID 6 configuration with Failure tolerance method set to RAID-5/6 (Erasure Coding) - Capacity and Primary level of failures set to 2. The RAID 6 configuration requires a minimum of six hosts.
The column headers identify the options for fitering based on filter type.

 Option Description 

 AI / Machine Learning Products that enable systems to learn from data rather than through explicit programming. 
 Analytics Products that facilitate the analysis of data, typically large sets of business data, by the use of mathematics, statistics, and other means. 
 Blockchain Products that facilitate the process of recording transactions and tracking assets in a business network. 
 Compute Infrastructure resources that serve as the basis for building apps in the cloud. 
 Containers A standard unit of software that packages up code and all its dependencies so the app runs quickly and reliably from one computing environment to another. 
 Converged infrastructure A way of structuring an information technology (IT) system by grouping multiple components into a single optimized computing package, components of which may include servers; data storage devices; networking equipment; and software for IT infrastructure management, automation, and orchestration. 
 Databases Products that provide some form of access to a database without the need for setting up physical hardware, installing software, or configuring for performance. 
 Developer tools Products that support developing, testing, and debugging software. 
 Enterprise applications Bundle of compatible products that deliver enterprise-grade app solutions for information sharing, automation, and agility. 
 Integration Products that facilitate the connection of data, apps, APIs, and devices across an organization to be more efficient, productive, and agile. 
 Internet of Things Products that support receiving and transferring data over wireless networks without human intervention. 
 Logging and monitoring Products that support receiving and transferring data over wireless networks without human intervention. 
 Mobile Products with specific or special utility for users creatings things to be used on mobile devices. 
 Networking Products that support or augment the linking of computers so they can operate interactively. 
 Security Products that provide the protection of stored data from theft, leakage, and deletion. 
 Storage Products that support data to be created, read, updated, and deleted. 



You can also scope your view of the catalog by using the Provider filter to browse by individual providers, and the Location filter to view products available in specific regions.
* [Storage class reference for Compute Engine](https://cloud.ibm.com/docs/satellite?topic=satellite-storage-gcp-compute-persistent-disk-csi-driversat-storage-gcp-ref)
* [Getting help and support for Google Compute Engine](https://cloud.ibm.com/docs/satellite?topic=satellite-storage-gcp-compute-persistent-disk-csi-driversat-gcp-csi-support)







 IBM storage templates 

[IBM Systems Block Storage CSI driver](https://cloud.ibm.com/docs/satellite?topic=satellite-storage-ibm-system-storage-block-csi-driverstorage-ibm-system-storage-block-csi-driver)



* [Prerequisites for using Block Storage for Classic](https://cloud.ibm.com/docs/satellite?topic=satellite-storage-ibm-system-storage-block-csi-driversat-storage-block-csi-prereq)
* [Creating and assigning a configuration in the console](https://cloud.ibm.com/docs/satellite?topic=satellite-storage-ibm-system-storage-block-csi-driveribm-system-storage-block-csi-driver-config-create-console)
* [Creating a configuration in the CLI](https://cloud.ibm.com/docs/satellite?topic=satellite-storage-ibm-system-storage-block-csi-driveribm-system-storage-block-csi-driver-config-create-cli)
* [Creating a configuration in the API](https://cloud.ibm.com/docs/satellite?topic=satellite-storage-ibm-system-storage-block-csi-driveribm-system-storage-block-csi-driver-config-create-api)
* [Creating a storage assignment in the console](https://cloud.ibm.com/docs/satellite?topic=satellite-storage-ibm-system-storage-block-csi-driverstorage-ibm-system-storage-block-csi-driver-include-assignment-create-console)
General Data Protection Regulation (GDPR) 

The [General Data Protection Regulation](https://gdpr.eu/) seeks to create a harmonized data protection law framework across the European Union (EU) and aims to give citizens back the control of their personal data. The GDPR imposes strict rules on those hosting and processing personal data anywhere in the world. Additionally, this regulation introduces rules that relate to the free movement of personal data within and outside of the EU.

With the GDPR, IBM® Power Systems™ Virtual Server clients can rely on the Power Systems Virtual Server team's understanding and compliance with emerging data privacy standards and legislation. Power Systems Virtual Server clients can also rely in IBM's wider ability to provide a comprehensive suite of solutions to assist businesses of all sizes with their own internal data governance requirements.



  Online retention of client data 

Client data is retained during the client's use of the workspace (that is, until the client's contract termination or expiration) by default. Additionally, clients can define shorter retention periods for some of their data within the workspace to align with their own organizational retention policies. All client data is removed from the workspace 1 business day after the client's contract termination or expiration.





  Backup retention of client data 

Power Systems Virtual Server does not provide backups of client data.





  Destruction of client data 

Power Systems Virtual Server gives the client the ability to delete all online client data at their request or termination of the workspace. The secure destruction of all client data happens at the end of life of the associated infrastructure or cloud service.





  Export of client data 

IBM contractually commits, as required by various industry and government regulations, that we will provide clients the capability to export their data, or that IBM will provide the client with export copies of their data upon request. Power Systems Virtual Server gives clients the ability to export data on their own.
* Default origin pools: A list of pool IDs. The list is ordered by their failover priority. Pools defined here are used by default, or when region pools are not configured for a given region.



Optionally, you can configure the following fields:



* Proxy: Route traffic through IBM's performance and metrics service.
* Session Affinity: Always route through the same performance and metrics instance. This option is available only if proxy is enabled.
* TTL: Time-to-live (TTL) of the DNS entry for the IP address returned by this load balancer. This option applies only to unproxied load balancer; otherwise, it defaults to Automatic.
* Geo routes: A mapping of region or country codes to a list of pools (ordered by their failover priority) for the given region. Any regions not explicitly defined fall back to using the default pools.

IBM's geographic regions differ from Cloudflare's regions. For details about the geographic regions Cloudflare uses, see "Geo Steering" in [Traffic steering](https://developers.cloudflare.com/load-balancing/understand-basics/traffic-steering/geo-steering).







 Editing or deleting a global load balancer 

To edit or delete a load balancer, or one of its components, click the overflow menu ![overflow icon](https://cloud.ibm.com/docs-content/v1/content/cb1eb27836421578019401fa7556779109430b29/cis//images/horizontal-overflow-icon.png) located on the right of the row, and select the action you want to take from the list.
To select, collect, preserve, and maintain content relevant to a specific topic. Curation establishes, maintains, and adds value to data; it transforms data into trusted information and knowledge.





 custom domain 

The customized portion of the URL selected by the user to direct requests to the application. A custom domain makes up part of the route. A custom domain can be a shared domain, a shared subdomain, or a shared domain and host. See also [host](https://cloud.ibm.com/docs/overview?topic=overview-glossaryx2002243), [subdomain](https://cloud.ibm.com/docs/overview?topic=overview-glossaryx2040080), [Uniform Resource Locator](https://cloud.ibm.com/docs/overview?topic=overview-glossaryx2042491), [domain](https://cloud.ibm.com/docs/overview?topic=overview-glossaryx2021210), [route](https://cloud.ibm.com/docs/overview?topic=overview-glossaryx2037338).







 D 



 daemon 

A program that runs unattended to perform continuous or periodic functions, such as network control.





 dashboard 

A user interface component that provides a comprehensive summary of pertinent information from various sources to the user.





 data center (DC) 

The physical location of the servers that provide cloud services.





 data encryption key 

A cryptographic key used to encrypt data that is stored in an application.





 data store 

A place, such as a database system, file, or directory, where data is stored.





 DC 

See [data center](https://cloud.ibm.com/docs/overview?topic=overview-glossaryx2439906).





 dedicated cloud 

A private cloud computing environment that provides infrastructure with single-tenant hardware. See also [borderless](https://cloud.ibm.com/docs/overview?topic=overview-glossaryx8439189).





 deployable architecture