vania-janet/multiturn-rag-retrieval-data huggingface dataset:
: IBM Cloud® File Storage for VPC is now available for customers with special approval to preview this service in the Washington, Dallas, Frankfurt, London, Sydney, and Tokyo regions.
: For more information about this service, see [About File Storage for VPC](https://cloud.ibm.com/docs/vpc?topic=vpc-file-storage-vpc-about).





 09 December 2021 

Security updates
: The following stock images were refreshed with the most recent fixes and security updates.



* Debian version 10
* CentOS version 7
* RHEL versions 7, 8.2, and 8.4
* Ubuntu version 20.04



Windows stock image updates
: For all Windows® stock images, TLS 1.2 was enabled and all earlier versions were disabled.
: The following cloudbase-init configuration files were updated to add the value "ntp_use_dhcp_config=true":



* C:\Program Files\Cloudbase Solutions\Cloudbase-Init\conf\cloudbase-init.conf
* C:\Program Files\Cloudbase Solutions\Cloudbase-Init\conf\cloudbase-init-unattend.conf



New stock image for virtual servers
: Rocky Linux version 8.5 is now supported as a stock image when you provision IBM Cloud VPC virtual servers.







 November 2021 



 30 November 2021 

VPN client-to-site servers update (open beta)
: You can now update a VPN server after the VPN is provisioned. For example, you can upgrade a stand-alone VPN server (one subnet) to a High Availability (HA) VPN server (two subnets in different zones). You can also detach a subnet to downgrade an HA VPN server to a stand-alone deployment, or change an attached subnet after your VPN server is provisioned. For more information, see [Upgrading to an HA VPN server](https://cloud.ibm.com/docs/vpc?topic=vpc-vpn-client-to-site-change-server-types).





 16 November 2021
Cloud Databases CLI 

The Cloud Databases CLI plug-in offers extra methods of accessing the capabilities of the Cloud Databases services. You can use Cloud Databases CLI to manage and connect to



* IBM Cloud® Databases for PostgreSQL
* IBM Cloud® Databases for MySQL
* IBM Cloud® Databases for EnterpriseDB
* IBM Cloud® Databases for Redis
* IBM Cloud® Databases for Elasticsearch
* IBM Cloud® Databases for etcd
* IBM Cloud® Messages for RabbitMQ
* IBM Cloud® Databases for MongoDB



The Cloud Databases CLI plug-in requires IBM Cloud CLI to be installed.



 The IBM Cloud CLI 

The IBM Cloud CLI is a general-purpose developer tool that provides access to your IBM Cloud account and services through a command-line interface.

An introduction and installation instructions are available on the [IBM Cloud CLI Getting Started page](https://cloud.ibm.com/docs/cli?topic=cli-getting-started). If you install the CLI from the cURL command that is provided, you get a selection of extra plug-ins and extensions for multiple IDEs.

You can install just the stand-alone package from the [Installing the stand-alone IBM Cloud CLI](https://cloud.ibm.com/docs/cli?topic=cli-install-ibmcloud-cli) page.

Access to services via IBM Cloud CLI is governed through Identity and Access Management. In order to use the CLI to view or manage a service (or to grant privileges to another user on your account), you must set the correct permissions. For more information about IAM management, see the [IAM Getting Started tutorial](https://cloud.ibm.com/docs/account?topic=account-access-getstarted)





 Installing the Cloud Databases CLI plug-in 

Once you have the IBM Cloud CLI, [log in](https://cloud.ibm.com/docs/cli?topic=cli-ibmcloud_cliibmcloud_login) and install the Cloud Databases plug-in.

ibmcloud plugin install cloud-databases

You can use
GET /{db}/_security <br>[Cloudant](https://cloud.ibm.com/apidocs/cloudantgetsecurity), [CouchDB](https://docs.couchdb.org/en/latest/api/database/security.htmlget--db-_security) Retrieve the current security object from the specified database. 
 PUT /{db}/_security <br>[Cloudant](https://cloud.ibm.com/apidocs/cloudantputsecurity), [CouchDB](https://docs.couchdb.org/en/latest/api/database/security.htmlput--db-_security) Set the security object for the specific database. 
 GET /{db}/_shards <br>[Cloudant](https://cloud.ibm.com/apidocs/cloudantgetshardsinformation), [CouchDB](https://docs.couchdb.org/en/latest/api/database/shard.htmlget--db-_shards) Retrieve information about the shards in the cluster. 
 POST /{db}/_view_cleanup <br>[CouchDB](https://docs.couchdb.org/en/latest/api/database/compact.htmlpost--db-_view_cleanup) Remove view index files that are no longer required because of changed views within design documents. 
 HEAD /{db}/{docid} <br>[Cloudant](https://cloud.ibm.com/apidocs/cloudantheaddocument), [CouchDB](https://docs.couchdb.org/en/latest/api/document/common.htmldb-doc) Retrieve the HTTP headers that contain a minimal amount of information about the specified document. 
 GET /{db}/{docid} <br>[Cloudant](https://cloud.ibm.com/apidocs/cloudantgetdocument), [CouchDB](https://docs.couchdb.org/en/latest/api/document/common.htmlget--db-docid) Retrieve the document specified by the docid from the specified database.
December 2020 

Supported regions
: Data Engine is available in Chennai, India. When you provision new instances, you can select whether it is being provisioned in Dallas, Frankfurt, or Chennai.

IBM Cloud Object Storage
: IBM Cloud Object Storage web console discovers SQL-queryable objects and folders and directly starts the Data Engine web console with a prefilled SQL statement for seamless interactive data exploration.





 November 2020 

Modify location of Hive partitions
: The location of Hive partitions can be modified by using the [ALTER TABLE SET LOCATION](https://cloud.ibm.com/docs/sql-query?topic=sql-query-sql-referencechapterAlterTableSetLocation) feature.





 October 2020 

Index management
: Data Engine index management, also referred to as data skipping is generally available with full production support.

New samples category Reference data statement
: IBM Cloud® Data Engine comes with open data out of the box, including geolocation, and demographic data that can be used as reference data to combine with your own data sets. It is based on open data from US Census, Eurostat Census, UNdata, OpenStreetMap, and Natural Earth. Explore it by using the new category Reference data statements in SAMPLES.

Time series functions
: Data Engine time series functions: The anchor functions are deprecated and replaced by the new and more powerful expression creation functions.

Python SDK
: The [ibmcloudsql](https://pypi.org/project/ibmcloudsql) Python SDK significantly expanded in functionality for even more powerful Python analytics with SQL. Take a tour of the functions in the [Data Engine Starter Notebook](https://dataplatform.cloud.ibm.com/exchange/public/entry/view/e82c765fd1165439caccfc4ce8579a25?context=cpdaas). The Python SDK also comes with a dedicated [online documentation](https://ibm-cloud.github.io/sql-query-clients/intro.htmlibmcloudsql).

Usage of legacy SoftLayer endpoints discontinued
* Select language - Choose the language of the websites from the list of supported languages. For the list of languages that Discovery supports, see [Language support](https://cloud.ibm.com/docs/discovery?topic=discovery-language-support). You should create a separate collection for each language.
* URL group to sync - Enter your URL and click the Add button to add it to the URL group. To specify the Crawl settings for this URL group, click the ![Cog](https://cloud.ibm.com/docs-content/v1/content/ded4adc3ea0bd2a81b113c579f2b1183926da211/discovery/images/icon_settings.png) icon. You can set the Maximum hops, which is the number of consecutive links to follow from the starting URL (the starting URL is 0). The default number of hops is 2 and the maximum is 20. If you are using the API, the maximum is 1000. You can specify URL paths to exclude from the crawl in the Exclude URLs where the path includes field. Separate the paths, using commas, for example, if you specified the URL http://domain.com, you could exclude http://domain.com/licenses and http://domain.com/pricing by entering /licenses/, /pricing/.



FAQ extraction was available as a beta feature that was supported only with web crawl connectors built for use from a Search skill in Watson Assistant. The beta feature is deprecated. FAQ extraction will stop being supported in v1 Discovery service instances on 1 March 2022.

When you specify a URL to crawl, the final / determines the subtree to crawl. For example, if you enter the URL https://www.example.com/banking/faqs.html, all URLs that begin with https://www.example.com/banking/ are crawled, and the input of https://www.example.com/banking crawls all URLs that begin with https://www.example.com/.
[Learn more about the CLI](https://cloud.ibm.com/docs/log-analysis?topic=logdna-cli-plugin-logdna-cli).

New API support
: New API added that can be used to export data from an instance, and manage views and alerts. [Learn more about the API](https://cloud.ibm.com/apidocs/logdna?code=pythonintroduction).





 31 January 2021 

Changes to archiving frequency
: Hourly archiving in Chennai, Tokyo, Sydney, Seoul, London, Washington instead of daily archiving. [Learn more](https://cloud.ibm.com/docs/log-analysis?topic=log-analysis-archiving).





 31 December 2020 

Addition of configuration support using an API
: Configuration support using an API, in addition to configuration using the web UI.

Terraform support
: Support for Terraform to programmatically manage IBM® Log Analysis instances and agents and automate their deployment.





 9 July 2020 

HIPPA service plans available
: Added support for 30-day search plans for HIPAA workloads.





 19 July 2019 

Enhanced data residency, compliance, and security
: The following support is now available:



* Services are available in London and Tokyo.
* Services in Frankfurt are now available as EU-Managed.
* Cloud Service endpoint support is available in all regions.







 27 November 2018 

Introducing IBM Log Analysis
: You can use IBM Log Analysis to manage system and application logs in the IBM Cloud. IBM Log Analysis offers administrators, DevOps teams, and developers advanced features to filter, search, and tail log data, define alerts, and design custom views to monitor application and system logs. [Learn more](https://cloud.ibm.com/docs/log-analysis?topic=log-analysis-getting-startedgetting-started)
Version 2 entity support for Korean and Spanish
: Version 2 entity type support is now available, for all public and premium service instances, for the following languages: Korean and Spanish. For details, see [Entity type systems](https://cloud.ibm.com/docs/natural-language-understanding?topic=natural-language-understanding-entity-type-systems).







 November 2020 



 12 November 2020 

Entity support for Arabic, Chinese (Simplified), and Dutch
: Support for entities is now available, for all public and premium service instances, for the following languages: Arabic, Chinese (Simplified) and Dutch. For details, see [Language support](https://cloud.ibm.com/docs/natural-language-understanding?topic=natural-language-understanding-language-support).
: Relevance ranking is not supported.





 4 November 2020 

Keyword support for additional languages
: Support for keywords is now available, for all public and premium service instances, for the following languages: Czech, Danish, Finnish, Hebrew, Norwegian, Norwegian-Bokmal, Norwegian-Nynorsk, Polish, and Slovak. For details, see [Language support](https://cloud.ibm.com/docs/natural-language-understanding?topic=natural-language-understanding-language-support).

Improved keyword support for Russian and Swedish
: The code that is used for keyword support for Russian and Swedish has been improved, so different, higher quality results are expected.







 September 2020 



 25 September 2020 

version parameter deprecated
: The version form parameter for model objects in the [API definition](https://cloud.ibm.com/apidocs/natural-language-understandingcreateadvancedrulesmodel) has been deprecated; use the model_version parameter instead. The model_version parameter will override version whenever there is a conflict until April 9, 2021.





 3 September 2020 

Summarization
: [Summarization (Experimental)](https://cloud.ibm.com/docs/natural-language-understanding?topic=natural-language-understanding-aboutsummarization) returns a summary of input source content. Summarization is currently available for English only.
For support for these products, go to [IBM Support](https://www.ibm.com/support/home/).

Support for third-party services is provided by the service provider.





 Does IBM Cloud provide support for resources available through the IBM SkillsBuild Software Downloads? 

The [IBM SkillsBuild Software Downloads](https://www.ibm.com/academic/home) is an IBM corporate program that provides access to the IBM Cloud Platform for faculty, students, and researchers at accredited academic institutions. Acceptance decisions, length of participation, awarding of credits, and any possible extensions are made by the IBM SkillsBuild Software Downloads Team and not IBM Cloud Support. IBM Cloud Support also does not provide technical support for accounts that are part of the IBM SkillsBuild Software Downloads Program. For more information about the program, see the [IBM SkillsBuild Software Downloads FAQ](https://www.ibm.com/academic/faqs/faqs).





 How do I ensure that users in my account get updates for a support case? 

As the account owner or as an administrator or editor on the Support Center service, you can add users in the account to the watchlist. Users on the watchlist can view and follow the support case's progress. For more information, see [Updating your support case's watchlist](https://cloud.ibm.com/docs/get-support?topic=get-support-contact-watchlist).





 Can I find support cases that are created by specific users? 

You can download a list of created support cases and view the cases that are created by each user.

To download a list of created support cases, use the following steps:



1. From the IBM Cloud console menu bar, click the Help icon ![Help icon](https://cloud.ibm.com/docs-content/v1/content/9147bc2ffd9bafd03e4559b378e714fac17a4977/icons/help.svg) > Support center.
2. Click View all from the Recent support cases tile.
3.
[Example query structure](https://cloud.ibm.com/docs-content/v1/content/ded4adc3ea0bd2a81b113c579f2b1183926da211/discovery/images/query_structure2.png)

Operators that evaluate a field (<= , >=, <, >) require a number or date as the value. Using quotations around a value always makes it a string. Therefore score>=0.5 is a valid query and score>="0.5" is not. See [Query operators](https://cloud.ibm.com/docs/discovery?topic=discovery-query-operators) for a complete list of operators.

Considerations:



* Not sure when to query on an entity, concept, or keyword? See [Understanding the difference between Entities, Concepts, and Keywords](https://cloud.ibm.com/docs/discovery?topic=discovery-configserviceudbeck).



After you click Run query and open the JSON tab, query highlighting is turned on, by default. The setting adds a highlight field to your query results. Within the highlight field, the words that match your query are wrapped in HTML <em> (emphasis) tags. For more information, see the [Query parameters](https://cloud.ibm.com/docs/discovery?topic=discovery-query-parametershighlight).







 Building combined queries 

You can combine query parameters together to build more targeted queries. For example, you can use the both the filter and query parameters together. For more information about filtering vs. querying, see [Differences between the filter and query parameters](https://cloud.ibm.com/docs/discovery?topic=discovery-query-parametersfiltervquery).





 How to structure an aggregation 

Aggregations return a set of data values; for example, top keywords, overall sentiment of entities, and more. For the full list of aggregation options, see [Aggregations](https://cloud.ibm.com/docs/discovery?topic=discovery-query-referenceaggregations).
[Search results list](https://cloud.ibm.com/docs-content/v1/content/f16b1f78a92498247223b337bd9303c2758b9ba8/discovery-data/images/search-results-example.png)

Figure 2. Search results list

[Try it](https://watson-developer-cloud.github.io/discovery-components/storybook/?path=/story/searchresults--default)





 Facets 

Refine your results with facets that help users filter the search results by specific categories and domains.

Zoom

![Facets](https://cloud.ibm.com/docs-content/v1/content/f16b1f78a92498247223b337bd9303c2758b9ba8/discovery-data/images/search-facets-example.png)

Figure 3. Facets

[Try it](https://watson-developer-cloud.github.io/discovery-components/storybook/?path=/story/searchfacets--default)





 Rich document preview 

Displays your results in a document preview. This view highlights result passages within the text of the original document. It also shows any enrichment mentions that are detected in the document. The rich preview is available with source documents where an SDU model is applied, such as PDF, Microsoft PowerPoint, and Microsoft Word files.

Zoom

![Rich document preview](https://cloud.ibm.com/docs-content/v1/content/f16b1f78a92498247223b337bd9303c2758b9ba8/discovery-data/images/search-doc-preview-example.png)

Figure 4. Rich document view

[Try it](https://watson-developer-cloud.github.io/discovery-components/storybook/?path=/story/documentpreview--default)





 Deploying a project
Getting started with IBM Master Data Management on Cloud 

IBM® Master Data Management on Cloud offers the rich features of an on-premises InfoSphere® Master Data Management (InfoSphere MDM) deployment without the cost, complexity, and risk of managing your own infrastructure. IBM MDM on Cloud provides preinstalled InfoSphere MDM configurations for production and development environments in an IBM SoftLayer® cloud-hosted environment.

After you [request a service](https://cloud.ibm.com/catalog/services/ibm-master-data-management-on-cloud) and receive your welcome letter with the service details, view the PDF documentation to get started:



* User Guides:



* [Master Data Management on Cloud User Guide (1.1.0)](https://cloud.ibm.com/media/docs/downloads/hosted-svcs/mdm/mdmoncloud_1.1.0_en_userguide.pdf)
* [Master Data Management on Cloud User Guide (1.2.0)](https://cloud.ibm.com/media/docs/downloads/hosted-svcs/mdm/mdmoncloud_1.2.0_en_userguide.pdf)
* [Master Data Management on Cloud User Guide (1.3.0)](https://cloud.ibm.com/media/docs/downloads/hosted-svcs/mdm/mdmoncloud_1.3.0_en_userguide.pdf)
* [Master Data Management on Cloud User Guide (1.5.0)](https://cloud.ibm.com/media/docs/downloads/hosted-svcs/mdm/mdmoncloud_1.5.0_en_userguide.pdf)
* [Master Data Management on Cloud User Guide (1.6.0)](https://cloud.ibm.com/media/docs/downloads/hosted-svcs/mdm/mdmoncloud_1.6.0_en_userguide.pdf)
Get recommendations by linking structured and unstructured data 

Establish a relation with data stored in the structured format



* [Learn more ![External link icon](https://cloud.ibm.com/docs-content/v1/content/icons/launch-glyph.svg)](https://developer.ibm.com/patterns/generate-insights-from-multiple-data-formats-using-watson-services/)
* [Get the Code ![External link icon](https://cloud.ibm.com/docs-content/v1/content/icons/launch-glyph.svg)](https://github.com/IBM/generate-insights-from-data-formats-with-watson)
* [View the Demo ![External link icon](https://cloud.ibm.com/docs-content/v1/content/icons/launch-glyph.svg)](https://www.youtube.com/watch?v=wj39DepBVBg)







 Provide automated customer support for emails 

Develop an intelligent customer support system using Watson natural language capabilities



* [Learn more ![External link icon](https://cloud.ibm.com/docs-content/v1/content/icons/launch-glyph.svg)](https://developer.ibm.com/patterns/email-support-automation-for-telco/)
* [Get the Code ![External link icon](https://cloud.ibm.com/docs-content/v1/content/icons/launch-glyph.svg)](https://github.com/IBM/smart-email-support)
* [View the Demo ![External link icon](https://cloud.ibm.com/docs-content/v1/content/icons/launch-glyph.svg)](https://www.youtube.com/watch?v=AT477px19gQ)







 Query a knowledge base for documents
Uploading data 

You can perform a one-time document upload from your local file system at any time to add data to a project.

You can upload up to 200 files at a time.

To process document sets that are larger than 200 files, you can add them to an external data source and use a data source crawler to upload them. For IBM Cloud Pak for Data deployments, you can use a Local File System data source for this purpose.

For more information about the maximum size allowed for each file, see [Document limits](https://cloud.ibm.com/docs/discovery-data?topic=discovery-data-collectionscollections-doc-limits).

Before you upload a CSV file to a Content Mining project, consider adding headers to the source file so that any fields that are generated from the file have meaningful names. Without headers, fields are given generic names, such as column_0, column_1, and so on.

To upload data, complete the following steps:



1. Open your project, go to the Manage collections page, and then click New collection.
2. Choose Upload data as your data source, and then click Next.
3. Name the collection.
4. If the language of the documents in storage is not English, select the appropriate language.

For a list of supported languages, see [Language support](https://cloud.ibm.com/docs/discovery-data?topic=discovery-data-language-support).
5. Optionally, click More processing settings to expand the menu, and then click Apply optical character recognition (OCR).

When OCR is enabled and your documents contain images, processing takes longer. For more information, see [Optical character recognition](https://cloud.ibm.com/docs/discovery-data?topic=discovery-data-collectionsocr).
6. Click Next.
7. Browse for the files you want to crawl.

IBM Cloud

You can drag documents that you want to add to your collection.
: New API added that can be used to manage the IBM Cloud Monitoring service. [Learn more about the API](https://cloud.ibm.com/apidocs/monitor).





 24 March 2021 

Secure beta support for image scanning reports
: V3 of the image scanning reports is available in beta. Functional changes include:



* Allowing scheduling of reports and sending them through notification channels.
* Allowing a preview of the report structure in the UI.
* Adding an advanced query builder.
* Adding more data columns and filters.
* Adding two report types: vulnerability and policy.







 22 March 2021 

Secure support for policy types
: Policy types allows you to group policies into logical groups based on the sources used in the policy engine.





 17 March 2021 

Secure UI enhancements and additional functionality
: The following changes have been made:



* Updates have been made to the scan results list.
* New table design for the vulnerabilities list.
* Ability to open individual vulnerabilities and display additional information.







 12 March 2021 

Secure deprecation
: The following features are deprecated for Secure:



* Commands Audit has been deprecated in favor of Activity Audit.
* Policy Events is deprecated in favor of the Events feed.







 3 March 2021 

PromQL query explorer
: The PromQL query explorer helps you understand metrics and their labels and values and create queries even faster than before.

IBM Cloud Functions integration
: IBM Cloud Functions can be used as a notification channel.

Persistence of dashboard scope
: When returning to a previously visited dashboard, the last used scope will be retained.





 2 March 2021 

Secure support for SOC 2, NIST 800-53 rev4 and rev5 regulatory compliance
: SOC2, NIST 800-53 rev4 and NIST 800-53 rev5 standards have been added to the compliance feature. New checks have also been added to the admission controller, network security policies, and node analyzer.





 23 February 2021 

Secure support for Windows scanning in beta
: A beta version of Windows scanning is available as a standalone scanning engine. No UI, management, or historical data is available.