vania-janet/multiturn-rag-retrieval-data huggingface dataset:
"rate": 16000,
"name": "en-US_BroadbandModel",
"language": "en-US",
"url": "{url}/v1/models/en-US_BroadbandModel",
"supported_features": {
"custom_language_model": true,
"custom_acoustic_model": true,
"speaker_labels": true
},
"description": "US English broadband model."
}





 List a specific next-generation model example 

The following example shows information about the next-generation US English telephony model, en-US_Telephony:

IBM Cloud

curl -X GET -u "apikey:{apikey}" "{url}/v1/models/en-US_Telephony"

IBM Cloud Pak for Data

curl -X GET --header "Authorization: Bearer {token}" "{url}/v1/models/en-US_Telephony"

The model supports low latency, speakers labels, and language model customization. It does not support acoustic model customization.

{
"name": "en-US_Telephony",
"rate": 8000,
"language": "en-US",
"description": "US English telephony model for narrowband audio (8kHz)",
"supported_features": {
"custom_language_model": true,
"custom_acoustic_model": false,
"low_latency": true,
"speaker_labels": true
},
"url": "{url}/v1/models/en-US_Telephony"
}
* For more information about grammars, see [Grammars](https://cloud.ibm.com/docs/speech-to-text?topic=speech-to-text-customizationgrammars-intro).



New beta grammar support for next-generation models
: Grammar support is now available as beta functionality for all next-generation models. All next-generation models are generally available (GA) and support language model customization. For more information, see the following topics:



* For more information about the status of grammar support for next-generation models, see [Customization support for next-generation models](https://cloud.ibm.com/docs/speech-to-text?topic=speech-to-text-custom-supportcustom-language-support-ng).
* For more information about grammars, see [Grammars](https://cloud.ibm.com/docs/speech-to-text?topic=speech-to-text-customizationgrammars-intro).



Note: Beta support for grammars by next-generation models is available for the Speech to Text service on IBM Cloud only. Grammars are not yet supported for next-generation models on IBM Cloud Pak for Data.

New custom_acoustic_model field for supported features
: The GET /v1/models and GET /v1/models/{model_id} methods now report whether a model supports acoustic model customization. The SupportedFeatures object now includes an additional field, custom_acoustic_model, a boolean that is true for a model that supports acoustic model customization and false otherwise. Currently, the field is true for all previous-generation models and false for all next-generation models.



* For more information about these methods, see [Listing information about models](https://cloud.ibm.com/docs/speech-to-text?topic=speech-to-text-models-list).
* For more information about support for acoustic model customization, see [Language support for customization](https://cloud.ibm.com/docs/speech-to-text?topic=speech-to-text-custom-support).







 22 October 2021
The model supports language model customization (GA) and acoustic model customization (beta). For more information, see [The US English short-form model](https://cloud.ibm.com/docs/speech-to-text?topic=speech-to-text-modelsmodelsShortform).

Updates to UK English and Spanish narrowband models for improved speech recognition
: The following language models have been updated for improved speech recognition:



* UK English narrowband model (en-GB_NarrowbandModel)
* Spanish narrowband model (es-ES_NarrowbandModel)



By default, the service automatically uses the updated models for all speech recognition requests. If you have custom language or custom acoustic models that are based on the models, you must upgrade your existing custom models to take advantage of the updates by using the following methods:



* POST /v1/customizations/{customization_id}/upgrade_model
* POST /v1/acoustic_customizations/{customization_id}/upgrade_model



For more information, see [Upgrading custom models](https://cloud.ibm.com/docs/speech-to-text?topic=speech-to-text-custom-upgrade).

New support for G.279 audio format
: The service now supports audio in the G.729 (audio/g729) format. The service supports only G.729 Annex D for narrowband audio. For more information, see [audio/g729 format](https://cloud.ibm.com/docs/speech-to-text?topic=speech-to-text-audio-formatsaudio-formats-g729).

Speakers labels feature now available for UK English narrowband model
: The speaker labels feature is now available for the narrowband model for UK English (en-GB_NarrowbandModel). The feature is beta functionality for all supported languages. For more information, see [Speaker labels](https://cloud.ibm.com/docs/speech-to-text?topic=speech-to-text-speaker-labels).

New limits on maximum amount of audio for custom acoustic models
* Enhanced neural voices, which include the string V3 in their names, are now available for Brazilian Portuguese, United Kingdom and United States English, French, German, Italian, Japanese, and Spanish (all dialects). Enhanced neural voices support the use of both IPA and IBM Symbolic Phonetic Representation (SPR) with the SSML <phoneme> element. Enhanced neural voices also achieve a slightly higher degree of natural-sounding speech. And further customization capabilities will be exposed for enhanced neural voices in the coming months.



The service no longer offers standard voices for any language. Standard voices used concatenative synthesis to assemble segments of recorded speech to generate the requested audio.

For more information, see [Languages and voices](https://cloud.ibm.com/docs/text-to-speech?topic=text-to-speech-voices).

New Australian English and Korean neural voices
: The following Australian English and Korean voices are new:



* The service now supports Australian English with the following two neural voices: en-AU_CraigVoice and en-AU_MadisonVoice.
* The service now supports two new Korean neural voices: ko-KR_HyunjunVoice and ko-KR_SiWooVoice.



Improved neural voices
: The voices for the existing Arabic, Chinese, Netherlands Dutch, and Korean languages, all of which were concatenative, are now neural:



* ar-MS_OmarVoice
* ko-KR_YoungmiVoice
* ko-KR_YunaVoice
* nl-NL_EmmaVoice
* nl-NL_LiamVoice
* zh-CN_LiNaVoice
* zh-CN_WangWeiVoice
* zh-CN_ZhangJingVoice



The following additional changes have also been made:



* The Arabic voice is now named ar-MS_OmarVoice. The former name, ar-AR_OmarVoice, is deprecated. It will continue to function for at least one year but might be removed at a future date. You are encouraged to migrate to the new name at your earliest convenience.
You do not need to upgrade custom language models that are based on these models. For more information about all available next-generation models, see [Next-generation languages and models](https://cloud.ibm.com/docs/speech-to-text?topic=speech-to-text-models-ng).

Updates to multiple next-generation telephony models
: The following next-generation English language telephony models have been updated for improved speech recognition:



* en-AU_Telephony
* en-GB_Telephony
* en-IN_Telephony
* en-US_Telephony



You do not need to upgrade custom models that are based on these models. For more information about all available next-generation models, see [Next-generation languages and models](https://cloud.ibm.com/docs/speech-to-text?topic=speech-to-text-models-ng).

Defect fix: Confidence scores are now reported for all transcription results
: Defect fix: Confidence scores are now reported for all transcription results. Previously, when the service returned multiple transcripts for a single speech recognition request, confidence scores might not be returned for all transcripts.

Security vulnerabilities addressed
: No security vulnerabilities were fixed for version 4.5.0.





 25 May 2022 (Version 4.0.9) 

Version 4.0.9 is now available
: Speech to Text for IBM Cloud Pak for Data version 4.0.9 is now available. This version supports IBM Cloud Pak for Data version 4.x and Red Hat OpenShift versions 4.6 and 4.8. For more information about installing and managing the service, see [Installing Watson Speech to Text](https://www.ibm.com/docs/en/cloud-paks/cp-data/4.0?topic=text-installing-watson-speech).

New Brazilian Portuguese pt-BR_Multimedia next-generation model
: The service now offers a next-generation multimedia model for Brazilian Portuguese: pt-BR_Multimedia. The new model supports low latency and is generally available. It also supports language model customization and grammars.
: Version 2 entity type support is now available, for all public and premium service instances, for the following languages: Russian and Swedish. For details, see [Entity type systems](https://cloud.ibm.com/docs/natural-language-understanding?topic=natural-language-understanding-entity-type-systems).





 3 August 2022 

Support for Single Label Classifications
: Classifications now allows users to pass in a model_type training parameter when creating or updating a model, in order to train a single label classifier. See [Classifications training parameters](https://cloud.ibm.com/docs/natural-language-understanding?topic=natural-language-understanding-classificationsclassification-training-parameters) for more details.





 11 July 2022 

Improved [custom classifications](https://cloud.ibm.com/docs/natural-language-understanding?topic=natural-language-understanding-classifications) model - Japanese
: Japanese custom classifications models now train and perform inference faster, with improved model results.

Improved [custom categories](https://cloud.ibm.com/docs/natural-language-understanding?topic=natural-language-understanding-categories) model
: Model contains improved word filtering, resulting in better category determination.





 7 April 2022 

Categories bug fix
: Fixed a bug in the Version 2 Categories type system.





 14 February 2022 

Emotion support
: Support for emotion is now available, for all public service instances, for French. For details, see [Language support](https://cloud.ibm.com/docs/natural-language-understanding?topic=natural-language-understanding-language-support).

Improved error handling and validation for emotion
: If a request contains both an error in the emotion feature and a valid feature request for another feature, the response returns a 200 with a warning for the emotion feature.
: The error log has changed from emotion request must specify at least one of: document, targets to emotion request must specify at least one of: document or targets.
: Requests that include the emotion feature with any nonstring elements in the targets list returns an error.





 1 December 2021 

Tone analytics
For a list of all enhanced neural voices, see [Enhanced neural voices](https://cloud.ibm.com/docs/text-to-speech?topic=text-to-speech-voiceslanguage-voices-enhanced-neural).



The following pages provide more information about the voices and their technology:



* For a blog that introduces the expressive voices, see [Is your conversational AI setting the right tone?](https://www.ibm.com/blogs/journey-to-ai/2022/09/is-your-conversational-ai-setting-the-right-tone/).
* For more information about the service's neural voice technology, see [The science behind the service](https://cloud.ibm.com/docs/text-to-speech?topic=text-to-speech-science).





 Language support by type of voice 

Table 1 shows the service's support for languages by type of voice. The following topics list the available languages and voices for each voice type.



Table 1. Language support by type of voice

 Language Expressive neural voices Enhanced neural voices 

 Dutch <br>(Netherlands) ✔ 
 English <br>(United Kingdom) ✔ 
 English <br>(Australian) ✔ 
 English <br>(United States) ✔ ✔ 
 French <br>(Canadian) ✔ 
 French <br>(France) ✔ 
 German ✔ 
 Italian ✔ 
 Japanese ✔ 
 Korean ✔ 
 Portuguese <br>(Brazilian) ✔ 
 Spanish <br>(Castilian) ✔ 
 Spanish <br>(Latin American) ✔ 
 Spanish <br>(South American) ✔ 







 Expressive neural voices 

Table 2 lists and provides audio samples for all available expressive neural voices. The Availability column indicates whether each voice is generally available (GA) for production use or beta. The column also indicates whether each voice is available for

IBM Cloud

,

IBM Cloud Pak for Data

, or both (no product version is cited).



* Expressive neural voices support additional features that are not available with other types of voices. These features include additional speaking styles, automatic emphasis of interjections, and emphasis of specified words.
[English](https://cloud.ibm.com/docs/language-translator?topic=language-translator-translation-modelsenglish) en [Punjabi (Pakistani)](https://cloud.ibm.com/docs/language-translator?topic=language-translator-translation-modelspunjabi-pakistan) pa-PK 
 [Estonian](https://cloud.ibm.com/docs/language-translator?topic=language-translator-translation-modelsestonian) et [Romanian](https://cloud.ibm.com/docs/language-translator?topic=language-translator-translation-modelsromanian) ro 
 [Finnish](https://cloud.ibm.com/docs/language-translator?topic=language-translator-translation-modelsfinnish) fi [Russian](https://cloud.ibm.com/docs/language-translator?topic=language-translator-translation-modelsrussian) ru 
 [French](https://cloud.ibm.com/docs/language-translator?topic=language-translator-translation-modelsfrench) fr [Serbian](https://cloud.ibm.com/docs/language-translator?topic=language-translator-translation-modelsserbian)[3] sr 
 [French (Canadian)](https://cloud.ibm.com/docs/language-translator?topic=language-translator-translation-modelsfrench-canadian) fr [Sinhala](https://cloud.ibm.com/docs/language-translator?topic=language-translator-translation-modelssinhala) si 
 [German](https://cloud.ibm.com/docs/language-translator?topic=language-translator-translation-modelsgerman) de [Slovak](https://cloud.ibm.com/docs/language-translator?topic=language-translator-translation-modelsslovak) sk
For more information about the next-generation models and low latency, see



* [Next-generation languages and models](https://cloud.ibm.com/docs/speech-to-text?topic=speech-to-text-models-ng)
* [Low latency](https://cloud.ibm.com/docs/speech-to-text?topic=speech-to-text-interimlow-latency)



New Castilian Spanish next-generation multimedia model
: The service now offers a next-generation multimedia model for Castilian Spanish: es-ES_Multimedia. The new model supports low latency and is generally available. It also supports language model customization (generally available) and grammars (beta).

For more information about all available next-generation models and their customization support, see



* [Next-generation languages and models](https://cloud.ibm.com/docs/speech-to-text?topic=speech-to-text-models-ng)
* [Customization support for next-generation models](https://cloud.ibm.com/docs/speech-to-text?topic=speech-to-text-custom-supportcustom-language-support-ng)







 11 February 2022 

Defect fix: Correct custom model upgrade and base model version documentation
: Defect fix: The documentation that describes the upgrade of custom models and the version strings that are used for different versions of base models has been updated. The documentation now states that upgrade for language model customization also applies to next-generation models. Also, the version strings that represent different versions of base models have been updated. And the base_model_version parameter can also be used with upgraded next-generation models.

For more information about custom model upgrade, when upgrade is necessary, and how to use older versions of custom models, see



* [Upgrading custom models](https://cloud.ibm.com/docs/speech-to-text?topic=speech-to-text-custom-upgrade)
* [Using upgraded custom models for speech recognition](https://cloud.ibm.com/docs/speech-to-text?topic=speech-to-text-custom-upgrade-use)
* For more information about the status of grammar support for next-generation models, see [Customization support for next-generation models](https://cloud.ibm.com/docs/speech-to-text?topic=speech-to-text-custom-supportcustom-language-support-ng).
* For more information about grammars, see [Grammars](https://cloud.ibm.com/docs/speech-to-text?topic=speech-to-text-customizationgrammars-intro).



New custom_acoustic_model field for supported features
: The GET /v1/models and GET /v1/models/{model_id} methods now report whether a model supports acoustic model customization. The SupportedFeatures object now includes an additional field, custom_acoustic_model, a boolean that is true for a model that supports acoustic model customization and false otherwise. Currently, the field is true for all previous-generation models and false for all next-generation models.



* For more information about these methods, see [Listing information about models](https://cloud.ibm.com/docs/speech-to-text?topic=speech-to-text-models-list).
* For more information about support for acoustic model customization, see [Language support for customization](https://cloud.ibm.com/docs/speech-to-text?topic=speech-to-text-custom-support).



Security vulnerability addressed
: The following security vulnerability associated with Apache Log4j has been fixed:



* [Security Bulletin: Vulnerability in Apache Log4j may affect IBM Watson Speech Services Cartridge for IBM Cloud Pak for Data (CVE-2021-4428)](https://www.ibm.com/support/pages/node/6536732)







 20 December 2021 (Version 1.2.x) 

Important: You can no longer install Speech to Text version 1.2.x on IBM Cloud Pak for Data version 3.5
: Important: You can no longer perform new installations of Speech to Text version 1.2.x on IBM Cloud Pak for Data version 3.5.
Unless otherwise labeled as

IBM Cloud

or

IBM Cloud Pak for Data

, a model and low latency are supported for both versions of the service.



 Telephony models 

Table 1 lists the available next-generation telephony models.



Table 1. Next-generation telephony models

 Language Model name Low-latency support Status 

 Arabic <br>(Modern Standard) ar-MS_Telephony Yes GA 
 Chinese <br>(Mandarin) zh-CN_Telephony Yes GA 
 Czech cs-CZ_Telephony Yes GA 
 Dutch <br>(Belgian) nl-BE_Telephony Yes GA 
 Dutch <br>(Netherlands) nl-NL_Telephony Yes GA 
 English <br>(Australian) en-AU_Telephony Yes GA 
 English <br>(Indian) en-IN_Telephony Yes GA 
 English <br>(United Kingdom) en-GB_Telephony Yes GA 
 English <br>(United States) en-US_Telephony Yes GA 
 English <br>(all supported dialects) en-WW_Medical_Telephony Yes Beta 
 French <br>(Canadian) fr-CA_Telephony Yes GA 
 French <br>(France) fr-FR_Telephony Yes GA 
 German de-DE_Telephony Yes GA 
 Hindi <br>(Indian) hi-IN_Telephony Yes GA 
 Italian it-IT_Telephony Yes GA 
 Japanese ja-JP_Telephony Yes GA 
 Korean ko-KR_Telephony Yes GA 
 Portuguese <br>(Brazilian) pt-BR_Telephony Yes GA 
 Spanish <br>(Castilian) es-ES_Telephony Yes GA 
 Spanish <br>(Argentinian, Chilean, <br>Colombian, Mexican, <br>and Peruvian) es-LA_Telephony Yes GA 
 Swedish sv-SE_Telephony Yes GA 



The Latin American Spanish model, es-LA_Telephony, applies to all Latin American dialects. It is the equivalent of the previous-generation models that are available for the Argentinian, Chilean, Colombian, Mexican, and Peruvian dialects.
: You can now configure a conditional response to jump directly to another node. See [Conditional responses](https://cloud.ibm.com/docs/assistant?topic=assistant-dialog-overviewdialog-overview-multiple) for more details.





 21 June 2018 

Language updates for system entities
: Dutch and Simplified Chinese language support are now generally available. Dutch language support includes fuzzy matching for misspellings. Traditional Chinese language support includes the availability of [system entities](https://cloud.ibm.com/docs/assistant?topic=assistant-system-entities) in beta release. See [Supported languages](https://cloud.ibm.com/docs/assistant?topic=assistant-language-support) for details.





 14 June 2018 

Washington, DC data center opens
: You can now create Watson Assistant service instances that are hosted in the Washington, DC data center. See [Data centers](https://cloud.ibm.com/docs/assistant?topic=assistant-services-informationservices-information-regions) for more details.

New API authentication process
: The Watson Assistant service has a new API authentication process for service instances that are hosted in the following regions:



* Washington, DC (us-east) as of 14 June 2018
* Sydney, Australia (au-syd) as of 7 May 2018



IBM Cloud® is migrating to token-based Identity and Access Management (IAM) authentication.

For new service instances in the regions listed, you use IAM for authentication. You can pass either a bearer token or an API key. Tokens support authenticated requests without embedding service credentials in every call. API keys use basic authentication.

For all new and existing service instances in other regions, you continue to use service credentials ({username}:{password}) for authentication.

When you use any of the Watson SDKs, you can pass the API key and let the SDK manage the lifecycle of the tokens. For more information and examples, see [Authentication](https://cloud.ibm.com/apidocs/assistant/assistant-v2authentication) in the API reference.
: The service now supports the following next-generation models with Speech to Text for IBM Cloud Pak for Data:



* Chinese (Mandarin) telephony model (zh-CN_Telephony). The new model supports low latency.
* English (Australian) multimedia model (en-AU_Multimedia). The new model does not support low latency.
* English (UK) multimedia model (en-GB_Multimedia). The new model does not support low latency.
* Spanish (Latin American) telephony model (es-LA_Telephony). The new model supports low latency.



Note: The Latin American Spanish model, es-LA_Telephony, applies to all Latin American dialects. It is the equivalent of the previous-generation models that are available for the Argentinian, Chilean, Colombian, Mexican, and Peruvian dialects. If you used a previous-generation model for any of these specific dialects, use the es-LA_Telephony model to migrate to the equivalent next-generation model.

The new models are generally available for speech recognition. They are generally available for language model customization and beta for grammars. They are not supported for acoustic model customization.



* Important: If you are performing a mirrored installation (for example, in an air-gapped environment) and plan to install any of the new next-generation models for Speech to Text, you must perform additional steps before mirroring the images. For more information, see the earlier release note.
* For more information about using the custom resource to install models, see [Installing Watson Speech to Text](https://www.ibm.com/docs/en/cloud-paks/cp-data/4.0?topic=text-installing-watson-speech).
* For more information about all available next-generation models, see [Next-generation languages and models](https://cloud.ibm.com/docs/speech-to-text?topic=speech-to-text-models-ng).