vania-janet/multiturn-rag-retrieval-data huggingface dataset:
* [Supported audio formats](https://cloud.ibm.com/docs/speech-to-text?topic=speech-to-text-audio-formats)



* Recognizing speech with the service



* [Making a speech recognition request](https://cloud.ibm.com/docs/speech-to-text?topic=speech-to-text-basic-request)
* [Understanding speech recognition results](https://cloud.ibm.com/docs/speech-to-text?topic=speech-to-text-basic-response)
* [The WebSocket interface](https://cloud.ibm.com/docs/speech-to-text?topic=speech-to-text-websockets)
* [The synchronous HTTP interface](https://cloud.ibm.com/docs/speech-to-text?topic=speech-to-text-http)
* [The asynchronous HTTP interface](https://cloud.ibm.com/docs/speech-to-text?topic=speech-to-text-async)



* Using speech recognition parameters



* [Audio transmission and timeouts](https://cloud.ibm.com/docs/speech-to-text?topic=speech-to-text-input)
* [Interim results and low latency](https://cloud.ibm.com/docs/speech-to-text?topic=speech-to-text-interim)
* [Speech activity detection](https://cloud.ibm.com/docs/speech-to-text?topic=speech-to-text-detection)
* [Speech audio parsing](https://cloud.ibm.com/docs/speech-to-text?topic=speech-to-text-parsing)
* [Speaker labels](https://cloud.ibm.com/docs/speech-to-text?topic=speech-to-text-speaker-labels)
* [Keyword spotting and word alternatives](https://cloud.ibm.com/docs/speech-to-text?topic=speech-to-text-spotting)
* Dutch: [stopwords_nl.txt](https://github.com/apache/lucene/blob/main/lucene/analysis/common/src/resources/org/apache/lucene/analysis/snowball/dutch_stop.txt)
* Finnish: [stopwords_fi.txt](https://github.com/apache/lucene/blob/main/lucene/analysis/common/src/resources/org/apache/lucene/analysis/snowball/finnish_stop.txt)
* French: [stopwords_fr.txt](https://github.com/apache/lucene/blob/main/lucene/analysis/common/src/resources/org/apache/lucene/analysis/snowball/french_stop.txt)
* German: [stopwords_de.txt](https://github.com/apache/lucene/blob/main/lucene/analysis/common/src/resources/org/apache/lucene/analysis/snowball/german_stop.txt)
* Hindi: [stopwords_hi.txt](https://github.com/apache/lucene/blob/main/lucene/analysis/common/src/resources/org/apache/lucene/analysis/hi/stopwords.txt)
* Italian: [stopwords_it.txt](https://github.com/apache/lucene/blob/main/lucene/analysis/common/src/resources/org/apache/lucene/analysis/snowball/italian_stop.txt)
* Norwegian (both supported dialects): [stopwords_no.txt](https://github.com/apache/lucene/blob/main/lucene/analysis/common/src/resources/org/apache/lucene/analysis/snowball/norwegian_stop.txt)
* For complete information about the service's level of support for all SSML elements, see [SSML elements](https://cloud.ibm.com/docs/text-to-speech?topic=text-to-speech-elements).
* For examples of using SSML elements with the text of a speech synthesis request, see [Examples of input text](https://cloud.ibm.com/docs/text-to-speech?topic=text-to-speech-usingHTTPhttpExamples).



* The service supports additional synthesis features for enhanced neural and expressive neural voices:



* [Modifying the speaking rate](https://cloud.ibm.com/docs/text-to-speech?topic=text-to-speech-synthesis-paramsparams-rate-percentage)
* [Modifying the speaking pitch](https://cloud.ibm.com/docs/text-to-speech?topic=text-to-speech-synthesis-paramsparams-pitch-percentage)



* The service supports additional synthesis features for expressive neural voices:



* [Using speaking styles](https://cloud.ibm.com/docs/text-to-speech?topic=text-to-speech-synthesis-expressivesyntheses-expressive-styles)
* [Emphasizing interjections](https://cloud.ibm.com/docs/text-to-speech?topic=text-to-speech-synthesis-expressivesyntheses-expressive-interjections)
* [Emphasizing words](https://cloud.ibm.com/docs/text-to-speech?topic=text-to-speech-synthesis-expressiveemphasizing-words)



* The service supports a synthesis feature that lets you control how alphanumeric strings are spelled out for German voices. For more information, see [Specifying how strings are spelled out](https://cloud.ibm.com/docs/text-to-speech?topic=text-to-speech-synthesis-paramsparams-spell-out-mode).
* The service supports the use of the SSML <mark> element with the WebSocket interface to obtain timing information for words of the resulting audio.
[112-Developer-tools.svg](https://cloud.ibm.com/media/docs/images/homepage/112-Developer-tools.svg)](https://developer.ibm.com/depmodels/cloud/)[Architecture Center<br><br>Discover the architecture references available for this product.<br><br>![190-Application-Platform.svg](https://cloud.ibm.com/media/docs/images/homepage/190-Application-Platform.svg)](https://www.ibm.com/cloud/architecture)[IBM Training<br><br>Build your skills with IBM Cloud training.<br><br>![83-Elements-of-the-cloud.svg](https://cloud.ibm.com/media/docs/images/homepage/83-Elements-of-the-cloud.svg)](https://www.ibm.com/training/cloud)[Community<br><br>Join the IBM Cloud community and collaborate with others.<br><br>![35-Connectivity.svg](https://cloud.ibm.com/media/docs/images/homepage/35-Connectivity.svg)](https://community.ibm.com/community/user/publiccloud/search?executeSearch=true&SearchTerm=direct%20link&rf=%5EMulti04%3Adirect%5E)
: All of the service's DNN-based voices now support the pitch and rate attributes of the SSML <prosody> element. The DNN-based voices do not support the volume attribute of the <prosody> element. For more information, see [The prosody element](https://cloud.ibm.com/docs/text-to-speech?topic=text-to-speech-elementsprosody_element).





 21 March 2019 

Visibility of service credentials now restricted by role
: Users can now see only service credential information that is associated with the role that has been assigned to their IBM Cloud account. For example, if you are assigned a reader role, any writer or higher levels of service credentials are no longer visible.

This change does not affect API access for users or applications with existing service credentials. The change affects only the viewing of credentials within IBM Cloud.





 4 March 2019 

New V2 neural English and Italian voices
: The service now offers four new V2 voices that use deep-learning synthesis to generate audio:



* en-US_AllisonV2Voice
* en-US_LisaV2Voice
* en-US_MichaelV2Voice
* it-IT_FrancescaV2Voice



These new voices use machine learning and a DNN to synthesize text to speech. Deep-learning, or Deep Neural Network (DNN)-based, synthesis produces audio with a more natural prosody and a more consistent overall quality.

But the new voices also produce audio with different signal qualities from the existing voices, so they might not be appropriate for all applications. Also, the new voices do not support the SSML elements <prosody>, <express-as>, and <voice-transformation>.

For more information about these DNN-based voices and how they differ from the existing voices, see [Languages and voices](https://cloud.ibm.com/docs/text-to-speech?topic=text-to-speech-voices).





 28 January 2019 

New support for IBM Cloud IAM by WebSocket interface
[112-Developer-tools.svg](https://cloud.ibm.com/media/docs/images/homepage/112-Developer-tools.svg)](https://developer.ibm.com/depmodels/cloud/)[Architecture Center<br><br>Discover the architecture references available for this product.<br><br>![190-Application-Platform.svg](https://cloud.ibm.com/media/docs/images/homepage/190-Application-Platform.svg)](https://www.ibm.com/cloud/architecture)[IBM Training<br><br>Build your skills with IBM Cloud training.<br><br>![83-Elements-of-the-cloud.svg](https://cloud.ibm.com/media/docs/images/homepage/83-Elements-of-the-cloud.svg)](https://www.ibm.com/training/cloud)[Community<br><br>Join the IBM Cloud community and collaborate with others.<br><br>![35-Connectivity.svg](https://cloud.ibm.com/media/docs/images/homepage/35-Connectivity.svg)](https://community.ibm.com/community/user/publiccloud/home)
* Install the service once and deploy multiple instances in the same project



The documentation that is specific to the Speech services correctly stated the multitenancy support.





 1 October 2021 (Version 1.1.x) 

Version 1.1.x is out of service
: Speech to Text and Text to Speech for IBM Cloud Pak for Data version 1.1.x went out of service on 30 September 2021. As of 1 October 2021, the documentation for version 1.1.x is no longer available. For more information, see [Software withdrawal and support discontinuance](https://www.ibm.com/common/ssi/ShowDoc.wss?docURL=/common/ssi/rep_ca/9/899/ENUSLP21-0099/index.html&request_locale=en).





 31 August 2021 (Version 4.0.0) 

All next-generation models are now generally available
: All next-generation language models are now generally available (GA). They are supported for use in production environments and applications.



* For more information about all next-generation language models and which models are currently available for IBM Cloud Pak for Data, see [Next-generation languages and models](https://cloud.ibm.com/docs/speech-to-text?topic=speech-to-text-models-ng).
* For more information about the features that are supported for each next-generation model, see [Supported features for next-generation models](https://cloud.ibm.com/docs/speech-to-text?topic=speech-to-text-models-ngmodels-ng-features).



Language model customization for next-generation models is now generally available
: Language model customization is now generally available (GA) for all available next-generation languages and models. Language model customization for next-generation models is supported for use in production environments and applications.

You use the same commands to create, manage, and use custom language models, corpora, and custom words for next-generation models as you do for previous-generation models. But customization for next-generation models works differently from customization for previous-generation models.
Languages and voices 

The IBM Watson® Text to Speech service supports a variety of languages, voices, and dialects. For different languages, the service offers female voices, male voices, or both. Each voice uses appropriate cadence and intonation for its dialect.

All of the service's voices use neural voice technology. Neural voice technology uses multiple Deep Neural Networks (DNNs) to predict the acoustic (spectral) features of the speech. The DNNs are trained on natural human speech and generate the resulting audio from the predicted acoustic features. During synthesis, the DNNs predict the pitch and phoneme duration (prosody), spectral structure, and waveform of the speech. Neural voices produce speech that is crisp and clear, with a very natural-sounding, smooth, and consistent audio quality.



 Supported languages and voices 

The service offers two types of voices with different qualities and capabilities:



* Expressive neural voices offer natural-sounding speech that is exceptionally clear and crisp. Their pronunciation and inflections are natural and conversational, and the resulting speech offers extremely smooth transitions between words. They also support the use of additional features that are not available with enhanced neural voices. For a list of all expressive voices, see [Expressive neural voices](https://cloud.ibm.com/docs/text-to-speech?topic=text-to-speech-voiceslanguage-voices-expressive).
* Enhanced neural voices achieve a high degree of natural-sounding speech and support most service features. For a list of all enhanced neural voices, see [Enhanced neural voices](https://cloud.ibm.com/docs/text-to-speech?topic=text-to-speech-voiceslanguage-voices-enhanced-neural).



The following pages provide more information about the voices and their technology:



* For a blog that introduces the expressive voices, see [Is your conversational AI setting the right tone?](https://www.ibm.com/blogs/journey-to-ai/2022/09/is-your-conversational-ai-setting-the-right-tone/).
For more information about all available next-generation models and their customization support, see



* [Next-generation languages and models](https://cloud.ibm.com/docs/speech-to-text?topic=speech-to-text-models-ng)
* [Customization support for next-generation models](https://cloud.ibm.com/docs/speech-to-text?topic=speech-to-text-custom-supportcustom-language-support-ng)



Beta next-generation en-WW_Medical_Telephony model now supports low latency
: The beta next-generation en-WW_Medical_Telephony model now supports low latency. For more information about all next-generation models and low latency, see



* [Next-generation languages and models](https://cloud.ibm.com/docs/speech-to-text?topic=speech-to-text-models-ng)
* [Low latency](https://cloud.ibm.com/docs/speech-to-text?topic=speech-to-text-interimlow-latency)



Security vulnerabilities addressed
: The following security vulnerabilities have been fixed:



* [Security Bulletin: A vulnerability with Guava affects IBM Watson Speech Services Cartridge for IBM Cloud Pak for Data (CVE-2020-8908)](https://www.ibm.com/support/pages/node/6575479)
* [Security Bulletin: A Google Guava vulnerability affects IBM Watson Speech Services Cartridge for IBM Cloud Pak for Data (CVE-2018-10237)](https://www.ibm.com/support/pages/node/6575477)
* [Security Bulletin: Vulnerabilities in Apache Tomcat affect IBM Watson Speech Services Cartridge for IBM Cloud Pak for Data (CVE-2022-23181)](https://www.ibm.com/support/pages/node/6575481)
<speak>
<prosody rate="fast">成功する/繁栄する</prosody>
</speak>

The service now correctly parses and applies the rate attribute of the <prosody> element for Japanese input.





 4 September 2020 

Customization interface is now generally available
: The customization interface is now generally available (GA). Customization is no longer beta functionality. You can use the customization interface to specify how the service pronounces unusual words that occur in your input text by creating language-specific custom dictionaries. It can be used with all generally available and beta voices. For more information, see [Understanding customization](https://cloud.ibm.com/docs/text-to-speech?topic=text-to-speech-customIntro).





 24 June 2020 

New UK English and French neural voices
: The service now offers three new neural voices:



* UK English: en-GB_CharlotteV3Voice and en-GB_JamesV3Voice
* French: fr-FR_NicolasV3Voice



It also offers an improved version of the existing UK neural voice, en-GB_KateV3Voice. For more information about all available voices, see [Languages and voices](https://cloud.ibm.com/docs/text-to-speech?topic=text-to-speech-voices).

Support for SSML digits attribute of <say-as> element for Japanese
: The service now supports the digits attribute of the SSML <say-as> element with its Japanese voice. For more information, see [The say-as element](https://cloud.ibm.com/docs/text-to-speech?topic=text-to-speech-elementssay-as_element).





 1 April 2020 

New Korean standard voices: ko-KR_YoungmiVoice and ko-KR_YunaVoice
: The service now supports two standard female Korean voices: ko-KR_YoungmiVoice and ko-KR_YunaVoice. The following information applies to both Korean voices:



* The voices are beta functionality.
[Hindi](https://cloud.ibm.com/docs/language-translator?topic=language-translator-translation-modelshindi) hi [Tamil](https://cloud.ibm.com/docs/language-translator?topic=language-translator-translation-modelstamil) ta 
 [Hungarian](https://cloud.ibm.com/docs/language-translator?topic=language-translator-translation-modelshungarian) hu [Telugu](https://cloud.ibm.com/docs/language-translator?topic=language-translator-translation-modelstelugu) te 
 [Irish](https://cloud.ibm.com/docs/language-translator?topic=language-translator-translation-modelsirish) ga [Thai](https://cloud.ibm.com/docs/language-translator?topic=language-translator-translation-modelsthai) th 
 [Indonesian](https://cloud.ibm.com/docs/language-translator?topic=language-translator-translation-modelsindonesian) id [Turkish](https://cloud.ibm.com/docs/language-translator?topic=language-translator-translation-modelsturkish) tr 
 [Italian](https://cloud.ibm.com/docs/language-translator?topic=language-translator-translation-modelsitalian) it [Ukrainian](https://cloud.ibm.com/docs/language-translator?topic=language-translator-translation-modelsukrainian) uk 
 [Japanese](https://cloud.ibm.com/docs/language-translator?topic=language-translator-translation-modelsjapanese) ja [Urdu](https://cloud.ibm.com/docs/language-translator?topic=language-translator-translation-modelsurdu) ur 
 [Kannada](https://cloud.ibm.com/docs/language-translator?topic=language-translator-translation-modelskannada) kn [Vietnamese](https://cloud.ibm.com/docs/language-translator?topic=language-translator-translation-modelsvietnamese) vi
We released a whole new infrastructure for our numeric system entities across all languages except Chinese, Korean, Japanese and Arabic. The updated @sys-number, @sys-date, @sys-time, @sys-currency, and @sys-percentage entities provide superior number recognition with higher precision. For more information about the new system entities, see [System entity details](https://cloud.ibm.com/docs/assistant?topic=assistant-system-entities).

The old version of the numeric system entities will stop being supported in June 2020 for English, Brazilian Portuguese, Czech, Dutch, French, German, Italian, and Spanish dialog skills.

Action: In each dialog skill where you use numeric system entities, go to the Options>System entities page and turn on the new system entities. Take some time to test the new version of system entities with your own dialogs to make sure they continue to work as expected. As you adopt the new system entities, share your feedback about your experience with the new technology.
* Person and location system entities

The @sys-person and @sys-location system entities, which were available in English as a beta only, are being deprecated. Consider using contextual entities as a way to capture these types of proper nouns. Instead of trying to add a dictionary-based entity that covers every permutation of the names for people or cities, for example, you can teach your skill to recognize the context in which such names are used. For more information about contextual entities, see [Annotation-based method](https://cloud.ibm.com/docs/assistant?topic=assistant-entitiesentities-annotations-overview).

Action: Remove references to @sys-person and @sys-location from your dialogs. Turn off the @sys-person and @sys-location system entities to prevent yourself or others from adding them to a dialog inadvertently.
* Irrelevance detection

We revised the irrelevance detection classification algorithm to make it even smarter out of the box. Now, even before you begin to teach the system about irrelevant requests, it is able to recognize user input that your skill is not designed to address.
[Bulgarian](https://cloud.ibm.com/docs/language-translator?topic=language-translator-translation-modelsbulgarian) bg [Maltese](https://cloud.ibm.com/docs/language-translator?topic=language-translator-translation-modelsmaltese) mt 
 [Catalan](https://cloud.ibm.com/docs/language-translator?topic=language-translator-translation-modelscatalan)[1] ca [Marathi](https://cloud.ibm.com/docs/language-translator?topic=language-translator-translation-modelsmarathi) mr 
 [Chinese (Simplified)](https://cloud.ibm.com/docs/language-translator?topic=language-translator-translation-modelschinese-simplified) zh [Montenegrin](https://cloud.ibm.com/docs/language-translator?topic=language-translator-translation-modelsmontenegrin)[2] cnr 
 [Chinese (Traditional)](https://cloud.ibm.com/docs/language-translator?topic=language-translator-translation-modelschinese-traditional) zh-TW [Nepali](https://cloud.ibm.com/docs/language-translator?topic=language-translator-translation-modelsnepali) ne 
 [Croatian](https://cloud.ibm.com/docs/language-translator?topic=language-translator-translation-modelscroatian) hr [Norwegian Bokmål](https://cloud.ibm.com/docs/language-translator?topic=language-translator-translation-modelsnorwegian-bokmal) nb 
 [Czech](https://cloud.ibm.com/docs/language-translator?topic=language-translator-translation-modelsczech) cs [Polish](https://cloud.ibm.com/docs/language-translator?topic=language-translator-translation-modelspolish) pl
en-US_Multimedia GA <br><br>IBM Cloud<br><br> 27 February 2023 <br><br>IBM Cloud Pak for Data<br><br> 1 May 2023 GA 
 English <br>(all supported dialects) en-WW_Medical_Telephony Beta Beta 
 French <br>(Canadian) fr-CA_Telephony GA GA 
 fr-CA_Multimedia GA GA 
 French <br>(France) fr-FR_Telephony GA GA 
 fr-FR_Multimedia GA GA 
 German de-DE_Telephony GA GA 
 de-DE_Multimedia GA GA 
 Hindi hi-IN_Telephony GA GA 
 Italian it-IT_Telephony GA GA 
 it-IT_Multimedia GA GA 
 Japanese ja-JP_Telephony GA <br><br>IBM Cloud<br><br> 27 February 2023 <br><br>IBM Cloud Pak for Data<br><br> 1 May 2023 GA 
 ja-JP_Multimedia GA <br><br>IBM Cloud<br><br> 27 February 2023 <br><br>IBM Cloud Pak for Data<br><br> 1 May 2023 GA 
 Korean ko-KR_Telephony GA GA 
 ko-KR_Multimedia GA GA 
 Portuguese <br>(Brazilian) pt-BR_Telephony GA GA 
 pt-BR_Multimedia GA GA 
 Spanish <br>(Castilian) es-ES_Telephony GA GA 
 es-ES_Multimedia GA GA 
 Spanish <br>(Argentinian, Chilean, <br>Colombian, Mexican, <br>and Peruvian) es-LA_Telephony GA GA 
 Swedish sv-SE_Telephony GA GA
Parameter summary 

The following sections provide a summary of all of the parameters that are available for speech recognition. The information includes availability for previous- and next-generation models, and support and usage for speech recognition interfaces.



* For more information about previous-generation languages and models, see [Previous-generation languages and models](https://cloud.ibm.com/docs/speech-to-text?topic=speech-to-text-models).
* For more information about next-generation languages and models, see [Next-generation languages and models](https://cloud.ibm.com/docs/speech-to-text?topic=speech-to-text-models-ng).





 access_token 

A required access token that you use to establish an authenticated connection with the WebSocket interface. For more information, see [Open a connection](https://cloud.ibm.com/docs/speech-to-text?topic=speech-to-text-websocketsws-open).



Table 1. The access_token parameter

 Availability and usage Description 

 Previous-generation models Generally available for all languages. 
 Next-generation models Generally available for all languages. 
 WebSocket Query parameter of /v1/recognize connection request 
 Synchronous HTTP Not supported 
 Asynchronous HTTP Not supported 







 acoustic_customization_id 

An optional customization ID for a custom acoustic model that is adapted for the acoustic characteristics of your environment and speakers. By default, no custom model is used. For more information, see [Using a custom acoustic model for speech recognition](https://cloud.ibm.com/docs/speech-to-text?topic=speech-to-text-acousticUse).



Table 2. The acoustic_customization_id parameter

 Availability and usage Description 

 Previous-generation models Generally available or beta for all models that support acoustic model customization. For more information, see [Customization support for previous-generation models](https://cloud.ibm.com/docs/speech-to-text?topic=speech-to-text-custom-supportcustom-language-support-pg).