vania-janet/multiturn-rag-retrieval-data huggingface dataset:
'E' ẽ<br><br>ɛ̃<br><br>æ̃ 0065+0303<br><br>025B+0303<br><br>00E6+0303 fin, plein, faim 
 'o' õ<br><br>ɔ̃ 006F+0303<br><br>0254+0303 bon, pont, mon 
 'oe' œ̃ 0153+0303 un, aucun, brun 



Note:



1. The x is elided in certain contexts.







 Consonants 



Table 2. Consonants (French)

 SPR symbol IPA symbol IPA Unicode Example words 

 b b 0062 bébé, balle, robe 
 d d 0064 dort, dolmen 
 f f 0066 chef, faim, phare 
 g g<br><br>ɡ 0067<br><br>0261 guerre, bague, garer 
 H ɥ 0265 suis, lui, nuée 
 j j<br><br>ʎ 006A<br><br>028E hiérarchie, paille, yoga 
 k k 006B kilo, caler, quai 
 l l 006C litre, illisible, pâle 
 m m 006D maman, femme, miser 
 n n 006E Anne, ni, maniaque 
 'ng' ŋ 014B parking, camping 
 'nj' ɲ 0272 agneau, campagne 
 p p 0070 porte, prêt, guêpe 
 r r<br><br>ɹ<br><br>ʀ<br><br>ʁ<br><br>x<br><br>χ 0072<br><br>0279<br><br>0280<br><br>0281<br><br>0078<br><br>03C7 parer, rare, carreau 
 s s 0073 sans, ambition, façon 
 S ʃ 0283 cheval, lâche, schéma 
 t t 0074 ton, patte, théâtre
The Sign in with Microsoft option that uses Open Authentication to authenticate with the external data source is a beta feature.

Log in to your Microsoft SharePoint account with your user name and password, and then complete two-factor authentication, if necessary.

Security Assertion Markup Language (SAML)
: Specify a username and password for a user that is authorized to access the site you want to crawl, and then click Next.
6. Specify the path you want to crawl in the Site collection path field.
7. Name the collection.
8. If the language of the documents on the site is not English, select the appropriate language.

For a list of supported languages, see [Language support](https://cloud.ibm.com/docs/discovery-data?topic=discovery-data-language-support).
9. Optional: Change the synchronization schedule.

For more information, see [Crawl schedule options](https://cloud.ibm.com/docs/discovery-data?topic=discovery-data-collectionscrawlschedule).
10. Optional: If you want to store any access control information that exists in the SharePoint documents that you crawl, in the Security section, set the Include Access Control List switch to On.

When you enable this option, information about SharePoint access rules that is stored in SharePoint source documents is retained and stored as metadata in the documents that are added to your collection.

This feature is not the same as enabling document-level security for the collection. The access rules in the document metadata are not used by Discovery search. Enabling this feature merely stores the information so that you can leverage the access rules when you build a custom search solution.

Use of this feature increases the size of the documents that are generated in the collection and increases the crawl time. Only enable the feature if your use case requires that you store the SharePoint document ACL information.

If you enable this feature, someone with the administrator role in Microsoft SharePoint must take extra steps to ensure that users who crawl the site have the right permissions to access ACL metadata.

An administrator must complete the following steps:



1. Log in to Microsoft SharePoint.
2.
EMEA region 

EMEA is an abbreviation for Europe, Middle East, and Africa.



  Europe, Middle East, and Africa region 



*  Albania
*  Algeria
*  Andorra
*  Angola
*  Austria
*  Bahrain
*  Belarus
*  Belgium
*  Benin
*  Bosnia/Herzegovina
*  Botswana
*  Bouvet Island
*  British Indian Ocean Territory
*  Bulgaria
*  Burkina
*  Burundi
*  Cameroon
*  Cape Verde
*  Central African Republic
*  Chad
*  Comoros
*  Congo
*  Cote D’Ivoire
*  Croatia
*  Cyprus
*  Czech Republic
*  Democratic Republic of Congo
*  Denmark
*  Djibouti
*  Egypt
*  Equatorial Guinea
*  Eritrea
*  Estonia
*  Ethiopia
*  Faroe Islands
*  Finland
*  France
*  France (European Territory)
*  Gabon
*  Gambia
*  Germany
*  Ghana
*  Gibraltar
*  Greece
*  Guinea
*  Guinea Bissau
*  Hungary
*  Iceland
*  Iran
*  Iraq
*  Ireland
*  Israel
*  Italy
*  Jordan
*  Kenya
*  Kuwait
*  Latvia
*  Lebanon
*  Lesotho
*  Liberia
*  Libya
*  Liechtenstein
*  Lithuania
*  Luxembourg
*  Macedonia
*  Madagascar
*  Malawi
*  Mali
*  Malta
*  Mauritania
*  Mauritius
*  Mayotte
*  Moldavia
*  Monaco
*  Morocco
*  Mozambique
*  Namibia
*  Netherlands
*  Niger
*  Nigeria
*  Norway
*  Oman
*  Other Europe
*  Poland
*  Portugal
*  Qatar
*  Reunion
*  Romania
*  Russia - Russian Federation
*  Rwanda
*  San Marino
*  Saudi Arabia
*  Senegal
*  Seychelles
*  Sierra Leone
*  Slovakia
*  Slovenia
*  Somalia
*  South Africa
*  Spain
*  St Helena
*  Sudan
*  Svalbard
*  Swaziland
*  Sweden
*  Switzerland
*  Syria
*  Tanzania
*  Togo
*  Tunisia
*  Turkey
*  Uganda
*  United Arab Emirates
*  United Kingdom
*  Vatican City
*  Western Sahara
*  Yemen
*  Yugoslavia
*  Zambia
*  Zimbabwe
Natural Language Classifier 

The IBM Watson® Natural Language Classifier uses machine learning algorithms to return the matching predefined classes for short text input. You create and train a classifier to connect predefined classes to example texts so that the service can apply those classes to new inputs. For more information about this service, see Natural Language Classifier.

The Watson packages are deprecated. Please use the [Watson SDKs](https://cloud.ibm.com/docs/watson?topic=watson-using-sdks) to perform Watson related functionality. For more information about which Watson SDK is included in the available runtimes, see the [Functions runtime](https://cloud.ibm.com/docs/openwhisk?topic=openwhisk-runtimes) documentation.

The Natural Language Classifier package contains the following entities. You can find additional details in the Natural Language Classifier API reference by clicking the entity name.



Table 1. Natural Language Classifier package entities

 Entity Type Parameters Description 

 [natural-language-classifier-v1](https://cloud.ibm.com/apidocs/natural-language-classifier) Package username, password, iam_access_token, iam_apikey, iam_url, headers, headers[X-Watson-Learning-Opt-Out], url Work with the Natural Language Classifier service. 
 [classify](https://cloud.ibm.com/apidocs/natural-language-classifierclassify-a-phrase) Action username, password, iam_access_token, iam_apikey, iam_url, headers, headers[X-Watson-Learning-Opt-Out], url, classifier_id, text, Classify a phrase. 
 [classify-collection](https://cloud.ibm.com/apidocs/natural-language-classifierclassify-multiple-phrases) Action username, password, iam_access_token, iam_apikey, iam_url, headers, headers[X-Watson-Learning-Opt-Out], url, classifier_id, collection Classify multiple phrases.
For example, in US English, the sound t of the word write (".1r1Yt") is pronounced as a flap (F) in writer (".1rY.0FR"). SPR input undergoes these modifications just as ordinary input text does. In this example, whether you enter ".1rY.0tR" or ".1rY.0FR" does not affect the speech that is generated.









 Working with IPA 

You can define IPA pronunciations by using phonetic symbols or Unicode values. The following are examples of valid IPA notations for the word tomato in phonetic symbols and Unicode:

<phoneme alphabet="ipa" ph="təˈmeɪ.ɾoʊ">tomato</phoneme>
<phoneme alphabet="ipa" ph="təˈmeɪ.ɾoʊ">tomato</phoneme>

IPA is an industry standard notation. For more information, see the following pages:



* For more information about IPA, see [International Phonetic Alphabet](https://wikipedia.org/wiki/International_Phonetic_Alphabet).
* For more information about phonetic symbols for Unicode, see [Phonetic symbols in Unicode](https://wikipedia.org/wiki/Phonetic_symbols_in_Unicode).







 Specifying syllables 

You can specify syllable boundaries and stress in both SPR and IPA.



 Syllable boundaries 

You can use a . (period, IPA Unicode 002E) to mark the beginning of each syllable in SPR or IPA. However, to preserve the valid phonetics of a language, the service can elect not to honor periods in some cases (for example, if a syllable boundary is placed at an illegal or unnatural position for a language). In general, in cases where you can indicate a valid preference for a syllable boundary or other aspect of a word's pronunciation, the service honors such requests.





 Syllable stress 

Table 1 identifies the symbols that you can use to indicate syllable stress for a pronunciation. IBM recommends that you indicate primary stress for pronunciations in either SPR or IPA. However, indicating syllable stress is optional for both formats; the service determines where stress occurs if you do not indicate it.



Table 1. Syllable stress
Click the Watson Package group.
5. Click the Natural Language Understanding Package.
6. Click Install.
7. After the package is installed, you are redirected to the actions page and can search for your new package, which is named natural-language-understanding-v1.
8. To use the actions in the natural-language-understanding-v1 Package, you must bind service credentials to the actions.



* To bind service credentials to all actions in the package, follow steps 4 and 5 in the [CLI instructions](https://cloud.ibm.com/docs/openwhisk?topic=openwhisk-pkg_natlang_understandingnlus_cli).
* To bind service credentials to individual actions, complete the following steps in the console.



You must complete the following steps for each action that you want to use.



1. Click an Action from the natural-language-understanding-v1 package that you want to use. The details page for that action opens.
2. In the left navigation, click the Parameters section.
3. Enter a new parameter. For the key, enter __bx_creds. For the value, paste in the service credentials JSON object from the service instance that you created earlier.











 Using the Natural Language Understanding package 

To use the actions in this package, run commands in the following format:

ibmcloud fn action invoke natural-language-understanding-v1/<action_name> -b -p <param name> <param>

All actions require a version parameter in the format YYYY-MM-DD. When the API is changed in a backwards-incompatible way, a new version date is released. See more details in the [API reference](https://cloud.ibm.com/apidocs/natural-language-understandingversioning).

This package's functions use the current version of Natural Language Understanding, 2018-03-16. Try out the list-models action.

ibmcloud fn action invoke natural-language-understanding-v1/list-models -b -p version 2018-03-16
Understanding phonetic symbols 

All languages and voices of the IBM Watson® Text to Speech service support both the standard International Phonetic Alphabet (IPA) and IBM Symbolic Phonetic Representation (SPR) notations to represent the sounds of words. Both notations provide phonetic encoding that represents the pronunciation of a word, the sounds that make up the word, how the sounds are divided into syllables, and which syllables are stressed. [Phonetic symbols for supported languages](https://cloud.ibm.com/docs/text-to-speech?topic=text-to-speech-symbolssupportedLanguages) provides links to topics that document the phonetic symbols for each language.



 Defining a word pronunciation 

To define the phonetic pronunciation for a word, either within input text or for a custom model, you use the <phoneme> element of the Speech Synthesis Markup Language (SSML) or equivalent method parameters. The <phoneme> element has two attributes:



* The alphabet attribute specifies the notation of the pronunciation. Use the value ibm to indicate that the pronunciation is defined in SPR. Use the value ipa to indicate that the pronunciation is defined in IPA.
* The ph attribute defines the pronunciation. It consists of a sequence of allowable symbols for a given language. The symbols define how the word that is enclosed in the <phoneme> element is to be pronounced.



Follow these rules when you define a pronunciation:



* Use only the documented SPR or IPA symbols. The service considers invalid any definition that contains phonetic symbols that are not allowed in a language. An SPR or IPA entry that does not conform to the required specification is invalid.
* When multiple IPA symbols (or symbol combinations) are documented for an SPR symbol, all of the IPA symbols are equivalent to the single SPR symbol. The service treats all of these IPA symbols the same and does not realize the subtle or regional differences that IPA is meant to describe.



For more information, see



* [The phoneme element](https://cloud.ibm.com/docs/text-to-speech?topic=text-to-speech-elementsphoneme_element)
list-identifiable-languages Action username, password, iam_access_token, iam_apikey, iam_url, headers, headers[X-Watson-Learning-Opt-Out], url List identifiable languages. 
 create-model Action username, password, iam_access_token, iam_apikey, iam_url, headers, headers[X-Watson-Learning-Opt-Out], url, base_model_id, name, forced_glossary, parallel_corpus Create a model. 
 delete-model Action username, password, iam_access_token, iam_apikey, iam_url, headers, headers[X-Watson-Learning-Opt-Out], url, model_id Delete a model. 
 get-model Action username, password, iam_access_token, iam_apikey, iam_url, headers, headers[X-Watson-Learning-Opt-Out], url, model_id Get model details. 
 list-models Action username, password, iam_access_token, iam_apikey, iam_url, headers, headers[X-Watson-Learning-Opt-Out], url, source, target, default_models List models. 





 Creating a Language Translator service instance 

Before you install the package, you must create a Language Translator service instance and service credentials.



1. Create a Language Translator service instance.
2. When the service instance is created, service credentials are automatically created for you.







 Installing the Language Translator package 

After you have a Language Translator service instance, install the Language Translator package into your namespace.



 Installing from the Cloud Functions CLI 

Install the Language Translator package from the CLI. Be sure to [install the Cloud Functions plug-in for the IBM Cloud CLI](https://cloud.ibm.com/docs/openwhisk?topic=openwhisk-cli_install) first.



1. Clone the Language Translator package repo.

git clone https://github.com/watson-developer-cloud/openwhisk-sdk
2.
en-id English (en) Indonesian (id) general 
 en-it English (en) Italian (it) general 
 en-ja English (en) Japanese (ja) general 
 en-kn English (en) Kannada (kn) general 
 en-ko English (en) Korean (ko) general 
 en-lt English (en) Lithuanian (lt) general 
 en-lv English (en) Latvian (lv) general 
 en-ml English (en) Malayalam (ml) general 
 en-mr English (en) Marathi (mr) general 
 en-ms English (en) Malay (ms) general 
 en-mt English (en) Maltese (mt) general 
 en-ne English (en) Nepali (ne) general 
 en-nb English (en) Norwegian Bokmål (nb) general 
 en-nl English (en) Dutch (nl) general 
 en-pa English (en) Indian Punjabi (pa) general 
 en-pa-PK English (en) Pakistani Punjabi (pa-PK) general 
 en-pl English (en) Polish (pl) general 
 en-pt English (en) Portuguese (pt) general 
 en-ro English (en) Romanian (ro) general 
 en-ru English (en) Russian (ru) general 
 en-si English (en) Sinhala (si) general 
 en-sk English (en) Slovak (sk) general 
 en-sl English (en) Slovenian (sl) general 
 en-sr English (en) Serbian (sr) general 
 en-sv English (en) Swedish (sv) general 
 en-ta English (en) Tamil (ta) general 
 en-te English (en) Telugu (te) general 
 en-th English (en) Thai (th) general 
 en-tr English (en) Turkish (tr) general 
 en-uk English (en) Ukrainian (uk) general 
 en-ur English (en) Urdu (ur) general 
 en-vi English (en) Vietnamese (vi) general 
 en-zh English (en) Simplified Chinese (zh) general 
 en-zh-TW English (en) Traditional Chinese (zh-TW) general 







 Estonian
sr-Latn-ME Serbian-Latin Montenegro 
 sr-Latn-RS Serbian-Latin Serbia 
 si-LK Sinhala Sri Lanka 
 sk-SK Slovak Slovakia 
 sl-SI Slovenian Slovenia 
 es-AR Spanish Argentina 
 es-BO Spanish Bolivia 
 es-CL Spanish Chile 
 es-CO Spanish Colombia 
 es-CR Spanish Costa Rica 
 es-DO Spanish Dominican Republic 
 es-EC Spanish Ecuador 
 es-SV Spanish El Salvador 
 es-GT Spanish Guatemala 
 es-HN Spanish Honduras 
 es-MX Spanish Mexico 
 es-NI Spanish Nicaragua 
 es-PA Spanish Panama 
 es-PY Spanish Paraguay 
 es-PE Spanish Peru 
 es-PR Spanish Puerto Rico 
 es-ES Spanish Spain 
 es-US Spanish United States 
 es-UY Spanish Uruguay 
 es-VE Spanish Venezuela 
 sw-KE Swahili Kenya 
 sw-TZ Swahili Tanzania 
 sv-SE Swedish Sweden 
 ta-IN Tamil India 
 te-IN Telugu India 
 th-TH Thai Thailand 
 tr-TR Turkish Turkey 
 uk-UA Ukrainian Ukraine 
 ur-IN Urdu India 
 ur-PK Urdu Pakistan 
 uz-Cyrl-UZ Uzbek-Cyrillic Uzbekistan 
 uz-Latn-UZ Uzbek-Latin Uzbekistan 
 vi-VN Vietnamese Vietnam 
 cy-GB Welsh United Kingdom 
 yo-NG Yoruba Nigeria 
 zu-ZA Zulu South Africa
Kurata, Gakuto, Abhinav Sethy, Bhuvana Ramabhadran, and George Saon. [Empirical Exploration of Novel Architectures and Objectives for Language Models.](https://www.isca-speech.org/archive_v0/Interspeech_2017/pdfs/0723.PDF) Proceedings of Interspeech 2017 (August 2017): pp. 279-283.
9. Kurata, Gakuto, Bhuvana Ramabhadran, George Saon, and Abhinav Sethy. [Language Modeling with Highway LSTM.](https://arxiv.org/pdf/1709.06436.pdf) Proceedings of IEEE Automatic Speech Recognition and Understanding Workshop (ASRU) (2017).
10. Kurata, Gakuto, and Kartik Audhkhasi. [Guiding CTC Posterior Spike Timings for Improved Posterior Fusion and Knowledge Distillation.](https://arxiv.org/pdf/1904.08311.pdf) Accepted by Interspeech 2019.
11. Padmanabhan, Mukund, and Michael Picheny. [Large-Vocabulary Speech Recognition Algorithms.](http://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.108.2469&rep=rep1&type=pdf) Computer, Vol. 35(4) (2002): pp. 42-50.
12. Picheny, Michael, David Nahamoo, Vaibhava Goel, Brian Kingsbury, Bhuvana Ramabhadran, Steven J. Rennie, and George Saon. [Trends and Advances in Speech Recognition.](https://ieeexplore.ieee.org/document/6032775) IBM Journal of Research and Development, Vol. 55(5) (October 2011): pp. 2:1-2:18.
13. Saon, George, Zoltan Tueske, Daniel Bolanos, and Brian Kingsbury.
w w<br><br>ʋ 0077<br><br>028B Eduard, aktuell, Januar 
 x x<br><br>χ 0078<br><br>03C7 Buch, Bach, Wochen 
 X ç 00E7 ich, Chemie, Kelch, mancher 
 z z 007A See, Satz, lesen 
 Z ʒ 0292 Garage, Genie 
 ? (glottal stop) ʔ 0294 erobern (IPA ʔɛɐˈʔoːbɐn) <br>erinnern (IPA ʔɛɐˈʁɪnɐn) 



Notes:



1. The IPA symbol ð (IPA Unicode 00F0) occurs only in loanwords from foreign languages, mostly English (for example, The New York Times). However, the service realizes that sound as IPA symbol d (IPA Unicode 0064).
2. The IPA symbol θ (IPA Unicode 03B8) occurs only in loanwords from foreign languages, mostly English (for example, thriller). However, the service realizes that sound as IPA symbol ʦ (IPA Unicode 02A6).
Credentials 'Credentials-1' from 'natural-language-understanding' service instance 'Watson Natural Language Understanding' bound to 'natural-language-understanding-v1'.
5. Verify that the package is configured with your Natural Language Understanding service instance credentials.

ibmcloud fn package get natural-language-understanding-v1 parameters

Example output

ok: got package natural-language-understanding-v1, displaying field parameters
[
{
"key": "__bx_creds",
"value": {
"natural-language-understanding": {
"credentials": "Credentials-1",
"instance": "Watson Natural Language Understanding",
"password": "AAAA0AAAAAAA",
"url": "https://gateway.watsonplatform.net/natural-language-understanding/api",
"username": "00a0aa00-0a0a-12aa-1234-a1a2a3a456a7"
}
}
}
]







 Installing from the Cloud Functions console 

You can install your package from the Cloud Functions console.



1. In the Cloud Functions console, go to the [Create page](https://cloud.ibm.com/functions/create).
2. Select the namespace that you want to install the package into.
3. Click Install Packages.
4. Click the Watson Package group.
5. Click the Natural Language Understanding Package.
6. Click Install.
7. After the package is installed, you are redirected to the actions page and can search for your new package, which is named natural-language-understanding-v1.
8. To use the actions in the natural-language-understanding-v1 Package, you must bind service credentials to the actions.
Activity Tracker events for Language Translator 

IBM is announcing the deprecation of the IBM Watson® Language Translator service for IBM Cloud® in all regions. As of 10 June 2023, the Language Translator tile will be removed from the IBM Cloud Platform for new customers; only existing customers will be able to access the product. As of 10 June 2024, the service will reach its End of Support date. As of 10 December 2024, the service will be withdrawn entirely and will no longer be available to any customers.

You can use the IBM Cloud® Activity Tracker service to track how users and applications interact with Language Translator in IBM Cloud®.

IBM Cloud Activity Tracker records user-initiated activities that change the state of a service in IBM Cloud. You can use this service to investigate abnormal activity and critical actions and to comply with regulatory audit requirements. In addition, you can be alerted about actions as they happen. The events that are collected comply with the Cloud Auditing Data Federation (CADF) standard. For more information, see the tutorial [Getting started with IBM Cloud Activity Tracker](https://cloud.ibm.com/docs/activity-tracker?topic=activity-tracker-getting-started).



  List of events 



Table 1. Actions that generate events

 Action                              Description                                     

 language-translator.model.create    Create a model (POST /v3/models)                
 language-translator.model.delete    Delete a model (DELETE /v3/models/{model_id})   







  Viewing events 

Events that are generated by an instance of the Language Translator service are automatically forwarded to the IBM Cloud Activity Tracker service instance that is available in the same location.

IBM Cloud Activity Tracker can have only one instance per location. To view events, you must access the web UI of the IBM Cloud Activity Tracker service in the same location where your service instance is available. For more information, see [Navigating to the UI](https://cloud.ibm.com/docs/activity-tracker?topic=activity-tracker-launch).
[delete-language-model](https://cloud.ibm.com/apidocs/speech-to-textdelete-a-custom-language-model) Action username, password, iam_access_token, iam_apikey, iam_url, headers, headers[X-Watson-Learning-Opt-Out], url, customization_id Delete a custom language model. 
 [get-language-model](https://cloud.ibm.com/apidocs/speech-to-textget-a-custom-language-model) Action username, password, iam_access_token, iam_apikey, iam_url, headers, headers[X-Watson-Learning-Opt-Out], url, customization_id Get a custom language model. 
 [list-language-models](https://cloud.ibm.com/apidocs/speech-to-textlist-custom-language-models) Action username, password, iam_access_token, iam_apikey, iam_url, headers, headers[X-Watson-Learning-Opt-Out], url, language List custom language models. 
 [reset-language-model](https://cloud.ibm.com/apidocs/speech-to-textreset-a-custom-language-model) Action username, password, iam_access_token, iam_apikey, iam_url, headers, headers[X-Watson-Learning-Opt-Out], url, customization_id Reset a custom language model. 
 [train-language-model](https://cloud.ibm.com/apidocs/speech-to-texttrain-a-custom-language-model) Action username, password, iam_access_token, iam_apikey, iam_url, headers, headers[X-Watson-Learning-Opt-Out], url, customization_id, word_type_to_add, customization_weight Train a custom language model.