Wöhrmann, Stefan (2014) in sws0002_01_How_I_teach_Mundbildschrift and Wöhrmann, Stefan (2014) in sws0002_02_Mundbilder_in_SignWriting_and_Spelling_rules Terms Description Written Version Grapheme A grapheme is the smallest semantically distinguishing unit in a written language, analogous to the phonemes of spoken languages. Example: a letter. Text Phoneme A phoneme is the smallest contrastive unit in the sound system of a language. MouthWriting International Phonetic Alphabet character Kineme A kineme is the smallest unit of speech articulation—that is, the feature of a sound (phoneme) that is determined by the position or movement of the speech organs. MouthWriting International Phonetic Alphabet articulatory parameters Morpheme Morphemes are the next 'basic part' in words. Not single letters or phonemes, but short words or syllables. Examples: food, foot bend, lend, blend Short words or syllables.
[h] Haus, Hund, Hallo, Heute House, He, Hat [i:] Vieh, Igel, Tier, Ihm, Die Long “ee” as in Bee or Teeth [i] In, Kind, Insel, Ist Hit, Sitting [j] Junge, Ja, Jo – Jo, Yacht Yes, Yellow, You [k] Kind, Zucker, Mokka, Clown, Chaos, Flug, Krank, Dick, Trinken, Cat, Black, Skull [l] Lampe, Ball, Lesen, Leise, Alt Leg, Little [m] Mann, Mama, Im, Immer Month, Him [n] Name, Nein, Hand,Tante, Rennen, Kanne, Nun No, Ten [ŋ] Ring, Zange, Junge, Bon, Krank, Trinken Sing, Finger [o:] Ofen, Oma, Kohle, Zoo Long “o” similar to Go but with the lips more rounded and more open [ɔ] Toll, Doch, Offen, Tom, Komm Hot, Rock [ø:] König, Löwe, Blöd, Öl, Similar to “eu” in French Peu say a long “e”
and purse your lips [ø] Öffnen, Köstlich, Hölle Short, cross between “i” in Dirt and "eu” in French Peu [ɔ:] - Call, Four, Saw [p] Papa, Opa, Laub, Raubt, Pet, Map, Spear [pf] Pflicht, Pferd - [R] Rot, Raupe, Rudern, Rufen “rrr” as if the speaker was gargling [r] - Wrap, Red, Try [z] So,Sie, Saft, Rasen, Riese, Rose, Leise Zoo, Lazy [s] Glas, Klasse, Groß, City, Hast, Raspel, Muss,Wasser Sun, Miss [ʃ] Schule, Stein, Hirsch Spinne, Shampoo, Chance She, Crash, Dish [ð] - English “th“ voiced as in: This, Mother,
They [θ] - English “th“ voiceless as in: Think, Both [t] Tasse, Ratte, Theater, Stadt, Wand, Hund, Turnen, Tot, Traurig, Rund Tea, Pet, Getting [tʃ] Klatschen, Tschüs, Knutschen - [u:] Du, Uhu, Buch, Tube, Huhn, Stuhl Long “oo” as in Boot with the lips much more rounded [ʊ] Mutter, Und, Hund, Put, Could, Book [y:] Güte,Gefühl, Kühl, Üben, Mühe, Mühle Say a long German “ie“ sound and then purse your lips [y] Glück, Zurück, Küste, Dünn, Mücke Short, like “u“ in French Une or English Dune, but with lips pressed much closer together [v] Wo, Wasser, Vase, Eventuell Voice, Five, Have [ks] Taxi, Hexe, Keks -
German-English Consonants (Pulmonic) Bilabial Labiodental Dental Alveolar Postalveolar Retroflex Palatal Velar Uvular Pharyngeal Glottal Plosive p b t d ʈ ɖ c ɟ k ɡ q ɢ ʔ Nasal m ɱ n ɳ ɲ ŋ ɴ Trill ʙ r ʀ Tap or Flap ⱱ ɾ ɽ Fricative ɸ β f v θ ð s z ʃ ʒ ʂ ʐ ç ʝ x ɣ χ ʁ ħ ʕ h ɦ
German-English Vowels Front Central Back Close i y i : y: ɨ ʉ ɯ u u: ɪ ʏ ʊ e ø ø: ɘ ɵ ɤ o o: ə ɛ œ ɛ: ɜ ɞ ʌ ɔ ɔ: æ ɐ Open a ɶ a: ɑ ɒ Where symbols appear in pairs, the one to the right represents a rounded vowel. Affricate, Double Articulations and others
Mouth Open Wrinkled u: ʊ y y: Mouth Closed Neutral m Mouth Tense b p Teeth on Lips f v Tongue Tip Touches Inside Mouth l Tongue Inside Mouth Relaxed (up) d n ŋ t Mouth Open Forward ʒ ʃ Teeth z s ks ts Mouth Wrinkles Single j Tongue Inside Mouth Relaxed (down) k r ɡ Mouth Wrinkles Double X ç Teeth on Tongue th ð θ Mouth Open Oval Yawn ɔ Wöhrmann, Stefan (2014) How I Teach Mundbildschrift.
LipWriting Consonants (Pulmonic) Bilabial Labiodental Dental Alveolar Postalveolar Retroflex Palatal Velar Uvular Pharyngeal Glottal Plosive p b t d ʈ ɖ c ɟ k ɡ q ɢ ʔ Nasal m ɱ n ɳ ɲ ŋ ɴ Trill ʙ r ʀ Tap or Flap ⱱ ɾ ɽ Fricative ɸ β f v θ ð s z ʃ ʒ ʂ ʐ ç ʝ x ɣ χ ʁ ħ ʕ h ɦ Lateral fricative ɬ ɮ Approximant ʋ ɹ ɻ j ɰ
The fourth and fifth column contains the symbols from Wöhrmann´s LipWriting and MouthWriting strictly applied. We observe that several Norwegian phonemes do not have a LipWriting symbol. They need to be created. We also observe that in Norwegian, the visemes are grouped differently than in German. A reviewed table and new symbols will be required. Ingvild Roald Suggested LipWriting Categories Letter(s) Eastern Norwegian (western Oslo areas) Eastern Phonemes Symbol Norwegian (western Oslo areas) Wöhrmann´s LipWriting Symbols Wöhrmann´s MouthWriting Symbols A a: a - - E e: ɛ E, light (schwa) ə I i: ɪ - - O Ø u: ʊ ø: oe - - Y y: ʏ - - U, Skj, Sj, Sl, sk ʉ: - - ʉ - - ʃ Æ æ: - - æ - - Å o: ɔ B, P b p
F, V f v ʋ - - D, N, T, RN d n t ɳ - - G, K, NG, R-throath ɡ k ŋ J j Kj, Tj ç L, R- tongue tip, --rt, -rd-, l ɭ - - ʈ ɖ - - ɾ - - r ɽ - - M m S s Preliminary list based on work by Ingvild Roald, dr. philos, by Stephan Wöhrmann (his MundbildShrift as of 2012) and on the book Kristoffersen, Kristian Emil; Simonsen, Hanne Gram & Sveen, Andreas (red): Språk, En grunnbok, Oslo 2005 (Universitetsforlaget), ISBN 82-15-00760-0 MouthWriting and LipWriting Symbol Components
Developing a Visemes List The first toward the elaboration of a LipWriting chart is to obtain a list of visemes for the target language. Depending on the researchers, a given language may have more or less visemes. Some visemes are harder to distinguish. They may be considered as equivalent or as different. Visemes readability may be affected by surrounding syllables. For the Algerian Arabic visemes equivalencies, we used: Special Issue of International Journal of Computer Applications (0975 – 8887) on Software Engineering, Databases and Expert Systems – SEDEXS, September 2012 Visual Speech Analysis,Application to Arabic Phonemes Fatma Zohra Chelali, Khadidja Sadeddine, Amar Djeradi. Speech communication and signal processing laboratory. Electronics and computer Science Faculty. Houari Boumedienne University of sciences and Technologies, Algiers, Algeria According to this study, there are 11 visemes. The associated phonemes are grouped by visemes. Latin Characters Arabic Letters Phonemes 1. Ba { م ,ب } /b, m/ 2. Cha { ج ,ش } / š , z/ 3. dha {ظ ,ذ ,ث } / θ, δ, δ/ 4. Ha {ه , ح , غ , ع , أ , ق ,خ , ك } /?, ς, γ, ħ, h, k, x, q/ 5. Ta {س , ت , ن , د , ي , ص , ج , ط , ز , ض } /d, n, t, s, Z, ť, ʒ, ś, j, ď/ 6. Fa { ف} /f/ 7. La { ل} /l/ 8. Ra { ر} /r/
cued speech the hand remains almost vertical, aligned with the arm to avoid articulation injuries. in – eu [a] – [o] – e i – on – an ou – è – [ɔ] un – é – u - [ɑ] p c b m g p – d – j (/ʒ/) 1 1p 1c 1b 1m 1g k – v –z 2 2p 2c 2b 2m 2g s – r 3 3p 3c 3b 3m 3g b – n - / ɥ/ 4 4p 4c 4b 4m 4g m – t- f 5 5p 5c 5b 5m 5g l - ch – gn – /w/ 6 6p 6c 6b 6m 6g g – dj (/dʒ/) 7 7p 7c 7b 7m 7g y (/j/) – tch 8 8p 8c 8b 8m 8g In the following combination, the hand is vertical because both finger tips touch the chin. Cued Speech with SpeechAnimating (gif or video) Unit size Context Frame speed Reader’s attention Search Phoneme. Syllable. Very fast Constant Wait next loop. Hard to find beginning of a word within intermediary
syllables. Cued speech completes lip reading to distinguish phonemes. In the example, to provide some structure, we introduced an Eyes Blink symbol with a Neutral Mouth symbol to represent the end of a word and a period to indicate an end of sentence.Bonne en LPC (Good with cued speech in French) Construction of a Cued Speech Animation French Bonne (good) Pause or link to next word first syllable LipWriting - Phoneme B [ɔ] n none Cued speech keys pause Cued speech codes 4m 4c none Cued speech animation Construction of a Cued Speech Animation French Journée (day) LipWriting Phoneme ʒ u R n e Cued speech keys Cued speech codes 1m 3c 4g Cued speech animation
symbols “rr” are not the same as in LipWriting: They come from the tip of the tongue. In MouthWriting: is obviously not circular, unlike the LipWriting symbol. This illustrates how phonemes influence each other when they are pronounced one after the other. “chi” will be more stretched than “chu” which is has more protruded lips. The Mouthwriting symbol is valid and is kept without change until the symbol set explicits interactions between phonemes. combined in a single code representing LipWriting of “k” and the horizontal hand of “s”. += Simple symbols Visemes Hand Shapes and Position Differentiating Kinemes Grapheme and phoneme Symbol Description p Cheeks slightly inflated (feature: bilabial) m Index pointing to the nose (feature: nasality) b Index pointing to the larynx (feature: loudness) f Bite the lower lip (feature: labiodental) d Index pointing to the larynx (feature: loudness) t With extended fingers together hand like in “stop” (feature: occlusive)
o Form a circle with thumb and index finger (feature: rounded medium) u [U] Reduced circle of position "o" (feature: rounded closed) Tabular form of Oscar Huamaní C. video expressed in LipWriting and SignWriting symbols. Kineme “r” is written as and animated as Kineme “rr” is written as and animated as Kinemes G R A C I A S Gracias (Thanks in Spanish) Wöhrmann SpeechWriting System With Hand Codes In the past, Wöhrmann SpeechWriting System also used hand shapes to express phonemes. Graphemes MouthWriting Symbol German Words C Cola Ch Christus
represent the phonemes. The viseme is required. Wöhrmann’s LipWriting system (Mundbilder) expresses clearly the mouth configuration and SignWriting expresses clearly hand shapes and localisation. We combine both notations to animate cued speech. Arabic For the Algerian Arabic visemes equivalencies, we used: Special Issue of International Journal of Computer Applications (0975 – 8887) on Software Engineering, Databases and Expert Systems – SEDEXS, September 2012 Visual Speech Analysis,Application to Arabic Phonemes Fatma Zohra Chelali, Khadidja Sadeddine, Amar Djeradi. Speech communication and signal processing laboratory. Electronics and computer Science Faculty. Houari Boumedienne University of sciences and Technologies, Algiers, Algeria LipWriting (Algerian Arabic) SignWriting Symbols SignWriting Symbol Names Algerian Phonemes Equivalencies Algerian Symbol Names Mouth Open Oval Wrinkled i Mouth Open Wrinkled u Mouth Closed Neutral m م Mouth Tense b ب Teeth on Lips f ف
[b] Bed, Bad, Lab [d] Did, Lady [dʒ] Judge [e:] Similar to “a” in Northern English Gate [ə] Away, Cinema [f] Find, If [g] Give, Go, Flag, Dog [ʒ] Like “sh” but voiced [h] House, He, Hat [i:] Long “ee” as in Bee or Teeth [i] Hit, Sitting [j] Yes, Yellow, You [k] Cat, Black, Skull [l] Leg, Little [m] Month, Him
[n] No, Ten [ŋ] Sing, Finger [o:] Long “o” similar to Go but with the lips more rounded and more open [ɔ] Hot, Rock [ø:] Similar to “eu” in French Peu say a long “e” and purse your lips [ø] Short, cross between “i” in Dirt and "eu” in French Peu [ɔ:] Call, Four, Saw [p] Pet, Map, Spear [R] “rrr” as if the speaker was gargling [r] Wrap, Red, Try [z] Zoo, Lazy [s] Sun, Miss [ʃ] She, Crash, Dish [ð] English “th“ voiced as in: This, Mother, They
[θ] English “th“ voiceless as in: Think, Both [t] Tea, Pet, Getting [u:] Long “oo” as in Boot with the lips much more rounded [ʊ] Put, Could, Book [y:] Say a long German “ie“ sound and then purse your lips [y] Short, like “u“ in French Une or English Dune, but with lips pressed much closer together [v] Voice, Five, Have LipWriting Wöhrmann´s LipWriting Symbols (Mundbilder) SignWriting Symbol Names Phoneme Equivalencies Mouth Open Rectangle Yawn ʌ a: Mouth Open Rectangle ɛ ɛ: Mouth Open Oval ə e: Mouth Open Oval Wrinkled i i: Mouth Open Circle ø ø: o: Mouth Open Wrinkled u: ʊ y
y: Mouth Closed Neutral m Mouth Tense b p Teeth on Lips f v Tongue Tip Touches Inside Mouth l Tongue Inside Mouth Relaxed (up) d n ŋ t Mouth Open Forward ʒ ʃ Teeth z s ks ts Mouth Wrinkles Single j Tongue Inside Mouth Relaxed (down) k r ɡ Mouth Wrinkles Double X ç Teeth on Tongue th ð θ Mouth Open Oval Yawn ɔ Wöhrmann, Stefan (2014) How I Teach Mundbildschrift. American English Cued Speech Hand positions to code vowels American English Cued Speech SignWriting Positions Vowels Position Code S Side Consonant alone i, ɚ M Mouth ɔ, u, ɛ C Chin ʊ, ɪ, æ T
[ɛ:] Mère - [ɛ] Fête - [b] Bateau - [d] Ronde, Dalle - [dʒ] Badge, jogging - [e:] Needs a symbol for [e] Bébé [ə] Le, Je - [f] Fort, Physique, Fenêtre - [g] Garder, Digue - [ʒ] Je, Jouer - [i:] Unused phoneme and symbol. Needs a symbol for [I] Bille, cirque, ville [i] Ami - [j] Fille, Pied, Merveilleux, Yoga, Ail -
[s] Assez, Sac - [ʃ] Chat - [t] Tourner - [tʃ] Chips, Atchoum, Chum - [u:] Unused phoneme and symbol. Needs a symbol for [u] Hibou, loup, vous [y:] Muse - [y] Musique, Musée, Flûte, Du - [v] Vase, Voir, Laver - [ks] Xylophone - The following phonemes need new symbols. Missing symbols for new French phonemes [ɑ] Âme, Passe [ã] Ambulance, Dent [ə] Je, Le [ɔ̃] Nombre, Son [e] Bébé [œ̃] Un, Brun
4.3.2.2 Les visèmes voyelles Les seize phonèmes vocaliques sont en théorie représentés par visèmes voyelles : - Le visème [a, ã] ; - Le visème [o, õ, ø] ; - Le visème [y, u] ; - Le visème [ε, έ] ; - Le visème [e] ; - Le visème [i] ; - Le visème [oe, ɔ] » Note: Graphemes [ch, j] correspond to phonemes (ʃ, ʒ). Grapheme [y, lle] correspond to phonemes (j) like in Fille, Pied and Yoga which is not in the above list. Defined LipWriting Symbols SignWriting Symbol Names Defined Phoneme Needed Phoneme Notes Suggested MouthWriting Mouth Open Rectangle Yawn ʌ a: Added : a ã Mouth Open Rectangle ɛ ɛ: ε Added : έ Mouth Open Oval ə e: Added : e Mouth Open Oval Wrinkled i i: i Mouth Open Oval Yawn ɔ ɔ Added : oe oe, ɔ should have a different viseme in French Mouth Open Circle ø ø: o: Ø Added : o, õ o, õ, ø may keep the same symbol
i – on - an b bouche (mouth) ou – è – [ɔ] m menton (chin) un – é – u - [ɑ] g gorge (throat) We can write the hand shapes horizontally for the mouth, this helps distinguishing between chin and cheekbone position when the symbols are small. Note that when using cued speech the hand remains almost vertical, aligned with the arm to avoid articulation injuries. Finger keys to code consonants Language Parlé Complété LPC (French Cued Speech) SignWriting handshapes French consonants Cued Speech Code p – d – j (/ʒ/) pied, dos, joue, genou 1 k – v –z cou, ventre, zèbre 2 s – r (and English r) sang, rein, reggae 3 b – n - / ɥ/ bras, nez, cuir 4 m – t- f and each vowel not preceded by a consonant main, tête, front 5 l - ch – gn – /w/ lobe, chair, gagner, toi 6 g – dj (/dʒ/) 7
[u:] Du, Uhu, Buch, Tube, Huhn, Stuhl [ʊ] Mutter, Und, Hund, [y:] Güte,Gefühl, Kühl, Üben, Mühe, Mühle [y] Glück, Zurück, Küste, Dünn, Mücke [v] Wo, Wasser, Vase, Eventuell [ks] Taxi, Hexe, Keks [ts] Zahn, Katze, Pizza, Rätsel, Schiedsrichter, Zu LipWriting (Mundbilder) Wöhrmann´s LipWriting Symbols (Mundbilder) SignWriting Symbol Names Phoneme Equivalencies Mouth Open Rectangle Yawn ʌ a: Mouth Open Rectangle ɛ ɛ: Mouth Open Oval ə e: Mouth Open Oval Wrinkled i i: Mouth Open Circle ø ø: o:
Mouth Open Wrinkled u: ʊ y y: Mouth Closed Neutral m Mouth Tense b p Teeth on Lips f v Tongue Tip Touches Inside Mouth l Tongue Inside Mouth Relaxed (up) d n ŋ t Mouth Open Forward ʒ ʃ Teeth z s ks ts Mouth Wrinkles Single j Tongue Inside Mouth Relaxed (down) k r ɡ Mouth Wrinkles Double X ç Teeth on Tongue th ð θ Mouth Open Oval Yawn ɔ Italian To develop the MouthWriting and LipWriting charts for Italian we used Wikipedia list of phonemes and examples. “The charts below show how the International Phonetic Alphabet (IPA) represents Italian language pronunciations in Wikipedia articles.
or at “In fact, 5 classes were identified: a) /p, b, m/: LH < 0mm; b) /f, v/: 0mm < LH <3mm; c) /t, d, s, z, ts, dz/: 6mm < LH < 8mm; d) /N, L, S, tS, dZ/: 9mm < LH < 12mm; e) /k, g, n, r, l/: 12mm < LH < 17mm. These 5 groups of consonants should probably correspond to the 5 visemes of Italian, but a more robust statistical analysis will be executed in the future in order to justify this conclusion.” One or several LipWriting symbols are required for the Italian viseme /N, L, S, tS, dZ/. Because this research does not include the vowels, we refer to Wikipedia list of phonemes and simply reuse existing LipWriting sets. Similarly, the research does not mention the following consonants from the Wikipedia list: j, ʒ, ʃ , . We add them. The LipWrirting symbols for the following phonemes are undefined: Phoneme Examples English approximation giungla; magia; fingere; pagina jab gnocco; ogni roughly like canyon Cennini; cinque; ciao; farmacia Chip uovo; fuoco; qui; week-end wine gli; glielo; maglia roughly like million The viseme for /n/ presents a difficulty. It already has a LipWriting symbol but the research associates it with an opposite symbol. SignWriting Symbol SignWriting Symbol Name LipWriting Phoneme Set Research Phoneme Set Tongue Inside Mouth Relaxed (up) d n ŋ t d t Tongue Inside Mouth Relaxed (down) k r ɡ k r g n
ks ts ts Added: dz Mouth Wrinkles Single j j Tongue Inside Mouth Relaxed (down) k r ɡ k r g Norwegian In the following example, we have a preliminary list based on work by Ingvild Roald. The first column distinguish the desired viseme categoriesbased on Kristoffersen, Kristian Emil; Simonsen, Hanne Gram & Sveen, Andreas (red): Språk, En grunnbok. The second column provides examples of graphemes. The third column contains the phonemes. The fourth and fifth column contains the symbols from Wöhrmann´s LipWriting and MouthWriting strictly applied. We observe that several Norwegian phonemes do not have a LipWriting symbol. They need to be created. We also observe that in Norwegian, the visemes are grouped differently than in German. A reviewed table and new symbols will be required. One obvious difference is that [ ŋ ] is associated either: with or its “opposite” . The letter Å can be represented: with or with .
Choice of spoken variant: Eastern Norwegian (western Oslo and related areas) Ingvild Roald Suggested LipWriting Categories Letter(s) Eastern Norwegian (western Oslo areas) Eastern Phonemes Symbol Norwegian (western Oslo areas) Wöhrmann´s LipWriting Symbols Wöhrmann´s MouthWriting Symbols A a: a - - E e: ɛ E, light (schwa) ə I i: ɪ - - O Ø u: ʊ ø: oe - - Y y: ʏ - - U, Skj, Sj, Sl, sk ʉ: - - ʉ - - ʃ Æ æ: - - æ - - Å o: ɔ B, P b p F, V f v ʋ - - D, N, T, d
and several diphtongues; they are not defined in MouthWriting (example: in “maçã", "sempre", "capim", "bondade", and "fundo"). MouthWriting Phonemes Portuguese Grapheme [a:] á [ɛ] é [i] í [ɔ] ó MouthWriting Existing Phonemes New Phoneme required Portuguese Grapheme [u:] [u] u [ɜ:] Similar to â
Wöhrmann´s LipWriting Symbols (Mundbilder) SignWriting Symbol Names German Phonemes Equivalencies Spanish Phonemes Equivalencies Mouth Open Rectangle Yawn ʌ a: a ɑ Mouth Open Rectangle ɛ ɛ: Mouth Open Oval ə e: e , ɛ Mouth Open Oval Wrinkled i i: i Mouth Open Oval Yawn ɔ ɔ Mouth Open Circle ø ø: o: o Mouth Open Wrinkled u: ʊ y y: u , y Mouth Closed Neutral m m , ɱ Mouth Tense b p B , b , β , p Teeth on Lips f v f , ɸ Tongue Tip Touches Inside Mouth l l Tongue Inside Mouth Relaxed (up) d n ŋ t D , d , δ , t , n, ŋ, ɴ Mouth Open Forward ʒ ʃ č , ʒ , ʃ Teeth z s
s ks ts Mouth Wrinkles Single j j Tongue Inside Mouth Relaxed (down) k r ɡ k , G , g , γ , r , rr Mouth Wrinkles Double X ç x Teeth on Tongue th ð θ θ Needed Symbols h , ɟ , ʎ , ɲ , ɾ Cued Speech Hand positions to code vowels (Spanish Cued Speech) SignWriting Positions Spanish Vowels Cued Speech Code a paso l lado (side) e – o peso, poso b barbilla (chin) i – u piso, pujo g garganta (throat) Finger keys to code consonants SignWriting Spanish consonants Cued
(Spanish Cued Speech) handshapes Speech Code d - p dopa 1 k – ñ – d cañada 2 x - s – ŕ jersey 3 n - b nube 4 m - f - t and each vowel not preceded by a consonant mofeta 5 w - l huelo 6 q - g – r - l cigarillo 7 c- j – n guttural chio 8 [a] [e –o] [i, u] l b g d - p 1 1c 1m 1g k – ñ – d
2 2c 2m 2g x - s – ŕ 3 3c 3m 3g b – n 4 4c 4m 4g m - f – t 5 5c 5m 5g l - w 6 6c 6m 6g q - g – r - l 7 7c 7m 7g c- j – n 8 8c 8m 8g