Talk:Lemmatization

message: Quote from the article:
: The combination of the base form with the part of speech is often called the 'lexeme' of the word.
I don't know who uses this terminology, but e.g. Lauri Bauer uses it slightly differently in his textbook Introducing Linguistic Morphology: "A lexeme is a dictionary word, an abstract unit of vocabulary. It is realised [...] by word-forms, in such a way that the word-form represents the lexeme and any inflectional endings [...] that are required." So I think that base form + pos are properties of a lexeme but not the lexeme itself. I'd say that 'lexeme' is just a word for 'word', in the sense of 'word' where tree and trees are both the same word. -- Mumpitz 20:49, 28 November 2006 (UTC)
thread_title:  lemma vs lexeme 

message: Just a small point -- the sentence (used to cover all the alphabet) was originally, The quick brown fox jumps over the lazy dog. Then dogs plural is unnecessary.  FYI, Julia Rossi (talk) 07:49, 30 January 2009 (UTC)
thread_title:  Lexicology 

message: The typing example has only one inflected term (jumps).  This page deserves some better examples.  I'll try to find some myself.  --Avirr (talk) 20:10, 16 October 2009 (UTC)
replies: text: "...might not be valid (see lazy below)"
What's wrong with 'lazy' below? Maybe it's actually stemmed to 'laz'? -- IdS (talk) 01:19, 12 March 2010 (UTC)

text: A lot of stemmers stem many words than end in -y to end -i instead, for various reasons. The Porter2 stemmer - often considered the newest/best stemmer - does this less often than the original Porter stemmer, but it still happens. 'lazy' is, in fact, stemmed to 'lazi' by the Porter2 stemmer (just tried it out now). The person doing the example probably just made a typo. I'm changing it, and giving a bit of an explanation. Sir Tobek (talk) 08:19, 19 August 2011 (UTC)
replies: text: Alright, I made the example a little better. There's still room for improvement. I can't promise that the Lucene Snowball Analzyer does actually stem it that way - I'm pretty certain it does from what I know about Snowball, but I can't currently get it to work on my computer. Don't have much in the way of sources for what I wrote but... I'm pretty sure it's right. I'm doing a lot of stemming in my dissertation at this very moment. What good procrastination Wikipedia is! Sir Tobek (talk) 08:58, 19 August 2011 (UTC)
thread_title:  Needs better examples 

message: This section contained only broken links and spammish links to commercial services. I deleted it.--2603:8000:8901:F00:B59F:7584:B15F:CD8 (talk) 20:41, 16 April 2021 (UTC)
thread_title: deleted Implementations section

message: :The following is a closed discussion of a requested move. Please do not modify it. Subsequent comments should be made in a new section on the talk page. Editors desiring to contest the closing decision should consider a move review after discussing it on the closer's talk page. No further edits should be made to this discussion.
The result of the move request was: moved. Given evidence being presented showing how the Z-spelling is the usual spelling even in varieties where you would expect the S-spelling. (closed by non-admin page mover) — Ceso femmuin mbolgaig mbung, mellohi! (投稿) 16:58, 6 September 2023 (UTC)
replies: text: Lemmatisation →  – Reopening this because the last discussion failed to mention that the -ize spelling is also favoured by Oxford spelling, which is commonly seen in the UK in academic contexts. Every source cited use the -ize spelling (except for 6 and 7 which do not use the word at all). This includes the cited Collins Dictionary, which also adheres to oxford spelling. Ngrams also shows the -ize spelling to be roughly 7x as frequent. jajaperson (talk) 11:12, 22 August 2023 (UTC)
replies: text: That doesn't seem to be accurate according to the British Google Ngrams. Rreagan007 (talk) 16:43, 30 August 2023 (UTC)

text: Please see my reply above. Linguistics papers contributed to by British linguists are about 5.6x more likely to use -ize than -ise. jajaperson (talk) 14:12, 29 August 2023 (UTC)
thread_title:  Requested move 22 August 2023