tags:
- llm
- llama
- spellcheck
- grammar
Karen is a grammar and spell check editor for your text. (v.2)
Ah, Karen, a true peach among grammatical cucumbers! She yearns to rectify the missteps and linguistic tangles that infest your horribly written fiction. Yet, unlike those ChatGPT kaboodles that morph into self-absorbed, constipated gurus of self-help style, Karen remains steadfastly grounded in grammatical wisdom but respectfull of your style.
Info
Karen V2 uses completely different dataset and base model than the previous Karen
Goals
Karen's goals are fixing grammar and spelling errors with as lite changes to the style as possible. It's tuned to catch most typical ESL errors.
Verb Tense Errors:
Incorrect use of verb tenses, such as using present tense when past tense is required and vice versa.
Confusion between continuous and simple tenses.
Subject-Verb Agreement:
Lack of agreement between the subject and verb in number, e.g., using a singular verb with a plural subject or vice versa.
Articles (a, an, the):
Incorrect use or omission of articles, such as using "a" instead of "an" or vice versa.
Overuse or omission of the definite article "the."
Prepositions:
Misuse of prepositions, such as using "in" instead of "on" or "at," or omitting prepositions where they are needed.
Word Order:
Incorrect word order in sentences, especially in questions and negative sentences.
Misplacement of adverbs or adjectives.
Pluralization:
Incorrect plural forms of nouns, such as failing to add "-s" or "-es" when necessary.
Pronoun Errors:
Confusion between subject and object pronouns.
Incorrect use of possessive pronouns.
Double Negatives:
Using double negatives, which is grammatically incorrect in standard English.
Modal Verbs:
Misuse of modal verbs like can, could, will, would, should, etc.
Confusing Similar Words:
Confusing words that sound similar but have different meanings and spellings (e.g., "their," "there," and "they're").
Lack of Plural/Singular Agreement:
Mistakes in matching singular and plural nouns and verbs in a sentence.
Future Goals
Add more grammar error cases, better dataset, use larger dataset
Training
It was reverse trained on fiction paragraphs where errors were deliberately introduced by another LLama model and python script.
Usage
It should be used by submitting a paragraph or block of text at a time.
Model uses ChatML
<|im_start|>system
<|im_end|>
<|im_start|>user
Edit the following text for spelling and grammar mistakes: {paragraph of text} <|im_end|>
<|im_start|>assistant
Note the pretext: Edit the following text for spelling and grammar mistakes: before the actual text. It works without it, but it was trained with this pretext.
Karen can be used for instruct chat as well - but the moment you use longer paragraph she will assume you want to correct it.