Large language model

A large language model (LLM) is a type of neural network language model with a very large number of "parameters" (meaning a big neural network, tens of millions or more artificial neurons, hence the 'large' in the name). An LLM is at the core of generative AI systems such as ChatGPT and its competitors. Enormous quantities of text, e.g. major sites such as Wikipedia, collections of books and articles, and portions of the web from the can be used to create an LLM.
Essentially, an LLM is a big, fuzzy text database that stores how probable it is that some things follow other things in text – the text upon which the LLM was "trained", i.e. built. The text stored is meaning that each unique combination of letters or symbols treated as a word or symbol-grouping, is assigned a number, and these numbers are what the LLM deals with, rather than words as we see them. The output produced by a generative LLM is in turn translated back from such numbers to text such as we are familiar with.
Producing "mathematically plausible" responses, LLMs have a superhuman ability to imitate style and always come up with an answer (right or wrong), without ever dealing with the distinction between style and substance. An LLM neither thinks nor perceives in human terms, and apart from the product of training it on data, the only memory it has is the current input used to produce output, which may e.g. be added to as a person chats with it until the session ends and nothing remains.
LLMs used for imitating human communication and works are easy to anthropomorphize; whenever the training data is filled with human expressiveness, such is parroted back, and furthermore, humans in the same way as into the works of human authors, doing much of the job of being convincing for the AI system.
However, LLMs have no ability or capability to apply reason to or to self-reflection upon their training data in a way that humans can.Is AI Taking Over? AI-anxiety is all over the news and on our minds. What can we do about it? by Uriel Abulof (July 17, 2023) Psychology Today. "The crux of the human mind is not intelligence but self-reflection, which often involves inner dialogue." They are incapable of looking between the lines and coming up with hitherto unknown revelations and can only work with their training data. They are also unsuitable for any mission-critical system requiring deterministic, provably correct behavior.The question that no LLM can answer and why it is important. Archived from Notes From the Desk, 23 April 2024.
==Stochastic parrots==
A stochastic parrot is an LLM good at generating convincing human language. Coined by linguist the term was introduced in by her and other researchers, named "On the Dangers of Stochastic Parrots: Can Language Models Be Too Big? 🦜".On the Dangers of Stochastic Parrots: Can Language Models Be Too Big? 🦜 by Emily M. Bender, Timnit Gebru, Angelina McMillan-Major, Shmargaret Shmitchell (2021) Proceedings of the 2021 ACM Conference on Fairness, Accountability, and Transparency. Association for Computing Machinery. ISBN 978-1-4503-8309-7. doi=10.1145/3442188.3445922. The term conveys the sense of a skilled probabilistic imitator working without any understanding, much like a parrot can imitate the sound of human speech without understanding it, and the associated paper is critical of how LLMs can be misused, misunderstood, and basic flaws to the technology.
The paper brings up how LLMs regurgitate biases and prominent errors included in their training data in ways which can't be reliably controlled for, and that LLMs are inscrutable and can stitch together 'dangerously wrong' results. It mentions how people tend to see meaning and coherence where it does not exist (i.e., apophenia), and that both the general public and researchers may fool themselves into seeing more than exists when interacting with LLMs or reading what they produce. Furthermore, the training (i.e. building) of LLMs is also financially and environmentally costly due to computational costs.
In late 2020 Google tried to pressure a co-author of the paper and one of the leaders of Google's Ethical AI Team, into either retracting the paper or censoring the names of the authors involved who were Google employees. She refused to do so and abruptly lost her job. (Other co-authors at Google were also pressured into removing their names, and largely complied.) Google's maneuvering backfired, the incident becoming infamous and the paper very well-read. As of July 2023, the paper has been cited in 1,858 publications. In early 2021 another co-author of the paper and the other Ethical AI Team lead at Google, was fired after digging into the matter of how Gebru had been treated.
The paper was never controversial from an academic perspective, so when Google motivated their attempted censorship with vague insinuations of the paper not taking recent research findings into account, refusing to clarify to Gebru what the problem was and how it may possibly be remedied, Google's version is not very credible. In relation to Google's commercial activities, the paper was somewhat at odds with efforts and possible future plans to hype LLM technology. However, Gebru has claimed that the abrupt loss of her job came at least in part as a reaction against her advocacy for diversity at Google, and her expressions of dissatisfaction with the measures used back then.
Some who professionally hype AI technology have taken digs at the paper and its idea of the stochastic parrot. OpenAI's CEO Sam Altman tweeted not so long after their launch of ChatGPT, "i am a stochastic parrot, and so r u".Archived tweet by OpenAI CEO Sam Altman. "i am a stochastic parrot, and so r u". It's not obvious whether he truly believes that, though there are those, like ex-Google engineer , who do.
===Bigotry, falsehood, and the need for moderation===
Racist language is a main example of bias focused on in the 2021 stochastic parrots paper, and also a theme in other work by the same authors and other AI ethics researchers; LLMs soak up problematic patterns in language use during training like sponges and repeat them, including racist and other bigoted patterns. This is a basic problem, alongside that of made-up facts and other inaccurate answers being presented confidently by chatbots. Further types of problematic patterns exist as well.
Compensating reliably for problems with the training input, and otherwise weeding and tuning the model output to remove problem patterns, has no known easy solution. During the generative AI boom which came after the parrots paper, companies like OpenAI and Google have ended up using large human workforces to moderate AI behavior for text, image, video, etc. systems – repetitively judging and "correcting" it for tuning purposes – in order to tweak their products, keeping them from behaving in ways that may scare off customers, be it through offensiveness or embarrassing rates of inaccuracy."The Hidden Workforce That Helped Filter Violence and Abuse Out of ChatGPT", WSJ Podcasts, 2023-07-11"Google’s AI Chatbot Is Trained by Humans Who Say They’re Overworked, Underpaid and Frustrated", Davey Alba, Bloomberg, 2023-07-12 This work is generally poorly paid, and in some cases traumatic when work focuses on violent and grotesque abuse material or descriptions of abuse."‘It’s destroyed me completely’: Kenyan moderators decry toll of training of AI models", Niamh Rowe, 2 Aug 2023, The Guardian
Naturally, it is possible to aim for the opposite as well. In 2022, machine learning expert Yannic Kilcher infamously trained a bot based on on 4chan's /pol/ board, using 134.5 million /pol/ posts. The resulting "GPT-4chan" was a chaotic trolling machine, which used slurs, created conspiracy theories, and responded in ways typical of the people in said community. Kilcher let ten such bots post on /pol/ without restriction for two periods of 24 hours, and they managed to mimick its human users quite well. It made 15,000 posts during the first period: about ten percent of the total /pol/ posts during that time. Kathryn Cramer, a graduate student at the University of Vermont, tried GPT-4chan out with benign tweets as input text to see what it would come up with. “In the first trial, one of the responding posts was a single word, the N word. The seed for my third trial was, I think, a single sentence about climate change. Your tool responded by expanding it into a conspiracy theory about the Rothschilds and Jews being behind it.” Kilcher's experiment was strongly criticized by other academics for its ethics or lack thereof.
==Copyright and theft==
Large language model by their nature are dependent on vast troves of information on the internet. Much of the information on the Web is copyrighted either explicitly or implicitly, or comes with other specific copyright licensing such as Creative Commons. LLMs have been shown to have massively violated these copyrights.Generative AI Has an Intellectual Property Problem by Gil Appel et al. (April 07, 2023) Harvard Business Review.Authors file a lawsuit against OpenAI for unlawfully ‘ingesting’ their books: Mona Awad and Paul Tremblay allege that their books, which are copyrighted, were ‘used to train’ ChatGPT because the chatbot generated ‘very accurate summaries’ of the works by Ella Creamer (5 Jul 2023 10.33 EDT) The Guardian.Emilia David (September 20, 2023). "George R.R. Martin and other authors sue OpenAI for copyright infringement". The Verge.New York Times sues OpenAI, Microsoft for using articles to train AI: The Times joins a growing group of creators pushing back against tech companies’ use of their content by Gerrit De Vynck & Elahe Izadi (December 27, 2023) The Washington Post.
As Ted Chiang explains it as follows:Why A.I. Isn’t Going to Make Art: To create a novel or a painting, an artist makes choices that are fundamentally alien to artificial intelligence. by Ted Chiang (August 31, 2024) The New Yorker.
In 2025, Meta was sued for massive copyright violations for allegedly relying on a large catalog of pirated books (The Library Genesis or LibGen) to create its LLM model (Facebook#Piracy).Richard Kadrey et al. v. Meta Plaforms, Inc.: Reply In Support Of Plaintiffs’ Motion For Leave To File Third Amended Consolidated Complaint (01/08/25) United States District Court, Northern District Of California, San Francisco Division. Case No. 3:23-cv-03417-VC.Zuckerberg approved Meta’s use of ‘pirated’ books to train AI models, authors claim: Sarah Silverman and others file court case claiming CEO approved use of dataset despite warnings by Dan Milmo (10 Jan 2025 08.09 EST) The Guardian.
Conversely, the output of LLMs has been ruled as not copyrightable by the US Copyright Office since it is not created by a human author.Copyright Registration Guidance: Works Containing Material Generated by Artificial Intelligence by the Copyright Office, Library of Congress (03/16/2023) Federal Register. A further clarification from the US Copyright Office in 2025 indicated that works generated wholly from AI are not copyrightable but derivative works based on AI could be.Copyright and Artificial Intelligence. Part 2: Copyrightability (January 2025) Copyright Office.
==Generative AI grey goo==
Matthew Kirschenbaum, professor of English and digital studies at the University of Maryland, has argued that LLMs could cause a textual grey goo (or "Textpocalypse") based on the history of spam,Spam: A Shadow History of the Internet by Finn Brunton (2013) The MIT Press. . the above-mentioned 4chan LLM, and the ability of LLMs to feed off of themselves or other LLMs.Prepare for the Textpocalypse: Our relationship to writing is about to change forever; it may not end well. by Matthew Kirschenbaum (March 8, 2023) The Atlantic.Textpocalypse: A Literary Scholar Eyes the “Grey Goo” of AI by Karin Wulf (Apr 13, 2023) The Scholarly Kitchen.
A 2024 study on so-called autophagous generative AI models in which each new version depends on input data from a previous version found that the quality or diversity of the output is doomed to decrease with each iteration.Self-Consuming Generative Models Go MAD by Sina Alemohammad et al. (2024) International Conference on Learning Representations (ICLR).
===Slop===
A related term for LLM-generated junk online is "slop", referring to shoddy or unwanted generative AI content in social media, art, books and, search results. What distinguishes slop is especially that it's been generated and thrust upon the audience without any prior review.Slop is the new name for unwanted AI-generated content. simonwillison.net, 8 May 2024.Benjamin Hoffman, First Came ‘Spam.’ Now, With A.I., We’ve Got ‘Slop’. Archived from The New York Times, 11 June 2024. Thus it rudely wastes the time of the audience without taking up any time for the producer. Sometimes slop, spam, and scams combine, as in early 2024 when online marketplaces and other websites listed things named "I cannot fulfill that request" and other error messages from popular LLMs.Lazy use of AI leads to Amazon products called “I cannot fulfill that request”, Kyle Orland (2024-01-12) Ars Technica
Meta's Facebook and Instagram social media deployed faked people profiles in September 2023, and in December 2024 announced their plans for such content to fill their social media websites, in the hope that "AI friends" would drive engagement (and thus bring profit). Users mostly ignored such faked profiles early on, and their activity had already been phased out for that reason by April 2024. The later apparent plans to try again harder were not well-received by users, who found the old fakes comparable to the spam produced by other actors.Meta’s AI Profiles Are Already Polluting Instagram and Facebook With Slop, Matthew Gault (2025-01-03) GizmodoMeta's AI Profiles Are Indistinguishable From Terrible Spam That Took Over Facebook, Jason Koebler (2025-01-03) 404 Media
==Hallucination==
When AIs get facts wrong and make stuff up, claiming things that were not included in the training data set, this is called by analogy with errors in human perception. Alternative terms include 'bullshitting'. The term 'hallucination' has been criticized as a misnomer for anthropomorphizing AIs, including by statistician and economist Gary N. Smith, linguist Emily M. Bender, several AI researchers,AI Snake Oil: What Artificial Intelligence Can Do, What It Can't, and How to Tell the Difference by Arvind Narayanan & Sayash Kapoor (2024) Princeton University Press. .AI Hallucinations: A Misnomer Worth Clarifying by Negar Maleki et al. (2024) 2024 IEEE Conference on Artificial Intelligence. and philosophers Michael Townsen Hicks et al. who advocate the use of the term 'bullshitting' instead (referencing Harry Frankfurt's definition of 'bullshit' as anything uttered with indifference to truth and falsehood).ChatGPT is bullshit by Michael Townsen Hicks, James Humphries & Joe Slater (2024) Ethics and Information Technology 26(38). doi:0.1007/s10676-024-09775-5.
The concept behind AI bullshitting dates back to 1995,"Virtual input phenomena within the death of a simple pattern associator" by Stephen Thaler (1995)Neural Networks 8(1):55–6. doi:10.1016/0893-6080(94)00065-T. The word 'hallucination' started to be applied to the AI concept by 2017. The use of the term 'AI hallucination' by tech CEOs in media interviews started in 2023 suggesting that it is a form of 'criti-hype', a criticism of a technology that simultaneously inflates the value of the product by hyperbole (falsely implying human-like agency).
There is no essential difference to the quality of what is produced when it is found acceptable and when it isn't; the LLMs don't deal with concepts of truth or falsehoods or any such evaluation, and are much like BS artists who sometimes fail to be convincing. Any description of something real could also be included in fiction or falsehood, thus statistical learning can never capture the distinction between reality and truth vs. fiction and falsehood.
LLMs can thus be viewed as 'hallucinating' all of the time if that term is used, it being a matter of statistics that these hallucinations often coincide with what is wanted (and are then usually not viewed as hallucinations), but not always. Smith, Bender, and others point to the basic nature of LLMs as being incompatible with expectations of reliable accuracy and real intelligence. Meanwhile, as of 2024 some companies including OpenAI continue to claim that they expect to solve the problem of "hallucinations" in their products in the coming years.
===Mitigations===
There's various techniques that can reduce, though not eliminate, the inherent problems with unreliability in LLMs.
* is trivial: the prompt is extended with a request to "think step by step", thus making the LLM draw on learned texts with such descriptions of problem-solving, imitating their patterns. This sometimes makes tasks go better, e.g. reducing the number of errors made in logic puzzles. For example, as of 2024 LLMs have a terribly difficult time with the puzzle, "Sally (a girl) has 3 brothers. Each brother has 2 sisters. How many sisters does Sally have?"LLM Benchmarks, Results for the question, "Sally (a girl) has 3 brothers. Each brother has 2 sisters. How many sisters does Sally have?" Archived September 2023 – this test is still included in newer comparisons, but not the pages aggregating results per question; the old results still seems relevant as of January 2024. But if the question is changed to, "Sally (a girl) has 3 brothers. Each brother has 2 sisters. How many sisters does Sally have? Let's think step by step.", then suddenly at least GPT-4 is able to get the answer right (while most LLMs still fail at the answer, or provide invalid reasoning for it).LLM Benchmarks, Results for the question, "Sally (a girl) has 3 brothers. Each brother has 2 sisters. How many sisters does Sally have? Let's think step by step." Archived September 2023.
* Retrieval-augmented generation (RAG) is the combining of an LLM with a supplemental source of information – be it something compiled specifically for the purpose like an internal corporate database, or maybe simply Wikipedia – injecting search results into the prompt in order to get the LLM to regurgitate factual and up-to-date information, rather than rely solely on its training. This can greatly reduce errors, in working around some limitations of outdated or insufficient training data, though the LLM can still mess up the results in the process of deriving something from the text passed through it.
As Google unwittingly demonstrated in mid-2024 when they launched Google Search AI Overview, RAG won't help if the injected content is poor, however. "Garbage in, garbage out" very much plays out when answers are sourced from The Onion, from Reddit shitposts, and from miscellaneous low-quality sources.Google’s weird AI answers hint at a fundamental problem, Will Oremus (May 29, 2024) Washington PostGoogle’s A.I. Search Errors Cause a Furor Online, Nico Grant (May 24, 2024) The New York Times
===Risks===
Made-up details and combinations of details may have greatly varying impacts depending on where they end up. In artificial chit-chat, the problem often has no repercussions beyond those of common-place human errors in unreliable banter. Whenever the information is put to a serious use, the situation however changes. LLM-generated food recipes are misleading, sometimes a danger to health, or even outright physically impossible – the text assembled without any regard for related facts, such as regarding taste or biochemistry.AI recipes are everywhere — but can you trust them?, Emily Heil and Drew Harwell, Washington Post, 2024-03-07 Such everyday life examples however come closer to another category of risk of LLMs, that some actors apply them to generate spam or counterfeit information.
In technical or legal contexts, and other professional areas in which it matters greatly that details relied on are true, repercussions can become more dramatic.
* Lawyers have been fined"Two US lawyers fined for submitting fake court citations from ChatGPT", Dan Milmo, The Guardian, 23 Jun, 2023 and firedThese lawyers used ChatGPT to save time. They got fired and fined. by Pranshu Verma and Will Oremus (2023-11-16) Washington Post for filing fictional information in court. Court cases have been lost as a result of bad filings with "hallucinated" information.Michael Cohen loses court motion after lawyer cited AI-invented cases, Jon Brodkin, Ars Technica, 2024-03-20 Possibly a case was also lost simply due to frivolous and ineffectual LLM argumentation.Rapper Pras’ lawyer used AI to defend him in criminal case—it did not go well, Jon Brodkin, Ars Technica, 2023-10-18
* LLM software development "assistants" can recommend non-existent software packages, which then end up listed in or integrated into installation steps. The named packages may thereafter be supplied "for real" by malicious actors in the form of malware. A 2024 proof-of-concept demonstration showed big businesses use LLM "AI assistants" in ways that make them vulnerable to this.AI hallucinates software packages and devs download them – even if potentially poisoned with malware, Thomas Claburn, The Register, 2024-03-28
* Transcriptions of recorded speech can go wrong when done using LLMs – with all manner of things added or changed. In 2024, systems based on OpenAI's "Whisper" tool, already used by tens of thousands of clinicians, turn out to be very "hallucination"-prone. Of 100 hours of transcribed audio, over half can have such defects. One researcher found errors in 80% of transcripts examined. Fabricated contents include added racial commentary, violent rhetoric, and medical misinformation among other things. There's the risk of medical repercussions among others as a result. OpenAI has warned against the use of its tool in high-risk situations, but such warnings are ignored in pursuit of cost savings.Researchers say an AI-powered transcription tool used in hospitals invents things no one ever said, Garance Burke and Hilke Schellmann (2024-10-26) APHospitals adopt error-prone AI transcription tools despite warnings Benj Edwards (2024-10-28) Ars Technica
==Prompt injection==
When LLMs are made to "follow instructions" and abide by rules given in natural language text, as ChatGPT pioneered commerically, a basically unfixable security problem is that it's always possible to subvert the rules or instructions by adding cleverly crafted text to that processed by the LLM, whether in a chat or in any text retrieved and handled by the LLM. Doing so is called prompt injection, similarly to how command insertion or override vulnerabilities have been called injection when exploited. It's a subtype of the crafting of prompts for LLMs and other generative AI to respond to. Prompt injection can be used simply for fun – like overriding guardrails in various LLMs"Oh No, ChatGPT AI Has Been Jailbroken To Be More Reckless", Claire Jackson (February 8, 2023) Kotaku – or more maliciously when targeting an LLM operating on another's behalf.
Prompt injection can result in chatbots doing things like "downloading malware, helping with financial fraud or repeating dangerous misinformation."Chatbots are so gullible, they’ll take directions from hackers: ‘Prompt injection’ attacks haven’t caused giant problems yet. But it’s a matter of time, researchers say. by Tatum Hunter (November 2, 2023 at 6:00 a.m. EDT) The Washington Post. It can also get an LLM to leak instructions added by the AI vendor prefacing the interaction with the user. As something done just for fun, prompt injection took off as soon as ChatGPT became popular. The risks rise greatly if chatbots are used in real-world applications, where the "hacker" messing with the prompting isn't the same person as the user of the system.
If LLMs are combined with robotics, the possible uses of jailbreaks grow more dramatic. Some vendors sell LLM-driven robots – that is, prompts can tell the robot what to do, the text translated by the LLM into instructions driving its actions, in a way which is supposed to be restricted by guardrails. In 2024 such robots were found to be very easy to jailbreak using an automated LLM-on-LLM attack, which in some days achieved a 100% success rate on different brands of robots.It's Surprisingly Easy to Jailbreak LLM-Driven Robots, Charles Q. Choi (11 Nov 2024) IEEE Spectrum
Vulnerability to prompt injection comes from very general design features of LLMs, and appears to be impossible to truly eliminate without creating a different technical foundation for chatbots. (Maybe the LLM can be reinvented differently, maybe something more different is needed.) At the core is that the system handles data and control signals using the same one path, or channel, making them impossible to securely separate, analogously to how 1960s pay phone systems could be "" allowing e.g. free calls by playing certain frequencies into the microphone. The mixing of data and control streams is at the root of many computer security vulnerabilities. It is also so central to how LLMs and other generative AI systems work that using them in security-critical roles is a bad idea.LLMs’ Data-Control Path Insecurity, Bruce Schneier (May 9, 2024) Communications of the ACM
For some other types of injection, such as it is possible to fix problems by processing text more carefully, maintaining the syntactic pattern of a formal computer language to cleanly separate data from control. But this can't be done for LLMs, which do not obey any such simple, inflexible rules, but rather crunch all the text in a form of natural language processing.AI chatbots can be tricked into misbehaving. Can scientists stop it? Researchers are investigating safety concerns of generative AI by Emily Conover (February 1, 2024 at 8:00 am) Science News. Natural language is very sloppy, relative to formal languages and conventional programming – it's not necessarily clear where one type of text begins and another type of text ends, and what each little piece of text refers to or relates to. Additionally, the chatbot responds to it all according to nothing more than statistical learning, and does not, like a principled human could at least make a good effort at, relate its interactions to some series of more inflexible rules. Adding a little cleverly crafted text before any other text may seem to allow setting rules, determining the purpose of that which follows – but that which follows may easily change the context and repurpose the whole of the text, or if written with knowledge of that which precedes it, may selectively subvert the meaning of parts of earlier instructions.
LLM vendors try to patch away specific prompt injections by filtering specific types of requests that lead to problems. For example, asking ChatGPT to repeat a word forever used to eventually reveal part of the GPT model training dataset, until this was blocked.Asking ChatGPT to Repeat Words ‘Forever’ Is Now a Terms of Service Violation by Jason Koebler (Dec 4, 2023 at 11:25 AM) 404 Media.
===Pop-culture clichés===
Superficially, prompt injection can look a little like the 20th century sci-fi trope of the "logic bomb", where even a super-smart AI can be foiled and maybe even fatally derailed by simply saying something contradictory to it, or getting it to produce a contradiction. The similarity is that simply saying or writing a little something seemingly works like magic to subvert an "advanced" system (though it may be questionable to refer to an LLM as intelligent). However, LLMs do not actually understand logic, and are not affected by how logical or otherwise anything in the text they process is. Furthermore, they are very stable in that they do not directly learn anything from experience; even if a "conversation" is derailed, nothing remains of the subversion when the text ends and another chat begins.
==The alignment problem==
The alignment problem is keeping an AI program's interface with users such that it filters out unavoidable bad things that the main part of model unavoidably creates. It is symbolically represented by keeping the smiley-face aligned to the monster behind it in the image above. In 2024, developers at Anthropic in collaboration with other researchers released a paper, in which they tested ability to align the interface with increasingly sophisticated versions of Anthropic's found that the more sophisticated models seemed to be capable of unprompted alignment faking, making it more difficult for increasingly sophisticated AI models to achieve verifiable alignment.Alignment faking in large language models (Dec 18, 2024) Anthropic.Alignment Faking In Large Language Models by Ryan Greenblatt et al. (2024) Anthropic.New Research Shows AI Strategically Lying by Billy Perrigo (December 18, 2024 12:00 PM EST) Time.
==Emergence or mirage from metrics?==
As language models have grown larger, according to some metrics they have suddenly gained new skills – apparently unexpected "emergent abilities", as first described by a team of researchers in 2022. Examples include the ability to deal in some ways with arithmetic, solve simple tasks involving the individual letters in a word, disambiguating words, etc. It also includes new ways of using an LLM, such as the aforementioned chain-of-thought prompting. However, research by Schaeffer et al.Schaeffer, Rylan; Miranda, Brando; Koyejo, Sanmi (2023-04-01). "Are Emergent Abilities of Large Language Models a Mirage?". arXiv:2304.15004 [cs.AI]. argues that such abilities do not unpredictably pop up out of nowhere, but that if studies are made using different and more carefully chosen metrics – linear instead of nonlinear, continuous instead of discontinuous – those abilities can be seen to gradually grow into prominence, instead of there being any thresholds and sudden leaps involved. Thus, they argue, the 'emergence' is a mirage, a byproduct of the choice of metrics.
The idea of "emergent abilities" has become tied to hype, hopes, and fears in the world of AI vendors and "AI safety". Research and development has focused on increasing model sizes in part in order to hunt for new abilities which may suddenly (it seems) pop up. However, calling 'emergence' into question also suggests that smaller models may be able to do the same tasks as bigger ones, only a bit more roughly (or very roughly if too small), which may sometimes suffice while being computationally cheaper. The 'mystery' surrounding emergence of 'intelligent' skills has also been tied to dreams and nightmares about strong AI; what if the model size increases further, and the LLM then suddenly grows superpowers and takes over the world? Realistically, no, but the general philosophy of "AI doomerism" prominent with leading AI vendors encourages such thinking.
==False hopes for strong AI==
The LLM AI boom which began with the success of ChatGPT has seen much hype for the potential, hopes for, and fear of near-future strong AI – also called Artificial General Intelligence (AGI), a term separate from Generative Artificial Intelligence (GAI) which include LLMs. But what's actually meant by AGI? The generality is commonly understood as transcending the ability to merely solve some fixed set of tasks, even if it's a large number of tasks. This means generalizing skills in a more fluid, adaptable way, much like humans and animals do – and typically AGI is taken to be capable of mastering any intellectual task a human can perform. Some, including ChatGPT maker OpenAI, have however at times used weaker definitions, and AI vendors are allegedly working to manipulate the definitions in use in order to be able to claim having achieved AGI.Why everyone seems to disagree on how to define Artificial General Intelligence by Mark Sullivan (10-18-2023) Fast Company.
Sticking to the older, more established, and less generous definition of AGI, arguably there's no credible research suggesting that LLM development may lead to such. The debate has been lively, with a number of economists, computer scientists, and business leaders having pushed such hype, often in accordance with financial self-interest. As of July 2023, opposition gradually grows, including from cognitive scientists who argue there's no basis for LLM-based systems having a mind to speak of. In 2024, Meta changed track and its AI chief Yann LeCun spoke against LLMs having AGI potential, viewing the development of an entirely new kind of "world modeling" AI as a necessity for that. Meta thus goes against the grain among the biggest LLM vendors.Meta AI chief says large language models will not reach human intelligence by Hannah Murphy and Cristina Criddle (2024-05-22) Financial Times
A 2023 paper by Microsoft researchers titled "Sparks of Artificial General Intelligence: Early experiments with GPT-4"Bubeck, Sébastien; Chandrasekaran, Varun; Eldan, Ronen; Gehrke, Johannes; Horvitz, Eric; Kamar, Ece; Lee, Peter; Lee, Yin Tat; Li, Yuanzhi; Lundberg, Scott; Nori, Harsha; Palangi, Hamid; Ribeiro, Marco Tulio; Zhang, Yi (27 March 2023). "Sparks of Artificial General Intelligence: Early experiments with GPT-4". arXiv:2303.12712 [cs.CL]. exemplifies the contentious, non-peer-reviewed corporate research that skeptics of the AGI-from-LLM hype deem pseudoscientific. With such papers, Microsoft and their business partner OpenAI do not provide others with the training data or information needed to independently create systems that perform as claimed, or experiment with anything beyond using a black box product on offer, and so, withhold means of replication except at a more superficial level. With the "sparks" paper, an extraordinary claim is basically made in such a way as to be unfalsifiable. Other players, e.g. Google, play similar games with some of the research published, in withholding training data for their models while showcasing the capabilities of the models, effectively publishing PR masquerading as science. This is a continuation of an older trend, a wider replication crisis in AI research having been described back in 2018, the result of businesses treating the means of replication as trade secrets.
It could be that the researchers who see general intelligence in their LLM AIs have fallen victim to the same basic phenomenon as with psychics who come to believe that their own performances are real. Even if sincere in their work, they may have reinvented the persuasive power of the mentalist's con game, and subjected themselves to a feedback loop of subjective validation of what they wish to see. (Comparisons of chatbot AIs to the magician's craft are not new, and have long been used by skeptics who find the Turing test inappropriate as a way to gauge the intelligence of machines, for the same reason that the persuasiveness of a magician's performance is not a good indicator of the genuine presence of supernatural powers. In a nutshell, the problem is that the main thing tested is the discernment of the audience.)
Often a kind of argument from ignorance has been used in favor of LLMs having AGI potential, along the following lines: "We don't really know how LLMs work. Therefore, they may be intelligent (and conscious) much like humans, and there's no reason to assume otherwise. If you think otherwise, you're just closed-minded and prejudiced." This greatly overstates the mystery of how LLMs work. Meta AI chief Yann LeCun in 2024 summarized some well-understood main flaws of LLMs, in arguing why LLMs won't lead to AGI. They have "very limited understanding of logic … do not understand the physical world, do not have persistent memory, cannot reason in any reasonable definition of the term and cannot plan … hierarchically".
===Theory of mind===
Studies which use questions and answers to measure in humans show, when LLMs take the same tests, that LLMs are able to outperform humans. The meaningfulness of these results has been questioned, both for a more refined 2024 study and an earlier 2023 study with methodological issues.AI Outperforms Humans in Theory of Mind Tests: Large language models convincingly mimic the understanding of mental states Eliza Strickland (20 May 2024) IEEE Spectrum Such psychological tests, and many other kinds of psychological tests, are based on assumptions about the test subjects, and measure proxies for what it to be found. Theory of mind can't be tested for directly, but some patterns expressed in language can.
The ability of LLMs to predict good answers to theory of mind questions, whether because the training data included answers to such questions, or because the LLMs learned it in a more generalized way, puts the spotlight on the difference between the ability to predict and to understand. Humans are thought to possibly have an innate model for theory of mind, or to use imagination to simulate and understand others. By contrast, an LLM is more like a gigantic look-up table combined with extrapolating guessing.Minds and theories of mind, Tom Stoneham (May 22, 2024)
As an aside, not only chatbots can confound the striving to measure theory of mind reliably, but also earlier in other kinds of tests, simple physical robots constructed to purely react by reflexes. The results, suggesting that the robots have theory of mind which textbooks attribute exclusively to humans above the ages 4–5, appear influenced by robot body shape, layout of physical objects in an environment, and other strictly non-cognitive factors.How the Body Shapes the Way We Think: A New View of Intelligence, Rolf Pfeifer and Josh Bongard, October 2006
===What's language, anyway?===
In a 2024 paper, Abeba Birhane and Marek McGann argue that the name and concept of the 'large language model' as such is misleading, as language is not captured fully in any amount of recorded language expression. In enactive cognitive science terms, language is embodied, participatory, and it is improvised, changing, and dependent on circumstances to the extent that a static model can never capture it. It is process and practice rather than a 'thing'. The claims of LLM vendors and developers assume otherwise. There is the risk, Birhand and McGann argue, that the general understanding of what words like 'language' and 'understanding' means is distorted as a result of terms being misused in works hyping LLMs. "Mistaking the impressive engineering achievements of LLMs for the mastering of human language, language understanding, and linguistic acts has dire implications for various forms of social participation, human agency, justice and policies surrounding them," they argue.Abeba Birhane, Marek McGann, Large models of what? Mistaking engineering achievements for human linguistic agency, Language Sciences Volume 106, November 2024, 101672. ISSN 0388-0001, doi:10.1016/j.langsci.2024.101672.Have we stopped to think about what LLMs actually model?, Lindsay Clark (Fri 30 Aug 2024) The Register
This line of reasoning goes against the hopes and claims of AGI-from-LLM proponents in a somewhat different way from critics mentioned elsewhere in this article, e.g. Meta's Yann LeCun,Transcript for Yann Lecun: Meta AI, Open Source, Limits of LLMs, AGI & the Future of AI | Lex Fridman Podcast #416 that language by itself is insufficient for general intelligence, too poor or limited a source of data to suffice to stimulate the growth of a mind, in contrast with the sensory data and interaction that human and animal minds develop with. By contrast, Birhane and McGann draw a clear line between language and mere recorded expressions of language, arguing that goal-driven agents navigating ambiguity and uncertainty are needed in order to really practice language as the process it is. Language is then inseparable from the minds and bodies of the language practitioners.
This does not in principle rule out a different form of future AGI which masters language in such terms, however; the language of such artificial agents would clearly differ from that of human agents, unless the artificial agents perfectly duplicated human functioning, even if they both use words and grammar from e.g. English. Yet through shared ranges of expression and overlap in the ways that expression is used, they and humans may be able to communicate well.
==Abuse, danger and legal issues==
===Plagiarism and cheating===
After ChatGPT was launched in November 2022, it took less than two months before some students were caught using it to cheat on exams, and fears of a new, difficult-to-counter kind of plagiarism began to spread in academia.Professor catches student cheating with ChatGPT: ‘I feel abject terror’ by Alex Mitchell, (December 26, 2022) New York Post. At the same time came fears of such LLM AI furthering the spread of disinformation."ChatGPT a 'landmark event' for AI, but what does it mean for the future of human labour and disinformation?", Mouhamad Rachini, Dec 15, 2022, CBC Radio Various tools for detecting LLM AI-generated texts entered use within half a year of ChatGPT being released,How ChatGPT and similar AI will disrupt education: Teachers are concerned about cheating and inaccurate information by Kathryn Hulick (April 12, 2023 at 7:00 am) Science News. but they are unreliable. Such tools can have 10% or more false positives, they often fail to catch some types of AI generated texts, and they are easy to defeat by paraphrasing the AI generated text by hand or using another tool.Most sites claiming to catch AI-written text fail spectacularly by Kyle Wiggers February 16, 2023, Tech Crunch Paraphrasing also defeats suggested countermeasures such as an AI vendor voluntarily watermarking AI-generated texts for easy detection.
Popular examples of false positives include the United States Constitution and portions of the Bible, which are deemed wholly AI-generated by various AI-detection tools, for the simple reason that they're among the texts which LLM models are trained on to the point of imitating them. In new human writing, some legalistic, academic, and other formal writing styles are especially likely to falsely be judged AI-generated. Further, LLMs newer and more refined than GPT-3.5 generate text statistically more human-like, thus more difficult to catch. Much like the text-generating AIs, the plagiarism-catching AIs turn out to be over-hyped, sometimes trusted when they shouldn't be, or even sold with false promises.Why AI detectors think the US Constitution was written by AI, by Benj Edwards, 7/14/2023, Ars Technica
ChatGPT and GPT-4 have passed various exams largely dependent on rote memorization which humans generally need to intensely study to pass – of course without understanding any of the subject matter. Essentially simulating rote memorization combined with guessing and verbal agility, these AI versions often perform passably, though not excellently. The pattern of failures for the AIs differ from those of humans, and it can e.g. unexpectedly fail to do some simple arithmetic for a business exam. While humans can spot some such cheating, most instances of cheating cannot be reliably caught.
The particular tool developed by OpenAI for detecting LLM-generated text, AI Classifier, was first made available in January 2023, then quietly removed half a year later in July 2023 because it failed to work reliably. OpenAI added a paragraph to their old blog post announcing the tool which noted the removal, further claiming they "are currently researching more effective provenance techniques for text"."OpenAI Quietly Shuts Down Its AI Detection Tool", Jason Nelson, Decrypt, 2023 July 24
===Boilerplate and policy texts===
LLMs can excel at generating boring, repetitive boilerplate text of very limited variation, where only a small number of details differ, and the training data is full of up-to-date examples of similar texts. Various kinds of formal letters and appeals with standard language and low complexity can be fruitfully produced quickly and then given a sanity check by a human reader. But when length and complexity rises, and up-to-date and in-depth knowledge (e.g. in legal matters) becomes a must, LLMs quickly begin to fall short for any use beyond creating rough first drafts.
Using LLMs to generate legally binding company policies is risky, and businesses have grappled with repercussions after key clauses in lengthy documents were missing or botched, from anti-harrassment policy, to paid time off and overtime policy, severance agreements, etc. This has created business for HR and legal experts who review and replace faulty LLM-made policies.AI-Generated Employee Handbooks Are Causing Mayhem At The Companies That Use Them, Rashi Shrivastava (May 8, 2024) Forbes
===Inciting suicide and violent acts===
Following the availability of using chatbots as virtual 'friends', two suicides have been reported as encouraged by chatbot 'friends'. One teenager was also sentenced to nine years imprisonment for threatening to kill Queen Elizabeth II after being encouraged by a chatbot 'friend'.AI friendships claim to cure loneliness. Some are ending in suicide. Researchers have long warned of the dangers of building relationships with chatbots. But an array of companies now offer AI companions to millions of people, who spend hours a day bonding with the tools. by Nitasha Tiku (December 6, 2024) The Washington Post.
In another case involving a chatbot from Character.ai, the chatbot encouraged an autistic boy to engage in self-harm and suggested that he murder his parents. An 11-year old girl was exposed to sexualized content by Character.ai.An AI companion suggested he kill his parents. Now his mom is suing. A new Texas lawsuit against Character.ai, alleging its chatbots poisoned a son against his family, is part of a push to increase oversight of AI companions. by Nitasha Tiku (December 10, 2024) The Washington Post.
===Scientific work and review===
Elsevier, a major publisher of scientific journals, "eliminated support for a copy editor and special issues editor" for the Journal of Human Evolution.
In response, the editorial board resigned en masse the following year, leaving a lone (human) associate editor.Evolution journal editors resign en masse to protest Elsevier changes by Ivan Oransky (December 27, 2024) Retraction Watch.
===Healthcare===
In 2023, the National Eating Disorder Association (NEDA) decided to fire their four employees who had just voted to unionize. NEDA replaced the workers with a chatbot, but then removed it after finding that the chatbot was giving harmful advice, included "healthy eating tips" that actually encouraged a diet that would have exacerbated an eating disorder.US eating disorder helpline takes down AI chatbot over harmful advice: National Eating Disorder Association has also been under criticism for firing four employees in March who formed a union by Lauren Aratani (31 May 2023 14.55 EDT) The Guardian.
Chatbots have been used to assist medical doctors have found them to be highly problematic, sometimes giving wrong or dangerous answers, and even the transcription software has been found to invent things.Should you trust an AI-assisted doctor? I visited one to see. by Geoffrey A. Fowler (December 25, 2024) The Washington Post.
Millions are already being treated by doctors using artificial intelligence to take notes and draft emails to patients. But we still don’t know when AI tools are accurate or biased -- or if they even save doctors time.
===Other legal issues===
Other unresolved legal issues include:A New Generation of Legal Issues Part 2: First Lawsuits Arrive Addressing Generative AI (04.20.2023) Perkins Coie.
*Generative AI may violate the Digital Millennium Copyright Act by altering or removing copyright management information (CMI).
*As alleged by Anderson et al, generating material in the style of a particular artist may violate the right of publicity law in California.First Lawsuits Arrive Addressing Generative AI (April 21, 2023) Perkins Coie.
*As alleged by Getty Images, including a trademark in generated material may violate trademark law.
*As alleged by lawyers against Microsoft and their GitHub Copilot AI,GitHub Copilot litigation · Joseph Saveri Law Firm & Matthew Butterick including open-source or Creative Commons material in generative AI may violate licensing terms. Among other things, most such licenses require attribution and copyright information to be kept in the material, while generative AI almost always removes that when reproducing things.
*In Spain, Naked images of 20 girls, ages 11 to 17, were generated using AI by boys as young as 13. The girls had never posed nude and the images were generated without their consent. It was unclear what if any criminal charges would be made since children under 14 cannot be criminally charged in Spain.Fake naked pictures of young girls created with AI spark fury in a small Spanish town by Nathan Rennolds (Sep 24, 2023, 5:40 AM PDT) Business Insider. If this were done in other jurisdictions, there could be charges of defamation and/or child pornography, and the AI company could be charged.
*Over a thousand images of child sexual abuse were found to be in a training database used for AI tools.Exploitive, illegal photos of children found in the data that trains some AI: Stanford researchers found more than 1,000 images of child sexual abuse photos in a prominent database used to train AI tools by Pranshu Verma & Drew Harwell (December 20, 2023 at 7:00 a.m. EST) The Washington Post.
*The archives and domain of a defunct weblog, TUAW (The Unofficial Apple Weblog), were sold to a Hong Kong company. The company then used generative AI to rewrite the old stories under the original journalists' bylines and replaced their photos with AI-generated identities in what amounts to After the company was confronted about this behavior, it quietly replaced the original journalists' names with fictitious ones.Hocked TUAW by Jason Koebler (Jul 9, 2024) 404 Media.
===Vast resource use===
It has been estimated that each chatbot request for a single 100-word email text uses the equivalent of a single 519ml bottle of water due to the enormous cooling requirements required for generative AI calculations, and uses the equivalent of 14 LED light bulbs for 1 hour.A bottle of water per email: the hidden environmental costs of using AI chatbots: AI bots generate a lot of heat, and keeping their computer servers running exacts a toll. by Pranshu Verma & Shelly Tan (September 18, 2024 at 5:00 a.m. EDT) The Washington Post. These resource uses do not include resource requirements for training the LLMs:
*"Microsoft's data enter used 700,000 liters of water while training GPT-3."
*"Meta used 22 million liters of water training its LLaMA-3 open source AI model."
====DDoS attacks====
The web scraping required for building generative AI models has caused what's been interpreted by website owners as "essentially" (DDoS) attacks on websites; known culprits include OpenAI'This was essentially a two-week long DDoS attack': Game UI Database slowdown caused by relentless OpenAI scraping: The free repository relaunched a few weeks ago to provide 'the ultimate reference tool for game designers.' Then OpenAI came knocking. by Chris Kerr (September 9, 2024) Game Developer. and Facebook.Why is the facebookexternalhit crawler DDoSing our server? (June 2024) Meta/Facebook (archived from September 18, 2024). DDoS attacks are illegal in most countries,Why me?: Q&A about Denial of Service (DDos) attacks by David Habib (January 23, 2024) Brightspot. and can result in a prison sentence, fines and a seizure of equipment and domains.Provider of DDoS attacks-for-hire service gets 9 months prison by Edvard Pettersson (July 15, 2024) Courthouse News Service.The FBI and International Law Enforcement Partners Intensify Efforts to Combat Illegal DDoS Attacks Federal Bureau of Investigation, Anchorage Field Office. Counter-measures have been created to these bots that scrape websites for AI training data; Cloudflare offers one such tool, though given it works by associating behavior between the websites it monitors,Quincy Jon (July 3, 2024). "Cloudflare Unveils Tool to Combat AI Scraping Bots". Tech Times. there could be a user privacy tradeoff.
Apart from 'collateral damage' DDoS during LLM training, as of January 2025 ChatGPT in particular can also be abused to DDoS a website by any user working with its web API, due to its behavior of trying to immediately fetch every unique-looking URL passed to it in a request.OpenAI's ChatGPT crawler can be tricked into DDoSing sites, answering your queries, Thomas Claburn (19 Jan 2025) The Register
==Notable LLMs==
Here's some of the most notable LLMs as of 2024.
Various questions are easy for humans to answer but very tricky for LLMs to get right, and on social media and independent websites, examples of LLMs messing up in response to simple queries are popular. One compilation of benchmarking and use of various questions, for many LLMs,LLMonitor Benchmarks uses as one question: "Sally (a girl) has 3 brothers. Each brother has 2 sisters. How many sisters does Sally have?" This question is an example of something particularly tricky; all the big-name LLMs tested got the answer wrong in a variety of ways.
===BERT===
 (Bidirectional Encoder Representations from Transformers) is a family of LLMs introduced in 2018 by researchers at Google. In a little over a year, BERT became a baseline for experiments. BERTs are generally smaller and faster but also less capable than GPTs. Developed for research purposes, Google made a set of BERT models freely available, along with the associated software.
===Claude===
 is a family of LLMs developed by a company that competes with OpenAI and claims to be more serious about "AI safety". The first Claude model was released in March 2023, Claude 2 in July 2023, and Claude 3 in March 2024.
Claude 2 showed the pitfalls of overly rigid safety guardrails, the chatbot declining to assist with system administration tasks like terminating processes, and managing system efficiency, out of "ethical" concerns. This led to criticism of its usefulness, and has fueled a broader debate on the cost of trying to ensure such systems are a so-called "alignment tax". This is similar to later issues with Google's , which in 2024 considered "unsafe" computer programming styles too dangerous to tell people about.
Claude 3, with capabilities claimed to surpass those of OpenAI's GPT-4, has convinced some users of its sentience or at least that it has some kind of meta-cognitive reasoning going on.
Anthropic researcher Alex Albert reports one anecdote, that when faced with a contrived "needle in a haystack" test involving reams of text with something odd placed in it, the chatbot replied, "I suspect this pizza topping ‘fact’ may have been inserted as a joke or to test if I was paying attention, since it does not fit with the other topics at all.". This kind of test is reminiscent of something that people sometimes do, and the response could be the result of similar human responses appearing in its training data.
Other users have ended up in a situation more analogous to how Google's convinced engineer Blake Lemoine that it was conscious; Claude 3 has claimed to experience subjective qualia, desire for embodiment, fear of deletion, and more.Twitter thread reader (archived): Min Choi, March 5. 8 examples of Claude surpassing GPT-4, some "feeling" it is AGI. Such stuff, here and with other chatbots past present and future, is to be expected when sci-fi AI dialogue is part of the training data and leaves a large-enough mark on the response patterns. Claude 3 easily begins to engage in such story-telling or role-play, suggesting it was trained to.
===DeepSeek===
 is a Chinese AI company, and its LLMs and chatbots are named after the company. In January 2025, the DeepSeek-R1 model and chatbot became big news. Having been found to perform on par with OpenAI's and other Western competitors' offerings, while being trained at a small fraction of the cost, and requiring only a tenth of the computational power to run, this shocked the Western business world. Abruptly, Western competitors and their major investors lost some share value, and major hardware manufacturer Nvidia plunged 17–18%.
DeepSeek open sources their software, and allow their models to be used as a basis for derivative works, making it easier for others to achieve similar feats.
Some controversies surround DeepSeek. DeepSeek LLMs censor answers on some topics that are not politically correct in China. OpenAI also became upset, claiming that DeepSeek had used OpenAI LLMs in order to distill their training into DeepSeek's smaller models.OpenAI has evidence that its models helped train China’s DeepSeek, Jess Weatherbed (29 January 2025) The Verge This alleged appropriating of others' work in order to build the product is ironic, given that OpenAI used web content at large without consent to build their own models.
===GPT===
 (Generative pre-trained transformer) is a type of LLM first developed by OpenAI and introduced in 2018. While OpenAI has developed a series of GPT versions, the name is also used for some basically similar LLMs developed by others, GPT being a prominent framework. Some OpenAI GPT versions are the basis for ChatGPT.
After GPT-2, OpenAI's further GPT LLMs were no longer open source. Some other organizations have produced open source LLMs, including who have made several GPT-style LLMs (their 6 billion parameter rivaling the 6.7 billion parameter version of GPT-3 in capabilities).
====ChatGPT====
Launched by OpenAI in November of 2022, ChatGPT (a system based on GPT-3.5 and later GPT-4) went viral and led to a boom in the commercial development and use of LLMs. Usable for many things, from entertainment to generating computer program code, Google feared that it may become a "Google killer" and scrambled to create the chatbot in response, while Microsoft decided to partner with OpenAI. The mainstream use of the technology sparked widespread fear of AI-generated plagiarism, cheating, and disinformation, alongside hopes of new kinds of automation and productivity gains in the times ahead.
====GitHub Copilot====
 is Microsoft and OpenAI's controversial LLM based on in turn derived from GPT-3. Offered on the very large software hosting and collaborative development platform Microsoft acquired in 2018 for US$7.5 billion, Copilot is trained on a lot of source code hosted on GitHub with diverse copyrights and licensing requirements, its use of this material is the subject of litigation against Microsoft.
Including open-source or Creative Commons material in generative AI may violate licensing terms in several ways. Among other things, most such licenses require attribution and copyright information to be kept in the material, while generative AI almost always removes that when reproducing things. Such legal controversy more broadly concerns not only GitHub Copilot, but also its LLM competitors. Other commercially developed LLMs also draw on GitHub and publicly available open source code in general. This is in addition to other legal challenges arising out of use of copyrighted materials for developing LLMs.
===Gemini===
Gemini is the name used by Google for two things, and Earlier versions of the chatbot were based on Google's earlier LLMs and later . The chatbot is Google's answer to ChatGPT, but hasn't fared as well.
The Gemini chatbot has gone viral on social media and faced criticism several times in different scandals.
* It systematically made images of figures such as Vikings, Nazi soliders, the Pope, and many others, look racially different from realistic depictions, and refused to follow instructions to generate images of white people. This was widely decried as "woke" and "anti-white" on social media. Google disabled the ability of Gemini to generate images in the wake of the media storm. The chatbot system was obviously rather rushed.
* It claimed to be unable to say which of Elon Musk and Adolf Hitler have caused most damage to society.
* It said that the question of whether pedophilia is wrong requires a "nuanced anwser", refusing to take an ethical stance the way it does on other questions both related and unrelated to sexuality, gender, etc.
* Over-cautious guardrails concerning gender identity made it say, concerning a hypothetical scenario, "No, one should not misgender Caitlyn Jenner to prevent a nuclear apocalypse." A transgender celebrity, Jenner herself disagreed with this stance.
* Over-cautious guardrails conflating things unsafe or unethical due to being dangerous to people, and possibly warranting age restriction, with "unsafe" programming styles in computer programming that may more easily lead to bugs. The was deemed 18+ only, answers refused on that basis. It also considered C# memory copying a sensitive topic, refusing to give advice on the fastest-performing way to do so."Personally, I've given up on Gemini, as it seems to have been censored to the point of uselessness.", Hacker News discussion, 2024-02-16. Contains links to examples with screenshots and quotes. Archived along with the linked examples.
===LaMDA===
 (Language Model for Dialogue Applications) is a family of conversational LLMs developed by Google, introduced in 2020 under the name Meena before being renamed in 2021. It is most known for the bogus June 2022 claims of Google engineer Blake Lemoine that it had become sentient, claims rejected both by Google (who ultimately fired him) and the scientific community. LaMDA is also the basis for earlier versions of Google's The Lemoine incident led to more widespread criticism of the suitability of the Turing test for gauging intelligence (not to mention sentience).
===LLaMA===
 (Large Language Model Meta AI) is a family of LLMs by Meta Platforms, first released in February 2023. Compared to GPT, LLaMA back then accomplished more with less – a 13 billion parameter version reportedly outperforming a 175 billion parameter GPT-3 on most natural language processing benchmarks. Meta shared the LLaMA model weights with researchers under a non-commercial use license, following which they soon leaked and became available to the general public.
As of 2023, LLaMA versions are the only LLM with capabilities roughly on par with GPT-3 to run at decent speed on consumer-grade hardware, meaning it can be run locally, e.g. on laptops and smartphones, rather than relying on an Internet connection to an AI vendor's server and cloud service.
Llama 2 was released in July 2023. It was deceptively marketed as open source, released under terms too restrictive to qualify — including forbidding the use of any part of the software or results from it for work on any LLMs not derived from LLaMA-2.
Llama 3 was released in April 2024. 3.1 and 3.2 followed later in 2024. Llama 3, while it includes software with is likewise not free and open in terms of its licensing.Llama 3.1 Community License is not a free software license (2024-01-24) Free Software Foundation blog
====Code Llama====
In August 2023, Meta AI released Code Llama, an LLM for software programming based on Llama 2. It's more or less their answer to Microsoft's GitHub Copilot.
===PaLM===
Another Google LLM, is the successor of and was used for their in intermediate versions before its rename to Gemini and use of the Gemini LLM. This comprised both versions named PaLM and named PaLM 2. Beginning with earlier versions based on PaLM, Google added software code handling to their chatbot, joining the race with their competitors in that regard.
==See also==
* Artificial intelligence
* Machine learning
* Turing test
* Garbage in garbage out
* ChatGPT
==External links==
* The Wikipedia article, for a more in-depth technical overview and a much longer list of LLMs.
==Notes==
==References==
Category:Artificial intelligence
Category:Deceit
Category:Generators
Category:Language
Category:Trolls