Stochastic parrot

Short description: Term used in machine learning

In machine learning, the term stochastic parrot is a metaphor that frames large language models as systems that statistically mimic text without real understanding. The word "stochastic" - from the ancient Greek "στοχαστικός" (stokhastikos, 'based on guesswork') - is a term from probability theory meaning "randomly determined".[1] The word "parrot" refers to parrots' ability to mimic human speech.[1]

The term was introduced in a 2021 paper on AI ethics titled "On the Dangers of Stochastic Parrots: Can Language Models Be Too Big? 🦜" and authored by Timnit Gebru, Emily M. Bender, Angelina McMillan-Major, and Margaret Mitchell.[lower-alpha 1] The paper outlined possible risks associated with large language models (LLMs). In December 2020, it was the subject of a workplace dispute between Gebru (then co-leader of Google's Ethical Artificial Intelligence Team) and Google, which had requested the retraction of the paper. The incident culminated in Gebru's controversial departure from the company.

The paper was later presented at the 2021 ACM Conference, and the term "stochastic parrot" has seen widespread use in academic research concerning generative AI and LLMs. The term has been interpreted negatively as an insult towards AI.[1]

## Contents

* 1 Background
* 1.1 Dismissal of Gebru by Google
* 2 Usage
* 3 Debate
* 3.1 Subjective experience
* 3.2 Fine-tuning
* 3.3 Hallucinations and mistakes
* 3.4 Benchmarks and experiments
* 3.5 Expert rebuttals
* 3.6 Interpretability
* 3.7 Shortcut learning and benchmark flaws
* 4 See also
* 5 Notes
* 6 References
* 6.1 Works cited
* 7 Further reading
* 8 External links

## Background

Timnit Gebru is an AI ethics researcher,[2] Emily M. Bender is a linguist specializing in computational linguistics, and Margaret Mitchell is a computer scientist specializing in algorithmic bias. Gebru had joined Google in 2018, where she co-led a team on the ethics of artificial intelligence with Mitchell.

In late 2020, the paper "On the Dangers of Stochastic Parrots: Can Language Models Be Too Big? 🦜" was co-written by Gebru and five other researchers, four of whom were Google employees. The paper argues that large language models (LLMs) present significant risks such as environmental and financial costs, inscrutability leading to unknown dangerous biases, and potential for deception as LLMs do not understand the concepts underlying what they learn.[3]

The paper states that LLMs are "stitching together sequences of linguistic forms ... observed in its vast training data, according to probabilistic information about how they combine, but without any reference to meaning." Therefore, they are labeled "stochastic parrots".[4]

### Dismissal of Gebru by Google

After the paper was submitted for consideration to the 2021 ACM Conference, Google requested that Gebru either retract the paper from the conference or remove the names of Google employees from it.[5] Gebru refused to do so without further discussion, and emailed Google Research vice president Megan Kacholia that if the company could not explain the request for retraction and address other concerns regarding similar projects, she would plan to resign after a transition period, stating that they could "work on a last date".[6] The following day, on December 2, 2020, Gebru received an email saying that Google was "accepting her resignation".[3] Her abrupt firing sparked protests by Google employees and negative publicity for the company.[7]

## Usage

The phrase has been used by AI skeptics to signify that LLMs lack understanding of the meaning of their outputs.[1]

Sam Altman, CEO of OpenAI, used the term shortly after the release of ChatGPT in December 2022, tweeting "i am a stochastic parrot, and so r u".[1] The term was nominated as the 2023 AI-related Word of the Year by the American Dialect Society.[8][9]

## Debate

Some LLMs, such as ChatGPT, have become capable of interacting with users in convincingly human-like conversations.[10] The development of these new systems has deepened the discussion of the extent to which LLMs understand or are simply "parroting".

According to machine learning researchers Lindholm, Wahlström, Lindsten, and Schön, the term "stochastic parrot" highlights two vital limitations of LLMs:[11][12]

* LLMs are limited by the data they are trained on and are simply stochastically repeating contents of datasets.
* Because they are just making up outputs based on training data, LLMs do not understand if they are saying something incorrect or inappropriate.

Lindholm et al. noted that, with poor quality datasets and other limitations, a learning machine might produce results that are "dangerously wrong".[11]

### Subjective experience

In the mind of a human being, words and language correspond to things one has experienced.[13] For LLMs, according to proponents of the theory, words correspond only to other words and patterns of usage fed into their training data.[14][15][4] Proponents of the idea of stochastic parrots thus conclude that statements about LLMs are due to "the human tendency to attribute meaning to text",[4] and claim this occurs despite the LLMs not actually understanding language.[14][4]

### Fine-tuning

Kelsey Piper argued that the claim that LLMs are stochastic parrots or mere "next-token predictors" focuses on pre-training, ignoring that modern LLMs are also fine-tuned to follow instructions and to prefer accurate answers.[16]

### Hallucinations and mistakes

The tendency of LLMs to pass off false information as fact is held as support.[13] Called hallucinations or confabulations, LLMs will occasionally synthesize information that matches some pattern.[14][15][13] LLMs may fail to distinguish fact and fiction, which leads to the claim that they can't connect words to a comprehension of the world, as humans do.[14][13] Furthermore, LLMs may fail to decipher complex or ambiguous grammar cases that rely on understanding the meaning of language.[14][15] For example:[14]

> The wet newspaper that fell down off the table is my favorite newspaper. But now that my favorite newspaper fired the editor I might not like reading it anymore. Can I replace 'my favorite newspaper' by 'the wet newspaper that fell down off the table' in the second sentence?

GPT-4, an LLM released in March 2023, responded yes, not understanding that the meaning of "newspaper" is different in these two contexts; it is first an object and second an institution.[14]

### Benchmarks and experiments

One argument against the hypothesis that LLMs are stochastic parrot is their results on benchmarks for reasoning, common sense and language understanding. In 2023, some LLMs have shown good results on many language understanding tests, such as the Super General Language Understanding Evaluation (SuperGLUE).[15][17] GPT-4 scored in the >90th-percentile on the Uniform Bar Examination and achieved 93% accuracy on the MATH benchmark of high-school Olympiad problems, results that exceed rote pattern-matching expectations.[18] Such tests, and the smoothness of many LLM responses, help as many as 51% of AI professionals believe they can truly understand language with enough data, according to a 2022 survey.[15]

### Expert rebuttals

Some AI researchers dispute the notion that LLMs merely "parrot" their training data.

Geoffrey Hinton, a pioneering figure in neural networks, counters that the metaphor misunderstands the prerequisite for accurate language prediction. He argues that "to predict the next word accurately, you have to understand the sentence", a view he presented on 60 Minutes in 2023.[19] From this perspective, understanding is not an alternative to statistical prediction, but rather an emergent property required to perform it effectively at scale. Hinton also uses logical puzzles to demonstrate that LLMs actually understand language.[20]

A 2024 Scientific American investigation described a closed Berkeley workshop where state-of-the-art models solved novel tier-4 mathematics problems and produced coherent proofs, indicating reasoning abilities beyond memorization.[21]

The GPT-4 Technical Report showed human-level results on professional and academic exams (e.g., the Uniform Bar Exam and USMLE), challenging the "parrot" characterization.[18]

Anthropic conducted mechanistic interpretability research on Claude, using attribution graphs to identify circuits. The research showed how the LLM processes information via chains of fuzzy logical inference, and indicated an ability to plan ahead. They found that Claude 3.5 Haiku "employs remarkably general abstractions", forms "internally generated plans for its future outputs" and "works backwards from its longer-term goals". They noted that "The mechanisms of the model can apparently only be faithfully described using an overwhelmingly large causal graph." They also found that the model includes "mechanisms that could underlie a simple form of metacognition", in that it "thinks about" the level of its own knowledge before reaching its answer.[22]

### Interpretability

Another line of evidence against the 'stochastic parrot' claim comes from mechanistic interpretability, a research field dedicated to reverse-engineering LLMs to understand their internal workings. Rather than only observing the model's input-output behavior, these techniques probe the model's internal activations, which can be used to determine if they contain structured representations of the world. The goal is to investigate whether LLMs are merely manipulating surface statistics or if they are building and using internal "world models" to process information.

One example is Othello-GPT, where a small transformer was trained to predict legal Othello moves. It has been found that this model has an internal representation of the Othello board, and that modifying this representation changes the predicted legal Othello moves in the correct way. This supports the idea that LLMs have a "world model", and are not just doing superficial statistics.[23][24]

In another example, a small transformer was trained on computer programs written in the programming language Karel. Similar to the Othello-GPT example, this model developed an internal representation of Karel program semantics. Modifying this representation results in appropriate changes to the output. Additionally, the model generates correct programs that are, on average, shorter than those in the training set.[25]

Researchers also studied "grokking", a phenomenon where an AI model initially memorizes the training data outputs, and then, after further training, suddenly finds a solution that generalizes to unseen data.[26]

### Shortcut learning and benchmark flaws

A significant counterpoint in the debate is the well-documented phenomenon of "shortcut learning."[27] Critics of claims for LLM understanding argue that high benchmark scores can be misleading.

When tests created to test people for language comprehension are used to test LLMs, they sometimes result in false positives caused by spurious correlations within text data.[28] Models have shown examples of shortcut learning, which is when a system makes unrelated correlations within data instead of using human-like understanding.[27]

## See also

* Autocomplete
* Chinese room
* Criticism of artificial neural networks
* Criticism of deep learning
* Generative AI
* Mark V. Shaney, an early chatbot that used a very simple three-word Markov chain algorithm to generate Markov text
* Talking bird
* The Nightingale (fairy tale)
* Kenku

## Notes

1. ↑ using the pseudonym "Shmargaret Shmitchell"

## References

1. ↑ 1.0 1.1 1.2 1.3 1.4 Zimmer, Ben (18 January 2024). "'Stochastic Parrot': A Name for AI That Sounds a Bit Less Intelligent" (in en-US). Wall Street Journal. https://www.wsj.com/arts-culture/books/stochastic-parrot-a-name-for-ai-that-sounds-a-bit-less-intelligent-789372f5.
2. ↑ Hao, Karen (2020-12-04). "We read the paper that forced Timnit Gebru out of Google. Here’s what it says." (in en). https://www.technologyreview.com/2020/12/04/1013294/google-ai-ethics-research-paper-forced-out-timnit-gebru/.
3. ↑ 3.0 3.1 Hao, Karen (4 December 2020). "We read the paper that forced Timnit Gebru out of Google. Here's what it says." (in en). https://www.technologyreview.com/2020/12/04/1013294/google-ai-ethics-research-paper-forced-out-timnit-gebru/.
4. ↑ 4.0 4.1 4.2 4.3 , Wikidata Q105943036
5. ↑ "Google’s Co-Head of Ethical AI Says She Was Fired for Email" (in en). Bloomberg.com. https://www.bloomberg.com/news/articles/2020-12-03/google-s-co-head-of-ethical-ai-says-she-was-fired-over-email.
6. ↑ Metz, Cade; Wakabayashi, Daisuke (2020-12-03). "Google Researcher Says She Was Fired Over Paper Highlighting Bias in A.I." (in en-US). The New York Times. ISSN 0362-4331. https://www.nytimes.com/2020/12/03/technology/google-researcher-timnit-gebru.html.
7. ↑ Lyons, Kim (5 December 2020). "Timnit Gebru's actual paper may explain why Google ejected her". https://www.theverge.com/2020/12/5/22155985/paper-timnit-gebru-fired-google-large-language-models-search-ai.
8. ↑ Corbin, Sam (15 January 2024). "Among Linguists, the Word of the Year Is More of a Vibe" (in en-US). The New York Times. ISSN 0362-4331. https://www.nytimes.com/2024/01/15/crosswords/linguistics-word-of-the-year.html.
9. ↑ "All of the Words of the Year, 1990 to Present" (in en-US). https://americandialect.org/woty/all-of-the-words-of-the-year-1990-to-present/.
10. ↑ Arkoudas, Konstantine (21 August 2023). "ChatGPT is no Stochastic Parrot. But it also Claims that 1 is Greater than 1" (in en). Philosophy & Technology 36 (3). doi:10.1007/s13347-023-00619-6. ISSN 2210-5441.
11. ↑ 11.0 11.1 Lindholm et al. 2022, pp. 322–3.
12. ↑ Uddin, Muhammad Saad (20 April 2023). "Stochastic Parrots: A Novel Look at Large Language Models and Their Limitations" (in en-US). https://towardsai.net/p/machine-learning/stochastic-parrots-a-novel-look-at-large-language-models-and-their-limitations.
13. ↑ 13.0 13.1 13.2 13.3 Fayyad, Usama M. (26 May 2023). "From Stochastic Parrots to Intelligent Assistants—The Secrets of Data and Human Interventions". IEEE Intelligent Systems 38 (3): 63–67. doi:10.1109/MIS.2023.3268723. ISSN 1541-1672. Bibcode: 2023IISys..38c..63F.
14. ↑ 14.0 14.1 14.2 14.3 14.4 14.5 14.6 Saba, Walid S. (2023). "Stochastic LLMS do not Understand Language: Towards Symbolic, Explainable and Ontologically Based LLMS". in Almeida, João Paulo A.; Borbinha, José; Guizzardi, Giancarlo et al. (in en). Conceptual Modeling. Lecture Notes in Computer Science. 14320. Cham: Springer Nature Switzerland. pp. 3–19. doi:10.1007/978-3-031-47262-6_1. ISBN 978-3-031-47262-6.
15. ↑ 15.0 15.1 15.2 15.3 15.4 Mitchell, Melanie; Krakauer, David C. (28 March 2023). "The debate over understanding in AI's large language models" (in en). Proceedings of the National Academy of Sciences 120 (13). doi:10.1073/pnas.2215907120. ISSN 0027-8424. PMID 36943882. Bibcode: 2023PNAS..12015907M.
16. ↑ Piper, Kelsey (13 February 2026). "When "technically true" becomes "actually misleading"" (in en). https://www.theargumentmag.com/p/when-technically-true-becomes-actually.
17. ↑ Wang, Alex; Pruksachatkun, Yada; Nangia, Nikita; Singh, Amanpreet; Michael, Julian; Hill, Felix; Levy, Omer; Bowman, Samuel R. (2 May 2019). "SuperGLUE: A Stickier Benchmark for General-Purpose Language Understanding Systems". arXiv:1905.00537 [cs.CL].
18. ↑ 18.0 18.1 OpenAI; et al. (2023). "GPT-4 Technical Report". arXiv:2303.08774 [cs.CL].
19. ↑ Pelley, Scott (8 October 2023). ""Godfather of Artificial Intelligence" Geoffrey Hinton on the promise, risks of advanced AI". CBS News. https://www.cbsnews.com/news/geoffrey-hinton-ai-dangers-60-minutes-transcript/.
20. ↑ 60 Minutes (9 October 2023). "Godfather of AI" Geoffrey Hinton: The 60 Minutes Interview. Archived from the original on 3 July 2025. Retrieved 2 July 2025 - via YouTube.`{{cite AV media}}`: CS1 maint: numeric names: authors list (link)
21. ↑ Morris, Ian (24 March 2024). "Inside the secret meeting where mathematicians struggled to outsmart AI". Scientific American. https://www.scientificamerican.com/article/inside-the-secret-meeting-where-mathematicians-struggled-to-outsmart-ai/. Retrieved 2 July 2025.
22. ↑ Lindsey, Jack et al. (27 March 2025). "On the Biology of a Large Language Model". Transformer Circuits Thread. https://transformer-circuits.pub/2025/attribution-graphs/biology.html. Retrieved 23 March 2026.
23. ↑ Li, Kenneth; Hopkins, Aspen K.; Bau, David; Viégas, Fernanda; Pfister, Hanspeter; Wattenberg, Martin (27 February 2023), Emergent World Representations: Exploring a Sequence Model Trained on a Synthetic Task
24. ↑ Li, Kenneth (21 January 2023). "Large Language Model: world models or surface statistics?" (in en). https://thegradient.pub/othello/.
25. ↑ Jin, Charles; Rinard, Martin (24 May 2023), Evidence of Meaning in Language Models Trained on Programs
26. ↑ Schreiner, Maximilian (11 August 2023). "Grokking in machine learning: When Stochastic Parrots build models" (in en-US). https://the-decoder.com/grokking-in-machine-learning-when-stochastic-parrots-build-models/.
27. ↑ 27.0 27.1 Geirhos, Robert; Jacobsen, Jörn-Henrik; Michaelis, Claudio; Zemel, Richard; Brendel, Wieland; Bethge, Matthias; Wichmann, Felix A. (10 November 2020). "Shortcut learning in deep neural networks" (in en). Nature Machine Intelligence 2 (11): 665–673. doi:10.1038/s42256-020-00257-z. ISSN 2522-5839. https://www.nature.com/articles/s42256-020-00257-z. Retrieved 3 April 2024.
28. ↑ Choudhury, Sagnik Ray; Rogers, Anna; Augenstein, Isabelle (15 September 2022), Machine Reading, Fast and Slow: When Do Models "Understand" Language?

### Works cited

* Lindholm, A.; Wahlström, N.; Lindsten, F.; Schön, T. B. (2022). Machine Learning: A First Course for Engineers and Scientists. Cambridge University Press. ISBN 978-1-108-84360-7.
* Weller, Adrian (13 July 2021). On the Dangers of Stochastic Parrots: Can Language Models Be Too Big? 🦜 (video). Alan Turing Institute. Keynote by Emily Bender. The presentation was followed by a panel discussion.

## Further reading

* Bogost, Ian (7 December 2022). "ChatGPT Is Dumber Than You Think: Treat it like a toy, not a tool". The Atlantic. https://www.theatlantic.com/technology/archive/2022/12/chatgpt-openai-artificial-intelligence-writing-ethics/672386/. Retrieved 17 January 2024.
* Chomsky, Noam (8 March 2023). "The False Promise of ChatGPT". The New York Times. https://www.nytimes.com/2023/03/08/opinion/noam-chomsky-chatgpt-ai.html.
* Glenberg, Arthur; Jones, Cameron Robert (6 April 2023). "It takes a body to understand the world – why ChatGPT and other language AIs don't know what they're saying". The Conversation. https://theconversation.com/it-takes-a-body-to-understand-the-world-why-chatgpt-and-other-language-ais-dont-know-what-theyre-saying-201280. Retrieved 17 January 2024.
* McQuillan, D. (2022). Resisting AI: An Anti-fascist Approach to Artificial Intelligence. Bristol University Press. ISBN 978-1-5292-1350-8.
* Thompson, E. (2022). Escape from Model Land: How Mathematical Models Can Lead Us Astray and What We Can Do about It. Basic Books. ISBN 978-1-5416-0098-0.
* Zhong, Qihuang; Ding, Liang; Liu, Juhua; Du, Bo; Tao, Dacheng (2023). "Can ChatGPT Understand Too? A Comparative Study on ChatGPT and Fine-tuned BERT". arXiv:2302.10198 [cs.CL].

## External links

* "On the Dangers of Stochastic Parrots: Can Language Models Be Too Big? 🦜" at Wikimedia Commons

* v
* t
* e

Generative AI

Concepts|

* Autoencoder
* Deep learning
* Fine-tuning
* Foundation model
* Generative adversarial network
* Generative pre-trained transformer
* Large language model
* Model Context Protocol
* Neural network
* Prompt engineering
* Reinforcement learning from human feedback
* Retrieval-augmented generation
* Self-supervised learning
* Stochastic parrot
* Synthetic data
* Top-p sampling
* Transformer
* Variational autoencoder
* Vibe coding
* Vision transformer
* Waluigi effect
* Word embedding

Models|

| Text|

* Character.ai
* ChatGPT
* Command A
* Claude
* DeepSeek
* Ernie
* Gemini
* Gemma
* GLM
* GPT
* 1
* 2
* 3
* J
* 3.5
* 4
* 4o
* o1
* o3
* 4.5
* 4.1
* o4-mini
* OSS
* 5
* 5.1
* Grok
* Hunyuan T1
* Kimi
* Llama
* Microsoft Copilot
* MiniMax M2
* Mistral Medium
* Qwen
* Velvet
* Solar Pro

|

Coding|

* Base44
* Claude Code
* Cursor
* Devstral
* GitHub Copilot
* Grok Code Fast 1
* Kimi-Dev
* Qwen3-Coder
* Replit

Image|

* Aurora
* Firefly
* Flux
* GPT Image 1
* Ideogram
* Imagen
* Leonardo
* Midjourney
* Qwen-Image
* Recraft
* Seedream
* Stable Diffusion

Video|

* Dream Machine
* Hailuo AI
* Kling
* Runway Gen
* Seedance
* Sora
* Veo
* Wan

Speech|

* 15.ai
* Eleven
* Gemini Speech
* GPT-4o mini TTS
* MiniMax Speech
* Speechify

Music|

* Eleven Music
* Endel
* Lyria
* MiniMax Music
* Riffusion
* Stable Audio
* Suno
* Udio

Agents|

* Agentforce
* AutoGLM
* AutoGPT
* ChatGPT Agent
* Devin AI
* Manus
* MiniMax Agent
* OpenAI Codex
* Operator
* Replit Agent

Controversies|

* Deepfake pornography
* Generative AI pornography
* Taylor Swift deepfake pornography controversy
* Google Gemini image generation controversy
* Pause Giant AI Experiments
* Removal of Sam Altman from OpenAI
* Statement on AI Risk
* Tay (chatbot)
* Théâtre D'opéra Spatial
* Voiceverse NFT plagiarism scandal

0.00

(0 votes)

Original source: https://en.wikipedia.org/wiki/Stochastic parrot. Read more

|

Retrieved from "https://handwiki.org/wiki/index.php?title=Stochastic_parrot&oldid=4504681"
*[v]: View this template
*[t]: Discuss this template
*[e]: Edit this template