Observer-expectancy effect

Cognitive bias of experimental subject

For other uses, see Observer effect (disambiguation).

This article has multiple issues. Please help improve it or discuss these issues on the talk page. (Learn how and when to remove these messages)

This article needs additional citations for verification. Please help improve this article by adding citations to reliable sources. Unsourced material may be challenged and removed.
Find sources: "Observer-expectancy effect" – news · newspapers · books · scholar · JSTOR (October 2021) (Learn how and when to remove this message)

|

The relevance of particular information in (or previously in) this article or section is disputed. The information may have been removed or included by an editor as a result. Please see discussion on the talk page considering whether its inclusion is warranted. (February 2020)

|

(Learn how and when to remove this message)

Part of a series on

Psychology

* Outline
* History
* Subfields

Basic psychology

* Abnormal
* Affective neuroscience
* Affective science
* Behavioral genetics
* Behavioral neuroscience
* Behaviorism
* Cognitive/Cognitivism
* Cognitive neuroscience
* Social
* Comparative
* Cross-cultural
* Cultural
* Developmental
* Differential
* Ecological
* Evolutionary
* Experimental
* Gestalt
* Intelligence
* Mathematical
* Moral
* Neuropsychology
* Perception
* Personality
* Psycholinguistics
* Psychophysiology
* Quantitative
* Social
* Theoretical

Applied psychology

* Anomalistic
* Applied behavior analysis
* Assessment
* Clinical
* Coaching
* Community
* Consumer
* Counseling
* Critical
* Educational
* Ergonomics
* Feminist
* Forensic
* Health
* Humanistic
* Industrial and organizational
* Legal
* Media
* Medical
* Military
* Music
* Occupational health
* Pastoral
* Political
* Positive
* Psychometrics
* Psychotherapy
* Religion
* School
* Sport and exercise
* Suicidology
* Systems
* Traffic

Concepts

* Behavior
* Behavioral engineering
* Behavioral genetics
* Behavioral neuroscience
* Cognition
* Competence
* Consciousness
* Consumer behavior
* Emotions
* Feelings
* Human factors and ergonomics
* Intelligence
* Mind
* Psychology of religion
* Psychometrics
* Terror management theory

Lists

* Counseling topics
* Disciplines
* Organizations
* Outline
* Psychologists
* Psychotherapies
* Research methods
* Schools of thought
* Timeline
* Topics

* Psychology portal

* v
* t
* e

The observer-expectancy effect[a] is a form of reactivity in which a researcher's cognitive bias causes them to subconsciously influence the participants of an experiment. Confirmation bias can lead to the experimenter interpreting results incorrectly because of the tendency to look for information that conforms to their hypothesis, and overlook information that argues against it.[1] It is a significant threat to a study's internal validity, and is therefore typically controlled using a double-blind experimental design.

It may include conscious or unconscious influences on subject behavior including creation of demand characteristics that influence subjects, and altered or selective recording of experimental results themselves.[2]

## Overview

[edit]

The experimenter may introduce cognitive bias into a study in several ways‍—‍in the observer-expectancy effect, the experimenter may subtly communicate their expectations for the outcome of the study to the participants, causing them to alter their behavior to conform to those expectations. Such observer bias effects are near-universal in human data interpretation under expectation and in the presence of imperfect cultural and methodological norms that promote or enforce objectivity.[3]

The classic example of experimenter bias is that of "Clever Hans", an Orlov Trotter horse claimed by his owner von Osten to be able to do arithmetic and other tasks. As a result of the large public interest in Clever Hans, philosopher and psychologist Carl Stumpf, along with his assistant Oskar Pfungst, investigated these claims. Ruling out simple fraud, Pfungst determined that the horse could answer correctly even when von Osten did not ask the questions. However, the horse was unable to answer correctly when either it could not see the questioner, or if the questioner themselves was unaware of the correct answer: When von Osten knew the answers to the questions, Hans answered correctly 89% of the time. However, when von Osten did not know the answers, Hans guessed only 6% of questions correctly. Pfungst then proceeded to examine the behaviour of the questioner in detail, and showed that as the horse's taps approached the right answer, the questioner's posture and facial expression changed in ways that were consistent with an increase in tension, which was released when the horse made the final, correct tap. This provided a cue that the horse had learned to use as a reinforced cue to stop tapping.[citation needed]

Experimenter-bias also influences human subjects. As an example, researchers compared performance of two groups given the same task (rating portrait pictures and estimating how successful each individual was on a scale of −10 to 10), but with different experimenter expectations.[citation needed] In one group, ("Group A"), experimenters were told to expect positive ratings while in another group, ("Group B"), experimenters were told to expect negative ratings. Data collected from Group A was a significant and substantially more optimistic appraisal than the data collected from Group B. The researchers suggested that experimenters gave subtle but clear cues with which the subjects complied.[4]

## Prevention

[edit]

This section does not cite any sources. Please help improve this section by adding citations to reliable sources. Unsourced material may be challenged and removed. (July 2024) (Learn how and when to remove this message)

|

Double blind techniques may be employed to combat bias by causing the experimenter and subject to be ignorant of which condition data flows from.

It might be thought that, due to the central limit theorem of statistics, collecting more independent measurements will improve the precision of estimates, thus decreasing bias. However, this assumes that the measurements are statistically independent. In the case of experimenter bias, the measures share correlated bias: simply averaging such data will not lead to a better statistic but may merely reflect the correlations among the individual measurements and their non-independent nature.

## Notes

[edit]

1. ^ Also called the experimenter-expectancy effect, expectancy bias, observer effect, or experimenter effect.

## See also

[edit]

* Society portal
* Psychology portal

* List of cognitive biases
* Allegiance bias
* Cultural bias
* Demand characteristics
* Epistemic feedback
* Funding bias
* Hawthorne effect
* N rays – imaginary radiation
* Naturalistic observation
* Observer bias
* Participant observer
* Placebo and Nocebo
* Publication bias
* Pygmalion effect – teachers who expect higher achievement from some children actually get it
* Reality tunnel
* Reflexivity (social theory)
* Subject-expectancy effect
* Systematic bias
* White-hat bias

## References

[edit]

1. ^ Goldstein, Bruce. "Cognitive Psychology". Wadsworth, Cengage Learning, 2011, p. 374
2. ^ Barry H. Kantowitz; Henry L. Roediger, III; David G. Elmes (2009). Experimental Psychology. Cengage Learning. p. 371\. ISBN 978-0-495-59533-5. Retrieved 7 September 2013.
3. ^ Rosenthal, R. (1966). Experimenter Effects in Behavioral Research. NY: Appleton-Century-Crofts.
4. ^ Rosenthal R. Experimenter Effects in Behavioral Research. New York, NY: Appleton-Century-Crofts, 1966. 464 p.

## External links

[edit]

* Skeptic's Dictionary on the Experimenter Effect

* v
* t
* e

Biases

Cognitive biases

* Acquiescence
* Ambiguity
* Affinity
* Anchoring
* Attentional
* Attribution
* Actor–observer
* Correspondence
* Authority
* Automation
* Availability
* Mean world
* Belief
* Blind spot
* Choice-supportive
* Commitment
* Confirmation
* Selective perception
* Compassion fade
* Congruence
* Cultural
* Declinism
* Distinction
* Dunning–Kruger
* Egocentric
* Curse of knowledge
* Emotional
* Extrinsic incentives
* Fading affect
* Framing
* Frequency
* Frog pond effect
* Halo effect
* Hindsight
* Horn effect
* Hostile attribution
* Impact
* Implicit
* In-group
* Intentionality
* Illusion of transparency
* Mean world syndrome
* Mere-exposure effect
* Narrative
* Negativity
* Normalcy
* Omission
* Optimism
* Out-group homogeneity
* Outcome
* Overton window
* Precision
* Present
* Pro-innovation
* Proximity
* Response
* Restraint
* Self-serving
* Social comparison
* Social influence bias
* Spotlight
* Status quo
* Substitution
* Time-saving
* Trait ascription
* Turkey illusion
* von Restorff effect
* Zero-risk
* In animals

Statistical biases|

* Estimator
* Forecast
* Healthy user
* Information
* Psychological
* Lead time
* Length time
* Non-response
* Observer
* Omitted-variable
* Participation
* Recall
* Sampling
* Selection
* Self-selection
* Social desirability
* Spectrum
* Survivorship
* Systematic error
* Systemic
* Verification
* Wet

Other biases|

* Academic
* Basking in reflected glory
* Déformation professionnelle
* Funding
* FUTON
* Inductive
* Infrastructure
* Inherent
* In education
* Liking gap
* Media
* False balance
* Vietnam War
* South Asia
* United States
* Arab–Israeli conflict
* Ukraine
* Net
* Political bias
* Publication
* System justification
* Reporting
* White hat
* Ideological bias on Wikipedia

Bias reduction|

* Cognitive bias mitigation
* Debiasing
* Heuristics in judgment and decision-making

* Lists: General
* Memory

* v
* t
* e

Common fallacies (list)

Formal|

| In propositional logic|

* Affirming a disjunct
* Affirming the consequent
* Denying the antecedent
* Argument from fallacy
* Masked man
* Mathematical fallacy

|

In quantificational logic|

* Existential
* Illicit conversion
* Proof by example
* Quantifier shift

Syllogistic fallacy|

* Affirmative conclusion from a negative premise
* Negative conclusion from affirmative premises
* Exclusive premises
* Existential
* Necessity
* Four terms
* Illicit major
* Illicit minor
* Undistributed middle

Informal|

| Equivocation|

* Equivocation
* False equivalence
* False attribution
* Quoting out of context
* Loki's Wager
* No true Scotsman
* Reification

|

Question-begging|

* Circular reasoning / Begging the question
* Loaded language
* Leading question
* Compound question / Loaded question / Complex question
* No true Scotsman

Correlative-based|

* False dilemma
* Perfect solution
* Denying the correlative
* Suppressed correlative

Illicit transference|

* Composition
* Division
* Ecological

Secundum quid|

* Accident
* Converse accident

Faulty generalization|

* Anecdotal evidence
* Sampling bias
* Cherry picking
* McNamara
* Base rate / Conjunction
* Double counting
* False analogy
* Slothful induction
* Overwhelming exception

Ambiguity|

* Accent
* False precision
* Moving the goalposts
* Quoting out of context
* Slippery slope
* Sorites paradox
* Syntactic ambiguity

Questionable cause|

* Animistic
* Furtive
* Correlation implies causation
* Cum hoc
* Post hoc
* Gambler's
* Inverse
* Regression
* Single cause
* Slippery slope
* Texas sharpshooter

Appeals|

* Law/Legality
* Stone / Proof by assertion

| Consequences|

* Argumentum ad baculum
* Wishful thinking

|

Emotion|

* Children
* Fear
* Flattery
* Novelty
* Pity
* Ridicule
* In-group favoritism
* Invented here / Not invented here
* Island mentality
* Loyalty
* Parade of horribles
* Spite
* Stirring symbols
* Wisdom of repugnance

Genetic fallacy|

| Ad hominem|

* Appeal to motive
* Association
* Reductio ad Hitlerum
* Godwin's law
* Reductio ad Stalinum
* Bulverism
* Poisoning the well
* Tone
* Tu quoque
* Whataboutism

|

* Authority
* Accomplishment
* Ipse dixit
* Poverty / Wealth
* Etymology
* Nature
* Tradition / Novelty
* Chronological snobbery

Other fallacies
of relevance|

| Arguments|

* Ad nauseam
* Sealioning
* Argument from anecdote
* Argument from silence
* Argument to moderation
* Argumentum ad populum

|

* Cliché
* The Four Great Errors
* I'm entitled to my opinion
* Ignoratio elenchi
* Invincible ignorance
* Moralistic / Naturalistic
* Motte-and-bailey fallacy
* Psychologist's fallacy
* Rationalization
* Red herring
* Two wrongs make a right
* Special pleading
* Straw man

* Category

* v
* t
* e

Hidden messages

Main|

* Subliminal message

Audio|

* Backmasking
* list
* Hidden track
* list
* pregap list
* Phonetic reversal
* Reverse speech

Numeric|

* Chronogram
* Numerology
* Theomatics
* Bible code
* Cryptology

Visual|

* Fnord
* Hidden text
* Paranoiac-critical method
* Pareidolia
* Psychorama
* Sacred geometry
* Steganography
* Visual cryptography

Other|

* Apophenia
* Asemic writing
* Clustering illusion
* Cryptic crossword
* Anagram
* Easter egg
* Observer-expectancy effect
* Pattern recognition
* Palindrome
* Simulacrum
* Synchronicity
* Unconscious mind

*[v]: View this template
*[t]: Discuss this template
*[e]: Edit this template