Nick Bostrom

Short description: Philosopher and writer (born 1973)

Nick Bostrom

Bostrom in 2020

Born|

Niklas Boström

(1973-03-10) 10 March 1973 (age 53)

Helsingborg, Sweden

Education|

* University of Gothenburg (BA)
* Stockholm University (MA)
* King's College London (MSc)
* London School of Economics (PhD)

Spouse(s)| Susan[1]
Era| Contemporary philosophy
Region| Western philosophy
School| Analytic philosophy[1]
Institutions| Yale University
University of Oxford
Future of Humanity Institute
Thesis| Observational Selection Effects and Probability (2000)
Doctoral advisor| Colin Howson
Craig Callender[2]

Main interests

| Philosophy of artificial intelligence
Bioethics

Notable ideas

| Anthropic bias
Reversal test
Simulation hypothesis
Vulnerable world hypothesis
Existential risk studies
Singleton
Ancestor simulation
Information hazard
Infinitarian paralysis[3]
Self-indication assumption
Self-sampling assumption
Website| nickbostrom.com
Part of the Ideology series on

Transhumanism
Overviews

* Outline of transhumanism
* Transhuman
* Transhumanism in fiction

Currents

* Abolitionism
* Extropianism
* Immortalism
* Postgenderism
* Postpoliticism
* Singularitarianism
* Technogaianism

Political ideologies

* Anarcho-transhumanism
* Libertarian transhumanism
* Democratic transhumanism
* Techno-progressivism

Organizations

* Foresight Institute
* Humanity+
* Institute for Ethics and Emerging Technologies
* Future of Humanity Institute
* LessWrong
* Science Party
* US Transhumanist Party

* v
* t
* e

Nick Bostrom (/ˈbɒstrəm/ BOST-rəm; Swedish: Niklas Boström sv; born 10 March 1973)[4] is a philosopher known for his work on existential risk, the anthropic principle, human enhancement ethics, whole brain emulation, superintelligence risks, and the reversal test. He was the founding director of the later defunct Future of Humanity Institute at the University of Oxford[5] and has become Principal Researcher at the Macrostrategy Research Initiative.[6]

Bostrom is the author of Anthropic Bias: Observation Selection Effects in Science and Philosophy (2002), Philosophy:Superintelligence: Paths, Dangers, Strategies (2014) and Deep Utopia: Life and Meaning in a Solved World (2024).

Bostrom believes that advances in artificial intelligence (AI) may lead to superintelligence, which he defines as "any intellect that greatly exceeds the cognitive performance of humans in virtually all domains of interest". He views this as a major source of opportunities and existential risks.[5][7]

## Contents

* 1 Early life and education
* 2 Research and writing
* 2.1 Existential risk
* 2.1.1 Vulnerable world hypothesis
* 2.2 Digital sentience
* 2.3 Anthropic reasoning
* 2.3.1 Simulation argument
* 2.4 Ethics of human enhancement
* 2.5 Technology strategy
* 2.6 Books
* 2.6.1 Superintelligence: Paths, Dangers, Strategies
* 2.6.1.1 Characteristics of a superintelligence
* 2.6.1.2 Mitigating the risk
* 2.6.1.3 Public reception
* 2.6.2 Deep Utopia: Life and Meaning in a Solved World
* 3 Public engagement
* 3.1 1996 email incident
* 4 Personal life
* 5 Selected works
* 5.1 Books
* 5.2 Journal articles
* 6 See also
* 7 Notes
* 8 References
* 9 External links

## Early life and education

Born as Niklas Boström in 1973 in Helsingborg, Sweden,[8] he disliked school at a young age and spent his last year of high school learning from home. He was interested in a wide variety of academic areas, including anthropology, art, literature, and science.[1]

He received a B.A. degree from the University of Gothenburg in 1994.[9] He then earned an M.A. degree in philosophy and physics from Stockholm University and an MSc degree in computational neuroscience from King's College London in 1996. During his time at Stockholm University, he researched the relationship between language and reality by studying the analytic philosopher W. V. Quine.[1] He also did some turns on London's stand-up comedy circuit.[8] In 2000, he was awarded a PhD degree in philosophy from the London School of Economics under the supervision of Colin Howson and Craig Callender.[2] His thesis was titled Observational selection effects and probability.[2] He held a teaching position at Yale University from 2000 to 2002, and was a British Academy Postdoctoral Fellow at the University of Oxford from 2002 to 2005.[10]

## Research and writing

### Existential risk

Bostrom's research concerns the future of humanity and long-term outcomes.[5][11] He discusses existential risk,[1] which he defines as one in which an "adverse outcome would either annihilate Earth-originating intelligent life or permanently and drastically curtail its potential". Bostrom is mostly concerned about anthropogenic risks, which are risks arising from human activities, particularly from new technologies such as advanced artificial intelligence, molecular nanotechnology, or synthetic biology.[12]

In 2005, Bostrom founded the Future of Humanity Institute which,[1] until its shutdown in 2024, researched the far future of human civilization.[13][14] He is also an adviser to the Centre for the Study of Existential Risk.[11]

In the 2008 essay collection, Global Catastrophic Risks, editors Bostrom and Milan M. Ćirković characterize the relationship between existential risk and the broader class of global catastrophic risks, and link existential risk to observer selection effects[15] and the Fermi paradox.[16]

#### Vulnerable world hypothesis

In a paper called "The Vulnerable World Hypothesis",[17] Bostrom suggests that there may be some technologies that destroy human civilization by default[lower-alpha 1] when discovered. Bostrom proposes a framework for classifying and dealing with these vulnerabilities. He also gives counterfactual thought experiments of how such vulnerabilities could have historically occurred, e.g. if nuclear weapons had been easier to develop or had ignited the atmosphere (as Edward Teller had feared).[19]

### Digital sentience

Bostrom supports the substrate independence principle, the idea that consciousness can emerge on various types of physical substrates, not only in "carbon-based biological neural networks" like the human brain.[20] He considers that "sentience is a matter of degree"[21] and that digital minds can in theory be engineered to have a much higher rate and intensity of subjective experience than humans, using less resources. Such highly sentient machines, which he calls "super-beneficiaries", would be extremely efficient at achieving happiness. He recommends finding "paths that will enable digital minds and biological minds to coexist, in a mutually beneficial way where all of these different forms can flourish and thrive".[22]

### Anthropic reasoning

Bostrom has published numerous articles on anthropic reasoning, as well as the book Anthropic Bias: Observation Selection Effects in Science and Philosophy. In the book, he criticizes previous formulations of the anthropic principle, including those of Brandon Carter, John Leslie, John Barrow, and Frank Tipler.[23]

Bostrom believes that the mishandling of indexical information is a common flaw in many areas of inquiry (including cosmology, philosophy, evolution theory, game theory, and quantum physics). He argues that an anthropic theory is needed to deal with these. He introduces the self-sampling assumption (SSA) and analyzes the self-indication assumption (SIA), shows how they lead to different conclusions in a number of cases, and identifies how each is affected by paradoxes or counterintuitive implications in certain thought experiments. He argues against SIA and proposes refining SSA into the strong self-sampling assumption (SSSA), which replaces "observers" in the SSA definition with "observer-moments".[24]

In later work, he proposed with Milan M. Ćirković and Anders Sandberg the phenomenon of anthropic shadow, an observation selection effect that prevents observers from observing certain kinds of catastrophes in their recent geological and evolutionary past. They suggest that events that lie in the anthropic shadow are likely to be underestimated unless statistical corrections are made.[25][26]

#### Simulation argument

Main article: Simulation hypothesis

Bostrom's simulation argument posits that at least one of the following statements is very likely to be true:[27][28]

1. The fraction of human-level civilizations that reach a posthuman stage is very close to zero;
2. The fraction of posthuman civilizations that are interested in running ancestor-simulations is very close to zero;
3. The fraction of all people with our kind of experiences that are living in a simulation is very close to one.

### Ethics of human enhancement

Bostrom is favorably disposed toward "human enhancement", or "self-improvement and human perfectibility through the ethical application of science", as well as a critic of bio-conservative views.[29]

In 1998, Bostrom co-founded (with David Pearce) the World Transhumanist Association[29] (which has since changed its name to Humanity+). In 2004, he co-founded (with James Hughes) the Institute for Ethics and Emerging Technologies,[30] although he is no longer involved with either of these organisations.

In 2005, Bostrom published the short story "The Fable of the Dragon-Tyrant" in the Journal of Medical Ethics. A shorter version was published in 2012 in Philosophy Now.[31] The fable personifies death as a dragon that demands a tribute of thousands of people every day. The story explores how status quo bias and learned helplessness can prevent people from taking action to defeat aging even when the means to do so are at their disposal. YouTuber CGP Grey created an animated version of the story.[32]

With philosopher Toby Ord, he proposed the reversal test in 2006. Given humans' irrational status quo bias, how can one distinguish between valid criticisms of proposed changes in a human trait and criticisms merely motivated by resistance to change? The reversal test attempts to do this by asking whether it would be a good thing if the trait was altered in the opposite direction.[33]

Bostrom's work also considers potential dysgenic effects in human populations but he thinks genetic engineering can provide a solution and that "In any case, the time-scale for human natural genetic evolution seems much too grand for such developments to have any significant effect before other developments will have made the issue moot".[34]

### Technology strategy

See also: Differential technological development

Bostrom has suggested that technology policy aimed at reducing existential risk should seek to influence the order in which various technological capabilities are attained, proposing the principle of differential technological development. This principle states that we ought to retard the development of dangerous technologies, particularly ones that raise the level of existential risk, and accelerate the development of beneficial technologies, particularly those that protect against the existential risks posed by nature or by other technologies.[34]

In 2011, Bostrom founded the Oxford Martin Program on the Impacts of Future Technology.[35]

Bostrom's theory of the unilateralist's curse has been cited as a reason for the scientific community to avoid controversial dangerous research such as reanimating pathogens.[36]

### Books

#### Superintelligence: Paths, Dangers, Strategies

In 2014, Bostrom published Philosophy:Superintelligence: Paths, Dangers, Strategies, which became a New York Times Best Seller.[37] The book argues that superintelligence is possible and explores different types of superintelligences, their cognition, the associated risks. He also presents technical and strategic considerations on how to make it safe.

##### Characteristics of a superintelligence

Bostrom explores multiple possible paths to superintelligence, including whole brain emulation and human intelligence enhancement, but focuses on artificial general intelligence, explaining that electronic devices have many advantages over biological brains.[38]

Bostrom draws a distinction between final goals and instrumental goals. A final goal is what an agent tries to achieve for its own intrinsic value. Instrumental goals are just intermediary steps towards final goals. Bostrom contends there are instrumental goals that will be shared by most sufficiently intelligent agents because they are generally useful to achieve any objective (e.g. preserving the agent's own existence or current goals, acquiring resources, improving its cognition...), this is the concept of instrumental convergence. On the other side, he writes that virtually any level of intelligence can in theory be combined with virtually any final goal (even absurd final goals, e.g. making paperclips), a concept he calls the orthogonality thesis.[39]

He argues that an AI with the ability to improve itself might initiate an intelligence explosion, resulting (potentially rapidly) in a superintelligence.[40] Such a superintelligence could have vastly superior capabilities, notably in strategizing, social manipulation, hacking or economic productivity. With such capabilities, a superintelligence could outwit humans and take over the world, establishing a singleton (which is "a world order in which there is at the global level a single decision-making agency"[lower-alpha 2]) and optimizing the world according to its final goals.[38]

Bostrom argues that giving simplistic final goals to a superintelligence could be catastrophic:

> Suppose we give an A.I. the goal to make humans smile. When the A.I. is weak, it performs useful or amusing actions that cause its user to smile. When the A.I. becomes superintelligent, it realizes that there is a more effective way to achieve this goal: take control of the world and stick electrodes into the facial muscles of humans to cause constant, beaming grins.[34]

##### Mitigating the risk

Bostrom explores several pathways to reduce the existential risk from AI. He emphasizes the importance of international collaboration, notably to reduce race to the bottom and AI arms race dynamics. He suggests potential techniques to help control AI, including containment, stunting AI capabilities or knowledge, narrowing the operating context (e.g. to question-answering), or "tripwires" (diagnostic mechanisms that can lead to a shutdown).[38] But Bostrom contends that "we should not be confident in our ability to keep a superintelligent genie locked up in its bottle forever. Sooner or later, it will out". He thus suggests that in order to be safe for humanity, superintelligence must be aligned with morality or human values so that it is "fundamentally on our side".[41] Potential AI normativity frameworks include Yudkowsky's coherent extrapolated volition (human values improved via extrapolation), moral rightness (doing what is morally right), and moral permissibility (following humanity's coherent extrapolated volition except when it's morally impermissible).[38]

Bostrom warns that an existential catastrophe can also occur from AI being misused by humans for destructive purposes, or from humans failing to take into account the potential moral status of digital minds. Despite these risks, he says that machine superintelligence seems involved at some point in "all the plausible paths to a really great future".[7]

##### Public reception

The book became a New York Times Best Seller and received positive feedback from personalities such as Stephen Hawking, Bill Gates, Elon Musk, Peter Singer and Derek Parfit. It was praised for offering clear and compelling arguments on a neglected yet important topic. It was sometimes criticized for spreading pessimism about the potential of AI, or for focusing on longterm and speculative risks.[42] Some skeptics such as Daniel Dennett or Oren Etzioni contended that superintelligence is too far away for the risk to be significant.[43][44] Yann LeCun considers that there is no existential risk, asserting that superintelligent AI will have no desire for self-preservation[45] and that experts can be trusted to make it safe.[46]

Raffi Khatchadourian wrote that Bostrom's book on superintelligence "is not intended as a treatise of deep originality; Bostrom's contribution is to impose the rigors of analytic philosophy on a messy corpus of ideas that emerged at the margins of academic thought."[42]

#### Deep Utopia: Life and Meaning in a Solved World

In his 2024 book, Deep Utopia: Life and Meaning in a Solved World, Bostrom explores the concept of an ideal life, if humanity transitions successfully into a post-superintelligence world. Bostrom notes that the question is "not how interesting a future is to look at, but how good it is to live in." He outlines some technologies that he considers physically possible in theory and available at technological maturity, such as cognitive enhancement, reversal of aging, arbitrary sensory inputs (taste, sound...), or the precise control of motivation, mood, well-being and personality. According to him, not only machines would be better than humans at working, but they would also undermine the purpose of many leisure activities, providing extreme welfare while challenging the quest for meaning.[47][48]

## Public engagement

Bostrom has provided policy advice and consulted for many governments and organizations. He gave evidence to the House of Lords, Select Committee on Digital Skills.[49] He is an advisory board member for the Machine Intelligence Research Institute,[50] Future of Life Institute,[51] and an external advisor for the Cambridge Centre for the Study of Existential Risk.[52]

### 1996 email incident

In January 2023, Bostrom issued an apology[53] for a 1996 listserv email[54] he sent as a postgrad where he had stated that he thought "Blacks are more stupid than whites", and where he also used the word "niggers" in a description of how he thought this statement might be perceived by others.[55][56] The apology, posted on his website,[53] stated that "the invocation of a racial slur was repulsive" and that he "completely repudiate[d] this disgusting email".[55]

The email has been described as "racist" in several news sources.[57][58][59][55] According to Andrew Anthony of The Guardian, "The apology did little to placate Bostrom’s critics, not least because he conspicuously failed to withdraw his central contention regarding race and intelligence, and seemed to make a partial defence of eugenics."[60]

Shortly afterward, Oxford University condemned the language used in the email and started an investigation.[55][58] The investigation concluded on 10 August 2023: "[W]e do not consider you to be a racist or that you hold racist views, and we consider that the apology you posted in January 2023 was sincere."[61][60]

## Personal life

Bostrom met his wife Susan in 2002. As of 2015, she lived in Montreal and Bostrom in Oxford. They have one son.[1]

## Selected works

### Books

* 2002 – Anthropic Bias: Observation Selection Effects in Science and Philosophy, ISBN 0-415-93858-9
* 2008 – Global Catastrophic Risks, edited by Bostrom and Milan M. Ćirković, ISBN 978-0-19-857050-9
* 2009 – Human Enhancement, edited by Bostrom and Julian Savulescu, ISBN 0-19-929972-2
* 2014 – Philosophy:Superintelligence: Paths, Dangers, Strategies, ISBN 978-0-19-967811-2
* 2024 - Deep Utopia: Life and Meaning in a Solved World, ISBN 978-1646871643

### Journal articles

* Bostrom, Nick (1998). "How Long Before Superintelligence?". Journal of Future Studies 2. http://www.nickbostrom.com/superintelligence.html.
* ~~~~ (January 2000). "Observer-relative chances in anthropic reasoning?". Erkenntnis 52 (1): 93–108. doi:10.1023/A:1005551304409. http://www.anthropic-principle.com/preprints/rel/relative.html.
* ~~~~ (October 2001). "The Meta-Newcomb Problem". Analysis 61 (4): 309–310. doi:10.1111/1467-8284.00310. http://www.nickbostrom.com/papers/newcomb.html.
* ~~~~ (March 2002). "Existential Risks: Analyzing Human Extinction Scenarios and Related Hazards". Journal of Evolution and Technology 9 (1). http://www.nickbostrom.com/existential/risks.html.
* ~~~~ (April 2003). "Are You Living in a Computer Simulation?". Philosophical Quarterly 53 (211): 243–255. doi:10.1111/1467-9213.00309. http://www.simulation-argument.com/simulation.pdf.
* ~~~~ (2003). "The Mysteries of Self-Locating Belief and Anthropic Reasoning". Harvard Review of Philosophy 11 (Spring): 59–74. doi:10.5840/harvardreview20031114. http://anthropic-principle.com/preprints/mys/mysteries.pdf.
* ~~~~ (November 2003). "Astronomical Waste: The Opportunity Cost of Delayed Technological Development". Utilitas 15 (3): 308–314. doi:10.1017/S0953820800004076. http://www.nickbostrom.com/astronomical/waste.html.
* ~~~~ (June 2005). "In Defense of Posthuman Dignity". Bioethics 19 (3): 202–214. doi:10.1111/j.1467-8519.2005.00437.x. PMID 16167401. http://www.nickbostrom.com/ethics/dignity.html.
* with Tegmark, Max (December 2005). "How Unlikely is a Doomsday Catastrophe?". Nature 438 (7069): 754. doi:10.1038/438754a. PMID 16341005. Bibcode: 2005Natur.438..754T.
* ~~~~ (2006). "What is a Singleton?". Linguistic and Philosophical Investigations 5 (2): 48–54. http://www.nickbostrom.com/fut/singleton.html.
* with Ord, Toby (July 2006). "The Reversal Test: Eliminating Status Quo Bias in Applied Ethics". Ethics 116 (4): 656–680. doi:10.1086/505233. PMID 17039628. http://www.nickbostrom.com/ethics/statusquo.pdf.
* with Sandberg, Anders (December 2006). "Converging Cognitive Enhancements". Annals of the New York Academy of Sciences 1093 (1): 201–207. doi:10.1196/annals.1382.015. PMID 17312260. Bibcode: 2006NYASA1093..201S. http://www.nickbostrom.com/papers/converging.pdf.
* ~~~~ (January 2008). "Drugs can be used to treat more than disease". Nature 452 (7178): 520. doi:10.1038/451520b. PMID 18235476. Bibcode: 2008Natur.451..520B. http://www.nickbostrom.com/letters/drugs.pdf.
* ~~~~ (2008). "The doomsday argument". Think 6 (17–18): 23–28. doi:10.1017/S1477175600002943.
* ~~~~ (2008). "Where Are They? Why I hope the search for extraterrestrial life finds nothing". Technology Review (May/June): 72–77. http://www.nickbostrom.com/extraterrestrial.pdf.
* Bostrom, Nick (2008). "Letter from Utopia". Studies in Ethics, Law, and Technology 2 (1). doi:10.2202/1941-6008.1025.
* with Sandberg, Anders (September 2009). "Cognitive Enhancement: Methods, Ethics, Regulatory Challenges". Science and Engineering Ethics 15 (3): 311–341. doi:10.1007/s11948-009-9142-5. PMID 19543814. http://www.nickbostrom.com/cognitive.pdf.
* ~~~~ (2009). "Pascal's Mugging". Analysis 69 (3): 443–445. doi:10.1093/analys/anp062. http://www.nickbostrom.com/papers/pascal.pdf.
* with Ćirković, Milan; Sandberg, Anders (2010). "Anthropic Shadow: Observation Selection Effects and Human Extinction Risks". Risk Analysis 30 (10): 1495–1506. doi:10.1111/j.1539-6924.2010.01460.x. PMID 20626690. Bibcode: 2010RiskA..30.1495C. http://www.nickbostrom.com/papers/anthropicshadow.pdf.
* ~~~~ (2011). "Information Hazards: A Typology of Potential Harms from Knowledge". Review of Contemporary Philosophy 10: 44–79. ProQuest 920893069. http://www.nickbostrom.com/information-hazards.pdf.
* Bostrom, Nick (2011). "THE ETHICS OF ARTIFICIAL INTELLIGENCE". Cambridge Handbook of Artificial Intelligence. http://www.nickbostrom.com/ethics/artificial-intelligence.pdf. Retrieved 13 February 2017.
* Bostrom, Nick (2011). "Infinite Ethics". Analysis and Metaphysics 10: 9–59. http://www.nickbostrom.com/ethics/infinite.pdf.
* ~~~~ (May 2012). "The Superintelligent Will: Motivation and Instrumental Rationality in Advanced Artificial Agents". Minds and Machines 22 (2): 71–84. doi:10.1007/s11023-012-9281-3. http://www.nickbostrom.com/superintelligentwill.pdf.
* with Armstrong, Stuart; Sandberg, Anders (November 2012). "Thinking Inside the Box: Controlling and Using Oracle AI". Minds and Machines 22 (4): 299–324. doi:10.1007/s11023-012-9282-2. http://www.nickbostrom.com/papers/oracle.pdf.
* ~~~~ (February 2013). "Existential Risk Reduction as Global Priority". Global Policy 4 (3): 15–31. doi:10.1111/1758-5899.12002. http://www.existential-risk.org/concept.html.
* with Shulman, Carl (February 2014). "Embryo Selection for Cognitive Enhancement: Curiosity or Game-changer?". Global Policy 5 (1): 85–92. doi:10.1111/1758-5899.12123. http://www.nickbostrom.com/papers/embryo.pdf.
* with Muehlhauser, Luke (2014). "Why we need friendly AI". Think 13 (36): 41–47. doi:10.1017/S1477175613000316. http://www.nickbostrom.com/views/whyfriendlyai.pdf.
* Bostrom, Nick (September 2019). "The Vulnerable World Hypothesis". Global Policy 10 (4): 455–476. doi:10.1111/1758-5899.12718.

## See also

* Doomsday argument
* Dream argument
* Effective altruism
* Pascal's mugging

## Notes

1. ↑ Bostrom says that the risk can be reduced if society sufficiently exits what he calls a "semi-anarchic default condition", which roughly means limited capabilities for preventive policing and global governance, and having individuals with diverse motivations.[18]
2. ↑ Bostrom notes that "the concept of a singleton is an abstract one: a singleton could be democracy, a tyranny, a single dominant AI, a strong set of global norms that include effective provisions for their own enforcement, or even an alien overlord—its defining characteristic being simply that it is some form of agency that can solve all major global coordination problems"[38]

## References

1. ↑ 1.0 1.1 1.2 1.3 1.4 1.5 1.6 Khatchadourian, Raffi (23 November 2015). "The Doomsday Invention". The New Yorker XCI (37): 64–79. ISSN 0028-792X. https://www.newyorker.com/magazine/2015/11/23/doomsday-invention-artificial-intelligence-nick-bostrom.
2. ↑ 2.0 2.1 2.2 Bostrom, Nick (2000). Observational selection effects and probability (phd thesis). London School of Economics and Political Science.
3. ↑ "Infinite Ethics". https://nickbostrom.com/ethics/infinite.pdf.
4. ↑ "nickbostrom.com". Nickbostrom.com. http://www.nickbostrom.com/cv.html.
5. ↑ 5.0 5.1 5.2 Shead, Sam (25 May 2020). "How Britain's oldest universities are trying to protect humanity from risky A.I." (in en). CNBC. https://www.cnbc.com/2020/05/25/oxford-cambridge-ai.html.
6. ↑ "Nick Bostrom's Home Page" (in en). https://nickbostrom.com/.
7. ↑ 7.0 7.1 "Nick Bostrom on the birth of superintelligence" (in en-US). https://bigthink.com/series/the-big-think-interview/superintelligence/.
8. ↑ 8.0 8.1 Thornhill, John (14 July 2016). "Artificial intelligence: can we control it?". Financial Times. https://www.ft.com/content/46d12e7c-4948-11e6-b387-64ab0a67014c.
9. ↑ Bostrom, Nick. "CV". https://www.nickbostrom.com/cv.pdf.
10. ↑ "Nick Bostrom on artificial intelligence". Oxford University Press. 8 September 2014. http://blog.oup.com/2014/09/interview-nick-bostrom-superintelligence/.
11. ↑ 11.0 11.1 Andersen, Ross. "Omens". http://aeon.co/magazine/philosophy/ross-andersen-human-extinction/.
12. ↑ Andersen, Ross (2012-03-06). "We're Underestimating the Risk of Human Extinction" (in en-US). https://www.theatlantic.com/technology/archive/2012/03/were-underestimating-the-risk-of-human-extinction/253821/.
13. ↑ Maiberg, Emanuel (2024-04-17). "Institute That Pioneered AI 'Existential Risk' Research Shuts Down" (in en). https://www.404media.co/institute-that-pioneered-ai-existential-risk-research-shuts-down/.
14. ↑ "Future of Humanity Institute". 2024-04-17. https://www.futureofhumanityinstitute.org/.
15. ↑ Tegmark, Max; Bostrom, Nick (2005). "Astrophysics: is a doomsday catastrophe likely?". Nature 438 (7069): 754. doi:10.1038/438754a. PMID 16341005. Bibcode: 2005Natur.438..754T. http://www.fhi.ox.ac.uk/__data/assets/pdf_file/0019/5923/How_Unlikely_is_a_Doomsday_Catastrophe_plus_Supplementary_Materials.pdf.
16. ↑ Overbye, Dennis (3 August 2015). "The Flip Side of Optimism About Life on Other Planets". The New York Times. https://www.nytimes.com/2015/08/04/science/space/the-flip-side-of-optimism-about-life-on-other-planets.html.
17. ↑ Bostrom, Nick (November 2019). "The Vulnerable World Hypothesis". Global Policy 10 (4): 455–476. doi:10.1111/1758-5899.12718. https://nickbostrom.com/papers/vulnerable.pdf.
18. ↑ Abhijeet, Katte (2018-12-25). "AI Doomsday Can Be Avoided If We Establish 'World Government': Nick Bostrom" (in en). https://analyticsindiamag.com/ai-doomsday-can-be-avoided-if-we-establish-world-government-nick-bostrom/.
19. ↑ Piper, Kelsey (2018-11-19). "How technological progress is making it likelier than ever that humans will destroy ourselves" (in en). https://www.vox.com/future-perfect/2018/11/19/18097663/nick-bostrom-vulnerable-world-global-catastrophic-risks.
20. ↑ Bostrom, Nick (2003). "Are You Living In a Computer Simulation?". Philosophical Quarterly 53 (211): 243–255. doi:10.1111/1467-9213.00309. https://simulation-argument.com/simulation.pdf.
21. ↑ Jackson, Lauren (2023-04-12). "What if A.I. Sentience Is a Question of Degree?" (in en-US). The New York Times. ISSN 0362-4331. https://www.nytimes.com/2023/04/12/world/artificial-intelligence-nick-bostrom.html.
22. ↑ Fisher, Richard (13 November 2020). "The intelligent monster that you should let eat you" (in en). https://www.bbc.com/future/article/20201111-philosophy-of-utility-monsters-and-artificial-intelligence.
23. ↑ Bostrom, Nick (2002). Anthropic Bias: Observation Selection Effects in Science and Philosophy. New York: Routledge. pp. 44–58. ISBN 978-0-415-93858-7. http://www.anthropic-principle.com/sites/anthropic-principle.com/files/pdfs/anthropicbias.pdf. Retrieved 22 July 2014.
24. ↑ Manson, Neil (2003-02-09). "Anthropic Bias: Observation Selection Effects in Science and Philosophy". https://ndpr.nd.edu/reviews/anthropic-bias-observation-selection-effects-in-science-and-philosophy/.
25. ↑ Brannen, Peter (2018-03-15). "Why Earth's History Appears So Miraculous" (in en). https://www.theatlantic.com/science/archive/2018/03/human-existence-will-look-more-miraculous-the-longer-we-survive/554513/.
26. ↑ "Anthropic Shadow: Observation Selection Effects and Human Extinction Risks". Nickbostrom.com. http://www.nickbostrom.com/papers/anthropicshadow.pdf.
27. ↑ Sutter, Paul (2024-01-31). "Could our Universe be a simulation? How would we even tell?" (in en-us). https://arstechnica.com/science/2024/01/could-our-universe-be-a-simulation-how-would-we-even-tell/.
28. ↑ Nesbit, Jeff. "Proof of the Simulation Argument". US News. https://www.usnews.com/news/blogs/at-the-edge/2012/12/17/proof-of-the-simulation-argument.
29. ↑ 29.0 29.1 Sutherland, John (9 May 2006). "The ideas interview: Nick Bostrom; John Sutherland meets a transhumanist who wrestles with the ethics of technologically enhanced human beings". The Guardian. https://www.theguardian.com/science/2006/may/09/academicexperts.genetics.
30. ↑ "A Philosophical History of Transhumanism". 2024. https://philosophynow.org/issues/160/A_Philosophical_History_of_Transhumanism.
31. ↑ Bostrom, Nick (2012-06-12). "The Fable of the Dragon-Tyrant" (in en). Philosophy Now 89: 6–9. https://philosophynow.org/issues/89/The_Fable_of_the_Dragon-Tyrant.
32. ↑ Fable of the Dragon-Tyrant (Video). 24 April 2018.
33. ↑ Bostrom, Nick; Ord, Toby (2006). "The reversal test: eliminating status quo bias in applied ethics". Ethics 116 (4): 656–679. doi:10.1086/505233. PMID 17039628. http://www.nickbostrom.com/ethics/statusquo.pdf.
34. ↑ 34.0 34.1 34.2 Bostrom, Nick (2002). "Existential Risks - Analyzing Human Extinction Scenarios and Related Hazards". Journal of Evolution and Technology. https://nickbostrom.com/existential/risks.
35. ↑ "Professor Nick Bostrom : People". Oxford Martin School. http://www.oxfordmartin.ox.ac.uk/people/22.
36. ↑ Lewis, Gregory (2018-02-19). "Horsepox synthesis: A case of the unilateralist's curse?". Bulletin of the Atomic Scientists. https://thebulletin.org/horsepox-synthesis-case-unilateralist’s-curse11523.
37. ↑ "Best Selling Science Books". The New York Times. 2014-09-08. https://www.nytimes.com/2014/09/09/science/best-selling-science-books.html.
38. ↑ 38.0 38.1 38.2 38.3 38.4 Bostrom, Nick (2016). Superintelligence. Oxford University Press. pp. 98–111. ISBN 978-0-19-873983-8. OCLC 943145542.
39. ↑ Bostrom, Nick (2014-09-11). "You Should Be Terrified of Superintelligent Machines" (in en-US). Slate. ISSN 1091-2339. https://slate.com/technology/2014/09/will-artificial-intelligence-turn-on-us-robots-are-nothing-like-humans-and-thats-what-makes-them-so-terrifying.html.
40. ↑ "Clever cogs". The Economist. ISSN 0013-0613. https://www.economist.com/books-and-arts/2014/08/09/clever-cogs.
41. ↑ Bostrom, Nick (March 2015). "What happens when our computers get smarter than we are?". https://www.ted.com/talks/nick_bostrom_what_happens_when_our_computers_get_smarter_than_we_are.
42. ↑ 42.0 42.1 Khatchadourian, Raffi (2015-11-16). "The Doomsday Invention" (in en-US). The New Yorker. https://www.newyorker.com/magazine/2015/11/23/doomsday-invention-artificial-intelligence-nick-bostrom. Retrieved 2023-08-13.
43. ↑ "Is Superintelligence Impossible?". https://www.edge.org/conversation/john_brockman-is-superintelligence-impossible.
44. ↑ Oren Etzioni (2016). "No, the Experts Don't Think Superintelligent AI is a Threat to Humanity". MIT Technology Review. https://www.technologyreview.com/s/602410/no-the-experts-dont-think-superintelligent-ai-is-a-threat-to-humanity/.
45. ↑ Arul, Akashdeep (2022-01-27). "Yann LeCun sparks a debate on AGI vs human-level AI" (in en-US). https://analyticsindiamag.com/yann-lecun-sparks-a-debate-on-agi-vs-human-level-ai/.
46. ↑ Taylor, Chloe (15 June 2023). "Almost half of CEOs fear A.I. could destroy humanity five to 10 years from now—but 'A.I. godfather' says an existential threat is 'preposterously ridiculous'" (in en). https://fortune.com/2023/06/15/yann-lecun-ai-godfather-destroy-humanity-threat/.
47. ↑ Coy, Peter (2024-04-05). "If A.I. Takes All Our Jobs, Will It Also Take Our Purpose?" (in en-US). The New York Times. ISSN 0362-4331. https://www.nytimes.com/2024/04/05/opinion/ai-jobs-nick-bostrom.html.
48. ↑ Bostrom, Nick (2024). "Technological maturity". Deep utopia: life and meaning in a solved world. Washington, DC: Ideapress Publishing. ISBN 978-1-64687-164-3.
49. ↑ "Digital Skills Committee – timeline" (in en). http://www.parliament.uk/business/committees/committees-a-z/lords-select/digital-skills-committee/timeline/.
50. ↑ "Team – Machine Intelligence Research Institute". https://intelligence.org/team/#advisors.
51. ↑ "Team – Future of Life Institute". https://futureoflife.org/team/.
52. ↑ McBain, Sophie (4 October 2014). "Apocalypse Soon: Meet The Scientists Preparing For the End Times". New Republic. https://newrepublic.com/article/119697/scientists-preparing-apocalypse. Retrieved 17 March 2017.
53. ↑ 53.0 53.1 Bostrom, Nick. "Apology for old email". https://nickbostrom.com/oldemail.pdf.
54. ↑ "extropians: Re: Offending People's Minds". 2015-04-27. http://extropians.weidai.com/extropians.96/0441.html.
55. ↑ 55.0 55.1 55.2 55.3 Ladden-Hall, Dan (2023-01-12). "Top Oxford Philosopher Nick Bostrom Admits Writing 'Disgusting' N-Word Mass Email" (in en). The Daily Beast. https://www.thedailybeast.com/nick-bostrom-oxford-philosopher-admits-writing-racist-n-word-email. "Nick Bostrom posted a note on his website apologizing for the appallingly racist listserv email."
56. ↑ Robins-Early, Nick (19 April 2024). "Oxford shuts down institute run by Elon Musk-backed philosopher". The Guardian. https://www.theguardian.com/technology/2024/apr/19/oxford-future-of-humanity-institute-closes. "The closure of Bostrom’s center is a further blow to the effective altruism and long-termism movements that the philosopher had spent decades championing, and which in recent years have become mired in scandals related to racism, sexual harassment and financial fraud. Bostrom himself issued an apology last year after a decades-old email surfaced in which he claimed “Blacks are more stupid than whites” and used the N-word."
57. ↑ Weinberg, Justin (13 January 2023). "Why a Philosopher's Racist Email from 26 Years Ago is News Today". The Daily Nous. https://dailynous.com/2023/01/13/why-philosophers-racist-email-26-years-ago-news-today/. "Influential Oxford philosopher Nick Bostrom, well-known for his work on philosophical questions related to ethics, the future, and technology (existential risk, artificial intelligence, simulation), posted an apology for a blatantly racist email he sent to a listserv 26 years ago."
58. ↑ 58.0 58.1 Bilyard, Dylan (15 January 2023). "Investigation Launched into Oxford Don's Racist Email". The Oxford Blue. https://theoxfordblue.co.uk/investigation-launched-into-oxford-dons-racist-email/.
59. ↑ Gault, Matthew; Pearson, Jordan (12 January 2023). "Prominent AI Philosopher and 'Father' of Longtermism Sent Very Racist Email to a 90s Philosophy Listserv". Vice. https://www.vice.com/en/article/prominent-ai-philosopher-and-father-of-longtermism-sent-very-racist-email-to-a-90s-philosophy-listserv/. "Nick Bostrom, an influential philosopher at the University of Oxford who has been called the “father” of the longtermism movement, has apologized for a racist email he sent in the mid-90s. In the email, Bostrom said that “Blacks are more stupid than whites,” adding, “I like that sentence and think it is true,” and used a racial slur."
60. ↑ 60.0 60.1 Anthony, Andrew (2024-04-28). "'Eugenics on steroids': the toxic and contested legacy of Oxford's Future of Humanity Institute" (in en-GB). The Observer. ISSN 0029-7712. https://www.theguardian.com/technology/2024/apr/28/nick-bostrom-controversial-future-of-humanity-institute-closure-longtermism-affective-altruism. "The apology did little to placate Bostrom’s critics, not least because he conspicuously failed to withdraw his central contention regarding race and intelligence, and seemed to make a partial defence of eugenics. Although, after an investigation, Oxford University did accept that Bostrom was not a racist, the whole episode left a stain on the institute’s reputation"
61. ↑ Bostrom, Nick. "Apology for an Old Email". https://nickbostrom.com/oldemail.pdf. "we do not consider you to be a racist or that you hold racist views, and we consider that the apology you posted in January 2023 was sincere. … we believe that your apology, your acknowledgement of the distress your actions caused, and your appreciation for the care and time that everyone has given to this process has been genuine and sincere. We were also encouraged that you have already embarked on a journey of deep and meaningful reflection, which includes exploring the learning and self-education from this process."

## External links

* Official website
* {{TED speaker}} template missing ID and not present in Wikidata.

* v
* t
* e

Effective altruism

Concepts|

* Charity assessment
* Demandingness objection
* Disability-adjusted life year
* Earning to give
* Equal consideration of interests
* Marginal utility
* Quality-adjusted life year
* Utilitarianism
* Venture philanthropy

Key figures|

* Liv Boeree
* Nick Bostrom
* Hilary Greaves
* Holden Karnofsky
* William MacAskill
* Dustin Moskovitz
* Yew-Kwang Ng
* Toby Ord
* Derek Parfit
* Peter Singer
* Eliezer Yudkowsky

Organizations|

* 80,000 Hours
* Animal Charity Evaluators
* Animal Ethics
* Against Malaria Foundation
* Center for High Impact Philanthropy
* Centre for the Study of Existential Risk
* Deworm the World Initiative
* Faunalytics
* Future of Humanity Institute
* Future of Life Institute
* Founders Pledge
* GiveDirectly
* GiveWell
* Giving What We Can
* Good Ventures
* The Good Food Institute
* The Humane League
* Mercy for Animals
* Machine Intelligence Research Institute
* Malaria Consortium
* Open Philanthropy Project
* Raising for Effective Giving
* Schistosomiasis Control Initiative
* Sentience Institute

Focus areas|

* Aid effectiveness
* Biotechnology risk
* Climate change
* Cultured meat
* Disease burden
* Economic stability
* Existential risk from artificial general intelligence
* Global catastrophic risk
* Global health
* Global poverty
* Immigration reform
* Intensive animal farming
* Land use reform
* Life extension
* Malaria prevention
* Mass deworming
* Neglected tropical diseases
* Wild animal suffering

Literature|

* Doing Good Better
* The End of Animal Farming
* Famine, Affluence, and Morality
* The Life You Can Save
* Living High and Letting Die
* The Most Good You Can Do
* Practical Ethics
* The Precipice

* v
* t
* e

Existential risk from artificial intelligence

Concepts|

* AI box
* AI takeover
* Control problem
* Existential risk from artificial general intelligence
* Friendly artificial intelligence
* Instrumental convergence
* Intelligence explosion
* Machine ethics
* Superintelligence
* Technological singularity

Organizations|

* Allen Institute for Artificial Intelligence
* Center for Applied Rationality
* Center for Security and Emerging Technology
* Centre for the Study of Existential Risk
* DeepMind
* Foundational Questions Institute
* Future of Humanity Institute
* Future of Life Institute
* Humanity+
* Institute for Ethics and Emerging Technologies
* Leverhulme Centre for the Future of Intelligence
* Machine Intelligence Research Institute
* OpenAI

People|

* Nick Bostrom
* Sam Harris
* Stephen Hawking
* Bill Hibbard
* Bill Joy
* Elon Musk
* Steve Omohundro
* Huw Price
* Martin Rees
* Stuart J. Russell
* Jaan Tallinn
* Max Tegmark
* Frank Wilczek
* Roman Yampolskiy
* Andrew Yang
* Eliezer Yudkowsky

Other|

* Open Letter on Artificial Intelligence
* Ethics of artificial intelligence
* Controversies and dangers of artificial general intelligence
* Artificial intelligence as a global catastrophic risk
* Superintelligence
* Our Final Invention

Category

* v
* t
* e

Future of Humanity Institute

People|

* Nick Bostrom
* K. Eric Drexler
* Robin Hanson
* Toby Ord
* Anders Sandberg

Concepts|

* Differential technological development
* Global catastrophic risk
* Great Filter
* Pascal's mugging
* Reversal test
* Self-indication assumption
* Self-sampling assumption
* Simulation hypothesis
* Singleton

Works|

* Anthropic Bias
* Global Catastrophic Risks
* Human Enhancement
* The Precipice
* Superintelligence

* v
* t
* e

Transhumanism

Overviews|

* Outline of transhumanism
* Transhumans
* Transhumanism in fiction

Currents|

* Abolitionism
* Extropianism
* Immortalism
* Postgenderism
* Postpoliticism
* Singularitarianism
* Technogaianism

Political ideologies|

* Anarcho-transhumanism
* Democratic transhumanism
* Libertarian transhumanism
* Techno-progressivism

Organizations|

* Foresight Institute
* Humanity+
* Institute for Ethics and Emerging Technologies
* Future of Humanity Institute
* LessWrong
* Science Party
* US Transhumanist Party

People|

* Nick Bostrom
* José Luis Cordeiro
* K. Eric Drexler
* Ben Goertzel
* Aubrey de Grey
* Zoltan Istvan
* FM-2030
* Nikolai Fyodorovich Fyodorov
* Robin Hanson
* Ray Kurzweil
* Ole Martin Moen
* Hans Moravec
* Max More
* Elon Musk
* David Pearce
* Martine Rothblatt
* Anders Sandberg
* Gennady Stolyarov II
* Vernor Vinge
* Natasha Vita-More
* Mark Alan Walker
* Eliezer Yudkowsky

* Category
* Wikiproject

0.00

(0 votes)

Original source: https://en.wikipedia.org/wiki/Nick Bostrom. Read more

|

Retrieved from "https://handwiki.org/wiki/index.php?title=Biography:Nick_Bostrom&oldid=4223942"
*[v]: View this template
*[t]: Discuss this template
*[e]: Edit this template