Rationality

Ruby (+1067/-436)
habryka (-12)
Ruby (+1)
Ruby (+1/-11)
Ruby (+242/-9)
Ruby
Ruby (+6)
Ruby (+3)
Ruby
Ruby
Rubyv1.76.0Aug 19th 2020 (+1067/-436)

FormalTheory / TheoreticalConcepts

Techniques & Skills

Failure Modes

Anticipated Experiences
Aumann's Agreement Theorem
Bayes Theorem
Bounded Rationality
Conservation of Expected Evidence
Contrarianism
Decision Theory
Epistemology
Game Theory
Gears-Level
Hansonian Pre-Rationality
Law-Thinking
Map and Territory
Newcomb's Problem
Occam's razor
Robust Agents
Solomonoff Induction
Truth, Semantics, & Meaning
Utility Functions
Value of Information
Robust Agents

 

 

Techniques
Focusing
Trigger Action Planning/Patterns
Goal Factoring

Applied Topics

Hamming QuestionsAlief
IdentityBetting
BettingCached Thoughts
Calibration
Dark Arts
Empiricism
Epistemic Modesty
Forecasting & Prediction
Concrete ForecastsGroup Rationality
Identity
Inside/Outside View
Introspection
Intuition
Practice & Philosophy of Science
Scholarship & Learning
ReplicabilityTaking Ideas Seriously
Dark ArtsValue of Information
 

Failure Modes

Affect Heuristic
Bucket Errors
Compartmentalization
Confirmation Bias
Fallacies
Goodhart’s Law
Groupthink
Heuristics and Biases
Mind Projection Fallacy
Rationalization
Motivated Reasoning
Confirmation Bias
Sunk-Cost Fallacy
Fallacies
Pica
Pitfalls of Rationality

CommunicationModels of the Mind

Other
Rationalization 
Self-Deception
Sunk-Cost Fallacy

Communication

Common Knowledge
Conversation
Decoupling vs Contextualizing
Disagreement
Distillation & Pedagogy
Double-Crux
Good Explanations (Advice)
Ideological Turing Tests
Inferential Distance
Information Cascades
Steelmanning
DisagreementMemetic Immune System
Philosophy of Language
Steelmanning

Techniques

Decoupling vs ContextualizingDouble-Crux
Focusing
Goal Factoring
Internal Double Crux
Hamming Questions
Noticing
Techniques
Trigger Action Planning/Patterns

Models of the Mind

Consciousness
Dual Process Theory (System 1 & 2)
General Intelligence
Subagents
Predictive Processing
Perceptual Control Theory


Practice & Philosophy of ScienceZombies
Rationality Quotes
Gears-Level
 

Other

Center for Applied Rationality
Curiosity
Rationality Quotes
Updated Beliefs (examples of)

Rubyv1.67.0Jul 11th 2020

Rationality is the art of thinking in ways that result in accurate beliefs and good decisions. It is the primary topic of LessWrong.

Rationality is not only about avoiding the vices of self-deception and obfuscation, but also about the virtue of curiosity, seeing the world more clearly than before, and achieving things previously unreachable to you. The study of rationality on LessWrong includes a theoretical understanding of ideal cognitive algorithms, as well as building a practice that uses these idealized algorithms to inform heuristics, habits, and techniques, to successfully reason and make decisions in the real world.

Topics covered in rationality include (but are not limited to): normative and theoretical explorations of ideal reasoning; the capabilities and limitations of our brain, mind and psychology; applied advice such as introspection techniques and how to achieve truth collaboratively; practical techniques and methodologies for figuring out what’s true ranging from rough quantitative modeling to full research guides.

Note that content about how the world is can be found under World Modeling, and practical advice about how to change the world is categorized under World Optimization or Practical.

Formal / Theoretical

Techniques & Skills

Failure Modes

Conservation of Expected Evidence
Decision Theory
Game Theory
Solomonoff Induction
Utility Functions
Value of Information
Robust Agents

 

 

Techniques
Focusing
Trigger Action Planning/Patterns
Goal Factoring
Hamming Questions
Identity
Betting
Forecasting & Prediction
Concrete Forecasts
Scholarship & Learning
Replicability
Dark Arts
Bucket Errors
Compartmentalization
Goodhart’s Law
Heuristics and Biases
Mind Projection Fallacy
Rationalization
Motivated Reasoning
Confirmation Bias
Sunk-Cost Fallacy
Logical Fallacies
Pica
Pitfalls of Rationality

Communication

Models of the Mind

Other

Inferential Distance
Information Cascades
Steelmanning
Disagreement
Philosophy of Language
Decoupling vs Contextualizing

Perceptual Control Theory

 

 

Rationality Quotes
Gears-Level

 

 

What we're calling "rationality"

A good heuristic is that rationality is about cognitive algorithms. Rather than being a synonym for true or optimal, the term rational should be reserved for describing whether or not a cognitive algorithm results in true beliefs and optimal actions.

This is distinct from practical advice, such as how to improve relationships or implement productivity systems, which should not be considered "rationality" per se. Some have pushed against labeling self-help as "rational dating", etc. for reasons along these lines [1, 2], and they are probably correct.

In accordance with this, LessWrong classifies most self-help type advice under the World Optimization tag and not the Rationality tag.

Similarly, most object-level material about how the world is, e.g. math, biology, history, etc. is tagged under World Modeling tag, with exceptions for neuroscience and probability theory, etc., which have concrete consequences for how one ought to think.

Heuristics and Biases

Early material on LessWrong frequently describes rationality with reference to heuristics and biases [1,2]. Indeed, LessWrong grew out of the blog Overcoming Bias and even Rationality: A-Z opens with a discussion of biases [1] with the opening chapter titled Predictably Wrong. The idea is that human mind has been shown to systematically make certain errors of reasoning, like confirmation bias. Rationality then consists of overcoming these biases.

Apart from the issue of the replication crises which discredited many examples of bias that were commonly referenced on LessWrong, e.g. priming, the "overcoming biases" frame of rationality is too limited. Rationality requires the development of many positive skills, not just removing negative biases to reveal underlying perfect reasoning. These are skills such as how to update the correct amount in response to evidence, how to resolve disagreements with others, how to introspect, and many more.

The Art and Science of Rationality

In a field like biology, we can draw a distinction between the science of biology, which involves various theories and empirical data about biological life, and the art of being a biologist, which is the specific way that a biologist thinks and plays with ideas and interacts to the world around them. Similarly, rationality is both a science and an art. There’s study of the iron-clad laws of reasoning and mechanics of the human mind, but there’s also the general training to be the kind of person who reasons well.

Rationalist

The term rationalist as a description of people is used in a couple of ways. It can refer to someone who endeavors to think better and implement as much rationality as they can. Many prefer the term aspiring rationalist to convey that the identifier is a claim to the goal of being more rational rather than a claim of having attained it already.

Perhaps more commonly, rationalist is used to refer culturally to someone associated with various rationalist communities separate from their efforts to improve their rationality.

Load More (10/161)