A Credible BS Meter
Carl Sagan’s Baloney Detection Kit
Carl Sagan’s "Baloney Detection Kit" provides a set of cognitive tools designed to help you distinguish between what is true and what is false. Below is a distillation of the nine lessons.
Core Concepts
Independent Confirmation: Seek multiple, independent sources to verify "facts."
Substantive Debate: Welcome input from experts with diverse viewpoints to test the evidence.
No Authorities: Treat "authorities" only as experts; they can and do make mistakes.
Multiple Hypotheses: Don’t stop at the first explanation. Explore all possible alternatives.
Avoid Personal Bias: Don't get attached to an idea just because it's yours. Try to find reasons to reject it.
Quantification: Numerical data is harder to manipulate than vague, qualitative descriptions.
Logical Consistency: Every link in a chain of an argument must work; a single weak link breaks the whole.
Occam’s Razor: If two explanations account for the data equally well, the simpler one is usually right.
Falsifiability: Ask if the claim can be tested and proven wrong. If it can't, it's not worth much.
Common Mistakes
Ad Hominem: Attacking the person rather than the argument.
Appeal to Authority: Believing something simply because a famous person or official said it.
Observational Selection: "Counting the hits and forgetting the misses" (ignoring evidence that contradicts your belief).
Real-World Example
When reviewing a new health supplement, "baloney detection" involves checking for independent clinical trials (Independent Confirmation), questioning if the "doctor" in the ad is an actual expert in that field (No Authorities), and seeing if the claims can be measured or if they are just vague promises like "feel better" (Quantification).
Prompt to Find Credible Information
Copy and use this prompt whenever you need to research a new topic:
"I want to research [Insert Topic]. Using Carl Sagan’s Baloney Detection Kit as a framework, please find and present information that meets the following criteria:
Provide independent confirmation from at least three different reputable sources.
Present multiple hypotheses or viewpoints on the topic, including the most common counter-arguments.
Highlight quantifiable data and statistics rather than vague qualitative claims.
Identify any arguments from authority that lack supporting evidence.
Evaluate the logical consistency of the primary claims—point out if any 'links' in the reasoning are weak or unproven.
Ensure all sources are falsifiable and based on peer-reviewed or verifiable evidence."
References
The Marginalian: The Baloney Detection Kit
Big Think: Carl Sagan’s 9 timeless lessons