Basic Rationality Manual Navigation

 

Quick Navigation for This Page

 

Why Evidence Comes After Logic

Logic tells you whether a conclusion follows from supporting claims. Evidence asks whether the supporting claims are actually connected to reality. You need both. A valid argument built on rotten evidence is still a machine for producing polished nonsense. Humanity has demonstrated this with enthusiasm.

Evidence is information that supports, weakens, or tests a claim. Good evidence does not merely feel convincing. It is relevant, accurate, traceable, proportionate to the claim, open to critique, and strong enough for the stakes involved.

The scientific method is not a single rigid recipe. It is a family of practices for testing explanations against observations, experiments, measurements, comparisons, replications, and critiques. Its basic discipline is simple: ideas must risk contact with reality.

 

How the Scientific Method Developed

The scientific method did not appear all at once, nor was it created by one person in one room after a heroic amount of coffee. It grew over centuries as people looked for better ways to test ideas against the world.

Aristotle asked systematic questions about nature long ago, but the modern scientific turn accelerated during the Scientific Revolution. Francis Bacon argued for careful observation and induction rather than authority alone. Galileo’s telescopic observations challenged inherited beliefs about the heavens. Later thinkers refined experimentation, measurement, statistics, and theory testing. In the twentieth century, Karl Popper emphasized falsifiability, the idea that scientific claims should be testable and open to being shown wrong.

The social need was practical. Traditional authority was often wrong. Custom was often wrong. Elegant theories were often wrong. People needed a way to test claims about medicine, motion, disease, chemistry, agriculture, engineering, and public life through repeatable contact with the world, rather than relying on status, tradition, or verbal brilliance alone.

 

Scientific Method Flow Chart

Step Question Best used for
Observation What is happening? Starting with contact with reality
Question What exactly do we want to know? Preventing vague inquiry
Hypothesis What explanation might fit? Creating a testable idea
Prediction What should we see if the idea is right? Making the claim risk failure
Test What structured check can we run? Comparing expectation with outcome
Comparison Compared with what? Reducing accidental causal claims
Replication Does it hold up again? Separating real patterns from one-time surprises
Critique What did we miss? Improving the method and conclusion

 

 

Core Parts of the Scientific Method

1. Observation

What it means: Observation is careful attention to what is actually happening. It can be direct, instrument-based, recorded in data, or gathered through structured reports.

How it goes right: A teacher notices that students do worse after schedule changes and checks attendance, sleep reports, and assignment timing.

How it goes wrong: Someone notices only the cases that support a favorite idea and quietly misplaces the rest in the junk drawer of memory.

Best used for: Starting inquiry with what is actually present, not what would be emotionally convenient.

 

2. Good Question Formation

What it means: Scientific thinking begins with a clear question. Bad questions produce muddy answers.

How it goes right: “Does changing class start time improve attendance and attention?”

How it goes wrong: “Why are students lazy these days?” That is not a neutral question. It smuggles in blame before evidence.

Best used for: Turning a complaint into an inquiry.

 

 

3. Testable Hypothesis

What it means: A hypothesis is a proposed explanation that can be tested.

How it goes right: “If classes start later, average attendance will improve by reducing sleep deprivation.”

How it goes wrong: A claim is stated so vaguely that no one can tell what would count as support or failure.

Best used for: Moving from guesswork to disciplined testing.

 

4. Prediction

What it means: A prediction states what you expect to see if the hypothesis is true.

How it goes right: “If our hypothesis is right, tardiness should decrease, especially in the first period.”

How it goes wrong: A person keeps the theory fuzzy so every outcome can be spun as success. At that point, the theory has become a motivational poster with a lab coat.

Best used for: Forcing a claim to say what reality should look like if it is correct.

 

5. Experiment or Structured Test

What it means: A test compares expectation with outcome. Sometimes that means a formal experiment. Sometimes it means structured observation, a pilot project, an A/B test, or a natural experiment when real life creates a useful comparison.

How it goes right: A clinic compares two appointment reminder systems and tracks no-show rates.

How it goes wrong: Ten changes happen at once, and then someone announces which one caused the result with ceremonial confidence.

Best used for: Learning from reality instead of merely arguing about it.

 

6. Controls and Comparison Groups

What it means: A control or comparison helps isolate what actually made the difference.

How it goes right: Two similar groups are compared, with one receiving the new intervention and one not.

How it goes wrong: A company rolls out a new process during the holiday season and declares victory without comparing the result to normal seasonal changes.

Best used for: Avoiding fake cause-and-effect conclusions.

 

7. Replication

What it means: Replication means seeing whether a result holds up when repeated by the same people, different people, or in different settings.

How it goes right: A promising study is repeated by other researchers or tested in other contexts.

How it goes wrong: One flashy result is treated like a settled truth before anyone checks whether it can be reproduced.

Best used for: Separating durable findings from accidents, noise, and publicity bait.

 

 

8. Peer Review and Critique

What it means: Peer review and critique subject methods, data, assumptions, and reasoning to rigorous scrutiny.

How it goes right: A study is challenged, improved, corrected, replicated, or sometimes rejected because others find flaws.

How it goes wrong: “Reviewed by experts” gets treated as magic certainty. Peer review is useful, not divine.

Best used for: Finding weaknesses that the original thinker, team, or organization may have missed.

 

 

Falsification and Disconfirming Evidence

Falsification means exposing a claim to evidence or tests that could show it is wrong. This is one of the most important habits in rational thinking because people naturally look for support. We like confirmation. It feels cozy. Unfortunately, cozy beliefs can still be false.

A testable claim should be able to say what would count against it. If a claim can explain every possible outcome, it may be too slippery to trust. A belief that cannot lose is often not strong. It is just protected from learning.

Example: A product team says, “If usage drops below this level after launch, our theory about customer demand is probably wrong.” That is a falsification condition. The team has named what would make them update.

Failure example: A wellness influencer says a supplement improves focus, mood, immunity, and sleep, but can never say what outcome would count against it. Every result becomes proof once the story starts bending hard enough. This is exactly why falsification matters.

 

 

Go to our practice worksheet here for the above tool if you haven't printed it out yet, and do the exercises associated with the above tool that you have read and understood. The problem or problems you are working on may not directly relate to every tool. Our practice worksheet will make the importance of these tools clear. After you complete the worksheet exercises for this tool, you may want to do the additional practice exercises below. 

Evidence Quality Checklist

Evidence question Why it matters
Is the claim clear? Vague claims are hard to test
What would count as disconfirming evidence? Unfalsifiable claims resist learning
How was the evidence gathered? Method shapes reliability
Compared with what? Without comparison, causal claims get sloppy
Is the sample relevant? Bad samples distort conclusions
Was the result replicated? One result may be noise
Who has inspected the work? Critique catches blind spots
Are there competing explanations? Evidence may fit more than one story

 

Evidence Quality in Everyday Life

You do not need a laboratory to use basic scientific thinking. You can use it in ordinary decisions. The pattern is the same: name the claim, define the question, identify what evidence would matter, look for comparisons, test small when possible, and update when results arrive.

For example, if you think a new work routine will improve your productivity, write a prediction before starting. Track a simple measure for two weeks. Compare it to a baseline. Note confounding changes like sleep, workload, interruptions, or deadlines. Then revise. This is not glamorous, but neither is repeating a failed routine for three years because it felt productive once.

 

Practice Exercises

Exercise 1: Turn a Complaint into a Testable Question

      1. Write one complaint related to your real problem.
      2. Rewrite it as a neutral question.
      3. Write one testable hypothesis.
      4. Write one prediction that would follow if the hypothesis is true.
      5. Write one result that would lower your confidence.

Exercise 2: Find the Missing Comparison

Choose one claim from a headline, advertisement, or workplace report. Ask, “Compared with what?” Then list what comparison group, baseline, or past trend would make the claim meaningful.

Exercise 3: Disconfirmation Drill

Write a belief you hold strongly. Then write three pieces of evidence that would weaken it. If you cannot do this, slow down. Your belief may have hired security.

 

AI Support Prompts for This Page

    • “Turn this vague claim into a clear, testable hypothesis: [claim]. Then write a prediction and one possible disconfirming result.”
    • “Evaluate this evidence for relevance, sample quality, comparison, replication, and possible alternative explanations: [paste evidence].”
    • “Help me design a small structured test for this everyday decision: [decision]. Include a baseline, comparison, measure, and review date.”
    • “What evidence would weaken or falsify this claim: [claim]?”
    • “List competing explanations that could also fit this observed pattern: [pattern].”

 

Frequently Asked Questions

Is the scientific method only for scientists?

No. Formal science uses specialized methods, but the basic habits of clear questions, testable claims, comparison, evidence, critique, and updating are useful in ordinary life.

Does one study prove something?

Usually no. One study can be important, but stronger confidence usually requires replication, converging evidence, better methods, and careful critique.

Can evidence be misleading?

Yes. Evidence can be weak, cherry-picked, mismeasured, outdated, biased, or interpreted through a bad causal story. That is why method matters.

 

Mini-Glossary

    • Control group: A comparison group that does not receive the treatment or condition being tested.
    • Disconfirming evidence: Evidence that weakens or challenges a claim.
    • Experiment: A structured test designed to compare expectation with outcome.
    • Falsification: Trying to show that a claim is wrong through evidence or tests that could defeat it.
    • Hypothesis: A proposed explanation that can be tested.
    • Observation: What is directly seen, recorded, measured, or reported through a defined method.
    • Peer review: Evaluation by qualified people who inspect reasoning, methods, or evidence.
    • Prediction: A statement about what should happen if a hypothesis is true.
    • Replication: Repeating a test or study to see whether the result holds up.

 

Selected References and Source Links

 

What's Next

Page 3 of our guide showed you how to test claims against reality using evidence, the scientific method, falsification, comparison, and critique. That is a major step forward. You are no longer just asking, “Does this argument sound good?” You are asking, “Can this claim survive contact with evidence?” Already, this puts you ahead of a VERY large portion of public conversation, where many claims are apparently released into the wild after being raised in a basement on vibes and fueled with sugary snack food.

But evidence does not interpret itself. Data can be badly measured, poorly sampled, misunderstood, exaggerated, cherry-picked, or wrapped in a graph so shiny that everyone forgets to ask whether it means anything. Page 4 helps you handle that next layer. You will learn how to spot weak measurements, separate signal from noise, use base rates, update your confidence, think in probabilities, avoid confusing correlation with causation, look for hidden confounders, and recognize the next level of biases that quietly shove your thinking toward convenient nonsense.

This next page is where clear thinking becomes much harder to fool. It helps you make better decisions when the evidence is incomplete, the numbers are messy, the causes are tangled, and your own brain is trying to “help” by jumping to the easiest conclusion, like a Labrador chasing a tennis ball into traffic. Keep going slowly. The goal is not to memorize terms. The goal is to become better at seeing what the numbers, causes, and biases are actually doing, so your decisions become more realistic, more flexible, and much less vulnerable to persuasive garbage wearing a lab coat.

Next: Continue to Page 4: Data Literacy, Probability, Causality, and Bias.

 

Basic Rationality Manual Navigation

 

© 2026 Universe Institute and Lawrence Wollersheim. All rights reserved.

No part of this page, guide, or related educational material may be copied, reproduced, republished, uploaded, posted, transmitted, distributed, sold, modified, adapted, or used to create derivative works in any form or by any means without prior written permission from Universe Institute, except for brief quotations used for review, commentary, education, or other uses permitted by law. For permission requests, please contact Universe Institute and Lawrence Wollersheim directly at [email protected]