Skip to main content
DebateForge Lab
Research methodology & transparency

Methodology

How the content on this site is chosen, checked and labelled — and what its methods cannot do.

How debate motions are chosen

The 18 motions were selected from 57 published BP tournament motions (2024–2026), keeping those that point to a verifiable real-world event, trend or policy. Sixteen are PF-style renderings of the original BP motions; the “Resolved:” wording is this site's own and was not used at the tournaments. Two were substantially adapted (Voluntary Solitude and Residential Zoning Reform) to avoid conflating distinct issues or overstating policy positions, and are labelled “DebateForge Lab Adapted Motion”. Each motion page shows the tournament, round and original wording, checked against the tournament's published motion list.

Source standards and evidence evaluation

Preferred sources, in order: legislation and official documents; original academic research; official statistics; international organisations; university and independent research institutes; credible journalism for event chronology; tournament records for motion provenance. Every evidence item is labelled as a verified fact, competing interpretation, normative argument, hypothetical or illustrative data, and states its limitations: sample, population, design, confounding, selection and generalisability. Correlations are never presented as established causation.

Research verification

Every source record says what was actually read when it was checked: “Full text checked” (the original publication or page was read and the cited finding checked against it), “Official summary checked” (a summary published by the authors or their institution), “Abstract checked” or “Secondary report checked”. Sources not yet checked would be marked “Verification pending”; none currently are. Wherever a source checked only against an abstract, summary or secondary report is cited, the citation says so. Each record shows the date it was last checked. Every evidence item on a motion page cites a checked source; automated tests enforce this rule. Known research gaps are listed on every motion page. Automated tests check that references are consistent; they cannot prove that a summary is faithful to its source. Corrections are welcome.

How argument maps are constructed

Each motion map is generated from the motion's written case, so the map and the text cannot disagree. Every argument becomes a claim, the mechanism it relies on, the evidence and assumptions under that mechanism, the impact it leads to and the values that justify the impact; counterevidence and rebuttals attach to the claims they challenge, and weighing nodes qualify the impacts they compare. Relationships are typed: supports, challenges, depends on, qualifies, leads to, justifies and conflicts with. Three cross-case maps compare reasoning across motions and are written by hand. Every map also has a text outline for screen readers and small screens.

How assumptions are identified

For each argument we ask what must be true for the mechanism to work and the impact to follow. Each assumption is classified as empirical (evidence could test it, and the page suggests how) or normative (it expresses a value judgment and must be argued for).

How values and weighing are analysed

Every motion has a five-level analysis: position, mechanism, impact (who benefits, who bears costs, how likely, severe, reversible and widespread), underlying value, and value weighing. Each value clash then answers nine questions: why each side prioritises its value, whether the conflict is genuine, what creates it, whether both values can be partly protected, which policies reduce the trade-off, which assumptions decide the priority, what evidence could change the judgment, and what disagreement would remain if both sides agreed on the facts. Several ethical frameworks are shown without declaring any one correct. Any numerical weighting is labelled an illustrative model: values such as justice or dignity are not objectively calculable.

Quantitative reasoning methodology

Each of the 15 modules has a mathematical foundation with defined symbols and assumptions, an intuitive explanation, a debate connection, a real-world application linked to the motions, a working interactive, practice questions with explained feedback, and its limitations. Calculations are separate from the interface and covered by unit tests with independently known answers. Interactive data are hypothetical and labelled as such unless a source is cited.

Limitations

The analyses are teaching material, not policy advice or legal advice. Some sources could be checked only against an abstract, an official summary or a secondary report (each citation says which), and evidence on several motions is thin; research gaps are listed openly. Legal rules differ by jurisdiction and change over time. Selection of motions, arguments and sources involves editorial judgment, and the site cannot cover every relevant study.

Verified information vs. illustrative material

Every piece of content carries one of these labels so readers know how much weight it can bear.

  • Verified fact

    Checked against a cited primary or reputable source.

  • Competing interpretation

    A reading of the evidence that others dispute.

  • Normative argument

    A claim about what ought to be valued or done.

  • Hypothetical

    An invented scenario used for teaching.

  • Illustrative data

    Made-up numbers chosen to teach a concept; not real measurements.

Limits of quantitative methods in evaluating values

  • Numbers can describe how large, likely or widespread an outcome is. They cannot by themselves say how much that outcome should matter.
  • Any weighting model on this site is labelled illustrative. Its result follows from the weights someone chose, so the argument is about those weights, not the arithmetic.
  • Some considerations, such as rights treated as constraints, may not be tradeable against outcomes at all. A weighted score cannot represent that view faithfully.
  • A calculation is only as good as its inputs. Sensitivity analysis shows which inputs a conclusion depends on; it does not make uncertain inputs certain.

Who made this site

DebateForge Lab was founded and developed by Theodore Ziqi Zhang as an independent educational project.

About DebateForge Lab explains why the project was created, its educational philosophy and its credits.