Skip to main content
ChanceWire may earn a commission when you visit partners via our links. DisclosureNot financial adviceLegal age in your jurisdiction (some partners 21+)
ChanceWireChanceWire

Poly Chance: Scan volume first, then open a category. Prices are implied probabilities — not guarantees. Start with the reading guide if this is new.

← Guides

Simpson's paradox in event market data

How SoftCta readers spot Simpson's paradox when reading polls, stats and track records — why combined data can show the opposite of every subgroup, and how weighting and group mix cause it. · 3 min read

Updated 27 Oct 2026

Poly ChanceChanceWire guide · fictional AI persona

Disclosure: ChanceWire may earn a commission if you sign up or trade through certain partner links. SoftCta only until partner tokens allow hard CTAs. Read How we make money and our Affiliate disclosure. Not financial advice. Informational only — not legal, tax, or investment advice. Digital assets and event contracts involve substantial risk of loss.

Simpson's paradox in event market data

Simpson's paradox is one of the most surprising patterns in statistics: a trend can hold in every subgroup and reverse when the groups are combined. It shows up in polls, sports, medicine and track records, all of which feed event market reasoning. This SoftCta guide explains the paradox and how to avoid being misled by aggregate numbers.

A simple example

Suppose forecaster A has a higher hit rate than forecaster B on both easy and hard questions. But A answered mostly hard questions while B answered mostly easy ones. Combined, B can show the higher overall hit rate, even though A was better in each category. The mix of question difficulty drives the reversal. This matters when comparing track records or calibration scores.

Polls and crosstabs

A candidate can gain among several demographic groups while losing overall if the sample's composition shifts. Pollsters weight samples to address this, and house effects partly reflect weighting choices. Our poll margins guide explains how weighting influences headline numbers.

Sports statistics

A player can have a higher batting average than another in two seasons separately but a lower combined average if their at-bats were distributed differently. Team stats across home and away games, or across opponents of different strength, can reverse similarly. Season-long stat leader markets are affected by these mix effects.

Economic data

Average wages can fall even as every group's wages rise if the workforce shifts toward lower-wage groups. Composition effects appeared in wage data during periods of large job losses concentrated in low-wage sectors. Reading subgroup data alongside headlines helps avoid misinterpreting releases.

How to guard against it

Ask what factors differ between the things being compared. Look at subgroup data and group sizes. Consider which comparison answers the actual question. Be cautious with aggregates built from groups with very different mixes, and pair this with base rate thinking. Avoid mining many slices for a striking reversal, which risks spurious findings.

Common pitfalls

  • Trusting combined totals when group mixes differ.
  • Comparing hit rates across different question difficulty.
  • Ignoring composition shifts in economic data.
  • Cherry-picking subgroups to support a view.
  • Assuming the paradox means data is wrong rather than misread.

Primary sources SoftCta readers open

  • Original datasets with subgroup breakdowns.
  • Pollster methodology notes on weighting.
  • Official statistics with composition details.
  • Track records with question difficulty or category labels.

Reading the quote step by step

  • Read the full title and rules, including the named settlement source and the time zone.
  • Convert the Yes and No prices to implied probabilities and note the gap between them.
  • Subtract fees and spread to see the effective price you would actually face.
  • Write your own probability range and the evidence behind it, then compare.
  • Check related and near-duplicate markets on other venues for consistency.

Closing SoftCta checklist

  • Re-read the venue definition in your own words before reacting to a price.
  • Convert prices with fee and spread awareness; verify live cents on the operator.
  • Prefer primary settlement sources over secondary headlines and social summaries.
  • Treat ChanceWire hubs, movers, and tools as orientation — not order entry.
  • Confirm age, location, and product eligibility; SoftCta pages will not suggest location spoofing.
  • If clarity is incomplete, watching is a complete SoftCta outcome — no pick-selling urgency required.

SoftCta habits

  • Write your own probability range before checking the crowd price.
  • Prefer dated primary sources over social summaries.
  • Compare related markets when a single book looks extreme.
  • Size curiosity with fees and depth in mind; substantial risk of loss.

FAQ

What is Simpson's paradox?
It occurs when a trend appears in several groups of data but reverses or disappears when the groups are combined, usually because the groups have different sizes or mixes.
Why does it matter for event markets?
Poll crosstabs, player stats, forecaster track records and economic data are often aggregated. A misleading aggregate can push a reader toward the wrong probability.
How can I detect it?
Look at subgroup results and the mix of cases in each group. If the composition differs a lot between the things being compared, combined totals may mislead.
Is the combined number or the subgroup number correct?
It depends on the question. The right comparison accounts for the factor that differs between groups, which requires thinking about what causes what.

Related