Overlap and Common-Support Trimming in Observational Causal Estimates

confidence: high · 6 sources

⚠
Working research — not a recommendation.

This page records what the evidence says a policy does, not what anyone should do about it. It has been synthesized from the cited sources but has not been independently reviewed.

What the evidence says

Propensity score methods can only compare units that have a realistic chance of receiving either treatment. Without adequate overlap, "causal comparisons cannot be made reliably because certain subgroups are observed under only one treatment condition" (Ahn 2026). Ahn also states that validity and generalizability of propensity-score estimates depend critically on sufficient overlap, and that without it the causal interpretation is unreliable "regardless of the apparent success of the statistical adjustment." The sources give no required amount of overlap.

The usual remedy is to drop units, and dropping units changes the question. In matching, unmatched individuals are excluded. The estimate then applies only to a restricted region of the covariate space, not the whole study population (Ahn 2026). Yang (2017) makes the same point for propensity-score trimming: dropping subjects with scores near zero or one "generally alters the estimand by changing the reference population." Researchers who trim first and then describe the target population from the surviving sample define the effect after the fact, and "using different samples may change the target estimand." Keele (2022), in an abstract-only claim, says steps to achieve overlap can yield very narrowly defined effects with little policy relevance.

Trimming is also a response to a variance problem. Extreme propensity scores produce large weights, which "can result in a large variance and poor finite sample properties" (Yang 2017). Khan (2024) says limited overlap is common in observational data, especially in high dimensions, and leads to extreme scores and high-variance estimates. D'Amour (2017) shows theoretically why high dimensions make this worse. Strict overlap bounds on covariate-mean imbalance grow more restrictive as dimension grows. The average unique discriminating information per covariate converges to zero. In the large-p limit, if the Bayes optimal classifier is consistent, the expected share of the sample that must be discarded to reach any fixed overlap bound approaches one. D'Amour concludes that trimming may need to be used more often when covariate dimension is large.

The evidence on how to trim is narrower. Yang proposes smooth weighting as an approximation to hard trimming. It is asymptotically linear, supports bootstrap confidence intervals, and shows slightly smaller variance than indicator weighting in simulations. Khan finds that trimming on propensity scores alone reduced variance little in an NHANES example, whereas trimming on both propensities and conditional variances reduced variance by 17%. Yang reports that for effects on the treated, the optimal support restriction trims scores close to one. Yang's simulations also show all estimators biased when the propensity model is misspecified.

Evidence is thin on real-world applications. Most variance results come from simulations or a single NHANES example. The sources do not measure how much of a sample is typically lost to trimming in applied studies.

Where the evidence splits

Yang (2017) describes extreme propensity scores as inflating variance and treats trimming or smooth weighting as the response. Khan (2024) reports that, in one NHANES problem, propensity-only trimming gave little variance reduction. The variance-minimizing homoscedastic trimming and the 0.1/0.9 rule "both actually slightly increase the variance." Khan attributes this to heteroscedasticity: propensity-only rules fail to capture the variance structure when conditional variances differ. Khan reports that trimming on both propensities and conditional variances reduced variance by 17%. Whether this pattern holds beyond NHANES is not shown in the sources on this page. Yang's claims do not test heteroscedastic settings, so the two sets of findings are not directly comparable.

Thresholds and dose-response

No threshold established in the current sources.

Open empirical questions

Findings

Insufficient overlap decreases the validity of propensity-based causal comparisons

confidence — direction: highconfidence — magnitude: highconsensus: settled, as a definitional requirement
mechanism
certain subgroups are observed under only one treatment condition, so no comparison exists for them
effect
direction is a loss of reliable causal interpretation; no magnitude given
conditions / moderators
applies regardless of apparent statistical adjustment; the required degree of overlap is not specified

Excluding unmatched or trimmed units changes the population and estimand

confidence — direction: highconfidence — magnitude: high for Ahn and Yang; low for Keeleconsensus: settled on direction
mechanism
dropping units redefines the reference population, so the estimate applies only to the retained region of covariate space
effect
the estimand changes (for matching, the ATT within a limited region); no numeric magnitude given
conditions / moderators
trimming first and then defining the target population from the surviving sample makes the estimand sample-dependent; Keele (2022) states, in an abstract-only claim, that achieving overlap can narrow effects until they have little policy relevance

Weak overlap and extreme propensity scores increase the variance of weighting estimators

confidence — direction: highconfidence — magnitude: mediumconsensus: settled on direction
mechanism
extreme scores produce large weights
effect
increases variance and worsens finite-sample properties; no numeric magnitude given
conditions / moderators
most pronounced when the overlap assumption is violated or nearly violated; limited overlap is common in high-dimensional observational data

Higher covariate dimension decreases the sample that can be retained under strict overlap

confidence — direction: highconfidence — magnitude: mediumconsensus: thin, a single theoretical source
mechanism
small imbalances across many covariates accumulate, and a classifier can separate treatment from control ever more accurately as dimension grows
effect
overlap bounds on covariate-mean imbalance become more restrictive; the expected proportion that must be discarded approaches one in the large-p limit if the Bayes optimal classifier is consistent
conditions / moderators
the retention result requires classifier consistency; the average unique discriminating information per covariate converges to zero under strict overlap

Smooth weighting decreases variance relative to indicator trimming

confidence — direction: highconfidence — magnitude: lowconsensus: thin, a single author's simulations
mechanism
smoothing the indicator inclusion function approximates trimming while allowing conventional asymptotic linearization
effect
decreases variance slightly in simulations; no numeric magnitude given
conditions / moderators
bootstrap variance estimates were close to true variances for all estimators in simulations; all estimators are biased when the propensity model is misspecified; augmented estimators improve precision when the propensity model is correct

Variance-aware trimming decreases variance where propensity-only trimming shows no measured reduction

confidence — direction: mediumconfidence — magnitude: mediumconsensus: thin
mechanism
a unit's contribution to asymptotic variance depends on k(x) = σ₁²(x)/e(x) + σ₀²(x)/(1−e(x)), which involves conditional variances as well as propensities
effect
heteroscedastic trimming decreases variance by 17% in the NHANES example; propensity-only trimming (the 0.1/0.9 rule and variance-minimizing homoscedastic trimming) slightly increases it
conditions / moderators
substantial heteroscedasticity; one dataset; homoscedastic trimming shows erratic standard errors