School Competition (Choice, Charter, Open Enrollment) and Test-Score Inequality

confidence: high · 8 sources

⚠
Working research — not a recommendation.

This page records what the evidence says a policy does, not what anyone should do about it. It has been synthesized from the cited sources but has not been independently reviewed.

What the evidence says

Charter-school achievement estimates vary sharply by identification strategy and location, and the studies do not agree on a single direction. Lottery-based causal designs report the largest gains: eighth-graders in New York City charter schools score 20 to 30 points higher on state math and reading assessments than public-school peers, closing about two-thirds of the urban-suburban achievement gap in that metro area. In Boston, charter middle-school attendance increases math scores by 0.4 SD per year and English Language Arts by 0.2 SD per year, and charter high-school attendance increases ELA/math by about 0.2 SD per year and writing by 0.17–0.28 SD per year. In Florida, charter achievement starts below traditional public schools in year one (2.0–2.1 points lower in math, 13% of an average year's gain; 1.5 points lower in reading, 12%) and reaches parity in math while exceeding traditional public schools in reading by 1.3 points (10% of a year's gain) by year five. Associational comparisons elsewhere find no such pattern: charter achievement in California and Philadelphia is statistically indistinguishable from traditional public schools, and Minnesota charter schools score lower on average than comparable traditional public schools after nearly two decades of operation.

Where private schooling widens test-score inequality, the evidence points to a within-school channel rather than a between-school one. Private school entry increases the variance of private-sector test scores by about 0.08 SD, and this growth traces mainly to inequality growing within schools, not across them. The private schools studied set an instructional level that favors richer students at the expense of poorer ones, even within the population that attends private school, and the entry of an additional private school increases schools' incentive to move further toward that wealthier-favoring level — making wealthier students relatively more marginal to retain. The resulting rise in within-school inequality comes mainly from reduced learning gains among poor students, while private entry shows no measured effect on mean test scores in either the public or private sector. The same study estimates that a school could increase poor students' annual test-score gains by up to 0.36 SD — nearly a year of schooling — by shifting from the instructional level optimal for wealthy students to the one optimal for poor students.

A randomized voucher lottery in Andhra Pradesh, India isolates the causal effect of private-school access from who selects into it. Lottery winners and losers show no difference in Telugu and math scores after two and four years, even though a raw cross-sectional gap of 0.65 SD separates public and private students — indicating that gap mostly reflects selection rather than instruction. Winners do score higher when all subjects are averaged (+0.13 SD), and the instrumented effect of attending a private school on test scores overall is +0.23 SD, with a large gain in Hindi (+0.55 SD, p<.001) and a smaller one in English (+0.12 SD, p=.098). Private schools achieve Telugu and math outcomes equal to public schools while spending 40% less instructional time on Telugu and 32% less on math, redirecting that time to English, science, and Hindi — the mechanism the study ties the non-core-subject gains to. The program shows no measured spillover on public-school non-applicants or on students already in private schools, and program participation does not correlate with household socioeconomic characteristics. Mean per-student cost is over three times higher in the public system than in the private schools sampled.

Effects of school competition on traditional-public-school achievement are small and inconsistent. A meta-analysis of the broader literature finds a partial correlation between competition and achievement of 0.06 at the school level (borderline, p<.10, confidence interval crosses zero), 0.001 at the student level (statistically significant but very small), and −0.002 at the district level (not significant). Site-specific studies split on direction: no measured effect on neighboring traditional public schools in a multi-state RAND study, a decrease in student performance in Ohio and Michigan, and a modest increase in math with unchanged reading in Florida. The same meta-analysis states these competitive effects are too small to produce a major change in achievement or inequality on their own, and finds no overall negative effect on traditional-public-school students associated with competition.

Racial segregation is the one lever where the direction of harm is consistent, though the underlying mechanism is largely unstated. Segregated learning environments are associated with lower test scores generally, and schools with 90% or greater minority enrollment combined with concentrated poverty have lower average test scores, less qualified and experienced teachers, and fewer advanced courses. In North Carolina, Black students who made a racially segregating transfer into a charter school show larger negative achievement effects than Black students who stayed in traditional public schools or made a non-segregating transfer, and North Carolina charter schools overall produced larger negative effects on Black students' scores than on White students' scores. Separately, a meta-analysis finds the competition-achievement association grows larger as a school's minority student share rises (β=0.04 per unit at the student level), though whether that differential narrows or widens the achievement gap for those students is not established in the sources. No claim here quantifies how large the racial effects are in point terms — only their direction and relative size against comparison groups.

Where the evidence splits

Selection bias ("cream-skimming") is argued two different ways with no reconciliation offered in the sources. One paper argues, on theoretical grounds, that several kinds of selection bias make achievement comparisons between charter/private and traditional public schools "virtually impossible," and that excluding lower-achieving student groups from enrollment mechanically raises a school's measured average. A separate multi-site empirical study, using student-level longitudinal comparisons of prior test scores, finds no systematic evidence that charter schools skim high-achieving students — transferring students' prior scores were at or below local averages in every site studied. The sources do not resolve this: one is a theoretical account of a general mechanism, the other a direct empirical test of one specific channel (prior achievement) across seven locations, and neither states whether other selection channels the theoretical argument raises (for example, parental effort or informational barriers) were tested.

Charter/competition effects on neighboring traditional public schools split by state and by unit of analysis, and the sources only partly explain why. A multi-state RAND study and a Zimmer et al. analysis find no effect on neighboring public schools' scores; Ohio and Michigan studies find a slight decrease; a Florida panel study finds a modest increase in math and no change in reading; and a meta-analysis finds the association near zero at the district level but small and positive at the school level. The sources tie part of this to geography (different states) and to unit of analysis (school vs. student vs. district level in the meta-analysis), but do not explain why Ohio and Michigan diverge from Florida beyond location.

The overall direction of charter achievement effects splits by study design as much as by geography. Positive results in New York City and Boston come from lottery-based quasi-experiments; null or negative results in Minnesota, California, and Philadelphia come from associational comparisons. Florida's panel study, also not lottery-based, finds convergence to parity in math and a positive reading effect by charter schools' fifth year — a result the sources do not reconcile with the null Philadelphia and California findings, which use similarly non-experimental designs.

Thresholds and dose-response

Schools with 90 percent or greater minority enrollment combined with concentrated poverty have lower average test scores, less qualified and experienced teachers, and fewer advanced courses than other schools.

Charter school achievement follows a dose-response pattern over time in the Florida panel study: it starts below traditional public schools in year one (2.0–2.1 points lower in math, 13% of an average year's gain; 1.5 points lower in reading, 12%), then rises to match traditional public schools in math and exceed them in reading (+1.3 points, 10% of an average year's gain) by the fifth year of operation.

Shifting a school's instructional level from the level optimal for wealthy students to the level optimal for poor students is estimated to raise poor students' annual test-score gains by as much as 0.36 SD.

Open empirical questions

Findings

New York City charter attendance increases eighth-grade math and reading scores

confidence — direction: highconfidence — magnitude: highconsensus: contested — other geographies (Minnesota, California, Philadelphia) find null or lower charter achievement
mechanism
not established in the source beyond charter enrollment
effect
increases scores by 20–30 points versus traditional public school students; reduces the urban-suburban achievement gap by roughly two-thirds
conditions / moderators
grade 8 only in the cited analysis; not established whether this holds at other grades or in other metro areas

Boston charter attendance increases annual math, ELA, and writing gains; comparable "pilot" schools show weaker or no effect

confidence — direction: highconfidence — magnitude: high for charter and pilot elementary estimates; low for pilot middle/high school estimatesconsensus: contested with associational studies elsewhere showing null/negative charter effects
mechanism
not established
effect
middle school: +0.4σ/year math, +0.2σ/year ELA; high school: ~0.2σ/year ELA and math, +0.17σ–0.28σ/year writing; pilot elementary: +0.06σ–0.07σ/year; pilot middle/high school ELA and math: not significantly different from zero
conditions / moderators
pilot middle schools serving grades 6–8 show a negative math effect (significant once baseline scores are controlled), while pilot K–8 schools show the opposite pattern

Florida charter achievement starts below traditional public schools and converges to parity or exceeds it by year five

confidence — direction: highconfidence — magnitude: highconsensus: contested with other-state associational findings of persistently lower or null charter achievement
mechanism
not established
effect
year one: −2.0 to −2.1 points math (13% of average annual gain), −1.5 points reading (12%); year five+: no significant math difference, +1.3 points reading (10% of average annual gain)
conditions / moderators
applies to charter schools with five or more years of operation; not established for schools closing or converting before then

Charter achievement is null or lower than traditional public schools in other associational comparisons

confidence — direction: highconfidence — magnitude: mediumconsensus: contested; thin per individual site
mechanism
not established
effect
Minnesota: lower average achievement (magnitude not specified); California: no measured effect; Philadelphia: no measured effect (gains statistically indistinguishable from traditional public schools)
conditions / moderators
all three are associational, non-lottery comparisons; contrasts with lottery-based positive findings in New York City and Boston

Charter effects vary by targeted student population and management type

confidence — direction: highconfidence — magnitude: medium to highconsensus: thin — single-state study
mechanism
not established; source notes standardized achievement tests may not capture alternative outcomes at-risk charters emphasize
effect
charters targeting at-risk/special-education students: −1.2 points math, no significant reading difference; for-profit vs. nonprofit management: no significant difference in math or reading
conditions / moderators
applies within the Florida charter population studied

Charter schools show greater variation in achievement performance than traditional public schools

confidence — direction: highconfidence — magnitude: mediumconsensus: thin — limited geographic replication
mechanism
not established
effect
increases the range of school-level achievement-impact variation versus traditional public schools generally; Ohio shows a much wider range of variation than its traditional public schools
conditions / moderators
magnitude of the gap varies by state; Ohio is described as a notable outlier

Charter-school competition shows mixed effects on neighboring traditional public schools' test scores

confidence — direction: mediumconfidence — magnitude: low to mediumconsensus: contested
mechanism
not established; one source flags possible selection bias in which students leave for charters as an untested confound
effect
no measured effect (multi-state RAND analysis; Zimmer et al. 2008 analysis); decreases scores (Ohio and Michigan); modest increase in math and no change in reading (Florida)
conditions / moderators
direction differs by state; not explained by the sources beyond location

School competition's association with achievement differs by unit of analysis

confidence — direction: medium at school level, high at student and district levelconfidence — magnitude: low to mediumconsensus: contested across levels of analysis
mechanism
not established
effect
partial correlation of 0.06 at the school level (p<.10, CI crosses zero); 0.001 at the student level (p<.01); −0.002 at the district level (not significant)
conditions / moderators
meta-analytic pooling across many underlying studies; direction/significance depends on which unit of analysis a study used

Private-school-choice competition shows a larger association with achievement than charter-school competition

confidence — direction: mediumconfidence — magnitude: mediumconsensus: thin — single meta-analytic moderator test
mechanism
not established
effect
β=0.22 (p<.05) for private school choice relative to charter-school competition
conditions / moderators
based on 17 studies of private choice competition in the meta-analysis; not established whether this holds outside quasi-experimental designs

The competition-achievement association is larger where a school's minority student share is higher, but not moderated by free/reduced-lunch share

confidence — direction: high for the minority-share result; high for the null FRL resultconfidence — magnitude: medium for minority share; high for the null FRL resultconsensus: thin — whether this narrows or widens inequality for minority students is not established in the sources
mechanism
not established
effect
β=0.04 per unit increase in minority student percentage (p<.001, student-level analysis); β=0.02 (p=.47, school level) and β=0.01 (p=.48, student level) for free/reduced-lunch share, neither significant
conditions / moderators
minority-share moderation holds at the student level; borderline at the school level (β=0.03, p=.07)

Competition's overall association with achievement is too small to change achievement or inequality on its own, and shows no overall negative effect on traditional-public-school students

confidence — direction: highconfidence — magnitude: mediumconsensus: settled within this meta-analysis; contested against the Ohio/Michigan negative findings above
mechanism
not established
effect
effects near zero across the pooled analyses; no overall negative achievement association for traditional-public-school students, though some individual studies find negative effects in specific contexts
conditions / moderators
a synthesis-level conclusion across the meta-analysis's pooled estimates

Racial segregation in school assignment decreases achievement, with larger negative effects for Black students in North Carolina charter transfers

confidence — direction: highconfidence — magnitude: mediumconsensus: thin — single-state finding
mechanism
not established
effect
segregated learning environments are associated with lower test scores generally; Black students making a racially segregating transfer to a North Carolina charter show larger negative achievement effects than those staying in traditional public schools or making a non-segregating transfer; North Carolina charters overall show larger negative effects for Black students than for White students
conditions / moderators
North Carolina-specific; not established whether the racial differential replicates in other states

Schools with 90 percent or greater minority enrollment and concentrated poverty have lower average test scores

confidence — direction: highconfidence — magnitude: not established (effect size not given)consensus: thin — cites a single cross-sectional study
mechanism
these schools have less qualified and experienced teachers and fewer advanced courses
effect
lower average test scores versus other schools (magnitude not specified)
conditions / moderators
applies at the 90%+ minority-enrollment-plus-poverty threshold

Charter transfers show no systematic cream-skimming of high achievers or large shift in overall racial stratification, though Black students' transfers move toward higher-Black-concentration charters in some sites

confidence — direction: high for no-cream-skimming and no-stratification-shift; medium for the self-segregation patternconfidence — magnitude: mediumconsensus: contested with Frankenberg (2003)'s theoretical selection-bias argument below
mechanism
not established
effect
no measured cream-skimming effect (transferring students' prior scores were at or below local averages in every site); no measured effect on overall racial/ethnic stratification; African American students transferring to charter schools moved to schools with higher concentrations of African American students in five of seven locales
conditions / moderators
cream-skimming and stratification findings are district-wide; the self-segregation pattern is a within-group finding among transferring Black students specifically

Selection bias is argued to inflate measured achievement comparisons by excluding lower-achieving student groups from enrollment

confidence — direction: highconfidence — magnitude: not established (no effect size given)consensus: contested — RAND (2009)'s empirical test of prior-achievement selection above finds no cream-skimming
mechanism
if students from lower-achieving groups do not enroll, a school's measured average scores mechanically rise
effect
invalidates direct achievement comparisons between charter/private and traditional public schools; increases measured average scores where lower-achieving groups are excluded
conditions / moderators
theoretical argument, not a direct empirical measurement

Private school entry increases within-school test-score inequality through reduced learning among poor students, with no measured effect on mean scores

confidence — direction: highconfidence — magnitude: highconsensus: settled within this study; no competing empirical estimate is present in these sources
mechanism
private-school entry increases within-private-sector inequality; the growth is concentrated within schools rather than between them, and results mainly from a reduction in poor students' learning gains rather than a change in wealthy students' gains
effect
increases variance in mean private-sector test scores by about 0.08 SD (0.077 SD); no measured effect on mean test scores in either the public or private sector
conditions / moderators
identified via difference-in-differences with school fixed effects and a restriction to non-switching students

Private schools set instructional levels that favor wealthier students, and private-school entry increases schools' incentive to move further toward that level

confidence — direction: mediumconfidence — magnitude: mediumconsensus: thin — model-dependent estimate
mechanism
private-school entry makes wealthier students relatively more marginal to retain, leading schools to move closer to the instructional level that suits them
effect
the average private school's instructional level favors richer students at the expense of poorer ones, even within the private-school population; entry of an additional private school increases inequality in learning
conditions / moderators
derived from a structural model rather than direct empirical estimation of the behavioral response

Aligning instructional level to poor students' optimum could increase their annual test-score gains

confidence — direction: mediumconfidence — magnitude: mediumconsensus: thin — model-dependent estimate
mechanism
matching instructional content to poor students' optimal level rather than wealthy students' optimal level
effect
increases poor students' yearly test-score gains by as much as 0.36 SD (roughly one year of education)
conditions / moderators
a structural-model estimate (β parameter), not a directly observed intervention

Voucher/private-school access shows no effect on core-subject (Telugu, math) test scores despite a large raw achievement gap between sectors

confidence — direction: highconfidence — magnitude: highconsensus: settled within this study
mechanism
the large 0.65 SD cross-sectional gap between public and private students mostly reflects selection into private schools rather than differences in instruction
effect
no significant difference in Telugu and math scores between lottery winners and losers after two and four years
conditions / moderators
randomized voucher lottery design isolates this from selection

Voucher/private-school access increases scores in non-core subjects and the overall subject average, alongside private schools' reallocation of instructional time away from Telugu and math

confidence — direction: highconfidence — magnitude: medium (English effect borderline; Hindi and overall-average effects higher confidence)consensus: settled within this study
mechanism
private schools spend 40% less instructional time on Telugu and 32% less on math than public schools, redirecting time to English, science/EVS, and Hindi, while still matching public schools' Telugu/math gains
effect
+0.13σ averaged across all subjects; +0.23σ instrumented effect of attending private school on test scores overall; +0.55σ in Hindi (p<.001); +0.12σ in English (p=.098, borderline)
conditions / moderators
applies to lottery winners in Andhra Pradesh over two to four years

Voucher program shows no measured spillover effects on non-applicant public-school students or on students already enrolled in private schools

confidence — direction: highconfidence — magnitude: highconsensus: settled within this study
mechanism
not established
effect
no measured effect on public-school students who did not apply for the voucher; no measured effect on students already attending private schools before the program
conditions / moderators
tested via a two-stage, village-level lottery design comparing treatment and control villages

Voucher program effects do not vary meaningfully by observable student characteristics, and program participation does not correlate with household socioeconomic status

confidence — direction: highconfidence — magnitude: highconsensus: settled within this study
mechanism
not established
effect
limited evidence of variation in program impact by student characteristics; voucher application and acceptance are not correlated with parental assets, education, or caste
conditions / moderators
tested via formal subgroup analysis and balance tests within the lottery framework