What the evidence says
Charter-school achievement estimates vary sharply by identification strategy and location, and the studies do not agree on a single direction. Lottery-based causal designs report the largest gains: eighth-graders in New York City charter schools score 20 to 30 points higher on state math and reading assessments than public-school peers, closing about two-thirds of the urban-suburban achievement gap in that metro area. In Boston, charter middle-school attendance increases math scores by 0.4 SD per year and English Language Arts by 0.2 SD per year, and charter high-school attendance increases ELA/math by about 0.2 SD per year and writing by 0.17–0.28 SD per year. In Florida, charter achievement starts below traditional public schools in year one (2.0–2.1 points lower in math, 13% of an average year's gain; 1.5 points lower in reading, 12%) and reaches parity in math while exceeding traditional public schools in reading by 1.3 points (10% of a year's gain) by year five. Associational comparisons elsewhere find no such pattern: charter achievement in California and Philadelphia is statistically indistinguishable from traditional public schools, and Minnesota charter schools score lower on average than comparable traditional public schools after nearly two decades of operation.
Where private schooling widens test-score inequality, the evidence points to a within-school channel rather than a between-school one. Private school entry increases the variance of private-sector test scores by about 0.08 SD, and this growth traces mainly to inequality growing within schools, not across them. The private schools studied set an instructional level that favors richer students at the expense of poorer ones, even within the population that attends private school, and the entry of an additional private school increases schools' incentive to move further toward that wealthier-favoring level — making wealthier students relatively more marginal to retain. The resulting rise in within-school inequality comes mainly from reduced learning gains among poor students, while private entry shows no measured effect on mean test scores in either the public or private sector. The same study estimates that a school could increase poor students' annual test-score gains by up to 0.36 SD — nearly a year of schooling — by shifting from the instructional level optimal for wealthy students to the one optimal for poor students.
A randomized voucher lottery in Andhra Pradesh, India isolates the causal effect of private-school access from who selects into it. Lottery winners and losers show no difference in Telugu and math scores after two and four years, even though a raw cross-sectional gap of 0.65 SD separates public and private students — indicating that gap mostly reflects selection rather than instruction. Winners do score higher when all subjects are averaged (+0.13 SD), and the instrumented effect of attending a private school on test scores overall is +0.23 SD, with a large gain in Hindi (+0.55 SD, p<.001) and a smaller one in English (+0.12 SD, p=.098). Private schools achieve Telugu and math outcomes equal to public schools while spending 40% less instructional time on Telugu and 32% less on math, redirecting that time to English, science, and Hindi — the mechanism the study ties the non-core-subject gains to. The program shows no measured spillover on public-school non-applicants or on students already in private schools, and program participation does not correlate with household socioeconomic characteristics. Mean per-student cost is over three times higher in the public system than in the private schools sampled.
Effects of school competition on traditional-public-school achievement are small and inconsistent. A meta-analysis of the broader literature finds a partial correlation between competition and achievement of 0.06 at the school level (borderline, p<.10, confidence interval crosses zero), 0.001 at the student level (statistically significant but very small), and −0.002 at the district level (not significant). Site-specific studies split on direction: no measured effect on neighboring traditional public schools in a multi-state RAND study, a decrease in student performance in Ohio and Michigan, and a modest increase in math with unchanged reading in Florida. The same meta-analysis states these competitive effects are too small to produce a major change in achievement or inequality on their own, and finds no overall negative effect on traditional-public-school students associated with competition.
Racial segregation is the one lever where the direction of harm is consistent, though the underlying mechanism is largely unstated. Segregated learning environments are associated with lower test scores generally, and schools with 90% or greater minority enrollment combined with concentrated poverty have lower average test scores, less qualified and experienced teachers, and fewer advanced courses. In North Carolina, Black students who made a racially segregating transfer into a charter school show larger negative achievement effects than Black students who stayed in traditional public schools or made a non-segregating transfer, and North Carolina charter schools overall produced larger negative effects on Black students' scores than on White students' scores. Separately, a meta-analysis finds the competition-achievement association grows larger as a school's minority student share rises (β=0.04 per unit at the student level), though whether that differential narrows or widens the achievement gap for those students is not established in the sources. No claim here quantifies how large the racial effects are in point terms — only their direction and relative size against comparison groups.
Where the evidence splits
Selection bias ("cream-skimming") is argued two different ways with no reconciliation offered in the sources. One paper argues, on theoretical grounds, that several kinds of selection bias make achievement comparisons between charter/private and traditional public schools "virtually impossible," and that excluding lower-achieving student groups from enrollment mechanically raises a school's measured average. A separate multi-site empirical study, using student-level longitudinal comparisons of prior test scores, finds no systematic evidence that charter schools skim high-achieving students — transferring students' prior scores were at or below local averages in every site studied. The sources do not resolve this: one is a theoretical account of a general mechanism, the other a direct empirical test of one specific channel (prior achievement) across seven locations, and neither states whether other selection channels the theoretical argument raises (for example, parental effort or informational barriers) were tested.
Charter/competition effects on neighboring traditional public schools split by state and by unit of analysis, and the sources only partly explain why. A multi-state RAND study and a Zimmer et al. analysis find no effect on neighboring public schools' scores; Ohio and Michigan studies find a slight decrease; a Florida panel study finds a modest increase in math and no change in reading; and a meta-analysis finds the association near zero at the district level but small and positive at the school level. The sources tie part of this to geography (different states) and to unit of analysis (school vs. student vs. district level in the meta-analysis), but do not explain why Ohio and Michigan diverge from Florida beyond location.
The overall direction of charter achievement effects splits by study design as much as by geography. Positive results in New York City and Boston come from lottery-based quasi-experiments; null or negative results in Minnesota, California, and Philadelphia come from associational comparisons. Florida's panel study, also not lottery-based, finds convergence to parity in math and a positive reading effect by charter schools' fifth year — a result the sources do not reconcile with the null Philadelphia and California findings, which use similarly non-experimental designs.
Thresholds and dose-response
Schools with 90 percent or greater minority enrollment combined with concentrated poverty have lower average test scores, less qualified and experienced teachers, and fewer advanced courses than other schools.
Charter school achievement follows a dose-response pattern over time in the Florida panel study: it starts below traditional public schools in year one (2.0–2.1 points lower in math, 13% of an average year's gain; 1.5 points lower in reading, 12%), then rises to match traditional public schools in math and exceed them in reading (+1.3 points, 10% of an average year's gain) by the fifth year of operation.
Shifting a school's instructional level from the level optimal for wealthy students to the level optimal for poor students is estimated to raise poor students' annual test-score gains by as much as 0.36 SD.
Findings
New York City charter attendance increases eighth-grade math and reading scores
confidence — direction: highconfidence — magnitude: highconsensus: contested — other geographies (Minnesota, California, Philadelphia) find null or lower charter achievement
- mechanism
- not established in the source beyond charter enrollment
- effect
- increases scores by 20–30 points versus traditional public school students; reduces the urban-suburban achievement gap by roughly two-thirds
- conditions / moderators
- grade 8 only in the cited analysis; not established whether this holds at other grades or in other metro areas
Boston charter attendance increases annual math, ELA, and writing gains; comparable "pilot" schools show weaker or no effect
confidence — direction: highconfidence — magnitude: high for charter and pilot elementary estimates; low for pilot middle/high school estimatesconsensus: contested with associational studies elsewhere showing null/negative charter effects
- mechanism
- not established
- effect
- middle school: +0.4σ/year math, +0.2σ/year ELA; high school: ~0.2σ/year ELA and math, +0.17σ–0.28σ/year writing; pilot elementary: +0.06σ–0.07σ/year; pilot middle/high school ELA and math: not significantly different from zero
- conditions / moderators
- pilot middle schools serving grades 6–8 show a negative math effect (significant once baseline scores are controlled), while pilot K–8 schools show the opposite pattern
Florida charter achievement starts below traditional public schools and converges to parity or exceeds it by year five
confidence — direction: highconfidence — magnitude: highconsensus: contested with other-state associational findings of persistently lower or null charter achievement
- mechanism
- not established
- effect
- year one: −2.0 to −2.1 points math (13% of average annual gain), −1.5 points reading (12%); year five+: no significant math difference, +1.3 points reading (10% of average annual gain)
- conditions / moderators
- applies to charter schools with five or more years of operation; not established for schools closing or converting before then
Charter achievement is null or lower than traditional public schools in other associational comparisons
confidence — direction: highconfidence — magnitude: mediumconsensus: contested; thin per individual site
- mechanism
- not established
- effect
- Minnesota: lower average achievement (magnitude not specified); California: no measured effect; Philadelphia: no measured effect (gains statistically indistinguishable from traditional public schools)
- conditions / moderators
- all three are associational, non-lottery comparisons; contrasts with lottery-based positive findings in New York City and Boston
Charter effects vary by targeted student population and management type
confidence — direction: highconfidence — magnitude: medium to highconsensus: thin — single-state study
- mechanism
- not established; source notes standardized achievement tests may not capture alternative outcomes at-risk charters emphasize
- effect
- charters targeting at-risk/special-education students: −1.2 points math, no significant reading difference; for-profit vs. nonprofit management: no significant difference in math or reading
- conditions / moderators
- applies within the Florida charter population studied
Charter schools show greater variation in achievement performance than traditional public schools
confidence — direction: highconfidence — magnitude: mediumconsensus: thin — limited geographic replication
- mechanism
- not established
- effect
- increases the range of school-level achievement-impact variation versus traditional public schools generally; Ohio shows a much wider range of variation than its traditional public schools
- conditions / moderators
- magnitude of the gap varies by state; Ohio is described as a notable outlier
Charter-school competition shows mixed effects on neighboring traditional public schools' test scores
confidence — direction: mediumconfidence — magnitude: low to mediumconsensus: contested
- mechanism
- not established; one source flags possible selection bias in which students leave for charters as an untested confound
- effect
- no measured effect (multi-state RAND analysis; Zimmer et al. 2008 analysis); decreases scores (Ohio and Michigan); modest increase in math and no change in reading (Florida)
- conditions / moderators
- direction differs by state; not explained by the sources beyond location
School competition's association with achievement differs by unit of analysis
confidence — direction: medium at school level, high at student and district levelconfidence — magnitude: low to mediumconsensus: contested across levels of analysis
- mechanism
- not established
- effect
- partial correlation of 0.06 at the school level (p<.10, CI crosses zero); 0.001 at the student level (p<.01); −0.002 at the district level (not significant)
- conditions / moderators
- meta-analytic pooling across many underlying studies; direction/significance depends on which unit of analysis a study used
Private-school-choice competition shows a larger association with achievement than charter-school competition
confidence — direction: mediumconfidence — magnitude: mediumconsensus: thin — single meta-analytic moderator test
- mechanism
- not established
- effect
- β=0.22 (p<.05) for private school choice relative to charter-school competition
- conditions / moderators
- based on 17 studies of private choice competition in the meta-analysis; not established whether this holds outside quasi-experimental designs
The competition-achievement association is larger where a school's minority student share is higher, but not moderated by free/reduced-lunch share
confidence — direction: high for the minority-share result; high for the null FRL resultconfidence — magnitude: medium for minority share; high for the null FRL resultconsensus: thin — whether this narrows or widens inequality for minority students is not established in the sources
- mechanism
- not established
- effect
- β=0.04 per unit increase in minority student percentage (p<.001, student-level analysis); β=0.02 (p=.47, school level) and β=0.01 (p=.48, student level) for free/reduced-lunch share, neither significant
- conditions / moderators
- minority-share moderation holds at the student level; borderline at the school level (β=0.03, p=.07)
Competition's overall association with achievement is too small to change achievement or inequality on its own, and shows no overall negative effect on traditional-public-school students
confidence — direction: highconfidence — magnitude: mediumconsensus: settled within this meta-analysis; contested against the Ohio/Michigan negative findings above
- mechanism
- not established
- effect
- effects near zero across the pooled analyses; no overall negative achievement association for traditional-public-school students, though some individual studies find negative effects in specific contexts
- conditions / moderators
- a synthesis-level conclusion across the meta-analysis's pooled estimates
Racial segregation in school assignment decreases achievement, with larger negative effects for Black students in North Carolina charter transfers
confidence — direction: highconfidence — magnitude: mediumconsensus: thin — single-state finding
- mechanism
- not established
- effect
- segregated learning environments are associated with lower test scores generally; Black students making a racially segregating transfer to a North Carolina charter show larger negative achievement effects than those staying in traditional public schools or making a non-segregating transfer; North Carolina charters overall show larger negative effects for Black students than for White students
- conditions / moderators
- North Carolina-specific; not established whether the racial differential replicates in other states
Schools with 90 percent or greater minority enrollment and concentrated poverty have lower average test scores
confidence — direction: highconfidence — magnitude: not established (effect size not given)consensus: thin — cites a single cross-sectional study
- mechanism
- these schools have less qualified and experienced teachers and fewer advanced courses
- effect
- lower average test scores versus other schools (magnitude not specified)
- conditions / moderators
- applies at the 90%+ minority-enrollment-plus-poverty threshold
Charter transfers show no systematic cream-skimming of high achievers or large shift in overall racial stratification, though Black students' transfers move toward higher-Black-concentration charters in some sites
confidence — direction: high for no-cream-skimming and no-stratification-shift; medium for the self-segregation patternconfidence — magnitude: mediumconsensus: contested with Frankenberg (2003)'s theoretical selection-bias argument below
- mechanism
- not established
- effect
- no measured cream-skimming effect (transferring students' prior scores were at or below local averages in every site); no measured effect on overall racial/ethnic stratification; African American students transferring to charter schools moved to schools with higher concentrations of African American students in five of seven locales
- conditions / moderators
- cream-skimming and stratification findings are district-wide; the self-segregation pattern is a within-group finding among transferring Black students specifically
Selection bias is argued to inflate measured achievement comparisons by excluding lower-achieving student groups from enrollment
confidence — direction: highconfidence — magnitude: not established (no effect size given)consensus: contested — RAND (2009)'s empirical test of prior-achievement selection above finds no cream-skimming
- mechanism
- if students from lower-achieving groups do not enroll, a school's measured average scores mechanically rise
- effect
- invalidates direct achievement comparisons between charter/private and traditional public schools; increases measured average scores where lower-achieving groups are excluded
- conditions / moderators
- theoretical argument, not a direct empirical measurement
Private school entry increases within-school test-score inequality through reduced learning among poor students, with no measured effect on mean scores
confidence — direction: highconfidence — magnitude: highconsensus: settled within this study; no competing empirical estimate is present in these sources
- mechanism
- private-school entry increases within-private-sector inequality; the growth is concentrated within schools rather than between them, and results mainly from a reduction in poor students' learning gains rather than a change in wealthy students' gains
- effect
- increases variance in mean private-sector test scores by about 0.08 SD (0.077 SD); no measured effect on mean test scores in either the public or private sector
- conditions / moderators
- identified via difference-in-differences with school fixed effects and a restriction to non-switching students
Private schools set instructional levels that favor wealthier students, and private-school entry increases schools' incentive to move further toward that level
confidence — direction: mediumconfidence — magnitude: mediumconsensus: thin — model-dependent estimate
- mechanism
- private-school entry makes wealthier students relatively more marginal to retain, leading schools to move closer to the instructional level that suits them
- effect
- the average private school's instructional level favors richer students at the expense of poorer ones, even within the private-school population; entry of an additional private school increases inequality in learning
- conditions / moderators
- derived from a structural model rather than direct empirical estimation of the behavioral response
Aligning instructional level to poor students' optimum could increase their annual test-score gains
confidence — direction: mediumconfidence — magnitude: mediumconsensus: thin — model-dependent estimate
- mechanism
- matching instructional content to poor students' optimal level rather than wealthy students' optimal level
- effect
- increases poor students' yearly test-score gains by as much as 0.36 SD (roughly one year of education)
- conditions / moderators
- a structural-model estimate (β parameter), not a directly observed intervention
Voucher/private-school access shows no effect on core-subject (Telugu, math) test scores despite a large raw achievement gap between sectors
confidence — direction: highconfidence — magnitude: highconsensus: settled within this study
- mechanism
- the large 0.65 SD cross-sectional gap between public and private students mostly reflects selection into private schools rather than differences in instruction
- effect
- no significant difference in Telugu and math scores between lottery winners and losers after two and four years
- conditions / moderators
- randomized voucher lottery design isolates this from selection
Voucher/private-school access increases scores in non-core subjects and the overall subject average, alongside private schools' reallocation of instructional time away from Telugu and math
confidence — direction: highconfidence — magnitude: medium (English effect borderline; Hindi and overall-average effects higher confidence)consensus: settled within this study
- mechanism
- private schools spend 40% less instructional time on Telugu and 32% less on math than public schools, redirecting time to English, science/EVS, and Hindi, while still matching public schools' Telugu/math gains
- effect
- +0.13σ averaged across all subjects; +0.23σ instrumented effect of attending private school on test scores overall; +0.55σ in Hindi (p<.001); +0.12σ in English (p=.098, borderline)
- conditions / moderators
- applies to lottery winners in Andhra Pradesh over two to four years
Voucher program shows no measured spillover effects on non-applicant public-school students or on students already enrolled in private schools
confidence — direction: highconfidence — magnitude: highconsensus: settled within this study
- mechanism
- not established
- effect
- no measured effect on public-school students who did not apply for the voucher; no measured effect on students already attending private schools before the program
- conditions / moderators
- tested via a two-stage, village-level lottery design comparing treatment and control villages
Voucher program effects do not vary meaningfully by observable student characteristics, and program participation does not correlate with household socioeconomic status
confidence — direction: highconfidence — magnitude: highconsensus: settled within this study
- mechanism
- not established
- effect
- limited evidence of variation in program impact by student characteristics; voucher application and acceptance are not correlated with parental assets, education, or caste
- conditions / moderators
- tested via formal subgroup analysis and balance tests within the lottery framework