Blind/Anonymized Hiring Field Experiments (Identity Withheld)

confidence: high · 2 sources

⚠
Working research — not a recommendation.

This page records what the evidence says a policy does, not what anyone should do about it. It has been synthesized from the cited sources but has not been independently reviewed.

What the evidence says

The strongest causal evidence on blind/anonymized hiring comes from a single quasi-experiment on orchestra auditions, where a physical screen conceals a candidate's identity — including gender — from the evaluating panel (Goldin 2000). Using individual fixed effects to track the same musicians auditioning with and without the screen, the study finds the screen increases the probability a woman advances from the preliminary round by about 11 percentage points, and increases the probability a woman wins the final round by about 33 percentage points among those who reached it. The mechanism the study attributes to these effects is concealment of visual gender cues from the panel during evaluation.

The same data show a second-order effect on the applicant pool itself: adopting blind auditions increased the number of women applying, but the additional applicants drawn in had lower average qualifications than existing applicants. This composition shift explains why an aggregate-level comparison (Table 4 in the source) can show a negative effect for women even though the within-individual estimate (Table 5) is positive — the aggregate result reflects a pool that got larger and, on average, less qualified, not a smaller effect of blindness on any given candidate's chances.

Combining both channels, the source estimates that the switch to blind auditions explains about one-third of the historical increase in the proportion of women among new orchestra hires, with another third attributed to the enlarged applicant pool described above. The source does not state what accounts for the remaining share of the historical increase. Separately, the same authors characterize the overall pattern as evidence that blind auditions "fostered impartiality" in hiring — but this is an inference from the advancement-outcome pattern rather than a direct measurement, and the source's own language ("the weight of the evidence suggests") flags it as an interpretation rather than a directly observed result.

Evidence on blind/anonymized hiring outside live auditions is much thinner and points a different direction. A review of blind resume field experiments — where race is withheld from resumes rather than identity being withheld from a live panel — finds results on minority hiring are "highly mixed," with some studies finding anonymization decreases minority hiring (Quillian 2021, citing Åslund & Skans 2012 and Behaghel et al. 2014).

None of the claims here address identity concealment carried through the full hiring process (beyond the audition or resume-screening stage alone, e.g., through interviews or reference checks), and none extend the orchestra findings to occupations outside classical music or the resume findings to protected characteristics other than race. That is an absence in the current evidence base, not a null result.

Where the evidence splits

Within the orchestra-audition data itself, the direction of the screen's effect is not consistent across stages: it increases advancement at the preliminary round (+11 points) and win probability at the final round (+33 points), but decreases advancement at the semifinal round (by 17–24 points). The source calls this semifinal result anomalous and notes its standard errors are substantial relative to the effect size, but does not offer an explanation for why the effect reverses sign mid-process. The split is unexplained by the source.

Within the blind-resume literature on minority hiring, results across studies are described as highly mixed, and at least part of the disagreement is attributed to a design factor rather than to the anonymization procedure itself: employers who volunteer to participate in these blind-hiring experiments may already have above-average concern about diversity, meaning the studies finding decreased minority hiring may reflect self-selection into the experiment (Bertrand & Duflo 2016) rather than a general effect of resume anonymization.

Thresholds and dose-response

No threshold established in the current sources.

Open empirical questions

Findings

Blind auditions increase women's advancement from the preliminary audition round

confidence — direction: highconfidence — magnitude: highconsensus: thin — single study in current sources, no contradicting evidence at this stage
mechanism
a screen conceals the candidate's identity, including gender, from the evaluating panel during preliminary rounds
effect
increases probability of advancement by about 11 percentage points (individual fixed-effects comparison of the same musicians with and without a screen)
conditions / moderators
applies at the preliminary stage; direction reverses at the semifinal stage (see below)

Blind auditions increase women's probability of winning the final audition round

confidence — direction: highconfidence — magnitude: highconsensus: thin — single study in current sources
mechanism
same identity-concealing screen, applied among candidates who already reached the final round
effect
increases probability of winning by about 33 percentage points for female musicians who reached the final round
conditions / moderators
applies only to candidates who advanced to the final round; not established for earlier stages beyond what is reported separately

Blind auditions decrease women's advancement at the semifinal audition round

confidence — direction: highconfidence — magnitude: mediumconsensus: contested within the same study — direction reversal is noted but unexplained
mechanism
not established — the source calls the result anomalous and gives no explanation for the reversal in direction
effect
decreases probability of advancement by about 17–24 percentage points at the semifinal stage
conditions / moderators
reverses the direction found at preliminary and final rounds; standard errors are substantial relative to the effect size

Blind auditions expand the female applicant pool while decreasing its average qualification

confidence — direction: highconfidence — magnitude: highconsensus: thin — single study in current sources
mechanism
the blind procedure drew in additional female applicants, but the marginal applicants had lower average qualifications than the existing pool, producing a negative aggregate-level result alongside a positive within-individual result
effect
increases pool size; decreases average qualification among female applicants
conditions / moderators
reconciles the apparent discrepancy between aggregate (Table 4) and within-individual (Table 5) estimates in the source

Blind auditions explain about one-third of the historical increase in the proportion of women among new orchestra hires

confidence — direction: highconfidence — magnitude: mediumconsensus: thin — single study in current sources
mechanism
direct effect of the screen on selection decisions, separate from the pool-expansion channel above
effect
explains about one-third (~33%) of the increase in proportion female among new hires; another one-third is attributed to the increased applicant pool; the source does not account for the remaining share
conditions / moderators
not established

Blind auditions increase impartiality in hiring judgment (inferred, not directly measured)

confidence — direction: highconfidence — magnitude: mediumconsensus: thin — single study, explicitly inferential rather than directly measured
mechanism
identity concealment is inferred to remove the opportunity for gender-based bias during evaluation
effect
increase in impartiality — not directly quantified; inferred from the advancement-outcome pattern above
conditions / moderators
not established; the source itself hedges this as an inference ("the weight of the evidence suggests")

Blind/anonymized resumes produce mixed effects on minority hiring, decreasing it in some studies

confidence — direction: highconfidence — magnitude: lowconsensus: contested — described in the source as "highly mixed"
mechanism
anonymizing resumes removes race-identifying information from evaluators; part of the negative findings is attributed instead to self-selection of employers with high concern about diversity into these experiments, not to the anonymization procedure itself
effect
mixed overall; decreased minority hiring found in some studies (Åslund & Skans 2012, Behaghel et al. 2014)
conditions / moderators
negative results linked to employer self-selection into the experiment (Bertrand & Duflo 2016); not established which studies are affected by this factor versus not