Evans Learning Labs
LinkedIn Email
Applied Research Brief

Why Representation Numbers Miss What Inclusion Climate Measures

Most organizations track diversity through headcount: who was hired, who was promoted, what the demographic breakdown looks like by level. Representation matters, but it answers a narrower question than most organizations think it does. Whether the people already inside the organization experience genuine inclusion is a distinct, separately measurable construct, and the research indicates it predicts retention and performance outcomes that representation numbers alone do not capture.
Abstract
Ely and Thomas's (2001) influential study of diversity paradigms found that organizations pursuing diversity primarily as a representation or legal-compliance goal realized markedly different outcomes than organizations that integrated diversity into how work itself gets done, a distinction with direct implications for what organizations should actually measure. Nishii's (2013) research established inclusive climate as an empirically distinct construct from demographic representation, one that independently predicts conflict, cooperation, and performance at the workgroup level regardless of how diverse the workgroup's composition is. Dobbin and Kalev's (2016) large-scale analysis of over eight hundred organizations' diversity interventions over three decades found that some of the most common program types, mandatory diversity training and formal grievance procedures among them, showed weak or negative effects on managerial diversity, while other interventions, mentoring programs and diversity task forces with real accountability, showed consistent positive effects. This brief reviews what the evidence indicates about the gap between representation and climate, and what that gap means for how organizations should actually measure DEI progress.

Representation Is Necessary but Not Sufficient

Three paradigms for pursuing diversity, and what each one actually changes
ParadigmWhat it treats diversity asWhat tends to stay unchanged
Discrimination-and-fairnessA compliance and representation targetWhose perspective actually shapes decisions
Access-and-legitimacyA market or legitimacy assetWhether diverse expertise is treated as central
Integration-and-learningA resource actively incorporated into how work gets doneMost consistently associated with real change
Figure 1. Organizations operating from the first two paradigms can achieve genuine representation gains while the underlying decision-making dynamics remain effectively unchanged.
Ely and Thomas, 2001

Ely and Thomas's (2001) study of diversity perspectives across organizations identified three distinct paradigms through which organizations pursue diversity, and found that the paradigm an organization actually operates from, not just its stated commitment to diversity, predicted meaningfully different outcomes. The discrimination-and-fairness paradigm treats diversity primarily as a compliance and representation goal: hire and promote a workforce that reflects the relevant population, and treat that as the objective largely achieved once the numbers reflect it. The access-and-legitimacy paradigm treats diversity instrumentally, valuing a diverse workforce for the market access or legitimacy it provides with diverse constituencies, without necessarily integrating diverse perspectives into how work itself gets done.

The integration-and-learning paradigm, the perspective Ely and Thomas's research found most consistently associated with positive work group outcomes, treats diversity of perspective as a resource actively incorporated into how the organization defines its work, solves problems, and makes decisions, not merely a demographic outcome to be achieved and maintained. Organizations operating from the first two paradigms can achieve genuinely strong representation numbers, a workforce that reflects population diversity or extends market reach, while the underlying work group dynamics, whose perspectives actually shape decisions, whose expertise gets treated as central rather than supplementary, remain effectively unchanged.

This distinction has direct measurement implications. An organization assessing its diversity progress purely through representation metrics, headcount by level, promotion rates by demographic group, can show genuine improvement on every number it tracks while the underlying climate, whether the people those numbers represent actually experience inclusion in how work gets done, remains stagnant or even deteriorates as the organization scales. Representation and climate are correlated but empirically distinct, and an organization that only measures the former has no reliable way to detect deterioration in the latter until it shows up in the turnover and engagement data that representation metrics alone cannot anticipate.

What Inclusion Climate Actually Measures

Nishii's (2013) research established inclusive climate as a construct distinct from demographic diversity itself, and found that climate for inclusion independently predicted conflict, cooperation, and performance at the work group level, holding constant how demographically diverse the group actually was. Highly diverse work groups with strong inclusive climates outperformed less diverse groups, while highly diverse groups with weak inclusive climates showed the conflict and coordination problems that opponents of diversity initiatives frequently point to as evidence against diversity itself, when the more accurate diagnosis is that demographic diversity without genuine inclusion produces exactly the friction that diversity efforts are meant to prevent.

Shore and colleagues' (2011) influential framework defines inclusion along two independent dimensions: belongingness, whether an individual experiences genuine acceptance and connection to the group, and uniqueness, whether an individual's distinct perspective and identity are actually valued rather than required to assimilate to fit in. Their model identifies exclusion as the failure of both dimensions, assimilation as belongingness without valued uniqueness, differentiation as valued uniqueness without genuine belongingness, and true inclusion as the presence of both simultaneously. Organizations that achieve strong representation numbers through hiring while implicitly expecting new hires to assimilate to existing norms are producing the assimilation condition, not genuine inclusion, and the distinction matters because assimilation-condition employees show measurably different engagement and retention patterns than genuinely included ones even when their satisfaction scores on generic engagement surveys look similar.

Dwertmann, Nishii, and van Knippenberg's (2016) review of the diversity climate literature further distinguishes fairness-and-discrimination climate, whether the organization is perceived as treating demographic groups equitably in formal processes, from synergy climate, whether diverse perspectives are perceived as genuinely leveraged rather than merely tolerated. Both matter, and they are not the same measurement: an organization can score well on fairness perceptions, formal processes are seen as equitable, while scoring poorly on synergy, diverse perspectives are formally welcomed but not actually incorporated into how decisions get made, and organizations measuring only one of these two climate dimensions are missing meaningful variance in the employee experience the other dimension captures.

Structural Fairness Beyond Individual Perception

Climate perception, however well measured, captures how people experience the organization's fairness; it does not by itself verify whether the organization's actual policies and processes produce equitable outcomes independent of individual perception. An organization can have a workforce that broadly perceives the organization as fair while specific structural elements, how promotion criteria are actually weighted, how compensation bands get set, which roles carry informal fast-track status, quietly produce disparate outcomes that individual perception surveys do not reliably surface, because perception is shaped by comparison to local reference groups and by information asymmetries that leave people without visibility into how their own outcomes compare to their broader cohort.

Genuine structural fairness assessment requires examining the actual outcomes a policy or process produces, not merely whether the policy is perceived as fair by the people subject to it, and the distinction matters because the two measures can diverge significantly. A promotion process perceived as fair by the majority of employees can still be producing systematically different outcomes for a specific group if the criteria being applied, while facially neutral, correlate with factors that themselves differ systematically across groups, informal sponsorship access, visibility to decision-makers, or fit with an unstated cultural template for what leadership potential looks like. Organizations serious about structural fairness measure both dimensions separately: perceived fairness and actual outcome equity, treating a gap between the two as a specific, addressable finding rather than as evidence that the perception measure was simply wrong.

A useful diagnostic question for any organization is whether it could currently answer, with actual data rather than confidence, whether two employees with comparable performance records and tenure but different demographic backgrounds have historically received comparable outcomes in promotion timing, compensation growth, and access to high-visibility assignments. Most organizations that have not specifically built structural fairness measurement into their DEI approach cannot answer this question with data, only with the general impression that their processes are fair, and the gap between that impression and an actual answer is precisely what structural outcome measurement is designed to close.

Which Interventions Actually Work

What the evidence says actually moves managerial diversity
Weak or negative effect
Mandatory diversity training
Compulsory framing often produces resistance
Formal grievance procedures
Adversarial framing discourages collaborative change
Consistent positive effect
Mentoring programs
Direct, sustained, personal engagement
Task forces with real authority
Accountability that's specific, not diffuse
Figure 2. The pattern separating effective from ineffective interventions is not intent but structure: ongoing, personally accountable engagement versus one-time, diffusely-owned compliance activity.
Dobbin and Kalev, 2016

Dobbin and Kalev's (2016) analysis of diversity interventions across more than eight hundred organizations over three decades produced findings that complicate the assumption that any well-intentioned DEI program produces positive change. Mandatory diversity training, among the most commonly implemented interventions, showed weak effects on managerial diversity in their analysis and, in some organizational contexts, measurably negative effects, a pattern their earlier work with Kelly (2006) traced partly to the reactance mandatory framing produces: people required to attend training designed to change their attitudes often respond with resistance to the framing itself rather than genuine attitude change.

Formal grievance procedures, another common intervention aimed at providing a channel for reporting discrimination, showed a similarly weak relationship with improved managerial diversity in the same analysis, a finding the researchers attribute partly to the adversarial framing such procedures create between the reporting employee and the manager or organization being reported on, discouraging the kind of proactive, collaborative culture change that actually shifts organizational patterns. Both findings run counter to what many organizations treat as the default DEI intervention toolkit, and both point toward the same underlying diagnosis: compliance-oriented interventions that people experience as being done to them, rather than engaged in with them, tend to produce resistance rather than the change they were designed to create.

The interventions Dobbin and Kalev's research found genuinely effective share a common structural feature: they create ongoing engagement and accountability rather than a one-time compliance event. Mentoring programs that connect underrepresented employees with more senior sponsors showed consistent positive effects on managerial diversity, as did diversity task forces with actual decision-making authority and visibility, and the practice of assigning specific individuals, not a diffuse organizational commitment, direct responsibility and accountability for diversity outcomes within their own area. The pattern across effective interventions is direct, sustained, personally accountable engagement; the pattern across ineffective ones is generalized, one-time, diffusely-owned compliance activity.

Measuring Climate, Not Just Counting Heads

The practical implication of this body of research is that organizations serious about DEI progress need a measurement approach that captures climate, belongingness, valued uniqueness, perceived fairness in formal processes, and perceived synergy in how diverse perspectives actually get used, alongside representation metrics and structural outcome data, not instead of them. Representation numbers remain a genuine and necessary measure; they are simply not a sufficient one, and an organization relying on them exclusively has no visibility into the specific climate and structural conditions the research identifies as actually driving the retention, engagement, and performance outcomes that representation alone does not predict.

Equally important is measuring accountability itself, specifically whether leaders at the level actually shaping day-to-day work experience are held personally responsible for climate outcomes in their own area, rather than treating DEI as a centralized program owned by a single function on behalf of the whole organization. Dobbin and Kalev's research on what actually works points consistently toward direct, distributed accountability as the mechanism separating durable culture change from well-intentioned compliance activity that leaves the underlying climate unchanged, and organizations that measure leadership accountability for climate outcomes specifically, not just overall program participation, gain the diagnostic visibility needed to identify where that accountability is genuinely present and where it exists only on paper.

None of this argues against representation as a goal. It argues that representation, structural outcome equity, and inclusion climate are three distinct things that the research indicates do not move together automatically, and an organization measuring only the first has meaningfully less visibility into its own DEI progress than it likely believes it has.

References
Explore the Evans Learning Labs diagnostic toolkit
Structured diagnostic tools covering leadership, team, and organizational performance.
Browse the toolkitBack to articles
Welcome back
Sign in to access your assessments
No account?
Terms of Use and Disclaimer

Informational and Educational Use Only

The diagnostic tools, assessments, profiles, and indexes offered by Evans Learning Labs are designed for informational and educational purposes only. Results do not constitute professional consulting advice, legal advice, psychological assessment, clinical evaluation, or any form of certified professional guidance.

Self-Reported Results

All results are based entirely on the responses provided by the individual completing the assessment. Evans Learning Labs makes no representation that scores or profiles accurately reflect objective organizational conditions or any other measurable external reality.

No Guarantee of Outcomes

Evans Learning Labs does not guarantee that use of these tools will produce any specific organizational, leadership, or performance outcome. Recommendations are general in nature and may not be appropriate for every individual, team, or organizational context.

Limitation of Liability

To the fullest extent permitted by applicable law, Evans Learning Labs, its principals, employees, and affiliates shall not be liable for any direct, indirect, incidental, consequential, or punitive damages arising from the use of or reliance on these tools or their results.

Governing Law

These terms are governed by the laws of the United States and Commonwealth of Kentucky.