The most important things to know about a leader are not the most measurable. But the gap between what is measurable and what matters has been substantially reduced by the diagnostic approaches the research has validated. The question is whether organizations are using them.
The assessment of leadership effectiveness, including integrity, judgment, interpersonal impact, and genuine investment in others, has historically been treated as either impossible to measure rigorously or reducible to behavioral observation in performance contexts. Research has progressively narrowed the gap between what matters most in leadership effectiveness and what diagnostic approaches can reliably measure. This article reviews the diagnostic approaches with the strongest evidence base, examines the behavioral interview as a primary diagnostic tool, addresses the integration of assessment into development, and considers the organizational commitment required to build genuine diagnostic capability.
Schmidt and Hunter's (1998) comprehensive meta-analysis of employment assessment methods established the evidence base for which approaches most reliably predict job performance across occupational contexts. For senior leadership assessment, the practically important finding is the incremental validity from combining methods, particularly cognitive assessment with structured behavioral assessment, which substantially exceeds the validity of any single method. For the specific performance dimensions most important in senior leadership, including interpersonal effectiveness, ethical behavior, and judgment under uncertainty, behavioral and situational assessment methods provide validity not captured by cognitive assessment alone.
Multi-source behavioral assessment, commonly implemented as 360-degree feedback, provides validity for behavioral dimensions of leadership most directly visible to those who experience the leader's behavior: direct reports who observe management practices, peers who observe collaboration and influence behavior, and senior leaders who observe strategic thinking and organizational judgment. Each rater group provides a different observational vantage point, and the convergence across vantage points identifies behavioral patterns that are consistent across contexts. The divergence across vantage points is equally informative: significant differences between how a leader is rated by direct reports versus peers versus supervisors reveal the behavioral inconsistency across audience that is itself a leadership effectiveness concern.
Structured simulation assessment, in which leaders respond to realistic scenarios approximating specific demands of target roles, provides validity for judgment-intensive dimensions that survey-based assessment cannot capture. Thornton and Rupp (2006) reviewed the assessment center literature and found that well-designed simulation exercises produced predictive validity for senior leadership effectiveness above and beyond personality, cognitive ability, and prior performance measures. The validity of simulation assessment is highest when scenarios are designed to elicit the specific judgment-intensive behaviors most important in the target role, and when raters are specifically trained to observe and evaluate the behavioral dimensions the scenarios are designed to measure.
The dimensions of leadership character most resistant to formal assessment are those most situation-dependent in their behavioral expression: courage in the face of organizationally powerful opposition, integrity in high-stakes situations where self-interest and stated principles conflict, and genuine investment in others' development when competing priorities pressure toward self-interested behavior. These dimensions can be probed through highly structured behavioral interviews with probes specifically designed to surface examples of behavior under these conditions, but the validity of these probes depends on the interviewer's ability to distinguish genuine behavioral evidence from socially desirable narrative.
The structured behavioral interview, in which candidates are asked to provide specific examples of past behavior in defined situations rather than to describe their approach, values, or general tendencies, is the highest-validity single assessment method available for the interpersonal, ethical, and leadership dimensions most important for senior role success. The behavioral interview gains its validity from the research finding that past behavior in specific situations is a stronger predictor of future behavior in similar situations than stated intentions, general self-descriptions, or hypothetical responses to posed situations. What a leader did when they faced a specific high-stakes ethical conflict is more predictive of what they will do in similar future conflicts than their articulate description of how they would ideally handle it.
The diagnostic power of the behavioral interview depends critically on the probe structure following the initial behavioral example. Most interviewers are satisfied with the initial example and move to the next question, accepting the narrative the candidate provides without probing the specific behavioral details that distinguish genuine behavioral evidence from plausible-sounding retrospective narrative. Effective behavioral interview probes follow the initial example with specific questions about what the candidate did, said, and decided at specific points in the situation, including what they considered but chose not to do, what drove their specific choices, and what they would do differently in retrospect.
The dimensions that behavioral interviews are most effective at assessing are partially distinct from those that multi-source and simulation assessment measure well. Behavioral interviews are most effective at assessing learning from experience, self-awareness about behavioral patterns and their effects, ethical reasoning quality, and the specific content of past decisions and their rationale. They are less effective at assessing dimensions more accurately measured by observers than by the leader themselves, including interpersonal impact and behavioral consistency across audiences and contexts. A comprehensive diagnostic assessment uses the behavioral interview for the dimensions it measures best and supplements it with multi-source assessment for those it measures less well.
The organizational investment in structured behavioral interview capability among hiring managers and talent review facilitators is among the highest-return investments in assessment quality available. The difference in validity between a highly structured behavioral interview with trained interviewers and probes and an unstructured interview with untrained interviewers is larger than the difference between any two validated assessment instruments. Organizations that invest in assessment instrument sophistication while leaving the quality of the human assessment process to individual interviewer preference are improving the formal assessment component while leaving the highest-validity and most commonly used component at low validity levels that undermine overall assessment quality.
The organizational value of leadership assessment is fully realized only when assessment findings inform specific development decisions rather than producing informative descriptions of current state that are filed without influencing what the organization invests in developing. The transition from assessment-for-description to assessment-for-development requires organizational infrastructure that most organizations have built inadequately: structured processes for translating assessment findings into specific development plans, accountability for whether those plans are implemented, and reassessment mechanisms that determine whether the development investment has produced the behavioral change the assessment identified as needed.
The development planning process most effectively converting assessment findings into behavioral change begins with identifying a small number of high-priority development areas, specifically those behavioral dimensions both below the standard required for the current or target role and theoretically developable within a reasonable time horizon. Most assessment findings identify more development priorities than any development plan can productively address simultaneously, and building comprehensive plans that address all identified gaps produces plans too diffuse to produce significant behavioral change in any specific area. Focus on one to three high-priority development targets, pursued with specific behavioral practice and regular feedback, consistently produces more behavioral change than broad plans spreading investment across ten.
The follow-up assessment discipline measuring whether development investments have produced behavioral change is the most frequently omitted element of the assessment-to-development cycle and the element whose absence most directly reduces the organizational return from assessment investment. Without reassessment, organizations cannot distinguish development plans that produced genuine behavioral change from those that produced activity without impact, cannot calibrate their development investment toward the approaches that work in their specific context, and cannot build the organizational knowledge about leadership development effectiveness that would make each subsequent development cycle more productive.
The organizational return from assessment-informed development is substantially larger than from development without diagnostic foundation, because it concentrates investment in the specific behavioral dimensions that the individual most needs to develop rather than in the generic programs that may or may not address those dimensions. Organizations that build the full assessment-to-development cycle, including valid assessment, specific development planning, development implementation with accountability, and reassessment to measure impact, produce leadership capability improvement at substantially higher rates than those that invest in development programs without the diagnostic foundation that makes targeted investment possible.
Building a diagnostic assessment capability that genuinely improves leadership development outcomes requires organizational commitment at a level that most organizations underestimate before beginning and underinvest in as the initiative progresses. The commitment required includes investment in assessment tool selection and validation, ensuring that the specific instruments used have evidence of validity for the leadership dimensions they are intended to measure; investment in assessor training, ensuring that people conducting behavioral interviews, rating simulation exercises, and interpreting multi-source feedback have the training required to produce the validity those methods can provide; and investment in the development planning and follow-through infrastructure that converts assessment findings into behavioral change.
The data governance requirements of leadership assessment data are a second commitment dimension that organizations frequently underestimate. Assessment data describing specific leaders' behavioral patterns, character dimensions, and developmental needs is among the most sensitive personal data an organization holds, and its governance, including who has access, for what purposes, with what safeguards, and for how long, requires explicit organizational policy that most organizations have not developed with sufficient specificity. Organizations with inadequate assessment data governance produce assessment programs whose use erodes trust in the assessment system itself.
Senior leadership commitment to participating in assessment processes as leaders themselves, rather than as the sponsors of assessment for other organizational levels, is the single most powerful signal of organizational seriousness about diagnostic assessment for development. Senior leaders who are visibly assessed, who share their assessment findings with their teams as modeling of developmental transparency, and who invest demonstrably in addressing their own identified development areas create the organizational culture of developmental accountability that makes assessment programs produce genuine behavioral change rather than compliance with an organizational process.
The most successful diagnostic assessment programs are designed from the beginning as developmental infrastructure rather than as administrative processes, used primarily to guide development investment rather than to make administrative distinctions between organizational members, and sustained over multiple years with consistent methodology rather than redesigned every time new senior leadership arrives with different assessment preferences. The cumulative organizational learning about leadership development effectiveness that sustained, consistent assessment programs produce is among the most valuable and least frequently captured forms of organizational knowledge.