ELL
Evans Learning Labs
Diagnostic Toolkit
Evans Learning Labs

Research and Methodology

How these tools were designed, what they are built on, and why the approach produces more useful results than conventional self-assessment instruments.

Contents
Section 1

Philosophy

Most self-assessment instruments produce results that feel meaningful but are not particularly useful. They tell you something you roughly already knew, confirm a self-image you had before you started, and leave you without a clear sense of what to actually do differently. This is not an accident. It is the predictable outcome of design choices that prioritize simplicity and completion rates over diagnostic value.

The three most common failure modes are vague response options, generic output, and the absence of any mechanism for honest self-confrontation.

Vague response options produce vague data. When a scale asks "How effective is your communication?" and offers options from "Not effective" to "Very effective," the instrument is measuring self-perception at its most general. The response reflects how good someone feels about their communication in the abstract, which is almost entirely disconnected from the specific behaviors that determine whether their communication actually works. Two people who both select "Effective" may communicate in entirely different ways, with entirely different results.

Generic output produces generic guidance. When results tell you that communication is a development area and recommend that you "seek feedback" or "practice active listening," the output has failed the most basic test of a diagnostic tool. A diagnosis that does not point to a specific cause and a specific intervention is not a diagnosis. It is a reminder that the thing you scored low on matters.

Without honest self-confrontation, self-report data is aspirational. People completing assessments tend to report the leader, teammate, or organization they intend to be rather than the one they actually are. Instruments that do not build in a mechanism for catching this produce inflated and unreliable scores. The gap between self-perception and actual behavior is often the most important finding available, and most instruments never surface it.

The Evans Learning Labs toolkit is built on a different premise: that a diagnostic tool earns its value by confronting the respondent with something specific and honest, pointing clearly to what is causing the gap, and giving them something concrete to do about it. Anything less is structured self-reflection at best.

Section 2

Assessment Design Principles

Each tool in the Evans Learning Labs suite reflects a consistent set of methodological choices. These choices are deliberate and interconnected. Understanding them clarifies both what the tools can tell you and why the approach produces more actionable results than conventional instruments.

1
Behavioral description over numerical rating
Every response option is a behavioral description, not a number on a scale. Rather than asking a respondent to rate themselves from 1 to 5 on a dimension, each option describes a specific, observable pattern of behavior at a distinct level of effectiveness. The respondent selects the description that most accurately reflects their consistent pattern, not their best moments or their intentions.

The difference between these approaches is not cosmetic. It is the difference between asking how someone feels about a behavior and asking them to identify which behavior actually describes them.

Conventional rating scale
"How effectively do you hold your team accountable for commitments?"

1 (Not at all) to 5 (Extremely effectively)
Measures self-image. Easy to answer optimistically. Produces no diagnostic information.
Behavioral description
"Accountability is rarely enforced on this team. Missed commitments are explained or ignored rather than addressed, and patterns of underdelivery have become normalized."

vs.

"Commitments on this team are clear, tracked, and consistently followed up. When something is missed, the gap is addressed directly without blame, and the pattern changes as a result."
Requires the respondent to recognize their actual pattern. Much harder to answer aspirationally.
2
Five-level calibration
Each response set contains five descriptions calibrated to represent meaningfully distinct levels of effectiveness. The five levels are designed so that the difference between adjacent options is large enough to be practically significant, not just statistically distinguishable. This produces scores with real interpretive weight, where a 2.1 and a 3.8 represent genuinely different states, not minor variations on the same theme.
3
Dimensional scoring
Each tool evaluates five distinct domains, scored independently and aggregated to an overall score. Domain-level scoring matters because overall scores can obscure important patterns. A leader with a 4.2 in self-awareness and a 1.8 in accountability has a meaningfully different development need than one who scores 3.0 across all five domains. Dimensional scoring makes those distinctions visible and actionable.
4
Perception versus reality
Before completing any assessment, the respondent predicts their own scores. After completing the assessment, they see a direct comparison between their predictions and their actual results. The gap between predicted and actual scores is often the most diagnostically valuable output of the entire exercise. Consistent over-prediction in a domain is a signal of a blind spot. Consistent under-prediction is a signal of excessive self-criticism or high standards. Both patterns carry meaning that a score alone cannot surface.
5
Actionable interpretation
Results are organized around priority development areas, not comprehensive coverage of all domains. The tool identifies the two domains most in need of attention and provides specific, behavioral recommendations for each. Recommendations are not generic best practice; they are calibrated to the score and describe what someone at that level can realistically do next. The goal is a result that changes what the respondent does on Monday morning, not one that confirms what they already believed about themselves.
6
Progress measurement built in
Every assessment is saved and retrievable. When a respondent retakes a tool after a period of development work, the platform automatically surfaces a side-by-side comparison of their first and current attempt at both the overall and domain level. This longitudinal view transforms the tool from a one-time snapshot into a development tracking instrument, and gives respondents direct evidence of what has changed and what has not.
7
Answer choice randomization
The five answer choices for each question are presented in a randomized sequence. The scores assigned to each choice are fixed and do not change, but the position of the highest and lowest descriptors shifts with each attempt. This design reduces the effect of positional response bias, which occurs when respondents form habitual patterns based on where high or low options reliably appear rather than reading each option on its merits. Randomization keeps the respondent actively engaged with the content of each choice.
8
Item banking for retake integrity
Each question in the assessment draws from a bank of multiple answer phrasings, all calibrated to the same behavioral level and point value, but written with different language and framing. Every time the respondent accesses a tool, one phrasing is randomly selected per point value per question. Respondents who retake a tool after development work are therefore unlikely to encounter the same exact phrasing they saw on their first attempt, which prevents memorization from inflating retake scores and ensures that score improvements reflect genuine behavioral change rather than familiarity with specific answer choices.
How answer choice randomization works in practice

The scoring architecture is unaffected by randomization. Each answer choice carries a fixed point value between 1 and 5 based on the behavioral level it describes. When a respondent selects an option, the system records the point value, not the position. The randomization only governs which of the five options appears first, second, third, and so on - not which option carries which score.

The practical effect is that a respondent who scored 2.4 on their first attempt and genuinely developed their capability before retaking the assessment will be selecting from a different positional arrangement each time. If their score improves, it is because they chose higher-scoring descriptions of behavior - not because they remembered which position the 5-point option occupied.

What item banking is and why it matters for longitudinal assessment

An item bank is a collection of multiple, interchangeable answer phrasings for the same behavioral anchor. All phrasings in the bank for a given point value describe the same level of behavior; they differ only in how that behavior is expressed in language. A bank for the score-3 position on an accountability question might include three separate descriptions that each characterize the same partially effective pattern, worded differently enough that a second encounter with any one of them does not trigger immediate recognition from a prior attempt.

The core problem item banking addresses is learning-based score inflation on retakes. When a respondent sees the same exact answer choices a second time, they can select the option they know produces the highest score rather than the one that genuinely describes them. This is not dishonesty in the ordinary sense; it is a natural response to familiarity. The score improves, but the behavior has not. Item banking closes this gap by ensuring that even a highly motivated respondent cannot improve their score simply by memorizing the previous answers.

For ELL's longitudinal tracking model, this matters significantly. The platform is designed so that respondents retake tools over extended periods as evidence of development. If retake scores could be inflated through familiarity with the answer choices, the longitudinal comparison would lose most of its diagnostic value. Item banking preserves the signal in that comparison by tying score changes to behavioral recognition rather than answer recall.

The item bank for each question is not static. Additional phrasings can be added to the bank without changing the scoring or the structure of the tool. As the platform matures, banks will be expanded based on what is learned about how different respondent populations interpret and relate to different formulations of the same behavioral level.

Section 3

Theoretical Foundations

The frameworks underlying each tool draw on established bodies of research across several disciplines. These foundations inform the domain structure, the behavioral anchors, and the interpretive logic of the instruments.

Leadership development
Research on leadership effectiveness, character-based leadership, capability development, and the behavioral correlates of leadership outcomes informs the individual leadership tools.
Organizational behavior
The organizational diagnostic tools draw on OB research covering culture, alignment, execution, decision-making, and the structural and social conditions that drive or limit organizational performance.
Team dynamics and psychological safety
The team tools reflect research on team effectiveness, interpersonal trust, psychological safety, and the behavioral conditions that enable or prevent collective performance. Amy Edmondson's foundational work on psychological safety is a direct influence on the Psychological Safety Index.
Applied psychology
Self-awareness, emotional regulation, resilience, and cognitive pattern recognition are grounded in research from applied and positive psychology, as well as behavioral science literature on how self-perception and actual behavior diverge.
Management science
Tools covering strategic thinking, execution, decision quality, and organizational alignment draw on management research on how organizations translate strategy into results and where that translation typically breaks down.
Virtuous organization frameworks
The Virtuous Leadership Profile and Virtuous Organization Index are grounded in frameworks of character-based and values-aligned leadership, drawing on both classical virtue ethics and their contemporary application to organizational contexts.

An important clarification: The Evans Learning Labs instruments have not undergone formal psychometric validation studies. The tools are designed as structured reflection and developmental diagnostic instruments, not as clinical, certified, or psychometrically validated assessment instruments. They are theoretically grounded and methodologically deliberate, but should be understood and used accordingly.

Section 4

Intended Use

Clarity about what these tools are for, and what they are not, is as important as understanding how they work. Using any instrument beyond its design intent reduces its value and can produce misleading results.

Designed for
  • Individual leadership reflection and development planning
  • Pre-coaching or pre-development baseline assessment
  • Team diagnostic and discussion facilitation
  • Organizational performance gap identification
  • Academic and educational application in leadership and management courses
  • Pre- and post-intervention progress measurement
  • Executive development programs and leadership cohorts
  • Self-directed professional development
Not designed for
  • Clinical psychological evaluation or diagnosis
  • Employment screening or hiring decisions
  • Performance management or disciplinary processes
  • Medical or therapeutic assessment
  • Certified psychological profiling
  • High-stakes personnel decisions used in isolation
  • Legal or compliance evaluation

When used for their intended purposes, these tools function as structured mirrors. They help individuals, teams, and organizations see their current state more clearly than unaided reflection typically allows, identify the specific gaps that most limit performance, and build a more targeted development plan than generic frameworks can support.

The value of any self-report instrument is bounded by the honesty of the respondent. These tools are designed to make honest answering easier and aspirational answering harder, but they cannot eliminate the effect of motivated self-presentation. Users who engage with genuine honesty and a genuine interest in growth get the most out of them.

Section 5

Continuing Development

Evans Learning Labs is an active and evolving platform. The platform is designed from the ground up to support this trajectory, and users benefit from being part of the foundational knowledge and data on which those capabilities are built.

Tools listed as coming soon are in active development and reflect the same methodological standards as the existing suite. Additional tools addressing adjacent domains are in early scoping.

The item banking system described in Section 2 is designed to grow over time. Each question's bank will be expanded as additional phrasings are developed and validated, increasing the variety available to repeat users and reducing the ceiling on the number of meaningful retakes the platform can support before familiarity becomes a factor.

Feedback from users, particularly from educators and organizational practitioners who use the tools with cohorts, directly informs development priorities. If you have observations about the tools' performance in applied settings, Evans Learning Labs welcomes that input.

More in the Research section
Welcome back
Sign in to access your assessments
No account?
Terms of Use and Disclaimer

Informational and Educational Use Only

The diagnostic tools, assessments, profiles, and indexes offered by Evans Learning Labs are designed for informational and educational purposes only. Results do not constitute professional consulting advice, legal advice, psychological assessment, clinical evaluation, or any form of certified professional guidance.

Self-Reported Results

All results are based entirely on the responses provided by the individual completing the assessment. Evans Learning Labs makes no representation that scores or profiles accurately reflect objective organizational conditions or any other measurable external reality.

No Guarantee of Outcomes

Evans Learning Labs does not guarantee that use of these tools will produce any specific organizational, leadership, or performance outcome. Recommendations are general in nature and may not be appropriate for every individual, team, or organizational context.

Limitation of Liability

To the fullest extent permitted by applicable law, Evans Learning Labs, its principals, employees, and affiliates shall not be liable for any direct, indirect, incidental, consequential, or punitive damages arising from the use of or reliance on these tools or their results.

Governing Law

These terms are governed by the laws of the United States and Commonwealth of Kentucky.