US organizations spent about $101.8 billion on employee training in 2023 (Training, 2023), and a large share of training budgets goes to leadership development (Lacerenza et al., 2017). Yet when pressed to demonstrate what that investment produced, most struggle to point to anything more concrete than participant satisfaction surveys and anecdotal feedback. The problem is rarely the training itself. It is the absence of a measurement framework that connects development activities to observable behavioral change and, ultimately, to business outcomes.

A meta-analysis of 335 leadership training studies found that programs work better when they start from a needs analysis, include feedback, and use practice and spaced sessions (Lacerenza et al., 2017). Yet many organizations continue running programs that lack even basic pre- and post-measurement. This is especially true of small and mid-sized businesses, where budgets are tight and every dollar needs to work. The result is a cycle of investment without evidence. Programs get funded because leadership development "feels important," but they are also the first line item cut when budgets tighten, precisely because no one can demonstrate their value.

The following five warning signs indicate that a leadership development program is operating without the assessment infrastructure it needs. Recognizing these signs is the first step toward transforming leadership development from a discretionary expense into a measurable business investment.

Sign 1: There Is No Baseline — You Cannot Measure What You Did Not Define

The most fundamental warning sign is also the most common: the program launched without establishing a baseline measurement of where participants stood before development began. Without a starting point, there is no way to quantify growth, identify areas that improved, or determine which participants benefited most. It is the equivalent of starting a fitness program without stepping on a scale or recording a single benchmark. Three months later, you might feel better, but you have no evidence of progress.

A robust baseline involves more than a self-assessment questionnaire. Multi-rater feedback instruments such as 360-degree assessments provide a far more accurate picture because they capture how leaders are perceived by the people they actually lead. Self-ratings tend to run higher than other people's ratings and agree with them only modestly (Harris & Schaubroeck, 1988). Atwater and Yammarino (1992) found that how closely leaders' self-ratings matched others' ratings changed how well leadership could be predicted, and leaders who rated themselves higher than others did tended to fare worse. A 360-degree assessment administered before development begins establishes not just where a leader is, but where the most significant perception gaps exist. That information should drive the development plan.

Baseline data also protects the organization's investment. When a company commits, say, $50,000 to a leadership development initiative (an illustrative figure for a mid-sized business running a cohort through a year-long program), stakeholders deserve evidence that the money produced measurable change. Pre-assessment data makes that evidence possible; without it, the organization is left relying on hope and good intentions.

Sign 2: The Content Is Generic — Everyone Gets the Same Program Regardless of Need

A second warning sign is the one-size-fits-all curriculum. Every participant attends the same workshops, reads the same case studies, and completes the same exercises, regardless of whether their primary development need is delegation, communication, strategic thinking, or managing conflict. This approach assumes all leaders need the same things. Decades of research show that people differ in traits that matter for work and leadership (Barrick & Mount, 1991; Judge et al., 2002), so their development needs differ too.

Assessment data enables targeted development. When personality assessments reveal that a leader scores high on conscientiousness but low on openness to experience, the development conversation shifts from a generic "become a better leader" to a specific "build comfort with ambiguity and experimentation." When 360-degree feedback shows that direct reports rate a leader low on employee involvement but high on task direction, the program can focus precisely on the behaviors that will close that gap. The Achieving Leader 360 (AL360), for example, covers 19 leadership factors across six domains, from Communication & Relations to Empowerment & Delegation to Adaptive Leadership, giving leaders and coaches a starting point for individual development plans rather than generic curricula.

A meta-analysis by Smither, London, and Reilly (2005) found that average gains after 360-degree feedback are small, and larger when the feedback shows a clear need to change and leaders set goals and act on them. Generic programs bypass these steps. They deliver broad content, set vague objectives, and rarely connect individual assessment results to the learning agenda.

For small and mid-sized businesses, the cost of a generic approach is particularly steep. These organizations cannot afford to send ten leaders through an identical program when only three of them need the content being delivered. Assessment data ensures that every development dollar targets an actual need.

Sign 3: There Is No Structured Follow-Up — The Program Ends When the Workshop Ends

The third warning sign is the absence of follow-up. The workshops conclude, the binders go on shelves, and no one circles back to measure whether behavior actually changed. Research on the transfer of training, the degree to which learned skills are applied on the job, shows that what happens back at work, such as manager support and chances to practice, strongly shapes whether training gets used (Baldwin & Ford, 1988). In one survey of 150 organizations, training professionals estimated that 62% of employees apply what they learned right after training, falling to 34% a year later (Saks & Belcourt, 2006).

Post-assessment data is what closes this loop. Administering the same 360-degree assessment six to twelve months after a development program provides objective evidence of behavioral change, or the lack thereof. It answers questions that satisfaction surveys cannot: Did direct reports notice a difference? Did the leader's self-awareness improve? Did specific targeted behaviors actually shift? The goal is not a punitive accountability system; it is a learning system. When leaders see their post-assessment data alongside their baseline, the feedback becomes deeply personal and motivating in a way that no workshop evaluation form can replicate.

Follow-up assessment also enables the organization to refine its approach. If a program consistently produces improvement in communication behaviors but not in delegation, that pattern reveals a gap in the curriculum or the coaching support structure. Without post-data, the organization keeps running the same program year after year with no mechanism for improvement.

Sign 4: ROI Is Measured by Anecdote — "People Seemed to Like It"

When asked about the return on a leadership development investment, many organizations default to anecdotal evidence: "The participants said it was valuable." "Our CEO noticed that the leadership team is communicating better." "We haven't had any turnover in that group since the program." While these observations are not meaningless, they do not constitute evidence of program effectiveness, and they are deeply vulnerable to confirmation bias and recency effects.

Kirkpatrick's (1994) four-level evaluation model (Reaction, Learning, Behavior, and Results) remains the standard framework for evaluating training programs. Many leadership development programs measure only Level 1, Reaction: Did participants enjoy it? Assessment data enables measurement at Level 3, Behavior: Did participants actually change how they lead? Behavior is the level that matters most for organizational impact, and it is the level that requires measurement instruments beyond post-workshop smile sheets.

Consider the difference between these two illustrative statements to a board or ownership group: "Participants rated the program 4.7 out of 5" versus "At the twelve-month follow-up, direct reports' 360 feedback showed clear movement on delegation and on inviting input, the two areas we targeted." The first statement describes satisfaction. The second describes behavior change. For organizations investing meaningful resources in leadership development, the distinction is the difference between a cost center and a strategic investment.

360 feedback alone produces small average gains; gains are larger when it is paired with goal setting, coaching and follow-up (Smither et al., 2005). Assessment data provides the measurement architecture that makes this possible.

Sign 5: Development Decisions Are Based on Assumptions, Not Data

The fifth warning sign is perhaps the most insidious: the organization selects who participates in leadership development and what they work on based on assumptions, politics, or seniority rather than data. The most vocal leader gets the executive coaching engagement. The longest-tenured manager gets sent to the prestigious program. The owner's assessment of who "has potential" drives the entire talent investment strategy, without any objective measurement to validate or challenge those assumptions.

Silzer and Church (2009) note that organizations rarely agree on what "potential" means, which leaves room for unstructured judgment, and unstructured judgment is open to familiar biases such as favoring people like ourselves. Assessment data provides an objective counterweight that informs judgment rather than replacing it. Personality assessments reveal dispositional strengths and risk factors. Values assessments surface alignment or misalignment with organizational culture. Cognitive ability assessments predict capacity for complex problem-solving. And 360-degree assessments reveal the gap between reputation and self-perception, which is often the most critical data point for development planning.

When organizations combine multiple assessment dimensions (behavioral style, personality, values, cognitive ability, and multi-rater feedback), they build a comprehensive picture of each leader that is far more reliable and actionable than any single data point or subjective impression. FactorFactory's AL360 assessment, grounded in Self-Determination Theory (Deci & Ryan, 2000), psychological safety research (Edmondson, 1999), and adaptive leadership frameworks (Heifetz et al., 2009), gives leaders structured feedback on six areas of leadership, each grounded in established research.

From Practice

This composite draws on several client engagements. A software development firm with about 60 employees had been promoting its best individual contributors into management roles, a common pattern in growing companies where technical expertise is abundant but management infrastructure is thin. The company invested in external training for these new managers: workshops on communication, time management, and team leadership from a well-regarded regional provider. The content was solid. The facilitators were engaging. End-of-session evaluations were consistently positive.

Yet eighteen months into this approach, the company was experiencing higher turnover among front-line employees reporting to these newly promoted managers than it had seen in the previous five years. Exit interviews pointed to a recurring theme: employees did not feel heard, did not feel trusted with meaningful work, and described their managers as technically proficient but interpersonally disconnected. The workshops had not moved the needle because they treated all new managers identically, without diagnosing what each individual actually needed to develop.

FactorFactory was engaged to establish a baseline using the AL360 with the cohort of eight new managers. The results were illuminating. As a group, these managers did well on the Leadership Philosophy domain; they understood intellectually what good leadership looked like. But their direct reports rated them noticeably lower on Employee Involvement and on Empowerment & Delegation, the behavioral dimensions that employees experience day-to-day. Several managers showed a pattern common among former individual contributors: they understood delegation conceptually but continued to retain control of work because they were faster at it themselves or did not trust the output quality of their teams.

With this data in hand, the development program was restructured. Instead of generic workshops, each manager received an individualized development plan targeting their two lowest-rated AL360 domains. Coaching sessions focused specifically on the behaviors flagged in the 360 feedback. Nine months later, a follow-up 360 showed clear progress: direct reports saw more delegation and more involvement, and front-line turnover in those managers' teams dropped below the company's historical average. The owner, who had been skeptical about the value of "more assessments," acknowledged that for the first time, leadership development felt like something he could see working, because the data showed it was.

Turning Leadership Development into a Measurable Investment

The five warning signs outlined above share a common root cause: the absence of a measurement framework. Without assessment data, leadership development programs cannot establish baselines, personalize content, follow up on behavior change, demonstrate ROI, or make data-informed decisions about talent investment. The result is programs that may feel valuable in the moment but cannot demonstrate lasting impact, which makes them perpetually vulnerable to budget cuts and organizational skepticism.

The solution is not to abandon leadership development or to replace it with assessment alone. The solution is to embed assessment into the development process at every stage: baseline measurement before the program begins, data-driven personalization of content during the program, and post-assessment follow-up to measure and reinforce behavior change. This architecture transforms leadership development from an act of faith into an evidence-based business investment.

For organizations ready to build this measurement infrastructure, the Achieving Leader 360 (AL360) provides a comprehensive, research-grounded starting point, measuring 19 leadership factors across six domains that capture how leaders think, communicate, involve, motivate, delegate, and adapt. Combined with personality, behavioral, and values assessments, it creates the kind of multi-dimensional leadership profile that makes development targeted and trackable over time. If you need to win funding first, read Building the Business Case; to fit assessment into a program you already run, see Adding an Assessment Block to an Existing Leadership Curriculum. If you lead people yourself, the free Achieving Leader Scorecard gives you a five-minute first look at your own habits. To explore how assessment data can strengthen your leadership development strategy, visit FactorFactory's contact page to start a conversation.

Sources

Research cited in this article, with links to the published work where available.

  • Atwater, L. E., & Yammarino, F. J. (1992). Does self-other agreement on leadership perceptions moderate the validity of leadership and performance predictions? Personnel Psychology, 45(1), 141–164. https://doi.org/10.1111/j.1744-6570.1992.tb00848.x
  • Baldwin, T. T., & Ford, J. K. (1988). Transfer of training: A review and directions for future research. Personnel Psychology, 41(1), 63–105. https://doi.org/10.1111/j.1744-6570.1988.tb00632.x
  • Barrick, M. R., & Mount, M. K. (1991). The Big Five personality dimensions and job performance: A meta-analysis. Personnel Psychology, 44(1), 1–26. https://doi.org/10.1111/j.1744-6570.1991.tb00688.x
  • Deci, E. L., & Ryan, R. M. (2000). The "what" and "why" of goal pursuits: Human needs and the self-determination of behavior. Psychological Inquiry, 11(4), 227–268. https://doi.org/10.1207/S15327965PLI1104_01
  • Edmondson, A. (1999). Psychological safety and learning behavior in work teams. Administrative Science Quarterly, 44(2), 350–383. https://doi.org/10.2307/2666999
  • Harris, M. M., & Schaubroeck, J. (1988). A meta-analysis of self-supervisor, self-peer, and peer-supervisor ratings. Personnel Psychology, 41(1), 43–62. https://doi.org/10.1111/j.1744-6570.1988.tb00631.x
  • Heifetz, R. A., Grashow, A., & Linsky, M. (2009). The practice of adaptive leadership: Tools and tactics for changing your organization and the world. Harvard Business Press.
  • Judge, T. A., Bono, J. E., Ilies, R., & Gerhardt, M. W. (2002). Personality and leadership: A qualitative and quantitative review. Journal of Applied Psychology, 87(4), 765–780. https://doi.org/10.1037/0021-9010.87.4.765
  • Kirkpatrick, D. L. (1994). Evaluating training programs: The four levels. Berrett-Koehler.
  • Lacerenza, C. N., Reyes, D. L., Marlow, S. L., Joseph, D. L., & Salas, E. (2017). Leadership training design, delivery, and implementation: A meta-analysis. Journal of Applied Psychology, 102(12), 1686–1718. https://doi.org/10.1037/apl0000241
  • Saks, A. M., & Belcourt, M. (2006). An investigation of training activities and transfer of training in organizations. Human Resource Management, 45(4), 629–648. https://doi.org/10.1002/hrm.20135
  • Silzer, R., & Church, A. H. (2009). The pearls and perils of identifying potential. Industrial and Organizational Psychology, 2(4), 377–412. https://doi.org/10.1111/j.1754-9434.2009.01163.x
  • Smither, J. W., London, M., & Reilly, R. R. (2005). Does performance improve following multisource feedback? A theoretical model, meta-analysis, and review of empirical findings. Personnel Psychology, 58(1), 33–66. https://doi.org/10.1111/j.1744-6570.2005.514_1.x
  • Training. (2023). 2023 Training Industry Report. Training Magazine. https://trainingmag.com/2023-training-industry-report/

About the Author

Kent E. Frese, Ph.D. is the Founder of FactorFactory and an Industrial-Organizational Psychologist with over 20 years of experience bridging academic psychometrics and practical business application. He designs research-based leadership, personality, and behavioral assessments used by consultants, coaches, and HR teams to drive leadership development, improve hiring decisions, and build stronger teams. Dr. Frese is a member of SIOP (Society for Industrial-Organizational Psychology), an adjunct faculty member supervising doctoral research, and has delivered more than 19,000 assessments across diverse industries.