In contemporary organizational environments, the application of evidence-based management (EBM) continues to gain momentum as a pivotal framework for enhancing decision-making processes. Despite its growing adoption, scholarly investigations into how decision makers utilize various sources of evidence remain limited, presenting a crucial gap in organizational research. Addressing this research void, a collaborative study undertaken by researchers at Carnegie Mellon University alongside academics from the University of Malta has introduced and validated a novel evaluative instrument: the Evidence-Based Management Source Utilization Scale (EBM-SUS). This scale is meticulously designed to capture and quantify the extent to which organizational leaders employ four fundamental sources of evidence in their decision making.
The significance of this development is articulated in a recently published article appearing in the International Journal of Organizational Analysis. The research team—comprising experts such as Denise M. Rousseau, Frank Bezzina, and Vincent Cassar—recognized the complexity in measuring evidence use within managerial contexts. Until now, assessments of evidence-based management have disproportionately emphasized clinical evidence paradigms, often rooted in healthcare settings, thereby lacking applicability in a broader organizational management spectrum. The EBM-SUS aims to redress this limitation by focusing explicitly on the four core sources of evidence that inform managerial choices: scientific research, organizational data, professional expertise, and stakeholder influence.
Scientifically, the integration of these four knowledge domains encapsulates a sophisticated model of decision science that transcends traditional single-source reliance. Scientific research contributes empirical rigor and theoretical grounding; organizational data offers contextualized, real-time insights; professional expertise provides tacit knowledge and situational acumen; and stakeholder influence ensures that ethical, social, and political dimensions are accounted for in decisions. By evaluating the degree to which managers draw upon each domain, the EBM-SUS facilitates granular understanding of evidence incorporation, potentially enhancing accountability and transparency within organizations.
Methodologically, the validation of the EBM-SUS involved two primary empirical studies carried out with senior officials from Malta’s public sector, including director generals, permanent secretaries, and managerial personnel responsible for policy formulation, resource allocation, and operational governance. The first study employed exploratory factor analysis, a statistical technique leveraged to identify underlying latent constructs within the proposed scale. This exploratory phase was crucial in ensuring that the EBM-SUS delineates distinct yet interrelated factors representing each evidence source.
Following this, the second study applied confirmatory factor analysis to rigorously test the scale’s measurement model integrity. Beyond verifying factor structure, this phase explored the relationship between EBM-SUS scores and behavioral tendencies such as risk aversion and conscientiousness in decision making. The findings indicated that the scale not only possesses strong psychometric properties—including reliability and construct validity—but also correlates meaningfully with relevant decision-making traits, underscoring its robustness and practical relevance.
The implications of these findings are multifold. By quantifying source-specific evidence use, organizations can target interventions to bolster decision-making quality, tailoring training or resource support to underutilized evidence domains. The scale also promotes managerial self-awareness and reflective practice, encouraging leaders to critically assess and balance their evidence inputs, potentially mitigating biases or overreliance on singular information streams. On a systemic level, EBM-SUS data could inform governance frameworks by embedding evidence use metrics into performance evaluations, steering organizations towards more evidence-informed cultures.
Despite its strengths, the study acknowledges several limitations inherent to the EBM-SUS and its deployment. Crucially, as a self-report tool, the scale is susceptible to social desirability bias, whereby respondents may overstate their engagement with evidence sources to align with normative expectations. Furthermore, while the scale assesses quantity or frequency of evidence use, it does not directly evaluate the quality, appropriateness, or effectiveness of the evidence applied, raising important questions for future research on how to integrate qualitative dimensions of evidence utilization.
Additionally, the exclusive focus on senior decision makers within Malta’s public sector circumscribes the generalizability of the findings. The cultural, institutional, and sectoral particularities inherent to this context may limit transferability to private organizations, multinational entities, or other national settings. Subsequent studies are necessary to replicate and extend the validation of the EBM-SUS across diverse environments, ensuring its adaptability and cross-cultural validity.
The development of the EBM-SUS stands as a landmark contribution to the science of management, providing a validated, nuanced instrument capable of advancing both scholarly understanding and practical application of evidence-based management. As organizations strive to navigate an increasingly complex landscape characterized by rapid information flow and stakeholder demands, tools like EBM-SUS offer a pathway to embedding rigor and transparency in decision making. The study’s authors underscore that enhancing managers’ deliberate engagement with multiple evidence sources is essential for achieving alignment between decision outcomes and organizational goals.
Moreover, the EBM-SUS opens new avenues for applied research aimed at linking evidence source utilization patterns with organizational performance metrics, risk management outcomes, and innovation capacity. Understanding these dynamics may empower organizations to cultivate evidence ecosystems that are resilient, adaptive, and ethically sound. Evidence-based management, as illuminated by this research, emerges not only as a methodological approach but as a strategic imperative in contemporary organizational leadership.
This pioneering work propels the discourse surrounding evidence use beyond theoretical postulations, equipping practitioners and scholars alike with an actionable instrument to measure and reinforce best practices. The scale embodies a comprehensive lens on the multifaceted nature of evidence, recognizing that none operates in isolation but rather interdependently shapes decision landscapes. The reliability and validity demonstrated affirm the scale’s potential to be integrated into managerial training programs, organizational audits, and academic investigations.
In essence, the creation and validation of the EBM-SUS represent a seminal stride towards operationalizing evidence-based management in real-world organizational contexts. By capturing nuanced variations in how leaders harness scientific data, organizational intelligence, expertise, and stakeholder voices, the scale offers a scaffold to enhance decision-making fidelity and governance efficacy. This work ultimately contributes to fostering organizational environments where empirical inquiry, professional judgment, and participatory considerations coalesce to inform judicious, accountable management.
Subject of Research: Development and validation of a measurement scale for evidence-based management practices focusing on four core sources of evidence.
Article Title: Evidence-based management in practice: measuring the use of four core sources of evidence
News Publication Date: 27-Mar-2026
Web References: http://dx.doi.org/10.1108/IJOA-11-2025-6185
Keywords: Evidence-based management, decision making, organizational behavior, measurement scale, evidence utilization, organizational data, scientific research, professional expertise, stakeholder influence, psychometric validation, organizational leadership, public sector management
