AI Grading on Campus: New Model Says Legitimacy, Not Capability, Decides Success

Artificial intelligence is quietly rewriting one of the most consequential rituals in higher education: assessment. Automated scoring engines grade essays in seconds, adaptive testing platforms recalibrate questions mid-exam, learning analytics dashboards flag struggling students before they fail, and generative AI tools now draft feedback comments that once consumed entire weekends of academic labour. A new conceptual study published in Discover Education argues that the real question facing universities is no longer whether these technologies will be adopted, but whether their adoption can be justified — educationally, ethically, professionally and institutionally — to the many stakeholders who must live with the consequences.

The study, authored by Joshua King Obeng-Nyarko of Essex Business School at the University of Essex, introduces what its author calls the AI-Assessment Ecosystem Model. Rather than treating AI in assessment as a discrete technical intervention to be evaluated on accuracy and efficiency, the framework reframes it as a sociotechnical and institutional arrangement whose legitimacy depends on the interaction of five interdependent domains: technological innovation, pedagogical alignment and learner needs, institutional strategy and governance, faculty and professional readiness, and ethical and inclusive implementation. The model’s central claim is deliberately provocative: a system can be technically brilliant and still fail, because legitimacy is not produced by any single element but by how the elements relate to one another.

To build the framework, Obeng-Nyarko conducted a conceptual synthesis rather than a systematic review, searching Scopus, Web of Science, ERIC, IEEE Xplore and Google Scholar for literature published primarily between 2019 and 2024, the period in which scholarship on AI in higher education assessment expanded dramatically. From an initial pool of 107 potentially relevant publications, 58 sources were retained for close analysis, selected according to interpretive criteria that included whether a source addressed AI or digital assessment in higher education, contributed to one of the emerging model’s domains, explained relationships or tensions between domains, or provided foundational theory in areas such as assessment validity, feedback, institutional legitimacy, organisational change, inclusive design or computer-supported collaborative learning. The result is a theory-building contribution intended to organise a fast-moving field, not an empirical validation of a single tool.

The fragmentation the model responds to is real and consequential. One strand of the literature celebrates technical capability: automated scoring, adaptive question sequencing, predictive analytics, multimodal analysis and explainable AI. A second strand foregrounds ethics and politics, warning that algorithmic systems embed bias, opacity, surveillance and data extraction into decisions that shape learners’ futures. A third examines pedagogy, asking whether automated feedback genuinely supports self-regulated learning or merely accelerates surface-level correction. A fourth addresses governance, procurement, quality assurance and organisational change. Each strand offers insight, but the study argues that when they are examined in isolation, AI adoption risks being driven by technical feasibility, institutional positioning or policy pressure rather than educational purpose.

Assessment is a uniquely high-stakes site for this tension. It is the mechanism through which institutions translate educational values into judgments about performance, progression and achievement. AI may bring speed, scale and responsiveness, but it can also intensify standardisation, obscure how judgments are made and displace human interpretation in ways that are difficult to defend on educational grounds. The study draws on assessment scholarship to stress that feedback only becomes educationally valuable when learners can interpret it, act on it and incorporate it into future work — a standard that apparent immediacy and personalisation from AI systems can easily mask. If students use an AI tool to polish text without ever understanding criteria or disciplinary standards, the technology may increase efficiency while quietly eroding assessment literacy.

The framework’s organising concept is legitimacy, theorised not as a property of a technology but as a relational and contested process of justification. Drawing on institutional theory, the study distinguishes pragmatic legitimacy, in which stakeholders see an arrangement as serving their interests; moral legitimacy, in which it is judged fair and aligned with educational values; and cognitive legitimacy, in which it becomes taken for granted as normal practice. The distinctions matter because they can pull in opposite directions. An AI feedback system may have pragmatic legitimacy for institutional leaders because it delivers timely feedback at scale, yet lack moral legitimacy among students if its judgments are opaque or inequitable. It may be normatively defensible to faculty who see formative value in it, yet culturally resisted where it conflicts with disciplinary expectations of human judgment. A system can even become cognitively normalised across a university while remaining ethically problematic — normalisation, the study warns, should never be mistaken for educational defensibility.

Each of the five domains carries its own technical and practical demands. Technological innovation is treated as enabling but insufficient: AI operates through data models, training assumptions and probabilistic outputs that may not align with the interpretive, context-sensitive nature of educational judgment, making explainability a condition of educational intelligibility rather than a mere engineering feature. Pedagogical alignment demands that AI use be evaluated against validity, formative value, student agency and disciplinary difference, since the standards governing fine arts, clinical education, laboratory science and the humanities are not reducible to a single model of performance. Institutional governance serves as the connective infrastructure linking innovation to accountability, covering procurement, data management, academic integrity policy and the conditions under which AI can be authorised, monitored, challenged and revised. The study also draws on organisational change literature to note that universities may adopt AI partly to secure legitimacy by conforming to sectoral expectations — a form of isomorphic pressure that can generate pragmatic approval while leaving moral and pedagogical questions unresolved.

The remaining two domains address people and principles. Faculty and professional readiness is described as the model’s interpretive core, because AI does not remove the need for expertise but reconfigures it: educators must now interpret automated outputs, evaluate the quality of AI-generated feedback, recognise overreliance, identify bias and decide when human judgment should take precedence. Recent AI literacy research suggests this requires identifiable competencies — understanding data, models, ethics and limitations — rather than generic digital confidence, meaning professional development must go beyond introductory workshops to support assessment redesign and routes for student dialogue. Ethical and inclusive implementation, meanwhile, is framed as constitutive rather than supplementary. Students differ in technology access, linguistic repertoire, disability status, neurodiversity and confidence in contesting institutional decisions, so AI-enabled assessment may redistribute advantage and disadvantage even when systems appear technically neutral. Inclusion, the study argues, must be built into design from the outset through accessible formats, transparent criteria, clear appeal routes and genuine opportunities for students to shape AI-mediated practices.

To illustrate the model in action, the paper offers a hypothetical case: a university introduces a generative AI tool providing draft feedback on written assignments in a large first-year module. Viewed through the technological domain alone, the system looks like a clear win — fast, adaptive, detailed. But the ecosystem lens surfaces harder questions. Does the feedback develop students’ evaluative judgment or merely polish prose? Do staff understand the system’s limits well enough to explain appropriate use and catch misleading advice? Who is accountable when the tool produces harmful or biased guidance, and is student work being used to train commercial models? Can multilingual and disabled students access the tool on equal terms, and can they contest its advice? The tool may enjoy pragmatic legitimacy for leaders burdened by feedback workloads and for students craving immediate support, yet still lack moral legitimacy if it weakens agency or obscures accountability.

The study is explicit about its limits: the model derives from conceptual synthesis rather than empirical testing, its domains reflect interpretive judgment, and its usefulness will depend on how well it travels across institutions, disciplines and regulatory environments. But its diagnostic ambition is clear. Misalignment between domains is not always a coordination failure to be engineered away; sometimes it reveals genuine conflicts of value — between efficiency and human judgment, standardisation and disciplinary diversity, innovation and accessibility. The framework’s purpose is not to resolve those tensions into consensus but to make them visible, to show whose interests proposed alignments serve, and to insist that AI-enabled assessment be justified through transparent, participatory and revisable institutional processes. As universities race to embed AI in grading and feedback, the message is stark: the technology that works is not necessarily the technology that can be defended.

Subject of Research: A conceptual ecosystem framework for evaluating artificial intelligence in higher education assessment across pedagogical, governance, professional and ethical domains

Article Title: Artificial intelligence in higher education assessment as an ecosystem of pedagogy governance and legitimacy

Article References: Artificial intelligence in higher education assessment as an ecosystem of pedagogy governance and legitimacy. (n.d.). https://doi.org/10.1007/s44217-026-02225-y

Image Credits: AI Generated

DOI: 10.1007/s44217-026-02225-y

Keywords: artificial intelligence, higher education, assessment, automated feedback, educational legitimacy, institutional governance, faculty readiness, inclusive assessment, learning analytics, generative AI, sociotechnical systems, academic integrity