AI tools are proliferating in the educational landscape, presenting both astonishing potential and notable concerns. The rapid development of various AI learning technologies has outpaced the educational research community’s ability to systematically assess their effectiveness. Consequently, there is an urgent need for an organized framework that not only allows for quick evaluation but also emphasizes ethical considerations when implementing these technologies in classrooms. The TOPSAIL project aims to bridge this gap by fostering a collaborative environment among researchers, educators, and tech innovators, thereby accelerating the evaluation of new AI tools that claim to enhance student learning.

The two-year project, guided by Principal Investigator Benjamin A. Motz from Indiana University’s College of Arts and Sciences’ Department of Psychological and Brain Sciences, marks a groundbreaking endeavor in establishing shared research infrastructure dedicated to the evaluation of AI tools. In essence, MOTZ and his team envision a future where educational institutions can adopt AI technologies based on solid empirical evidence rather than anecdotal reports or marketing claims. This new paradigm seeks to anchor the adoption of AI in education within the framework of rigorous psychological science and the principles of learning theory.

A key feature of this testbed is its function as a living laboratory, as described by Motz. The TOPSAIL initiative will host rigorous and replicable research directly within active learning environments. This approach ensures that research findings are not only theoretical but also practical and applicable in real-world educational settings. Additionally, the project aims to include necessary guardrails to protect the rights of end users, particularly students, and their families, ensuring that privacy remains a priority.

From a technical standpoint, TOPSAIL will be integrated within Canvas, Instructure’s popular learning management system that serves millions of students across various educational institutions. By leveraging Terracotta, an experimental research plugin designed for Canvas that adheres to ethical research practices, this project will create an ideal platform for real-time evaluations and assessments of AI innovations in diverse educational contexts. The testbed will incorporate robust privacy protections alongside experimental controls to safeguard student data and promote ethical research methodologies.

Dr. Mary Styers, Co-Principal Investigator and Director of Research for LearnPlatform by Instructure, emphasizes the critical nature of this project amid the rapid technological advancements in learning tools. The importance of creating evidence-based supports for educators and students cannot be overstated. As Styers notes, the project will establish the necessary guardrails to ensure student safety and privacy are paramount while also paving the way for meaningful research outcomes that should inform educational practices.

The collaborative nature of the TOPSAIL project illustrates the combined expertise of Indiana University and Instructure, integrating their knowledge in the science of learning and the infrastructure necessary for solid research methodologies. This synergy provides an exciting opportunity for continuous improvement in evaluation methods that will ultimately benefit educators and learners alike. The project’s team of experts spans various fields, including educational technology, artificial intelligence, and cyberinfrastructure, ensuring a holistic approach to the challenges posed by AI integration in education.

Importantly, the TOPSAIL team has proactively established partnerships with three K-12 school districts, acknowledging that the design of an effective testbed must be rooted in a deep understanding of local educational landscapes. Through active engagement with educators, the project will facilitate on-site focus groups and collaborative workshops, designed to co-create design requirements that adequately address pressing concerns around AI safety, privacy, and practical implementation in classrooms across the nation.

Dr. Matthew Callison, Director of Innovation and Strategic Partnerships for the South Fayette Township School District in Pennsylvania and a key player in the collaboration, voiced his enthusiasm about the potential impact of TOPSAIL. The project’s framework is tailored to ensure that educational districts can collaborate closely with researchers and technology companies. This partnership aims to create a systematic approach to pilot AI tools responsibly, while simultaneously gathering significant data that can inform future scaling decisions. Callison’s comments underscore a pivotal desire in the educational community for research that directly influences best practices while adhering to the rigorous standards that students and families expect.

In previous fields such as cybersecurity and autonomous vehicles, testbeds have played an essential role in providing controlled environments for piloting innovations prior to their widespread deployment. TOPSAIL aspires to translate this proven methodology into educational research for the first time, creating an infrastructure that not only promotes responsible pilot evaluations within actual classrooms but also does so calmly and rigorously. Through active engagement with community stakeholders, the resulting protocols developed from the project’s insights will guide the full-scale implementation of the testbed.

The scope of the TOPSAIL initiative extends far beyond merely assessing the efficacy of AI tools. By establishing the technical and ethical frameworks necessary for its implementation, the project seeks to open avenues for extensive research opportunities constrained by rigorous guidelines surrounding student privacy and safety. This holistic perspective aims to ensure that AI technologies serve their intended educational purposes while protecting vulnerable populations, especially in K-12 environments.

Motz is enthused about the transformative potential of TOPSAIL, asserting that it will fundamentally alter how educational institutions approach innovations in learning technologies. By providing a structured platform for comprehensive testing, we stand at a pivotal moment when the discourse surrounding AI-enabled learning tools shifts from theoretical speculations to pragmatic evaluations. The project will empower educators to make informed decisions based on empirical data, encouraging an environment where technology complements educational experiences rather than complicates them.

In summary, the TOPSAIL testbed stands as a remarkable model for future research infrastructure that can showcase the power of collaboration between academic institutions and industry partners. As the testbed becomes established, it promises to demonstrate how innovative solutions can effectively address some of the most complex societal challenges facing the education sector today. The initiative is not only focused on advancing the field of educational technology but also ensuring that the rights and safety of students remain paramount throughout this transformative journey.

TOPSAIL is proudly led by Indiana University in collaboration with its partners at Instructure, Arizona State University, and three K-12 school district partners.

Subject of Research: AI in Education
Article Title: Indiana University and Instructure Team Up for AI Educational Testbed
News Publication Date: October 2023
Web References: [Not available]
References: [Not available]
Image Credits: [Not available]

Keywords

AI, education, research infrastructure, testbed, ethical practices

Dr. MacNutt’s recent paper, titled “Reflective Writing Assignments in the Era of GenAI: Student Behavior and Attitudes Suggest Utility, Not Futility,” was published in the esteemed journal Advances in Physiology Education. The study spans nearly 400 participants enrolled in three different health and exercise science courses, all of whom were surveyed anonymously about their use of AI tools during at least five reflective writing assignments. Each course operated under a unified AI policy allowing students the option to incorporate GenAI in their work, offering a controlled backdrop to better understand how students interact with these emergent technologies.

As GenAI tools such as ChatGPT represent the cutting edge of natural language processing, enabling users to communicate with complex language models that can generate human-like text responses, their impact on educational practices continues to be a topic of intense debate. Dr. MacNutt explains that while these tools hold incredible promise for enriching student learning experiences, they also present potential risks if exploited to bypass genuine intellectual engagement. Hence, the concern among educators and institutions revolves largely around maintaining academic integrity while embracing technological innovation.

The findings from this UBCO study are particularly illuminating in this regard. Approximately one-third of the surveyed students reported actively using GenAI tools, but the motivations driving this usage defy the simplistic narrative of cheating or laziness. Over 80% of those who used AI cited reasons that span from expediting task completion to fostering deeper learning, and striving for high academic achievement. This nuanced perspective suggests that students perceive AI as a means to support their educational goals rather than circumvent them.

More specifically, the data reveals that the predominant use of AI was to initiate the composition process or to assist in revising and polishing sections of their assignments. It is crucial to highlight that only a minuscule 0.3% of assignments were predominantly authored by AI, indicating that most students maintain active authorship and critical engagement with their work. This challenges the often alarmist view that AI tools are being employed to produce entire pieces of academic writing with minimal human involvement.

An intriguing aspect that emerges from this research is the ethical dimension underlying student behavior toward AI tools. Participants conveyed that their usage choices were guided by a personal sense of ethical responsibility and a genuine desire to leverage AI in ways that scaffold learning rather than undermine it. This finding disrupts common assumptions that undergraduate learners prioritize grades above learning, instead painting a picture of a conscientious and discerning student body adapting to new educational technologies.

The study also underscores complexities relating to equity and access. Dr. MacNutt notes that paid versions of GenAI platforms may offer superior functionality, potentially giving an unfair advantage to students who can afford these subscriptions. This raises important questions about digital divides and the creation of new forms of educational inequality that mirror broader societal disparities. Ensuring equitable access to AI resources remains a pressing challenge for institutions aiming to incorporate these tools fairly.

Moreover, GenAI’s utility for students with diverse needs cannot be overstated. Individuals learning English as an additional language or those with reading and writing disabilities stand to benefit significantly from AI-assisted writing support. Such applications highlight the potential for AI to enhance inclusivity and personalized learning within higher education, provided ethical frameworks and support structures accompany technological adoption.

The implications of this study are far-reaching for educators and policy makers tasked with navigating the evolving landscape of technology-enhanced learning. Dr. MacNutt advocates for policies that emphasize collaboration between students and AI rather than surveillance or punitive measures. This approach calls for fostering digital literacy and ethical AI use, enabling learners to harness these tools responsibly and strategically within their academic journeys.

As AI technology continues to advance with rapid innovation cycles, ongoing research will be critical to monitor changing student behaviors, attitudes, and outcomes. The UBCO study offers a foundational understanding but also serves as a call to action for universities worldwide to develop responsive educational frameworks that integrate GenAI effectively while safeguarding academic integrity.

Ultimately, this research reorients the conversation away from alarmism and toward a balanced recognition of both the opportunities and challenges that generative AI brings to education. By appreciating students’ nuanced engagement with AI and addressing concerns of equity and ethics head-on, academic communities can better prepare for a future where human and artificial intelligence collaborate to enrich learning at every level.

The insights from Dr. MacNutt and her team not only dispel fears around GenAI misuse but also invite educators to reconsider how they design assignments, evaluate learning outcomes, and support diverse learners in an AI-augmented academic ecosystem. This study offers a hopeful vision that aligns technological progress with educational values, fostering an environment where AI serves as an enabler rather than a disruptor of student success.

Subject of Research: People

Article Title: Reflective writing assignments in the era of GenAI: student behavior and attitudes suggest utility, not futility

News Publication Date: 5-May-2025

Web References:
Advances in Physiology Education Article
DOI Link

References:
MacNutt, M., & Stranges, T. (2025). Reflective writing assignments in the era of GenAI: student behavior and attitudes suggest utility, not futility. Advances in Physiology Education, DOI:10.1152/advan.00241.2024.

Keywords: Education, Education policy, Education technology, Educational assessment, Educational attainment, Educational methods, Learning