Digital Tools Can Teach PhD Students to Reason, Not Just Search, Study Finds

A new study from Ukrainian researchers suggests that the difference between a doctoral student who merely uses digital tools and one who genuinely thinks through them may be the most important variable in modern PhD training. The research, published in Discover Education, followed 104 doctoral students at Sumy State Pedagogical University named after A. S. Makarenko and Kherson State University as they completed a course called Modern IT in Scientific Research. Rather than treating software such as ChatGPT, Elicit, ResearchRabbit, and Zotero as convenient shortcuts, the course deliberately embedded these services into methodological tasks, and the results hint at something deeper than technical skill: a measurable shift in how students formulate problems, justify their methods, and interrogate their own evidence.

The research team, led by Marina Drushlyak and Olena Semenikhina of Sumy State Pedagogical University together with Svitlana Martos and Svitlana Klymovych of Kherson State University, built their study around a construct they call research reasoning. They operationalized it through three indicators. The first, problematization, covers the precise formulation of a research question and the boundaries of a topic. The second, methodological justification, captures the conscious choice of procedures, criteria for selecting sources, and methods of analysis. The third, reflective evaluation, involves checking the reliability of results and recognizing the limitations of methods, including the risks posed by generative artificial intelligence. Students were then classified as basic, intermediate, or advanced depending on how far their work moved along this spectrum.

Crucially, the researchers did not treat the tools themselves as the object of learning. Instead, they identified three mechanisms through which digital services can shape reasoning. The first mechanism involves external representations and the structuring of the research field: knowledge maps, citation graphs, and timelines that transform a vague search into genuine problematization. The second is heuristic generation, in which language models and recommendation systems accelerate the production of alternatives and preliminary models, but only when explicit rules for source selection are applied. The third mechanism is the organization and verification of evidence, supported by services such as Scite, Elicit, and Consensus that screen for contradictory citations and help verify claims. In the authors’ framing, tools operate as links in a chain running from tool to procedure to evidence, rather than as isolated user skills.

The qualitative heart of the study lies in the students’ own work. One participant described using ResearchRabbit before citing an influential article, discovering that although the paper had accumulated more than a hundred citations, fifteen of them were contradictory and pointed to methodological flaws. That discovery prompted a critical reassessment of the article’s reliability, and the student ultimately cited it while noting the existing criticisms. Another student, after Connected Papers revealed twelve contradictory citations attached to a key theoretical source, went so far as to revise the entire introduction of a literature review, adding a section on the scientific debates surrounding the theory. These are not the actions of students outsourcing their thinking to software; they are examples of tools triggering disciplined engagement with evidence.

Large language models played a different but complementary role. Several students used ChatGPT or Claude not to generate content but to attack their own arguments. One presented a preliminary structure to ChatGPT and asked it to identify weaknesses in the reasoning; the model suggested three alternative perspectives, two of which the student integrated into a Research Limitations section. Another uploaded a written conclusion to Claude with a prompt asking the system to assess the strength of the arguments and identify logical errors, and discovered that one argument was circular. The student rewrote it. In both cases, the researchers note, the artificial intelligence acted as a trigger for reflection, but the conclusions were formulated by the student, a distinction that sits at the core of their pedagogical model.

The survey component of the study, while descriptive rather than explanatory, helps map the landscape of tool use. Among the 104 respondents, 56 percent mentioned large language models in open-ended responses, 33 percent cited AI literature-review tools based on semantic search, 22 percent noted bibliographic managers with AI features, and 7 percent mentioned citation-based mapping tools. Google Scholar dominated literature searching at 85 percent, though it received a lower effectiveness rating than Scopus because of filtering difficulties. Excel remained the most common analysis tool at 67 percent, while Python and R were rated as flexible but burdened by a steep entry barrier. Most participants reported combining three to five tools, a pattern the authors interpret not as fragmentation but as a rational division of labor across the mechanisms of structuring, generation, and verification.

Educator observations, recorded in field memos over two academic years, added an external check on the qualitative themes. The observers used a rubric ranging from a procedural minimum, in which isolated technical actions bear no connection to the research goal, up to reflective integration, in which evidence verification, framework revision, and the delineation of AI boundaries become systematic. Most cases fell into the middle levels, where tools function as conveniences or as instruments of modeling, while the highest level occurred sporadically but carried methodological significance. The memos also documented failure modes: one student copied an AI-generated source list into a paper without checking accessibility or formatting, and three of the seven references turned out to be unusable. Such episodes illustrate the gap between possessing a tool and possessing a method.

That gap is precisely what the study identifies as the central challenge. The authors describe three groups of barriers that keep students trapped at superficial levels of digital practice. Technical difficulties, including unstable access, format incompatibilities, and synchronization failures, fragment digital work into disconnected operations. Conceptual barriers arise when students do not understand how a tool supports the research task, breaking the chain from tool to procedure to evidence into isolated actions. Reflective barriers appear when generated texts, source lists, and summaries are accepted without critical revision. The proposed remedy is not more software but more structure: mandatory micro-sections in reports asking what could be wrong, verification of counter-claims for key sources, brief methodological commentaries explaining each tool’s function and limits, and group work organized around collective evidence audits rather than mutual technical assistance.

The course itself offers a template for how this might work in practice. Students completed personalized micro-projects tied to their dissertation topics: analyzing research landscapes with VOSviewer, constructing academic genealogies with the Mathematics Genealogy Project, classifying sources in Zotero, and visualizing key concepts with Canva. Reflective mini-essays required them to articulate the limitations and potential of their chosen tools and to analyze the ethical challenges of AI use. One student described how an initial keyword map in VOSviewer revealed a separate cluster that clarified the boundaries of a review; another explained how a network graph exposed methodological articles previously overlooked, changing the structure of a section. In each case, the visualization served as a framework for synthesis rather than an end in itself, which is exactly the disposition the researchers hoped to cultivate.

The authors are careful about the limits of their claims. The empirical material is qualitative, drawn from two Ukrainian universities, and the survey served a contextual and triangulation function rather than testing hypotheses or measuring change. No theme frequencies or inter-coder coefficients were calculated; the analysis prioritized reflexive thematic analysis, thick description, and analytical generalization. Future work, they suggest, should include independent pre- and post-course measurements and quantitative validation of the reasoning indicators. Even so, the implications are hard to ignore at a moment when generative AI is flooding academia with fabricated references and confident nonsense. The study’s central message is that digital literacy at the doctoral level cannot mean tool mastery alone. It must mean the ability to think through platforms, to verify what they produce, and to take responsibility for the chain of evidence that connects a search result to a scientific conclusion. Institutions that treat AI as a threat to be banned, the findings suggest, may be missing the more productive opportunity: teaching the next generation of researchers to reason with it, critically and on the record.

Subject of Research: How digital and AI tools integrated into doctoral methodological training shape PhD students' research reasoning

Article Title: Developing research reasoning through digital tools in PhD students’ methodological training

Article References: Drushlyak, M., Martos, S., Klymovych, S., & Semenikhina, O. (2026). Developing research reasoning through digital tools in PhD students’ methodological training. Discover Education, 5(1), Article 1001. https://doi.org/10.1007/s44217-026-02110-8

Image Credits: AI Generated

DOI: 10.1007/s44217-026-02110-8

Keywords: PhD education, research reasoning, digital tools, artificial intelligence, generative AI, methodological training, digital literacy, citation analysis, open science, LLMs, evidence verification, doctoral training