<?xml version="1.0" encoding="UTF-8"?><rss version="2.0"
	xmlns:content="http://purl.org/rss/1.0/modules/content/"
	xmlns:wfw="http://wellformedweb.org/CommentAPI/"
	xmlns:dc="http://purl.org/dc/elements/1.1/"
	xmlns:atom="http://www.w3.org/2005/Atom"
	xmlns:sy="http://purl.org/rss/1.0/modules/syndication/"
	xmlns:slash="http://purl.org/rss/1.0/modules/slash/"
	>

<channel>
	<title>collaboration &#8211; Science</title>
	<atom:link href="https://scienmag.com/tag/collaboration/feed/" rel="self" type="application/rss+xml" />
	<link>https://scienmag.com</link>
	<description></description>
	<lastBuildDate>Sat, 10 Oct 2026 10:07:34 +0000</lastBuildDate>
	<language>en-US</language>
	<sy:updatePeriod>
	hourly	</sy:updatePeriod>
	<sy:updateFrequency>
	1	</sy:updateFrequency>
	<generator>https://wordpress.org/?v=7.1.3</generator>

<image>
	<url>https://scienmag.com/wp-content/uploads/2024/07/cropped-scienmag_ico-32x32.jpg</url>
	<title>collaboration &#8211; Science</title>
	<link>https://scienmag.com</link>
	<width>32</width>
	<height>32</height>
</image> 
<site xmlns="com-wordpress:feed-additions:1">73899611</site>	<item>
		<title>Cambodia&#8217;s Teacher Colleges Test a Four-Step Formula for 21st-Century Skills</title>
		<link>https://scienmag.com/cambodias-teacher-colleges-test-a-four-step-formula-for-21st-century-skills/</link>
		
		<dc:creator><![CDATA[Courtney Benton]]></dc:creator>
		<pubDate>Sat, 10 Oct 2026 10:07:34 +0000</pubDate>
				<category><![CDATA[Science Education]]></category>
		<category><![CDATA[21st-century skills development]]></category>
		<category><![CDATA[4Cs skills]]></category>
		<category><![CDATA[Battambang]]></category>
		<category><![CDATA[Cambodia]]></category>
		<category><![CDATA[Cambodia education policy reform]]></category>
		<category><![CDATA[Cambodia teacher education reform]]></category>
		<category><![CDATA[collaboration]]></category>
		<category><![CDATA[concept-based instruction]]></category>
		<category><![CDATA[concept-based instruction in Cambodia]]></category>
		<category><![CDATA[Critical thinking]]></category>
		<category><![CDATA[curriculum reform]]></category>
		<category><![CDATA[fostering learner autonomy in teacher training]]></category>
		<category><![CDATA[improving STEM teacher training]]></category>
		<category><![CDATA[inquiry-based learning in Cambodia]]></category>
		<category><![CDATA[international assessment challenges in Cambodia]]></category>
		<category><![CDATA[learner autonomy]]></category>
		<category><![CDATA[mixed methods]]></category>
		<category><![CDATA[project-based learning]]></category>
		<category><![CDATA[project-based learning implementation]]></category>
		<category><![CDATA[scalable instructional models]]></category>
		<category><![CDATA[self-directed learning]]></category>
		<category><![CDATA[self-directed learning for teachers]]></category>
		<category><![CDATA[teacher education]]></category>
		<category><![CDATA[teacher qualification and professional development]]></category>
		<guid isPermaLink="false">https://scienmag.com/?p=258202</guid>

					<description><![CDATA[A new mixed-methods study of 300 Cambodian student teachers shows that integrating concept-based instruction, self-directed learning, and project-based learning significantly boosts critical thinking, collaboration, communication, and creativity.]]></description>
										<content:encoded><![CDATA[<p>Cambodia ranked last among 81 countries in the most recent PISA assessment, and the reasons reach deep into how its teachers are trained. For decades, teacher education programs in the country have emphasized content transmission, memorization, and examination-oriented instruction, leaving little room for inquiry, learner autonomy, or collaborative problem-solving. A new study published in Discover Education argues that the way out of this trap is not any single reform method, but the deliberate integration of three of them: concept-based instruction, self-directed learning, and project-based learning. The research, led by Sophon Hieng of the National University of Battambang, synthesizes five empirical studies involving 300 student teachers at Battambang Teacher Education College and distills them into a four-step instructional model that its authors say is both evidence-based and scalable.</p>
<p>The stakes extend beyond one institution. Cambodia&#8217;s Ministry of Education, Youth, and Sport has pursued an ambitious reform agenda, including participation in international assessments, expansion of STEM education, and a Pentagonal Strategy for 2025–2026 that prioritizes building 21st-century skills. Yet the study documents persistent misalignments: teacher qualifications that do not match reform goals, a shortage of qualified STEM instructors, teaching methodologies that remain lecture-heavy, and professional development for teacher educators that survey data suggest is urgently needed. In this environment, the four Cs—critical thinking, collaboration, communication, and creativity—are widely recognized as essential competencies for future teachers, but they are rarely cultivated systematically.</p>
<p>The theoretical architecture of the study draws on three complementary traditions. Concept-based instruction, rooted in Vygotskian principles and the work of Gal&#8217;perin, organizes learning around transferable</p>
<p>The measurement apparatus behind the study deserves attention, because claims about skill development in teacher education often rest on weak instruments. Here, the researchers triangulated multiple data streams: validated rubrics designed specifically to score the four Cs, a self-directed learning questionnaire whose internal consistency reached a Cronbach&#8217;s alpha of 0.94—a figure indicating exceptionally high reliability for a multi-item scale—and thematic analysis of reflection journals written by the student teachers themselves. Triangulation matters because each data type compensates for the blind spots of the others. Rubrics capture observable performance but can miss internal shifts in motivation; questionnaires capture self-perception but are vulnerable to social desirability bias; journals capture the texture of lived experience but are difficult to quantify. By requiring convergence across all three, the study strengthens the inferential chain linking the integrated framework to the observed outcomes.</p>
<p>The headline gains—critical thinking improving by 20 percent, teamwork by 18 percent, and self-directed learning by 22 percent relative to comparison conditions—should be read as evidence of synergy rather than as universal effect sizes. The authors&#8217; central claim is that the integrated framework outperforms the same pedagogies delivered separately, a proposition consistent with a broader pattern in the learning sciences. Concept-based instruction supplies the conceptual scaffolding that makes knowledge transferable; self-directed learning supplies the motivational and metacognitive engine that drives independent practice; project-based learning supplies the authentic context in which both can be exercised. When any one component is missing, the others tend to underperform. A project without conceptual grounding can become busywork; self-directed study without a conceptual map can drift; concepts without application can remain inert.</p>
<p>The four-step model that emerges from the synthesis—identifying the concept, planning the self-directed learning, developing the project, and conducting structured reflection—maps neatly onto well-established cycles of experiential and self-regulated learning. The first step echoes the insight, running back to systematic investigations of concept-based teaching since the 1960s, that durable learning is organized around relationships among concepts rather than isolated facts. The second step operationalizes self-directed learning as an explicit planning activity, which is significant because research on self-regulation consistently shows that forethought phases—goal setting, strategy selection, resource anticipation—are where many learners falter. The third step embeds learning in a project that demands collaboration and communication. The fourth, structured reflection, converts experience into articulated understanding, and the reflection journals in this study provided the qualitative evidence that this conversion was actually occurring.</p>
<p>Reflection deserves particular emphasis because it is the step most often truncated in practice. In teacher education, reflective practice is frequently invoked but rarely scaffolded; student teachers are told to reflect without being taught how. The study&#8217;s use of structured reflection, analyzed thematically, suggests that reflection functions best when it is an integral, assessed component of the instructional cycle rather than an optional coda. For the student teachers at Battambang Teacher Education College, the journals appear to have served a dual purpose: as a learning tool that consolidated their own development of the four Cs, and as a data source that allowed researchers to trace how the participants perceived their growth in autonomy, critical awareness, and collaborative competence over time.</p>
<p>The Cambodian context gives these findings added weight. A education system historically oriented toward content transmission and examination preparation creates a specific obstacle for reforms aimed at higher-order thinking: teachers tend to teach as they were taught. If preservice teachers themselves never experience concept-based, self-directed, project-oriented learning, they are unlikely to reproduce such methods in their own classrooms, regardless of what curriculum documents prescribe. This is the practical logic of intervening at the teacher education stage. By developing the four Cs in future teachers, the framework attempts to break a generational cycle in which transmission-oriented pedagogy replicates itself. The study&#8217;s finding that self-directed learning improved by 22 percent is especially relevant here, since learner autonomy is both an outcome for the student teachers and a precondition for them to foster autonomy in their future pupils.</p>
<p>The policy implications the authors draw are correspondingly structural rather than merely instructional. They argue that national standards for teacher education should specify consistent teaching methods and explicitly promote 21st-century skills, so that reform goals and classroom practice are aligned rather than divergent. The study documents that Cambodia&#8217;s reform agenda—including the Pentagonal Strategy&#8217;s emphasis on 21st-century skills and the performance agreement in which 90.9 percent of eleven metrics were met—has created demand for such competencies at the policy level, while classroom methodology has lagged. The proposed framework is offered as a bridge between these layers: a concrete, evidence-based procedure that curriculum designers can embed in national standards and teacher educators can implement locally, with the claim of scalability resting on the model&#8217;s four-step simplicity and its grounding in a multi-study synthesis rather than a single pilot.</p>
<p>Scalability claims in education research warrant scrutiny, and several features of this framework bear on its plausibility. The model does not require expensive technology, although the authors note that learning management systems, collaborative platforms, and AI-assisted tools can facilitate its implementation by supporting conceptual understanding, collaboration, and reflective practice. Its core requirements are trained teacher educators, time for projects and reflection, and assessment instruments capable of capturing the four Cs. The digital dimension aligns the framework with the OECD Learning Compass 2030 vision of learner agency in technology-rich environments, and with the broader trajectory from the Fourth Industrial Revolution toward Society 5.0, where human-centric innovation and sustainability are emphasized alongside technological capability. But the framework&#8217;s dependence on educator capacity also means that the professional development gaps the study identifies among teacher educators represent a genuine constraint on scale-up, not merely a contextual footnote.</p>
<p>The mixed-methods design also illustrates a methodological point with implications beyond Cambodia. The authors explicitly recommend that a variety of mixed methods be employed rather than reliance on a single approach, and their integrative synthesis of five empirical studies demonstrates how a multi-study evidence base can be assembled in a low- and middle-income country context where large-scale randomized trials are often infeasible. Integrative syntheses of this kind occupy a middle ground between single-site interventions and systematic reviews: they preserve contextual specificity while accumulating evidence across cohorts, which is particularly valuable when the phenomenon of interest—development of complex competencies like creativity and collaboration—unfolds over time and resists capture by any single instrument.</p>
<p>Several caveats temper the findings. The study was conducted at a single institution with 300 student teachers, and the authors acknowledge that prior Cambodian research on concept-based instruction was limited in duration and conducted with high school students, meaning the local evidence base remains thin. The reported percentage improvements derive from pilot implementation, and the durability of the gains—whether student teachers retain and deploy the four Cs once they enter classrooms—remains an open question that would require longitudinal follow-up of graduates into their teaching careers. The generalizability of the framework to other education systems with different cultural expectations around learner autonomy and classroom authority is likewise untested, although the theoretical foundations the authors cite—Vygotskian perspectives on concept formation, research linking self-directed learning to intrinsic motivation and self-efficacy, and studies showing project-based learning&#8217;s effectiveness for 21st-century skills—draw on literatures spanning many national contexts.</p>
<p>What the study ultimately contributes is a demonstration that integration itself can be treated as a design principle with measurable consequences. The four Cs are not developed incidentally by good teaching; the authors&#8217; data suggest they develop differentially when concept-based instruction, self-directed learning, and project-based learning are deliberately sequenced into a coherent cycle. For Cambodian teacher education, the framework offers a route toward aligning national reform ambitions with classroom reality. For the wider field, it adds to a growing body of evidence that the whole of an integrated pedagogy can exceed the sum of its parts, and that the place to prove this is in the training of the teachers who will, in turn, shape the next generation of learners.</p>
<p><strong>Subject of Research:</strong> Integrating concept-based instruction, self-directed learning, and project-based learning to develop 21st-century skills in Cambodian teacher education</p>
<p><strong>Article Title:</strong> Integrating concept based instruction and self directed learning develops the four Cs in Cambodian teacher education</p>
<p><strong>Article References:</strong> Hieng, S., Hum, C., Soeung, S., Sam, R., &amp; Bou, D. (2026). Integrating concept based instruction and self directed learning develops the four Cs in Cambodian teacher education. <em>Discover Education, 5</em>(1), Article 1005. <a href="https://doi.org/10.1007/s44217-026-02196-0" rel="noopener noreferrer">https://doi.org/10.1007/s44217-026-02196-0</a></p>
<p><strong>Image Credits:</strong> AI Generated</p>
<p><strong>DOI:</strong> <a href="https://doi.org/10.1007/s44217-026-02196-0" rel="noopener noreferrer">10.1007/s44217-026-02196-0</a></p>
<p><strong>Keywords:</strong> teacher education, Cambodia, concept-based instruction, self-directed learning, project-based learning, 4Cs skills, critical thinking, collaboration, mixed methods, learner autonomy, curriculum reform, Battambang</p>
]]></content:encoded>
					
		
		
		<post-id xmlns="com-wordpress:feed-additions:1">258202</post-id>	</item>
		<item>
		<title>Power Imbalances Undermine Evidence-Based Programs for Young People, Review Finds</title>
		<link>https://scienmag.com/power-imbalances-undermine-evidence-based-programs-for-young-people-review-finds/</link>
		
		<dc:creator><![CDATA[Courtney Benton]]></dc:creator>
		<pubDate>Wed, 23 Sep 2026 10:39:37 +0000</pubDate>
				<category><![CDATA[Social Science]]></category>
		<category><![CDATA[barriers to effective mental health interventions]]></category>
		<category><![CDATA[child and adolescent mental health]]></category>
		<category><![CDATA[child welfare]]></category>
		<category><![CDATA[collaboration]]></category>
		<category><![CDATA[evidence-based child and adolescent intervention implementation]]></category>
		<category><![CDATA[evidence-based interventions]]></category>
		<category><![CDATA[impact of leadership on youth mental health outcomes]]></category>
		<category><![CDATA[implementation science]]></category>
		<category><![CDATA[influence of staff and organizational structures on youth therapy programs]]></category>
		<category><![CDATA[Leadership]]></category>
		<category><![CDATA[leadership influence on program effectiveness]]></category>
		<category><![CDATA[organisational climate]]></category>
		<category><![CDATA[organizational barriers to therapy program success]]></category>
		<category><![CDATA[power dynamics in youth mental health services]]></category>
		<category><![CDATA[power imbalances]]></category>
		<category><![CDATA[qualitative synthesis]]></category>
		<category><![CDATA[real-world challenges in evidence-based program delivery]]></category>
		<category><![CDATA[role of organizational power in program failure]]></category>
		<category><![CDATA[staff buy-in]]></category>
		<category><![CDATA[systematic review]]></category>
		<category><![CDATA[systematic review of evidence-based program rollout in child]]></category>
		<category><![CDATA[systemic issues in child and family services]]></category>
		<category><![CDATA[transformational leadership]]></category>
		<category><![CDATA[translating clinical trial success to real-world practice]]></category>
		<guid isPermaLink="false">https://scienmag.com/?p=210109</guid>

					<description><![CDATA[A systematic review of 24 qualitative studies finds that power imbalances among leaders are the biggest barrier to implementing evidence-based interventions in child and adolescent services, while shared vision, staff buy-in, communication, collaboration, and holistic support drive success.]]></description>
										<content:encoded><![CDATA[<p>When a therapy program proven to work in clinical trials fails to help children in the real world, the reason is often not the program itself but the people and structures charged with delivering it. A new systematic review published in the Journal of Child and Family Studies argues that leadership is one of the most decisive, and most frequently mishandled, ingredients in whether evidence-based interventions actually reach the young people they are designed to serve. The review, conducted by Charlotte Rose and Joel Harvey of Royal Holloway, University of London, synthesised 24 qualitative studies and found that the single most corrosive force undermining implementation was not a lack of funding or training, but the misuse of power within organisations.</p>
<p>The researchers set out to answer a deceptively simple question: which leadership components act as barriers or facilitators when evidence-based interventions are rolled out in services for children and adolescents? The distinction between efficacy and effectiveness sits at the heart of this question. An intervention may be efficacious, meaning it produces the intended outcomes under controlled research conditions, yet fail to be effective, meaning those outcomes are not achieved when frontline staff deliver it in routine services with real-world resource constraints and competing demands. Implementation science exists precisely to close that gap, and more than 60 frameworks have been developed to guide the process. Most converge on a small set of recurring domains, including intervention characteristics, the outer system context, the inner organisational context, individual provider characteristics, and the implementation process itself. Where frameworks diverge is in how they treat leadership: some position it as one factor among many within the organisational context, while others treat it as a cross-cutting mechanism that shapes multiple domains simultaneously.</p>
<p>Implementation leadership theory proposes that first-level leaders, the supervisors and managers with direct day-to-day oversight of frontline staff, shape what researchers call the implementation climate: the shared staff perceptions of what is expected, supported, and rewarded in relation to evidence-based practice. That climate, in turn, drives clinicians&#8217; actual use of the intervention. Because first-level leaders sit closest to service delivery, they have been identified as key levers for improving the adoption, utilisation, and sustainment of evidence-based practice. Yet previous systematic reviews had concentrated almost exclusively on social care settings, leaving open whether the same leadership processes operate across the full range of contexts in which children receive interventions, from schools and community mental health clinics to residential units and child welfare agencies.</p>
<p>Child and adolescent services are structurally more complex than many adult-facing services in ways that plausibly change what leadership must do. Delivery typically involves multiple family members alongside the young person, meaning leaders must sustain buy-in across a wider and less stable set of stakeholders. Young people are frequently supported across several services simultaneously, including health, education, social care, and the justice system, requiring leaders to coordinate communication across organisational boundaries with different priorities, funding structures, and accountabilities. These services also often operate under statutory time limits, safeguarding obligations, and policy scrutiny that constrain the pace and manner in which change can be introduced.</p>
<p>To capture this complexity, Rose and Harvey conducted a systematic review in accordance with Cochrane guidelines and the PRISMA reporting standards, with the protocol registered on PROSPERO. They searched Scopus, PsycINFO, and Web of Science, complemented by hand-searching reference lists and grey literature, with no restrictions on publication date or geographic origin. Eligible studies had to be empirical, peer-reviewed, qualitative in design, and had to explicitly name the implemented intervention, which had to focus on mental health. Studies also had to investigate leadership directly or identify it as a major or subtheme. From 4,098 initial citations, 24 studies met the full criteria, published between 2014 and 2023 and encompassing 575 participants ranging from frontline practitioners and supervisors to organisational leaders and stakeholders. Seventeen studies were conducted in the United States, with the remainder from the United Kingdom, Canada, Norway, Australia, and Belgium, and settings spanned social care, education, community mental health, and inpatient and residential care.</p>
<p>The interventions under study were diverse, including SafeCare, the Strengthening Families Program, Parent Management Training Oregon Model, The Incredible Years Teacher Classroom Management Programme, Multisystemic Therapy, Trauma-Focused Cognitive-Behavioural Therapy, the Positive Parenting Program, the Olweus Bullying Prevention Program, and mindfulness-based approaches, among others. Methodological quality was assessed using the Critical Appraisal Skills Programme checklist, with all but one study rated as high or moderate quality, and interrater reliability reaching almost perfect agreement during screening. The synthesis itself followed Thomas and Harden&#8217;s three-step thematic synthesis: line-by-line coding, developing descriptive themes, and developing analytic themes.</p>
<p>The analysis produced one overarching theme, two themes, and six subthemes. The overarching theme, power imbalances, cut across everything else. A top-down approach, characterised by decisions made without consulting frontline staff, led to relationship breakdowns, inadequate implementation preparation, reduced engagement, and an absence of collaboration. The dynamic was compounded where oversight mechanisms intended to support fidelity instead reinforced a sense of surveillance and diminished autonomy. One caseworker described feeling unable to raise concerns about an intervention because doing so would be reported to senior leadership, admitting that ultimately, in their words, you do not want that because you want to keep your job. Power imbalances were thus sustained not only through exclusion from decision-making but through frontline staff&#8217;s fear of consequences for voicing disagreement. Conversely, involving individuals at all implementation levels fostered a sense of ownership and demonstrated the value of their contributions.</p>
<p>The first of the two main themes, developing a core purpose, captured the leadership tasks salient during the early adoption phase. It comprised creating a shared vision, obtaining staff buy-in, and demonstrating commitment to the intervention. Leaders who brought together staff from multiple levels and agencies, aligning the intervention&#8217;s vision with staff values and motivations, promoted engagement and commitment to change. Buy-in proved to be a recurring rather than one-off task: staff turnover meant leaders had to continuously re-engage successive cohorts, which in turn necessitated strategic recruitment practices such as screening for implementation willingness. Leaders who genuinely believed in an intervention&#8217;s effectiveness and appropriateness were more inclined to allocate resources and address staff needs, while disinterest and ambivalence at the top hindered support. Notably, in twelve studies, leaders&#8217; physical presence, attending meetings, sending reminders, observing staff, and participating in training, reinforced commitment and priority, with staff describing leaders who were not just sitting in their offices but experiencing the work first-hand.</p>
<p>The second theme, maintaining implementation, reflected leadership tasks sustained throughout delivery and comprised effective communication, a collaborative approach, and holistic support. Clear communication structures prevented challenges from escalating, while their absence left staff feeling out of the loop and contributed to relationship breakdowns. Employing multiple communication methods, enabling staff to ask questions, sharing successes and concerns, and recognising staff efforts all enhanced engagement. Collaboration within leadership teams and with external agencies provided resources, knowledge, and expertise, and supported implementation even amid high staff turnover, with one participant noting that the show did not stop because one person did not show up. Yet collaboration was also described as complex, complicated by differing values and objectives between private and public services. Holistic support encompassed both instrumental support, such as supervision, training, and manageable workloads, and emotional support, including empathy and responsiveness to feedback, which together fostered motivation and reduced conflict.</p>
<p>The authors situate these findings within transformational leadership theory, mapping the identified components onto its classic dimensions: idealised influence through leaders&#8217; commitment to the intervention, inspirational motivation through creating a shared vision, intellectual stimulation through vision-building, and individualised consideration through holistic support and communication. They also introduce resilience as an interpretive lens, suggesting that evidence-informed frameworks such as the Organizational Resiliency Model, developed in physical health and child protection contexts, could be applied in educational and mental health settings. The review is not without limitations: all included studies originated from high-income countries, restricting generalisability, and the breadth of sectors covered means setting-specific leadership components may have been obscured. The authors also note a striking absence of research on the psychological and interpersonal dimensions of leadership, particularly how interpersonal dynamics within collaboration shape implementation. Their conclusion is a call to action: organisations should not expect leadership skills to develop naturally but must actively upskill leaders through implementation models, ongoing training, and policy adjustments, because when leadership works, the ultimate beneficiaries are children, adolescents, and their families.</p>
<p><strong>Subject of Research:</strong> The role of leadership in implementing evidence-based interventions in child and adolescent services</p>
<p><strong>Article Title:</strong> Leadership in the Implementation of Evidence-Based Interventions in Child and Adolescent Services: A Systematic Review</p>
<p><strong>Article References:</strong> Rose, C., &amp; Harvey, J. (2026). Leadership in the Implementation of Evidence-Based Interventions in Child and Adolescent Services: A Systematic Review. <em>Journal of Child and Family Studies</em>. <a href="https://doi.org/10.1007/s10826-026-03378-y" rel="noopener noreferrer">https://doi.org/10.1007/s10826-026-03378-y</a></p>
<p><strong>Image Credits:</strong> AI Generated</p>
<p><strong>DOI:</strong> <a href="https://doi.org/10.1007/s10826-026-03378-y" rel="noopener noreferrer">10.1007/s10826-026-03378-y</a></p>
<p><strong>Keywords:</strong> leadership, implementation science, evidence-based interventions, child and adolescent mental health, systematic review, power imbalances, transformational leadership, staff buy-in, organisational climate, collaboration, qualitative synthesis, child welfare</p>
]]></content:encoded>
					
		
		
		<post-id xmlns="com-wordpress:feed-additions:1">210109</post-id>	</item>
		<item>
		<title>Small Models, Big Payoff: Teamwork Fixs AI Tool-Calling Errors</title>
		<link>https://scienmag.com/small-models-big-payoff-teamwork-fixs-ai-tool-calling-errors/</link>
		
		<dc:creator><![CDATA[Violet Maxwell]]></dc:creator>
		<pubDate>Tue, 22 Sep 2026 14:13:36 +0000</pubDate>
				<category><![CDATA[Earth Science]]></category>
		<category><![CDATA[agentic AI systems]]></category>
		<category><![CDATA[AI system bottlenecks]]></category>
		<category><![CDATA[AI task planning]]></category>
		<category><![CDATA[AI tool invocation errors]]></category>
		<category><![CDATA[API request formatting]]></category>
		<category><![CDATA[autonomous AI task execution]]></category>
		<category><![CDATA[collaboration]]></category>
		<category><![CDATA[collaboration between large and small models]]></category>
		<category><![CDATA[Enhanced]]></category>
		<category><![CDATA[improving AI tool accuracy]]></category>
		<category><![CDATA[invocation]]></category>
		<category><![CDATA[large language models]]></category>
		<category><![CDATA[method]]></category>
		<category><![CDATA[multi-model]]></category>
		<category><![CDATA[natural language to machine commands]]></category>
		<category><![CDATA[Scientific Research]]></category>
		<category><![CDATA[small models for AI]]></category>
		<category><![CDATA[tool]]></category>
		<category><![CDATA[tool selection in AI]]></category>
		<guid isPermaLink="false">https://scienmag.com/?p=205719</guid>

					<description><![CDATA[Large language models have dazzled the world with their ability to write, reason and converse, but when it comes to actually doing things—booking a flight, querying a database, triggering a smart-home routine—they often stumble on something almost embarrassingly mundane: formatting.]]></description>
										<content:encoded><![CDATA[<p>Large language models have dazzled the world with their ability to write, reason and converse, but when it comes to actually doing things—booking a flight, querying a database, triggering a smart-home routine—they often stumble on something almost embarrassingly mundane: formatting. A new study published in the open-access journal Vicinagearth argues that the single biggest bottleneck in letting AI agents call external tools is not intelligence at all, but the rigid syntactic discipline required to produce a machine-readable API request. The research team, led by Yudian Zhang and Xuelong Li at the Institute of Artificial Intelligence (TeleAI) of China Telecom, together with Haijiang Zhu of Beijing University of Chemical Technology, proposes an elegantly simple remedy: let a large model think and a small model tidy up.</p>
<p>The work arrives at a moment when the AI industry is pouring enormous resources into so-called agentic systems—models that autonomously plan tasks and invoke software tools on the user&#8217;s behalf. Tool invocation sits at the heart of this vision. In the standard tool-learning pipeline, which researchers typically divide into task planning, tool selection, tool invocation and response generation, the invocation stage is the make-or-break moment. The model must extract parameters from a natural-language query, match them to a tool&#8217;s specification, and emit a request so precisely structured that a downstream server can parse it without error. Any stray character, a missing parenthesis, or a misplaced comma can cause the entire call to fail silently.</p>
<p>What the researchers discovered through systematic perturbation experiments is striking: the success of a tool call is far more sensitive to format standardization than to semantic accuracy. When they fine-tuned the Llama3.1-8B-Instruct model on the ToolACE dataset using LoRA, randomly altering numbers in the training labels left accuracy nearly untouched, and shuffling parameter strings produced only a modest decline. But when they changed the format itself—swapping bracket types, converting integers to floating-point numbers, or reordering parameters—performance collapsed. Simply changing bracket styles dragged live-task accuracy down to 42.51 percent from a much higher baseline. Converting numbers to floats proved most devastating of all, with one metric plunging to 25.39 percent, because the abstract syntax tree evaluation used by the benchmark flags data-type mismatches instantly.</p>
<p>The most dramatic result came from compounding these perturbations. In a double mixed-modification experiment that first randomized bracket usage and then converted numbers to floats, live accuracy cratered to just 3.02 percent—essentially total failure. The lesson, the authors argue, is that conventional fine-tuning creates what they call format fragility: models rigidly cling to whatever format patterns they saw in training data, and even when prompts explicitly specify an output format, fine-tuned models frequently ignore those instructions and emit unparsable output. Earlier studies have described this phenomenon as format specialization or task locking, where intense fine-tuning erodes a model&#8217;s general in-context learning ability on non-target tasks.</p>
<p>Recognizing that reasoning and formatting are fundamentally different skills, the team designed a division-of-labor architecture that separates them. In their collaborative framework, the large language model receives the user&#8217;s question and a list of available tools, then produces an intermediate output containing its thought process, the selected tool name and the parameter information. Crucially, this intermediate output need not follow any format at all—the large model is freed from worrying about syntax. That freedom is precisely what preserves its generalization. The intermediate result is then handed to a small, specialized format model whose sole job is to normalize it into a strict, predefined structure that can be parsed directly into a callable API request.</p>
<p>The experimental payoff was substantial. When the same perturbed models were paired with the formatting model, accuracy rebounded dramatically. The Random Mix Twice configuration, which had fallen to 3.02 percent, soared to 73.42 percent once the small model normalized the output. The formatting step effectively absorbs all the chaotic variations—missing parentheses, wrong number formats, unexpected parameter orders—that would otherwise doom the invocation. The authors also contrast their approach with in-context learning, noting that few-shot examples struggle to exhaustively cover complex, nested parameter schemas, whereas a dedicated format model explicitly models the output structure and separates tool selection from argument generation.</p>
<p>The study used the Berkeley Function Call Leaderboard, a benchmark of more than 1,700 instances spanning simple, multiple, parallel and parallel-multiple function calls in Python, as well as REST API, JavaScript and Java tasks. Evaluation relied on the benchmark&#8217;s abstract syntax tree methodology, which checks whether function names, required parameters and data types all conform to the function documentation. The experiments ran on a single RTX 4090 GPU, underscoring that the collaborative method is computationally modest: instead of retraining a giant model, it attaches a lightweight normalizer to the end of the pipeline.</p>
<p>The implications reach across the AI industry. Giants including IBM&#8217;s Granite-20B-FunctionCalling, ToolLLM, APIGen and ToolACE have all pursued better function-calling models through increasingly sophisticated fine-tuning and dataset synthesis. But the new study suggests a quiet vulnerability running through that entire paradigm: as long as a single model is asked to be both reasoner and formatter, it will remain brittle. A wrong parameter value may still pass parsing and merely yield an irrelevant result, but a wrong bracket is fatal. The finding that format correctness outranks content accuracy inverts a common assumption that semantic quality is the primary axis of model quality, and it offers a practical, modular fix that developers could retrofit onto existing systems without touching the underlying model weights.</p>
<p>The authors are candid about the limits of their approach. Their evaluation remains confined to static, single-turn settings on specific test sets, while real-world agents must handle multi-turn dialogues that demand consistent tracking of context and parameters across turns. Real APIs also evolve their schemas over time, and format learning grounded in fixed training data struggles to adapt. Yet the multi-model framework points toward a natural solution: the large model can continue to handle contextual reasoning and intent understanding while the small model operates as a lightweight, updatable formatter that maps intent to whatever the current API schema requires. The team plans to integrate schema-based validation checkers and explore online adaptation techniques, including few-shot in-context learning and parameter-efficient fine-tuning, to keep inference costs low while boosting robustness in dynamic deployments.</p>
<p>For a field fixated on scale, the takeaway is refreshingly counterintuitive. Sometimes the fastest way to make a giant AI smarter is to pair it with a tiny, single-minded helper obsessed with punctuation. By decoupling what a model knows from how it says it, the study reframes tool learning as a coordination problem rather than a capability problem—and suggests that the next leap in autonomous AI agents may come not from bigger brains, but from better teamwork.</p>
<p><strong>Subject of Research:</strong> Enhanced tool invocation method through multi-model collaboration</p>
<p><strong>Article Title:</strong> Enhanced tool invocation method through multi-model collaboration</p>
<p><strong>Article References:</strong> Enhanced tool invocation method through multi-model collaboration. (n.d.). <a href="https://doi.org/10.1007/s44336-025-00028-7" rel="noopener noreferrer">https://doi.org/10.1007/s44336-025-00028-7</a></p>
<p><strong>Image Credits:</strong> AI Generated</p>
<p><strong>DOI:</strong> <a href="https://doi.org/10.1007/s44336-025-00028-7" rel="noopener noreferrer">10.1007/s44336-025-00028-7</a></p>
<p><strong>Keywords:</strong> Enhanced, tool, invocation, method, multi-model, collaboration, scientific research</p>
]]></content:encoded>
					
		
		
		<post-id xmlns="com-wordpress:feed-additions:1">205719</post-id>	</item>
	</channel>
</rss>
