Monday, November 16, 2026
Science
No Result
View All Result
  • Login
  • HOME
  • SCIENCE NEWS
  • CONTACT US
  • HOME
  • SCIENCE NEWS
  • CONTACT US
No Result
View All Result
Scienmag
No Result
View All Result
Home Science News Science Education

Observational Grid Accurately Measures Collaborative Problem Solving Across Secondary School Tasks

November 16, 2026
in Science Education
Courtney Benton
By Courtney Benton Scienmag Editorial Profile - Science and Technology Policy
Reading Time: 6 mins read
0
Observational Grid Accurately Measures Collaborative Problem Solving Across Secondary School Tasks

Observational Grid Accurately Measures Collaborative Problem Solving Across Secondary School Tasks

65
SHARES
587
VIEWS
Share on FacebookShare on Twitter
ADVERTISEMENT

Educational researchers at the University of Belgrade and the Institute for Educational Research have validated the Collaborative Problem Solving Observation Grid, known as the CPS-OG, providing a standardized observational instrument to assess group collaboration across distinct academic domains. Published in Frontiers in Education, the investigation evaluates how student groups coordinate shared activities during complex problem solving, translating prior research into a practical rubric capturing group-level performance. Collaborative problem solving has become a key educational competence, yet existing measurement frameworks struggle to balance comprehensive coverage with classroom usability. By evaluating interactions across four empirically grounded dimensions—socio-cognitive exchange, socio-emotional climate, task regulation, and group regulation—the CPS-OG establishes a structured method for examining collaboration without requiring laborious turn-by-turn conversational transcription. The validation study tested the instrument across scientific and civic literacy tasks, demonstrating that the grid reliably evaluates collaborative quality across different subject-matter contexts while maintaining robust psychometric properties across secondary school student groups.

The development of the CPS-OG addresses long-standing theoretical and methodological limitations within collaborative learning assessment. Previous observational methodologies have predominantly emphasized cognitive discourse while overlooking the social, emotional, and regulatory mechanisms that sustain productive teamwork. Established coding schemes, such as the Scheme for Educational Dialogue Analysis, categorize communicative acts but dedicate less attention to explicit task management and group-level relational regulation. Other widely cited models, including the Thinking Together framework and the CRESST teamwork process model, either embed regulatory actions within broader cognitive engagement categories or focus narrowly on organizational dynamics at the expense of disciplinary reasoning. Qualitative micro-analytic techniques require extensive audio-visual transcription and context-specific interpretive frameworks that restrict their application in larger educational cohorts. Grounded in a systematic review of one hundred sixty empirical studies drawn from more than five thousand publications, the CPS-OG translates core findings regarding productive and unproductive peer interactions into an integrated, macro-level assessment system.

The resulting instrument encompasses twenty-one operational items distributed across four core dimensions, supplemented by ratings of classroom dialogue types and an indicator of individual engagement. The socio-cognitive dimension contains seven items capturing active listening, consensus building, divergent idea generation, mutual justification, idea elaboration, collaborative synthesis of solutions, and one reverse-scored indicator reflecting authoritarian cognitive dominance. The socio-emotional dimension comprises four items designed to evaluate group cohesion, mutual respect, positive working atmosphere, and interpersonal friction. Task regulation is evaluated through five items examining initial planning, temporal efficiency, collective progress monitoring, strategic adaptation during problem solving, and an inverted measure of group disorganization. Finally, the group regulation dimension incorporates five items assessing balanced participation, encouragement of peer contributions, collaborative conflict resolution, and two reverse-scored measures targeting member exclusion and domineering role assignment. Each item is scored on a five-point scale from zero to four, alongside an option to designate behaviors as not applicable.

To evaluate the psychometric performance of the observation grid, the research team conducted validation testing with eighty-four small groups comprising two hundred forty-one secondary school students aged sixteen from six grammar schools and six vocational secondary schools in Belgrade, Serbia. The sample was deliberately structured into same-gender groupings, consisting of seventy-three triads and eleven dyads, with fifty-seven female groups and twenty-seven male groups participating in the testing sessions. The authors selected same-gender groups to control for known interactional confounds, as prior literature demonstrates that mixed-gender and same-gender groups exhibit divergent conversational dynamics and differential benefits during collaborative problem solving. Participants were recruited through classroom invitations distributed by school psychologists, with students self-selecting their partners from within their regular classrooms. Ethical approval was secured from the institutional review board of the Department of Psychology at the University of Belgrade, and written informed consent was provided by participating students and their legal guardians.

The experimental procedure required each student group to complete two conceptually distinct collaborative tasks designed to assess the cross-domain robustness of the observation grid. One task evaluated scientific literacy using items released from the OECD Programme for International Student Assessment, while the second task evaluated civic literacy using framework materials from both PISA and the International Civic and Citizenship Education Study. Both tasks had been identified through Item Response Theory analyses as highly challenging problems and were adapted for collaborative administration by requiring groups to formulate collective arguments justifying their final choices. Task administration order was randomized across cohorts to control for potential sequence effects. Group performance products were subsequently evaluated across two distinct parameters: solution accuracy, scored from zero to four points according to predetermined coding schemes, and argumentation quality, rated on a scale from zero to two points, yielding an overall product quality metric from zero to six points.

Observational scoring was conducted by twelve trained researchers organized into six evaluation pairs, each having participated in developing the CPS-OG. Following structured training involving independent reviews of benchmark video recordings and group calibration discussions, each rater independently evaluated recorded sessions using the CPS-OG, Mercer’s established dialogue typology, and a global item measuring overall discussion presence. The raters utilized standardized coding protocols with dedicated observation fields to note salient collaborative events before assigning holistic scores across entire task sessions. When discrepancies emerged between paired raters, the assessors convened to discuss their observations and reach a final consensus score. External dialogue quality was classified using Neil Mercer’s tripartite framework, categorizing interaction into disputational talk characterized by unelaborated disagreement, cumulative talk marked by uncritical sharing, and exploratory talk featuring critical reasoning, active elaboration, and constructive engagement with alternative viewpoints. The prevalence of each dialogue type was rated on a three-point scale ranging from one to three.

Descriptive analyses revealed that secondary school participants demonstrated moderate average levels of socio-cognitive exchange and task regulation alongside higher scores for socio-emotional climate and group regulation across both problem domains. For scientific literacy tasks, mean ratings were two point zero three for socio-cognitive exchange, two point ninety-six for socio-emotional quality, two point eighteen for task regulation, and two point seventy-three for group regulation, with comparable averages of two point zero six, two point ninety-six, two point twenty-three, and two point seventy-seven observed during civic literacy tasks. Cumulative dialogue predominated in both contexts, recording means of two point forty-four in science and two point forty-eight in civic tasks, whereas exploratory dialogue averaged one point thirty-seven and one point thirty-eight, and conflictual dialogue remained low at one point twenty-one and one point sixteen. Product quality averaged three point forty-five points for scientific tasks and three point eighty-six points for civic tasks across cohorts.

Psychometric evaluation demonstrated high reliability across individual items and composite scales within both instructional domains. Interrater reliability was examined using two-way mixed-effects intraclass correlation coefficients with absolute agreement, yielding item-level coefficients that ranged from point eighty-one to point ninety-three, uniformly exceeding the conventional threshold of point seventy-five indicative of excellent rater agreement. Confirmatory factor analyses were estimated using the weighted least squares mean and variance adjusted estimator, incorporating adjustments for nested group observations. Composite reliability values satisfied established psychometric standards, reaching point ninety-five for socio-cognitive exchange, point ninety-two and point eighty-eight for socio-emotional climate, point eighty-three and point eighty-seven for task regulation, and point eighty-two and point eighty-three for group regulation across scientific and civic contexts, respectively. Average variance extracted metrics consistently surpassed the recommended threshold of point fifty, ranging from point fifty-one to point seventy-five across all dimensions and tasks, indicating that each latent construct accounted for substantial item variance.

The internal structure of the instrument was confirmed through one-factor confirmatory structural models estimated independently for each conceptual dimension in both task environments. Across the socio-cognitive dimension, comparative fit indices were excellent, with CFI values of point nine hundred ninety-six in science and point nine hundred ninety-four in civics, accompanied by standardized factor loadings ranging from point seventy-six to point ninety-five. Collaborative synthesis of new ideas emerged as the strongest socio-cognitive indicator, exhibiting standardized loadings of point ninety-four for scientific tasks and point ninety-five for civic tasks, while authoritarian cognitive dominance demonstrated expected negative loadings of negative point sixty-three and negative point seventy-four. The socio-emotional model exhibited perfect fit indices across both domains, with factor loadings between point eighty-one and point ninety-three for cohesion, mutual respect, and positive climate. In group regulation, balanced member participation showed consistent loadings of point seventy-eight in both contexts, confirming stable measurement behavior across diverse problem domains.

Criterion-related validity was established through regression analyses linking observational scores to external dialogue measures and group performance outcomes. Socio-cognitive exchange emerged as the strongest positive predictor of exploratory dialogue, yielding standardized beta coefficients of point ninety-seven in scientific literacy and point ninety-six in civic literacy, while showing moderate positive associations with cumulative dialogue and significant negative associations with conflictual interactions. Socio-emotional quality and group regulation were strongly and inversely associated with conflictual dialogue, recording standardized coefficients of negative point eighty-six and negative point eighty-nine during scientific problem solving, demonstrating that constructive interpersonal norms buffer groups against counterproductive friction. Furthermore, overall product quality was positively predicted by socio-cognitive exchange, with standardized weights of point forty-six in science and point forty-seven in civics, and by task regulation, with weights of point thirty in science and point forty-four in civics, confirming the operational value of multidimensional observational grids for classroom monitoring and research.

Subject of Research: Development and psychometric validation of the Collaborative Problem Solving Observation Grid

Article Title: A comprehensive observational instrument for assessing collaborative problem solving: development and validation of the CPS-OG

Article References: Stepanović Ilić, I., Krstić, K., Baucal, A., Ivanović, J., Videnović, M., Jošić, S., Jolić Marjanović, Z., Altaras, A., Pavlović Babić, D., Nikitović, T., Mojović Zdravković, K., & Rajić, M. (2026). A comprehensive observational instrument for assessing collaborative problem solving: development and validation of the CPS-OG. Frontiers in Education, 11, Article 1934297. https://doi.org/10.3389/feduc.2026.1934297

Image Credits: AI Generated

DOI: 10.3389/feduc.2026.1934297

Keywords: collaborative problem solving, educational assessment, observational grid, psychometrics, socio-cognitive exchange, task regulation, secondary education, construct validity, comprehensive, observational, instrument, assessing

Cite Scienmag News

Courtney Benton. (November 16, 2026). Observational Grid Accurately Measures Collaborative Problem Solving Across Secondary School Tasks. Scienmag. https://scienmag.com/observational-grid-accurately-measures-collaborative-problem-solving-across-secondary-school-tasks/

Courtney Benton. "Observational Grid Accurately Measures Collaborative Problem Solving Across Secondary School Tasks." Scienmag, 16 November 2026, https://scienmag.com/observational-grid-accurately-measures-collaborative-problem-solving-across-secondary-school-tasks/. Accessed 16 November 2026.

Courtney Benton. "Observational Grid Accurately Measures Collaborative Problem Solving Across Secondary School Tasks." Scienmag. November 16, 2026. https://scienmag.com/observational-grid-accurately-measures-collaborative-problem-solving-across-secondary-school-tasks/

Tags: assessingcollaborative problem solvingcomprehensiveconstruct validityeducational assessmentInstrumentobservationalobservational gridpsychometricssecondary educationsocio-cognitive exchangetask regulation
Share26Tweet16
Previous Post

Systematic Review Finds Connected Home Research Relies Heavily on Cloud Architectures

Next Post

Nanocomposite Coatings Neutralize Acid and Strengthen Degraded Cellulose Acetate Films

Related Posts

Thirty-One Studies Across Twelve Countries Detail Global Innovations in STEM Education
Science Education

Thirty-One Studies Across Twelve Countries Detail Global Innovations in STEM Education

November 16, 2026
Revised Conceptual Framework Categorizes Mindset-Signaling Teacher Practices Across Five Core Functions
Science Education

Revised Conceptual Framework Categorizes Mindset-Signaling Teacher Practices Across Five Core Functions

November 16, 2026
Collaborative Architectural Design Teams Achieve Higher Project Scores in Studio Evaluation
Science Education

Collaborative Architectural Design Teams Achieve Higher Project Scores in Studio Evaluation

November 16, 2026
Integrated Instruction Linked to Higher Problem-Solving Development in Non-Randomised University Study
Science Education

Integrated Instruction Linked to Higher Problem-Solving Development in Non-Randomised University Study

November 16, 2026
AI-Generated Visuals Aid University Students in Reflective Coursework and Metacognition
Science Education

AI-Generated Visuals Aid University Students in Reflective Coursework and Metacognition

November 16, 2026
Dana Foundation Honors Jennifer French and Eric Chudler With Champion Awards
Science Education

Dana Foundation Honors Jennifer French and Eric Chudler With Champion Awards

November 16, 2026
Next Post
Cladribine Preserves Antibody Levels Better Than Anti-CD20 Multiple Sclerosis Therapies

Cladribine Preserves Antibody Levels Better Than Anti-CD20 Multiple Sclerosis Therapies

  • Mothers who receive childcare support from maternal grandparents show more optimized

    Mothers who receive childcare support from maternal grandparents show more parental warmth, finds NTU Singapore study

    27656 shares
    Share 11059 Tweet 6912
  • University of Seville Breaks 120-Year-Old Mystery, Revises a Key Einstein Concept

    1061 shares
    Share 424 Tweet 265
  • Bee body mass, pathogens and local climate influence heat tolerance

    682 shares
    Share 273 Tweet 171
  • Researchers record first-ever images and data of a shark experiencing a boat strike

    546 shares
    Share 218 Tweet 137
  • Groundbreaking Clinical Trial Reveals Lubiprostone Enhances Kidney Function

    531 shares
    Share 212 Tweet 133
Science

Embark on a thrilling journey of discovery with Scienmag.com—your ultimate source for cutting-edge breakthroughs. Immerse yourself in a world where curiosity knows no limits and tomorrow’s possibilities become today’s reality!

RECENT NEWS

  • Quxie Capsule Strategy Is Associated with Longer Survival in Metastatic Colorectal Cancer
  • Visceral Adipose Tissue Associates With Survival in Endometrial Cancer Immunotherapy Cohort
  • Rare Endobronchial Lipoma Mimicking Central Lung Cancer Resolved by Bronchoscopic Resection
  • Immunosuppression Reverses Rapid Nephrotic Syndrome Masked by Diabetic Nephropathy in Case Report

Categories

  • Agriculture
  • Anthropology
  • Archaeology
  • Athmospheric
  • Biology
  • Biotechnology
  • Blog
  • Bussines
  • Cancer
  • Chemistry
  • Climate
  • Earth Science
  • Editorial Policy
  • Marine
  • Mathematics
  • Medicine
  • Pediatry
  • Policy
  • Psychology & Psychiatry
  • Science Education
  • Science News
  • Social Science
  • Space
  • Technology and Engineering

Subscribe to Blog via Email

Enter your email address to subscribe to this blog and receive notifications of new posts by email.

Join 5,150 other subscribers

© 2026 Scienmag - Science Magazine

Welcome Back!

Login to your account below

Forgotten Password?

Retrieve your password

Please enter your username or email address to reset your password.

Log In
No Result
View All Result
  • HOME
  • SCIENCE NEWS
  • CONTACT US

© 2026 Scienmag - Science Magazine

Discover more from Science

Subscribe now to keep reading and get access to the full archive.

Continue reading