<?xml version="1.0" encoding="UTF-8"?><rss version="2.0"
	xmlns:content="http://purl.org/rss/1.0/modules/content/"
	xmlns:wfw="http://wellformedweb.org/CommentAPI/"
	xmlns:dc="http://purl.org/dc/elements/1.1/"
	xmlns:atom="http://www.w3.org/2005/Atom"
	xmlns:sy="http://purl.org/rss/1.0/modules/syndication/"
	xmlns:slash="http://purl.org/rss/1.0/modules/slash/"
	>

<channel>
	<title>multimodal assessment &#8211; Science</title>
	<atom:link href="https://scienmag.com/tag/multimodal-assessment/feed/" rel="self" type="application/rss+xml" />
	<link>https://scienmag.com</link>
	<description></description>
	<lastBuildDate>Sun, 27 Sep 2026 19:33:41 +0000</lastBuildDate>
	<language>en-US</language>
	<sy:updatePeriod>
	hourly	</sy:updatePeriod>
	<sy:updateFrequency>
	1	</sy:updateFrequency>
	<generator>https://wordpress.org/?v=7.1.2</generator>

<image>
	<url>https://scienmag.com/wp-content/uploads/2024/07/cropped-scienmag_ico-32x32.jpg</url>
	<title>multimodal assessment &#8211; Science</title>
	<link>https://scienmag.com</link>
	<width>32</width>
	<height>32</height>
</image> 
<site xmlns="com-wordpress:feed-additions:1">73899611</site>	<item>
		<title>Screens, Seconds and Faces: New Study Probes Why Test Scores Mislead</title>
		<link>https://scienmag.com/screens-seconds-and-faces-new-study-probes-why-test-scores-mislead/</link>
		
		<dc:creator><![CDATA[Denise Maddox]]></dc:creator>
		<pubDate>Sun, 27 Sep 2026 19:33:41 +0000</pubDate>
				<category><![CDATA[Technology and Engineering]]></category>
		<category><![CDATA[comprehensive approach to understanding test performance]]></category>
		<category><![CDATA[Computer-based test performance analysis]]></category>
		<category><![CDATA[e-learning]]></category>
		<category><![CDATA[effect of candidate facial expressions on test results]]></category>
		<category><![CDATA[electronic testing]]></category>
		<category><![CDATA[evaluation of test question complexity and presentation]]></category>
		<category><![CDATA[facial expression recognition]]></category>
		<category><![CDATA[factors affecting accuracy of electronic knowledge tests]]></category>
		<category><![CDATA[factors influencing test scores beyond knowledge]]></category>
		<category><![CDATA[guessing detection]]></category>
		<category><![CDATA[human-computer interaction]]></category>
		<category><![CDATA[impact of test item design on assessment outcomes]]></category>
		<category><![CDATA[implications for digital assessment validity]]></category>
		<category><![CDATA[influence of test timing and interaction on scores]]></category>
		<category><![CDATA[item quality]]></category>
		<category><![CDATA[learning analytics]]></category>
		<category><![CDATA[limitations of percentage scores in measuring learning]]></category>
		<category><![CDATA[Machine learning]]></category>
		<category><![CDATA[multi-stream data analysis in educational assessment]]></category>
		<category><![CDATA[multimodal assessment]]></category>
		<category><![CDATA[psychometrics]]></category>
		<category><![CDATA[response time]]></category>
		<category><![CDATA[role of screen rendering in electronic testing]]></category>
		<category><![CDATA[Shannon entropy]]></category>
		<guid isPermaLink="false">https://scienmag.com/?p=216963</guid>

					<description><![CDATA[A new study in Mobile Networks and Applications combines Shannon entropy, response times and facial-expression analysis to show that electronic test scores reflect item design and human-computer interaction as much as knowledge.]]></description>
										<content:encoded><![CDATA[<p>A final score on a computer-based test tells you far less than it appears to. That is the central premise of a new study published in Mobile Networks and Applications, in which a team of Serbian and Croatian researchers set out to disentangle what actually drives performance during electronic knowledge assessment. Their conclusion is sobering for anyone who treats a percentage on a screen as a pure measure of learning: the number a candidate produces reflects not only what they know, but also how the test items are constructed, how those items are rendered on screen, how long the candidate spends wrestling with them, and even the fleeting expressions that cross their face in the first seconds of reading a question.</p>
<p>The research, led by Danilo Strugarevic of the Academy of Applied Preschool Teaching and Health Studies in Kruševac, Serbia, together with Vojkan Nikolic of the University of Criminal Investigation and Police Studies in Belgrade, Dragan Perakovic of the University of Zagreb and Aleksandar Jevremovic of Singidunum University, took an unusually broad view of the testing process. Rather than examining a single signal in isolation, the team combined several distinct streams of information: textual characteristics of the test items, entropy-based measures computed from screenshots of the rendered displays, response times, candidates&#8217; self-reported knowledge, and facial-expression features captured during the exam. The goal was to see whether these process indicators, taken together, could support a more accurate and more honest interpretation of electronic test performance than scores alone.</p>
<p>One of the most technically interesting elements of the study is its use of Shannon entropy, the foundational information-theoretic quantity that measures the unpredictability or information content of a signal. In this context, entropy served as a compact descriptor of how informationally dense a rendered test item appeared on screen. The researchers computed entropy measures such as Entropy_AVG, Entropy_SUM and logEntropy from screenshots of the displays that candidates actually saw. The intuition is straightforward: a visually or textually cluttered item carries more information per unit of screen space, and that density may shape how long a candidate needs to process it. The data bore this out in part. Both Entropy_AVG and QA_Total_Length, a measure of question and answer text length, were positively associated with response time, with correlation coefficients of 0.298 and 0.288 respectively, both statistically significant at p &lt; 0.001.</p>
<p>Yet the relationship between time and performance proved far more elusive. Response time was not significantly associated with the final test result at all, showing a correlation of just −0.029 with a p-value of 0.435. In other words, spending longer on a question neither helped nor hurt the score in any statistically detectable way. This finding cuts against a common intuition in assessment design, where slow responses are sometimes read as a sign of struggle or guessing and fast responses as a sign of confident mastery. The study suggests that response time is a genuine process indicator, sensitive to the structural demands of the item, but it is not a reliable proxy for knowledge.</p>
<p>When the team turned to prediction, the picture became more modest. They compared global and segmented regression models that attempted to predict test outcomes from the combined feature set, and found that predictive performance was limited, with no single algorithm emerging as superior across all evaluation measures. This is an important negative result. In an era when machine-learning vendors promise to read competence out of behavioural traces, the study offers a reminder that the mapping from interaction data to knowledge is noisy and algorithm-dependent. Entropy_SUM and logEntropy showed weak positive associations with the final result, hinting that items with higher informational content may relate in some small way to performance, while Question_Length stood out as the highest-ranked negative structural indicator, meaning longer questions were associated with lower results.</p>
<p>The facial-expression analysis produced perhaps the most nuanced findings of all. Using automated facial-expression recognition, the researchers extracted features corresponding to emotional categories over the course of the test. As standalone predictors, these features had limited value: classification agreement was low and regression correlations were near zero. But a subtler pattern emerged when the team examined timing. Features computed from the first five seconds of each item, covering neutral, disgust and anger expressions, were more informative than averages computed over the full response interval. This suggests that the initial emotional reaction to reading a question, the moment a candidate first registers its demands, may carry more signal than the emotional state sustained while answering. Intriguingly, this early-window advantage did not hold across all expression categories, indicating that different emotions unfold on different timescales during problem solving.</p>
<p>The study&#8217;s framing draws on a rich tradition in psychometrics and learning analytics. Classical test theory and item response theory have long recognised that item characteristics shape observed scores, and decades of research on guessing in multiple-choice and true-false formats have shown that partial knowledge and informed guessing can inflate results. What is new here is the attempt to bring information theory into the item-review pipeline. Prior work has used entropy-based algorithms to quantify textual comprehension difficulty and to cluster visual question difficulty, and the present study extends that logic to the actual pixels a candidate sees, treating the rendered display as a measurable object in its own right rather than a neutral window onto the question text.</p>
<p>The multimodal approach also connects to a growing body of work on emotion in learning. Pekrun&#8217;s control-value theory of achievement emotions has established that emotional states are not incidental to performance but causally intertwined with it, and earlier studies have monitored facial expressions to gauge learner attention in e-learning environments. The Serbian team&#8217;s contribution is to test whether such signals can be harvested unobtrusively, from a standard webcam during a real exam, and to report honestly on how much predictive weight they can actually bear. Their answer, based on the data, is: some, but not much on their own, and only when timed carefully.</p>
<p>Methodologically, the study was conducted at the Department of Health Studies in Ćuprija, Serbia, with ethical approval from the institutional Ethics Committee and written informed consent from all participants, including consent to be video-recorded during testing. The authors note that the underlying datasets, which include performance records, behavioural traces, and image and video material, cannot be released publicly because of privacy and ethical restrictions, though anonymised and processed data may be shared on reasonable request subject to institutional approvals. All four authors contributed equally to the work, with Strugarevic leading conceptualisation and methodology and the team sharing data collection, analysis and interpretation.</p>
<p>The practical implications reach toward the next generation of digital assessment platforms. The authors argue that jointly considering item-structure measures, screenshot-derived entropy, response time, self-reported knowledge and facial-expression features could support smarter testing environments that combine conventional scores with interpreted process indicators, helping item-quality review and potentially helping to distinguish knowledge-supported responses from those involving guessing. Crucially, they resist the temptation to crown any single indicator as definitive. No webcam, no timer and no entropy calculation can certify knowledge, detect guessing, or read an emotional state on its own. What the study demonstrates is that these signals are complementary pieces of a larger puzzle, and that the honest path to fairer electronic assessment runs not through any single magic metric but through the disciplined, statistically cautious fusion of many imperfect ones. In a world increasingly examined by algorithm, that caution may be the study&#8217;s most valuable result.</p>
<p><strong>Subject of Research:</strong> Multimodal human-computer interaction analysis for reducing error in electronic knowledge assessment</p>
<p><strong>Article Title:</strong> Analysis of Human-Computer Interaction Aimed at Reducing Error in Assessing Students’ Knowledge</p>
<p><strong>Article References:</strong> Strugarevic, D., Nikolic, V., Perakovic, D., &amp; Jevremovic, A. (2026). Analysis of Human-Computer Interaction Aimed at Reducing Error in Assessing Students’ Knowledge. <em>Mobile Networks and Applications</em>. <a href="https://doi.org/10.1007/s11036-026-02538-0" rel="noopener noreferrer">https://doi.org/10.1007/s11036-026-02538-0</a></p>
<p><strong>Image Credits:</strong> AI Generated</p>
<p><strong>DOI:</strong> <a href="https://doi.org/10.1007/s11036-026-02538-0" rel="noopener noreferrer">10.1007/s11036-026-02538-0</a></p>
<p><strong>Keywords:</strong> human-computer interaction, electronic testing, Shannon entropy, facial expression recognition, psychometrics, response time, learning analytics, multimodal assessment, machine learning, item quality, guessing detection, e-learning</p>
]]></content:encoded>
					
		
		
		<post-id xmlns="com-wordpress:feed-additions:1">216963</post-id>	</item>
		<item>
		<title>Brain Wave Connectivity Offers Clues to Consciousness Recovery After Injury</title>
		<link>https://scienmag.com/brain-wave-connectivity-offers-clues-to-consciousness-recovery-after-injury/</link>
		
		<dc:creator><![CDATA[Cassandra Pierce]]></dc:creator>
		<pubDate>Tue, 22 Sep 2026 17:21:24 +0000</pubDate>
				<category><![CDATA[Medicine]]></category>
		<category><![CDATA[alpha oscillations]]></category>
		<category><![CDATA[bedside electroencephalography in brain injury]]></category>
		<category><![CDATA[BMC Medical Imaging]]></category>
		<category><![CDATA[brain injury]]></category>
		<category><![CDATA[brain injury recovery predictors]]></category>
		<category><![CDATA[brain network communication biomarkers]]></category>
		<category><![CDATA[brain wave connectivity]]></category>
		<category><![CDATA[coherence]]></category>
		<category><![CDATA[consciousness recovery after brain injury]]></category>
		<category><![CDATA[disorders of consciousness]]></category>
		<category><![CDATA[EEG]]></category>
		<category><![CDATA[EEG analysis for consciousness]]></category>
		<category><![CDATA[EEG brain network communication]]></category>
		<category><![CDATA[functional connectivity]]></category>
		<category><![CDATA[Glasgow Coma Scale]]></category>
		<category><![CDATA[Glasgow Coma Scale limitations]]></category>
		<category><![CDATA[multimodal assessment]]></category>
		<category><![CDATA[neuroimaging in coma prognosis]]></category>
		<category><![CDATA[neurophysiology]]></category>
		<category><![CDATA[neurophysiology of consciousness]]></category>
		<category><![CDATA[prognosis]]></category>
		<category><![CDATA[prognosis of impaired consciousness]]></category>
		<category><![CDATA[stroke and traumatic brain injury prognosis]]></category>
		<category><![CDATA[weighted phase lag index]]></category>
		<guid isPermaLink="false">https://scienmag.com/?p=207171</guid>

					<description><![CDATA[A new study finds that alpha-band EEG connectivity during task performance shows an exploratory association with six-month consciousness recovery after brain injury, though it does not outperform age and Glasgow Coma Scale scores.]]></description>
										<content:encoded><![CDATA[<p>For families gathered at the bedside of a loved one with a severe brain injury, one question dominates everything else: will they wake up? Prognosticating consciousness recovery remains one of the most difficult tasks in medicine. Clinical scales such as the Glasgow Coma Scale capture behavior at a moment in time, but they can miss the hidden neurophysiology that determines whether a patient will regain the ability to respond to the world. Now, a study published in BMC Medical Imaging suggests that a simple, bedside electroencephalography (EEG) measure of brain network communication may carry meaningful information about whether patients will follow commands six months after injury, though the researchers urge caution about how far the finding can be pushed.</p>
<p>The research team, led by Sari Rahmawati Kusuma Dewi of Taipei Medical University together with colleagues from several Taiwanese institutions, enrolled 111 hospitalized adults with impaired consciousness following acquired brain injury between October 2022 and November 2024 at Shuang Ho Hospital. The cohort was clinically heterogeneous: 37 percent had ischemic strokes, 33 percent hemorrhagic strokes, 25 percent traumatic brain injuries, and the remainder brain tumors or aneurysms. Patients were on average 69 years old, nearly two-thirds were men, and hypertension was present in more than 70 percent. Each participant underwent task-based EEG during hospitalization and was followed for six months, with outcomes categorized by whether the patient maintained or recovered the ability to follow commands.</p>
<p>The EEG paradigm itself was elegantly simple. Patients heard alternating spoken commands, ten seconds of &#8220;keep opening and closing your hand&#8221; followed by ten seconds of &#8220;stop opening and closing your hand,&#8221; delivered through the E-Prime presentation software with event markers embedded in the recording. Critically, the investigators included all patients in the analysis regardless of whether overt movement was visible, because the goal was to probe command-related brain engagement rather than confirm motor execution. Signals were recorded from a standard 19-channel 10-20 electrode array at 500 Hz, band-pass filtered between 1 and 30 Hz for analysis, and cleaned of artifacts using independent component analysis with automated classification via the ICLabel algorithm, with conservative retention of ambiguous components to avoid discarding genuine neural signal in this fragile population.</p>
<p>From these recordings, the team computed three measures of functional connectivity: spectral coherence, the weighted phase lag index (wPLI), and a debiased squared version of wPLI. The choice of metrics matters. Coherence, while popular, can be inflated by zero-lag synchronization arising from volume conduction, in which electrical activity from a single source is picked up by multiple electrodes, creating the illusion of communication between distant brain regions. The wPLI sidesteps much of this problem by weighting the imaginary component of the cross-spectrum, emphasizing phase-lagged interactions that are more likely to reflect genuine neural communication. The debiased squared estimator further corrects for finite-sample bias, providing a robustness check on the primary findings. Connectivity was summarized across delta, theta, alpha, and beta frequency bands during both moving and resting command conditions, with mean and median values averaged across all channel pairs.</p>
<p>The headline result was striking even if statistically fragile. Alpha-band wPLI during the moving condition showed the strongest nominal difference between outcome groups: patients who went on to maintain or recover command-following had higher alpha connectivity (mean 0.374) than those who did not (mean 0.318), a difference with a nominal p-value of 0.006. Alpha activity, oscillating at 8 to 12 Hz, has long been linked to large-scale cortical communication and thalamocortical function, making it a biologically plausible candidate marker of preserved consciousness networks. Group-level connectivity matrices reinforced the picture, showing visually stronger wPLI in the good outcome group, particularly over posterior parieto-occipital regions during the movement command condition. By contrast, coherence showed no significant group differences in any band or condition, and the debiased wPLI estimator showed directionally consistent but attenuated effects.</p>
<p>Here the story becomes a lesson in modern statistical rigor. The alpha-band finding did not survive Benjamini-Hochberg false discovery rate correction across the full family of 48 EEG connectivity variables, yielding a corrected p-value of 0.169. In adjusted logistic regression, alpha-band moving wPLI retained a nominal association with good outcome after controlling for age and Glasgow Coma Scale total score (odds ratio 1.76 per standard deviation), but the confidence interval was wide, and the association attenuated toward the null when the models additionally accounted for injury etiology or baseline motor responsiveness as measured by the GCS-Motor score. A Firth penalized regression, designed for small samples, produced a borderline, directionally consistent result. The authors are transparent: this is an exploratory, hypothesis-generating signal, not an established biomarker.</p>
<p>Perhaps the most sobering comparison came when EEG connectivity was pitted against plain clinical data. Age and Glasgow Coma Scale score together achieved a cross-validated area under the receiver operating characteristic curve of 0.778, while the multimodal model adding mean wPLI achieved 0.733 in leave-one-out validation, actually performing slightly worse once overfitting was controlled. Even simplified four-predictor models, which had healthier events-per-variable ratios, matched but did not exceed the clinical model. Formal incremental value testing confirmed the impression: adding wPLI features to age and GCS produced no statistically significant improvement by DeLong test or likelihood-ratio test. Calibration was adequate for both model types, and decision-curve analysis showed only small, threshold-dependent differences in net benefit, mostly between 55 and 75 percent probability thresholds. In short, the brain wave data told a biologically interesting story but did not beat two numbers any clinician can collect at the bedside.</p>
<p>Why does this matter? Because the field of consciousness prognostication is hungry for scalable tools. Positron emission tomography and functional magnetic resonance imaging can reveal residual brain function that behavior alone conceals, including the phenomenon of cognitive motor dissociation, in which unresponsive patients show covert brain activation to commands. But these technologies are expensive, technically demanding, and largely confined to specialized centers. EEG, by contrast, is inexpensive, noninvasive, and available in virtually every hospital. If task-related connectivity measures can be validated as complementary markers, they could eventually enrich multimodal prognostic frameworks without requiring patients to be transported to imaging suites. The present study also adds methodological value by demonstrating that phase-based measures such as wPLI behave differently from coherence in clinical populations, and that bias-reduced estimators should be reported alongside standard indices.</p>
<p>The investigators acknowledge important limitations. The study was single-center and modestly sized. The cohort excluded patients with hypoxic or post-cardiac arrest injury, the population where many consciousness biomarkers are tested, limiting generalizability. The six-month outcome, based on command-following, collapses death and persistent unresponsiveness into a single bad outcome category, which is clinically meaningful but coarser than graded functional scales. Many patients were already obeying commands at baseline, so the outcome partly reflected maintenance rather than recovery of responsiveness, and the task conditions were defined by instruction markers rather than verified behavioral compliance. Sedative effects were captured only as a binary variable, and short-epoch connectivity estimates may be influenced by fluctuations in arousal during recording.</p>
<p>The bottom line is characteristically scientific: a promising, plausible, and honestly reported signal that demands replication. Alpha-band task-related wPLI captured something real about the recovering injured brain, but its incremental value beyond age and clinical scales remains unproven in this cohort. The authors call for larger multicenter studies with external validation and more granular outcome measures before any clinical implementation. For now, the study stands as a careful step toward the long-sought goal of reading the injured brain&#8217;s network integrity at the bedside, using little more than electrodes, spoken commands, and rigorous statistics.</p>
<p><strong>Subject of Research:</strong> EEG functional connectivity as a prognostic marker for six-month consciousness-related outcome after acquired brain injury</p>
<p><strong>Article Title:</strong> EEG functional connectivity measures for differentiating 6-month consciousness-related outcome after brain injury</p>
<p><strong>Article References:</strong> Dewi, S. R. K., Chen, H.-C., Li, Y.-C., Yang, H.-C., Huang, C.-W., Chan, L., Tu, Y.-K., Kuo, T. B. J., &amp; Lin, M.-C. (2026). EEG functional connectivity measures for differentiating 6-month consciousness-related outcome after brain injury. <em>BMC Medical Imaging, 26</em>(1), Article 461. <a href="https://doi.org/10.1186/s12880-026-02681-w" rel="noopener noreferrer">https://doi.org/10.1186/s12880-026-02681-w</a></p>
<p><strong>Image Credits:</strong> AI Generated</p>
<p><strong>DOI:</strong> <a href="https://doi.org/10.1186/s12880-026-02681-w" rel="noopener noreferrer">10.1186/s12880-026-02681-w</a></p>
<p><strong>Keywords:</strong> EEG, functional connectivity, weighted phase lag index, disorders of consciousness, brain injury, prognosis, Glasgow Coma Scale, alpha oscillations, coherence, multimodal assessment, neurophysiology, BMC Medical Imaging</p>
]]></content:encoded>
					
		
		
		<post-id xmlns="com-wordpress:feed-additions:1">207171</post-id>	</item>
	</channel>
</rss>
