<?xml version="1.0" encoding="UTF-8"?><rss version="2.0"
	xmlns:content="http://purl.org/rss/1.0/modules/content/"
	xmlns:wfw="http://wellformedweb.org/CommentAPI/"
	xmlns:dc="http://purl.org/dc/elements/1.1/"
	xmlns:atom="http://www.w3.org/2005/Atom"
	xmlns:sy="http://purl.org/rss/1.0/modules/syndication/"
	xmlns:slash="http://purl.org/rss/1.0/modules/slash/"
	>

<channel>
	<title>hand tracking &#8211; Science</title>
	<atom:link href="https://scienmag.com/tag/hand-tracking/feed/" rel="self" type="application/rss+xml" />
	<link>https://scienmag.com</link>
	<description></description>
	<lastBuildDate>Thu, 01 Oct 2026 22:03:56 +0000</lastBuildDate>
	<language>en-US</language>
	<sy:updatePeriod>
	hourly	</sy:updatePeriod>
	<sy:updateFrequency>
	1	</sy:updateFrequency>
	<generator>https://wordpress.org/?v=7.1.3</generator>

<image>
	<url>https://scienmag.com/wp-content/uploads/2024/07/cropped-scienmag_ico-32x32.jpg</url>
	<title>hand tracking &#8211; Science</title>
	<link>https://scienmag.com</link>
	<width>32</width>
	<height>32</height>
</image> 
<site xmlns="com-wordpress:feed-additions:1">73899611</site>	<item>
		<title>Signing in Mid-Air: VR Headsets Learn to Verify Your Signature in 3D</title>
		<link>https://scienmag.com/signing-in-mid-air-vr-headsets-learn-to-verify-your-signature-in-3d/</link>
		
		<dc:creator><![CDATA[Denise Maddox]]></dc:creator>
		<pubDate>Thu, 01 Oct 2026 22:03:56 +0000</pubDate>
				<category><![CDATA[Technology and Engineering]]></category>
		<category><![CDATA[3D biometric authentication in virtual reality]]></category>
		<category><![CDATA[AirSign virtual signature system]]></category>
		<category><![CDATA[authentication]]></category>
		<category><![CDATA[behavioral biometrics]]></category>
		<category><![CDATA[biometric signature capture in virtual environments]]></category>
		<category><![CDATA[Biometrics]]></category>
		<category><![CDATA[cybersecurity]]></category>
		<category><![CDATA[dynamic time warping]]></category>
		<category><![CDATA[enhancing immersion with virtual signature verification]]></category>
		<category><![CDATA[frictionless user authentication in VR]]></category>
		<category><![CDATA[hand tracking]]></category>
		<category><![CDATA[hand-tracking for digital signatures]]></category>
		<category><![CDATA[handwriting-based biometric authentication in VR]]></category>
		<category><![CDATA[human-computer interaction]]></category>
		<category><![CDATA[immersive VR login methods]]></category>
		<category><![CDATA[innovative security methods for VR headsets]]></category>
		<category><![CDATA[Meta Quest]]></category>
		<category><![CDATA[non-intrusive VR user verification]]></category>
		<category><![CDATA[Rust]]></category>
		<category><![CDATA[signature recognition]]></category>
		<category><![CDATA[standalone VR headset security solutions]]></category>
		<category><![CDATA[Unity]]></category>
		<category><![CDATA[virtual reality]]></category>
		<category><![CDATA[VR signature verification]]></category>
		<guid isPermaLink="false">https://scienmag.com/?p=223842</guid>

					<description><![CDATA[Researchers at Sapienza University of Rome have built AirSign, a VR authentication system that verifies users by recognizing three-dimensional signatures drawn in mid-air with controllers or bare hands.]]></description>
										<content:encoded><![CDATA[<p>Virtual reality has long promised total immersion, yet one mundane task keeps yanking users out of their digital worlds: authentication. Whether paying inside a VR app store, unlocking confidential documents in a laboratory, or entering a restricted industrial area, users of standalone headsets such as the Meta Quest 3 or Pico 4 are still forced to peck at floating virtual keyboards or pull out a smartphone running a companion app. Both approaches break the sense of presence that defines the medium, introduce fatigue and typing errors, and add friction that grows worse with every complex password requirement. A team of researchers at Sapienza University of Rome, working with a colleague from Unitelma Sapienza, now argues that the solution may be as old as handwriting itself. Their prototype, called AirSign, lets users sign their name in the air, in full three dimensions, and verifies who they are without ever leaving the virtual environment.</p>
<p>The core idea is deceptively simple: treat a hand-drawn signature as a biometric trait, just as banks and document workflows have done for decades with pen and paper. What makes AirSign distinctive is how it captures that signature. Instead of confining users to a predefined two-dimensional plane, or demanding specialized peripherals such as data gloves or a Leap Motion sensor mounted on a desk, the system exploits hardware that modern headsets already carry. Users can sign either with motion controllers or, on devices that support it, with camera-based hand tracking. A single unified gesture, a pinch between the index finger and thumb, signals the intent to write. When the virtual fingertips touch, the system begins sampling the three-dimensional coordinates of the fingertip at the headset&#8217;s refresh rate, typically 90 to 120 hertz, and renders the resulting strokes in real time so the user receives immediate visual feedback.</p>
<p>Under the hood, every signature becomes a multivariate time series. Each sampled point stores a position vector and a velocity vector, the latter computed from the change in position between consecutive frames divided by the elapsed time. Because the hand-tracking cameras on consumer headsets rely on monocular RGB input without dedicated depth sensors, the raw trajectory is noisy. To tame the jitter, the researchers apply linear interpolation, smoothing each sampled position halfway toward the previous one. This acts as a first-order low-pass filter, balancing responsiveness against stability. Two normalization steps then make signatures comparable regardless of where and how the user was facing when signing: the entire trajectory is translated so its first point sits at the world origin, and it is rotated by a quaternion so that the user&#8217;s initial viewing direction aligns with a canonical axis. The result is a signature that can be drawn anywhere, at any orientation, and still be matched against stored templates.</p>
<p>Comparing two signatures captured at different speeds and lengths is the central algorithmic challenge, and it is where Dynamic Time Warping enters the picture. Simple Euclidean distance fails catastrophically when two otherwise identical trajectories are temporally shifted, because points that should correspond are compared with the wrong partners. DTW solves this by warping the time axis of one sequence to find an optimal non-linear alignment with the other, minimizing the cumulative local distance along an admissible warping path that respects boundary, continuity, and monotonicity constraints. The method&#8217;s key property for signature verification is its invariance to time shifts: identical but misaligned sequences yield a distance at or near zero. Classic DTW carries a quadratic cost in both time and memory, however, which is prohibitive on a battery-powered headset, so the team turned to FastDTW, a multilevel approximation that coarsens the series, projects a low-resolution warping path upward, and refines it within a constrained radius, achieving linear time and space complexity.</p>
<p>The engineering choices reveal how much practical constraint shapes such systems. An early client-server design was abandoned in favor of fully on-device processing, with signature data saved directly to the headset&#8217;s local file system. The DTW computation was rewritten in Rust after benchmarks showed the original Python implementation took 2.37 seconds to compare a 383-point signature with itself, while the Rust version finished in 0.03 seconds, roughly 79 times faster. On a tenfold larger sample of 3,830 points, the gap widened to 480-fold, with Rust completing in 0.13 seconds what Python needed more than a minute to do. Further optimizations, including a Sakoe-Chiba band that restricts the warping path to a diagonal window and a diagonal DTW variant that slashes memory use, cut processing time by more than half on a 70,000-point signature. Classification also runs asynchronously on a background thread, preventing the rendering loop from freezing, a detail that matters enormously in VR, where a stalled frame that no longer matches head movement can induce motion sickness.</p>
<p>Even the choice of which features to feed the matcher mattered. An initial feature set combining position, velocity, and acceleration produced puzzling misclassifications: a handwritten name and an arbitrary wave pattern were judged suspiciously similar to a figure eight, with average DTW distances low enough to slip beneath the acceptance threshold. Ablation analysis showed that acceleration data was injecting noise rather than discriminative power, so the team stripped it out, keeping only position and velocity. The revised feature set produced a much clearer separation between similar and dissimilar signatures, eliminated the false positives, and, as a bonus, shrank the data files and simplified the computation. It is a textbook example of how more sensors and more features do not automatically mean better biometrics.</p>
<p>To evaluate the system, the researchers recruited 28 volunteers, roughly 60 percent male and 40 percent female, aged between 20 and 40, none of whom had meaningful prior headset experience. Each participant produced 25 signatures under two input modalities, controllers and hand tracking, and two experimental conditions. In the fixed-signature scenario, everyone wrote the same word, AIRSIGNX, deliberately stressing the system&#8217;s ability to distinguish people who share an identical signature shape. In the custom-signature scenario, each user chose a personal symbol or name, mimicking real-world variability. The team measured false acceptance and false rejection rates across swept thresholds and derived Equal Error Rates, the operating point where the two error rates coincide. Custom signatures proved markedly easier to verify, with EERs as low as 0.030 to 0.061 depending on input method, corresponding to authentication accuracy of roughly 94 to 97 percent. The hostile fixed-signature scenario, which doubles as a simulation of a skilled forgery attack in which an attacker knows the target&#8217;s signature shape, yielded EERs between 0.097 and 0.165, still translating to accuracy between roughly 83.5 and 90 percent.</p>
<p>Two further findings stand out. First, when the template gallery was reduced from 20 signatures per user to just 5, error rates rose only marginally, with the custom-signature EER reaching 0.030 with controllers and 0.053 with hand tracking. That stability matters for practical deployment, because it suggests users could enroll quickly without degrading security. Second, controllers consistently outperformed hand tracking on the Area Under the Curve metric, with very large effect sizes in both scenarios, reflecting the spatial jitter, gesture-detection latency, and occasional tracking losses inherent to camera-based hand modeling. Yet for the metric that matters most in practice, the EER on custom signatures, the difference between input methods was statistically negligible. In other words, when inter-class variability is high, the noisier but more convenient hand-tracking mode authenticates just as reliably, especially after smoothing. Users themselves praised the pinch-to-write gesture as natural and ergonomic, with the only recurring complaint being a slight lag in detecting fingertip contact at the start and end of strokes.</p>
<p>The security analysis is framed with appropriate caution. The researchers consider three threat levels: zero-knowledge attacks by random impostors, captured by the custom-signature EER; shape-aware attacks by forgers who know what the victim writes, captured by the fixed-signature EER; and dynamics-aware attacks, which they defer to dedicated future adversarial testing. Including velocity profiles in the DTW calculation is hypothesized to resist spatial replay attacks, since replicating how fast a signature was drawn is substantially harder than copying its shape, but the team is explicit that this hypothesis still needs rigorous testing. On the performance side, the entire verification cycle, including normalization, feature extraction, and DTW matching, completes within 350 milliseconds and adds less than 2 percent power draw on a standalone Meta Quest 2, confirming that biometric authentication can run continuously without draining the battery or degrading frame rates.</p>
<p>The authors are candid about the study&#8217;s limits. Twenty-eight participants cannot represent the full demographic spectrum, all data was collected in a single session, and no head-to-head comparison with classifiers such as support vector machines or deep learning architectures was possible, partly because variable-length 3D time series resist fixed-length feature extraction and the sample size is too small to train neural models fairly. They position AirSign accordingly, not as a novel classification algorithm but as a systems-level contribution: the first demonstration that unconstrained, on-device, three-dimensional signature verification is feasible on ordinary consumer VR hardware. Future work will scale the user cohort, parallelize the DTW computation across CPU cores, refine index-thumb contact detection, mount a proper defense against forged signatures, and benchmark the approach against gaze, motion, and keystroke biometrics. If those steps succeed, the awkward floating keyboard may finally give way to something far more intuitive: simply signing your name into the air.</p>
<p><strong>Subject of Research:</strong> VR-based 3D hand-written signature recognition for biometric user authentication in virtual reality</p>
<p><strong>Article Title:</strong> AirSign: An innovative VR-based hand-written signature recognition</p>
<p><strong>Article References:</strong> Frascarelli, G., Marini, M. R., De Marsico, M., Mecca, A., &amp; Cinque, L. (2026). AirSign: An innovative VR-based hand-written signature recognition. <em>Multimedia Tools and Applications, 85</em>(10), Article 790. <a href="https://doi.org/10.1007/s11042-026-21951-x" rel="noopener noreferrer">https://doi.org/10.1007/s11042-026-21951-x</a></p>
<p><strong>Image Credits:</strong> AI Generated</p>
<p><strong>DOI:</strong> <a href="https://doi.org/10.1007/s11042-026-21951-x" rel="noopener noreferrer">10.1007/s11042-026-21951-x</a></p>
<p><strong>Keywords:</strong> virtual reality, biometrics, signature recognition, Dynamic Time Warping, hand tracking, authentication, Meta Quest, behavioral biometrics, Rust, Unity, human-computer interaction, cybersecurity</p>
]]></content:encoded>
					
		
		
		<post-id xmlns="com-wordpress:feed-additions:1">223842</post-id>	</item>
		<item>
		<title>Virtual Reality Headset Tracks How Distractors Hijack Hands and Eyes in 3D</title>
		<link>https://scienmag.com/virtual-reality-headset-tracks-how-distractors-hijack-hands-and-eyes-in-3d/</link>
		
		<dc:creator><![CDATA[Glenn Wilkins]]></dc:creator>
		<pubDate>Fri, 25 Sep 2026 00:03:31 +0000</pubDate>
				<category><![CDATA[Psychology & Psychiatry]]></category>
		<category><![CDATA[3D eye and hand tracking in VR]]></category>
		<category><![CDATA[additional singleton task]]></category>
		<category><![CDATA[attentional capture]]></category>
		<category><![CDATA[attentional capture in virtual environments]]></category>
		<category><![CDATA[Behavior Research Methods]]></category>
		<category><![CDATA[distraction effects on hand-eye coordination]]></category>
		<category><![CDATA[distractors]]></category>
		<category><![CDATA[eye tracking]]></category>
		<category><![CDATA[hand tracking]]></category>
		<category><![CDATA[immersive attention research methods]]></category>
		<category><![CDATA[immersive environments]]></category>
		<category><![CDATA[immersive virtual reality distraction studies]]></category>
		<category><![CDATA[influence of salient distractors on attention]]></category>
		<category><![CDATA[reaching movements]]></category>
		<category><![CDATA[real-world distraction modeling in VR]]></category>
		<category><![CDATA[sensorimotor processing]]></category>
		<category><![CDATA[tracking gaze and hand movements in VR]]></category>
		<category><![CDATA[virtual reality]]></category>
		<category><![CDATA[virtual reality attention research]]></category>
		<category><![CDATA[virtual reality laboratory experiments]]></category>
		<category><![CDATA[virtual reality task design for attention studies]]></category>
		<category><![CDATA[virtual reality vs traditional attention testing]]></category>
		<category><![CDATA[visual attention]]></category>
		<category><![CDATA[visual search]]></category>
		<guid isPermaLink="false">https://scienmag.com/?p=213591</guid>

					<description><![CDATA[Researchers used a virtual reality headset to simultaneously track hand and eye movements, showing that classic attentional capture effects generalize to immersive 3D environments.]]></description>
										<content:encoded><![CDATA[<p>For decades, scientists studying attention have asked volunteers to stare at flat screens and press buttons. The results have been enormously influential, but they raise an uncomfortable question: how much do we really learn about distraction in the real world when our experiments take place in a two-dimensional rectangle? A new study published in Behavior Research Methods by Max D. Gurr, Christopher D. Erb, and colleagues at the University of Auckland and Connecticut College tackles that question head-on by moving the classic laboratory test of distraction into immersive virtual reality, where participants reach for virtual objects with their hands while a headset simultaneously records every flick of their eyes.</p>
<p>The task the researchers chose is the additional singleton paradigm, one of the most widely used tools in attention research. Participants search for a uniquely shaped target, such as a pear among apples, while a salient distractor, here a red object among green ones, appears on half of the trials. In traditional versions, people respond more slowly and make more errors when the distractor is present, a phenomenon known as attentional capture. The salient stimulus grabs attention automatically, even though it is irrelevant to the task. What has been missing is a way to watch that capture unfold in three dimensions, in movements that resemble the reaching and looking we do every day.</p>
<p>Fifty-four participants aged 18 to 26 wore an HTC Vive Pro Eye headset fitted with integrated eye tracking and held a motion-tracked controller in their dominant hand. The system recorded hand positions at roughly 90 hertz and gaze direction from the headset&#8217;s infrared eye tracker, allowing the team to capture reaching and looking behavior at the same time in the same trial. Participants completed the task in two contrasting virtual environments: a sparsely detailed, untextured room designed to mimic a bare laboratory, and a richly detailed virtual greenhouse filled with visual clutter. The order of the environments was counterbalanced across participants.</p>
<p>On each trial, four fruit-shaped stimuli appeared on a virtual tree at the top, left, right, and bottom locations. The target was always the unique shape, and its color and identity were randomized from trial to trial, encouraging participants to search for any singleton rather than a specific feature. When a distractor appeared, it was always the uniquely colored object. Participants initiated each reach by holding the controller inside a central starting sphere for two seconds, then had three seconds to move to the target. Correct responses earned a pleasant 600-hertz tone; errors or timeouts produced a low 300-hertz buzz.</p>
<p>The results were striking in their consistency. When a distractor was present, participants were slower to initiate their movements, slower to complete them, and slower overall. Their reach trajectories curved more, their hands spent a greater proportion of each movement being pulled toward the distractor location, their eyes traveled greater angular distances, and they took longer to fixate the target for the first time. Effect sizes were substantial, with distractor presence explaining between roughly a quarter and nearly two-thirds of the variance in individual measures. In short, the attentional capture effects documented over thirty years of button-press experiments generalize robustly to three-dimensional immersive environments.</p>
<p>But the study&#8217;s real methodological contribution lies in how the movements were analyzed. Traditional reach-tracking studies collapse three-dimensional trajectories into two-dimensional summary statistics such as maximum perpendicular deviation from a straight path. The problem is that a large deviation does not necessarily mean the hand was drawn toward the distractor; it could also reflect a delayed decision, with the hand drifting toward the center of the display before committing. Gurr and colleagues instead computed continuous target attraction and distractor attraction scores: for every time point in a movement, they determined which object the hand was moving closest toward, and calculated the proportion of the trajectory devoted to each. These measures revealed capture effects that the curvature measure missed entirely, particularly on trials where the distractor appeared far from the target.</p>
<p>Those attraction scores also allowed the team to reconstruct the time course of capture using cluster-based permutation analyses. When the distractor was adjacent to the target, the hand was pulled toward the distractor from the very first moments of movement, with the effect persisting for up to 78 percent of the trajectory before the movement was corrected. Even when the target and distractor sat on opposite sides of the display, the hand still showed significant early attraction to the distractor, though the effect was briefer and weaker. This graded pattern mirrors earlier findings that capture costs shrink as the distance between target and distractor grows, and it extends them into a fully three-dimensional movement space.</p>
<p>The comparison between the sparse room and the rich greenhouse produced a subtler story. Participants were generally slower and moved their eyes more in the detailed greenhouse, consistent with prior work showing that cluttered environments impair visual search. Yet the size of the attentional capture effect itself did not differ between environments. Bayesian analyses provided moderate evidence for this null result on several measures, though the evidence was mixed on others. One complication emerged: participants who started in the sparse room performed nearly identically in both environments, while those who started in the rich greenhouse were markedly faster in the sparse room afterward, hinting at practice or adaptation effects that future studies will need to disentangle.</p>
<p>The authors are candid about the limitations. Many participants adopted a rigid strategy of looking first at the top location, which complicated the analysis of initial eye movements. The task&#8217;s fixed layout may have allowed participants to learn that the bottom object revealed the target&#8217;s color, potentially shrinking the distractor effect. And VR hardware brings its own caveats: the headset&#8217;s eye tracker is less precise than professional laboratory systems, and the motion-to-photon lag between a real hand movement and its virtual rendering, estimated at a few tens of milliseconds, means VR-derived timing should be compared cautiously with data from electromagnetic or optical trackers.</p>
<p>Even so, the study makes a compelling case that a commercially available VR headset, costing a fraction of traditional tracking rigs, can deliver laboratory-grade measurements of how distraction plays out simultaneously in the hand and the eye. Because the equipment is portable and the software tools are increasingly accessible, the approach could spread quickly through labs studying attention, perception, and motor control. The data and analysis scripts have been released openly, and the team plans to publish user-friendly processing software. The gap between the psychology laboratory and the cluttered, three-dimensional world we actually inhabit may finally be starting to close.</p>
<p><strong>Subject of Research:</strong> Measuring attentional capture dynamics in hand and eye movements using virtual reality</p>
<p><strong>Article Title:</strong> Measuring the dynamics of attentional capture in hand and eye movements with virtual reality</p>
<p><strong>Article References:</strong> Gurr, M. D., Moher, J., Egbert, M. D., &amp; Erb, C. D. (2026). Measuring the dynamics of attentional capture in hand and eye movements with virtual reality. <em>Behavior Research Methods, 58</em>(11), Article 302. <a href="https://doi.org/10.3758/s13428-026-03177-9" rel="noopener noreferrer">https://doi.org/10.3758/s13428-026-03177-9</a></p>
<p><strong>Image Credits:</strong> AI Generated</p>
<p><strong>DOI:</strong> <a href="https://doi.org/10.3758/s13428-026-03177-9" rel="noopener noreferrer">10.3758/s13428-026-03177-9</a></p>
<p><strong>Keywords:</strong> attentional capture, virtual reality, eye tracking, hand tracking, additional singleton task, visual attention, reaching movements, distractors, Behavior Research Methods, sensorimotor processing, visual search, immersive environments</p>
]]></content:encoded>
					
		
		
		<post-id xmlns="com-wordpress:feed-additions:1">213591</post-id>	</item>
	</channel>
</rss>
