<?xml version="1.0" encoding="UTF-8"?><rss version="2.0"
	xmlns:content="http://purl.org/rss/1.0/modules/content/"
	xmlns:wfw="http://wellformedweb.org/CommentAPI/"
	xmlns:dc="http://purl.org/dc/elements/1.1/"
	xmlns:atom="http://www.w3.org/2005/Atom"
	xmlns:sy="http://purl.org/rss/1.0/modules/syndication/"
	xmlns:slash="http://purl.org/rss/1.0/modules/slash/"
	>

<channel>
	<title>neural ordinary differential equations &#8211; Science</title>
	<atom:link href="https://scienmag.com/tag/neural-ordinary-differential-equations/feed/" rel="self" type="application/rss+xml" />
	<link>https://scienmag.com</link>
	<description></description>
	<lastBuildDate>Tue, 13 Oct 2026 23:26:31 +0000</lastBuildDate>
	<language>en-US</language>
	<sy:updatePeriod>
	hourly	</sy:updatePeriod>
	<sy:updateFrequency>
	1	</sy:updateFrequency>
	<generator>https://wordpress.org/?v=7.1.3</generator>

<image>
	<url>https://scienmag.com/wp-content/uploads/2024/07/cropped-scienmag_ico-32x32.jpg</url>
	<title>neural ordinary differential equations &#8211; Science</title>
	<link>https://scienmag.com</link>
	<width>32</width>
	<height>32</height>
</image> 
<site xmlns="com-wordpress:feed-additions:1">73899611</site>	<item>
		<title>Neural ODEs and Graph Attention Team Up to Predict How Opinions Spread Online</title>
		<link>https://scienmag.com/neural-odes-and-graph-attention-team-up-to-predict-how-opinions-spread-online/</link>
		
		<dc:creator><![CDATA[Cassandra Pierce]]></dc:creator>
		<pubDate>Tue, 13 Oct 2026 23:26:31 +0000</pubDate>
				<category><![CDATA[Technology and Engineering]]></category>
		<category><![CDATA[bounded confidence model]]></category>
		<category><![CDATA[Classical models of social influence and their limitations]]></category>
		<category><![CDATA[computational social science]]></category>
		<category><![CDATA[Computational social science and social physics integration]]></category>
		<category><![CDATA[Data-driven models for social opinion dynamics]]></category>
		<category><![CDATA[Deep learning models for online opinion spread]]></category>
		<category><![CDATA[Fusion of neural ODEs and attention mechanisms]]></category>
		<category><![CDATA[graph attention networks]]></category>
		<category><![CDATA[Graph Attention networks in social opinion prediction]]></category>
		<category><![CDATA[Graph neural networks for social network analysis]]></category>
		<category><![CDATA[Machine learning]]></category>
		<category><![CDATA[Mechanistic interpretability in opinion modeling]]></category>
		<category><![CDATA[neural ordinary differential equations]]></category>
		<category><![CDATA[Neural Ordinary Differential Equations for opinion dynamics]]></category>
		<category><![CDATA[opinion dynamics]]></category>
		<category><![CDATA[Opinion trajectory forecasting in social media]]></category>
		<category><![CDATA[polarization]]></category>
		<category><![CDATA[Predicting consensus and polarization in online communities]]></category>
		<category><![CDATA[prediction]]></category>
		<category><![CDATA[Robust deep learning approaches for opinion evolution]]></category>
		<category><![CDATA[robustness]]></category>
		<category><![CDATA[social media]]></category>
		<category><![CDATA[social networks]]></category>
		<category><![CDATA[socially informed neural networks]]></category>
		<guid isPermaLink="false">https://scienmag.com/?p=269387</guid>

					<description><![CDATA[A new model called GA-ODE combines graph attention networks with ordinary differential equation constraints to predict opinion evolution on social networks with improved accuracy and robustness.]]></description>
										<content:encoded><![CDATA[<p>Social media platforms have become the primary arenas where public opinion forms, fractures, and spreads. When a controversial event breaks, users react through posts, reposts, and comments, and those interactions can crystallize into consensus, polarization, or sharp factional divides. For researchers and policymakers alike, being able to forecast how individual opinions will evolve over time is a tantalizing goal, but one that has resisted straightforward solutions. A research team led by Quan Liu of Nanyang Normal University now reports a new model, called GA-ODE, that fuses classical social physics with modern deep learning to predict opinion trajectories more accurately and more robustly than previous approaches. The work, published in Discover Artificial Intelligence, addresses a long-standing tension in computational social science between mechanistic interpretability and raw predictive power.</p>
<p>The difficulty lies in two competing traditions. Classical opinion dynamics models, such as the DeGroot model of 1974, the Friedkin-Johnsen model, and the Hegselmann-Krause bounded-confidence framework, describe how individuals update their views through explicit interaction rules. These models elegantly explain group-level phenomena like consensus formation and polarization, but they rest on simplifying assumptions: global interactions, homogeneous influence weights, or fixed neighborhoods. Real social networks, by contrast, are sparse and locally connected, and different neighbors exert very different degrees of influence on any given user. When the goal shifts from describing aggregate trends to predicting what a specific individual will believe next month, those idealized assumptions begin to crack.</p>
<p>Purely data-driven methods have the opposite problem. Continuous-time stochastic models such as SLANT and SLANT+ can process irregular event streams, while deep sequence models like LSTM and Transformers capture nonlinear patterns in individual histories, and graph neural networks incorporate network topology through neighborhood aggregation. Yet these approaches learn statistical correlations without any explicit formulation of social influence mechanisms. The authors point out that under observational noise, this lack of structural grounding causes substantial error accumulation over long prediction horizons, causing predicted trajectories to drift away from the actual dynamics of opinion change.</p>
<p>GA-ODE, short for graph attention with ordinary differential equations, belongs to an emerging middle ground sometimes called socially informed neural networks, which borrows ideas from physics-informed neural networks and Neural ODEs. The architecture has four cooperating components. First, each user receives a learnable embedding vector concatenated with their initially observed opinion, and a multilayer perceptron converts timestamps into continuous-time feature vectors. Second, a graph attention network computes unnormalized attention scores between a target user and each neighbor, normalizes them through a softmax function, and aggregates neighborhood information using a multi-head mechanism. This allows the model to learn differentiated aggregation weights, reflecting the fact that not all neighbors matter equally.</p>
<p>Third, inspired by the gating machinery of LSTM networks, the model employs a gated evolution unit to balance two opposing forces: individual opinion persistence and neighborhood assimilation. A forget gate, computed jointly from the temporal features and the user&#8217;s previous hidden state, determines how much of the historical cognitive state to retain. An input gate and a candidate cell state then control how much aggregated neighborhood information flows into the update, while an output gate regulates the contribution of the cell state to the final hidden representation. A self-attention module subsequently fuses the user&#8217;s hidden state with the temporal embedding, capturing the dynamic correlation between who a user is and when the prediction is being made.</p>
<p>The fourth and most distinctive component is a structure-aware ODE consistency constraint rooted in the Stochastic Bounded Confidence Model. Instead of a hard confidence threshold that forbids interaction between people holding divergent views, this probabilistic formulation assigns interaction probabilities inversely related to opinion distance, so individuals are more likely to engage like-minded peers but occasionally interact with those who disagree. The authors derive a continuous-time dynamical system from the discrete interaction rule, and because sampling discrete interaction partners is not differentiable, they apply the Gumbel-Softmax reparameterization trick to create a smooth, differentiable relaxation. The training loss then penalizes the squared difference between the time derivative of the predicted opinion trajectory, computed via automatic differentiation at randomly sampled collocation points, and the expected social influence term restricted to each user&#8217;s immediate neighborhood by an adjacency matrix mask.</p>
<p>The team evaluated GA-ODE against ten baselines, ranging from the classical Voter and DeGroot models to spatiotemporal graph networks like STGCN and T-GCN and socially informed rivals such as SINN, NPBC, and TT-SBCM. On three synthetic datasets engineered to produce consensus, polarization, and clustering dynamics, GA-ODE achieved accuracies of 0.892, 0.948, and 0.977 respectively. On a real-world dataset of political interactions gathered from the X platform between December 2023 and March 2024, containing roughly 10,883 messages from 526 users across 384 time steps, it reached an accuracy of 0.655. Compared with the strongest baseline, TT-SBCM, the improvements ranged from 1.5 to 3.7 percentage points, and two-tailed Welch&#8217;s t-tests across five random seeds confirmed the gains were statistically significant on every dataset.</p>
<p>Ablation experiments revealed why each piece matters. Replacing graph attention with uniform average-pooling aggregation dropped the macro-F1 score on the consensus dataset from 0.806 to 0.608, confirming that differentiated neighbor influence is essential. Removing the gating mechanism caused similar degradation, showing that opinion inertia cannot be captured by simply concatenating features. Perhaps most intriguingly, the topology-aware mask provided only limited benefits on clean graphs, where the graph attention encoder could already extract sufficient neighborhood information, but proved decisive under structural degradation. When 30 percent of edges were corrupted with spurious connections, GA-ODE maintained an accuracy of 0.621 while the mask-free variant fell to 0.551, and similar advantages appeared under missing edges and isolated nodes.</p>
<p>The robustness tests extended beyond network damage to the dynamics themselves. Real opinion change rarely follows smooth assimilation: sharp disagreement can trigger repulsive interactions driven by cognitive dissonance or the backfire effect, and sudden external events can jolt entire populations at once. When the team injected opinion-repulsion effects into the simulation, baseline models lost 4.6 to 7.3 percentage points of accuracy while GA-ODE lost only 2.3 to 2.8. Under external shocks delivered at specific time points, baselines dropped 3.2 to 5.2 points against GA-ODE&#8217;s 1.5 to 1.7. A t-SNE visualization further showed that the model&#8217;s latent representations form clearer, more discriminative clusters than those of the SINN baseline on the election data.</p>
<p>The authors are candid about the model&#8217;s limits. It assumes that social interactions remain static within the observation window, an idealization that real platforms routinely violate, and it is sensitive to sparsely represented opinion classes, which explains the gap between its accuracy and macro-F1 score on the imbalanced election dataset. Real-world validation also rested on a single platform and topic. Future work, they write, will pursue scalable graph learning and efficient ODE solving for large networks, dynamic graph modeling to capture the co-evolution of relationships and opinions, and broader evaluation across platforms and domains. Even so, GA-ODE offers a compelling demonstration that the century-old mathematics of social influence, when welded carefully onto graph attention networks and continuous-time dynamics, can make the messy evolution of human belief measurably more predictable.</p>
<p><strong>Subject of Research:</strong> A hybrid machine learning model combining graph attention and neural ordinary differential equations to predict opinion dynamics on social networks</p>
<p><strong>Article Title:</strong> An opinion evolution prediction model based on graph attention and ordinary differential equations</p>
<p><strong>Article References:</strong> Liu, Q., Duan, L., Jia, M., &amp; Li, Y. (2026). An opinion evolution prediction model based on graph attention and ordinary differential equations. <em>Discover Artificial Intelligence, 6</em>(1), Article 1474. <a href="https://doi.org/10.1007/s44163-026-02445-z" rel="noopener noreferrer">https://doi.org/10.1007/s44163-026-02445-z</a></p>
<p><strong>Image Credits:</strong> AI Generated</p>
<p><strong>DOI:</strong> <a href="https://doi.org/10.1007/s44163-026-02445-z" rel="noopener noreferrer">10.1007/s44163-026-02445-z</a></p>
<p><strong>Keywords:</strong> opinion dynamics, graph attention networks, neural ordinary differential equations, social media, bounded confidence model, prediction, social networks, polarization, machine learning, computational social science, robustness, socially informed neural networks</p>
]]></content:encoded>
					
		
		
		<post-id xmlns="com-wordpress:feed-additions:1">269387</post-id>	</item>
		<item>
		<title>Graph Transformer Model Aims to Sharpen RNA Velocity Predictions in Single-Cell Genomics</title>
		<link>https://scienmag.com/graph-transformer-model-aims-to-sharpen-rna-velocity-predictions-in-single-cell-genomics/</link>
		
		<dc:creator><![CDATA[Juliet Wilcox]]></dc:creator>
		<pubDate>Sun, 04 Oct 2026 00:17:11 +0000</pubDate>
				<category><![CDATA[Biology]]></category>
		<category><![CDATA[BMC Bioinformatics]]></category>
		<category><![CDATA[capturing cellular relationships with deep learning]]></category>
		<category><![CDATA[cell differentiation]]></category>
		<category><![CDATA[cellular differentiation trajectory prediction]]></category>
		<category><![CDATA[computational biology]]></category>
		<category><![CDATA[deep learning]]></category>
		<category><![CDATA[deep learning for cellular state prediction]]></category>
		<category><![CDATA[dynamic cell state modeling]]></category>
		<category><![CDATA[graph transformer]]></category>
		<category><![CDATA[graph transformer neural networks in genomics]]></category>
		<category><![CDATA[graph-based models for gene expression]]></category>
		<category><![CDATA[multi-head attention]]></category>
		<category><![CDATA[multi-head attention in single-cell data analysis]]></category>
		<category><![CDATA[multi-omics integration]]></category>
		<category><![CDATA[neural ordinary differential equations]]></category>
		<category><![CDATA[neural ordinary differential equations in bioinformatics]]></category>
		<category><![CDATA[novel mechanisms in RNA velocity modeling]]></category>
		<category><![CDATA[RNA velocity]]></category>
		<category><![CDATA[RNA velocity estimation methods]]></category>
		<category><![CDATA[Single-Cell RNA Sequencing]]></category>
		<category><![CDATA[single-cell RNA velocity analysis]]></category>
		<category><![CDATA[single-cell sequencing data interpretation]]></category>
		<category><![CDATA[trajectory inference]]></category>
		<category><![CDATA[Transcriptomics]]></category>
		<guid isPermaLink="false">https://scienmag.com/?p=232706</guid>

					<description><![CDATA[Researchers have developed GTVelo, a graph transformer-based neural ordinary differential equation model that improves RNA velocity inference by capturing long-range cellular relationships and multi-branch trajectories from single-cell data.]]></description>
										<content:encoded><![CDATA[<p>Single-cell biology has been transformed over the past decade by the ability to measure gene expression in thousands of individual cells at once, but a snapshot of expression levels only tells part of the story. Cells are dynamic entities, constantly transitioning between states as they develop, differentiate, and respond to their environment. One of the most influential computational techniques for recovering that hidden dynamics from static data is RNA velocity, a method that estimates the direction and speed of a cell&#8217;s movement through transcriptional state space. Now, a team of researchers in China has introduced a new deep learning approach, called GTVelo, that applies a graph transformer architecture to the RNA velocity problem, with the goal of capturing cellular relationships that existing methods tend to miss. The work, published as a research article in BMC Bioinformatics, describes a neural ordinary differential equation model built around multi-head attention and a novel multi-origin state mechanism.</p>
<p>To understand why the new model matters, it helps to revisit what RNA velocity actually measures. Standard single-cell RNA sequencing counts mature, spliced transcripts, but many protocols also capture unspliced nascent RNA that has not yet been processed. Because unspliced RNA reflects genes that a cell has recently started transcribing, the ratio between unspliced and spliced counts for each gene provides a hint about whether that gene is being induced or repressed. By combining these signals across thousands of genes, RNA velocity methods can infer a vector field over the cell population, pointing each cell toward its likely future state. This allows researchers to reconstruct developmental trajectories, identify lineage relationships, and predict the endpoints of differentiation without needing time-series measurements.</p>
<p>The original formulation of RNA velocity relied on a dynamical model of splicing kinetics, treating the interplay between unspliced and spliced RNA as a set of ordinary differential equations whose parameters could be estimated from the data. While elegant, this approach struggles with the noise, dropout, and sparsity that plague single-cell datasets, and it often produces inconsistent velocity estimates across complex, multi-lineage systems. Subsequent methods have taken different routes: some simplify the problem by assuming steady-state kinetics, while others turn to neural networks to learn the velocity field directly from latent representations of gene expression. These neural approaches have improved robustness, but they come with their own limitations, particularly in how they model relationships between cells.</p>
<p>A key weakness of many current neural velocity models, the authors of the new study argue, lies in their reliance on local neighborhood structure. Most pipelines begin by constructing a k-nearest neighbor graph in a reduced-dimensional space, typically using principal component analysis to compress the high-dimensional expression profiles. The graph is meant to approximate the local geometry of the transcriptional manifold, and velocity information is propagated only between neighboring cells. Yet in real tissues, biologically related cells may not be nearest neighbors in the embedding space. Cells that lie far apart in the graph can still share developmental ancestry or be destined for similar fates, and these long-range dependencies carry information that a purely local model discards. Capturing them requires an architecture capable of attending to arbitrary pairs of cells rather than only to immediate neighbors.</p>
<p>That is precisely where the transformer comes in. Transformers, the architecture family that underpins modern large language models, are built around self-attention, a mechanism that lets each element in a set compute weighted relationships with every other element. Multi-head attention extends this by running several attention computations in parallel, each with its own learned projection, so that different heads can specialize in different kinds of relationships. Applied to single-cell data, a graph transformer can in principle learn which cells are relevant to one another regardless of their distance in the neighborhood graph, while the graph structure itself provides an inductive bias that keeps the model grounded in the observed topology of the data. GTVelo combines these ingredients within a neural ordinary differential equation framework, meaning that the learned attention-based representation feeds into a continuous-time dynamical model of how cell states evolve.</p>
<p>The neural ordinary differential equation component is significant in its own right. Rather than discretizing time into steps, a neural ODE defines the derivative of the cell&#8217;s latent state as the output of a neural network, and the trajectory is obtained by integrating that derivative forward. This continuous formulation is a natural fit for RNA velocity, which is fundamentally about the instantaneous rate of change of transcriptional state. It also allows the model to produce smooth trajectories through latent space, which is important when the underlying biology involves gradual differentiation rather than abrupt jumps between discrete states. By embedding the transformer-based encoder inside this dynamical system, GTVelo seeks to couple rich relational modeling of the cell population with principled temporal dynamics.</p>
<p>One of the more distinctive features of the new model is what the authors call a multi-origin state mechanism. Many existing approaches effectively assume that all trajectories in a dataset can be described starting from a single initial state, which becomes problematic in datasets containing multiple lineages, branching differentiation paths, or heterogeneous cell populations. A single origin forces the model to squeeze fundamentally different developmental stories into one shared starting point, degrading the accuracy of velocity estimates for every lineage involved. GTVelo instead allows inference to proceed from multiple origins, which the authors say enables flexible handling of multi-branch trajectories. This flexibility also extends to data integration: the model is designed to accommodate multi-omics inputs, reflecting the growing trend in genomics toward assays that measure RNA alongside chromatin accessibility, protein abundance, or other molecular layers in the same cells.</p>
<p>According to the study, GTVelo was evaluated across multiple benchmark datasets and compared against established RNA velocity methods using standard evaluation metrics. The reported results show competitive performance overall, with GTVelo outperforming the compared methods on most of the standard metrics in most cases. Two of the evaluation concepts highlighted in the paper are cross-boundary directedness, which measures whether inferred velocities correctly point across the boundaries between clusters in a biologically consistent direction, and in-cluster coherence, which assesses whether velocity vectors within a cluster are mutually consistent rather than pointing in conflicting directions. Together, these metrics probe whether a velocity model captures both the global organization of a trajectory and the local smoothness of the inferred dynamics, two properties that are often in tension.</p>
<p>The implications for downstream biology could be substantial. RNA velocity is widely used to annotate developmental hierarchies, trace the origins of disease-associated cell states, and generate hypotheses about lineage commitment in contexts ranging from embryogenesis to tumor evolution. Models that handle branching trajectories and long-range cellular associations more reliably could improve the fidelity of these analyses, particularly in complex tissues where multiple lineages coexist and where rare transitional populations carry outsized biological importance. The stated ability to integrate multi-omics data points toward applications in which velocity is estimated from joint measurements, potentially revealing regulatory dynamics that transcript-only models cannot see. As with any computational method, real-world performance will depend on how the benchmarks translate to noisy, dataset-specific conditions, and independent validation by the community will be an important next step.</p>
<p>The research was carried out by Shensi Huang, Hongyu Zhang, and Jianping Zhao of Xinjiang University, together with Zile Wang of Dalian University of Technology, Haiyun Wang of Wuhan University of Science and Technology, and Junfeng Xia of Anhui University, and was supported by funding including grants from the National Natural Science Foundation of China. The article was published open access in BMC Bioinformatics on 15 September 2026, with the accepted manuscript shared early under a permanent DOI. For a field that has seen a rapid succession of velocity methods, each claiming incremental gains, GTVelo&#8217;s contribution lies in bringing the attention machinery of modern deep learning to bear on a problem that has long been constrained by local graph assumptions and single-origin trajectory models. Whether graph transformers become a standard component of the single-cell dynamics toolbox, the study adds a technically grounded option for researchers wrestling with the messy, branching reality of cellular differentiation.</p>
<p><strong>Subject of Research:</strong> RNA velocity inference in single-cell transcriptomics using a graph transformer-based neural ordinary differential equation model</p>
<p><strong>Article Title:</strong> RNA velocity inference based on graph transformer</p>
<p><strong>Article References:</strong> Huang, S., Wang, Z., Zhang, H., Wang, H., Zhao, J., &amp; Xia, J. (2026). RNA velocity inference based on graph transformer. <em>BMC Bioinformatics</em>. <a href="https://doi.org/10.1186/s12859-026-06550-9" rel="noopener noreferrer">https://doi.org/10.1186/s12859-026-06550-9</a></p>
<p><strong>Image Credits:</strong> AI Generated</p>
<p><strong>DOI:</strong> <a href="https://doi.org/10.1186/s12859-026-06550-9" rel="noopener noreferrer">10.1186/s12859-026-06550-9</a></p>
<p><strong>Keywords:</strong> RNA velocity, single-cell RNA sequencing, graph transformer, neural ordinary differential equations, trajectory inference, cell differentiation, deep learning, multi-head attention, multi-omics integration, transcriptomics, computational biology, BMC Bioinformatics</p>
]]></content:encoded>
					
		
		
		<post-id xmlns="com-wordpress:feed-additions:1">232706</post-id>	</item>
	</channel>
</rss>
