<?xml version="1.0" encoding="UTF-8"?><rss version="2.0"
	xmlns:content="http://purl.org/rss/1.0/modules/content/"
	xmlns:wfw="http://wellformedweb.org/CommentAPI/"
	xmlns:dc="http://purl.org/dc/elements/1.1/"
	xmlns:atom="http://www.w3.org/2005/Atom"
	xmlns:sy="http://purl.org/rss/1.0/modules/syndication/"
	xmlns:slash="http://purl.org/rss/1.0/modules/slash/"
	>

<channel>
	<title>universal approximation &#8211; Science</title>
	<atom:link href="https://scienmag.com/tag/universal-approximation/feed/" rel="self" type="application/rss+xml" />
	<link>https://scienmag.com</link>
	<description></description>
	<lastBuildDate>Wed, 30 Sep 2026 17:25:37 +0000</lastBuildDate>
	<language>en-US</language>
	<sy:updatePeriod>
	hourly	</sy:updatePeriod>
	<sy:updateFrequency>
	1	</sy:updateFrequency>
	<generator>https://wordpress.org/?v=7.1.2</generator>

<image>
	<url>https://scienmag.com/wp-content/uploads/2024/07/cropped-scienmag_ico-32x32.jpg</url>
	<title>universal approximation &#8211; Science</title>
	<link>https://scienmag.com</link>
	<width>32</width>
	<height>32</height>
</image> 
<site xmlns="com-wordpress:feed-additions:1">73899611</site>	<item>
		<title>New Geometry-Aware AI Reads the Global Shape of Networks Through Distance Fingerprints</title>
		<link>https://scienmag.com/new-geometry-aware-ai-reads-the-global-shape-of-networks-through-distance-fingerprints/</link>
		
		<dc:creator><![CDATA[Blake Davidson]]></dc:creator>
		<pubDate>Wed, 30 Sep 2026 17:25:37 +0000</pubDate>
				<category><![CDATA[Technology and Engineering]]></category>
		<category><![CDATA[anchor points in graph analysis]]></category>
		<category><![CDATA[coarse geometry]]></category>
		<category><![CDATA[coarse geometry in AI]]></category>
		<category><![CDATA[distance fingerprints in machine learning]]></category>
		<category><![CDATA[geometric deep learning]]></category>
		<category><![CDATA[geometry-aware AI models]]></category>
		<category><![CDATA[global network shape perception]]></category>
		<category><![CDATA[Graph Neural Networks]]></category>
		<category><![CDATA[graph neural networks limitations]]></category>
		<category><![CDATA[Gromov-hyperbolic spaces]]></category>
		<category><![CDATA[hyperbolic geometry]]></category>
		<category><![CDATA[large-scale network shape analysis]]></category>
		<category><![CDATA[Machine learning]]></category>
		<category><![CDATA[metric space representations]]></category>
		<category><![CDATA[metric spaces]]></category>
		<category><![CDATA[Network geometry]]></category>
		<category><![CDATA[networks]]></category>
		<category><![CDATA[nonlinear distance functions]]></category>
		<category><![CDATA[quasi-isometry]]></category>
		<category><![CDATA[quasi-isometry in neural networks]]></category>
		<category><![CDATA[representation learning]]></category>
		<category><![CDATA[spectral embedding]]></category>
		<category><![CDATA[structure-aware graph embedding]]></category>
		<category><![CDATA[universal approximation]]></category>
		<guid isPermaLink="false">https://scienmag.com/?p=217454</guid>

					<description><![CDATA[A UCLA mathematician has introduced a distance-based representation learning framework grounded in coarse geometry that reads the global shape of networks directly, dramatically outperforming local and spectral methods on graphs that differ in large-scale structure.]]></description>
										<content:encoded><![CDATA[<p>A mathematician at the University of California, Los Angeles has proposed a new way for machine learning systems to perceive the large-scale shape of networks, and the results suggest that a decades-old habit of artificial intelligence may be blinding it to some of the most important structure in the data. In a paper published in Neural Processing Letters, Koffi Enakoutsa of the UCLA Department of Mathematics introduces a representation learning framework built on coarse geometry, the branch of mathematics that studies metric spaces up to quasi-isometry, meaning up to distortions that stretch distances by bounded multiplicative and additive factors. The central idea is deceptively simple: instead of letting a neural network infer the geometry of a graph by repeatedly aggregating information from immediate neighbors, the model reads geometry directly, through nonlinear functions of the distances from every point to a learned set of anchor points.</p>
<p>The motivation comes from a well-known blind spot in graph neural networks. These architectures, along with classical spectral embedding methods, build their representations by aggregating local neighborhood information, layer by layer or eigenvector by eigenvector. That strategy works well when the properties that matter are themselves local, such as the content similarity of connected documents. But it systematically misses global metric properties: how quickly the volume of a space grows with distance, whether the space is hyperbolic in the sense of Gromov, and what the boundary at infinity looks like. Those coarse-geometric signatures are precisely what distinguish a grid from a tree, or a flat lattice from a negatively curved hierarchical network, even when the two graphs are indistinguishable at the level of small neighborhoods.</p>
<p>Enakoutsa&#8217;s framework formalizes this intuition with three mathematical guarantees. First, the learned representations are stable under quasi-isometries: if two metric spaces are coarsely equivalent, meaning one can be mapped onto the other with bounded distortion, their distance-based feature representations remain correspondingly close. This is the property that makes the features genuinely geometric rather than artifacts of a particular graph labeling. Second, the framework satisfies a universal approximation property for the distance-generated algebra on compact metric spaces, meaning that with enough anchors and appropriate nonlinearities, the model can approximate any continuous function in that algebra arbitrarily well. Third, the method extends naturally to the boundary at infinity of Gromov-hyperbolic spaces, the idealized boundary points that encode how geodesics diverge, which is where the hierarchical structure of many real networks actually lives.</p>
<p>The parametric model works as follows. A set of anchor points is chosen in the metric space, and each data point is described not by its adjacency relations but by the vector of its distances to those anchors. These distances are then passed through nonlinear activations with learnable scales, so that the entire feature map is differentiable and the anchors themselves can be trained by gradient descent. The result is what the author calls a nonlinear feature algebra: a family of functions generated by distance measurements, closed under the nonlinear transformations the network applies. Because distance to an anchor is a global quantity, every feature already carries information about the position of a point relative to the whole space, not just its immediate surroundings.</p>
<p>The experimental test was designed to isolate exactly the capability that local methods lack. Enakoutsa constructed pairs of graphs that share low-order local structure but differ in their coarse geometry, such as grid graphs and tree graphs. Locally, both look like ordinary networks; globally, a grid is flat and grows quadratically while a tree is hyperbolic and grows exponentially. A tanh-activated distance representation achieved a mean accuracy of 77.8 percent, with a standard deviation of 5.8 percent, in separating grid from tree topology across ten runs. The local and spectral baselines managed only 48.7 plus or minus 5.9 percent and 45.5 plus or minus 5.1 percent respectively, essentially chance performance, and the difference was highly significant with a paired t-test yielding p less than ten to the minus five.</p>
<p>The activation function turned out to matter enormously. When the saturating tanh nonlinearity was replaced with a non-saturating ReLU, performance on the same grid-versus-tree task jumped to 99.9 plus or minus 0.4 percent, near-perfect separation. The same ReLU-activated representation also achieved 96.2 plus or minus 2.4 percent accuracy in distinguishing a grid from a Barabási-Albert scale-free graph, another pair whose members differ dramatically in growth rate and curvature. The contrast between the two activations suggests that the saturating behavior of tanh compresses exactly the long-range distance information the method depends on, while the unbounded ReLU preserves the dynamic range needed to encode global geometry.</p>
<p>On real-world networks, however, the picture became more nuanced, and the author is careful to report this scope dependence rather than overclaim. The distance-based representation outperformed spectral embedding on the Zachary karate club network and on the Les Misérables co-occurrence network, both small graphs whose structure is strongly shaped by community and hierarchy. But on the Cora and PubMed citation networks, which reach up to roughly 20,000 nodes, spectral embedding won. The reason, according to the paper, is that the labels in those citation datasets track content homophily, the tendency of papers to cite similar papers, rather than coarse geometry. When the signal in the data is local and content-driven, local aggregation remains the right tool; when the signal is global and metric, the distance-based approach dominates.</p>
<p>This honest boundary of applicability may prove as informative as the headline results. The work does not claim that distance features should replace message passing everywhere. Instead, it identifies a class of problems, those governed by growth rate, hyperbolicity, and boundary structure, where local methods are provably and empirically inadequate, and supplies a principled alternative with mathematical guarantees. The connection to coarse geometry also gives the field a vocabulary it has lacked: quasi-isometry invariance is a much weaker and more robust equivalence than graph isomorphism, and methods that respect it should generalize across graphs that look different locally but share the same large-scale shape.</p>
<p>The implications reach into several active areas of machine learning. Hyperbolic embeddings have become popular for hierarchical data such as knowledge graphs, taxonomies, and biological phylogenies, precisely because negatively curved spaces can embed tree-like structure with low distortion. The new framework offers a way to detect and exploit that hyperbolicity directly from distances, rather than committing to a particular embedding space in advance. It also connects to geometric deep learning, the broad research program aiming to build neural architectures whose inductive biases respect the symmetries and structure of the underlying data domain, and to the theory of neural and nonlocal operators, both listed among the paper&#8217;s keywords.</p>
<p>Published open access under a Creative Commons Attribution 4.0 license and released as a citable version of record with a permanent DOI, the paper arrives from an unexpected direction: a mathematics department rather than a computer science lab, and without external funding. That provenance is fitting for a contribution whose main strength is conceptual. By grounding representation learning in the mathematics of large-scale metric structure, the work suggests that the next advance in how machines understand networks may come not from deeper stacks of local message passing, but from teaching them to measure distances and read the shape of the whole space at once. Whether the approach can be scaled efficiently to graphs with millions of nodes, and whether hybrid architectures can combine local content signals with global geometric ones, are the natural next questions for this emerging line of research.</p>
<p><strong>Subject of Research:</strong> Distance-based representation learning for graphs using nonlinear functions of distances to learnable anchor points, grounded in coarse geometry</p>
<p><strong>Article Title:</strong> Distance-Based Representation Learning with Nonlinear Feature Algebras</p>
<p><strong>Article References:</strong> Enakoutsa, K. (2026). Distance-Based Representation Learning with Nonlinear Feature Algebras. <em>Neural Processing Letters</em>. <a href="https://doi.org/10.1007/s11063-026-11882-x" rel="noopener noreferrer">https://doi.org/10.1007/s11063-026-11882-x</a></p>
<p><strong>Image Credits:</strong> AI Generated</p>
<p><strong>DOI:</strong> <a href="https://doi.org/10.1007/s11063-026-11882-x" rel="noopener noreferrer">10.1007/s11063-026-11882-x</a></p>
<p><strong>Keywords:</strong> geometric deep learning, coarse geometry, representation learning, graph neural networks, hyperbolic geometry, universal approximation, spectral embedding, metric spaces, quasi-isometry, networks, machine learning, Gromov-hyperbolic spaces</p>
]]></content:encoded>
					
		
		
		<post-id xmlns="com-wordpress:feed-additions:1">217454</post-id>	</item>
		<item>
		<title>Quantum neural operator learns PDEs with quadratic expressivity edge</title>
		<link>https://scienmag.com/quantum-neural-operator-learns-pdes-with-quadratic-expressivity-edge/</link>
		
		<dc:creator><![CDATA[Cassandra Pierce]]></dc:creator>
		<pubDate>Sun, 13 Sep 2026 03:20:08 +0000</pubDate>
				<category><![CDATA[Technology and Engineering]]></category>
		<category><![CDATA[DeepONet]]></category>
		<category><![CDATA[expressivity]]></category>
		<category><![CDATA[IBM quantum processors]]></category>
		<category><![CDATA[neural operators]]></category>
		<category><![CDATA[neural operators for fluid dynamics]]></category>
		<category><![CDATA[neural operators for PDEs]]></category>
		<category><![CDATA[NISQ era]]></category>
		<category><![CDATA[noisy intermediate-scale quantum era]]></category>
		<category><![CDATA[partial differential equations]]></category>
		<category><![CDATA[partial differential equations solvers]]></category>
		<category><![CDATA[QuanONet]]></category>
		<category><![CDATA[QuanONet architecture]]></category>
		<category><![CDATA[quantum computational science]]></category>
		<category><![CDATA[Quantum Computing]]></category>
		<category><![CDATA[quantum deep learning benchmarks]]></category>
		<category><![CDATA[quantum error resilience]]></category>
		<category><![CDATA[Quantum machine learning]]></category>
		<category><![CDATA[Quantum neural networks]]></category>
		<category><![CDATA[quantum neural operator]]></category>
		<category><![CDATA[quantum vs classical neural models]]></category>
		<category><![CDATA[scientific machine learning]]></category>
		<category><![CDATA[trainable frequencies]]></category>
		<category><![CDATA[universal approximation]]></category>
		<guid isPermaLink="false">https://scienmag.com/?p=201208</guid>

					<description><![CDATA[Researchers have developed QuanONet, a quantum neural operator proven to achieve quadratic expressivity that outperforms quantum baselines and matches classical models on near-term quantum hardware.]]></description>
										<content:encoded><![CDATA[<p>Scientists at Shanghai Jiao Tong University have unveiled a quantum neural operator that promises to squeeze genuine machine-learning power out of today&#8217;s noisy, error-prone quantum processors. The architecture, called QuanONet, is designed specifically for the noisy intermediate-scale quantum era, the awkward period in which quantum computers possess enough qubits to be interesting but far too few to run the deep, fault-tolerant circuits that many quantum machine-learning proposals assume. In a study published in Nature Machine Intelligence, the team reports both a theoretical breakthrough and practical benchmarks suggesting that quantum models can, under carefully matched conditions, rival classical neural operators without demanding prohibitive qubit counts or circuit depths.</p>
<p>Neural operators have quietly become one of the most consequential tools in computational science. Instead of learning a mapping between finite vectors, they learn mappings between functions, which makes them natural solvers for partial differential equations. Given a family of PDEs describing, say, fluid flow through porous rock or heat diffusing through a material, a trained neural operator can predict the full solution field for a new set of parameters almost instantly, bypassing the expensive numerical solvers that would otherwise be required. Classical architectures such as DeepONet and the Fourier neural operator have transformed this landscape, but their quantum counterparts have lagged behind, hampered by processing overheads and theoretical gaps about what quantum circuits can actually represent.</p>
<p>The central obstacle has been scaling. Many quantum machine-learning paradigms demand qubit counts or circuit depths that grow so quickly with problem size that they collapse into impracticality on near-term hardware. The Shanghai team, led by Ruocheng Wang, Xiaoqiu Zhong, Zhuo Xia and Junchi Yan, attacked the problem from two directions at once: they built a leaner architecture and, crucially, they proved something rigorous about its power.</p>
<p>The theoretical centerpiece is an extension of the universal approximation theorem to the quantum domain for continuous nonlinear operators. Universal approximation, first established for classical neural networks in the 1990s, guarantees that sufficiently wide networks can represent a broad class of functions; the operator version underpins DeepONet. Proving an analogous guarantee for quantum circuits closes a foundational gap, but the team went further. Departing from the conventional view that quantum advantage must flow from the exponential size of Hilbert space, they showed that the architecture&#8217;s density matrix implicitly constructs a quadratic feature frame.</p>
<p>That quadratic frame yields a striking expressivity bound. For operators, the implicit feature space scales as O(p²) in the number of parameters p, circumventing the O(p) linear capacity limits of matched classical models. In plain terms, each additional parameter in the quantum model buys roughly a square&#8217;s worth of representational capacity compared with a classical model of the same size. This is a subtle but meaningful advantage: it does not rely on exotic claims about exponentially large state spaces, but on a concrete, provable property of how the quantum circuit encodes features.</p>
<p>The second innovation addresses a practical bottleneck known as spectrum alignment. Quantum models encode input data through frequency modulation, and capturing high-frequency components of a solution, the sharp gradients and fine oscillations that matter in real PDEs, typically requires either deep circuits or many parameters. The researchers introduced a trainable-frequency strategy, dubbed TF-QuanONet, in which the base frequencies of the encoding adaptively space themselves during training. The network effectively learns which frequencies to emphasize, capturing relatively high-frequency structure without inflating the parameter count or the circuit depth.</p>
<p>The benchmarks are where the claims meet reality. Across extensive experiments, TF-QuanONet notably outperformed competing quantum baselines and achieved accuracy competitive with classical frameworks under strictly matched-parameter conditions, a fairness constraint that quantum machine-learning comparisons often fail to honor. More intriguing still is what happened as the problems grew. In high-dimensional scaling regimes, with latent dimensions p approaching 256, the quantum architecture exhibited superior optimization robustness, consistently converging to its intrinsic error floor while classical baselines suffered from high variance. The quantum model was not just accurate; it was reliably trainable where its classical competitors became erratic.</p>
<p>The team also tested the architecture on real IBM quantum processors, including the ibm_fez device, as a qualitative proof of concept. Comparisons between noise-free simulations and physical hardware demonstrated that QuanONet retains functional resilience on near-term machines, a nontrivial achievement given that real qubits decohere, gates misfire, and measurement noise corrupts outputs. The experiments spanned a range of canonical problems, including dynamical systems, advection equations and Darcy flow, with visualizations confirming that predictions track ground-truth solutions across varying input frequencies.</p>
<p>The work arrives amid a broader reckoning in quantum machine learning, where researchers have grown wary of claims that evaporate under fair comparison or realistic hardware assumptions. By grounding its architecture in a proven expressivity theorem, keeping resource requirements modest, and validating on commercial hardware, the study offers a template for what credible quantum advantage in scientific machine learning might look like. The code has been released publicly on GitHub and archived on Zenodo, and all datasets were generated directly from it, inviting the community to scrutinize and extend the results.</p>
<p>Whether the quadratic expressivity edge translates into decisive practical wins as quantum hardware improves remains an open question, but the study reframes the debate. Rather than waiting for fault-tolerant machines or betting everything on exponential Hilbert spaces, it demonstrates that carefully designed quantum architectures, with theory and engineering aligned, can already hold their own against strong classical baselines on the noisy processors available today.</p>
<p><strong>Subject of Research:</strong> A quantum neural operator architecture with a proven quadratic expressivity bound for solving partial differential equations on near-term quantum hardware.</p>
<p><strong>Article Title:</strong> Quantum neural operators with implicit quadratic frame and expressivity advantages</p>
<p><strong>Article References:</strong> Wang, R., Zhong, X., Xia, Z., &amp; Yan, J. (2026). Quantum neural operators with implicit quadratic frame and expressivity advantages. <em>Nature Machine Intelligence</em>. <a href="https://doi.org/10.1038/s42256-026-01289-7" rel="noopener noreferrer">https://doi.org/10.1038/s42256-026-01289-7</a></p>
<p><strong>Image Credits:</strong> AI Generated</p>
<p><strong>DOI:</strong> <a href="https://doi.org/10.1038/s42256-026-01289-7" rel="noopener noreferrer">10.1038/s42256-026-01289-7</a></p>
<p><strong>Keywords:</strong> quantum machine learning, neural operators, partial differential equations, QuanONet, NISQ era, universal approximation, expressivity, trainable frequencies, IBM quantum processors, DeepONet, quantum computing, scientific machine learning</p>
]]></content:encoded>
					
		
		
		<post-id xmlns="com-wordpress:feed-additions:1">201208</post-id>	</item>
	</channel>
</rss>
