The diffuse Galactic emission is the fog of high-energy astrophysics. It arises when cosmic rays, protons and electrons accelerated by sources such as supernova remnants, collide with interstellar gas, dust grains, magnetic fields, and the sea of starlight that permeates the Galaxy. Protons smashing into gas produce neutral pions that decay into gamma rays, while electrons scatter low-energy photons up to gamma-ray energies through inverse Compton processes and radiate synchrotron light in magnetic fields. Disentangling these components is notoriously difficult because their contributions overlap and depend on poorly constrained distributions of gas, radiation, and cosmic rays. Traditional models, such as the widely used GALPROP code, solve the cosmic-ray transport equation with detailed parameterizations, but they require extensive tuning and still struggle in the structurally complex inner Galaxy.

The research team, led by Xi Liu and colleagues at Sun Yat-sen University, took a deliberately different route. Rather than assuming a physical model from first principles, they trained two standard machine learning algorithms, Random Forest and K-Nearest Neighbors regression, to learn a direct mapping between Planck’s nine all-sky foreground maps, spanning 30 to 857 gigahertz, and the gamma-ray intensity predicted by the Fermi-LAT interstellar emission model across 28 energy bins from 50 megaelectronvolts to 814 gigaelectronvolts. Each Planck band traces a different physical regime: the lowest frequencies are dominated by synchrotron radiation from cosmic-ray electrons, intermediate bands mix free-free and spinning-dust emission, and the highest frequencies are dominated by thermal dust, a reliable tracer of interstellar gas.

The results are striking. In the 0.1 to 10 gigaelectronvolt range, where the diffuse gamma-ray sky is brightest, the models achieve coefficients of determination above 0.90, peaking at 0.96 at 687 megaelectronvolts. The predicted full-sky maps reproduce the major morphological features of the gamma-ray Galaxy, and the extracted spectral energy distribution of the inner Galactic plane matches the reference model closely. The team verified that the learned relationship is not a local accident: when a model trained on one Galactic hemisphere was tested on the opposite side, performance varied by no more than 6 percent regardless of how large a training region was used, indicating that the microwave-to-gamma-ray connection reflects a robust, large-scale property of the Milky Way rather than a statistical fluke of nearby structures.

Perhaps the most physically revealing result comes from asking which Planck frequencies matter most. When the high-frequency bands, dominated by thermal dust emission, were used alone, they achieved predictive power nearly identical to that of all nine bands in the 0.1 to 10 gigaelectronvolt range, while the low-frequency synchrotron channels performed markedly worse. This is exactly what one would expect if the diffuse gamma-ray emission at these energies is hadronically dominated: gamma-ray intensity is proportional to the product of gas column density and cosmic-ray density, and dust is an excellent proxy for the gas that serves as the target material. Above 10 gigaelectronvolts, however, the predictive power of the low-frequency bands rises, consistent with a growing leptonic contribution in which the synchrotron-emitting electron population also produces gamma rays through inverse Compton scattering. The analysis thus provides an independent, data-driven confirmation of the standard picture of Galactic gamma-ray production.

The residual maps, showing where the learned mapping breaks down, read like a tour of the Galaxy’s most enigmatic structures. Positive residuals appear toward the Magellanic Clouds and Centaurus A, where abundant gas and dust in nearby systems tempt the model to predict hadronic gamma-ray emission that the reference maps treat separately. Warm ionized gas complexes such as Barnard’s Loop in Orion and the Gum Nebula also show over-predictions, because free-free emission is subdominant across the Planck bands. On the other side, negative residuals trace Loop I and the North Polar Spur, hinting at inverse-Compton-dominated radiation fields or enhanced electron populations that submillimeter dust tracers cannot capture. Around the Galactic Center, the residuals mirror the shape of the Fermi Bubbles, the giant gamma-ray lobes whose faint, hard-spectrum microwave counterpart is too subtle for the model to disentangle without explicit priors.

The team also uncovered a curious hemispheric asymmetry: at high Galactic latitudes, the model systematically under-predicts the north while over-predicting the south by 10 to 30 percent on average. Because the discrepancy is spatially coherent rather than random, it may point to genuine physical differences between the two Galactic hemispheres, such as variations in cosmic-ray density or radiation fields. A segmented analysis of the inner Galaxy further showed that the asymmetry is concentrated within 30 degrees of the Galactic Center, likely linked to the Galactic bar and spiral-arm tangents, while the outer disk behaves with remarkable uniformity.

In a direct head-to-head comparison at roughly 4.3 gigaelectronvolts, the machine learning approach outperformed a GALPROP simulation tuned to the latest AMS-02 cosmic-ray data in the inner disk and Galactic Center region, achieving a coefficient of determination of 0.9465 and a mean absolute relative error of 14.7 percent, compared with 0.8624 and 22.3 percent for the physical model. GALPROP, by contrast, held a slight edge in the more homogeneous outer disk and in parts of the halo, confirming its reliability under simpler conditions. The authors emphasize that the two approaches are complementary: the data-driven model absorbs non-linear multi-frequency correlations that static gas distributions miss, while the physical simulation remains indispensable for interpretation and extrapolation.

An appendix to the study adds a compelling validation using raw Fermi-LAT photon counts rather than the smoothed emission model. As exposure accumulated over 40 weeks of mission data, the predictive performance climbed steadily and stabilized, and the negative residuals in the predicted maps turned out to coincide with 86 known gamma-ray point sources cataloged by Fermi, including pulsars, blazars, and a radio galaxy. Because the machine learning model learned the diffuse background purely from gas and dust maps without ever seeing point-source information, any compact gamma-ray emitter naturally surfaces as a localized deficit, offering an independent check on standard source-detection pipelines.

Beyond its immediate results, the work positions machine learning as a physically interpretable instrument rather than a black box. The learned mapping encodes real relationships between interstellar matter, radiation fields, and cosmic-ray processes, and its failures mark precisely the regions where conventional templates are incomplete or biased. The authors propose extending the framework with low-frequency radio surveys such as the Haslam 408-megahertz map, polarized microwave channels, and hydrogen-alpha data on ionized gas, and eventually integrating X-ray, ultra-high-energy gamma-ray, and neutrino observations. Such a multi-messenger, data-driven baseline could help separate standard emission from exotic components, sharpen constraints on cosmic-ray propagation, and, in an era when IceCube has detected Galactic neutrinos and LHAASO has measured PeV-scale diffuse emission, provide the empirical foundation that next-generation high-energy astrophysics will demand.

Subject of Research: Data-driven machine learning modeling of Galactic diffuse gamma-ray emission using multi-wavelength Planck observations

Article Title: Data-driven modeling of Galactic diffuse emission with multi-wavelength observations

Article References: Data-driven modeling of Galactic diffuse emission with multi-wavelength observations. (n.d.). https://doi.org/10.1140/epjc/s10052-026-16408-2

Image Credits: AI Generated

DOI: 10.1140/epjc/s10052-026-16408-2

Keywords: Galactic diffuse emission, machine learning, Planck satellite, Fermi-LAT, cosmic rays, gamma-ray astronomy, interstellar medium, inverse Compton, hadronic emission, GALPROP, Fermi Bubbles, multi-messenger astrophysics

The story begins with the physics of the early universe. About 380,000 years after the Big Bang, the scattering of radiation by free electrons generated a small amount of linear polarization in the CMB, a process somewhat analogous to the polarization produced when sunlight scatters in the Earth’s atmosphere. That polarization comes in two distinct varieties. E modes, first detected in 2002, arise from density shifts in the primordial plasma and display symmetric patterns across the sky. B modes, by contrast, have curl-like swirl patterns. Gravitational lensing, the distortion of CMB light by matter lying between us and the early universe, produces B modes that have already been observed, while primordial gravitational waves rippling through spacetime could produce an additional B-mode signal that has so far eluded detection. Finding that primordial signal would transform our understanding of the infant cosmos and could strongly support particular models of cosmic inflation, the theorized exponential expansion that shaped the universe in its first fraction of a second.

Against this backdrop, cosmic birefringence has emerged as one of the most tantalizing possibilities in observational cosmology. Recent analyses have suggested that the polarization of the CMB may have rotated by only a fraction of a degree during its nearly fourteen-billion-year journey. That sounds vanishingly small, but even such a slight rotation would be profound. It could provide evidence for physics beyond the Standard Model of particle physics, and it might offer clues about the nature of dark matter and dark energy, the mysterious components that together account for roughly 95 percent of the universe’s energy density. One possible explanation involves an axion-like field coupled to light, a class of hypothetical particles that would not necessarily constitute dark matter but whose existence would nonetheless revolutionize particle physics. Other theories connect cosmic birefringence to fields associated with dark energy itself, making the measurement a potential window onto some of the deepest mysteries in modern science.

There is, however, a formidable catch, and it lies at the heart of the new research. Even a minuscule error in the orientation of a telescope’s polarization-sensitive detectors can produce almost exactly the same observed effect as a genuine cosmic rotation. From the CMB signal alone, scientists cannot distinguish between a uniform rotation imposed by the cosmos and a common miscalibration of detector orientation, because both produce precisely the same pattern in the data. In other words, the very measurement that could reveal new physics is also the measurement most vulnerable to being faked by instrumental imperfections. As Anto I. Lonappan, a postdoctoral fellow at UC San Diego and lead author of the new study, explains, the stakes of getting this right could hardly be higher. “The signal we are looking for is incredibly small, so we have to be certain that we are seeing the universe and not our instrument,” Lonappan said. “Our method gives us a complementary way to check that distinction. Before interpreting a tiny rotation as new physics, we want to know that the calibration itself can be trusted.”

The UC San Diego team, which also includes Chancellor’s Distinguished Professor of Physics Brian Keating and Associate Professor of Physics Kam Arnold, approached the problem with an elegant strategy built on comparison. Rather than relying on a single map of the sky, the researchers compared maps made from different groups of detectors. The logic is straightforward but powerful: a genuine cosmic rotation would be common to all the maps, because the universe rotates the polarization of every photon in the same way. In the new method, that common rotation cancels out when the maps are compared against one another, leaving behind only the differences in their polarization calibration. The technique is intentionally blind to any rotation shared by all the maps, which means it can determine how well different detector sets are calibrated relative to one another, but it cannot by itself establish the overall polarization angle or the absolute cosmic birefringence signal. That final step still requires an independent absolute calibration reference.

To put their method to the test, the researchers developed a different estimator and applied it to existing observations from the European Space Agency’s Planck satellite, which spent years mapping the CMB across the entire sky. The team applied the technique to eight Planck polarization maps and compared the resulting calibration pattern with that obtained from the established analysis currently used to separate instrumental rotation from cosmic birefringence, an approach known as the Minami-Komatsu analysis. The result was reassuring: the two approaches were found to be consistent, despite relying on different assumptions. As a conditional demonstration, the researchers anchored their differential reconstruction to the common calibration mode inferred by the existing analysis, which reproduced a cosmic-birefringence angle of 0.37 plus or minus 0.12 degrees, consistent with the Minami-Komatsu result. The study, published in the Astrophysical Journal Letters, thus provides an important cross-check on one of cosmology’s most intriguing recent claims.

The significance of this work extends well beyond the specific question of cosmic birefringence. The calibration method developed at UC San Diego could directly support the search for primordial B modes, the curl-like polarization patterns that would constitute evidence for gravitational waves in the early universe. The reason is subtle but critical: relative angle-calibration errors between detector sets can convert E modes into spurious B modes, contaminating exactly the signal that inflation hunters are trying to isolate. By identifying such errors before they can masquerade as a cosmological signal, the new framework acts as a safeguard for the next generation of experiments. As instruments push polarization measurements to increasingly high precision, the margin for instrumental error shrinks dramatically, and independent calibration checks will become an essential part of the analysis pipeline before very small signals are interpreted as evidence for new physics.

That need is about to become acute. Experiments such as those at the Simons Observatory, where Keating serves as principal investigator, are designed to measure CMB polarization with unprecedented sensitivity, and their results will be scrutinized with correspondingly unprecedented rigor. “The detection of primordial B modes would transform our understanding of the early universe, so the measurement must survive rigorous calibration checks,” Keating said. “Anto has developed a useful new framework for testing relative polarization-angle calibration. This is ultimately about knowing when we can trust a measurement.” In a field where entire theories of the universe’s origin can hinge on angles measured to a fraction of a degree, that philosophy, trust but verify, and verify again with an independent method, may prove as important as any detector or telescope.

The broader lesson of the UC San Diego study is a familiar one in the history of science: extraordinary claims demand extraordinary scrutiny. Cosmic birefringence, if confirmed, would rank among the most consequential discoveries in modern physics, opening a new observational window onto dark matter, dark energy, and the fundamental laws that governed the universe’s first instants. But the same fractional-degree rotation that excites theorists can be manufactured by a slightly tilted detector, and the new differential calibration method offers a way to tell the two apart. By demonstrating that an independent estimator, built on different assumptions, agrees with the established Minami-Komatsu analysis when applied to Planck’s eight polarization maps, the researchers have strengthened the foundation on which future claims will rest. Whether the universe truly is twisted remains an open question, but thanks to this work, the answer will rest on firmer ground, and the next generation of CMB experiments will know precisely how much confidence to place in the ancient light they are measuring.

Subject of Research: A new differential polarization calibration method to test cosmic birefringence in the cosmic microwave background

Article Title: Is the universe twisted? A new check on a possible twist in the universe’s oldest light

Article References: Is the universe twisted? A new check on a possible twist in the universe’s oldest light. (n.d.). Original publication

Image Credits: AI Generated

DOI: Not provided

Keywords: cosmic microwave background, cosmic birefringence, polarization, calibration, Planck satellite, B modes, E modes, dark matter, dark energy, cosmic inflation, Simons Observatory, Standard Model