<?xml version="1.0" encoding="UTF-8"?><rss version="2.0"
	xmlns:content="http://purl.org/rss/1.0/modules/content/"
	xmlns:wfw="http://wellformedweb.org/CommentAPI/"
	xmlns:dc="http://purl.org/dc/elements/1.1/"
	xmlns:atom="http://www.w3.org/2005/Atom"
	xmlns:sy="http://purl.org/rss/1.0/modules/syndication/"
	xmlns:slash="http://purl.org/rss/1.0/modules/slash/"
	>

<channel>
	<title>correspondence analysis &#8211; Science</title>
	<atom:link href="https://scienmag.com/tag/correspondence-analysis/feed/" rel="self" type="application/rss+xml" />
	<link>https://scienmag.com</link>
	<description></description>
	<lastBuildDate>Fri, 02 Oct 2026 09:35:50 +0000</lastBuildDate>
	<language>en-US</language>
	<sy:updatePeriod>
	hourly	</sy:updatePeriod>
	<sy:updateFrequency>
	1	</sy:updateFrequency>
	<generator>https://wordpress.org/?v=7.1.3</generator>

<image>
	<url>https://scienmag.com/wp-content/uploads/2024/07/cropped-scienmag_ico-32x32.jpg</url>
	<title>correspondence analysis &#8211; Science</title>
	<link>https://scienmag.com</link>
	<width>32</width>
	<height>32</height>
</image> 
<site xmlns="com-wordpress:feed-additions:1">73899611</site>	<item>
		<title>New Study Reveals the Best Way to Spot Outliers in Categorical Data</title>
		<link>https://scienmag.com/new-study-reveals-the-best-way-to-spot-outliers-in-categorical-data/</link>
		
		<dc:creator><![CDATA[Blake Davidson]]></dc:creator>
		<pubDate>Fri, 02 Oct 2026 09:35:50 +0000</pubDate>
				<category><![CDATA[Technology and Engineering]]></category>
		<category><![CDATA[anomaly detection]]></category>
		<category><![CDATA[anomaly detection algorithms for categorical attributes]]></category>
		<category><![CDATA[artificial intelligence techniques for outlier detection]]></category>
		<category><![CDATA[benchmark evaluation]]></category>
		<category><![CDATA[best practices for outlier detection in categorical variables]]></category>
		<category><![CDATA[categorical data]]></category>
		<category><![CDATA[CBRW]]></category>
		<category><![CDATA[challenges of outlier detection in non-numerical data]]></category>
		<category><![CDATA[correspondence analysis]]></category>
		<category><![CDATA[data conversion]]></category>
		<category><![CDATA[data mining]]></category>
		<category><![CDATA[identifying outliers in real-world datasets]]></category>
		<category><![CDATA[importance of detecting anomalies in categorical datasets]]></category>
		<category><![CDATA[isolation forest]]></category>
		<category><![CDATA[KNN-outlier]]></category>
		<category><![CDATA[large-scale study on categorical outlier detection]]></category>
		<category><![CDATA[limitations of traditional outlier detection methods]]></category>
		<category><![CDATA[Machine learning]]></category>
		<category><![CDATA[mixed data]]></category>
		<category><![CDATA[new research on categorical data analysis]]></category>
		<category><![CDATA[outlier detection]]></category>
		<category><![CDATA[outlier detection in categorical data]]></category>
		<category><![CDATA[outlier detection in healthcare and finance data]]></category>
		<category><![CDATA[systematic methods for categorical outlier detection]]></category>
		<guid isPermaLink="false">https://scienmag.com/?p=226927</guid>

					<description><![CDATA[A large-scale study from the University of São Paulo tested three strategies for detecting outliers in categorical and mixed data across 47 datasets and 14 algorithms, finding that native categorical detectors like CBRW usually win while a predictive model picks the best approach with 80 percent accuracy.]]></description>
										<content:encoded><![CDATA[<p>Outlier detection has become one of the quiet workhorses of the modern data economy. Every time a bank flags a suspicious transaction, a security system isolates an anomalous network event, or a quality-control pipeline catches a defective product, an algorithm is quietly deciding that a particular record does not belong. Yet a new large-scale study from the University of São Paulo suggests that for a huge class of real-world data, the field has been relying on guesswork. The research, published in Artificial Intelligence Review by Felippe Pires Ferreira and Robson L. F. Cordeiro of the Institute of Mathematics and Computer Sciences, offers the most systematic answer yet to a deceptively simple question: when your dataset contains categorical attributes, how should you actually detect the outliers?</p>
<p>The problem is more consequential than it might first appear. Most outlier detection algorithms were designed with numerical data in mind. They measure distances, densities, and deviations in spaces where every attribute is a number, and where concepts like proximity are mathematically straightforward. But real datasets are rarely so cooperative. Medical records contain diagnoses and blood types. Customer databases contain product categories, subscription tiers, and regions. Fraud datasets mix transaction amounts with merchant categories and card types. In these settings, the numerical machinery of classical anomaly detection either breaks down or silently distorts the data, and practitioners have been left to improvise without solid evidence about which improvisation works.</p>
<p>Ferreira and Cordeiro frame the field&#8217;s improvisations as three competing strategies. The first is to apply algorithms that can process categorical data directly, respecting the discrete nature of attributes such as color, brand, or diagnosis. The second is to convert categorical attributes into numerical ones before detection, transforming the data into a form that standard numerical detectors can consume. The third is the bluntest instrument: simply remove the categorical attributes and run detection on the numerical columns alone. Each strategy has intuitive appeal and intuitive drawbacks, but until now there has been no rigorous, large-scale comparison of how they actually perform across diverse datasets and detectors.</p>
<p>To settle the question, the researchers mounted an unusually comprehensive experimental campaign. They assembled 47 datasets and ran 14 different outlier detection algorithms across them, evaluating all three strategic approaches under controlled conditions. This scale matters. Many published comparisons in machine learning rest on a handful of benchmark datasets, which makes it dangerously easy to overfit conclusions to particular data quirks. By sweeping across dozens of datasets with varied characteristics, the study could distinguish between strategies that win consistently and strategies that win only under specific conditions, a distinction that turns out to be central to the paper&#8217;s findings.</p>
<p>The headline result is that the first strategy, applying algorithms that handle categorical data natively, is usually the preferred choice. And within that strategy, one detector stood out from the pack: CBRW, an algorithm that approaches categorical outliers through a weighted-graph perspective on attribute values. When datasets contain categorical attributes, the evidence indicates that reaching for a purpose-built categorical detector, particularly CBRW, is the most reliable default. This finding carries real practical weight, because it suggests that the common habit of forcing categorical data through numerical pipelines may often be an unnecessary detour that costs detection quality.</p>
<p>But the study resists the temptation of a one-size-fits-all verdict. The second strategy, converting categorical attributes into numbers before detection, proved superior in certain contexts, and the researchers found that which contexts depends on the characteristics of the data itself. Notably, when this conversion route was taken, detectors such as Isolation Forest, known as iForest, and KNN-outlier achieved better results in those favorable settings. Isolation Forest works by randomly partitioning the data and isolating records that are easy to separate from the rest, while KNN-outlier flags points that sit far from their nearest neighbors. Both are staples of the numerical anomaly detection toolkit, and the study shows they can still earn their keep on mixed data, provided the categorical-to-numerical conversion is done well.</p>
<p>That proviso led the authors to a second, finer-grained comparison: among the many techniques for converting categorical attributes into numerical representations, which one should practitioners choose? Here again the study produced a clear signal. Correspondence Analysis, a classical statistical method that maps categorical variables into a low-dimensional numerical space while preserving the associations between attribute values, often yielded the best detection results among the conversion approaches evaluated. For teams committed to running numerical detectors on mixed data, this finding offers a concrete, evidence-backed recommendation in place of an arbitrary choice of encoding technique.</p>
<p>Perhaps the most forward-looking contribution goes beyond ranking the strategies. Because the best approach depends on data characteristics, the researchers built a predictive model, a meta-level classifier trained on their experimental findings, that examines a new dataset and predicts which of the three strategies is most likely to perform best. The model achieves 80 percent accuracy in identifying the winning strategy. In a field where practitioners often have no principled basis for choosing an approach, an 80 percent reliable recommendation engine represents a meaningful step toward automated, data-driven method selection, analogous to the meta-learning systems that have begun to guide algorithm choice in supervised learning.</p>
<p>The study also delivers a quieter but equally important negative result: the third strategy, discarding categorical attributes altogether, does not emerge as a recommended path. Throwing away information is the kind of shortcut that survives in practice because it is easy, and part of the value of a systematic comparison is that it can retire such shortcuts with evidence. The findings collectively suggest that the information carried by categorical attributes is genuinely useful for anomaly detection, whether consumed directly by a categorical-aware algorithm or preserved through a careful numerical conversion such as Correspondence Analysis.</p>
<p>For the broader machine learning community, the significance of this work lies in its methodological honesty. Rather than crowning a single universal champion, it maps the conditions under which each strategy excels and then builds a bridge from those conditions to practical recommendations for new data. The authors have also committed fully to reproducibility: all code, detailed results, parameter values tested, and datasets used in the study are freely available for download on GitHub, allowing other researchers to scrutinize, extend, or challenge the conclusions. Supported in part by the Brazilian agency CAPES and published open access, the survey arrives as both a practical handbook for anyone deploying anomaly detection on messy real-world data and a benchmark against which future categorical outlier detection methods will now have to be measured. As fraud, cybersecurity, and data-quality applications continue to multiply across industries dominated by categorical information, the question this study answers is no longer an academic curiosity. It is an operational decision worth getting right, and for the first time, practitioners have a large-scale evidence base to guide it.</p>
<p><strong>Subject of Research:</strong> Comparative evaluation of outlier detection methods for categorical and mixed data</p>
<p><strong>Article Title:</strong> A comparative evaluation of outlier detection in categorical and mixed data</p>
<p><strong>Article References:</strong> Ferreira, F. P., &amp; Cordeiro, R. L. F. (2026). A comparative evaluation of outlier detection in categorical and mixed data. <em>Artificial Intelligence Review</em>. <a href="https://doi.org/10.1007/s10462-026-11687-3" rel="noopener noreferrer">https://doi.org/10.1007/s10462-026-11687-3</a></p>
<p><strong>Image Credits:</strong> AI Generated</p>
<p><strong>DOI:</strong> <a href="https://doi.org/10.1007/s10462-026-11687-3" rel="noopener noreferrer">10.1007/s10462-026-11687-3</a></p>
<p><strong>Keywords:</strong> outlier detection, categorical data, mixed data, anomaly detection, CBRW, Isolation Forest, KNN-outlier, Correspondence Analysis, data conversion, machine learning, data mining, benchmark evaluation</p>
]]></content:encoded>
					
		
		
		<post-id xmlns="com-wordpress:feed-additions:1">226927</post-id>	</item>
		<item>
		<title>How Kolkata&#8217;s Changing Urban Form Is Turning Everyday Heat Into a Health Hazard</title>
		<link>https://scienmag.com/how-kolkatas-changing-urban-form-is-turning-everyday-heat-into-a-health-hazard/</link>
		
		<dc:creator><![CDATA[Courtney Benton]]></dc:creator>
		<pubDate>Wed, 23 Sep 2026 21:05:00 +0000</pubDate>
				<category><![CDATA[Social Science]]></category>
		<category><![CDATA[city landscapes and thermal signatures]]></category>
		<category><![CDATA[climate change and urban development]]></category>
		<category><![CDATA[correspondence analysis]]></category>
		<category><![CDATA[effects of dense housing on temperature]]></category>
		<category><![CDATA[health hazards from urban heat]]></category>
		<category><![CDATA[heat stress]]></category>
		<category><![CDATA[impact of built environment on city heat]]></category>
		<category><![CDATA[Kolkata]]></category>
		<category><![CDATA[Kolkata urban transformation]]></category>
		<category><![CDATA[land surface temperature]]></category>
		<category><![CDATA[Local Climate Zone classification]]></category>
		<category><![CDATA[Local Climate Zones]]></category>
		<category><![CDATA[Public health]]></category>
		<category><![CDATA[remote sensing]]></category>
		<category><![CDATA[satellite mapping of urban heat]]></category>
		<category><![CDATA[sky view factor]]></category>
		<category><![CDATA[urban climate and public health]]></category>
		<category><![CDATA[urban greenery loss and heat increase]]></category>
		<category><![CDATA[urban heat island]]></category>
		<category><![CDATA[urban heat island effect]]></category>
		<category><![CDATA[urban morphology]]></category>
		<category><![CDATA[urban planning for heat mitigation]]></category>
		<category><![CDATA[Urbanization]]></category>
		<category><![CDATA[West Bengal]]></category>
		<guid isPermaLink="false">https://scienmag.com/?p=210289</guid>

					<description><![CDATA[A 13-year study of the Kolkata Metropolitan Area links rapid densification and vegetation loss to rising land surface temperatures and increasingly specific heat-related health complaints among residents.]]></description>
										<content:encoded><![CDATA[<p>Kolkata is getting hotter in a way that satellite maps alone can no longer fully explain. A new study of the Kolkata Metropolitan Area, published in Discover Cities, has tracked how the city&#8217;s built landscape transformed between 2010 and 2023, and then asked residents how that transformation actually feels in their bodies. The answer is sobering: as compact mid-rise apartment blocks and dense low-rise neighborhoods have swallowed gardens, wetlands, and farmland, the surface of the metropolis has warmed, and the health complaints of ordinary people have shifted from vague, generalized discomfort to sharply defined symptoms tied to specific kinds of urban fabric.</p>
<p>The research team, led by geographers at Adamas University in West Bengal, used the Local Climate Zone (LCZ) framework, a classification scheme introduced by urban climatologists Ian Stewart and Tim Oke in 2012. Instead of treating a city as a single hot mass, the LCZ scheme divides it into zones of uniform surface cover, structure, material, and human activity, spanning hundreds of meters to several kilometers. Compact high-rise districts, lightweight slum housing, heavy industry, dense tree cover, and low agricultural plants each form distinct zones with their own thermal signatures. This matters because the urban heat island effect, first noticed by Luke Howard in London in the 1810s, is not uniform: it is the product of street geometry, building height, impervious surfaces, and the slow disappearance of vegetation that shades and cools.</p>
<p>To map these zones, the researchers turned to the free Landsat satellite archive, downloading every available scene from 2010, 2015, 2020, and 2023 with less than ten percent cloud cover. Land surface temperature was retrieved using a single-channel algorithm for Landsat 5 and a split-window method for Landsat 8, both executed in Google Earth Engine. The LCZ classification itself was performed in the open-source SAGA-GIS platform using a supervised Random Forest classifier trained on carefully refined sample polygons drawn from high-resolution Google Earth imagery, following the WUDAPT Level 0 protocol. Landsat scenes were resampled from 30 meters to a 100-meter grid, the scale at which local urban structure is best represented, and majority filtering removed isolated pixels to produce morphologically coherent zones.</p>
<p>The classification proved robust. Kappa coefficients ranged from 0.8367 in 2010 to 0.8462 in 2023, with overall accuracy between 83 and 84 percent in every year. The team went further than most satellite studies by validating the maps on the ground: they captured fisheye photographs of the sky at breast height across six sampled locations, from the planned avenues of Kalyani to the congested lanes of the Kolkata Municipal Corporation area. By converting these images to black and white, separating sky pixels from building, road, and tree pixels, and computing the ratio of open sky to the full circular image, they derived Sky View Factors for each site. The measured values matched the documented morphology of the assigned LCZ classes, confirming that the satellite-derived zones reflect real street-canyon geometry, which governs how much solar radiation reaches the ground and how much longwave radiation escapes at night.</p>
<p>The temporal picture is stark. In 2010, building-type zones covered roughly 40 percent of the metropolitan area while vegetated zones held 53 percent. By 2020 the balance had tipped, with built forms at 52 percent and vegetation down to 41 percent. By 2023, built-up classes dominated at 66.37 percent of the total area, and vegetated classes had collapsed to just 12.45 percent. The city has not merely spread; it has compacted. Open high-rise and open mid-rise forms were converted into compact mid-rise (LCZ 2) and compact low-rise (LCZ 3) fabric, signaling both vertical growth and densification. Mean centers of the zone distributions reveal the direction of change: compact high-rise and mid-rise zones shifted southward toward Sonarpur Rajpur, where scarce land pushed developers toward gated high-rise apartments, while most other built classes expanded northward and northeastward into Barasat, Barrackpore, and Kamarhati, where open land remained. The southward retreat of dense trees, scattered trees, scrub, and low plants marks the loss of green and agricultural land in the north.</p>
<p>Land surface temperatures rose accordingly. The annual mean climbed from about 21.99 degrees Celsius in the late reference period to 23.25 degrees Celsius in 2023, and the Landsat retrievals correlated strongly (r = 0.80) with the MODIS Terra daily temperature product, lending independent credibility to the estimates. When the researchers computed heat island intensity, the difference between each built zone&#8217;s mean temperature and that of low plants (LCZ D), the rural reference, three classes stood out: lightweight low-rise (LCZ 7), large low-rise (LCZ 8), and heavy industry (LCZ 10). These zones, home to low-cost slum housing and the jute, textile, and chemical industries along the Hooghly River belt, consistently showed the strongest and most persistent surface heat island signatures across all four study years.</p>
<p>But temperatures on a map do not sweat. To capture the human dimension, the team surveyed 715 adults across 28 municipalities in March to May 2023, using stratified random sampling across all nine building-type LCZs. Every respondent reported at least one hour of daily outdoor sun exposure, divided into four bands from one to three hours up to ten to twelve hours. The questionnaire catalogued 28 heat-induced discomforts, from headaches and heavy sweating to dizziness, excessive thirst, blurred vision, skin rashes, back pain, muscle pain, and even seizures. Geocoding each residence and overlaying the points on the 100-meter LCZ map linked every report to a specific urban morphology. A heat map of relative frequencies showed that ten symptoms were moderate to highly frequent regardless of exposure time, with headache and heavy sweating dominant everywhere, and that the probability of nearly every discomfort rose steadily as hours in the sun increased.</p>
<p>The most technically innovative step was a correspondence analysis linking LCZ classes to reported symptoms for each exposure band, tested with chi-square statistics that were significant at p &lt; 0.001 for all four durations. The pattern changed with time. During one-to-three-hour exposure, the associations were noisy: lightweight low-rise zones and large low-rise zones appeared as outliers, and symptoms clustered loosely without clear zone-specific links. As exposure lengthened, the structure sharpened. Total inertia, a measure of how differentiated the zone-symptom relationships are, rose from 0.215 for short exposure to 0.584 for ten-to-twelve-hour exposure, while the first two dimensions explained up to 76.5 percent of the variance. By the longest exposure band, specific pairings emerged: heavy sweating with compact low-rise zones, heat stroke with compact high-rise, suffocation with compact high-rise and mid-rise, and headache and back pain with open mid-rise and heavy industrial zones. Prolonged heat, in other words, converts generalized misery into a predictable geography of illness.</p>
<p>The implications reach well beyond Kolkata. The findings align with LCZ studies in Hamburg, Nanjing, and central European cities showing that densification raises surface temperatures, but they add something most such studies lack: empirical, field-based evidence of who suffers and how. Because lightweight low-rise settlements and industrial belts combine the highest temperatures with some of the city&#8217;s most vulnerable residents, the study exposes a socio-spatial dimension of urban warming, where those least able to afford cooling bear the greatest thermal burden. The authors note that the zones shifting northward and northeastward, including open mid-rise, open low-rise, lightweight low-rise, and industrial classes, deserve priority planning attention, and they point to artificial intelligence, green infrastructure, and reflective surfaces as tools for predictive modeling and mitigation aligned with the Sustainable Development Goals on sustainable cities, climate action, and health.</p>
<p>What makes this research resonate is its refusal to separate climate science from lived experience. A city that loses two-fifths of its vegetation in thirteen years does not just warm statistically; its residents report more headaches, more dizziness, more thirst, and more dangerous symptoms as their hours outdoors lengthen. The lesson for rapidly urbanizing tropical cities is that urban form is health policy. Every compact mid-rise tower raised on a former wetland, every tree line cleared for a road, quietly rewrites the thermal contract between a city and the people who walk its streets, and the new study gives planners a framework, validated from orbit down to the fisheye lens, for reading that contract before it is signed.</p>
<p><strong>Subject of Research:</strong> Heat-induced health discomforts associated with changing local climate zones in the Kolkata Metropolitan Area, India</p>
<p><strong>Article Title:</strong> Understanding the heat-induced discomforts associated with changing local climate zones in indian cities</p>
<p><strong>Article References:</strong> Parial, M., Khorat, P., Mukherjee, K., Dash, P., Karmakar, S., Roy, A. D., Bhadra, T., Saha, A., &amp; Dhali, B. (2026). Understanding the heat-induced discomforts associated with changing local climate zones in indian cities. <em>Discover Cities, 3</em>(1), Article 190. <a href="https://doi.org/10.1007/s44327-026-00288-y" rel="noopener noreferrer">https://doi.org/10.1007/s44327-026-00288-y</a></p>
<p><strong>Image Credits:</strong> AI Generated</p>
<p><strong>DOI:</strong> <a href="https://doi.org/10.1007/s44327-026-00288-y" rel="noopener noreferrer">10.1007/s44327-026-00288-y</a></p>
<p><strong>Keywords:</strong> urban heat island, local climate zones, Kolkata, land surface temperature, remote sensing, sky view factor, urban morphology, heat stress, public health, correspondence analysis, urbanization, West Bengal</p>
]]></content:encoded>
					
		
		
		<post-id xmlns="com-wordpress:feed-additions:1">210289</post-id>	</item>
	</channel>
</rss>
