<?xml version="1.0" encoding="UTF-8"?><rss version="2.0"
	xmlns:content="http://purl.org/rss/1.0/modules/content/"
	xmlns:wfw="http://wellformedweb.org/CommentAPI/"
	xmlns:dc="http://purl.org/dc/elements/1.1/"
	xmlns:atom="http://www.w3.org/2005/Atom"
	xmlns:sy="http://purl.org/rss/1.0/modules/syndication/"
	xmlns:slash="http://purl.org/rss/1.0/modules/slash/"
	>

<channel>
	<title>measurement-driven academic culture &#8211; Science</title>
	<atom:link href="https://scienmag.com/tag/measurement-driven-academic-culture/feed/" rel="self" type="application/rss+xml" />
	<link>https://scienmag.com</link>
	<description></description>
	<lastBuildDate>Sun, 06 Sep 2026 16:36:08 +0000</lastBuildDate>
	<language>en-US</language>
	<sy:updatePeriod>
	hourly	</sy:updatePeriod>
	<sy:updateFrequency>
	1	</sy:updateFrequency>
	<generator>https://wordpress.org/?v=7.1</generator>

<image>
	<url>https://scienmag.com/wp-content/uploads/2024/07/cropped-scienmag_ico-32x32.jpg</url>
	<title>measurement-driven academic culture &#8211; Science</title>
	<link>https://scienmag.com</link>
	<width>32</width>
	<height>32</height>
</image> 
<site xmlns="com-wordpress:feed-additions:1">73899611</site>	<item>
		<title>Quantifying science: how metrics drive modern academic culture</title>
		<link>https://scienmag.com/quantifying-science-how-metrics-drive-modern-academic-culture/</link>
		
		<dc:creator><![CDATA[Courtney Benton]]></dc:creator>
		<pubDate>Sun, 06 Sep 2026 16:36:05 +0000</pubDate>
				<category><![CDATA[Social Science]]></category>
		<category><![CDATA[Academic citation metrics]]></category>
		<category><![CDATA[academic publishing influence]]></category>
		<category><![CDATA[anthropology of academic assessment]]></category>
		<category><![CDATA[anthropology of research evaluation systems]]></category>
		<category><![CDATA[citation counting and h-index]]></category>
		<category><![CDATA[effects of quantitative metrics on scientific careers]]></category>
		<category><![CDATA[evaluation of research quality through metrics]]></category>
		<category><![CDATA[evaluation systems in higher education]]></category>
		<category><![CDATA[impact of indicator-based assessment on science]]></category>
		<category><![CDATA[impact of quantitative assessment on science]]></category>
		<category><![CDATA[influence of publication metrics on academic careers]]></category>
		<category><![CDATA[influence of ranking systems on research]]></category>
		<category><![CDATA[institutional research ranking influences]]></category>
		<category><![CDATA[institutional research rankings]]></category>
		<category><![CDATA[measurement and evaluation in scientific research]]></category>
		<category><![CDATA[measurement-driven academic culture]]></category>
		<category><![CDATA[normalization of scholarly output]]></category>
		<category><![CDATA[publication impact measurement]]></category>
		<category><![CDATA[Research evaluation metrics]]></category>
		<category><![CDATA[role of h-index in research evaluation]]></category>
		<category><![CDATA[role of indicators in research assessment]]></category>
		<category><![CDATA[scholarly communication evaluation]]></category>
		<category><![CDATA[scholarly communication metrics]]></category>
		<guid isPermaLink="false">https://scienmag.com/quantifying-science-how-metrics-drive-modern-academic-culture/</guid>

					<description><![CDATA[The way science is judged has become as consequential as the science itself, and two recent books examined in a new review in the journal Higher Education argue that the machinery of measurement now shapes nearly every facet of academic life. In a book review published in Higher Education, Yunfei Ma of the University of [&#8230;]]]></description>
										<content:encoded><![CDATA[<p>The way science is judged has become as consequential as the science itself, and two recent books examined in a new review in the journal Higher Education argue that the machinery of measurement now shapes nearly every facet of academic life. In a book review published in Higher Education, Yunfei Ma of the University of Oxford&#8217;s Department of Education assesses Emanuel Kulczycki&#8217;s &#8220;The Evaluation Game: How Publication Metrics Shape Scholarly Communication&#8221; (Cambridge University Press, 2023) alongside Cris Shore and Susan Wright&#8217;s &#8220;Audit Culture: How Indicators and Rankings are Reshaping the World&#8221; (Pluto Press, 2024). Together, the review suggests, these works map the technical and anthropological dimensions of a system in which numbers—from citation counts to institutional rankings—have become the currency through which knowledge, careers, and entire national research systems are governed.</p>
<p>At the technical heart of this system sits the h-index, introduced by physicist Jorge Hirsch in 2005 as a single-number summary of an individual&#8217;s scientific output. A researcher has an h-index of h if h of their papers have each been cited at least h times. The elegance of the formula is precisely what made it so seductive: it rewards both productivity and sustained citation impact while damping the influence of one or two runaway hits. But comparative studies have repeatedly shown that the same researcher can return strikingly different h-values depending on the database used to compute it, because Web of Science, Scopus, and Google Scholar differ enormously in their journal coverage and citation harvesting. Bar-Ilan&#8217;s classic comparison of the three databases demonstrated these discrepancies empirically, and later work by Singh and colleagues quantified just how divergent the coverage of Web of Science, Scopus, and Dimensions really is, with Scopus indexing far more contemporary journals while Web of Science remains more selective and historically skewed.</p>
<p>That unevenness matters because bibliometric indicators are rarely used as neutral descriptions. When hiring committees, funding agencies, and national assessment exercises rely on them, the databases&#8217; blind spots translate directly into institutional blind spots. Asubiaro, Onaolapo, and Mills documented regional disparities in Web of Science and Scopus coverage, showing that journals from the Global South are systematically underrepresented. Heleta and Mzileni&#8217;s analysis of South Africa&#8217;s accredited-journal indexes extends the argument, describing what they call bibliometric coloniality: the way citation infrastructures rooted in the Global North determine which knowledge is counted as legitimate science, and which is rendered invisible. Marginson and Xu&#8217;s work on hegemony and inequality in global science similarly challenges the center-periphery model, arguing that the dominance of a small cluster of wealthy, English-language publishing centers produces structural inequalities that metrics quietly naturalize.</p>
<p>Kulczycki&#8217;s book, as the review presents it, provides the conceptual scaffolding for understanding how this came to pass. Rather than treating publication metrics as passive measurements, he frames evaluation as a game with rules, players, and strategies. Scholars are not simply measured; they learn to play. They select journals for indexing prestige rather than audience, calibrate reference lists, and time submissions to optimize citation windows. The consequence, on this account, is that metrics do not merely reflect scholarly communication—they restructure it. The technical literature on citation impact indicators, most comprehensively synthesized in Waltman&#8217;s review in the Journal of Informetrics, has long acknowledged the statistical limitations of raw citation counts: field-normalization problems, length-of-citation-window biases, and the sensitivity of indicators to database cleaning decisions. What Kulczycki adds is the insight that these are not peripheral technicalities but the very levers through which the measurement system reshapes the behavior it claims to observe.</p>
<p>Shore and Wright&#8217;s contribution, building on two decades of anthropological work, widens the lens from individual indicators to what they call audit culture. Their intellectual lineage runs through Michael Power&#8217;s 1997 study of &#8220;the audit society,&#8221; in which rituals of verification proliferate because organizations must demonstrate trustworthiness symbolically rather than simply possess it. Shore himself had argued as early as 2008 that audit practices in universities amount to a form of illiberal governance: academics are ostensibly autonomous professionals, yet they are steered through performance targets, workload models, and publication counts rather than through direct commands. The new book extends this analysis beyond the university, tracing how indicators and rankings now govern hospitals, development agencies, and states. The underlying mechanism is consistent across domains—once a number becomes a target, it stops being a neutral measure and becomes an instrument of control.</p>
<p>The review situates both books within the broader political economy of higher education reform. Performance-based funding schemes, in which government allocations to universities depend on measured outputs, have spread globally, and Dougherty and Natow&#8217;s analysis in Higher Education found that neoliberal theory captures this practice only imperfectly: real-world schemes are shaped by political compromise, historical legacies, and bureaucratic negotiation, not just market logic. Similarly, Lynch&#8217;s account of &#8220;control by numbers&#8221; documents how new managerialism uses rankings and metrics to centralize authority within universities, shifting power from academic collegial bodies to administrative layers that interpret the numbers. Beerkens traces the evolution of performance data in higher education governance toward a &#8220;big data&#8221; era in which granular, real-time dashboards promise—or threaten—to make steering continuous rather than episodic. Madsen&#8217;s work on governing by numbers in social democratic contexts shows that even welfare-state higher education systems, ostensibly resistant to marketization, have adopted quantitative governance practices.</p>
<p>The faculty experience of this regime is documented in empirical work such as Vican, Friedman, and Andreasen&#8217;s study of competing logics in higher education, which found that academics experience metrics, money, and managerialism as conflicting demands on their professional identities. The h-index debate, summarized for librarians by Barnes, has moved from statistical quibbles to existential questions: if a single number can determine tenure, researchers rationally invest in citation-maximizing strategies rather than in slower, riskier, or more socially embedded forms of inquiry. The result, critics argue, is a systematic narrowing of research agendas toward topics, methods, and publication venues that generate countable output quickly.</p>
<p>Reform efforts have not been absent. The San Francisco Declaration on Research Assessment, issued in 2013, explicitly called on institutions to stop using journal-based metrics—most famously the journal impact factor—as a surrogate for the quality of individual research. The Leiden Manifesto, published in Nature in 2015 by Hicks, Wouters, Waltman, de Rijcke, and Rafols, set out ten principles for responsible metrics, including that indicators should be robust to gaming, transparent, and kept in their place as instruments serving research assessment rather than defining it. Both documents acknowledge the technical realities: citation indicators are statistically meaningful at the level of fields and aggregated units, but their variance at the level of individual researchers is far too high to bear the evaluative weight placed on them. Yet the review&#8217;s framing suggests that declarations have struggled to dislodge the underlying audit culture, because the problem is not merely methodological but political—indicators persist because they serve the governance needs of states, funders, and university administrations.</p>
<p>What emerges from reading the two books together, as Ma&#8217;s review makes clear, is a two-level picture. At one level are the technical artifacts: databases with uneven coverage, indices with known statistical pathologies, rankings with opaque weighting schemes. At another level is the cultural formation that Shore and Wright call audit culture, which explains why those artifacts acquire such coercive force. Xu&#8217;s work on epistemic diversity adds a further caution: cross-cultural comparative research shows that the very ontology of knowledge differs across traditions, meaning that a global metric regime built on one tradition&#8217;s publication and citation norms inevitably marginalizes others. Cameron&#8217;s old quip about informal sociology and Hare&#8217;s work on central planning haunt the discussion from opposite directions—both reminding readers that centrally planned systems, whether socialist or metric-based, generate characteristic pathologies of target-chasing and information distortion.</p>
<p>The stakes of this scholarship extend well beyond academia. Universities train the professionals who staff medicine, engineering, law, and public administration; if the incentive structures inside universities reward countable publication over genuine inquiry, those distortions propagate outward. The review&#8217;s quiet conclusion is that neither book offers a simple escape route, and neither claims to. Kulczycki&#8217;s evaluation game cannot simply be abandoned, because some form of assessment is unavoidable in systems that allocate public money; Shore and Wright&#8217;s audit culture cannot simply be opted out of, because verification demands are written into funding law. The realistic ambition, on both accounts, is to design indicators that are harder to game, to keep them subordinate to expert judgment, to diversify the databases and languages through which scholarship is recognized, and to restore spaces of academic work that are not continuously rendered as numbers. That the debate now spans bibliometrics, anthropology, sociology, and higher education policy is itself evidence of how thoroughly the machinery of measurement has penetrated the modern academy—and why understanding its gears has become a scientific problem in its own right.</p>
<div class="scienmag-article-metadata"><strong>Subject of Research:</strong> The role of publication metrics, audit culture, and quantitative indicators in shaping scholarly communication and university governance</p>
<p><strong>Article Title:</strong> Metrics, measures, and the machinery of modern academia</p>
<p><strong>Article References:</strong> Ma, Y. (2026). Metrics, measures, and the machinery of modern academia. <em>Higher Education</em>. <a href="https://doi.org/10.1007/s10734-026-01716-z" target="_blank" rel="noopener noreferrer">https://doi.org/10.1007/s10734-026-01716-z</a></p>
<p><strong>Image Credits:</strong> AI Generated</p>
<p><strong>DOI:</strong> <a href="https://doi.org/10.1007/s10734-026-01716-z" target="_blank" rel="noopener noreferrer">10.1007/s10734-026-01716-z</a></p>
<p><strong>Keywords:</strong> publication metrics, audit culture, h-index, university rankings, bibliometrics, research assessment, higher education governance, scholarly communication, performance-based funding, managerialism</p>
</div>
]]></content:encoded>
					
		
		
		<post-id xmlns="com-wordpress:feed-additions:1">188837</post-id>	</item>
	</channel>
</rss>
