<?xml version="1.0" encoding="UTF-8"?><rss version="2.0"
	xmlns:content="http://purl.org/rss/1.0/modules/content/"
	xmlns:wfw="http://wellformedweb.org/CommentAPI/"
	xmlns:dc="http://purl.org/dc/elements/1.1/"
	xmlns:atom="http://www.w3.org/2005/Atom"
	xmlns:sy="http://purl.org/rss/1.0/modules/syndication/"
	xmlns:slash="http://purl.org/rss/1.0/modules/slash/"
	>

<channel>
	<title>AI risk management &#8211; Science</title>
	<atom:link href="https://scienmag.com/tag/ai-risk-management/feed/" rel="self" type="application/rss+xml" />
	<link>https://scienmag.com</link>
	<description></description>
	<lastBuildDate>Thu, 13 Aug 2026 01:59:30 +0000</lastBuildDate>
	<language>en-US</language>
	<sy:updatePeriod>
	hourly	</sy:updatePeriod>
	<sy:updateFrequency>
	1	</sy:updateFrequency>
	<generator>https://wordpress.org/?v=7.1.1</generator>

<image>
	<url>https://scienmag.com/wp-content/uploads/2024/07/cropped-scienmag_ico-32x32.jpg</url>
	<title>AI risk management &#8211; Science</title>
	<link>https://scienmag.com</link>
	<width>32</width>
	<height>32</height>
</image> 
<site xmlns="com-wordpress:feed-additions:1">73899611</site>	<item>
		<title>Agentic Profiles Could Strengthen AI Governance</title>
		<link>https://scienmag.com/agentic-profiles-could-strengthen-ai-governance/</link>
		
		<dc:creator><![CDATA[Courtney Benton]]></dc:creator>
		<pubDate>Thu, 13 Aug 2026 01:59:30 +0000</pubDate>
				<category><![CDATA[Technology and Engineering]]></category>
		<category><![CDATA[AI agent autonomy]]></category>
		<category><![CDATA[AI capabilities and safety]]></category>
		<category><![CDATA[AI decision-making frameworks]]></category>
		<category><![CDATA[AI goal complexity]]></category>
		<category><![CDATA[AI governance]]></category>
		<category><![CDATA[AI risk management]]></category>
		<category><![CDATA[AI safety regulation]]></category>
		<category><![CDATA[AI system generality]]></category>
		<category><![CDATA[governance challenges in AI evolution]]></category>
		<category><![CDATA[measuring AI efficacy]]></category>
		<category><![CDATA[oversight of autonomous agents]]></category>
		<category><![CDATA[regulation of AI agents]]></category>
		<guid isPermaLink="false">https://scienmag.com/agentic-profiles-could-strengthen-ai-governance/</guid>

					<description><![CDATA[Artificial intelligence is moving rapidly from systems that answer questions to agents that can pursue objectives, make decisions and act across digital environments. That shift is creating a governance problem that cannot be solved by measuring model performance alone, according to a new paper in Nature. Researchers Atoosa Kasirzadeh and Iason Gabriel propose a framework [&#8230;]]]></description>
										<content:encoded><![CDATA[<p>Artificial intelligence is moving rapidly from systems that answer questions to agents that can pursue objectives, make decisions and act across digital environments. That shift is creating a governance problem that cannot be solved by measuring model performance alone, according to a new paper in <em>Nature</em>. Researchers Atoosa Kasirzadeh and Iason Gabriel propose a framework for understanding AI agents through four connected dimensions: autonomy, efficacy, goal complexity and generality. Their central argument is that the word “agent” covers systems with radically different capabilities, risks and oversight needs—and that treating them as one category could leave major gaps in regulation and public safety.</p>
<p>The first dimension, autonomy, describes how independently an AI system can operate. A low-autonomy assistant may generate a draft, recommend an action or wait for a human command before doing anything further. A more autonomous agent may break a broad instruction into subtasks, select tools, execute actions and adapt its behaviour based on changing conditions. At the highest levels, an agent could pursue a goal over extended periods with limited human intervention. Technically, this may involve planning loops, memory systems, tool access, environmental feedback and the ability to revise a sequence of actions. Each additional layer of independence changes the governance challenge, because oversight must move from checking individual outputs to monitoring an ongoing process.</p>
<p>Efficacy is the second dimension and refers to an agent’s ability to achieve intended outcomes in the world. A system can be highly autonomous yet ineffective, repeatedly taking actions without producing useful results. Conversely, an agent with modest independence may be extremely effective within a narrow domain, such as scheduling resources, analyzing specialized data or controlling a well-defined industrial process. Efficacy depends on more than language fluency. It can be shaped by access to reliable information, the quality of an agent’s planning and reasoning, its ability to use external software, the accuracy of its internal representations and the consequences of errors. As efficacy rises, failures may become less frequent—but successful actions can also create greater impact when the system is operating without close supervision.</p>
<p>The third dimension, goal complexity, concerns the structure of the objectives an AI agent is asked to pursue. Simple goals may involve a single, clearly defined task with an obvious completion condition. Complex goals can require an agent to balance competing priorities, interpret ambiguous instructions, coordinate multiple steps and respond to unexpected events. A request such as “find the best available option” may conceal questions about cost, reliability, fairness, timing, privacy and risk. For an AI system, translating such a request into operational decisions is not merely a matter of generating text. It requires selecting subgoals, assigning priorities and determining when a result is good enough. Governance must therefore address how goals are specified, who has authority to define them and how conflicts between objectives are resolved.</p>
<p>Generality forms the fourth axis. Narrow agents are designed for a limited task, environment or professional setting, where developers can test performance against a relatively stable set of conditions. General-purpose agents are intended to function across many domains, potentially moving between research, administration, programming, education and other activities. Greater generality can make systems more useful, but it also expands the range of situations in which their behaviour may be difficult to predict. A narrow system may be evaluated using domain-specific benchmarks and safety checks. A general system requires broader testing, because risks can emerge from combinations of capabilities that were not present in any single training example or evaluation scenario.</p>
<p>Together, the four dimensions produce what the authors call “agentic profiles.” Rather than asking whether a system is simply an AI agent, the framework asks what kind of agent it is and how its properties interact. A task-specific assistant might have low autonomy, moderate efficacy, simple goals and limited generality. An enterprise system that can access databases, coordinate workflows and act on behalf of employees could occupy a different profile, with higher efficacy and goal complexity. A highly autonomous, general-purpose agent would sit at the most demanding end of several axes, raising questions about supervision, accountability, security and control. The profiles are not intended as rigid labels; they are maps for comparing systems that may look similar on the surface but have very different real-world implications.</p>
<p>This approach also highlights why governance cannot rely on one universal safety measure. An autonomous agent with access to financial systems presents different concerns from a highly effective but closely supervised scientific assistant. A system with complex goals may require mechanisms for clarifying instructions, exposing intermediate plans and detecting conflicts between objectives. A general-purpose agent may need continuous monitoring across contexts rather than a one-time certification. Technical safeguards could include permission boundaries, sandboxed tool use, audit logs, human approval checkpoints, uncertainty reporting and emergency shutdown procedures. But the paper’s framework also points beyond engineering: organizations must determine who is responsible when an agent causes harm, how affected people can challenge decisions and what forms of deployment should require public oversight.</p>
<p>The researchers’ proposal arrives as AI developers increasingly describe their products as capable of acting rather than merely responding. Modern agents can combine large language models with retrieval systems, code execution, web browsing, APIs and persistent memory. In a typical control loop, the model receives an objective, observes information from its environment, generates a plan, invokes tools, evaluates results and repeats the process. This architecture can turn a probabilistic text generator into a system with practical influence over external events. The same loop that allows an agent to complete useful multi-step work can also amplify a mistaken assumption, an ambiguous instruction or a malicious input. Understanding an agent’s profile therefore becomes essential before deciding how much access, authority and autonomy it should receive.</p>
<p>The paper presents agentic profiles as a common language for developers, policymakers and the public at a moment when the boundaries between software and decision-maker are becoming increasingly blurred. The framework does not claim that every risk can be predicted from four dimensions, nor does it replace detailed technical evaluation. Its value lies in making differences visible: two systems may both be marketed as assistants, while one only suggests actions and the other executes them; two may be equally capable, while one operates in a narrow environment and the other generalizes across domains. By mapping autonomy, efficacy, goal complexity and generality, the authors argue, society can design governance mechanisms that match the actual power of an AI agent—before usefulness, scale and independence outpace accountability.</p>
<p><strong>Subject of Research</strong>: AI agent capabilities and governance</p>
<p><strong>Article Title</strong>: Agentic profiles for effective AI governance</p>
<p><strong>Article References</strong>: Kasirzadeh, A., Gabriel, I. Agentic profiles for effective AI governance. <i>Nature</i> <b>656</b>, 320–328 (2026). <a href="https://doi.org/10.1038/s41586-026-10805-z">https://doi.org/10.1038/s41586-026-10805-z</a></p>
<p><strong>Image Credits</strong>: AI Generated</p>
<p><strong>DOI</strong>: 10.1038/s41586-026-10805-z</p>
<p><strong>Keywords</strong>: artificial intelligence, AI agents, AI governance, autonomy, efficacy, goal complexity, generality, agentic profiles, AI safety, regulation</p>
]]></content:encoded>
					
		
		
		<post-id xmlns="com-wordpress:feed-additions:1">178814</post-id>	</item>
		<item>
		<title>Current AI Risks Pose Greater Threat Than Apocalyptic Future Scenarios</title>
		<link>https://scienmag.com/current-ai-risks-pose-greater-threat-than-apocalyptic-future-scenarios/</link>
		
		<dc:creator><![CDATA[Blake Davidson]]></dc:creator>
		<pubDate>Wed, 23 Apr 2025 08:10:14 +0000</pubDate>
				<category><![CDATA[Social Science]]></category>
		<category><![CDATA[AI risk management]]></category>
		<category><![CDATA[algorithmic bias concerns]]></category>
		<category><![CDATA[dystopian AI narratives]]></category>
		<category><![CDATA[empirical research on AI threats]]></category>
		<category><![CDATA[immediate AI threats]]></category>
		<category><![CDATA[labor market disruptions due to AI]]></category>
		<category><![CDATA[long-term versus short-term AI risks]]></category>
		<category><![CDATA[misinformation and AI]]></category>
		<category><![CDATA[privacy erosion from technology]]></category>
		<category><![CDATA[public perception of AI dangers]]></category>
		<category><![CDATA[societal challenges of artificial intelligence]]></category>
		<category><![CDATA[University of Zurich AI study]]></category>
		<guid isPermaLink="false">https://scienmag.com/current-ai-risks-pose-greater-threat-than-apocalyptic-future-scenarios/</guid>

					<description><![CDATA[In a rapidly evolving technological landscape, artificial intelligence (AI) continues to spark widespread debate about its potential threats and benefits. While some have focused heavily on dystopian visions of AI triggering the extinction of humanity in the distant future, new empirical research challenges the notion that such speculative fears dominate public concern. A comprehensive study [&#8230;]]]></description>
										<content:encoded><![CDATA[<p>In a rapidly evolving technological landscape, artificial intelligence (AI) continues to spark widespread debate about its potential threats and benefits. While some have focused heavily on dystopian visions of AI triggering the extinction of humanity in the distant future, new empirical research challenges the notion that such speculative fears dominate public concern. A comprehensive study conducted by political scientists at the University of Zurich reveals that people are in fact far more apprehensive about immediate and tangible risks posed by AI technologies than about abstract, apocalyptic scenarios. This insight reshapes the narrative around AI risks, emphasizing the need to address current societal challenges alongside ongoing conversations about long-term existential dangers.</p>
<p>The study’s importance stems from the persistent tension in public discourse between sensational, far-future AI risk narratives and the very real, present-day problems that AI systems already cause. While existential risks – scenarios in which AI could hypothetically threaten humanity’s survival – often capture media attention and public imagination, they may inadvertently overshadow or distract from more pressing issues such as algorithmic bias, misinformation, privacy erosion, and labor market disruptions. The University of Zurich’s research offers the first large-scale, systematic data to empirically examine how framing AI risks influences public perception and concern.</p>
<p>To explore these dynamics, the research team undertook a series of three large-scale online experimental surveys involving more than 10,000 participants from the United States and the United Kingdom. These experimental designs exposed participants to varying narratives about AI: some read headlines emphasizing catastrophic, long-term threats to humanity; others encountered information focused exclusively on immediate concerns such as social discrimination, misinformation, and workforce impacts; while a control group viewed content highlighting the advantages and potential benefits of AI technologies. By comparing these groups’ responses, the researchers aimed to determine whether alarmist framing about existential risks diminishes public engagement with or awareness of more proximate problems.</p>
<p>A striking outcome from the experiments showed that individuals consistently expressed considerably greater concern about present-day AI-related harms compared to distant, theoretical catastrophes. Professor Fabrizio Gilardi of the University of Zurich’s Department of Political Science explains, “Our data highlight that people acknowledge the urgency of current risks like systemic bias encoded within AI algorithms and AI-driven job displacement. Even when confronted with apocalyptic warnings, their worry about these immediate problems remains substantially more pronounced.” This finding contradicts the criticism that emphasizing speculative future risks distracts from or undermines addressing urgent societal issues stemming from AI.</p>
<p>Notably, the study also reveals that people are capable of making nuanced distinctions between abstract, long-term existential threats and concrete, existing harms. Importantly, respondents did not exhibit a binary or mutually exclusive understanding of AI’s risks. Instead, they simultaneously recognized and took seriously the multifaceted challenges AI presents, both today and potentially tomorrow. This suggests that public concern should not be simplified or forced into an “either-or” framing when it comes to AI risk discourse.</p>
<p>The implications for the broader field of AI ethics, policy, and governance are significant. Historically, discussions of AI risk have often been polarized, with some arguing for urgent preventive measures solely against far-future scenarios, while others advocate focusing exclusively on mitigating current harms. The University of Zurich study encourages moving beyond this dichotomy by fostering a holistic approach that concurrently addresses immediate issues—such as bias amplification in automated decision-making systems and misinformation propagation—as well as invests in long-term research and safeguards against catastrophic risks.</p>
<p>This dual-perspective approach is especially crucial in times when AI technologies are increasingly embedded into key societal infrastructures. For example, facial recognition systems used in law enforcement can perpetuate racial and gender biases, leading to unjust outcomes. Social media algorithms powered by AI can exacerbate the spread of false information, influencing public opinion and democratic processes. Meanwhile, automation threatens to disrupt labor markets by making certain jobs obsolete, fueling economic and social uncertainty. Acknowledging these urgent challenges underscores the necessity of regulatory frameworks and oversight mechanisms tailored to present realities.</p>
<p>Moreover, the study’s nuanced findings provide valuable guidance for science communicators, policymakers, and AI developers aiming to engage the public effectively. Sensationalized warnings about an AI apocalypse, while attention-grabbing, should be balanced with clear communication about tangible harms and practical mitigation strategies to maintain public trust and foster constructive dialogue. As co-author Emma Hoes points out, “Public discourse should not be dominated by fear of the unknown but enriched with awareness of the concrete harms AI already causes, as well as the benefits it offers.”</p>
<p>Scientific literature had long speculated on the psychological effects of risk framing and media portrayal on public risk perception, but reliable empirical data in the context of AI risk narratives were scarce until now. This study fills that significant knowledge gap by demonstrating that existential risk narratives do not inherently suppress concern for immediate AI-related problems. Instead, awareness of both risk categories coexists robustly in the public mind, affirming the capacity for complex risk understanding among diverse populations.</p>
<p>The research team’s methodical approach, leveraging randomized exposure to different narrative framings, sets a new standard in studying perceptions around emerging technologies. This methodology can be applied to future investigations on risk communication strategies in other contentious technological domains. As debates unfold around AI-powered innovations like autonomous vehicles, medical diagnostics, and predictive policing, understanding how framing influences public caution and acceptance will be increasingly crucial.</p>
<p>While the study’s insights help to recalibrate the conversation on AI risk, they also call attention to the peril of complacency. The unmistakable fact that current AI risks command greater worry compels urgent policy responses and technological interventions. Regulatory bodies must prioritize transparency, accountability, and fairness in AI systems while ensuring that research into existential risks continues to receive due attention and funding.</p>
<p>In summary, the University of Zurich’s groundbreaking research reconciles two often competing perspectives within AI risk discourse. By establishing that neither present harms nor future dangers dominate or undermine the other in public concern, it underscores the importance of an integrative dialogue that encompasses the full spectrum of AI’s societal impact. Through precision in communication and policymaking, society can better navigate the complex landscape of artificial intelligence, harnessing its promise while safeguarding against its pitfalls.</p>
<hr />
<p><strong>Subject of Research</strong>: People</p>
<p><strong>Article Title</strong>: Existential Risk Narratives About Artificial Intelligence Do Not Distract From Its Immediate Harms</p>
<p><strong>News Publication Date</strong>: 17-Apr-2025</p>
<p><strong>Web References</strong>: <a href="http://dx.doi.org/10.1073/pnas.2419055122">10.1073/pnas.2419055122</a></p>
<p><strong>References</strong>: Emma Hoes, Fabrizio Gilardi. Existential Risk Narratives About Artificial Intelligence Do Not Distract From Its Immediate Harms. Proceedings of the National Academy of Sciences. April 17, 2025.</p>
<p><strong>Keywords</strong>: Artificial intelligence, Fear, Risk perception, Social psychology, Human social behavior, Society</p>
]]></content:encoded>
					
		
		
		<post-id xmlns="com-wordpress:feed-additions:1">38490</post-id>	</item>
	</channel>
</rss>
