<?xml version="1.0" encoding="UTF-8"?><rss version="2.0"
	xmlns:content="http://purl.org/rss/1.0/modules/content/"
	xmlns:wfw="http://wellformedweb.org/CommentAPI/"
	xmlns:dc="http://purl.org/dc/elements/1.1/"
	xmlns:atom="http://www.w3.org/2005/Atom"
	xmlns:sy="http://purl.org/rss/1.0/modules/syndication/"
	xmlns:slash="http://purl.org/rss/1.0/modules/slash/"
	>

<channel>
	<title>safety and user preferences in AI &#8211; Science</title>
	<atom:link href="https://scienmag.com/tag/safety-and-user-preferences-in-ai/feed/" rel="self" type="application/rss+xml" />
	<link>https://scienmag.com</link>
	<description></description>
	<lastBuildDate>Wed, 21 Oct 2026 23:10:08 +0000</lastBuildDate>
	<language>en-US</language>
	<sy:updatePeriod>
	hourly	</sy:updatePeriod>
	<sy:updateFrequency>
	1	</sy:updateFrequency>
	<generator>https://wordpress.org/?v=7.1.3</generator>

<image>
	<url>https://scienmag.com/wp-content/uploads/2024/07/cropped-scienmag_ico-32x32.jpg</url>
	<title>safety and user preferences in AI &#8211; Science</title>
	<link>https://scienmag.com</link>
	<width>32</width>
	<height>32</height>
</image> 
<site xmlns="com-wordpress:feed-additions:1">73899611</site>	<item>
		<title>Review proposes explicit-intent framework for embodied AI</title>
		<link>https://scienmag.com/review-proposes-explicit-intent-framework-for-embodied-ai/</link>
		
		<dc:creator><![CDATA[Denise Maddox]]></dc:creator>
		<pubDate>Wed, 21 Oct 2026 23:10:08 +0000</pubDate>
				<category><![CDATA[Technology and Engineering]]></category>
		<category><![CDATA[AI knowledge integration]]></category>
		<category><![CDATA[AI safety]]></category>
		<category><![CDATA[AI task planning and decision-making]]></category>
		<category><![CDATA[Artificial Intelligence]]></category>
		<category><![CDATA[autonomous household robots]]></category>
		<category><![CDATA[autonomous vehicles]]></category>
		<category><![CDATA[drones]]></category>
		<category><![CDATA[embodied]]></category>
		<category><![CDATA[embodied AI]]></category>
		<category><![CDATA[environmental constraints in AI]]></category>
		<category><![CDATA[explicit-intent framework]]></category>
		<category><![CDATA[goal-oriented robotic systems]]></category>
		<category><![CDATA[Human-AI Interaction]]></category>
		<category><![CDATA[human-robot interaction]]></category>
		<category><![CDATA[IDEAI]]></category>
		<category><![CDATA[intent modeling]]></category>
		<category><![CDATA[intent representation in robotics]]></category>
		<category><![CDATA[NEEDS]]></category>
		<category><![CDATA[robotics]]></category>
		<category><![CDATA[safety and user preferences in AI]]></category>
		<category><![CDATA[task and purpose preservation]]></category>
		<category><![CDATA[value alignment]]></category>
		<category><![CDATA[world models]]></category>
		<guid isPermaLink="false">https://scienmag.com/?p=331037</guid>

					<description><![CDATA[A peer-reviewed review proposes IDEAI, a framework for representing, checking and revising the intent that guides embodied AI actions in changing environments.]]></description>
										<content:encoded><![CDATA[<p>A peer-reviewed review published online on August 6, 2026, proposes IDEAI, a framework intended to help embodied artificial intelligence systems preserve the purpose of their actions as tasks, conditions and requirements change. The system-level proposal links human goals, environmental constraints, knowledge and physical action through an explicit representation of intent. A household robot asked to prepare a banana milkshake illustrates the problem: understanding the instruction is not enough if the robot must choose ingredients and tools, construct a feasible sequence, respond to a missing item or broken appliance, and respect the user’s health, safety and preferences. The prompt identifies a task, but it may not specify the purpose, assumptions or limits that should govern each step.</p>
<p>The review, “Intent-Driven Embodied Artificial Intelligence,” was written by Nanning Zheng of the Institute of Artificial Intelligence and Robotics at Xi’an Jiaotong University and appeared in National Science Review. Zheng defines intent as a structured commitment that connects what a person wants, what the environment permits, what the system knows and what it ultimately does. This technical meaning is distinct from a task, target state, prompt or reward signal. A task states what should be done, whereas intent additionally records why it is being done, the assumptions involved, expected consequences, execution constraints and value boundaries. Under the proposed definition, intent can be inspected, revised and verified rather than remaining implicit in an instruction or hidden inside a policy.</p>
<p>Embodied AI broadly refers to systems that perceive, reason and act through continuing contact with the physical world, including autonomous vehicles, drones and other physically situated agents. Large language models, multimodal learning, reinforcement learning and vision–language–action models have improved performance in navigation, manipulation and interaction, according to the review. Many such systems nevertheless continue to depend on prompt-level instructions, predefined objectives or task-specific rewards. Those mechanisms can be effective when the goal is clear and the environment remains stable. In open settings, information may be incomplete, circumstances can change, and requirements may be revised while the system is acting. A local action can also succeed while the broader plan drifts from its original purpose, leaving an agent dependent on an assumption that no longer holds or pursuing an efficient solution that violates a physical, social or safety constraint.</p>
<p>IDEAI organizes the proposed approach around four interacting layers. Semantic grounding connects an instruction with actual ingredients, tools and available actions. Concept generation and learning provide reusable knowledge about objects, skills and their likely consequences. Intent modeling turns a broad request into commitments that can be divided into sub-intents and revised when necessary. Value alignment brings safety, legality, human preferences and ethical or social considerations into the process before a plan is chosen. The framework does not treat these functions as a one-way production line. Perception changes the concepts and plans available to the system, intent directs attention and action, and value alignment can rule particular plans in or out. Action then alters the environment and generates new evidence, which may require revisions to the agent’s knowledge, plan or intent.</p>
<p>With intent represented explicitly, an embodied system has a reference against which it can evaluate changing conditions. It can examine whether a plan still serves the original purpose, whether an instruction is ambiguous, or whether an important assumption has failed. It may then divide broad goals into sub-intents, pause an unsafe action, request clarification or replan in response to new information. The intent representation therefore functions as a check on task execution rather than as another instruction appended to the prompt. It preserves the connection between the reason for acting and the particular actions selected, making the proposed framework relevant when local optimization could undermine the broader objective.</p>
<p>To illustrate how the framework could be developed, Zheng groups existing research into seven technical pillars: intent capture and semantic modeling; human priors and intuitive reasoning; world models and contextualized planning; conflict detection and multi-agent coordination; bidirectional alignment and explainable interaction; safety boundaries and verifiability; and online learning and knowledge evolution. The review presents these pillars as a map of relevant handoffs rather than as specifications for a single completed architecture. They identify interfaces at which intent may be captured, misunderstood or distorted—for example, when a command is misread, an assumption proves false, commitments conflict, a plan becomes unsafe or knowledge becomes outdated. Because the proposal synthesizes existing research through a literature review, its principal theoretical contribution is organizational rather than the introduction of a new learning algorithm.</p>
<p>IDEAI is intended to connect several kinds of existing methods within that structure. The review identifies task graphs, goal-conditioned policies, hierarchical learning, world models, human feedback, safety barriers, runtime monitors and formal verification as components that may support the process. Their roles differ, but the framework gives them a shared question to address: whether the current plan continues to serve the commitment that motivated it. If an observation invalidates an assumption, a constraint becomes more important or a user changes a preference, the represented intent can support a plan revision, an interruption or a request for clarification. This arrangement is intended to keep commitments grounded, inspectable, value-constrained and open to revision from instruction through execution, rather than treating them as fixed properties of the initial prompt.</p>
<p>The review considers potential settings including domestic service robots, autonomous-driving systems, low-altitude drones, emergency-rescue swarms and heterogeneous robot teams for lunar construction. These are examples in which goals may not be fully specified in advance, plans unfold over time and mistakes can carry serious consequences. In such contexts, an explicit account of intent could help separate negotiable preferences from hard safety limits. It could also clarify when an agent should act independently, when it should ask for clarification and when human approval may be needed. The proposal does not claim that explicit intent is equally valuable in every application. Zheng notes that short, well-defined tasks, low-level motor control, stable environments, conventional feedback control or implicit objectives may be simpler and more effective when the surrounding conditions do not require a more elaborate structure.</p>
<p>The additional structure also carries costs and possible failure modes. An intent-based system requires memory and computation to preserve commitments over time. Errors in semantic grounding, concept formation or value judgment can propagate into later decisions. At the same time, intent must be stable enough to support a long plan without becoming so rigid that the system ignores new evidence. The balance between stability and adaptability remains an open problem. The review consequently positions IDEAI as most relevant when instructions are incomplete, decisions extend over time, agents must coordinate or mistakes can cause serious harm. Its value in any particular setting would have to be established through the development and evaluation of concrete systems rather than through the literature synthesis alone.</p>
<p>For embodied AI, completing a task is only part of the test. A robot may select the correct objects while disregarding the reason for its actions, and an autonomous vehicle may reach a destination after the relevant situation has changed and its original plan is no longer valid. IDEAI therefore shifts the design question from simply whether an agent finished a job toward whether it maintained the job’s purpose as circumstances evolved. Zheng summarizes the central argument as a requirement for embodied systems to track why they are acting, notice when assumptions no longer hold and adjust without crossing safety or value boundaries. The review offers a conceptual framework for that goal, while the robustness of its implementations and the balance between its computational demands and potential benefits remain questions for subsequent experimental and engineering work.</p>
<p><strong>Subject of Research:</strong> An intent-centered framework for embodied artificial intelligence</p>
<p><strong>Article Title:</strong> Why embodied AI needs to know what it’s doing—and why</p>
<p><strong>Article References:</strong> Why embodied AI needs to know what it’s doing—and why. <a href="https://www.eurekalert.org/news-releases/1145063" rel="noopener noreferrer">Original publication</a> (Bibliographic details unavailable.)</p>
<p><strong>Image Credits:</strong> AI Generated</p>
<p><strong>DOI:</strong> Not provided</p>
<p><strong>Keywords:</strong> embodied AI, robotics, artificial intelligence, intent modeling, AI safety, value alignment, human-robot interaction, autonomous vehicles, drones, world models, embodied, needs</p>
]]></content:encoded>
					
		
		
		<post-id xmlns="com-wordpress:feed-additions:1">331037</post-id>	</item>
	</channel>
</rss>
