The economics of attention in agent systems
The scarce resource in agentic work is not only compute. It is the human attention needed to make consequential decisions, inspect evidence, and recover from uncertain work.
It is easy to measure the cost of an AI system in tokens, GPU time, tool calls, and cloud spend. Those numbers matter. They are not the whole cost.
Every agent task also consumes human attention. Someone frames the request, decides what authority to grant, reviews the meaningful changes, interprets uncertainty, and handles the exceptions. A system that produces many plausible outputs but demands constant reconstruction and review can be expensive even when its model bill is low.
The central design question is therefore not how to remove people from the loop. It is how to reserve human attention for the decisions that benefit from it.
Attention is allocated by risk
People should not spend the same amount of time reviewing a small wording change and a production database operation. The system can help by making consequence visible. Low-risk tasks can proceed with routine checks. Medium-risk tasks can collect evidence and ask for targeted review. High-risk tasks can require clearer approvals, narrower scope, and stronger recovery plans.
This approach is more useful than a single autonomy setting. "Autonomous" does not describe whether an agent is reading a document, changing a branch, sending a customer message, or touching a persistent record. A risk-shaped workflow does.
The better the runtime makes scope and evidence visible, the less attention a reviewer wastes on finding basic facts. They can spend their time on the judgment that cannot be reduced to a tool call: whether the tradeoff is acceptable, whether the data is representative, whether the task should proceed at all.
Cheap output can create expensive review
As models become faster and cheaper, they can generate more code, more drafts, more plans, and more candidate changes. This may look like pure leverage. It can also create a review backlog if the output is not bounded by a coherent task structure.
The remedy is not to slow the model down. It is to make the unit of work legible. An agent should work toward a specific objective, produce a scoped proposal, attach the evidence that supports it, and make remaining uncertainty explicit. This turns a large amount of model activity into a small number of decisions a person can actually make.
The distinction between activity and progress matters. A busy agent can create many artifacts; a useful agent reduces the amount of human effort needed to reach a responsible decision.
Budgets are behavioral tools
Compute budgets are often treated as billing controls. They can also improve behavior. A task with a defined budget is encouraged to gather useful evidence rather than retrying indefinitely. A tool-call limit can trigger a pause and a request for direction when the environment is behaving unexpectedly. A time budget can distinguish a quick repair from an investigation that needs a different owner.
These limits should not be hidden punishments. They should be visible parts of the task's operating context, alongside permissions and acceptance criteria. When a task approaches a budget, the runtime can preserve the current state and ask whether to continue, narrow scope, or hand the work to a person.
Attention creates an architecture requirement
Once human attention is treated as a finite resource, several product choices become clearer. The runtime should summarize consequential work before it asks for approval. It should attach evidence to the claim it supports rather than force a reviewer to search. It should keep the scope of a task narrow enough that a person can understand its boundary. It should preserve state on interruption so that review effort is not repeatedly spent reconstructing the same history.
These are not merely interface preferences. They determine whether a team can run several agent tasks at once without turning senior people into full-time interpreters of model output. An organization gains leverage only when the number of responsible decisions grows more slowly than the amount of useful work completed.
The balance will vary by domain. A research workflow may accept more exploration and ambiguity. A production change may need stronger evidence. A customer-facing action may need an explicit review even when the model has performed well in the past. The infrastructure should make those variations possible without requiring a new system for every level of risk.
The point of automation is better attention
The most valuable agentic systems will not be the ones that make the most noise or attempt the most autonomy. They will be the systems that turn routine, bounded work into well-supported proposals and give people back the attention needed for exploration, judgment, and collaboration.
That is a more demanding standard than simply reducing clicks. It asks infrastructure to understand the difference between a task that can proceed quietly and a decision that deserves a human being fully present.
Agent 系统中的注意力经济学
Agent 工作中稀缺的资源不只是计算,还包括人类用于做出有后果的决定、检查证据和恢复不确定工作的注意力。
人们很容易用 Token、GPU 时间、工具调用和云支出来衡量 AI 系统的成本。这些数字重要,却不是全部成本。
每个 Agent 任务也会消耗人的注意力。有人需要描述请求、决定授予什么权限、review 有意义的变更、理解不确定性并处理例外。一个产生大量看似合理的结果、却要求人不断重建上下文和 review 的系统,即使模型账单很低,也可能非常昂贵。
因此,核心设计问题不是如何把人从循环里移除,而是如何把人的注意力留给真正值得判断的决定。
注意力应该按风险分配
人不应该花同样的时间 review 一处小文案修改和一次生产数据库操作。系统可以通过让后果可见来帮助分配注意力。低风险任务可以执行例行检查,中风险任务可以收集证据并请求有针对性的 review,高风险任务可以要求更清晰的审批、更窄的范围和更强的恢复计划。
这比一个单一的自治设置更有用。“自治”并没有说明 Agent 是在读取文档、修改分支、发送客户消息,还是接触持久记录。按风险塑造的工作流才有这个信息。
运行时越能让范围和证据可见,reviewer 在寻找基本事实时浪费的注意力就越少。他们可以把时间用在不能被工具调用替代的判断上:权衡是否可接受、数据是否有代表性、任务是否应该继续。
便宜的输出会创造昂贵的 review
模型更快、更便宜之后,可以生成更多代码、草稿、计划和候选变更。这看起来像纯粹的杠杆,也可能在输出没有被连贯的任务结构约束时制造 review 积压。
解决办法不是让模型慢下来,而是让工作单元变得清楚。Agent 应该朝一个具体目标工作,产生范围明确的提案,附上支持它的证据,并把剩余不确定性说清楚。这样,大量模型活动会被转化成一个人真正能够做出的少数决定。
活动和进展不是一回事。忙碌的 Agent 可以产生大量产物;有用的 Agent 会减少人走到负责任决定所需的工作。
预算是行为工具
计算预算常常被当成计费控制,但它也能改善行为。有明确预算的任务,会更倾向于收集有用证据,而不是无限重试。工具调用上限可以在环境异常时触发暂停和求助。时间预算可以区分快速修复和需要另一位负责人介入的调查。
这些限制不应该是隐藏的惩罚,而应该和权限、验收标准一起成为任务运行上下文的可见部分。当任务接近预算时,运行时可以保存当前状态,并询问是继续、缩小范围,还是把工作交给人。
注意力会产生架构要求
当人类注意力被当成有限资源后,很多产品选择会变得清楚。运行时应该在请求审批前总结有后果的工作,把证据附在它支持的结论上,让任务范围足够窄,以便人理解边界,并在中断时保留状态,使 review 不需要反复重建同一段历史。
这些不只是界面偏好。它们决定一个团队能否同时运行多个 Agent 任务,而不把资深人员变成模型输出的全职翻译。只有当负责任的决定数量增长慢于完成的有用工作量时,组织才真正获得杠杆。
不同领域的平衡会不同。研究工作流可以接受更多探索和模糊;生产变更可能需要更强证据;面向客户的动作即使模型过去表现良好,也可能需要明确 review。基础设施应该支持这些差异,而不要求每种风险都建立一套新系统。
自动化的目的应该是更好的注意力
最有价值的 Agent 系统,不是最吵闹或尝试最多自治的系统,而是能把日常、有边界的工作变成证据充分的提案,并把探索、判断与合作所需的注意力还给人。
这比减少点击更加严格。它要求基础设施理解什么任务可以安静地继续,什么决定值得一个人完整地在场。