跳到正文
RCreddit.com·

Are enterprise AI agents actually ready for production?

AI 摘要

企业AI代理的生产就绪性是一个复杂的问题,许多试点项目未能成功上线。据估计,88%到~95%的代理试点项目从未投入生产,这并非因为模型本身不够智能,而是由于对“生产就绪”的理解框架存在偏差。代理的就绪状态并非二元的,而是指其在特定限制和防护措施内,能够胜任具体、有边界的工作,并且在涉及昂贵或不可逆操作时,需要有人工干预。因此,关键在于评估代理在特定限制下完成某项任务的准备程度,而非笼统地询问代理是否已准备就绪。

时间与来源
发布
2026年9月7日 09:33
来源类型
开发者社区
档位
社区
信源状态
正常
档位是按信源手工设定的编辑判断,不是逐条打分。

时间以 UTC 显示

更多信息
首次发现2026年9月7日 14:00时区UTC · UTC+0
正文

I've spent the last couple of years helping teams drag agents from "wow, great demo" to something that survives contact with real users, and I've come around to thinking "ready for production" is just the wrong frame. An agent isn't ready or not-ready the way a database is up or down. It's ready for a specific, bounded job, inside guardrails, with a human somewhere in the loop for anything expensive or irreversible. Ask "is this agent ready to do X within these limits" and you can actually answer it. Ask "are agents ready" and you get a hype cycle.

The stat everyone throws around is that most agent pilots never ship. I've seen 88% quoted most often; some sources push it to ~95%. Pick your number, the direction's the same. And it's almost never because the model is dumb.

The demo runs on a clean slice of data somebody hand-picked, one tidy prompt, a task with an obvious finish line. Production is the opposite - duplicate customer records, a permissions model nobody documented, three systems that spell the same field three different ways, and a task that runs forty minutes across six tools instead of one clean exchange.

The thing that actually kills these in production is non-determinism, and specifically that you can't tell in advance when the agent is going to be confidently wrong. A normal system fails loudly. An agent fails quietly, sounds completely sure of itself, and does it in a way your test suite never anticipated.

I've watched agents score 95%+ on internal evals and then bleed money in week one because a tool timed out mid-loop and the agent just., improvised its way around it. Something like a third of catalogued production incidents trace back to a tool failure the agent didn't handle gracefully. Golden-path tests don't catch that, because the golden path assumes the tools work.

The teams who do get to production mostly look the same. A few patterns I'd bet on:

- They treat evaluation and observability as infrastructure, not an afterthought. If you can't trace every tool call and decision step, you're flying blind and you won't know it's broken until the business impact already landed.

- Reliability comes from deterministic guardrails and modular design, not better prompting. Keep the LLM on intent and language understanding; route anything that needs to be exact (money, queries, state changes) to typed, testable code.

- Human-in-the-loop on high-stakes actions, with real approval gates. Not because the model's useless, but because "confidently wrong and irreversible" is the failure mode that ends the program.

- Narrow scope. The single-agent-does-everything build gets exponentially harder to debug. Decompose early.

Where it's genuinely working right now: customer support triage, SDR/outbound, internal ops and knowledge retrieval, coding assistance. Banking and insurance are further along than most (they already live and breathe audit trails), while healthcare and public sector lag - which tells you the bottleneck is governance and data, not intelligence.

So: ready? For a scoped, observable, guardrailed workflow with an owner and a rollback plan - yeah, and plenty are already in production earning their keep. As a drop-in autonomous employee you point at your messiest process and walk away - not close, and I'd be skeptical of anyone selling that.

Curious what everyone else is seeing. For those of you who got something to prod - what actually broke first when real traffic hit it?

来源·reddit.com·RSS 全文